Class Tokenizer


  • public final class Tokenizer
    extends Object
    A utility class providing methods capable of splitting String entries into an array of tokens based on either default or custom token delimiters.
    Author:
    Marek Potociar
    • Field Summary

      Fields 
      Modifier and Type Field Description
      static String COMMON_DELIMITERS
      Common Jersey delimiters used by various properties.
    • Method Summary

      All Methods Static Methods Concrete Methods 
      Modifier and Type Method Description
      static String[] tokenize​(String entry)
      Get a canonical array of tokens from a String entry that may contain zero or more tokens separated by common delimiters " ,;\n".
      static String[] tokenize​(String[] entries)
      Get a canonical array of tokens from an array of String entries where each entry may contain zero or more tokens separated by common delimiters " ,;\n".
      static String[] tokenize​(String[] entries, String delimiters)
      Get a canonical array of tokens from an array of String entries where each entry may contain zero or more tokens separated by characters in delimiters string.
      static String[] tokenize​(String entry, String delimiters)
      Get a canonical array of tokens from a String entry that may contain zero or more tokens separated by characters in delimiters string.
    • Field Detail

      • COMMON_DELIMITERS

        public static final String COMMON_DELIMITERS
        Common Jersey delimiters used by various properties.
        See Also:
        Constant Field Values
    • Method Detail

      • tokenize

        public static String[] tokenize​(String[] entries)
        Get a canonical array of tokens from an array of String entries where each entry may contain zero or more tokens separated by common delimiters " ,;\n".
        Parameters:
        entries - an array where each String entry may contain zero or more common delimiters separated tokens.
        Returns:
        the array of tokens, each token is trimmed, the array will not contain any empty or null entries.
      • tokenize

        public static String[] tokenize​(String[] entries,
                                        String delimiters)
        Get a canonical array of tokens from an array of String entries where each entry may contain zero or more tokens separated by characters in delimiters string.
        Parameters:
        entries - an array where each String entry may contain zero or more delimiters separated tokens.
        delimiters - string with delimiters, every character represents one delimiter.
        Returns:
        the array of tokens, each token is trimmed, the array will not contain any empty or null entries.
      • tokenize

        public static String[] tokenize​(String entry)
        Get a canonical array of tokens from a String entry that may contain zero or more tokens separated by common delimiters " ,;\n".
        Parameters:
        entry - a String that may contain zero or more common delimiters separated tokens.
        Returns:
        the array of tokens, each tokens is trimmed, the array will not contain any empty or null entries.
      • tokenize

        public static String[] tokenize​(String entry,
                                        String delimiters)
        Get a canonical array of tokens from a String entry that may contain zero or more tokens separated by characters in delimiters string.
        Parameters:
        entry - a String that may contain zero or more delimiters separated tokens.
        delimiters - string with delimiters, every character represents one delimiter.
        Returns:
        the array of tokens, each tokens is trimmed, the array will not contain any empty or null entries.