Package com.yahoo.language.process

Enum Class TokenType

java.lang.Object
java.lang.Enum<TokenType>
com.yahoo.language.process.TokenType
All Implemented Interfaces:
Serializable, Comparable<TokenType>, Constable
public enum TokenType extends Enum<TokenType>
An enumeration of token types.
Author:
Mathias Mølster Lidal

  • Enum Constant Details

    • UNKNOWN

      public static final TokenType UNKNOWN

    • SPACE

      public static final TokenType SPACE

    • PUNCTUATION

      public static final TokenType PUNCTUATION

    • SYMBOL

      public static final TokenType SYMBOL

    • ALPHABETIC

      public static final TokenType ALPHABETIC

    • NUMERIC

      public static final TokenType NUMERIC

    • INDEXABLE_SYMBOL

      public static final TokenType INDEXABLE_SYMBOL

    • MARKER

      public static final TokenType MARKER

  • Method Details

    • values

      public static TokenType[] values()
      Returns an array containing the constants of this enum class, in the order they are declared.
      Returns:
      an array containing the constants of this enum class, in the order they are declared

    • valueOf

      public static TokenType valueOf(String name)
      Returns the enum constant of this class with the specified name. The string must match exactly an identifier used to declare an enum constant in this class. (Extraneous whitespace characters are not permitted.)
      Parameters:
      name - the name of the enum constant to be returned.
      Returns:
      the enum constant with the specified name
      Throws:
      IllegalArgumentException - if this enum class has no constant with the specified name
      NullPointerException - if the argument is null

    • getValue

      public int getValue()
      Returns an int code for this type

    • isIndexable

      public boolean isIndexable()
      Marker for whether this type of token can be indexed for search. Note that a Token can be excluded from an index, even though the token type marks it as indexable.
      Returns:
      whether this type of token can be indexed
      See Also:

    • valueOf

      public static TokenType valueOf(int value)
      Translates this from the int code representation returned from getValue()