Package com.yahoo.language.process
Enum TokenType
- java.lang.Object
-
- java.lang.Enum<TokenType>
-
- com.yahoo.language.process.TokenType
-
- All Implemented Interfaces:
java.io.Serializable
,java.lang.Comparable<TokenType>
public enum TokenType extends java.lang.Enum<TokenType>
An enumeration of token types.- Author:
- Mathias Mølster Lidal
-
-
Enum Constant Summary
Enum Constants Enum Constant Description ALPHABETIC
MARKER
NUMERIC
PUNCTUATION
SPACE
SYMBOL
UNKNOWN
-
Method Summary
All Methods Static Methods Instance Methods Concrete Methods Modifier and Type Method Description int
getValue()
Returns an int code for this typeboolean
isIndexable()
Marker for whether this type of token can be indexed for search.static TokenType
valueOf(int value)
Translates this from the int code representation returned fromgetValue()
static TokenType
valueOf(java.lang.String name)
Returns the enum constant of this type with the specified name.static TokenType[]
values()
Returns an array containing the constants of this enum type, in the order they are declared.
-
-
-
Enum Constant Detail
-
UNKNOWN
public static final TokenType UNKNOWN
-
SPACE
public static final TokenType SPACE
-
PUNCTUATION
public static final TokenType PUNCTUATION
-
SYMBOL
public static final TokenType SYMBOL
-
ALPHABETIC
public static final TokenType ALPHABETIC
-
NUMERIC
public static final TokenType NUMERIC
-
MARKER
public static final TokenType MARKER
-
-
Method Detail
-
values
public static TokenType[] values()
Returns an array containing the constants of this enum type, in the order they are declared. This method may be used to iterate over the constants as follows:for (TokenType c : TokenType.values()) System.out.println(c);
- Returns:
- an array containing the constants of this enum type, in the order they are declared
-
valueOf
public static TokenType valueOf(java.lang.String name)
Returns the enum constant of this type with the specified name. The string must match exactly an identifier used to declare an enum constant in this type. (Extraneous whitespace characters are not permitted.)- Parameters:
name
- the name of the enum constant to be returned.- Returns:
- the enum constant with the specified name
- Throws:
java.lang.IllegalArgumentException
- if this enum type has no constant with the specified namejava.lang.NullPointerException
- if the argument is null
-
getValue
public int getValue()
Returns an int code for this type
-
isIndexable
public boolean isIndexable()
Marker for whether this type of token can be indexed for search. Note that a Token can be excluded from an index, even though the token type marks it as indexable.- Returns:
- whether this type of token can be indexed
- See Also:
Token.isIndexable()
-
valueOf
public static TokenType valueOf(int value)
Translates this from the int code representation returned fromgetValue()
-
-