Extends the value of the specified property to include a new symbol.
Extends the value of the specified property to include a new symbol.
This symbol is added to the current set of symbols that the property maps to.
desired property to extend
new symbol to add to the specified property's value
a token for which the specified property's value is extended with the specified value
For singleton properties (i.e.
For singleton properties (i.e. the value is a singleton set), this returns the single symbol in that set.
For undefined properties, a reserved Token.propertyNotFound symbol is returned.
An exception is thrown if the specified property is associated with a non-singleton set.
the desired property
the singleton value of the desired property
Retrieves the value of a specified property.
Retrieves the value of a specified property.
If the property is not defined, then the empty set is returned.
the desired property
the value of the desired property (a set of symbols)
Returns true if this token is considered punctuation.
Returns true if this token is considered punctuation.
Note that "." is the Google coarse part-of-speech tag for all punctuation.
true if this token is considered punctuation
a symbol-to-symbolset map, used for annotating the token with properties
a symbol-to-symbolset map, used for annotating the token with properties
Replaces the value of the specified property.
Replaces the value of the specified property.
desired property to replace
new desired value for the specified property
a token for which the specified property is mapped to the specified value
the surface form of the token (i.e.
the surface form of the token (i.e. the word)
The NexusToken is the "zeroth" token of a sentence.