Uses of Interface
com.yahoo.language.process.Token
-
Packages that use Token Package Description com.yahoo.language.opennlp com.yahoo.language.process com.yahoo.language.simple -
-
Uses of Token in com.yahoo.language.opennlp
Methods in com.yahoo.language.opennlp that return types with arguments of type Token Modifier and Type Method Description Iterable<Token>
OpenNlpTokenizer. tokenize(String input, Language language, StemMode stemMode, boolean removeAccents)
-
Uses of Token in com.yahoo.language.process
Methods in com.yahoo.language.process that return Token Modifier and Type Method Description Token
Token. getComponent(int i)
Returns a component token of thisMethods in com.yahoo.language.process that return types with arguments of type Token Modifier and Type Method Description Iterable<Token>
Tokenizer. tokenize(String input, Language language, StemMode stemMode, boolean removeAccents)
Returns the tokens produced from an input string under the rules of the given Language and additional options -
Uses of Token in com.yahoo.language.simple
Classes in com.yahoo.language.simple that implement Token Modifier and Type Class Description class
SimpleToken
Methods in com.yahoo.language.simple that return Token Modifier and Type Method Description Token
SimpleToken. getComponent(int i)
Methods in com.yahoo.language.simple that return types with arguments of type Token Modifier and Type Method Description Iterable<Token>
SimpleTokenizer. tokenize(String input, Language language, StemMode stemMode, boolean removeAccents)
Methods in com.yahoo.language.simple with parameters of type Token Modifier and Type Method Description SimpleToken
SimpleToken. addComponent(Token token)
-