Uses of Interface
com.yahoo.language.process.Token
-
Packages that use Token Package Description com.yahoo.language.process -
-
Uses of Token in com.yahoo.language.process
Methods in com.yahoo.language.process that return Token Modifier and Type Method Description Token
Token. getComponent(int i)
Returns a component token of thisMethods in com.yahoo.language.process that return types with arguments of type Token Modifier and Type Method Description java.lang.Iterable<Token>
Tokenizer. tokenize(java.lang.String input, Language language, StemMode stemMode, boolean removeAccents)
Returns the tokens produced from an input string under the rules of the given Language and additional options
-