@ExportPackage @PublicApi
Package com.yahoo.language.process
-
Interface Summary Interface Description Normalizer This interface provides NFKC normalization of Strings through the underlying linguistics library.Segmenter Interface providing segmentation, i.e.Stemmer Interface providing stemming of single words.Token A single token produced by the tokenizer.Tokenizer Language-sensitive tokenization of a text string.Transformer Interface for providers of text transformations such as accent removal. -
Class Summary Class Description CharacterClasses Determines the class of a given character.GramSplitter A class which splits consecutive word character sequences into overlapping character n-grams.GramSplitter.Gram An immutable start index and length pairGramSplitter.GramSplitterIterator SegmenterImpl StemList A list of strings which does not allow for duplicate elements.StemmerImpl -
Enum Summary Enum Description StemMode An enum of the stemming modes which can be requested.TokenScript List of token scripts (e.g.TokenType An enumeration of token types. -
Exception Summary Exception Description ProcessingException Exception class indicating that a fatal error occured during linguistic processing.