com.salesforce.op.stages.impl.feature
Text tokenization result
Text tokenization result
detected language
sentence tokens
Language wise sentence tokenization
Language wise sentence tokenization
text to tokenize
language detector instance
text analyzer instance
sentence splitter instance
whether to attempt language detection
default language
language detection threshold
whether to convert all characters to lowercase before tokenizing
minimum token length
detected language and sentence tokens