StandardTokenizer
instead, which has the same functionality.
This filter will be removed in Lucene 5.0@Deprecated public class RussianLetterTokenizer extends CharTokenizer
Tokenizer
that extends LetterTokenizer
by also allowing the basic Latin digits 0-9.
You must specify the required Version
compatibility when creating
RussianLetterTokenizer
:
CharTokenizer
uses an int based API to normalize and
detect token characters. See CharTokenizer.isTokenChar(int)
and
CharTokenizer.normalize(int)
for details.AttributeSource.AttributeFactory, AttributeSource.State
Constructor and Description |
---|
RussianLetterTokenizer(Version matchVersion,
AttributeSource.AttributeFactory factory,
Reader in)
Deprecated.
Construct a new RussianLetterTokenizer using a given
AttributeSource.AttributeFactory . |
RussianLetterTokenizer(Version matchVersion,
Reader in)
Deprecated.
Construct a new RussianLetterTokenizer.
|
end, incrementToken, reset
addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, copyTo, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, reflectAsString, reflectWith, restoreState, toString
public RussianLetterTokenizer(Version matchVersion, Reader in)
in
- the input to split up into tokenspublic RussianLetterTokenizer(Version matchVersion, AttributeSource.AttributeFactory factory, Reader in)
AttributeSource.AttributeFactory
. * @param
matchVersion Lucene version to match See
abovefactory
- the attribute factory to use for this Tokenizer
in
- the input to split up into tokensCopyright © 2010 - 2020 Adobe. All Rights Reserved