Class ClassicAnalyzer
- java.lang.Object
-
- org.apache.lucene.analysis.Analyzer
-
- org.apache.lucene.analysis.util.StopwordAnalyzerBase
-
- org.apache.lucene.analysis.standard.ClassicAnalyzer
-
- All Implemented Interfaces:
java.io.Closeable
,java.lang.AutoCloseable
public final class ClassicAnalyzer extends StopwordAnalyzerBase
FiltersClassicTokenizer
withClassicFilter
,LowerCaseFilter
andStopFilter
, using a list of English stop words.You must specify the required
Version
compatibility when creating ClassicAnalyzer:- As of 3.1, StopFilter correctly handles Unicode 4.0 supplementary characters in stopwords
- As of 2.9, StopFilter preserves position increments
- As of 2.4, Tokens incorrectly identified as acronyms are corrected (see LUCENE-1068)
StandardAnalyzer
implements Unicode text segmentation, as specified by UAX#29.
-
-
Nested Class Summary
-
Nested classes/interfaces inherited from class org.apache.lucene.analysis.Analyzer
Analyzer.GlobalReuseStrategy, Analyzer.PerFieldReuseStrategy, Analyzer.ReuseStrategy, Analyzer.TokenStreamComponents
-
-
Field Summary
Fields Modifier and Type Field Description static int
DEFAULT_MAX_TOKEN_LENGTH
Default maximum allowed token lengthstatic CharArraySet
STOP_WORDS_SET
An unmodifiable set containing some common English words that are usually not useful for searching.-
Fields inherited from class org.apache.lucene.analysis.Analyzer
GLOBAL_REUSE_STRATEGY, PER_FIELD_REUSE_STRATEGY
-
-
Constructor Summary
Constructors Constructor Description ClassicAnalyzer(Version matchVersion)
Builds an analyzer with the default stop words (STOP_WORDS_SET
).ClassicAnalyzer(Version matchVersion, java.io.Reader stopwords)
Builds an analyzer with the stop words from the given reader.ClassicAnalyzer(Version matchVersion, CharArraySet stopWords)
Builds an analyzer with the given stop words.
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description int
getMaxTokenLength()
void
setMaxTokenLength(int length)
Set maximum allowed token length.-
Methods inherited from class org.apache.lucene.analysis.util.StopwordAnalyzerBase
getStopwordSet
-
Methods inherited from class org.apache.lucene.analysis.Analyzer
close, getOffsetGap, getPositionIncrementGap, getReuseStrategy, tokenStream, tokenStream
-
-
-
-
Field Detail
-
DEFAULT_MAX_TOKEN_LENGTH
public static final int DEFAULT_MAX_TOKEN_LENGTH
Default maximum allowed token length- See Also:
- Constant Field Values
-
STOP_WORDS_SET
public static final CharArraySet STOP_WORDS_SET
An unmodifiable set containing some common English words that are usually not useful for searching.
-
-
Constructor Detail
-
ClassicAnalyzer
public ClassicAnalyzer(Version matchVersion, CharArraySet stopWords)
Builds an analyzer with the given stop words.- Parameters:
matchVersion
- Lucene version to match See {@link above}stopWords
- stop words
-
ClassicAnalyzer
public ClassicAnalyzer(Version matchVersion)
Builds an analyzer with the default stop words (STOP_WORDS_SET
).- Parameters:
matchVersion
- Lucene version to match See {@link above}
-
ClassicAnalyzer
public ClassicAnalyzer(Version matchVersion, java.io.Reader stopwords) throws java.io.IOException
Builds an analyzer with the stop words from the given reader.- Parameters:
matchVersion
- Lucene version to match See {@link above}stopwords
- Reader to read stop words from- Throws:
java.io.IOException
- See Also:
WordlistLoader.getWordSet(Reader, Version)
-
-
Method Detail
-
setMaxTokenLength
public void setMaxTokenLength(int length)
Set maximum allowed token length. If a token is seen that exceeds this length then it is discarded. This setting only takes effect the next time tokenStream or tokenStream is called.
-
getMaxTokenLength
public int getMaxTokenLength()
- See Also:
setMaxTokenLength(int)
-
-