Package org.apache.lucene.analysis.core
package org.apache.lucene.analysis.core
Basic, general-purpose analysis components.
-
ClassesClassDescription"Tokenizes" the entire stream as a single token.Emits the entire input as a single token.Factory for
KeywordTokenizer
.A LetterTokenizer is a tokenizer that divides text at non-letters.Factory forLetterTokenizer
.Normalizes token text to lower case.Factory forLowerCaseFilter
.LowerCaseTokenizer performs the function of LetterTokenizer and LowerCaseFilter together.Factory forLowerCaseTokenizer
.Removes stop words from a token stream.Factory forStopFilter
.Removes tokens whose types appear in a set of blocked types from a token stream.Factory class forTypeTokenFilter
.Normalizes token text to UPPER CASE.Factory forUpperCaseFilter
.An Analyzer that usesWhitespaceTokenizer
.A WhitespaceTokenizer is a tokenizer that divides text at whitespace.Factory forWhitespaceTokenizer
.