See: Description
| Class | Description |
|---|---|
| Analyzer |
An Analyzer builds TokenStreams, which analyze text.
|
| Token | |
| Tokenizer |
A Tokenizer is a TokenStream whose input is a Reader.
|
| TokenStream |
A TokenStream enumerates the sequence of tokens, either from fields of a
document or from query text.
|