Class StandardAnalyzer
- java.lang.Object
-
- org.apache.cassandra.index.sasi.analyzer.AbstractAnalyzer
-
- org.apache.cassandra.index.sasi.analyzer.StandardAnalyzer
-
- All Implemented Interfaces:
java.util.Iterator<java.nio.ByteBuffer>
public class StandardAnalyzer extends AbstractAnalyzer
-
-
Nested Class Summary
Nested Classes Modifier and Type Class Description static class
StandardAnalyzer.TokenType
-
Field Summary
Fields Modifier and Type Field Description protected java.io.Reader
inputReader
-
Fields inherited from class org.apache.cassandra.index.sasi.analyzer.AbstractAnalyzer
next
-
-
Constructor Summary
Constructors Constructor Description StandardAnalyzer()
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description protected java.lang.String
getFilteredCurrentToken()
java.lang.String
getToken()
boolean
hasNext()
boolean
incrementToken()
void
init(java.util.Map<java.lang.String,java.lang.String> options, AbstractType<?> validator)
protected void
init(StandardTokenizerOptions options)
void
init(StandardTokenizerOptions tokenizerOptions, AbstractType<?> validator)
boolean
isCompatibleWith(AbstractType<?> validator)
Test whether the given validator is compatible with the underlying analyzer.boolean
isTokenizing()
void
reset(java.io.InputStream input)
void
reset(java.nio.ByteBuffer input)
-
Methods inherited from class org.apache.cassandra.index.sasi.analyzer.AbstractAnalyzer
next, normalize, remove, validate
-
-
-
-
Method Detail
-
getToken
public java.lang.String getToken()
-
incrementToken
public final boolean incrementToken() throws java.io.IOException
- Throws:
java.io.IOException
-
getFilteredCurrentToken
protected java.lang.String getFilteredCurrentToken() throws java.io.IOException
- Throws:
java.io.IOException
-
init
public void init(java.util.Map<java.lang.String,java.lang.String> options, AbstractType<?> validator)
- Specified by:
init
in classAbstractAnalyzer
-
init
protected void init(StandardTokenizerOptions options)
-
init
public void init(StandardTokenizerOptions tokenizerOptions, AbstractType<?> validator)
-
hasNext
public boolean hasNext()
-
reset
public void reset(java.nio.ByteBuffer input)
- Specified by:
reset
in classAbstractAnalyzer
-
reset
public void reset(java.io.InputStream input)
-
isTokenizing
public boolean isTokenizing()
- Overrides:
isTokenizing
in classAbstractAnalyzer
- Returns:
- true if current analyzer provides text tokenization, false otherwise.
-
isCompatibleWith
public boolean isCompatibleWith(AbstractType<?> validator)
Description copied from class:AbstractAnalyzer
Test whether the given validator is compatible with the underlying analyzer.- Specified by:
isCompatibleWith
in classAbstractAnalyzer
- Parameters:
validator
- the validator to test the compatibility with- Returns:
- true if the give validator is compatible, false otherwise
-
-