Class SDParserTokenManager
- java.lang.Object
-
- com.yahoo.searchdefinition.parser.SDParserTokenManager
-
- All Implemented Interfaces:
SDParserConstants
public class SDParserTokenManager extends java.lang.Object implements SDParserConstants
Token Manager.
-
-
Field Summary
Fields Modifier and Type Field Description protected int
curChar
protected CharStream
input_stream
static int[]
jjnewLexState
Lex State array.static java.lang.String[]
jjstrLiteralImages
Token literal values.static java.lang.String[]
lexStateNames
Lexer state names.-
Fields inherited from interface com.yahoo.searchdefinition.parser.SDParserConstants
ALIAS, ALWAYS, ANNOTATION, ANNOTATIONREFERENCE, ARITY, ARRAY, AS, ASCENDING, ATTRIBUTE, BODY, BOLDING, BRACE_ML_CONTENT, BRACE_ML_LEVEL_1, BRACE_ML_LEVEL_2, BRACE_ML_LEVEL_3, BRACE_SL_CONTENT, BRACE_SL_LEVEL_1, BRACE_SL_LEVEL_2, BRACE_SL_LEVEL_3, COLON, COMMA, COMPRESSION, COMPRESSIONLEVEL, COMPRESSIONTHRESHOLD, CONSTANT, CONSTANTS, CONTEXT, CREATEIFNONEXISTENT, CUTOFF_FACTOR, CUTOFF_STRATEGY, DEFAULT, DENSEPOSTINGLISTTHRESHOLD, DESCENDING, DIRECT, DISTANCEMETRIC, DIVERSITY, DOCUMENT, DOCUMENTSUMMARY, DOT, DOUBLE, DYNAMIC, ENABLE_BM25, ENABLEBITVECTORS, ENABLEONLYBITVECTOR, EOF, EVALUATION_POINT, EXACT, EXACTTERMINATOR, EXPRESSION_ML, EXPRESSION_SL, FALSE, FASTACCESS, FASTSEARCH, FIELD, FIELDS, FIELDSET, FILE, FILE_PATH, FILTER, FIRSTPHASE, FROMDISK, FULL, FUNCTION, GRAM, GRAMSIZE, GREATERTHAN, HEADER, HNSW, HTTP, HUGE, ID, IDENTICAL, IDENTIFIER, IDENTIFIER_WITH_DASH, IGNOREDEFAULTRANKFEATURES, IMPORT, INDEX, INDEXING, INDEXINGREWRITE, INHERITS, INLINE, INTEGER, KEEPRANKCOUNT, LBRACE, LESSTHAN, LITERAL, LOCALE, LONG, LOOSE, LOWERBOUND, LOWERCASE, LZ4, MACRO, MAP, MATCH, MATCHEDELEMENTSONLY, MATCHPHASE, MAXFILTERCOVERAGE, MAXHITS, MAXLENGTH, MAXLINKSPERNODE, MIN_GROUPS, MINHITSPERTHREAD, MTOKEN, MUTABLE, NEIGHBORSTOEXPLOREATINSERT, NEVER, NL, NONE, NORMAL, NORMALIZING, NUMSEARCHPARTITIONS, NUMTHREADSPERSEARCH, OFF, ON, ONDEMAND, ORDER, PRE_POST_FILTER_TIPPING_POINT, PREFIX, PRIMARY, PROPERTIES, QUATERNARY, QUERYCOMMAND, QUESTIONMARK, QUOTEDSTRING, RANK, RANKDEGRADATION, RANKDEGRADATIONFREQ, RANKFEATURES_ML, RANKFEATURES_SL, RANKPROFILE, RANKPROPERTIES, RANKSCOREDROPLIMIT, RANKTYPE, RAW, RBRACE, REFERENCE, REMOVEIFZERO, RERANKCOUNT, RPBINLOW, RPBINSIZE, RPPOSBINSIZE, SCHEMA, SEARCH, SEARCHLIB_SKIP, SECONDARY, SECONDPHASE, SINGLE_LINE_COMMENT, SORTING, SOURCE, SSCONTEXTUAL, SSOVERRIDE, SSTITLE, SSURL, STATIC, STEMMING, STRENGTH, STRICT, STRING, STRUCT, STRUCTFIELD, SUBSTRING, SUFFIX, SUMMARY, SUMMARYFEATURES_ML, SUMMARYFEATURES_ML_INHERITS, SUMMARYFEATURES_SL, SUMMARYTO, SYMMETRIC, TENSOR_TYPE, TENSOR_VALUE_ML, TENSOR_VALUE_SL, TERMWISELIMIT, TERTIARY, TEXT, TO, tokenImage, TRUE, TYPE, UCA, UPPERBOUND, URI, URI_PATH, USEDOCUMENT, VARIABLE, WEIGHT, WEIGHTEDSET, WORD
-
-
Constructor Summary
Constructors Constructor Description SDParserTokenManager(CharStream stream)
Constructor.SDParserTokenManager(CharStream stream, int lexState)
Constructor.
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description Token
getNextToken()
Get the next Token.protected Token
jjFillToken()
void
ReInit(CharStream stream)
Reinitialise parser.void
ReInit(CharStream stream, int lexState)
Reinitialise parser.void
SwitchTo(int lexState)
Switch to specified lex state.
-
-
-
Field Detail
-
jjstrLiteralImages
public static final java.lang.String[] jjstrLiteralImages
Token literal values.
-
lexStateNames
public static final java.lang.String[] lexStateNames
Lexer state names.
-
jjnewLexState
public static final int[] jjnewLexState
Lex State array.
-
input_stream
protected CharStream input_stream
-
curChar
protected int curChar
-
-
Constructor Detail
-
SDParserTokenManager
public SDParserTokenManager(CharStream stream)
Constructor.
-
SDParserTokenManager
public SDParserTokenManager(CharStream stream, int lexState)
Constructor.
-
-
Method Detail
-
jjFillToken
protected Token jjFillToken()
-
getNextToken
public Token getNextToken()
Get the next Token.
-
ReInit
public void ReInit(CharStream stream)
Reinitialise parser.
-
ReInit
public void ReInit(CharStream stream, int lexState)
Reinitialise parser.
-
SwitchTo
public void SwitchTo(int lexState)
Switch to specified lex state.
-
-