Package com.yahoo.schema.parser

Class SchemaParserTokenManager

java.lang.Object

com.yahoo.schema.parser.SchemaParserTokenManager

All Implemented Interfaces:

SchemaParserConstants

public class SchemaParserTokenManager
extends Object
implements SchemaParserConstants

Token Manager.

Field Summary

Fields

Modifier and Type	Field	Description
protected int	curChar
protected CharStream	input_stream
static final int[]	jjnewLexState	Lex State array.
static final String[]	jjstrLiteralImages	Token literal values.
static final String[]	lexStateNames	Lexer state names.

Fields inherited from interface com.yahoo.schema.parser.SchemaParserConstants

ALIAS, ALWAYS, ANNOTATION, ANNOTATIONREFERENCE, APPROXIMATE_THRESHOLD, ARITY, ARRAY, AS, ASCENDING, ATTRIBUTE, BOLDING, BRACE_ML_CONTENT, BRACE_ML_LEVEL_1, BRACE_ML_LEVEL_2, BRACE_ML_LEVEL_3, BRACE_SL_CONTENT, BRACE_SL_LEVEL_1, BRACE_SL_LEVEL_2, BRACE_SL_LEVEL_3, BTREE, CASED, COLON, COMMA, CONSTANT, CONSTANTS, CONTEXT, CREATE_IF_NONEXISTENT, CUTOFF_FACTOR, CUTOFF_STRATEGY, DEFAULT, DENSE_POSTING_LIST_THRESHOLD, DESCENDING, DICTIONARY, DIRECT, DISTANCE_METRIC, DIVERSITY, DOCUMENT, DOCUMENT_SUMMARY, DOT, DOUBLE, DOUBLE_KEYWORD, DOUBLEQUOTEDSTRING, DYNAMIC, ENABLE_BIT_VECTORS, ENABLE_BM25, ENABLE_ONLY_BIT_VECTOR, EOF, EVALUATION_POINT, EXACT, EXACT_TERMINATOR, EXECUTION_MODE, EXPRESSION_ML, EXPRESSION_SL, FALSE, FAST_ACCESS, FAST_RANK, FAST_SEARCH, FIELD, FIELDS, FIELDSET, FILE, FILE_PATH, FILTER, FIRST_PHASE, FROM_DISK, FULL, FUNCTION, GLOBAL_PHASE, GPU_DEVICE, GRAM, GRAM_SIZE, GREATERTHAN, HASH, HNSW, HTTP, ID, IDENTICAL, IDENTIFIER, IDENTIFIER_WITH_DASH, IGNORE_DEFAULT_RANK_FEATURES, IMPORT, INDEX, INDEXING, INHERITS, INLINE, INPUTS, INTEGER, INTEROP_THREADS, INTRAOP_THREADS, KEEP_RANK_COUNT, LBRACE, LESSTHAN, LITERAL, LOCALE, LONG, LOOSE, LOWER_BOUND, LOWERCASE, MACRO, MAP, MATCH, MATCH_PHASE, MATCHED_ELEMENTS_ONLY, MATCHFEATURES_ML, MATCHFEATURES_ML_INHERITS, MATCHFEATURES_SL, MAX_FILTER_COVERAGE, MAX_HITS, MAX_LENGTH, MAX_LINKS_PER_NODE, MIN_GROUPS, MIN_HITS_PER_THREAD, MODEL, MTOKEN, MULTI_THREADED_INDEXING, MUTABLE, MUTATE, NEIGHBORS_TO_EXPLORE_AT_INSERT, NEVER, NL, NONE, NORMAL, NORMALIZING, NUM_SEARCH_PARTITIONS, NUM_THREADS_PER_SEARCH, OFF, OMIT_SUMMARY_FEATURES, ON, ON_DEMAND, ON_FIRST_PHASE, ON_MATCH, ON_SECOND_PHASE, ON_SUMMARY, ONNX_INPUT_SL, ONNX_MODEL, ONNX_OUTPUT_SL, OPERATION, ORDER, PAGED, PARALLEL, POST_FILTER_THRESHOLD, PRE_POST_FILTER_TIPPING_POINT, PREFIX, PRIMARY, PROPERTIES, QUATERNARY, QUERY, QUERY_COMMAND, QUESTIONMARK, RANK, RANK_PROFILE, RANK_PROPERTIES, RANK_SCORE_DROP_LIMIT, RANK_TYPE, RANKFEATURES_ML, RANKFEATURES_SL, RAW, RAW_AS_BASE64_IN_SUMMARY, RBRACE, REFERENCE, REMOVE_IF_ZERO, RERANK_COUNT, SCHEMA, SEARCH, SEARCHLIB_SKIP, SECOND_PHASE, SECONDARY, SEQUENTIAL, SINGLE_LINE_COMMENT, SINGLEQUOTEDSTRING, SORTING, SOURCE, SSCONTEXTUAL, SSOVERRIDE, SSTITLE, SSURL, STATIC, STEMMING, STRENGTH, STRICT, STRING, STRUCT, STRUCT_FIELD, SUBSTRING, SUFFIX, SUMMARY, SUMMARY_TO, SUMMARYFEATURES_ML, SUMMARYFEATURES_ML_INHERITS, SUMMARYFEATURES_SL, SYMMETRIC, TENSOR_TYPE, TENSOR_VALUE_ML, TENSOR_VALUE_SL, TERMWISE_LIMIT, TERTIARY, TEXT, TO, tokenImage, TRUE, TYPE, UCA, UNCASED, UPPER_BOUND, URI, URI_PATH, VARIABLE, WEIGHT, WEIGHTEDSET, WORD

Constructor Summary

Constructors

Constructor	Description
SchemaParserTokenManager(CharStream stream)	Constructor.
SchemaParserTokenManager(CharStream stream, int lexState)	Constructor.

Method Summary

Modifier and Type	Method	Description
Token	getNextToken()	Get the next Token.
protected Token	jjFillToken()
void	ReInit(CharStream stream)	Reinitialise parser.
void	ReInit(CharStream stream, int lexState)	Reinitialise parser.
void	SwitchTo(int lexState)	Switch to specified lex state.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

jjstrLiteralImages

public static final String[] jjstrLiteralImages

Token literal values.

lexStateNames

public static final String[] lexStateNames

Lexer state names.

jjnewLexState

public static final int[] jjnewLexState

Lex State array.

input_stream

protected CharStream input_stream

curChar

protected int curChar

Constructor Details

SchemaParserTokenManager

public SchemaParserTokenManager(CharStream stream)

Constructor.

SchemaParserTokenManager

public SchemaParserTokenManager(CharStream stream,
 int lexState)

Constructor.

Method Details

jjFillToken

protected Token jjFillToken()

getNextToken

public Token getNextToken()

Get the next Token.

ReInit

public void ReInit(CharStream stream)

Reinitialise parser.

ReInit

public void ReInit(CharStream stream,
 int lexState)

Reinitialise parser.

SwitchTo

public void SwitchTo(int lexState)

Switch to specified lex state.