Package com.yahoo.search.query.textserialize.parser

Class ParserTokenManager

java.lang.Object

com.yahoo.search.query.textserialize.parser.ParserTokenManager

All Implemented Interfaces:

ParserConstants

public class ParserTokenManager
extends Object
implements ParserConstants

Token Manager.

Field Summary

Fields

Modifier and Type	Field	Description
protected int	curChar
protected SimpleCharStream	input_stream
static final int[]	jjnewLexState	Lex State array.
static final String[]	jjstrLiteralImages	Token literal values.
static final String[]	lexStateNames	Lexer state names.

Fields inherited from interface com.yahoo.search.query.textserialize.parser.ParserConstants

BOOLEAN, CLOSE_CURLY, CLOSE_PAREN, CLOSE_SQUARE, DEFAULT, DIGIT, EOF, EXPONENT, NULL, NUMBER, OPEN_CURLY, OPEN_PAREN, OPEN_SQUARE, QUOTE, SIGN, STRING, STRING_CHARACTER, SYMBOL, SYMBOL_FIRST, SYMBOL_REST, tokenImage

Constructor Summary

Constructors

Constructor	Description
ParserTokenManager(SimpleCharStream stream)	Constructor.
ParserTokenManager(SimpleCharStream stream, int lexState)	Constructor.

Method Summary

Modifier and Type	Method	Description
Token	getNextToken()	Get the next Token.
protected Token	jjFillToken()
void	ReInit(SimpleCharStream stream)	Reinitialise parser.
void	ReInit(SimpleCharStream stream, int lexState)	Reinitialise parser.
void	SwitchTo(int lexState)	Switch to specified lex state.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

jjstrLiteralImages

public static final String[] jjstrLiteralImages

Token literal values.

lexStateNames

public static final String[] lexStateNames

Lexer state names.

jjnewLexState

public static final int[] jjnewLexState

Lex State array.

input_stream

protected SimpleCharStream input_stream

curChar

protected int curChar

Constructor Details

ParserTokenManager

public ParserTokenManager(SimpleCharStream stream)

Constructor.

ParserTokenManager

public ParserTokenManager(SimpleCharStream stream,
 int lexState)

Constructor.

Method Details

jjFillToken

protected Token jjFillToken()

getNextToken

public Token getNextToken()

Get the next Token.

ReInit

public void ReInit(SimpleCharStream stream)

Reinitialise parser.

ReInit

public void ReInit(SimpleCharStream stream,
 int lexState)

Reinitialise parser.

SwitchTo

public void SwitchTo(int lexState)

Switch to specified lex state.