Package cc.redberry.rings.io

Class Tokenizer

java.lang.Object

cc.redberry.rings.io.Tokenizer

All Implemented Interfaces:

Serializable

public final class Tokenizer
extends Object
implements Serializable

Simple math expression tokenizer

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static interface	Tokenizer.CharacterStream	Stream of chars.
static class	Tokenizer.Token	Simple token
static class	Tokenizer.TokenType	token type

Field Summary

Fields

Modifier and Type	Field	Description
static Tokenizer.Token	BRACKET_CLOSE
static Tokenizer.Token	BRACKET_OPEN
static Tokenizer.Token	DIVIDE
static Tokenizer.Token	END
static Tokenizer.Token	EXPONENT
static Tokenizer.Token	MINUS
static Tokenizer.Token	MULTIPLY
static Tokenizer.Token	PLUS
static Tokenizer.Token	SPACE

Constructor Summary

Constructors

Constructor	Description
Tokenizer(Tokenizer.CharacterStream stream)	Create tokenizer of a given char stream

Method Summary

Modifier and Type	Method	Description
static Tokenizer.CharacterStream	concat(Tokenizer.CharacterStream a, Tokenizer.CharacterStream b)	Concat char streams
static Tokenizer.CharacterStream	mkCharacterStream(String string, Character terminateChar)	Create character stream from string
static Tokenizer	mkTokenizer(String string)	Create string tokenizer
static Tokenizer	mkTokenizer(String string, Character terminateChar)	Create string tokenizer
Tokenizer.Token	nextToken()	Get the next token from stream

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

END

public static final Tokenizer.Token END

PLUS

public static final Tokenizer.Token PLUS

MINUS

public static final Tokenizer.Token MINUS

MULTIPLY

public static final Tokenizer.Token MULTIPLY

DIVIDE

public static final Tokenizer.Token DIVIDE

EXPONENT

public static final Tokenizer.Token EXPONENT

BRACKET_OPEN

public static final Tokenizer.Token BRACKET_OPEN

BRACKET_CLOSE

public static final Tokenizer.Token BRACKET_CLOSE

SPACE

public static final Tokenizer.Token SPACE

Constructor Details

Tokenizer

public Tokenizer(Tokenizer.CharacterStream stream)

Create tokenizer of a given char stream

Method Details

nextToken

public Tokenizer.Token nextToken()

Get the next token from stream

concat

public static Tokenizer.CharacterStream concat(Tokenizer.CharacterStream a,
Tokenizer.CharacterStream b)

Concat char streams

mkCharacterStream

public static Tokenizer.CharacterStream mkCharacterStream(String string,
Character terminateChar)

Create character stream from string

Parameters:

terminateChar - if a non-null value specified, stream will terminate on the last char preceding the terminateChar

mkTokenizer

public static Tokenizer mkTokenizer(String string,
Character terminateChar)

Create string tokenizer

Parameters:

terminateChar - if a non-null value specified, stream will terminate on the last char preceding the terminateChar

mkTokenizer

public static Tokenizer mkTokenizer(String string)

Create string tokenizer