Tokens

trait Tokens

This component provides the notion of Token, the unit of information that is passed from lexical parsers in the Lexical component to the parsers in the TokenParsers component.

This component provides the notion of Token, the unit of information that is passed from lexical parsers in the Lexical component to the parsers in the TokenParsers component.

class Object
trait Matchable
class Any
class Lexical
trait StdTokens

Type members

Classlikes

case object EOF extends Token

A class for end-of-file tokens

A class for end-of-file tokens

case class ErrorToken(msg: String) extends Token

A class of error tokens. Error tokens are used to communicate errors detected during lexical analysis

A class of error tokens. Error tokens are used to communicate errors detected during lexical analysis

abstract class Token

Objects of this type are produced by a lexical parser or scanner, and consumed by a parser.

Objects of this type are produced by a lexical parser or scanner, and consumed by a parser.

See also

Value members

Concrete methods

def errorToken(msg: String): Token

This token is produced by a scanner Scanner when scanning failed.

This token is produced by a scanner Scanner when scanning failed.