package token
This package provides a wealth of functionality for performing common lexing tasks.
It is organised as follows:
- the main parsing functionality is accessed via
Lexer
, which provides implementations for the combinators found in the sub-packages given aLexicalDesc
. - the
descriptions
sub-package is how a lexical structure can be described, providing the configuration that alters the behaviour of the parsers produced by theLexer
. - the other sub-packages contain the high-level interfaces that the
Lexer
exposes, which can be used to pass whitespace-aware and non-whitespace-aware combinators around in a uniform way. - the
predicate
module contains functionality to help define boolean predicates on characters or unicode codepoints.
- Alphabetic
- By Inheritance
- token
- AnyRef
- Any
- Hide All
- Show All
- Public
- Protected
Package Members
- package descriptions
This package contains the descriptions of various lexical structures to be fed to
Lexer
.This package contains the descriptions of various lexical structures to be fed to
Lexer
.- Since
4.0.0
- package names
This package contains the abstract parsers for parsing identifiers and operators.
This package contains the abstract parsers for parsing identifiers and operators.
- Since
4.0.0
- package numeric
This package contains the abstract parsers for parsing numeric literals, like integers and reals.
This package contains the abstract parsers for parsing numeric literals, like integers and reals.
- Since
4.0.0
- package symbol
This package contains the abstract parsers for parsing symbolic tokens like keywords.
This package contains the abstract parsers for parsing symbolic tokens like keywords.
- Since
4.0.0
- package text
This package contains the abstract parsers for parsing string and character literals.
This package contains the abstract parsers for parsing string and character literals.
- Since
4.0.0
Type Members
- class Lexer extends AnyRef
This class provides a large selection of functionality concerned with lexing.
This class provides a large selection of functionality concerned with lexing.
This class provides lexing functionality to
parsley
, however it is guaranteed that nothing in this class is not implementable purely usingparsley
's pre-existing functionality. These are regular parsers, but constructed in such a way that they create a clear and logical separation from the rest of the parser.The class is broken up into several internal "modules" that group together similar kinds of functionality. Importantly, the
lexemes
andnonlexemes
objects separate the underlying token implementations based on whether or not they consume whitespace or not. Functionality is broadly duplicated across both of these modules:lexemes
should be used by a wider parser, to ensure whitespace is handled uniformly; andnonlexemes
should be used to define further composite tokens or in special circumstances where whitespace should not be consumed.It is possible that some of the implementations of parsers found within this class may have been hand-optimised for performance: care will have been taken to ensure these implementations precisely match the semantics of the originals.
Value Members
- object predicate
This module contains functionality to describe character predicates, which can be used to determine what characters are valid for different tokens.
This module contains functionality to describe character predicates, which can be used to determine what characters are valid for different tokens.
- Since
4.0.0
This is the documentation for Parsley.
Package structure
The parsley package contains the
Parsley
class, as well as theResult
,Success
, andFailure
types. In addition to these, it also contains the following packages and "modules" (a module is defined as being an object which mocks a package):parsley.Parsley
contains the bulk of the core "function-style" combinators.parsley.combinator
contains many helpful combinators that simplify some common parser patterns.parsley.character
contains the combinators needed to read characters and strings, as well as combinators to match specific sub-sets of characters.parsley.debug
contains debugging combinators, helpful for identifying faults in parsers.parsley.extension
contains syntactic sugar combinators exposed as implicit classes.parsley.io
contains extension methods to run parsers with input sourced from IO sources.parsley.expr
contains the following sub modules:parsley.expr.chain
contains combinators used in expression parsingparsley.expr.precedence
is a builder for expression parsers built on a precedence table.parsley.expr.infix
contains combinators used in expression parsing, but with more permissive types than their equivalents inchain
.parsley.expr.mixed
contains combinators that can be used for expression parsing, but where different fixities may be mixed on the same level: this is rare in practice.parsley.implicits
contains several implicits to add syntactic sugar to the combinators. These are sub-categorised into the following sub modules:parsley.implicits.character
contains implicits to allow you to use character and string literals as parsers.parsley.implicits.combinator
contains implicits related to combinators, such as the ability to make any parser into aParsley[Unit]
automatically.parsley.implicits.lift
enables postfix application of the lift combinator onto a function (or value).parsley.implicits.zipped
enables boths a reversed form of lift where the function appears on the right and is applied on a tuple (useful when type inference has failed) as well as a.zipped
method for building tuples out of several combinators.parsley.errors
contains modules to deal with error messages, their refinement and generation.parsley.errors.combinator
provides combinators that can be used to either produce more detailed errors as well as refine existing errors.parsley.errors.tokenextractors
provides mixins for common token extraction strategies during error message generation: these can be used to avoid implementingunexpectedToken
in theErrorBuilder
.parsley.lift
contains functions which lift functions that work on regular types to those which now combine the results of parsers returning those same types. these are ubiquitous.parsley.ap
contains functions which allow for the application of a parser returning a function to several parsers returning each of the argument types.parsley.registers
contains combinators that interact with the context-sensitive functionality in the form of registers.parsley.token
contains theLexer
class that provides a host of helpful lexing combinators when provided with the description of a language.parsley.genericbridges
contains some basic implementations of the Parser Bridge pattern (see Design Patterns for Parser Combinators in Scala, or the parsley wiki): these can be used before more specialised generic bridge traits can be constructed.