Class TokenStream.CaseInsensitiveTokenFactory

    • Constructor Detail

      • CaseInsensitiveTokenFactory

        public CaseInsensitiveTokenFactory()
    • Method Detail

      • addToken

        public void addToken​(Position position,
                             int startIndex,
                             int endIndex,
                             int type)
        Description copied from interface: TokenStream.Tokens
        Create a single- or multi-character token with the supplied type and with the characters in the range given by the starting and ending index in the character stream. The character at the ending index is not included in the token (as this is standard practice when using 0-based indexes).
        Parameters:
        position - the position (line and column numbers) of this new token; may not be null
        startIndex - the index of the first character to appear in the token; must be a valid index in the stream
        endIndex - the index just past the last character to appear in the token; must be a valid index in the stream
        type - the type of the token