TokenScanner (Gherkin 20.0.0 API)

java.lang.Object
- io.cucumber.gherkin.TokenScanner

All Implemented Interfaces:

Parser.ITokenScanner
```
public class TokenScanner
extends Object
implements Parser.ITokenScanner
```
The scanner reads a gherkin doc (typically read from a .feature file) and creates a token for each line. The tokens are passed to the parser, which outputs an AST (Abstract Syntax Tree).

If the scanner sees a # language header, it will reconfigure itself dynamically to look for Gherkin keywords for the associated language. The keywords are defined in gherkin-languages.json.

- Constructor Summary
  
  Constructors
  Constructor Description
  
  TokenScanner(Reader source)
  
  TokenScanner(String source)
- Method Summary
  
  All Methods Instance Methods Concrete Methods
  Modifier and Type Method Description
  
  Token read()
  - Methods inherited from class java.lang.Object
    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

- Constructor Detail
  - TokenScanner
```
public TokenScanner(String source)
```
  - TokenScanner
```
public TokenScanner(Reader source)
```
- Method Detail
  - read
```
public Token read()
```
    Specified by:
    
    read in interface Parser.ITokenScanner