Modifier and Type | Field and Description |
---|---|
static java.lang.String |
TOKENS |
IGNORE_ANNOTATIONS, IGNORE_IDENTIFIERS, IGNORE_LITERALS
Constructor and Description |
---|
AnyTokenizer() |
Modifier and Type | Method and Description |
---|---|
void |
tokenize(SourceCode sourceCode,
Tokens tokenEntries) |
public static final java.lang.String TOKENS
public void tokenize(SourceCode sourceCode, Tokens tokenEntries)
Copyright © 2002-2014 InfoEther. All Rights Reserved.