net.sourceforge.pmd.cpd

Interface Tokenizer

All Known Implementing Classes:

AbstractTokenizer, AnyTokenizer

public interface Tokenizer

Field Summary

Fields

Modifier and Type	Field and Description
static String	IGNORE_ANNOTATIONS
static String	IGNORE_IDENTIFIERS
static String	IGNORE_LITERALS

Method Summary

Methods

Modifier and Type	Method and Description
void	tokenize(SourceCode sourceCode, Tokens tokenEntries)

Field Detail

IGNORE_LITERALS

static final String IGNORE_LITERALS

See Also:

Constant Field Values

IGNORE_IDENTIFIERS

static final String IGNORE_IDENTIFIERS

See Also:

Constant Field Values

IGNORE_ANNOTATIONS

static final String IGNORE_ANNOTATIONS

See Also:

Constant Field Values

Method Detail

tokenize

void tokenize(SourceCode sourceCode,
            Tokens tokenEntries)
              throws IOException

Throws:

IOException