Package net.sourceforge.pmd.cpd.internal

Class JavaCCTokenizer

java.lang.Object

net.sourceforge.pmd.cpd.internal.JavaCCTokenizer

All Implemented Interfaces:

Tokenizer

public abstract class JavaCCTokenizer
extends java.lang.Object
implements Tokenizer

Field Summary

Fields inherited from interface net.sourceforge.pmd.cpd.Tokenizer

DEFAULT_SKIP_BLOCKS_PATTERN, IGNORE_ANNOTATIONS, IGNORE_IDENTIFIERS, IGNORE_LITERALS, IGNORE_USINGS, OPTION_SKIP_BLOCKS, OPTION_SKIP_BLOCKS_PATTERN

Constructor Summary

Constructors

Constructor	Description
JavaCCTokenizer()

Method Summary

Modifier and Type	Method	Description
protected abstract TokenManager	getLexerForSource(SourceCode sourceCode)
protected TokenFilter	getTokenFilter(TokenManager tokenManager)
protected TokenEntry	processToken(Tokens tokenEntries, GenericToken currentToken, java.lang.String filename)
void	tokenize(SourceCode sourceCode, Tokens tokenEntries)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

JavaCCTokenizer

public JavaCCTokenizer()

Method Detail

getLexerForSource

protected abstract TokenManager getLexerForSource(SourceCode sourceCode)

getTokenFilter

protected TokenFilter getTokenFilter(TokenManager tokenManager)

processToken

protected TokenEntry processToken(Tokens tokenEntries,
                                  GenericToken currentToken,
                                  java.lang.String filename)

tokenize

public void tokenize(SourceCode sourceCode,
                     Tokens tokenEntries)
              throws java.io.IOException

Specified by:

tokenize in interface Tokenizer

Throws:

java.io.IOException