Package net.sourceforge.pmd.cpd

Class PythonTokenizer

java.lang.Object

net.sourceforge.pmd.cpd.internal.JavaCCTokenizer

net.sourceforge.pmd.cpd.PythonTokenizer

All Implemented Interfaces:

net.sourceforge.pmd.cpd.Tokenizer

public class PythonTokenizer
extends net.sourceforge.pmd.cpd.internal.JavaCCTokenizer

The Python tokenizer.

Field Summary

Fields inherited from interface net.sourceforge.pmd.cpd.Tokenizer

DEFAULT_SKIP_BLOCKS_PATTERN, IGNORE_ANNOTATIONS, IGNORE_IDENTIFIERS, IGNORE_LITERALS, IGNORE_USINGS, OPTION_SKIP_BLOCKS, OPTION_SKIP_BLOCKS_PATTERN

Constructor Summary

Constructors

Constructor	Description
PythonTokenizer()

Method Summary

Modifier and Type	Method	Description
protected net.sourceforge.pmd.lang.TokenManager	getLexerForSource(net.sourceforge.pmd.cpd.SourceCode sourceCode)

Methods inherited from class net.sourceforge.pmd.cpd.internal.JavaCCTokenizer

getTokenFilter, processToken, tokenize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PythonTokenizer

public PythonTokenizer()

Method Detail

getLexerForSource

protected net.sourceforge.pmd.lang.TokenManager getLexerForSource(net.sourceforge.pmd.cpd.SourceCode sourceCode)

Specified by:

getLexerForSource in class net.sourceforge.pmd.cpd.internal.JavaCCTokenizer