net.sourceforge.pmd.cpd

Class CsTokenizer

java.lang.Object

net.sourceforge.pmd.cpd.CsTokenizer

All Implemented Interfaces:

Tokenizer

public class CsTokenizer
extends Object
implements Tokenizer

This class does a best-guess try-anything tokenization.

Author:

jheintz

Field Summary

Fields inherited from interface net.sourceforge.pmd.cpd.Tokenizer

DEFAULT_SKIP_BLOCKS_PATTERN, IGNORE_ANNOTATIONS, IGNORE_IDENTIFIERS, IGNORE_LITERALS, IGNORE_USINGS, OPTION_SKIP_BLOCKS, OPTION_SKIP_BLOCKS_PATTERN

Constructor Summary

Constructors

Constructor and Description
CsTokenizer()

Method Summary

Methods

Modifier and Type	Method and Description
void	setIgnoreUsings(boolean ignoreUsings)
void	setProperties(Properties properties)
void	tokenize(SourceCode sourceCode, Tokens tokenEntries)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CsTokenizer

public CsTokenizer()

Method Detail

setProperties

public void setProperties(Properties properties)

tokenize

public void tokenize(SourceCode sourceCode,
            Tokens tokenEntries)

Specified by:

tokenize in interface Tokenizer

setIgnoreUsings

public void setIgnoreUsings(boolean ignoreUsings)