Package net.sourceforge.pmd.cpd

Class JavaTokenizer

  • All Implemented Interfaces:
    net.sourceforge.pmd.cpd.Tokenizer
    public class JavaTokenizer
extends net.sourceforge.pmd.cpd.internal.JavaCCTokenizer

    • Field Summary

      Fields 
      Modifier and Type Field Description
      static java.lang.String CPD_END  
      static java.lang.String CPD_START  

      • Fields inherited from interface net.sourceforge.pmd.cpd.Tokenizer

        DEFAULT_SKIP_BLOCKS_PATTERN, IGNORE_ANNOTATIONS, IGNORE_IDENTIFIERS, IGNORE_LITERALS, IGNORE_USINGS, OPTION_SKIP_BLOCKS, OPTION_SKIP_BLOCKS_PATTERN

    • Constructor Summary

      Constructors 
      Constructor Description
      JavaTokenizer()  

    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      protected net.sourceforge.pmd.lang.TokenManager getLexerForSource​(net.sourceforge.pmd.cpd.SourceCode sourceCode)  
      protected net.sourceforge.pmd.cpd.token.TokenFilter getTokenFilter​(net.sourceforge.pmd.lang.TokenManager tokenManager)  
      protected net.sourceforge.pmd.cpd.TokenEntry processToken​(net.sourceforge.pmd.cpd.Tokens tokenEntries, net.sourceforge.pmd.lang.ast.GenericToken currentToken, java.lang.String fileName)  
      void setIgnoreAnnotations​(boolean ignoreAnnotations)  
      void setIgnoreIdentifiers​(boolean ignore)  
      void setIgnoreLiterals​(boolean ignore)  
      void setProperties​(java.util.Properties properties)  
      void tokenize​(net.sourceforge.pmd.cpd.SourceCode sourceCode, net.sourceforge.pmd.cpd.Tokens tokenEntries)  

      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

    • Constructor Detail

      • JavaTokenizer

        public JavaTokenizer()

    • Method Detail

      • setProperties

        public void setProperties​(java.util.Properties properties)

      • tokenize

        public void tokenize​(net.sourceforge.pmd.cpd.SourceCode sourceCode,
                     net.sourceforge.pmd.cpd.Tokens tokenEntries)
              throws java.io.IOException
        Specified by:
        tokenize in interface net.sourceforge.pmd.cpd.Tokenizer
        Overrides:
        tokenize in class net.sourceforge.pmd.cpd.internal.JavaCCTokenizer
        Throws:
        java.io.IOException

      • getLexerForSource

        protected net.sourceforge.pmd.lang.TokenManager getLexerForSource​(net.sourceforge.pmd.cpd.SourceCode sourceCode)
        Specified by:
        getLexerForSource in class net.sourceforge.pmd.cpd.internal.JavaCCTokenizer

      • getTokenFilter

        protected net.sourceforge.pmd.cpd.token.TokenFilter getTokenFilter​(net.sourceforge.pmd.lang.TokenManager tokenManager)
        Overrides:
        getTokenFilter in class net.sourceforge.pmd.cpd.internal.JavaCCTokenizer

      • processToken

        protected net.sourceforge.pmd.cpd.TokenEntry processToken​(net.sourceforge.pmd.cpd.Tokens tokenEntries,
                                                          net.sourceforge.pmd.lang.ast.GenericToken currentToken,
                                                          java.lang.String fileName)
        Overrides:
        processToken in class net.sourceforge.pmd.cpd.internal.JavaCCTokenizer

      • setIgnoreLiterals

        public void setIgnoreLiterals​(boolean ignore)

      • setIgnoreIdentifiers

        public void setIgnoreIdentifiers​(boolean ignore)

      • setIgnoreAnnotations

        public void setIgnoreAnnotations​(boolean ignoreAnnotations)