Class FileTokenizer

    • Constructor Detail

      • FileTokenizer

        public FileTokenizer()
    • Method Detail

      • getToken

        public java.lang.String getToken​(java.io.Reader in)
                                  throws java.io.IOException
        Get the complete input as a string
        Specified by:
        getToken in interface Tokenizer
        Parameters:
        in - the reader object
        Returns:
        the complete input
        Throws:
        java.io.IOException - if error reading
      • getPostToken

        public java.lang.String getPostToken()
        Return the intra-token string
        Specified by:
        getPostToken in interface Tokenizer
        Returns:
        an empty string always