com.nytlabs.corpus

Class NYTCorpusDocumentParser

java.lang.Object

com.nytlabs.corpus.NYTCorpusDocumentParser

public class NYTCorpusDocumentParser
extends Object

NYTCorpusDocumentParser
Created: Jun 17, 2008
Author: Evan Sandhaus ([email protected])

Class for parsing New York Times articles from NITF files.

The original version contained a possible memory leak: the BufferedReader object was not closed. Additionally, an API to read from an InputStream was added.

Author:

Evan Sandhaus

Field Summary

Fields

Modifier and Type	Field and Description
static String	DATE_PUBLICATION_ATTRIBUTE NITF Constant

Constructor Summary

Constructors

Constructor and Description
NYTCorpusDocumentParser()

Method Summary

Modifier and Type	Method and Description
NYTCorpusDocument	fromByteArray(byte[] bytes, boolean validating)
NYTCorpusDocument	parseNYTCorpusDocumentFromDOMDocument(File file, Document document)
NYTCorpusDocument	parseNYTCorpusDocumentFromDOMDocument(InputStream is, Document document)
NYTCorpusDocument	parseNYTCorpusDocumentFromFile(File file, boolean validating) Parse an New York Times Document from a file.
NYTCorpusDocument	parseNYTCorpusDocumentFromFile(InputStream is, boolean validating) Parse an New York Times Document from an InputStream.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

DATE_PUBLICATION_ATTRIBUTE

public static final String DATE_PUBLICATION_ATTRIBUTE

NITF Constant

See Also:

Constant Field Values

Constructor Detail

NYTCorpusDocumentParser

public NYTCorpusDocumentParser()

Method Detail

fromByteArray

public NYTCorpusDocument fromByteArray(byte[] bytes,
                                       boolean validating)

parseNYTCorpusDocumentFromFile

public NYTCorpusDocument parseNYTCorpusDocumentFromFile(File file,
                                                        boolean validating)

Parse an New York Times Document from a file.

Parameters:

file - The file from which to parse the document.

validating - True if the file is to be validated against the nitf DTD and false if it is not. It is recommended that validation be disabled, as all documents in the corpus have previously been validated against the NITF DTD.

Returns:

The parsed document, or null if an error occurs.

parseNYTCorpusDocumentFromDOMDocument

public NYTCorpusDocument parseNYTCorpusDocumentFromDOMDocument(File file,
                                                               Document document)

parseNYTCorpusDocumentFromFile

public NYTCorpusDocument parseNYTCorpusDocumentFromFile(InputStream is,
                                                        boolean validating)

Parse an New York Times Document from an InputStream.

Parameters:

is - The InputStream from which to parse the document.

validating - True if the file is to be validated against the nitf DTD and false if it is not. It is recommended that validation be disabled, as all documents in the corpus have previously been validated against the NITF DTD.

Returns:

The parsed document, or null if an error occurs.

parseNYTCorpusDocumentFromDOMDocument

public NYTCorpusDocument parseNYTCorpusDocumentFromDOMDocument(InputStream is,
                                                               Document document)