Package org.apache.druid.data.input.impl

Class JsonReader

java.lang.Object

org.apache.druid.data.input.IntermediateRowParsingReader<String>

org.apache.druid.data.input.impl.JsonReader

All Implemented Interfaces:

InputEntityReader

public class JsonReader
extends IntermediateRowParsingReader<String>

In contrast to JsonLineReader which processes input text line by line independently, this class tries to parse the input text as a whole to an array of objects. The input text can be: 1. a JSON string of an object in a line or multiple lines(such as pretty-printed JSON text) 2. multiple JSON object strings concated by white space character(s) For case 2, what should be noticed is that if an exception is thrown when parsing one JSON string, the rest JSON text will all be ignored For more information, see: https://github.com/apache/druid/pull/10383

Method Summary

Modifier and Type	Method	Description
protected CloseableIterator<String>	intermediateRowIterator()	Creates an iterator of intermediate rows.
protected List<InputRow>	parseInputRows(String intermediateRow)	Parses the given intermediate row into a list of InputRows.
protected InputEntity	source()
protected List<Map<String,Object>>	toMap(String intermediateRow)	Converts the given intermediate row into a Map.

Methods inherited from class org.apache.druid.data.input.IntermediateRowParsingReader

intermediateRowIteratorWithMetadata, read, sample

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

intermediateRowIterator

protected CloseableIterator<String> intermediateRowIterator()
                                                     throws IOException

Description copied from class: IntermediateRowParsingReader

Creates an iterator of intermediate rows. The returned rows will be consumed by IntermediateRowParsingReader.parseInputRows(T) and IntermediateRowParsingReader.toMap(T). Either this or IntermediateRowParsingReader.intermediateRowIteratorWithMetadata() should be implemented

Overrides:

intermediateRowIterator in class IntermediateRowParsingReader<String>

Throws:

IOException

source

protected InputEntity source()

Overrides:

source in class IntermediateRowParsingReader<String>

Returns:

InputEntity which the implementation is reading from. Useful in generating informative ParseExceptions. For example, in case of FileEntity, file name containing erroneous records or in case of HttpEntity, the endpoint containing the erroneous data can be attached to the error message

parseInputRows

protected List<InputRow> parseInputRows(String intermediateRow)
                                 throws IOException,
                                        ParseException

Description copied from class: IntermediateRowParsingReader

Parses the given intermediate row into a list of InputRows. This should return a non-empty list.

Specified by:

parseInputRows in class IntermediateRowParsingReader<String>

Throws:

ParseException - if it cannot parse the given intermediateRow properly

IOException

toMap

protected List<Map<String,Object>> toMap(String intermediateRow)
                                        throws IOException

Description copied from class: IntermediateRowParsingReader

Converts the given intermediate row into a Map. The returned JSON will be used by InputSourceSampler. Implementations can use any method to convert the given row into a Map. This should return a non-empty list with the same size of the list returned by IntermediateRowParsingReader.parseInputRows(T) or the returned objects will be discarded

Specified by:

toMap in class IntermediateRowParsingReader<String>

Throws:

IOException