Package org.apache.druid.segment.nested

Class NestedCommonFormatColumnSerializer

java.lang.Object

org.apache.druid.segment.nested.NestedCommonFormatColumnSerializer

All Implemented Interfaces:

GenericColumnSerializer<StructuredData>, Serializer

Direct Known Subclasses:

NestedDataColumnSerializer, ScalarNestedCommonFormatColumnSerializer, VariantColumnSerializer

public abstract class NestedCommonFormatColumnSerializer
extends Object
implements GenericColumnSerializer<StructuredData>

Basic serializer implementation for the NestedCommonFormatColumn family of columns. The AutoTypeColumnIndexer catalogs the types and fields present in the data it processes using a StructuredDataProcessor. When persisting and merging segments, the AutoTypeColumnMerger will choose the most appropriate serializer based on the data which was processed as follows:

See Also:

- single type double columns, - single type long columns, - single type string columns, - single type array columns of string, long, double, and mixed type columns, - nested columns

Field Summary

Fields

Modifier and Type	Field	Description
static String	NESTED_FIELD_PREFIX
static String	RAW_FILE_NAME
static byte	V0

Constructor Summary

Constructors

Constructor	Description
NestedCommonFormatColumnSerializer()

Method Summary

Modifier and Type	Method	Description
protected ByteBuffer	computeFilenameBytes()
protected static void	copyFromTempSmoosh(FileSmoosher smoosher, SmooshedFileMapper fileMapper)
abstract String	getColumnName()
abstract DictionaryIdLookup	getDictionaryIdLookup()
abstract boolean	hasNulls()
abstract void	openDictionaryWriter(File segmentBaseDir)
abstract void	serializeDictionaries(Iterable<String> strings, Iterable<Long> longs, Iterable<Double> doubles, Iterable<int[]> arrays)
void	serializeFields(SortedMap<String,FieldTypeInfo.MutableTypeSet> fields)
abstract void	setDictionaryIdLookup(DictionaryIdLookup dictionaryIdLookup)
protected void	writeInternal(FileSmoosher smoosher, Serializer serializer, String fileName)
static void	writeV0Header(WritableByteChannel channel, ByteBuffer columnNameBuffer)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.druid.segment.GenericColumnSerializer

open, serialize

Methods inherited from interface org.apache.druid.segment.serde.Serializer

getSerializedSize, writeTo

Field Detail

V0

public static final byte V0

See Also:

Constant Field Values

RAW_FILE_NAME

public static final String RAW_FILE_NAME

See Also:

Constant Field Values

NESTED_FIELD_PREFIX

public static final String NESTED_FIELD_PREFIX

See Also:

Constant Field Values

Constructor Detail

NestedCommonFormatColumnSerializer

public NestedCommonFormatColumnSerializer()

Method Detail

openDictionaryWriter

public abstract void openDictionaryWriter(File segmentBaseDir)
                                   throws IOException

Throws:

IOException

serializeFields

public void serializeFields(SortedMap<String,FieldTypeInfo.MutableTypeSet> fields)
                     throws IOException

Throws:

IOException

serializeDictionaries

public abstract void serializeDictionaries(Iterable<String> strings,
                                           Iterable<Long> longs,
                                           Iterable<Double> doubles,
                                           Iterable<int[]> arrays)
                                    throws IOException

Throws:

IOException

getColumnName

public abstract String getColumnName()

getDictionaryIdLookup

public abstract DictionaryIdLookup getDictionaryIdLookup()

setDictionaryIdLookup

public abstract void setDictionaryIdLookup(DictionaryIdLookup dictionaryIdLookup)

hasNulls

public abstract boolean hasNulls()

writeInternal

protected void writeInternal(FileSmoosher smoosher,
                             Serializer serializer,
                             String fileName)
                      throws IOException

Throws:

IOException

copyFromTempSmoosh

protected static void copyFromTempSmoosh(FileSmoosher smoosher,
                                         SmooshedFileMapper fileMapper)
                                  throws IOException

Throws:

IOException

writeV0Header

public static void writeV0Header(WritableByteChannel channel,
                                 ByteBuffer columnNameBuffer)
                          throws IOException

Throws:

IOException

computeFilenameBytes

protected ByteBuffer computeFilenameBytes()