org.apache.druid.segment.nested

Class ScalarNestedCommonFormatColumnSerializer<T>

java.lang.Object

org.apache.druid.segment.nested.NestedCommonFormatColumnSerializer

org.apache.druid.segment.nested.ScalarNestedCommonFormatColumnSerializer<T>

All Implemented Interfaces:

GenericColumnSerializer<StructuredData>, Serializer

Direct Known Subclasses:

ScalarDoubleColumnSerializer, ScalarLongColumnSerializer, ScalarStringColumnSerializer

public abstract class ScalarNestedCommonFormatColumnSerializer<T>
extends NestedCommonFormatColumnSerializer

Field Summary

Fields

Modifier and Type	Field and Description
protected boolean	closedForWrite
protected Closer	closer
protected ByteBuffer	columnNameBytes
protected String	dictionaryFileName
protected DictionaryIdLookup	dictionaryIdLookup
protected boolean	dictionarySerialized
protected DictionaryWriter<T>	dictionaryWriter
protected boolean	hasNulls
protected IndexSpec	indexSpec
protected FixedIndexedIntWriter	intermediateValueWriter
protected static Logger	log
protected String	name
protected SegmentWriteOutMedium	segmentWriteOutMedium

Fields inherited from class org.apache.druid.segment.nested.NestedCommonFormatColumnSerializer

ARRAY_DICTIONARY_FILE_NAME, ARRAY_ELEMENT_BITMAP_INDEX_FILE_NAME, ARRAY_ELEMENT_DICTIONARY_FILE_NAME, BITMAP_INDEX_FILE_NAME, DOUBLE_DICTIONARY_FILE_NAME, DOUBLE_VALUE_COLUMN_FILE_NAME, ENCODED_VALUE_COLUMN_FILE_NAME, LONG_DICTIONARY_FILE_NAME, LONG_VALUE_COLUMN_FILE_NAME, NESTED_FIELD_PREFIX, NULL_BITMAP_FILE_NAME, RAW_FILE_NAME, STRING_DICTIONARY_FILE_NAME, V0

Constructor Summary

Constructors

Constructor and Description
ScalarNestedCommonFormatColumnSerializer(String name, String dictionaryFileName, IndexSpec indexSpec, SegmentWriteOutMedium segmentWriteOutMedium, Closer closer)

Method Summary

Modifier and Type	Method and Description
String	getColumnName()
DictionaryIdLookup	getGlobalLookup()
long	getSerializedSize() Returns the number of bytes, that this Serializer will write to the output _channel_ (not smoosher) on a Serializer.writeTo(java.nio.channels.WritableByteChannel, org.apache.druid.java.util.common.io.smoosh.FileSmoosher) call.
boolean	hasNulls()
void	open()
protected abstract void	openValueColumnSerializer() Called during open() to allow opening any separate type specific value column serializers
protected abstract int	processValue(Object rawValue) Called during serialize(ColumnValueSelector) to convert value to dictionary id.
void	serialize(ColumnValueSelector<? extends StructuredData> selector)
void	writeTo(WritableByteChannel channel, FileSmoosher smoosher) Writes serialized form of this object to the given channel.
protected abstract void	writeValueColumn(FileSmoosher smoosher) Called during writeTo(WritableByteChannel, FileSmoosher) to allow any type specific value column serializers to use the FileSmoosher to write stuff to places.

Methods inherited from class org.apache.druid.segment.nested.NestedCommonFormatColumnSerializer

computeFilenameBytes, getInternalFileName, openDictionaryWriter, serializeDictionaries, serializeFields, writeInternal, writeV0Header

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

log

protected static final Logger log

name

protected final String name

segmentWriteOutMedium

protected final SegmentWriteOutMedium segmentWriteOutMedium

indexSpec

protected final IndexSpec indexSpec

closer

protected final Closer closer

dictionaryFileName

protected final String dictionaryFileName

dictionaryIdLookup

protected DictionaryIdLookup dictionaryIdLookup

dictionaryWriter

protected DictionaryWriter<T> dictionaryWriter

closedForWrite

protected boolean closedForWrite

dictionarySerialized

protected boolean dictionarySerialized

intermediateValueWriter

protected FixedIndexedIntWriter intermediateValueWriter

columnNameBytes

protected ByteBuffer columnNameBytes

hasNulls

protected boolean hasNulls

Constructor Detail

ScalarNestedCommonFormatColumnSerializer

public ScalarNestedCommonFormatColumnSerializer(String name,
                                                String dictionaryFileName,
                                                IndexSpec indexSpec,
                                                SegmentWriteOutMedium segmentWriteOutMedium,
                                                Closer closer)

Method Detail

processValue

protected abstract int processValue(@Nullable
                                    Object rawValue)
                             throws IOException

Called during serialize(ColumnValueSelector) to convert value to dictionary id.

Implementations may optionally also serialize the value to a type specific value column if they opened one with openValueColumnSerializer(), or do whatever else is useful to do while handling a single row value.

Throws:

IOException

openValueColumnSerializer

protected abstract void openValueColumnSerializer()
                                           throws IOException

Called during open() to allow opening any separate type specific value column serializers

Throws:

IOException

writeValueColumn

protected abstract void writeValueColumn(FileSmoosher smoosher)
                                  throws IOException

Called during writeTo(WritableByteChannel, FileSmoosher) to allow any type specific value column serializers to use the FileSmoosher to write stuff to places.

Throws:

IOException

getColumnName

public String getColumnName()

Specified by:

getColumnName in class NestedCommonFormatColumnSerializer

getGlobalLookup

public DictionaryIdLookup getGlobalLookup()

Specified by:

getGlobalLookup in class NestedCommonFormatColumnSerializer

hasNulls

public boolean hasNulls()

Specified by:

hasNulls in class NestedCommonFormatColumnSerializer

open

public void open()
          throws IOException

Throws:

IOException

serialize

public void serialize(ColumnValueSelector<? extends StructuredData> selector)
               throws IOException

Throws:

IOException

getSerializedSize

public long getSerializedSize()

Description copied from interface: Serializer

Returns the number of bytes, that this Serializer will write to the output _channel_ (not smoosher) on a Serializer.writeTo(java.nio.channels.WritableByteChannel, org.apache.druid.java.util.common.io.smoosh.FileSmoosher) call.

writeTo

public void writeTo(WritableByteChannel channel,
                    FileSmoosher smoosher)
             throws IOException

Description copied from interface: Serializer

Writes serialized form of this object to the given channel. If parallel data streams are needed, they could be created with the provided smoosher.

Throws:

IOException