Package org.apache.druid.segment.nested

Class CompressedNestedDataComplexColumn<TStringDictionary extends Indexed<ByteBuffer>>

java.lang.Object

org.apache.druid.segment.nested.NestedDataComplexColumn

org.apache.druid.segment.nested.CompressedNestedDataComplexColumn<TStringDictionary>

All Implemented Interfaces:

Closeable, AutoCloseable, BaseColumn, ComplexColumn, NestedCommonFormatColumn

Direct Known Subclasses:

NestedDataColumnV3, NestedDataColumnV4, NestedDataColumnV5

public abstract class CompressedNestedDataComplexColumn<TStringDictionary extends Indexed<ByteBuffer>>
extends NestedDataComplexColumn
implements NestedCommonFormatColumn

Implementation of NestedDataComplexColumn which uses a CompressedVariableSizedBlobColumn for the 'raw' StructuredData values and provides selectors for nested field columns specified by ordered lists of NestedPathPart.

The list of available nested paths is stored in fields, and their associated types stored in fieldInfo which can be accessed by the index of the field in fields.

In the case that the nested column has only a single field, and that field is the 'root' path, specified by rootFieldPath, the selectors created for the complex column itself will use the 'root' path selectors instead.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.druid.segment.nested.NestedCommonFormatColumn

NestedCommonFormatColumn.Format

Field Summary

Fields

Modifier and Type	Field	Description
static org.apache.druid.segment.nested.CompressedNestedDataComplexColumn.IntTypeStrategy	INT_TYPE_STRATEGY

Constructor Summary

Constructors

Constructor

Description

CompressedNestedDataComplexColumn(String columnName, ColumnType logicalType, ColumnConfig columnConfig, CompressedVariableSizedBlobColumnSupplier compressedRawColumnSupplier, ImmutableBitmap nullValues, GenericIndexed<String> fields, FieldTypeInfo fieldInfo, com.google.common.base.Supplier<TStringDictionary> stringDictionary, com.google.common.base.Supplier<FixedIndexed<Long>> longDictionarySupplier, com.google.common.base.Supplier<FixedIndexed<Double>> doubleDictionarySupplier, com.google.common.base.Supplier<FrontCodedIntArrayIndexed> arrayDictionarySupplier, SmooshedFileMapper fileMapper, BitmapSerdeFactory bitmapSerdeFactory, ByteOrder byteOrder, String rootFieldPath)

Method Summary

Modifier and Type	Method	Description
void	close()	Close and release any resources associated with this column.
Indexed<Object[]>	getArrayDictionary()
ColumnHolder	getColumnHolder(List<NestedPathPart> path)	Get a ColumnHolder for a nested field column to retrieve metadata, the column itself, or indexes.
ColumnIndexSupplier	getColumnIndexSupplier(List<NestedPathPart> path)	Make a ColumnIndexSupplier for a nested field column
Set<ColumnType>	getColumnTypes(List<NestedPathPart> path)	Get all ColumnType for the nested field column
Indexed<Double>	getDoubleDictionary()
abstract String	getField(List<NestedPathPart> path)
abstract String	getFieldFileName(String fileNameBase, String field, int fieldIndex)
SortedMap<String,FieldTypeInfo.MutableTypeSet>	getFieldTypeInfo()
int	getLength()
ColumnType	getLogicalType()
Indexed<Long>	getLongDictionary()
List<List<NestedPathPart>>	getNestedFields()	Get list of fields represented as a sequence of NestedPathPart
ImmutableBitmap	getNullValues()
Object	getRowValue(int rowNum)	Return rows in the column.
Indexed<String>	getStringDictionary()
TStringDictionary	getUtf8BytesDictionary()
boolean	isNumeric(List<NestedPathPart> path)	Shortcut to check if a nested field column is TypeSignature.isNumeric(), useful when broadly choosing the type of vector selector to be used when dealing with the path
ColumnValueSelector<?>	makeColumnValueSelector(List<NestedPathPart> path, ReadableOffset readableOffset)	Make a ColumnValueSelector for a nested field column
ColumnValueSelector<?>	makeColumnValueSelector(ReadableOffset offset)	Optionally overridden when complex column serialization is not based on default serialization based on GenericIndexed in ComplexColumnSerializer.
DimensionSelector	makeDimensionSelector(List<NestedPathPart> path, ReadableOffset readableOffset, ExtractionFn fn)	Make a DimensionSelector for a nested field column
SingleValueDimensionVectorSelector	makeSingleValueDimensionVectorSelector(List<NestedPathPart> path, ReadableVectorOffset readableOffset)	Make a SingleValueDimensionVectorSelector for a nested field column
VectorObjectSelector	makeVectorObjectSelector(List<NestedPathPart> path, ReadableVectorOffset readableOffset)	Make a VectorObjectSelector for a nested field column
VectorObjectSelector	makeVectorObjectSelector(ReadableVectorOffset offset)
VectorValueSelector	makeVectorValueSelector(List<NestedPathPart> path, ReadableVectorOffset readableOffset)	Make a VectorValueSelector for a nested field column
VectorValueSelector	makeVectorValueSelector(ReadableVectorOffset offset)
abstract List<NestedPathPart>	parsePath(String path)

Methods inherited from class org.apache.druid.segment.nested.NestedDataComplexColumn

getClazz, getTypeName

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

INT_TYPE_STRATEGY

public static final org.apache.druid.segment.nested.CompressedNestedDataComplexColumn.IntTypeStrategy INT_TYPE_STRATEGY

Constructor Detail

CompressedNestedDataComplexColumn

public CompressedNestedDataComplexColumn(String columnName,
                                         ColumnType logicalType,
                                         ColumnConfig columnConfig,
                                         CompressedVariableSizedBlobColumnSupplier compressedRawColumnSupplier,
                                         ImmutableBitmap nullValues,
                                         GenericIndexed<String> fields,
                                         FieldTypeInfo fieldInfo,
                                         com.google.common.base.Supplier<TStringDictionary> stringDictionary,
                                         com.google.common.base.Supplier<FixedIndexed<Long>> longDictionarySupplier,
                                         com.google.common.base.Supplier<FixedIndexed<Double>> doubleDictionarySupplier,
                                         @Nullable
                                         com.google.common.base.Supplier<FrontCodedIntArrayIndexed> arrayDictionarySupplier,
                                         SmooshedFileMapper fileMapper,
                                         BitmapSerdeFactory bitmapSerdeFactory,
                                         ByteOrder byteOrder,
                                         String rootFieldPath)

Method Detail

parsePath

public abstract List<NestedPathPart> parsePath(String path)

getField

public abstract String getField(List<NestedPathPart> path)

getFieldFileName

public abstract String getFieldFileName(String fileNameBase,
                                        String field,
                                        int fieldIndex)

getFieldTypeInfo

public SortedMap<String,FieldTypeInfo.MutableTypeSet> getFieldTypeInfo()

Specified by:

getFieldTypeInfo in interface NestedCommonFormatColumn

getLogicalType

public ColumnType getLogicalType()

Specified by:

getLogicalType in interface NestedCommonFormatColumn

getNestedFields

public List<List<NestedPathPart>> getNestedFields()

Description copied from class: NestedDataComplexColumn

Get list of fields represented as a sequence of NestedPathPart

Specified by:

getNestedFields in class NestedDataComplexColumn

getUtf8BytesDictionary

public TStringDictionary getUtf8BytesDictionary()

getStringDictionary

public Indexed<String> getStringDictionary()

Specified by:

getStringDictionary in interface NestedCommonFormatColumn

getLongDictionary

public Indexed<Long> getLongDictionary()

Specified by:

getLongDictionary in interface NestedCommonFormatColumn

getDoubleDictionary

public Indexed<Double> getDoubleDictionary()

Specified by:

getDoubleDictionary in interface NestedCommonFormatColumn

getArrayDictionary

public Indexed<Object[]> getArrayDictionary()

Specified by:

getArrayDictionary in interface NestedCommonFormatColumn

getNullValues

public ImmutableBitmap getNullValues()

getRowValue

@Nullable
public Object getRowValue(int rowNum)

Description copied from interface: ComplexColumn

Return rows in the column.

Specified by:

getRowValue in interface ComplexColumn

Parameters:

rowNum - the row number

Returns:

row object of type same as ComplexColumn.getClazz() } at row number "rowNum" .

makeColumnValueSelector

public ColumnValueSelector<?> makeColumnValueSelector(ReadableOffset offset)

Description copied from interface: ComplexColumn

Optionally overridden when complex column serialization is not based on default serialization based on GenericIndexed in ComplexColumnSerializer.

Specified by:

makeColumnValueSelector in interface BaseColumn

Specified by:

makeColumnValueSelector in interface ComplexColumn

Parameters:

offset - object to retrieve row number

Returns:

the ColumnValueSelector object

makeVectorObjectSelector

public VectorObjectSelector makeVectorObjectSelector(ReadableVectorOffset offset)

Specified by:

makeVectorObjectSelector in interface BaseColumn

Specified by:

makeVectorObjectSelector in interface ComplexColumn

makeVectorValueSelector

public VectorValueSelector makeVectorValueSelector(ReadableVectorOffset offset)

Specified by:

makeVectorValueSelector in interface BaseColumn

getLength

public int getLength()

Specified by:

getLength in interface ComplexColumn

Returns:

serialized size (in bytes) of this column. -1 for unknown

close

public void close()

Description copied from interface: ComplexColumn

Close and release any resources associated with this column.

Specified by:

close in interface AutoCloseable

Specified by:

close in interface Closeable

Specified by:

close in interface ComplexColumn

makeDimensionSelector

public DimensionSelector makeDimensionSelector(List<NestedPathPart> path,
                                               ReadableOffset readableOffset,
                                               ExtractionFn fn)

Description copied from class: NestedDataComplexColumn

Make a DimensionSelector for a nested field column

Specified by:

makeDimensionSelector in class NestedDataComplexColumn

makeColumnValueSelector

public ColumnValueSelector<?> makeColumnValueSelector(List<NestedPathPart> path,
                                                      ReadableOffset readableOffset)

Description copied from class: NestedDataComplexColumn

Make a ColumnValueSelector for a nested field column

Specified by:

makeColumnValueSelector in class NestedDataComplexColumn

makeSingleValueDimensionVectorSelector

public SingleValueDimensionVectorSelector makeSingleValueDimensionVectorSelector(List<NestedPathPart> path,
                                                                                 ReadableVectorOffset readableOffset)

Description copied from class: NestedDataComplexColumn

Make a SingleValueDimensionVectorSelector for a nested field column

Specified by:

makeSingleValueDimensionVectorSelector in class NestedDataComplexColumn

makeVectorObjectSelector

public VectorObjectSelector makeVectorObjectSelector(List<NestedPathPart> path,
                                                     ReadableVectorOffset readableOffset)

Description copied from class: NestedDataComplexColumn

Make a VectorObjectSelector for a nested field column

Specified by:

makeVectorObjectSelector in class NestedDataComplexColumn

makeVectorValueSelector

public VectorValueSelector makeVectorValueSelector(List<NestedPathPart> path,
                                                   ReadableVectorOffset readableOffset)

Description copied from class: NestedDataComplexColumn

Make a VectorValueSelector for a nested field column

Specified by:

makeVectorValueSelector in class NestedDataComplexColumn

getColumnTypes

@Nullable
public Set<ColumnType> getColumnTypes(List<NestedPathPart> path)

Description copied from class: NestedDataComplexColumn

Get all ColumnType for the nested field column

Specified by:

getColumnTypes in class NestedDataComplexColumn

getColumnHolder

@Nullable
public ColumnHolder getColumnHolder(List<NestedPathPart> path)

Description copied from class: NestedDataComplexColumn

Get a ColumnHolder for a nested field column to retrieve metadata, the column itself, or indexes.

Specified by:

getColumnHolder in class NestedDataComplexColumn

getColumnIndexSupplier

@Nullable
public ColumnIndexSupplier getColumnIndexSupplier(List<NestedPathPart> path)

Description copied from class: NestedDataComplexColumn

Make a ColumnIndexSupplier for a nested field column

Specified by:

getColumnIndexSupplier in class NestedDataComplexColumn

isNumeric

public boolean isNumeric(List<NestedPathPart> path)

Description copied from class: NestedDataComplexColumn

Shortcut to check if a nested field column is TypeSignature.isNumeric(), useful when broadly choosing the type of vector selector to be used when dealing with the path

Specified by:

isNumeric in class NestedDataComplexColumn