Package org.apache.druid.segment
Class NumericDimensionMergerV9
- java.lang.Object
-
- org.apache.druid.segment.NumericDimensionMergerV9
-
- All Implemented Interfaces:
DimensionMerger
,DimensionMergerV9
- Direct Known Subclasses:
DoubleDimensionMergerV9
,FloatDimensionMergerV9
,LongDimensionMergerV9
public abstract class NumericDimensionMergerV9 extends Object implements DimensionMergerV9
-
-
Field Summary
Fields Modifier and Type Field Description protected String
dimensionName
protected IndexSpec
indexSpec
protected SegmentWriteOutMedium
segmentWriteOutMedium
protected GenericColumnSerializer
serializer
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description ColumnValueSelector
convertSortedSegmentRowValuesToMergedRowValues(int segmentIndex, ColumnValueSelector source)
Creates a value selector, which converts values with per-segment, _sorted order_ (seeDimensionIndexer.convertUnsortedValuesToSorted(org.apache.druid.segment.ColumnValueSelector)
) encoding from the given selector to their equivalent representation in the merged set of rows.boolean
hasOnlyNulls()
Returns true if this dimension has no data besides nulls.void
processMergedRow(ColumnValueSelector selector)
Process a column value(s) (potentially multi-value) of a row from the given selector and update the DimensionMerger's internal state.void
writeIndexes(List<IntBuffer> segmentRowNumConversions)
Internally construct any index structures relevant to this DimensionMerger.void
writeMergedValueDictionary(List<IndexableAdapter> adapters)
Given a list of segment adapters: - Read _sorted order_ (e.-
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
-
Methods inherited from interface org.apache.druid.segment.DimensionMergerV9
makeColumnDescriptor
-
-
-
-
Field Detail
-
dimensionName
protected final String dimensionName
-
indexSpec
protected final IndexSpec indexSpec
-
segmentWriteOutMedium
protected final SegmentWriteOutMedium segmentWriteOutMedium
-
serializer
protected final GenericColumnSerializer serializer
-
-
Method Detail
-
writeMergedValueDictionary
public final void writeMergedValueDictionary(List<IndexableAdapter> adapters)
Description copied from interface:DimensionMerger
Given a list of segment adapters: - Read _sorted order_ (e. g. seeIncrementalIndexAdapter.getDimValueLookup(String)
) dictionary encoding information from the adapters - Merge those sorted order dictionary into a one big sorted order dictionary and write this merged dictionary. The implementer should maintain knowledge of the "index number" of the adapters in the input list, i.e., the position of each adapter in the input list. This "index number" will be used to refer to specific segments later inDimensionMerger.convertSortedSegmentRowValuesToMergedRowValues(int, org.apache.druid.segment.ColumnValueSelector)
.- Specified by:
writeMergedValueDictionary
in interfaceDimensionMerger
- Parameters:
adapters
- List of adapters to be merged.- See Also:
DimensionIndexer.convertUnsortedValuesToSorted(org.apache.druid.segment.ColumnValueSelector)
-
convertSortedSegmentRowValuesToMergedRowValues
public final ColumnValueSelector convertSortedSegmentRowValuesToMergedRowValues(int segmentIndex, ColumnValueSelector source)
Description copied from interface:DimensionMerger
Creates a value selector, which converts values with per-segment, _sorted order_ (seeDimensionIndexer.convertUnsortedValuesToSorted(org.apache.druid.segment.ColumnValueSelector)
) encoding from the given selector to their equivalent representation in the merged set of rows. This method is used by the index merging process to build the merged sequence of rows. The implementing class is expected to use the merged value metadata constructed duringDimensionMerger.writeMergedValueDictionary(List)
, if applicable. For example, an implementation of this function for a dictionary-encoded String column would convert the segment-specific, sorted order dictionary values within the row to the common merged dictionary values determined duringDimensionMerger.writeMergedValueDictionary(List)
.- Specified by:
convertSortedSegmentRowValuesToMergedRowValues
in interfaceDimensionMerger
- Parameters:
segmentIndex
- indicates which segment the row originated from, in the order established inDimensionMerger.writeMergedValueDictionary(List)
source
- the selector from which to take values to convert- Returns:
- a selector with converted values
-
processMergedRow
public final void processMergedRow(ColumnValueSelector selector) throws IOException
Description copied from interface:DimensionMerger
Process a column value(s) (potentially multi-value) of a row from the given selector and update the DimensionMerger's internal state. After constructing a merged sequence of rows across segments, the index merging process will iterate through these rows and on each iteration, for each column, pass the column value selector to the corresponding DimensionMerger. This allows each DimensionMerger to build its internal view of the sequence of merged rows, to be written out to a segment later.- Specified by:
processMergedRow
in interfaceDimensionMerger
- Throws:
IOException
-
writeIndexes
public final void writeIndexes(@Nullable List<IntBuffer> segmentRowNumConversions)
Description copied from interface:DimensionMerger
Internally construct any index structures relevant to this DimensionMerger. After receiving the sequence of merged rows via iteratedDimensionMerger.processMergedRow(org.apache.druid.segment.ColumnValueSelector)
calls, the DimensionMerger can now build any index structures it needs. For example, a dictionary encoded String implementation would create its bitmap indexes for the merged segment during this step. The index merger will provide a list of row number conversion IntBuffer objects. Each IntBuffer is associated with one of the segments being merged; the position of the IntBuffer in the list corresponds to the position of segment adapters within the input list ofDimensionMerger.writeMergedValueDictionary(List)
. For example, suppose there are two segments A and B. Row 24 from segment A maps to row 99 in the merged sequence of rows, The IntBuffer for segment A would have a mapping of 24 -> 99.- Specified by:
writeIndexes
in interfaceDimensionMerger
- Parameters:
segmentRowNumConversions
- A list of row number conversion IntBuffer objects.
-
hasOnlyNulls
public boolean hasOnlyNulls()
Description copied from interface:DimensionMerger
Returns true if this dimension has no data besides nulls. SeeNullColumnPartSerde
for how null-only columns are stored in the segment.- Specified by:
hasOnlyNulls
in interfaceDimensionMerger
-
-