org.apache.parquet.column.values.dictionary

Class DictionaryValuesWriter.PlainBinaryDictionaryValuesWriter

java.lang.Object

org.apache.parquet.column.values.ValuesWriter

org.apache.parquet.column.values.dictionary.DictionaryValuesWriter

org.apache.parquet.column.values.dictionary.DictionaryValuesWriter.PlainBinaryDictionaryValuesWriter

All Implemented Interfaces:

AutoCloseable, RequiresFallback

Direct Known Subclasses:

DictionaryValuesWriter.PlainFixedLenArrayDictionaryValuesWriter

Enclosing class:

DictionaryValuesWriter

public static class DictionaryValuesWriter.PlainBinaryDictionaryValuesWriter
extends DictionaryValuesWriter

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.parquet.column.values.dictionary.DictionaryValuesWriter

DictionaryValuesWriter.PlainBinaryDictionaryValuesWriter, DictionaryValuesWriter.PlainDoubleDictionaryValuesWriter, DictionaryValuesWriter.PlainFixedLenArrayDictionaryValuesWriter, DictionaryValuesWriter.PlainFloatDictionaryValuesWriter, DictionaryValuesWriter.PlainIntegerDictionaryValuesWriter, DictionaryValuesWriter.PlainLongDictionaryValuesWriter

Field Summary

Fields

Modifier and Type	Field and Description
protected it.unimi.dsi.fastutil.objects.Object2IntMap<Binary>	binaryDictionaryContent

Fields inherited from class org.apache.parquet.column.values.dictionary.DictionaryValuesWriter

allocator, dictionaryByteSize, dictionaryTooBig, encodedValues, encodingForDictionaryPage, firstPage, lastUsedDictionaryByteSize, lastUsedDictionarySize, maxDictionaryByteSize

Constructor Summary

Constructors

Constructor and Description
PlainBinaryDictionaryValuesWriter(int maxDictionaryByteSize, Encoding encodingForDataPage, Encoding encodingForDictionaryPage, ByteBufferAllocator allocator)

Method Summary

Modifier and Type	Method and Description
protected void	clearDictionaryContent() clear/free the underlying dictionary content
void	fallBackDictionaryEncodedData(ValuesWriter writer)
int	getDictionarySize()
DictionaryPage	toDictPageAndClose() Returns the dictionary generated by this writer if one was created.
void	writeBytes(Binary v)

Methods inherited from class org.apache.parquet.column.values.dictionary.DictionaryValuesWriter

close, dictPage, fallBackAllValuesTo, getAllocatedSize, getBufferedSize, getBytes, getEncoding, isCompressionSatisfying, memUsageString, reset, resetDictionary, shouldFallBack

Methods inherited from class org.apache.parquet.column.values.ValuesWriter

writeBoolean, writeByte, writeDouble, writeFloat, writeInteger, writeLong

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

binaryDictionaryContent

protected it.unimi.dsi.fastutil.objects.Object2IntMap<Binary> binaryDictionaryContent

Constructor Detail

PlainBinaryDictionaryValuesWriter

public PlainBinaryDictionaryValuesWriter(int maxDictionaryByteSize,
                                         Encoding encodingForDataPage,
                                         Encoding encodingForDictionaryPage,
                                         ByteBufferAllocator allocator)

Method Detail

writeBytes

public void writeBytes(Binary v)

Overrides:

writeBytes in class ValuesWriter

Parameters:

v - the value to encode

toDictPageAndClose

public DictionaryPage toDictPageAndClose()

Description copied from class: ValuesWriter

Returns the dictionary generated by this writer if one was created. As part of this operation the dictionary is closed and will not have any new values written into it.

Overrides:

toDictPageAndClose in class ValuesWriter

Returns:

the dictionary page or null if not dictionary based

getDictionarySize

public int getDictionarySize()

Specified by:

getDictionarySize in class DictionaryValuesWriter

Returns:

size in items

clearDictionaryContent

protected void clearDictionaryContent()

Description copied from class: DictionaryValuesWriter

clear/free the underlying dictionary content

Specified by:

clearDictionaryContent in class DictionaryValuesWriter

fallBackDictionaryEncodedData

public void fallBackDictionaryEncodedData(ValuesWriter writer)

Specified by:

fallBackDictionaryEncodedData in class DictionaryValuesWriter