org.apache.flink.table.data.binary

类 LazyBinaryFormat<T>

java.lang.Object

org.apache.flink.table.data.binary.LazyBinaryFormat<T>

所有已实现的接口:

BinaryFormat

直接已知子类:

BinaryRawValueData, BinaryStringData

@Internal
public abstract class LazyBinaryFormat<T>
extends Object
implements BinaryFormat

An abstract implementation fo BinaryFormat which is lazily serialized into binary or lazily deserialized into Java object.

The reason why we introduce this data structure is in order to save (de)serialization in nested function calls. Consider the following function call chain:

UDF0(input) -> UDF1(result0) -> UDF2(result1) -> UDF3(result2)

Such nested calls, if the return values of UDFs are Java object format, it will result in multiple conversions between Java object and binary format:

 converterToBinary(UDF0(converterToJavaObject(input))) ->
   converterToBinary(UDF1(converterToJavaObject(result0))) ->
     converterToBinary(UDF2(converterToJavaObject(result1))) ->
       ...
 

So we introduced LazyBinaryFormat to avoid the redundant cost, it has three forms:

• Binary form
• Java object form
• Binary and Java object both exist

It can lazy the conversions as much as possible. It will be converted into required form only when it is needed.

字段概要

从接口继承的字段 org.apache.flink.table.data.binary.BinaryFormat

HIGHEST_FIRST_BIT, HIGHEST_SECOND_TO_EIGHTH_BIT, MAX_FIX_PART_DATA_SIZE

构造器概要

构造器

构造器和说明
LazyBinaryFormat()
LazyBinaryFormat(org.apache.flink.core.memory.MemorySegment[] segments, int offset, int sizeInBytes)
LazyBinaryFormat(org.apache.flink.core.memory.MemorySegment[] segments, int offset, int sizeInBytes, T javaObject)
LazyBinaryFormat(T javaObject)
LazyBinaryFormat(T javaObject, BinarySection binarySection)

方法概要

限定符和类型	方法和说明
void	ensureMaterialized(org.apache.flink.api.common.typeutils.TypeSerializer<T> serializer) Ensure we have materialized binary format.
BinarySection	getBinarySection()
T	getJavaObject()
int	getOffset() Gets the start offset of this binary data in the MemorySegments.
org.apache.flink.core.memory.MemorySegment[]	getSegments() Gets the underlying MemorySegments this binary format spans.
int	getSizeInBytes() Gets the size in bytes of this binary data.
protected abstract BinarySection	materialize(org.apache.flink.api.common.typeutils.TypeSerializer<T> serializer) Materialize java object to binary format.
void	setJavaObject(T javaObject) Must be public as it is used during code generation.

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

LazyBinaryFormat

public LazyBinaryFormat()

LazyBinaryFormat

public LazyBinaryFormat(org.apache.flink.core.memory.MemorySegment[] segments,
                        int offset,
                        int sizeInBytes,
                        T javaObject)

LazyBinaryFormat

public LazyBinaryFormat(org.apache.flink.core.memory.MemorySegment[] segments,
                        int offset,
                        int sizeInBytes)

LazyBinaryFormat

public LazyBinaryFormat(T javaObject)

LazyBinaryFormat

public LazyBinaryFormat(T javaObject,
                        BinarySection binarySection)

方法详细资料

getJavaObject

public T getJavaObject()

getBinarySection

public BinarySection getBinarySection()

setJavaObject

public void setJavaObject(T javaObject)

Must be public as it is used during code generation.

getSegments

public org.apache.flink.core.memory.MemorySegment[] getSegments()

从接口复制的说明: BinaryFormat

Gets the underlying MemorySegments this binary format spans.

指定者:

getSegments 在接口中 BinaryFormat

getOffset

public int getOffset()

从接口复制的说明: BinaryFormat

Gets the start offset of this binary data in the MemorySegments.

指定者:

getOffset 在接口中 BinaryFormat

getSizeInBytes

public int getSizeInBytes()

从接口复制的说明: BinaryFormat

Gets the size in bytes of this binary data.

指定者:

getSizeInBytes 在接口中 BinaryFormat

ensureMaterialized

public final void ensureMaterialized(org.apache.flink.api.common.typeutils.TypeSerializer<T> serializer)

Ensure we have materialized binary format.

materialize

protected abstract BinarySection materialize(org.apache.flink.api.common.typeutils.TypeSerializer<T> serializer)
                                      throws IOException

Materialize java object to binary format. Inherited classes need to hold the information they need. (For example, RawValueData needs javaObjectSerializer).

抛出:

IOException