Class LengthPrefixCoder<T>
- java.lang.Object
-
- org.apache.beam.sdk.coders.Coder<T>
-
- org.apache.beam.sdk.coders.StructuredCoder<T>
-
- org.apache.beam.sdk.coders.LengthPrefixCoder<T>
-
- Type Parameters:
T
- the type of the values being transcoded
- All Implemented Interfaces:
java.io.Serializable
public class LengthPrefixCoder<T> extends StructuredCoder<T>
ACoder
which is able to take any existing coder and wrap it such that it is only invoked in theouter context
. The data representing the element is prefixed with a length using a variable integer encoding.- See Also:
- Serialized Form
-
-
Nested Class Summary
-
Nested classes/interfaces inherited from class org.apache.beam.sdk.coders.Coder
Coder.Context, Coder.NonDeterministicException
-
-
Method Summary
All Methods Static Methods Instance Methods Concrete Methods Modifier and Type Method Description boolean
consistentWithEquals()
LengthPrefixCoder
is consistent with equals if the nestedCoder
is.T
decode(java.io.InputStream inStream)
Decodes a value of typeT
from the given input stream in the given context.void
encode(T value, java.io.OutputStream outStream)
Encodes the given value of typeT
onto the given output stream.java.util.List<? extends Coder<?>>
getCoderArguments()
protected long
getEncodedElementByteSize(T value)
Overridden to short-circuit the defaultStructuredCoder
behavior of encoding and counting the bytes.Coder<T>
getValueCoder()
Gets the value coder that will be prefixed by the length.boolean
isRegisterByteSizeObserverCheap(T value)
LengthPrefixCoder
is cheap ifvalueCoder
is cheap.static <T> LengthPrefixCoder<T>
of(Coder<T> valueCoder)
void
verifyDeterministic()
LengthPrefixCoder
is deterministic if the nestedCoder
is.-
Methods inherited from class org.apache.beam.sdk.coders.StructuredCoder
equals, getComponents, hashCode, toString
-
Methods inherited from class org.apache.beam.sdk.coders.Coder
decode, encode, getEncodedTypeDescriptor, registerByteSizeObserver, structuralValue, verifyDeterministic, verifyDeterministic
-
-
-
-
Method Detail
-
of
public static <T> LengthPrefixCoder<T> of(Coder<T> valueCoder)
-
encode
public void encode(T value, java.io.OutputStream outStream) throws CoderException, java.io.IOException
Description copied from class:Coder
Encodes the given value of typeT
onto the given output stream.- Specified by:
encode
in classCoder<T>
- Throws:
CoderException
- if the value could not be encoded for some reasonjava.io.IOException
- if writing to theOutputStream
fails for some reason
-
decode
public T decode(java.io.InputStream inStream) throws CoderException, java.io.IOException
Description copied from class:Coder
Decodes a value of typeT
from the given input stream in the given context. Returns the decoded value.- Specified by:
decode
in classCoder<T>
- Throws:
CoderException
- if the value could not be decoded for some reasonjava.io.IOException
- if reading from theInputStream
fails for some reason
-
getCoderArguments
public java.util.List<? extends Coder<?>> getCoderArguments()
Description copied from class:Coder
If this is aCoder
for a parameterized type, returns the list ofCoder
s being used for each of the parameters in the same order they appear within the parameterized type's type signature. If this cannot be done, or thisCoder
does not encode/decode a parameterized type, returns the empty list.- Specified by:
getCoderArguments
in classCoder<T>
-
getValueCoder
public Coder<T> getValueCoder()
Gets the value coder that will be prefixed by the length.
-
verifyDeterministic
public void verifyDeterministic() throws Coder.NonDeterministicException
LengthPrefixCoder
is deterministic if the nestedCoder
is.Throw
Coder.NonDeterministicException
if the coding is not deterministic.In order for a
Coder
to be considered deterministic, the following must be true:- two values that compare as equal (via
Object.equals()
orComparable.compareTo()
, if supported) have the same encoding. - the
Coder
always produces a canonical encoding, which is the same for an instance of an object even if produced on different computers at different times.
- Specified by:
verifyDeterministic
in classCoder<T>
- Throws:
Coder.NonDeterministicException
- if this coder is not deterministic.
- two values that compare as equal (via
-
consistentWithEquals
public boolean consistentWithEquals()
LengthPrefixCoder
is consistent with equals if the nestedCoder
is.Returns
true
if thisCoder
is injective with respect toObject.equals(java.lang.Object)
.Whenever the encoded bytes of two values are equal, then the original values are equal according to
Objects.equals()
. Note that this is well-defined fornull
.This condition is most notably false for arrays. More generally, this condition is false whenever
equals()
compares object identity, rather than performing a semantic/structural comparison.By default, returns false.
- Overrides:
consistentWithEquals
in classCoder<T>
-
getEncodedElementByteSize
protected long getEncodedElementByteSize(T value) throws java.lang.Exception
Overridden to short-circuit the defaultStructuredCoder
behavior of encoding and counting the bytes. The size is known to be the size of the value plus the number of bytes required to prefix the length.Returns the size in bytes of the encoded value using this coder.
- Overrides:
getEncodedElementByteSize
in classCoder<T>
- Throws:
java.lang.Exception
-
isRegisterByteSizeObserverCheap
public boolean isRegisterByteSizeObserverCheap(T value)
LengthPrefixCoder
is cheap ifvalueCoder
is cheap.Returns whether
Coder.registerByteSizeObserver(T, org.apache.beam.sdk.util.common.ElementByteSizeObserver)
cheap enough to call for every element, that is, if thisCoder
can calculate the byte size of the element to be coded in roughly constant time (or lazily).Not intended to be called by user code, but instead by
PipelineRunner
implementations.By default, returns false. The default
Coder.registerByteSizeObserver(T, org.apache.beam.sdk.util.common.ElementByteSizeObserver)
implementation invokesCoder.getEncodedElementByteSize(T)
which requires re-encoding an element unless it is overridden. This is considered expensive.- Overrides:
isRegisterByteSizeObserverCheap
in classCoder<T>
-
-