@DefaultAnnotation(org.checkerframework.checker.nullness.qual.NonNull.class)
Package org.apache.beam.sdk.values
Defines
PCollection
and other classes for representing data in
a Pipeline
.
In particular, see these collection abstractions:
PCollection
- an immutable collection of values of typeT
and the main representation for data in Beam.PCollectionView
- an immutable view of aPCollection
that can be accessed as a side input of aParDo
PTransform
.PCollectionTuple
- a heterogeneous tuple ofPCollections
used in cases where aPTransform
takes or returns multiplePCollections
.PCollectionList
- a homogeneous list ofPCollections
used, for example, as input toFlatten
.
And these classes for individual values play particular roles in Beam:
KV
- a key/value pair that is used by keyed transforms, most notablyGroupByKey
.TimestampedValue
- a timestamp/value pair that is used for windowing and handling out-of-order data in streaming execution.
For further details, see the documentation for each class in this package.
-
Interface Summary Interface Description PCollectionView<T> APCollectionView<T>
is an immutable view of aPCollection
as a value of typeT
that can be accessed as a side input to aParDo
transform.PCollectionViews.HasDefaultValue<T> PCollectionViews.TypeDescriptorSupplier<T> PInput The interface for things that might be input to aPTransform
.POutput The interface for things that might be output from aPTransform
.PValue For internal use.TypeDescriptors.TypeVariableExtractor<InputT,OutputT> A helper interface for use withTypeDescriptors.extractFromTypeParameters(Object, Class, TypeVariableExtractor)
. -
Class Summary Class Description EncodableThrowable A wrapper around aThrowable
for use with coders.FailsafeValueInSingleWindow<T,ErrorT> An immutable tuple of value, timestamp, window, and pane.FailsafeValueInSingleWindow.Coder<T,ErrorT> A coder forFailsafeValueInSingleWindow
.KV<K,V> An immutable key/value pair.KV.OrderByKey<K extends java.lang.Comparable<? super K>,V> AComparator
that ordersKVs
by the natural ordering of their keys.KV.OrderByValue<K,V extends java.lang.Comparable<? super V>> AComparator
that ordersKVs
by the natural ordering of their values.PBegin PCollection<T> APCollection<T>
is an immutable collection of values of typeT
.PCollectionList<T> APCollectionList<T>
is an immutable list of homogeneously typedPCollection<T>s
.PCollectionRowTuple APCollectionRowTuple
is an immutable tuple ofPCollection
, "keyed" by a string tag.s
PCollectionTuple APCollectionTuple
is an immutable tuple of heterogeneously-typedPCollections
, "keyed" byTupleTags
.PCollectionViews For internal use only; no backwards compatibility guarantees.PCollectionViews.IterableViewFn<T> Deprecated. PCollectionViews.IterableViewFn2<T> Implementation which is able to adapt an iterable materialization to aIterable<T>
.PCollectionViews.ListViewFn<T> Deprecated. PCollectionViews.ListViewFn2<T> Implementation which is able to adapt a multimap materialization to aList<T>
.PCollectionViews.MapViewFn<K,V> Deprecated. PCollectionViews.MapViewFn2<K,V> Implementation which is able to adapt a multimap materialization to aMap<K, V>
.PCollectionViews.MultimapViewFn<K,V> Deprecated. PCollectionViews.MultimapViewFn2<K,V> Implementation which is able to adapt a multimap materialization to aMap<K, Iterable<V>>
.PCollectionViews.SimplePCollectionView<ElemT,PrimitiveViewT,ViewT,W extends BoundedWindow> A class forPCollectionView
implementations, with additional type parameters that are not visible at pipeline assembly time when the view is used as a side input.PCollectionViews.SingletonViewFn<T> Deprecated. PCollectionViews.SingletonViewFn2<T> Implementation which is able to adapt an iterable materialization to aT
.PCollectionViews.ValueOrMetadata<T,MetaT> Stores values or metadata about values.PCollectionViews.ValueOrMetadataCoder<T,MetaT> A coder forPCollectionViews.ValueOrMetadata
.PDone PValueBase For internal use.PValues For internal use.Row Row
is an immutable tuple-like schema to represent one element in aPCollection
.Row.Builder Builder forRow
.Row.Equals Row.FieldValueBuilder Builder forRow
that bases a row on another row.RowWithGetters A Concrete subclass ofRow
that delegates to a set of providedFieldValueGetter
s.RowWithStorage Concrete subclass ofRow
that explicitly stores all fields of the row.SchemaVerification ShardedKey<K> A key and a shard number.TaggedPValue For internal use only; no backwards-compatibility guarantees.TimestampedValue<V extends @Nullable java.lang.Object> An immutable pair of a value and a timestamp.TimestampedValue.TimestampedValueCoder<T> ACoder
forTimestampedValue
.TupleTag<V> ATupleTag
is a typed tag to use as the key of a heterogeneously typed tuple, likePCollectionTuple
.TupleTagList ATupleTagList
is an immutable list of heterogeneously typedTupleTags
.TypeDescriptor<T> A description of a Java type, including actual generic parameters where possible.TypeDescriptors A utility class for creatingTypeDescriptor
objects for different types, such as Java primitive types, containers andKVs
of otherTypeDescriptor
objects, and extracting type variables of parameterized types (e.g.TypeParameter<T> Captures a free type variable that can be used inTypeDescriptor.where(org.apache.beam.sdk.values.TypeParameter<X>, org.apache.beam.sdk.values.TypeDescriptor<X>)
.ValueInSingleWindow<T> An immutable tuple of value, timestamp, window, and pane.ValueInSingleWindow.Coder<T> A coder forValueInSingleWindow
.ValueWithRecordId<ValueT> For internal use only; no backwards compatibility guarantees.ValueWithRecordId.StripIdsDoFn<T> ValueWithRecordId.ValueWithRecordIdCoder<ValueT> WindowingStrategy<T,W extends BoundedWindow> AWindowingStrategy
describes the windowing behavior for a specific collection of values. -
Enum Summary Enum Description PCollection.IsBounded The enumeration of cases for whether aPCollection
is bounded.WindowingStrategy.AccumulationMode The accumulation modes that can be used with windowing.