com.google.cloud.dataflow.sdk.util

Class GroupAlsoByWindowsDoFn<K,InputT,OutputT,W extends BoundedWindow>

java.lang.Object

com.google.cloud.dataflow.sdk.transforms.DoFn<KV<K,Iterable<WindowedValue<InputT>>>,KV<K,OutputT>>

com.google.cloud.dataflow.sdk.util.GroupAlsoByWindowsDoFn<K,InputT,OutputT,W>

Type Parameters:

K - key type

InputT - input value element type

OutputT - output value element type

W - window type

All Implemented Interfaces:

Serializable

@SystemDoFnInternal
public abstract class GroupAlsoByWindowsDoFn<K,InputT,OutputT,W extends BoundedWindow>
extends DoFn<KV<K,Iterable<WindowedValue<InputT>>>,KV<K,OutputT>>

DoFn that merges windows and groups elements in those windows, optionally combining values.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class com.google.cloud.dataflow.sdk.transforms.DoFn

DoFn.Context, DoFn.ProcessContext, DoFn.RequiresWindowAccess

Constructor Summary

Constructors

Constructor and Description
GroupAlsoByWindowsDoFn()

Method Summary

Modifier and Type	Method and Description
static <K,InputT,AccumT,OutputT,W extends BoundedWindow> GroupAlsoByWindowsDoFn<K,InputT,OutputT,W>	create(WindowingStrategy<?,W> windowingStrategy, AppliedCombineFn<K,InputT,AccumT,OutputT> combineFn, Coder<K> keyCoder) Construct a GroupAlsoByWindowsDoFn using the combineFn if available.
static <K,V,W extends BoundedWindow> GroupAlsoByWindowsDoFn<K,V,Iterable<V>,W>	createForIterable(WindowingStrategy<?,W> windowingStrategy, Coder<V> inputCoder) Create a GroupAlsoByWindowsDoFn without a combine function.

Methods inherited from class com.google.cloud.dataflow.sdk.transforms.DoFn

createAggregator, createAggregator, finishBundle, getAllowedTimestampSkew, getInputTypeDescriptor, getOutputTypeDescriptor, processElement, startBundle

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GroupAlsoByWindowsDoFn

public GroupAlsoByWindowsDoFn()

Method Detail

createForIterable

public static <K,V,W extends BoundedWindow> GroupAlsoByWindowsDoFn<K,V,Iterable<V>,W> createForIterable(WindowingStrategy<?,W> windowingStrategy,
                                                                                                        Coder<V> inputCoder)

Create a GroupAlsoByWindowsDoFn without a combine function. Depending on the windowFn this will either use iterators or window sets to implement the grouping.

Parameters:

windowingStrategy - The window function and trigger to use for grouping

inputCoder - the input coder to use

create

public static <K,InputT,AccumT,OutputT,W extends BoundedWindow> GroupAlsoByWindowsDoFn<K,InputT,OutputT,W> create(WindowingStrategy<?,W> windowingStrategy,
                                                                                                                  AppliedCombineFn<K,InputT,AccumT,OutputT> combineFn,
                                                                                                                  Coder<K> keyCoder)

Construct a GroupAlsoByWindowsDoFn using the combineFn if available.