com.google.cloud.dataflow.sdk.util

Class StreamingSideInputDoFnRunner<InputT,OutputT,W extends BoundedWindow>

java.lang.Object

com.google.cloud.dataflow.sdk.util.DoFnRunner<InputT,OutputT>

com.google.cloud.dataflow.sdk.util.StreamingSideInputDoFnRunner<InputT,OutputT,W>

Type Parameters:

InputT - the type of the DoFn's (main) input elements

OutputT - the type of the DoFn's (main) output elements

W - the type of the windows of the main input

public class StreamingSideInputDoFnRunner<InputT,OutputT,W extends BoundedWindow>
extends DoFnRunner<InputT,OutputT>

Runs a DoFn by constructing the appropriate contexts and passing them in.

Nested Class Summary

Nested classes/interfaces inherited from class com.google.cloud.dataflow.sdk.util.DoFnRunner

DoFnRunner.ListOutputManager, DoFnRunner.OutputManager

Field Summary

Fields inherited from class com.google.cloud.dataflow.sdk.util.DoFnRunner

context, fn

Constructor Summary

Constructors

Constructor and Description
StreamingSideInputDoFnRunner(PipelineOptions options, DoFnInfo<InputT,OutputT> doFnInfo, SideInputReader sideInputReader, DoFnRunner.OutputManager outputManager, TupleTag<OutputT> mainOutputTag, List<TupleTag<?>> sideOutputTags, ExecutionContext.StepContext stepContext, CounterSet.AddCounterMutator addCounterMutator)

Method Summary

Modifier and Type	Method and Description
void	finishBundle() Calls DoFn.finishBundle(com.google.cloud.dataflow.sdk.transforms.DoFn<InputT, OutputT>.Context).
void	invokeProcessElement(WindowedValue<InputT> elem)
void	startBundle() Calls DoFn.startBundle(com.google.cloud.dataflow.sdk.transforms.DoFn<InputT, OutputT>.Context).

Methods inherited from class com.google.cloud.dataflow.sdk.util.DoFnRunner

create, createProcessContext, processElement

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

StreamingSideInputDoFnRunner

public StreamingSideInputDoFnRunner(PipelineOptions options,
                                    DoFnInfo<InputT,OutputT> doFnInfo,
                                    SideInputReader sideInputReader,
                                    DoFnRunner.OutputManager outputManager,
                                    TupleTag<OutputT> mainOutputTag,
                                    List<TupleTag<?>> sideOutputTags,
                                    ExecutionContext.StepContext stepContext,
                                    CounterSet.AddCounterMutator addCounterMutator)
                             throws Exception

Throws:

Exception

Method Detail

startBundle

public void startBundle()

Description copied from class: DoFnRunner

Calls DoFn.startBundle(com.google.cloud.dataflow.sdk.transforms.DoFn<InputT, OutputT>.Context).

Overrides:

startBundle in class DoFnRunner<InputT,OutputT>

invokeProcessElement

public void invokeProcessElement(WindowedValue<InputT> elem)

Overrides:

invokeProcessElement in class DoFnRunner<InputT,OutputT>

finishBundle

public void finishBundle()

Description copied from class: DoFnRunner

Calls DoFn.finishBundle(com.google.cloud.dataflow.sdk.transforms.DoFn<InputT, OutputT>.Context).

Overrides:

finishBundle in class DoFnRunner<InputT,OutputT>