com.google.cloud.dataflow.sdk.runners.worker

Class DataflowSideInputReader

java.lang.Object

com.google.cloud.dataflow.sdk.util.SizedSideInputReader.Defaults

com.google.cloud.dataflow.sdk.runners.worker.DataflowSideInputReader

All Implemented Interfaces:

SideInputReader, SizedSideInputReader

public class DataflowSideInputReader
extends SizedSideInputReader.Defaults
implements SizedSideInputReader

A simple side input reader that re-reads a side input from its iterable each time it is requested.

Sizes are accurate only for PCollectionView implementations that read the same amount of data for each access.

Nested Class Summary

Nested classes/interfaces inherited from interface com.google.cloud.dataflow.sdk.util.SizedSideInputReader

SizedSideInputReader.Defaults

Method Summary

Modifier and Type	Method and Description
<T> boolean	contains(PCollectionView<T> view) Returns true if the given PCollectionView is valid for this reader.
<T> Sized<T>	getSized(PCollectionView<T> view, BoundedWindow window) Gets a side input for a view and window by reading data according to the corresponding SideInputInfo, passing the result through the view's PCollectionView.fromIterableInternal(java.lang.Iterable<com.google.cloud.dataflow.sdk.util.WindowedValue<?>>) conversion method, and extracting the value for the appropriate window.
boolean	isEmpty() Returns true if there are no side inputs in this reader.
static DataflowSideInputReader	of(Iterable<? extends com.google.api.services.dataflow.model.SideInputInfo> sideInputInfos, PipelineOptions options, ExecutionContext context) Creates a new SideInputReader that will provide side inputs according to the provided SideInputInfo descriptors.

Methods inherited from class com.google.cloud.dataflow.sdk.util.SizedSideInputReader.Defaults

get

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface com.google.cloud.dataflow.sdk.util.SideInputReader

get

Method Detail

of

public static DataflowSideInputReader of(Iterable<? extends com.google.api.services.dataflow.model.SideInputInfo> sideInputInfos,
                                         PipelineOptions options,
                                         ExecutionContext context)
                                  throws Exception

Creates a new SideInputReader that will provide side inputs according to the provided SideInputInfo descriptors.

Throws:

Exception

contains

public <T> boolean contains(PCollectionView<T> view)

Description copied from interface: SideInputReader

Returns true if the given PCollectionView is valid for this reader.

Specified by:

contains in interface SideInputReader

isEmpty

public boolean isEmpty()

Description copied from interface: SideInputReader

Returns true if there are no side inputs in this reader.

Specified by:

isEmpty in interface SideInputReader

getSized

public <T> Sized<T> getSized(PCollectionView<T> view,
                             BoundedWindow window)

Gets a side input for a view and window by reading data according to the corresponding SideInputInfo, passing the result through the view's PCollectionView.fromIterableInternal(java.lang.Iterable<com.google.cloud.dataflow.sdk.util.WindowedValue<?>>) conversion method, and extracting the value for the appropriate window.

Specified by:

getSized in interface SizedSideInputReader