Index (Google Cloud Dataflow SDK 1.0.0 API)

A B C D E F G H I J K L M N O P R S T U V W X Y

A

AbstractBoundedReaderIterator<T> - Class in com.google.cloud.dataflow.sdk.util.common.worker: An abstract base class for implementations of ReaderIterator classes for bounded sources, where hasNext() returns the same value if called multiple times.
AbstractBoundedReaderIterator() - Constructor for class com.google.cloud.dataflow.sdk.util.common.worker.AbstractBoundedReaderIterator
AbstractReaderIterator() - Constructor for class com.google.cloud.dataflow.sdk.util.common.worker.Reader.AbstractReaderIterator
access(StateTag<StateT>) - Method in interface com.google.cloud.dataflow.sdk.util.ReduceFn.StateContext: Access the storage for the given address in the current window.
accessAcrossMergedWindows(StateTag<StateT>) - Method in interface com.google.cloud.dataflow.sdk.util.ReduceFn.StateContext: Access the storage for the given address in all of the windows that were merged into the current window including the current window.
accessAcrossMergingWindows(StateTag<StateT>) - Method in interface com.google.cloud.dataflow.sdk.util.ReduceFn.MergingStateContext: Access a merged view of the storage for the given address in all of the windows being merged.
accessInEachMergingWindow(StateTag<StateT>) - Method in interface com.google.cloud.dataflow.sdk.util.ReduceFn.MergingStateContext: Access a map from windows being merged to the associated StateT.
AccumulatingCombineFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Combine.AccumulatingCombineFn
accumulatingFiredPanes() - Static method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window: Returns a new Window PTransform that uses the registered WindowFn and Triggering behavior, and that accumulates elements in a pane after they are triggered.
accumulatingFiredPanes() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window.Bound: Returns a new Window PTransform that uses the registered WindowFn and Triggering behavior, and that accumulates elements in a pane after they are triggered.
accumulatingFiredPanes() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window.Unbound: Returns a new Window PTransform that uses the registered WindowFn and Triggering behavior, and that accumulates elements in a pane after they are triggered.
ActiveWindowSet<W extends BoundedWindow> - Interface in com.google.cloud.dataflow.sdk.util: Tracks the windows that are active.
ActiveWindowSet.MergeCallback<W extends BoundedWindow> - Interface in com.google.cloud.dataflow.sdk.util: Callback for ActiveWindowSet.mergeIfAppropriate(W, com.google.cloud.dataflow.sdk.util.ActiveWindowSet.MergeCallback<W>).
add(WindowedValue<K>, AccumT, InputT) - Method in class com.google.cloud.dataflow.sdk.runners.worker.MapTaskExecutorFactory.ValueCombiner
add(Long) - Method in class com.google.cloud.dataflow.sdk.transforms.ApproximateUnique.ApproximateUniqueCombineFn.LargestUnique: Adds a value to the heap, returning whether the value is (large enough to be) in the heap.
add(W) - Method in interface com.google.cloud.dataflow.sdk.util.ActiveWindowSet: Add a window to the ActiveWindowSet.
add(Counter<?>) - Method in class com.google.cloud.dataflow.sdk.util.common.CounterSet
add(K, AccumT, InputT) - Method in interface com.google.cloud.dataflow.sdk.util.common.worker.PartialGroupByKeyOperation.Combiner
add(ElemT) - Method in interface com.google.cloud.dataflow.sdk.util.common.worker.Sink.SinkWriter: Adds a value to the sink.
add(W) - Method in class com.google.cloud.dataflow.sdk.util.MergingActiveWindowSet
add(W) - Method in class com.google.cloud.dataflow.sdk.util.NonMergingActiveWindowSet
add(InputT) - Method in interface com.google.cloud.dataflow.sdk.util.state.MergeableState: Add a value to the buffer.
addAccum(AccumT) - Method in interface com.google.cloud.dataflow.sdk.util.state.CombiningValueStateInternal: Add an accumulator to this combining value.
addBoolean(Map<String, Object>, String, boolean) - Static method in class com.google.cloud.dataflow.sdk.util.Structs
addChannel(WritableByteChannel) - Method in class com.google.cloud.dataflow.sdk.util.ShardingWritableByteChannel: Adds another shard output channel.
addCollectionToSingletonOutput(String, PValue, PValue) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Adds an output with the given name to the previously added CollectionToSingleton Dataflow step, consuming the specified input PValue and producing the specified output PValue.
addComposite(TransformTreeNode) - Method in class com.google.cloud.dataflow.sdk.runners.TransformTreeNode: Adds a composite operation to the transform node.
addCounter(Counter<?>) - Method in class com.google.cloud.dataflow.sdk.util.common.CounterSet: Adds a counter.
addCounter(Counter<T>) - Method in class com.google.cloud.dataflow.sdk.util.common.CounterSet.AddCounterMutator: Adds the given Counter into the enclosing CounterSet.
AddCounterMutator() - Constructor for class com.google.cloud.dataflow.sdk.util.common.CounterSet.AddCounterMutator
addDictionary(Map<String, Object>, String, Map<String, Object>) - Static method in class com.google.cloud.dataflow.sdk.util.Structs
addDouble(Map<String, Object>, String, Double) - Static method in class com.google.cloud.dataflow.sdk.util.Structs
addEncodingInput(Coder<?>) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Sets the encoding for the current Dataflow step.
addExtensionsFrom(Class<?>...) - Method in class com.google.cloud.dataflow.sdk.coders.Proto2Coder: Deprecated.
use Proto2Coder.withExtensionsFrom(java.lang.Iterable<java.lang.Class<?>>)
addExtensionsFrom(Iterable<Class<?>>) - Method in class com.google.cloud.dataflow.sdk.coders.Proto2Coder: Deprecated.
use Proto2Coder.withExtensionsFrom(java.lang.Iterable<java.lang.Class<?>>)
addHold(ReduceFn<?, ?, ?, W>.ProcessValueContext, boolean) - Method in class com.google.cloud.dataflow.sdk.util.WatermarkHold: Update the watermark hold to include the timestamp of the value in c.
addInput(String, Boolean) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Adds an input with the given name and value to the current Dataflow step.
addInput(String, String) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Adds an input with the given name and value to the current Dataflow step.
addInput(String, Long) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Adds an input with the given name and value to the current Dataflow step.
addInput(String, PInput) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Adds an input with the given name to the previously added Dataflow step, coming from the specified input PValue.
addInput(String, Map<String, Object>) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Adds an input that is a dictionary of strings to objects.
addInput(String, List<? extends Map<String, Object>>) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Adds an input that is a list of objects.
addInput(TransformTreeNode, PInput) - Method in class com.google.cloud.dataflow.sdk.runners.TransformHierarchy: Adds an input to the given node.
addInput(ApproximateUnique.ApproximateUniqueCombineFn.LargestUnique, T) - Method in class com.google.cloud.dataflow.sdk.transforms.ApproximateUnique.ApproximateUniqueCombineFn
addInput(InputT) - Method in interface com.google.cloud.dataflow.sdk.transforms.Combine.AccumulatingCombineFn.Accumulator: Adds the given input value to this accumulator, modifying this accumulator.
addInput(AccumT, InputT) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.AccumulatingCombineFn
addInput(double[], Double) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineDoubleFn
addInput(Combine.Holder<V>, V) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineFn
addInput(int[], Integer) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineIntegerFn
addInput(long[], Long) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineLongFn
addInput(AccumT, InputT) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.CombineFn: Adds the given input value to the given accumulator, returning the new accumulator value.
addInput(List<V>, V) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.IterableCombineFn
addInput(K, AccumT, InputT) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.KeyedCombineFn: Adds the given input value to the given accumulator, modifying the accumulator.
addInput(Top.BoundedHeap<KV<Integer, T>, SerializableComparator<KV<Integer, T>>>, T) - Method in class com.google.cloud.dataflow.sdk.transforms.Sample.FixedSizedSampleFn
addInput(List<T>, T) - Method in class com.google.cloud.dataflow.sdk.transforms.View.Concatenate
addInputProducer(PValue, TransformTreeNode) - Method in class com.google.cloud.dataflow.sdk.runners.TransformTreeNode: Adds an input to the transform node.
addInputsRandomly(Combine.KeyedCombineFn<? super K, ? super InputT, AccumT, ?>, K, Iterable<InputT>, Random) - Static method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.TestCombineDoFn: Create a random list of accumulators from the given list of values.
addList(Map<String, Object>, String, List<? extends Map<String, Object>>) - Static method in class com.google.cloud.dataflow.sdk.util.Structs
addList(Map<String, Object>, String, T[]) - Static method in class com.google.cloud.dataflow.sdk.util.Structs
addLong(Map<String, Object>, String, long) - Static method in class com.google.cloud.dataflow.sdk.util.Structs
addLongs(Map<String, Object>, String, long...) - Static method in class com.google.cloud.dataflow.sdk.util.Structs
addNewCounter(Counter<?>) - Method in class com.google.cloud.dataflow.sdk.util.common.CounterSet: Adds a new counter, throwing an exception if a counter of the same name already exists.
addNull(Map<String, Object>, String) - Static method in class com.google.cloud.dataflow.sdk.util.Structs
addObject(Map<String, Object>, String, Map<String, Object>) - Static method in class com.google.cloud.dataflow.sdk.util.Structs
addObserver(Observer) - Method in class com.google.cloud.dataflow.sdk.util.common.ElementByteSizeObservableIterable: Sets the observer, which will observe the iterator returned in the next call to iterator() method.
addOrReuseCounter(Counter<T>) - Method in class com.google.cloud.dataflow.sdk.util.common.CounterSet: Adds the given Counter to this CounterSet.
addOutput(String, PValue) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Adds an output with the given name to the previously added Dataflow step, producing the specified output PValue, including its Coder if a TypedPValue.
addOutput(Receiver) - Method in class com.google.cloud.dataflow.sdk.util.common.worker.OutputReceiver: Adds a new receiver that this OutputReceiver forwards to.
addOutputCounter(ElementCounter) - Method in class com.google.cloud.dataflow.sdk.util.common.worker.OutputReceiver
addOverrideForClass(Class<?>, DataflowWorkerLoggingOptions.Level) - Method in class com.google.cloud.dataflow.sdk.options.DataflowWorkerLoggingOptions.WorkerLogLevelOverrides: Overrides the default log level for the passed in class.
addOverrideForName(String, DataflowWorkerLoggingOptions.Level) - Method in class com.google.cloud.dataflow.sdk.options.DataflowWorkerLoggingOptions.WorkerLogLevelOverrides: Overrides the default log level for the passed in name.
addOverrideForPackage(Package, DataflowWorkerLoggingOptions.Level) - Method in class com.google.cloud.dataflow.sdk.options.DataflowWorkerLoggingOptions.WorkerLogLevelOverrides: Overrides the default log level for the passed in package.
addStep(PTransform<?, ?>, String) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Adds a step to the Dataflow workflow for the given transform, with the given Dataflow step type.
addStep(PTransform<?, ? extends PValue>, Step) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Adds a pre-defined step to the Dataflow workflow.
addString(Map<String, Object>, String, String) - Static method in class com.google.cloud.dataflow.sdk.util.Structs
addStringList(Map<String, Object>, String, List<String>) - Static method in class com.google.cloud.dataflow.sdk.util.Structs
addTraceFor(AbstractGoogleClient, String) - Method in class com.google.cloud.dataflow.sdk.options.GoogleApiDebugOptions.GoogleApiTracer: Creates a GoogleApiDebugOptions.GoogleApiTracer that sets the trace destination on all calls that match the given client type.
addTraceFor(AbstractGoogleClientRequest<?>, String) - Method in class com.google.cloud.dataflow.sdk.options.GoogleApiDebugOptions.GoogleApiTracer: Creates a GoogleApiDebugOptions.GoogleApiTracer that sets the trace traceDestination on all calls that match for the given request type.
addValue(InputT) - Method in interface com.google.cloud.dataflow.sdk.transforms.Aggregator: Adds a new value into the Aggregator.
addValue(T) - Method in class com.google.cloud.dataflow.sdk.util.common.Counter: Adds a new value to the aggregation stream.
addValue(InputT) - Method in class com.google.cloud.dataflow.sdk.util.CounterAggregator
addValueInternal(PValue) - Method in class com.google.cloud.dataflow.sdk.Pipeline: Adds the given PValue to this Pipeline.
addValueOnlyOutput(String, PValue) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Adds an output with the given name to the previously added Dataflow step, producing the specified output PValue, including its Coder if a TypedPValue.
advance() - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.DatastoreReader
advance() - Method in class com.google.cloud.dataflow.sdk.io.OffsetBasedSource.OffsetBasedReader
advance() - Method in class com.google.cloud.dataflow.sdk.io.Source.Reader: Advances the reader to the next valid record.
advance() - Method in class com.google.cloud.dataflow.sdk.io.UnboundedSource.UnboundedReader: Advances the reader to the next valid record.
advance() - Method in class com.google.cloud.dataflow.sdk.util.common.ElementByteSizeObserver: Advances the observer to the next element.
advanceImpl() - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSource.FileBasedReader
advanceImpl() - Method in class com.google.cloud.dataflow.sdk.io.OffsetBasedSource.OffsetBasedReader: Same as BoundedReader#advance, except OffsetBasedSource.OffsetBasedReader base class takes care of coordinating against concurrent calls to OffsetBasedSource.OffsetBasedReader.splitAtFraction(double).
advanceProcessingTime(ReduceFnRunner<?, ?, ?, ?>, Instant) - Method in class com.google.cloud.dataflow.sdk.util.BatchTimerInternals
advanceWatermark(ReduceFnRunner<?, ?, ?, ?>, Instant) - Method in class com.google.cloud.dataflow.sdk.util.BatchTimerInternals
AfterAll<W extends BoundedWindow> - Class in com.google.cloud.dataflow.sdk.transforms.windowing: Create a Trigger that fires and finishes once after all of its sub-triggers have fired.
AfterEach<W extends BoundedWindow> - Class in com.google.cloud.dataflow.sdk.transforms.windowing: A composite Trigger that executes its sub-triggers in order.
AfterFirst<W extends BoundedWindow> - Class in com.google.cloud.dataflow.sdk.transforms.windowing: Create a composite Trigger that fires once after at least one of its sub-triggers have fired.
AfterPane<W extends BoundedWindow> - Class in com.google.cloud.dataflow.sdk.transforms.windowing: Triggers that fire based on properties of the elements in the current pane.
AfterProcessingTime<W extends BoundedWindow> - Class in com.google.cloud.dataflow.sdk.transforms.windowing: AfterProcessingTime triggers fire based on the current processing time.
AfterWatermark<W extends BoundedWindow> - Class in com.google.cloud.dataflow.sdk.transforms.windowing: AfterWatermark triggers fire based on progress of the system watermark.
Aggregator<InputT,OutputT> - Interface in com.google.cloud.dataflow.sdk.transforms: An Aggregator<InputT> enables monitoring of values of type InputT, to be combined across all bundles.
AggregatorPipelineExtractor - Class in com.google.cloud.dataflow.sdk.runners: An AggregatorPipelineExtractor retrieves Aggregators at each ParDo and returns a Map of Aggregator to the PTransforms in which it is present.
AggregatorPipelineExtractor(Pipeline) - Constructor for class com.google.cloud.dataflow.sdk.runners.AggregatorPipelineExtractor: Creates an AggregatorPipelineExtractor for the given Pipeline.
AggregatorRetrievalException - Exception in com.google.cloud.dataflow.sdk.runners: Signals that an exception has occurred while retrieving Aggregators.
AggregatorRetrievalException(String, Throwable) - Constructor for exception com.google.cloud.dataflow.sdk.runners.AggregatorRetrievalException
AggregatorRetriever - Class in com.google.cloud.dataflow.sdk.transforms: A class for extracting Aggregators from DoFns.
AggregatorValues<T> - Class in com.google.cloud.dataflow.sdk.runners: A collection of values associated with an Aggregator.
AggregatorValues() - Constructor for class com.google.cloud.dataflow.sdk.runners.AggregatorValues
alignedTo(Duration, Instant) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.TimeTrigger: Aligns timestamps to the smallest multiple of size since the offset greater than the timestamp.
alignedTo(Duration) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.TimeTrigger: Aligns the time to be the smallest multiple of size greater than the timestamp since the epoch.
ALL_CONTEXTS - Static variable in class com.google.cloud.dataflow.sdk.testing.CoderProperties: All the contexts, for use in test cases.
ALL_SHARDS - Static variable in class com.google.cloud.dataflow.sdk.util.ShardingWritableByteChannel: Special shard number that causes a write to all shards.
ALLOWED_ENCODINGS - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
and(TupleTag<V>, List<V>) - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult: Returns a new CoGbkResult based on this, with the given tag and given data added to it.
and(TupleTag<V>, PCollection<KV<K, V>>) - Method in class com.google.cloud.dataflow.sdk.transforms.join.KeyedPCollectionTuple: Returns a new KeyedPCollectionTuple<K> that is the same as this, appended with the given PCollection.
and(TupleTag<V>, V) - Method in class com.google.cloud.dataflow.sdk.util.PTuple: Returns a new PTuple that has all the values and tags of this PTuple plus the given value and tag.
and(PCollection.IsBounded) - Method in enum com.google.cloud.dataflow.sdk.values.PCollection.IsBounded: Returns the composed IsBounded property.
and(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.values.PCollectionList: Returns a new PCollectionList that has all the PCollections of this PCollectionList plus the given PCollection appended to the end.
and(Iterable<PCollection<T>>) - Method in class com.google.cloud.dataflow.sdk.values.PCollectionList: Returns a new PCollectionList that has all the PCollections of this PCollectionList plus the given PCollections appended to the end, in order.
and(TupleTag<T>, PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.values.PCollectionTuple: Returns a new PCollectionTuple that has each PCollection and TupleTag of this PCollectionTuple plus the given PCollection associated with the given TupleTag.
and(TupleTag<?>) - Method in class com.google.cloud.dataflow.sdk.values.TupleTagList: Returns a new TupleTagList that has all the TupleTags of this TupleTagList plus the given TupleTag appended to the end.
and(List<TupleTag<?>>) - Method in class com.google.cloud.dataflow.sdk.values.TupleTagList: Returns a new TupleTagList that has all the TupleTags of this TupleTagList plus the given TupleTags appended to the end, in order.
any(long) - Static method in class com.google.cloud.dataflow.sdk.transforms.Sample: Sample#any(long) takes a PCollection<T> and a limit, and produces a new PCollection<T> containing up to limit elements of the input PCollection.
ApiSurface - Class in com.google.cloud.dataflow.sdk.util: Represents the API surface of a package prefix.
APPEND_TRAILING_NEWLINES - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
AppEngineEnvironment - Class in com.google.cloud.dataflow.sdk.util: Stores whether we are running within AppEngine or not.
AppEngineEnvironment() - Constructor for class com.google.cloud.dataflow.sdk.util.AppEngineEnvironment
ApplianceShuffleReader - Class in com.google.cloud.dataflow.sdk.runners.worker: ApplianceShuffleReader reads chunks of data from a shuffle dataset for a position range.
ApplianceShuffleReader(byte[]) - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.ApplianceShuffleReader
ApplianceShuffleWriter - Class in com.google.cloud.dataflow.sdk.runners.worker: ApplianceShuffleWriter writes chunks of data to a shuffle dataset.
ApplianceShuffleWriter(byte[], long) - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.ApplianceShuffleWriter
applicableTo(PCollection<?>) - Static method in class com.google.cloud.dataflow.sdk.transforms.GroupByKey
ApplicationNameOptions - Interface in com.google.cloud.dataflow.sdk.options: Options that allow setting the application name.
AppliedCombineFn<K,InputT,AccumT,OutputT> - Class in com.google.cloud.dataflow.sdk.util: A Combine.KeyedCombineFn with a fixed accumulator coder.
AppliedPTransform<InputT extends PInput,OutputT extends POutput,TransformT extends PTransform<? super InputT,OutputT>> - Class in com.google.cloud.dataflow.sdk.transforms: Represents the application of a PTransform to a specific input to produce a specific output.
apply(InputT) - Method in interface com.google.cloud.dataflow.sdk.coders.DelegateCoder.CodingFunction
apply(PInput) - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Read.Bound
apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound
apply(PInput) - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Read.Bound
apply(PCollection<TableRow>) - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.Bound
apply(PInput) - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read.Bound
apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Write.Bound
apply(PInput) - Method in class com.google.cloud.dataflow.sdk.io.Read.Bounded
apply(PInput) - Method in class com.google.cloud.dataflow.sdk.io.Read.Unbounded
apply(PInput) - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Read.Bound
apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Write.Bound
apply(PTransform<? super PBegin, OutputT>) - Method in class com.google.cloud.dataflow.sdk.Pipeline: Like Pipeline.apply(String, PTransform) but defaulting to the name of the PTransform.
apply(String, PTransform<? super PBegin, OutputT>) - Method in class com.google.cloud.dataflow.sdk.Pipeline: Starts using this pipeline with a root PTransform such as TextIO.READ or Create.
apply(PTransform<InputT, OutputT>, InputT) - Method in class com.google.cloud.dataflow.sdk.runners.BlockingDataflowPipelineRunner
apply(PTransform<InputT, OutputT>, InputT) - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineRunner: Applies the given transform to the input.
apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineRunner.StreamingPubsubIOWrite
apply(PTransform<InputT, OutputT>, InputT) - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner
apply(PTransform<InputT, OutputT>, InputT) - Method in class com.google.cloud.dataflow.sdk.runners.PipelineRunner: Applies a transform to the given input, returning the output.
apply(PTransform<InputT, OutputT>, InputT) - Method in class com.google.cloud.dataflow.sdk.testing.TestDataflowPipelineRunner
apply(double, double) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineDoubleFn: Applies the binary operation to the two operands, returning the result.
apply(V, V) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineFn: Applies the binary operation to the two operands, returning the result.
apply(int, int) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineIntegerFn: Applies the binary operation to the two operands, returning the result.
apply(long, long) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineLongFn: Applies the binary operation to the two operands, returning the result.
apply(Iterable<? extends InputT>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.CombineFn: Applies this CombineFn to a collection of input values to produce a combined output value.
apply(PCollection<InputT>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.Globally
apply(PCollection<InputT>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.GloballyAsSingletonView
apply(PCollection<? extends KV<K, ? extends Iterable<InputT>>>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.GroupedValues
apply(K, Iterable<? extends InputT>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.KeyedCombineFn: Applies this KeyedCombineFn to a key and a collection of input values to produce a combined output value.
apply(PCollection<KV<K, InputT>>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.PerKey
apply(PCollection<KV<K, InputT>>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.PerKeyWithHotKeyFanout
apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.Count.PerElement
apply(PInput) - Method in class com.google.cloud.dataflow.sdk.transforms.Create.TimestampedValues
apply(PInput) - Method in class com.google.cloud.dataflow.sdk.transforms.Create.Values
apply(PCollection<Iterable<T>>) - Method in class com.google.cloud.dataflow.sdk.transforms.Flatten.FlattenIterables
apply(PCollectionList<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.Flatten.FlattenPCollectionList
apply(PCollection<KV<K, V>>) - Method in class com.google.cloud.dataflow.sdk.transforms.GroupByKey
apply(PCollection<KV<K, Iterable<WindowedValue<V>>>>) - Method in class com.google.cloud.dataflow.sdk.transforms.GroupByKey.GroupAlsoByWindow
apply(PCollection<KV<K, V>>) - Method in class com.google.cloud.dataflow.sdk.transforms.GroupByKey.GroupByKeyOnly
apply(PCollection<KV<K, V>>) - Method in class com.google.cloud.dataflow.sdk.transforms.GroupByKey.ReifyTimestampsAndWindows
apply(PCollection<KV<K, Iterable<WindowedValue<V>>>>) - Method in class com.google.cloud.dataflow.sdk.transforms.GroupByKey.SortValuesByTimestamp
apply(PCollection<? extends InputT>) - Method in class com.google.cloud.dataflow.sdk.transforms.IntraBundleParallelization.Bound
apply(KeyedPCollectionTuple<K>) - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGroupByKey
apply(PTransform<KeyedPCollectionTuple<K>, OutputT>) - Method in class com.google.cloud.dataflow.sdk.transforms.join.KeyedPCollectionTuple: Like KeyedPCollectionTuple.apply(String, PTransform) but defaulting to the name provided by the PTransform.
apply(String, PTransform<KeyedPCollectionTuple<K>, OutputT>) - Method in class com.google.cloud.dataflow.sdk.transforms.join.KeyedPCollectionTuple: Applies the given PTransform to this input KeyedPCollectionTuple and returns its OutputT.
apply(PCollection<? extends KV<K, ?>>) - Method in class com.google.cloud.dataflow.sdk.transforms.Keys
apply(PCollection<KV<K, V>>) - Method in class com.google.cloud.dataflow.sdk.transforms.KvSwap
apply(T, T) - Method in class com.google.cloud.dataflow.sdk.transforms.Max.MaxFn
apply(T, T) - Method in class com.google.cloud.dataflow.sdk.transforms.Min.MinFn
apply(PCollection<? extends InputT>) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.Bound
apply(PCollection<? extends InputT>) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.BoundMulti
apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.Partition
apply(InputT) - Method in class com.google.cloud.dataflow.sdk.transforms.PTransform: Applies this PTransform on the given InputT, and returns its Output.
apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.RemoveDuplicates
apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.Sample.SampleAny
apply(InputT) - Method in interface com.google.cloud.dataflow.sdk.transforms.SerializableFunction: Returns the result of invoking this function on the given input.
apply(double, double) - Method in class com.google.cloud.dataflow.sdk.transforms.Sum.SumDoubleFn
apply(int, int) - Method in class com.google.cloud.dataflow.sdk.transforms.Sum.SumIntegerFn
apply(long, long) - Method in class com.google.cloud.dataflow.sdk.transforms.Sum.SumLongFn
apply(PCollection<? extends KV<?, V>>) - Method in class com.google.cloud.dataflow.sdk.transforms.Values
apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.View.AsIterable
apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.View.AsList
apply(PCollection<KV<K, V>>) - Method in class com.google.cloud.dataflow.sdk.transforms.View.AsMap
apply(PCollection<KV<K, V>>) - Method in class com.google.cloud.dataflow.sdk.transforms.View.AsMultimap
apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.View.AsSingleton
apply(PCollection<ElemT>) - Method in class com.google.cloud.dataflow.sdk.transforms.View.CreatePCollectionView
apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window.Bound
apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window.Remerge
apply(PCollection<V>) - Method in class com.google.cloud.dataflow.sdk.transforms.WithKeys
apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.Write.Bound
apply(PCollection<KV<K, V>>) - Method in class com.google.cloud.dataflow.sdk.util.Reshuffle
apply(PTransform<? super PBegin, OutputT>) - Method in class com.google.cloud.dataflow.sdk.values.PBegin: Like PBegin.apply(String, PTransform) but defaulting to the name of the PTransform.
apply(String, PTransform<? super PBegin, OutputT>) - Method in class com.google.cloud.dataflow.sdk.values.PBegin: Applies the given PTransform to this input PBegin, using name to identify this specific application of the transform.
apply(PTransform<? super PCollection<T>, OutputT>) - Method in class com.google.cloud.dataflow.sdk.values.PCollection: Like PCollection.apply(String, PTransform) but defaulting to the name of the PTransform.
apply(String, PTransform<? super PCollection<T>, OutputT>) - Method in class com.google.cloud.dataflow.sdk.values.PCollection: Applies the given PTransform to this input PCollection<T>, using name to identify this specific application of the transform.
apply(PTransform<PCollectionList<T>, OutputT>) - Method in class com.google.cloud.dataflow.sdk.values.PCollectionList: Like PCollectionList.apply(String, PTransform) but defaulting to the name of the PTransform.
apply(String, PTransform<PCollectionList<T>, OutputT>) - Method in class com.google.cloud.dataflow.sdk.values.PCollectionList: Applies the given PTransform to this input PCollectionList<T>, using name to identify this specific application of the transform.
apply(PTransform<PCollectionTuple, OutputT>) - Method in class com.google.cloud.dataflow.sdk.values.PCollectionTuple: Like PCollectionTuple.apply(String, PTransform) but defaulting to the name of the PTransform.
apply(String, PTransform<PCollectionTuple, OutputT>) - Method in class com.google.cloud.dataflow.sdk.values.PCollectionTuple: Applies the given PTransform to this input PCollectionTuple, using name to identify this specific application of the transform.
applyTransform(InputT, PTransform<? super InputT, OutputT>) - Static method in class com.google.cloud.dataflow.sdk.Pipeline: Like Pipeline.applyTransform(String, PInput, PTransform) but defaulting to the name provided by the PTransform.
applyTransform(String, InputT, PTransform<? super InputT, OutputT>) - Static method in class com.google.cloud.dataflow.sdk.Pipeline: Applies the given PTransform to this input InputT and returns its OutputT.
approximatePTransformName(Class<?>) - Static method in class com.google.cloud.dataflow.sdk.util.StringUtils: Returns a name for a PTransform class.
ApproximateQuantiles - Class in com.google.cloud.dataflow.sdk.transforms: PTransforms for getting an idea of a PCollection's data distribution using approximate N-tiles, either globally or per-key.
ApproximateQuantiles() - Constructor for class com.google.cloud.dataflow.sdk.transforms.ApproximateQuantiles
ApproximateQuantiles.ApproximateQuantilesCombineFn<T,ComparatorT extends Comparator<T> & Serializable> - Class in com.google.cloud.dataflow.sdk.transforms: The ApproximateQuantilesCombineFn combiner gives an idea of the distribution of a collection of values using approximate N-tiles.
approximateSimpleName(Class<?>) - Static method in class com.google.cloud.dataflow.sdk.util.StringUtils: Returns a simple name for a class.
ApproximateUnique - Class in com.google.cloud.dataflow.sdk.transforms: PTransforms for estimating the number of distinct elements in a PCollection, or the number of distinct values associated with each key in a PCollection of KVs.
ApproximateUnique() - Constructor for class com.google.cloud.dataflow.sdk.transforms.ApproximateUnique
ApproximateUnique.ApproximateUniqueCombineFn<T> - Class in com.google.cloud.dataflow.sdk.transforms: CombineFn that computes an estimate of the number of distinct values that were combined.
ApproximateUnique.ApproximateUniqueCombineFn.LargestUnique - Class in com.google.cloud.dataflow.sdk.transforms: A heap utility class to efficiently track the largest added elements.
ApproximateUniqueCombineFn(long, Coder<T>) - Constructor for class com.google.cloud.dataflow.sdk.transforms.ApproximateUnique.ApproximateUniqueCombineFn
areAllSubtriggersFinished() - Method in interface com.google.cloud.dataflow.sdk.transforms.windowing.Trigger.TriggerInfo: Returns true if all the sub-triggers of the current trigger are marked finished.
as(Class<T>) - Method in interface com.google.cloud.dataflow.sdk.options.PipelineOptions: Transforms this object into an object of type <T> saving each property that has been manipulated.
as(Class<T>) - Static method in class com.google.cloud.dataflow.sdk.options.PipelineOptionsFactory: Creates and returns an object that implements <T>.
as(Class<T>) - Method in class com.google.cloud.dataflow.sdk.options.PipelineOptionsFactory.Builder: Creates and returns an object that implements <T> using the values configured on this builder during construction.
asBoolean(Object) - Static method in class com.google.cloud.dataflow.sdk.util.Values
asCloudObject() - Method in class com.google.cloud.dataflow.sdk.coders.AvroCoder
asCloudObject() - Method in interface com.google.cloud.dataflow.sdk.coders.Coder: Returns the CloudObject that represents this Coder.
asCloudObject() - Method in class com.google.cloud.dataflow.sdk.coders.CustomCoder
asCloudObject() - Method in class com.google.cloud.dataflow.sdk.coders.IterableCoder
asCloudObject() - Method in class com.google.cloud.dataflow.sdk.coders.JAXBCoder
asCloudObject() - Method in class com.google.cloud.dataflow.sdk.coders.KvCoder
asCloudObject() - Method in class com.google.cloud.dataflow.sdk.coders.Proto2Coder
asCloudObject() - Method in class com.google.cloud.dataflow.sdk.coders.SerializableCoder
asCloudObject() - Method in class com.google.cloud.dataflow.sdk.coders.StandardCoder
asCloudObject() - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult.CoGbkResultCoder
asCloudObject() - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResultSchema
asCloudObject() - Method in class com.google.cloud.dataflow.sdk.util.WindowedValue.FullWindowedValueCoder
asCloudObject() - Method in class com.google.cloud.dataflow.sdk.util.WindowedValue.ValueOnlyWindowedValueCoder
asCloudObject() - Method in class com.google.cloud.dataflow.sdk.values.TupleTag
asDouble(Object) - Static method in class com.google.cloud.dataflow.sdk.util.Values
asIterable() - Static method in class com.google.cloud.dataflow.sdk.transforms.View: Returns a View.AsIterable that takes a PCollection as input and produces a PCollectionView of the values, to be consumed as an iterable side input.
asKeyedFn() - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.CombineFn: Converts this CombineFn into an equivalent Combine.KeyedCombineFn that ignores the keys passed to it and combines the values according to this CombineFn.
asList() - Static method in class com.google.cloud.dataflow.sdk.transforms.View: Returns a transform that takes a PCollection and returns a List containing all of its elements, to be consumed as a side input.
asLong(Object) - Static method in class com.google.cloud.dataflow.sdk.util.Values
asMap() - Static method in class com.google.cloud.dataflow.sdk.transforms.View: Returns an View.AsMap transform that takes a PCollection as input and produces a PCollectionView of the values to be consumed as a Map<K, V> side input.
asMultimap() - Static method in class com.google.cloud.dataflow.sdk.transforms.View: Returns an View.AsMultimap transform that takes a PCollection of KV<K, V> pairs as input and produces a PCollectionView of its contents as a Map<K, Iterable<V>> for use as a side input.
asOutputReference(PValue) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Encode a PValue reference as an output reference.
assertFor(ExpectedT) - Method in interface com.google.cloud.dataflow.sdk.testing.DataflowAssert.AssertRelation
AssignContext() - Constructor for class com.google.cloud.dataflow.sdk.transforms.windowing.WindowFn.AssignContext
assignedWindows(WindowFn<T, W>, long) - Static method in class com.google.cloud.dataflow.sdk.testing.WindowFnTestUtils
assignsToSingleWindow() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.GlobalWindows
assignsToSingleWindow() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.PartitioningWindowFn
assignsToSingleWindow() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.WindowFn: Returns true if this WindowFn assigns each element to a single window.
assignWindow(Instant) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.DaysWindows
assignWindow(Instant) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.MonthsWindows
assignWindow(Instant) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.YearsWindows
assignWindow(Instant) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.FixedWindows
assignWindow(Instant) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.PartitioningWindowFn: Returns the single window to which elements with this timestamp belong.
assignWindows(WindowFn<Object, GlobalWindow>.AssignContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.GlobalWindows
assignWindows(WindowFn<Object, W>.AssignContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.InvalidWindows
assignWindows(WindowFn<T, W>.AssignContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.PartitioningWindowFn
assignWindows(WindowFn<Object, IntervalWindow>.AssignContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Sessions
assignWindows(WindowFn<Object, IntervalWindow>.AssignContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.SlidingWindows
assignWindows(WindowFn<T, W>.AssignContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.WindowFn: Given a timestamp and element, returns the set of windows into which it should be placed.
AssignWindowsDoFn<T,W extends BoundedWindow> - Class in com.google.cloud.dataflow.sdk.util: DoFn that tags elements of a PCollection with windows, according to the provided WindowFn.
AssignWindowsDoFn(WindowFn<? super T, W>) - Constructor for class com.google.cloud.dataflow.sdk.util.AssignWindowsDoFn
asSingleton() - Static method in class com.google.cloud.dataflow.sdk.transforms.View: Returns a View.AsSingleton transform that takes a singleton PCollection as input and produces a PCollectionView of the single value, to be consumed as a side input.
asSingletonView() - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.Globally: Returns a PTransform that produces a PCollectionView whose elements are the result of combining elements per-window in the input PCollection.
asString(Object) - Static method in class com.google.cloud.dataflow.sdk.util.Values
asV1Beta1Path() - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.PubsubSubscription
asV1Beta1Path() - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.PubsubTopic
asV1Beta2Path() - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.PubsubSubscription
asV1Beta2Path() - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.PubsubTopic
atMaxAttempts() - Method in class com.google.cloud.dataflow.sdk.util.AttemptAndTimeBoundedExponentialBackOff
atMaxAttempts() - Method in class com.google.cloud.dataflow.sdk.util.AttemptBoundedExponentialBackOff
atMaxInterval() - Method in class com.google.cloud.dataflow.sdk.util.IntervalBoundedExponentialBackOff
AtomicCoder<T> - Class in com.google.cloud.dataflow.sdk.coders: An AtomicCoder is a Coder that has no component Coders or other state.
AtomicCoder() - Constructor for class com.google.cloud.dataflow.sdk.coders.AtomicCoder
attachInput(Operation, int) - Method in class com.google.cloud.dataflow.sdk.util.common.worker.ReceivingOperation: Adds an input to this Operation, coming from the given output of the given source Operation.
AttemptAndTimeBoundedExponentialBackOff - Class in com.google.cloud.dataflow.sdk.util: Extension of AttemptBoundedExponentialBackOff that bounds the total time that the backoff is happening as well as the amount of retries.
AttemptAndTimeBoundedExponentialBackOff(int, long, long) - Constructor for class com.google.cloud.dataflow.sdk.util.AttemptAndTimeBoundedExponentialBackOff: Constructs an instance of AttemptAndTimeBoundedExponentialBackoff.
AttemptAndTimeBoundedExponentialBackOff(int, long, long, NanoClock) - Constructor for class com.google.cloud.dataflow.sdk.util.AttemptAndTimeBoundedExponentialBackOff: Constructs an instance of AttemptAndTimeBoundedExponentialBackoff.
AttemptBoundedExponentialBackOff - Class in com.google.cloud.dataflow.sdk.util: Implementation of BackOff that increases the back off period for each retry attempt using a randomization function that grows exponentially.
AttemptBoundedExponentialBackOff(int, long) - Constructor for class com.google.cloud.dataflow.sdk.util.AttemptBoundedExponentialBackOff
AvroByteReader<T> - Class in com.google.cloud.dataflow.sdk.runners.worker: A source that reads Avro files.
AvroByteReader(String, Long, Long, Coder<T>) - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.AvroByteReader
AvroByteSink<T> - Class in com.google.cloud.dataflow.sdk.runners.worker: A sink that writes Avro files.
AvroByteSink(String, Coder<T>) - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.AvroByteSink
AvroByteSink(String, String, String, int, Coder<T>) - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.AvroByteSink
AvroCoder<T> - Class in com.google.cloud.dataflow.sdk.coders: A Coder using Avro binary format.
AvroCoder(Class<T>, Schema) - Constructor for class com.google.cloud.dataflow.sdk.coders.AvroCoder
AvroCoder.AvroDeterminismChecker - Class in com.google.cloud.dataflow.sdk.coders: Helper class encapsulating the various pieces of state maintained by the recursive walk used for checking if the encoding will be deterministic.
AvroDeterminismChecker() - Constructor for class com.google.cloud.dataflow.sdk.coders.AvroCoder.AvroDeterminismChecker
AvroIO - Class in com.google.cloud.dataflow.sdk.io: PTransforms for reading and writing Avro files.
AvroIO() - Constructor for class com.google.cloud.dataflow.sdk.io.AvroIO
AvroIO.Read - Class in com.google.cloud.dataflow.sdk.io: A root PTransform that reads from an Avro file (or multiple Avro files matching a pattern) and returns a PCollection containing the decoding of each record.
AvroIO.Read.Bound<T> - Class in com.google.cloud.dataflow.sdk.io: A PTransform that reads from an Avro file (or multiple Avro files matching a pattern) and returns a bounded PCollection containing the decoding of each record.
AvroIO.Write - Class in com.google.cloud.dataflow.sdk.io: A root PTransform that writes a PCollection to an Avro file (or multiple Avro files matching a sharding pattern).
AvroIO.Write.Bound<T> - Class in com.google.cloud.dataflow.sdk.io: A PTransform that writes a bounded PCollection to an Avro file (or multiple Avro files matching a sharding pattern).
AvroIOTranslator - Class in com.google.cloud.dataflow.sdk.runners.dataflow: Avro transform support code for the Dataflow backend.
AvroIOTranslator() - Constructor for class com.google.cloud.dataflow.sdk.runners.dataflow.AvroIOTranslator
AvroIOTranslator.ReadTranslator - Class in com.google.cloud.dataflow.sdk.runners.dataflow: Implements AvroIO Read translation for the Dataflow backend.
AvroIOTranslator.WriteTranslator - Class in com.google.cloud.dataflow.sdk.runners.dataflow: Implements AvroIO Write translation for the Dataflow backend.
AvroReader(AvroSource<T>) - Constructor for class com.google.cloud.dataflow.sdk.io.AvroSource.AvroReader
AvroReader<T> - Class in com.google.cloud.dataflow.sdk.runners.worker: A source that reads Avro files.
AvroReader(String, Long, Long, WindowedValue.ValueOnlyWindowedValueCoder<T>) - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.AvroReader
AvroReaderFactory - Class in com.google.cloud.dataflow.sdk.runners.worker: Creates an AvroReader from a CloudObject spec.
AvroSink<T> - Class in com.google.cloud.dataflow.sdk.runners.worker: A sink that writes Avro files.
AvroSink(String, WindowedValue.ValueOnlyWindowedValueCoder<T>) - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.AvroSink
AvroSink(String, String, String, int, WindowedValue.ValueOnlyWindowedValueCoder<T>) - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.AvroSink
AvroSinkFactory - Class in com.google.cloud.dataflow.sdk.runners.worker: Creates an AvroSink from a CloudObject spec.
AvroSource<T> - Class in com.google.cloud.dataflow.sdk.io: A FileBasedSource for reading Avro-format files.
AvroSource.AvroReader<T> - Class in com.google.cloud.dataflow.sdk.io: A BlockBasedSource.BlockBasedReader for reading blocks from Avro files.

B

bag(String, Coder<T>) - Static method in class com.google.cloud.dataflow.sdk.util.state.StateTags: Create a state tag that is optimized for adding values frequently, and occasionally retrieving all the values that have been added.
BagState<T> - Interface in com.google.cloud.dataflow.sdk.util.state: State containing a bag values.
Base64Utils - Class in com.google.cloud.dataflow.sdk.util: Utilities related to Base64 encoding.
Base64Utils() - Constructor for class com.google.cloud.dataflow.sdk.util.Base64Utils
BaseExecutionContext - Class in com.google.cloud.dataflow.sdk.util: Base class for implementations of ExecutionContext.
BaseExecutionContext() - Constructor for class com.google.cloud.dataflow.sdk.util.BaseExecutionContext
BaseExecutionContext.StepContext - Class in com.google.cloud.dataflow.sdk.util: Base class for implementations of ExecutionContext.StepContext.
baseOutputFilename - Variable in class com.google.cloud.dataflow.sdk.io.FileBasedSink: Base filename for final output files.
baseTemporaryFilename - Variable in class com.google.cloud.dataflow.sdk.io.FileBasedSink.FileBasedWriteOperation: Base filename used for temporary output files.
BasicSerializableSourceFormat - Class in com.google.cloud.dataflow.sdk.runners.dataflow: A helper class for supporting sources defined as Source.
BasicSerializableSourceFormat(PipelineOptions) - Constructor for class com.google.cloud.dataflow.sdk.runners.dataflow.BasicSerializableSourceFormat
BasicSerializableSourceFormat.BoundedSourceSplit<T> - Class in com.google.cloud.dataflow.sdk.runners.dataflow: A DynamicSplitResult specified explicitly by a pair of BoundedSource objects describing the primary and residual sources.
Batch(List<ShuffleEntry>, ShufflePosition) - Constructor for class com.google.cloud.dataflow.sdk.util.common.worker.ShuffleBatchReader.Batch
BatchingShuffleEntryReader - Class in com.google.cloud.dataflow.sdk.util.common.worker: BatchingShuffleEntryReader provides a mechanism for reading entries from a shuffle dataset.
BatchingShuffleEntryReader(ShuffleBatchReader) - Constructor for class com.google.cloud.dataflow.sdk.util.common.worker.BatchingShuffleEntryReader: Constructs a BatchingShuffleEntryReader.
BatchModeExecutionContext - Class in com.google.cloud.dataflow.sdk.util: ExecutionContext for use in batch mode.
BatchModeExecutionContext() - Constructor for class com.google.cloud.dataflow.sdk.util.BatchModeExecutionContext: Creates a BatchModeExecutionContext.
BatchTimerInternals - Class in com.google.cloud.dataflow.sdk.util: TimerInternals that uses priority queues to manage the timers that are ready to fire.
BatchTimerInternals(Instant) - Constructor for class com.google.cloud.dataflow.sdk.util.BatchTimerInternals
beforeExecute(Thread, Runnable) - Method in class com.google.cloud.dataflow.sdk.util.BoundedQueueExecutor
begin() - Method in class com.google.cloud.dataflow.sdk.Pipeline: Returns a PBegin owned by this Pipeline.
beginningOnDay(int) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.MonthsWindows
beginningOnDay(int, int) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.YearsWindows
BigEndianIntegerCoder - Class in com.google.cloud.dataflow.sdk.coders: A BigEndianIntegerCoder encodes Integers in 4 bytes, big-endian.
BigEndianLongCoder - Class in com.google.cloud.dataflow.sdk.coders: A BigEndianLongCoder encodes Longs in 8 bytes, big-endian.
BIGQUERY_CREATE_DISPOSITION - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
BIGQUERY_DATASET - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
BIGQUERY_PROJECT - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
BIGQUERY_QUERY - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
BIGQUERY_SCHEMA - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
BIGQUERY_TABLE - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
BIGQUERY_WRITE_DISPOSITION - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
BigQueryIO - Class in com.google.cloud.dataflow.sdk.io: PTransforms for reading and writing BigQuery tables.
BigQueryIO() - Constructor for class com.google.cloud.dataflow.sdk.io.BigQueryIO
BigQueryIO.Read - Class in com.google.cloud.dataflow.sdk.io: A PTransform that reads from a BigQuery table and returns a PCollection of TableRows containing each of the rows of the table.
BigQueryIO.Read.Bound - Class in com.google.cloud.dataflow.sdk.io: A PTransform that reads from a BigQuery table and returns a bounded PCollection of TableRows.
BigQueryIO.ShardedKeyCoder<KeyT> - Class in com.google.cloud.dataflow.sdk.io: A Coder for ShardedKey, using a wrapped key Coder.
BigQueryIO.Write - Class in com.google.cloud.dataflow.sdk.io: A PTransform that writes a PCollection containing TableRows to a BigQuery table.
BigQueryIO.Write.Bound - Class in com.google.cloud.dataflow.sdk.io: A PTransform that can write either a bounded or unbounded PCollection of TableRows to a BigQuery table.
BigQueryIO.Write.CreateDisposition - Enum in com.google.cloud.dataflow.sdk.io: An enumeration type for the BigQuery create disposition strings publicly documented as CREATE_NEVER, and CREATE_IF_NEEDED.
BigQueryIO.Write.WriteDisposition - Enum in com.google.cloud.dataflow.sdk.io: An enumeration type for the BigQuery write disposition strings publicly documented as WRITE_TRUNCATE, WRITE_APPEND, and WRITE_EMPTY.
BigQueryIOTranslator - Class in com.google.cloud.dataflow.sdk.runners.dataflow: BigQuery transform support code for the Dataflow backend.
BigQueryIOTranslator() - Constructor for class com.google.cloud.dataflow.sdk.runners.dataflow.BigQueryIOTranslator
BigQueryIOTranslator.ReadTranslator - Class in com.google.cloud.dataflow.sdk.runners.dataflow: Implements BigQueryIO Read translation for the Dataflow backend.
BigQueryIOTranslator.WriteTranslator - Class in com.google.cloud.dataflow.sdk.runners.dataflow: Implements BigQueryIO Write translation for the Dataflow backend.
BigQueryOptions - Interface in com.google.cloud.dataflow.sdk.options: Properties needed when using BigQuery with the Dataflow SDK.
BigQueryReader - Class in com.google.cloud.dataflow.sdk.runners.worker: A source that reads a BigQuery table and yields TableRow objects.
BigQueryReader(BigQueryOptions, TableReference) - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.BigQueryReader: Builds a BigQuery source using pipeline options to instantiate a Bigquery client.
BigQueryReader(BigQueryOptions, String, String) - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.BigQueryReader
BigQueryReader(Bigquery, TableReference) - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.BigQueryReader: Builds a BigQueryReader directly using a BigQuery client.
BigQueryReader(Bigquery, String, String) - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.BigQueryReader
BigQueryReaderFactory - Class in com.google.cloud.dataflow.sdk.runners.worker: Creates a BigQueryReader from a CloudObject spec.
BigQueryTableInserter - Class in com.google.cloud.dataflow.sdk.util: Inserts rows into BigQuery.
BigQueryTableInserter(Bigquery, TableReference) - Constructor for class com.google.cloud.dataflow.sdk.util.BigQueryTableInserter: Constructs a new row inserter.
BigQueryTableInserter(Bigquery, TableReference, int) - Constructor for class com.google.cloud.dataflow.sdk.util.BigQueryTableInserter: Constructs a new row inserter.
BigQueryTableRowIterator - Class in com.google.cloud.dataflow.sdk.util: Iterates over all rows in a table.
BigQueryTableRowIterator(Bigquery, TableReference) - Constructor for class com.google.cloud.dataflow.sdk.util.BigQueryTableRowIterator
BigQueryTableRowIterator(Bigquery, String, String) - Constructor for class com.google.cloud.dataflow.sdk.util.BigQueryTableRowIterator
BINARY - Static variable in class com.google.cloud.dataflow.sdk.util.MimeTypes
BinaryCombineDoubleFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineDoubleFn
BinaryCombineFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineFn
BinaryCombineIntegerFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineIntegerFn
BinaryCombineLongFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineLongFn
bind(StateTag.StateBinder) - Method in interface com.google.cloud.dataflow.sdk.util.state.StateTag: Use the binder to create an instance of StateT appropriate for this address.
bindBag(StateTag<BagState<T>>, Coder<T>) - Method in interface com.google.cloud.dataflow.sdk.util.state.StateTag.StateBinder
bindCombiningValue(StateTag<CombiningValueStateInternal<InputT, AccumT, OutputT>>, Coder<AccumT>, Combine.CombineFn<InputT, AccumT, OutputT>) - Method in interface com.google.cloud.dataflow.sdk.util.state.StateTag.StateBinder
binderForNamespace(StateNamespace) - Method in class com.google.cloud.dataflow.sdk.util.state.StateTable: Provide the StateBinder to use for creating Storage instances in the specified namespace.
bindValue(StateTag<ValueState<T>>, Coder<T>) - Method in interface com.google.cloud.dataflow.sdk.util.state.StateTag.StateBinder
bindWatermark(StateTag<WatermarkStateInternal>) - Method in interface com.google.cloud.dataflow.sdk.util.state.StateTag.StateBinder
Block() - Constructor for class com.google.cloud.dataflow.sdk.io.BlockBasedSource.Block
BlockBasedReader(BlockBasedSource<T>) - Constructor for class com.google.cloud.dataflow.sdk.io.BlockBasedSource.BlockBasedReader
BlockBasedSource<T> - Class in com.google.cloud.dataflow.sdk.io: A BlockBasedSource is a FileBasedSource where a file consists of blocks of records.
BlockBasedSource(String, long) - Constructor for class com.google.cloud.dataflow.sdk.io.BlockBasedSource: Creates a BlockBasedSource based on a file name or pattern.
BlockBasedSource(String, long, long, long) - Constructor for class com.google.cloud.dataflow.sdk.io.BlockBasedSource: Creates a BlockBasedSource for a single file.
BlockBasedSource.Block<T> - Class in com.google.cloud.dataflow.sdk.io: A Block represents a block of records that can be read.
BlockBasedSource.BlockBasedReader<T> - Class in com.google.cloud.dataflow.sdk.io: A Reader that reads records from a BlockBasedSource.
BlockingDataflowPipelineOptions - Interface in com.google.cloud.dataflow.sdk.options: Options that are used to configure the BlockingDataflowPipelineRunner.
BlockingDataflowPipelineOptions.StandardOutputFactory - Class in com.google.cloud.dataflow.sdk.options: Returns a default of System.out.
BlockingDataflowPipelineRunner - Class in com.google.cloud.dataflow.sdk.runners: A PipelineRunner that's like DataflowPipelineRunner but that waits for the launched job to finish.
BlockingDataflowPipelineRunner(DataflowPipelineRunner, BlockingDataflowPipelineOptions) - Constructor for class com.google.cloud.dataflow.sdk.runners.BlockingDataflowPipelineRunner
booleans(String, Counter.AggregationKind) - Static method in class com.google.cloud.dataflow.sdk.util.common.Counter: Constructs a new Counter that aggregates Boolean values according to the desired aggregation kind.
Bound() - Constructor for class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.Bound
BoundedQueueExecutor - Class in com.google.cloud.dataflow.sdk.util: Executor that blocks on execute() if its queue is full.
BoundedQueueExecutor(int, long, TimeUnit, int, ThreadFactory) - Constructor for class com.google.cloud.dataflow.sdk.util.BoundedQueueExecutor
BoundedReader() - Constructor for class com.google.cloud.dataflow.sdk.io.BoundedSource.BoundedReader
BoundedSource<T> - Class in com.google.cloud.dataflow.sdk.io: A Source that reads a finite amount of input and, because of that, supports some additional operations.
BoundedSource() - Constructor for class com.google.cloud.dataflow.sdk.io.BoundedSource
BoundedSource.BoundedReader<T> - Class in com.google.cloud.dataflow.sdk.io: A Reader that reads a bounded amount of input and supports some additional operations, such as progress estimation and dynamic work rebalancing.
BoundedSourceSplit(BoundedSource<T>, BoundedSource<T>) - Constructor for class com.google.cloud.dataflow.sdk.runners.dataflow.BasicSerializableSourceFormat.BoundedSourceSplit
BoundedWindow - Class in com.google.cloud.dataflow.sdk.transforms.windowing: A BoundedWindow represents a finite grouping of elements, with an upper bound (larger timestamps represent more recent data) on the timestamps of elements that can be placed in the window.
BoundedWindow() - Constructor for class com.google.cloud.dataflow.sdk.transforms.windowing.BoundedWindow
bucketExists(GcsPath) - Method in class com.google.cloud.dataflow.sdk.util.GcsUtil: Returns whether the GCS bucket exists.
BUF_SIZE - Static variable in class com.google.cloud.dataflow.sdk.runners.worker.FileBasedReader
BufferingGroupingTable(long, PartialGroupByKeyOperation.GroupingKeyCreator<? super K>, PartialGroupByKeyOperation.PairInfo, PartialGroupByKeyOperation.SizeEstimator<? super K>, PartialGroupByKeyOperation.SizeEstimator<? super V>) - Constructor for class com.google.cloud.dataflow.sdk.util.common.worker.PartialGroupByKeyOperation.BufferingGroupingTable
build() - Method in class com.google.cloud.dataflow.sdk.util.InstanceBuilder: Creates the instance by calling the factory method with the given arguments.
buildTemporaryFilename(String, String) - Static method in class com.google.cloud.dataflow.sdk.io.FileBasedSink.FileBasedWriteOperation: Build a temporary filename using the temporary filename separator with the given prefix and suffix.
by(PredicateT) - Static method in class com.google.cloud.dataflow.sdk.transforms.Filter: Returns a PTransform that takes an input PCollection<T> and returns a PCollection<T> with elements that satisfy the given predicate.
ByteArrayCoder - Class in com.google.cloud.dataflow.sdk.coders: A ByteArrayCoder encodes byte[] objects.
ByteArrayShufflePosition - Class in com.google.cloud.dataflow.sdk.runners.worker: Represents a position of a GroupingShuffleReader as an opaque array of bytes, encoded in a way such that lexicographic ordering of the bytes is consistent with the inherent ordering of GroupingShuffleReader positions.
ByteArrayShufflePosition(byte[]) - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.ByteArrayShufflePosition
byteArrayToJsonString(byte[]) - Static method in class com.google.cloud.dataflow.sdk.util.StringUtils: Converts the given array of bytes into a legal JSON string.
byteArrayToString(byte[]) - Static method in class com.google.cloud.dataflow.sdk.util.common.worker.ShuffleEntry
bytesCounterName(String, String) - Method in class com.google.cloud.dataflow.sdk.util.common.worker.ReadOperation
bytesCounterName(String, String) - Method in class com.google.cloud.dataflow.sdk.util.common.worker.WriteOperation

C

CachingShuffleBatchReader - Class in com.google.cloud.dataflow.sdk.util.common.worker: A ShuffleBatchReader that caches batches as they're read.
CachingShuffleBatchReader(ShuffleBatchReader) - Constructor for class com.google.cloud.dataflow.sdk.util.common.worker.CachingShuffleBatchReader: Constructs a new CachingShuffleBatchReader.
CalendarWindows - Class in com.google.cloud.dataflow.sdk.transforms.windowing: A collection of WindowFns that windows values into calendar-based windows such as spans of days, months, or years.
CalendarWindows() - Constructor for class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows
CalendarWindows.DaysWindows - Class in com.google.cloud.dataflow.sdk.transforms.windowing: A WindowFn that windows elements into periods measured by days.
CalendarWindows.MonthsWindows - Class in com.google.cloud.dataflow.sdk.transforms.windowing: A WindowFn that windows elements into periods measured by months.
CalendarWindows.YearsWindows - Class in com.google.cloud.dataflow.sdk.transforms.windowing: A WindowFn that windows elements into periods measured by years.
cancel() - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineJob: Cancels the job.
CannotProvideCoderException - Exception in com.google.cloud.dataflow.sdk.coders: The exception thrown when a CoderProvider cannot provide a Coder that has been requested.
CannotProvideCoderException(String) - Constructor for exception com.google.cloud.dataflow.sdk.coders.CannotProvideCoderException
CannotProvideCoderException(String, Throwable) - Constructor for exception com.google.cloud.dataflow.sdk.coders.CannotProvideCoderException
CannotProvideCoderException(Throwable) - Constructor for exception com.google.cloud.dataflow.sdk.coders.CannotProvideCoderException
check(TypeDescriptor<?>, Schema) - Method in class com.google.cloud.dataflow.sdk.coders.AvroCoder.AvroDeterminismChecker
CLASS_AND_METHOD_FORMATTER - Static variable in class com.google.cloud.dataflow.sdk.util.common.ReflectHelpers: A Function that turns a method into the declaring class + method signature.
CLASS_NAME - Static variable in class com.google.cloud.dataflow.sdk.util.common.ReflectHelpers: A Function with returns the classes name.
CLASS_SIMPLE_NAME - Static variable in class com.google.cloud.dataflow.sdk.util.common.ReflectHelpers: A Function with returns the classes name.
clear(Trigger<W>.TriggerContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterPane
clear(Trigger<W>.TriggerContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterProcessingTime
clear(Trigger<W>.TriggerContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.DefaultTrigger
clear(Trigger<W>.TriggerContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Trigger: Clear any state associated with this trigger in the given window.
clear(ReduceFn.StateContext) - Method in class com.google.cloud.dataflow.sdk.util.PaneInfoTracker
clear() - Method in class com.google.cloud.dataflow.sdk.util.state.InMemoryStateInternals
clear() - Method in interface com.google.cloud.dataflow.sdk.util.state.State: Clear out the state location.
clear() - Method in class com.google.cloud.dataflow.sdk.util.state.StateTable
clearEverything(ReduceFn<?, ?, ?, W>.Context) - Method in class com.google.cloud.dataflow.sdk.util.TriggerRunner: Clear all the state for executing triggers, including the finished bits.
clearNamespace(StateNamespace) - Method in class com.google.cloud.dataflow.sdk.util.state.StateTable
clearOutputElements() - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnTester: Clears the record of the elements output so far to the main output.
clearPane(ReduceFn<?, ?, ?, W>.Context) - Method in class com.google.cloud.dataflow.sdk.util.NonEmptyPanes: Record that the given pane is empty.
clearSideOutputElements(TupleTag<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnTester: Clears the record of the elements output so far to the side output with the given tag.
clearState(ReduceFn<K, InputT, OutputT, W>.Context) - Method in class com.google.cloud.dataflow.sdk.util.ReduceFn: Called to clear any persisted state that the ReduceFn may be holding.
clearState(ReduceFn<?, ?, ?, W>.Context) - Method in class com.google.cloud.dataflow.sdk.util.TriggerRunner: Clear the state used for executing triggers, but leave the finished set to indicate the window is closed.
clone() - Method in class com.google.cloud.dataflow.sdk.util.CloudObject
clone(Coder<T>, T) - Static method in class com.google.cloud.dataflow.sdk.util.CoderUtils: Clones the given value by encoding and then decoding it with the specified Coder.
clone() - Method in class com.google.cloud.dataflow.sdk.util.common.ForwardingReiterator
clone() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.ProgressTrackingReiterator
clone(T) - Static method in class com.google.cloud.dataflow.sdk.util.SerializableUtils
cloneAs(Class<T>) - Method in interface com.google.cloud.dataflow.sdk.options.PipelineOptions: Makes a deep clone of this object, and transforms the cloned object into the specified type kls.
close() - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.DatastoreReader
close() - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSink.FileBasedWriter: Closes the channel and return the bundle result.
close() - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSource.FileBasedReader: Closes any ReadableByteChannel created for the current reader.
close() - Method in class com.google.cloud.dataflow.sdk.io.Sink.Writer: Finishes writing the bundle.
close() - Method in class com.google.cloud.dataflow.sdk.io.Source.Reader: Closes the reader.
close() - Method in class com.google.cloud.dataflow.sdk.runners.worker.ApplianceShuffleWriter
close() - Method in class com.google.cloud.dataflow.sdk.runners.worker.FileBasedReader.FileBasedIterator
close() - Method in class com.google.cloud.dataflow.sdk.runners.worker.logging.DataflowWorkerLoggingHandler
close() - Method in class com.google.cloud.dataflow.sdk.util.BigQueryTableRowIterator
close() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.MapTaskExecutor
close() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.Reader.AbstractReaderIterator
close() - Method in interface com.google.cloud.dataflow.sdk.util.common.worker.Reader.ReaderIterator
close() - Method in interface com.google.cloud.dataflow.sdk.util.common.worker.Sink.SinkWriter
close() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.StateSampler
close() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.StateSampler.ScopedState
close() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.WorkExecutor
close() - Method in class com.google.cloud.dataflow.sdk.util.ExposedByteArrayInputStream
close() - Method in class com.google.cloud.dataflow.sdk.util.ShardingWritableByteChannel
CloudCounterUtils - Class in com.google.cloud.dataflow.sdk.util: Utilities for working with CloudCounters.
CloudCounterUtils() - Constructor for class com.google.cloud.dataflow.sdk.util.CloudCounterUtils
CloudDebuggerOptions - Interface in com.google.cloud.dataflow.sdk.options: Options for controlling Cloud Debugger.
CloudMetricUtils - Class in com.google.cloud.dataflow.sdk.util: Utilities for working with Dataflow API Metrics.
CloudObject - Class in com.google.cloud.dataflow.sdk.util: A representation of an arbitrary Java object to be instantiated by Dataflow workers.
cloudPositionToReaderPosition(Position) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.SourceTranslationUtils
cloudProgressToReaderProgress(ApproximateProgress) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.SourceTranslationUtils
cloudSourceOperationRequestToSourceOperationRequest(SourceOperationRequest) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.SourceTranslationUtils
cloudSourceOperationResponseToSourceOperationResponse(SourceOperationResponse) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.SourceTranslationUtils
cloudSourceToDictionary(Source) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.SourceTranslationUtils
CloudSourceUtils - Class in com.google.cloud.dataflow.sdk.util: Utilities for working with Source Dataflow API definitions and Reader objects.
CloudSourceUtils() - Constructor for class com.google.cloud.dataflow.sdk.util.CloudSourceUtils
CO_GBK_RESULT_SCHEMA - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
Coder<T> - Interface in com.google.cloud.dataflow.sdk.coders: A Coder<T> defines how to encode and decode values of type T into byte streams.
coder - Variable in class com.google.cloud.dataflow.sdk.runners.worker.FileBasedReader
Coder.Context - Class in com.google.cloud.dataflow.sdk.coders: The context in which encoding or decoding is being done.
Coder.NonDeterministicException - Class in com.google.cloud.dataflow.sdk.coders: Exception thrown by Coder.verifyDeterministic() if the encoding is not deterministic.
coderAllowsEncoding(Coder<T>, String) - Static method in class com.google.cloud.dataflow.sdk.testing.CoderProperties
coderConsistentWithEquals(Coder<T>, T, T) - Static method in class com.google.cloud.dataflow.sdk.testing.CoderProperties
coderConsistentWithEqualsInContext(Coder<T>, Coder.Context, T, T) - Static method in class com.google.cloud.dataflow.sdk.testing.CoderProperties
coderDecodeEncodeContentsEqual(Coder<CollectionT>, CollectionT) - Static method in class com.google.cloud.dataflow.sdk.testing.CoderProperties: Verifies that for the given Coder<Collection<T>>, and value of type Collection<T>, encoding followed by decoding yields an equal value of type Collection<T>, in any Coder.Context.
coderDecodeEncodeContentsEqualInContext(Coder<CollectionT>, Coder.Context, CollectionT) - Static method in class com.google.cloud.dataflow.sdk.testing.CoderProperties: Verifies that for the given Coder<Collection<T>>, and value of type Collection<T>, encoding followed by decoding yields an equal value of type Collection<T>, in the given Coder.Context.
coderDecodeEncodeContentsInSameOrder(Coder<IterableT>, IterableT) - Static method in class com.google.cloud.dataflow.sdk.testing.CoderProperties: Verifies that for the given Coder<Collection<T>>, and value of type Collection<T>, encoding followed by decoding yields an equal value of type Collection<T>, in any Coder.Context.
coderDecodeEncodeContentsInSameOrderInContext(Coder<IterableT>, Coder.Context, IterableT) - Static method in class com.google.cloud.dataflow.sdk.testing.CoderProperties: Verifies that for the given Coder<Iterable<T>>, and value of type Iterable<T>, encoding followed by decoding yields an equal value of type Collection<T>, in the given Coder.Context.
coderDecodeEncodeEqual(Coder<T>, T) - Static method in class com.google.cloud.dataflow.sdk.testing.CoderProperties: Verifies that for the given Coder<T>, and value of type T, encoding followed by decoding yields an equal value of type T, in any Coder.Context.
coderDecodeEncodeEqualInContext(Coder<T>, Coder.Context, T) - Static method in class com.google.cloud.dataflow.sdk.testing.CoderProperties: Verifies that for the given Coder<T>, Coder.Context, and value of type T, encoding followed by decoding yields an equal value of type T.
coderDecodesBase64(Coder<T>, String, T) - Static method in class com.google.cloud.dataflow.sdk.testing.CoderProperties
coderDecodesBase64(Coder<T>, List<String>, List<T>) - Static method in class com.google.cloud.dataflow.sdk.testing.CoderProperties
coderDecodesBase64ContentsEqual(Coder<IterableT>, String, IterableT) - Static method in class com.google.cloud.dataflow.sdk.testing.CoderProperties
coderDecodesBase64ContentsEqual(Coder<IterableT>, List<String>, List<IterableT>) - Static method in class com.google.cloud.dataflow.sdk.testing.CoderProperties
coderDeterministic(Coder<T>, T, T) - Static method in class com.google.cloud.dataflow.sdk.testing.CoderProperties: Verifies that for the given Coder<T>, and values of type T, if the values are equal then the encoded bytes are equal, in any Coder.Context.
coderDeterministicInContext(Coder<T>, Coder.Context, T, T) - Static method in class com.google.cloud.dataflow.sdk.testing.CoderProperties: Verifies that for the given Coder<T>, Coder.Context, and values of type T, if the values are equal then the encoded bytes are equal.
coderEncodesBase64(Coder<T>, T, String) - Static method in class com.google.cloud.dataflow.sdk.testing.CoderProperties
coderEncodesBase64(Coder<T>, List<T>, List<String>) - Static method in class com.google.cloud.dataflow.sdk.testing.CoderProperties
CoderException - Exception in com.google.cloud.dataflow.sdk.coders: A CoderException is thrown if there is a problem encoding or decoding a value.
CoderException(String) - Constructor for exception com.google.cloud.dataflow.sdk.coders.CoderException
CoderException(String, Throwable) - Constructor for exception com.google.cloud.dataflow.sdk.coders.CoderException
CoderException(Throwable) - Constructor for exception com.google.cloud.dataflow.sdk.coders.CoderException
CoderFactories - Class in com.google.cloud.dataflow.sdk.coders: Static utility methods for creating and working with Coders.
CoderFactory - Interface in com.google.cloud.dataflow.sdk.coders: A CoderFactory creates coders and decomposes values.
coderHasEncodingId(Coder<T>, String) - Static method in class com.google.cloud.dataflow.sdk.testing.CoderProperties
CoderProperties - Class in com.google.cloud.dataflow.sdk.testing: Properties for use in Coder tests.
CoderProperties() - Constructor for class com.google.cloud.dataflow.sdk.testing.CoderProperties
CoderProvider - Interface in com.google.cloud.dataflow.sdk.coders: A CoderProvider may create a Coder for any concrete class.
CoderRegistry - Class in com.google.cloud.dataflow.sdk.coders: A CoderRegistry allows registering the default Coder to use for a Java class, and looking up and instantiating the default Coder for a Java type.
CoderRegistry() - Constructor for class com.google.cloud.dataflow.sdk.coders.CoderRegistry
coderSerializable(Coder<T>) - Static method in class com.google.cloud.dataflow.sdk.testing.CoderProperties
CoderSizeEstimator(Coder<T>) - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.MapTaskExecutorFactory.CoderSizeEstimator
CoderUtils - Class in com.google.cloud.dataflow.sdk.util: Utilities for working with Coders.
CoGbkResult - Class in com.google.cloud.dataflow.sdk.transforms.join: A row result of a CoGroupByKey.
CoGbkResult(CoGbkResultSchema, Iterable<RawUnionValue>) - Constructor for class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult: A row in the PCollection resulting from a CoGroupByKey transform.
CoGbkResult(CoGbkResultSchema, Iterable<RawUnionValue>, int) - Constructor for class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult
CoGbkResult.CoGbkResultCoder - Class in com.google.cloud.dataflow.sdk.transforms.join: A Coder for CoGbkResults.
CoGbkResultSchema - Class in com.google.cloud.dataflow.sdk.transforms.join: A schema for the results of a CoGroupByKey.
CoGbkResultSchema(TupleTagList) - Constructor for class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResultSchema: Builds a schema from a tuple of TupleTag<?>s.
CoGroupByKey<K> - Class in com.google.cloud.dataflow.sdk.transforms.join: A PTransform that performs a CoGroupByKey on a tuple of tables.
CollectionCoder<T> - Class in com.google.cloud.dataflow.sdk.coders: A CollectionCoder encodes Collections.
CollectionCoder(Coder<T>) - Constructor for class com.google.cloud.dataflow.sdk.coders.CollectionCoder
com.google.cloud.dataflow.sdk - package com.google.cloud.dataflow.sdk: Provides a simple, powerful model for building both batch and streaming parallel data processing Pipelines.
com.google.cloud.dataflow.sdk.annotations - package com.google.cloud.dataflow.sdk.annotations: Defines annotations used across the SDK.
com.google.cloud.dataflow.sdk.coders - package com.google.cloud.dataflow.sdk.coders: Defines Coders to specify how data is encoded to and decoded from byte strings.
com.google.cloud.dataflow.sdk.io - package com.google.cloud.dataflow.sdk.io: Defines transforms for reading and writing common storage formats, including AvroIO, BigQueryIO, and TextIO.
com.google.cloud.dataflow.sdk.io.range - package com.google.cloud.dataflow.sdk.io.range
com.google.cloud.dataflow.sdk.options - package com.google.cloud.dataflow.sdk.options: Defines PipelineOptions for configuring pipeline execution.
com.google.cloud.dataflow.sdk.runners - package com.google.cloud.dataflow.sdk.runners: Defines runners for executing Pipelines in different modes, including DirectPipelineRunner and DataflowPipelineRunner.
com.google.cloud.dataflow.sdk.runners.dataflow - package com.google.cloud.dataflow.sdk.runners.dataflow: Implementation of the DataflowPipelineRunner.
com.google.cloud.dataflow.sdk.runners.worker - package com.google.cloud.dataflow.sdk.runners.worker: Implementation of the harness that runs on each Google Compute Engine instance to coordinate execution of Pipeline code.
com.google.cloud.dataflow.sdk.runners.worker.logging - package com.google.cloud.dataflow.sdk.runners.worker.logging
com.google.cloud.dataflow.sdk.runners.worker.windmill - package com.google.cloud.dataflow.sdk.runners.worker.windmill
com.google.cloud.dataflow.sdk.testing - package com.google.cloud.dataflow.sdk.testing: Defines utilities for unit testing Dataflow pipelines.
com.google.cloud.dataflow.sdk.transforms - package com.google.cloud.dataflow.sdk.transforms: Defines PTransforms for transforming data in a pipeline.
com.google.cloud.dataflow.sdk.transforms.join - package com.google.cloud.dataflow.sdk.transforms.join: Defines the CoGroupByKey transform for joining multiple PCollections.
com.google.cloud.dataflow.sdk.transforms.windowing - package com.google.cloud.dataflow.sdk.transforms.windowing: Defines the Window transform for dividing the elements in a PCollection into windows, and the Trigger for controlling when those elements are output.
com.google.cloud.dataflow.sdk.util - package com.google.cloud.dataflow.sdk.util: Defines utilities used by the Dataflow SDK.
com.google.cloud.dataflow.sdk.util.common - package com.google.cloud.dataflow.sdk.util.common: Defines utilities shared by multiple PipelineRunner implementations.
com.google.cloud.dataflow.sdk.util.common.worker - package com.google.cloud.dataflow.sdk.util.common.worker: Defines utilities used to implement the harness that runs user code.
com.google.cloud.dataflow.sdk.util.gcsfs - package com.google.cloud.dataflow.sdk.util.gcsfs: Defines utilities used to interact with Google Cloud Storage.
com.google.cloud.dataflow.sdk.util.state - package com.google.cloud.dataflow.sdk.util.state
com.google.cloud.dataflow.sdk.values - package com.google.cloud.dataflow.sdk.values: Defines PCollection and other classes for representing data in a Pipeline.
Combine - Class in com.google.cloud.dataflow.sdk.transforms: PTransforms for combining PCollection elements globally and per-key.
Combine() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Combine
Combine.AccumulatingCombineFn<InputT,AccumT extends Combine.AccumulatingCombineFn.Accumulator<InputT,AccumT,OutputT>,OutputT> - Class in com.google.cloud.dataflow.sdk.transforms: A CombineFn that uses a subclass of Combine.AccumulatingCombineFn.Accumulator as its accumulator type.
Combine.AccumulatingCombineFn.Accumulator<InputT,AccumT,OutputT> - Interface in com.google.cloud.dataflow.sdk.transforms: The type of mutable accumulator values used by this AccumulatingCombineFn.
Combine.BinaryCombineDoubleFn - Class in com.google.cloud.dataflow.sdk.transforms: An abstract subclass of Combine.CombineFn for implementing combiners that are more easily expressed as binary operations on doubles.
Combine.BinaryCombineFn<V> - Class in com.google.cloud.dataflow.sdk.transforms: An abstract subclass of Combine.CombineFn for implementing combiners that are more easily expressed as binary operations.
Combine.BinaryCombineIntegerFn - Class in com.google.cloud.dataflow.sdk.transforms: An abstract subclass of Combine.CombineFn for implementing combiners that are more easily expressed as binary operations on ints.
Combine.BinaryCombineLongFn - Class in com.google.cloud.dataflow.sdk.transforms: An abstract subclass of Combine.CombineFn for implementing combiners that are more easily expressed as binary operations on longs.
Combine.CombineFn<InputT,AccumT,OutputT> - Class in com.google.cloud.dataflow.sdk.transforms: A CombineFn<InputT, AccumT, OutputT> specifies how to combine a collection of input values of type InputT into a single output value of type OutputT.
Combine.Globally<InputT,OutputT> - Class in com.google.cloud.dataflow.sdk.transforms: Combine.Globally<InputT, OutputT> takes a PCollection<InputT> and returns a PCollection<OutputT> whose elements are the result of combining all the elements in each window of the input PCollection, using a specified CombineFn<InputT, AccumT, OutputT>.
Combine.GloballyAsSingletonView<InputT,OutputT> - Class in com.google.cloud.dataflow.sdk.transforms: Combine.GloballyAsSingletonView<InputT, OutputT> takes a PCollection<InputT> and returns a PCollectionView<OutputT> whose elements are the result of combining all the elements in each window of the input PCollection, using a specified CombineFn<InputT, AccumT, OutputT>.
Combine.GroupedValues<K,InputT,OutputT> - Class in com.google.cloud.dataflow.sdk.transforms: GroupedValues<K, InputT, OutputT> takes a PCollection<KV<K, Iterable<InputT>>>, such as the result of GroupByKey, applies a specified KeyedCombineFn<K, InputT, AccumT, OutputT> to each of the input KV<K, Iterable<InputT>> elements to produce a combined output KV<K, OutputT> element, and returns a PCollection<KV<K, OutputT>> containing all the combined output elements.
Combine.Holder<V> - Class in com.google.cloud.dataflow.sdk.transforms: Holds a single value value of type V which may or may not be present.
Combine.IterableCombineFn<V> - Class in com.google.cloud.dataflow.sdk.transforms: Converts a SerializableFunction from Iterable<V>s to Vs into a simple Combine.CombineFn over Vs.
Combine.KeyedCombineFn<K,InputT,AccumT,OutputT> - Class in com.google.cloud.dataflow.sdk.transforms: A KeyedCombineFn<K, InputT, AccumT, OutputT> specifies how to combine a collection of input values of type InputT, associated with a key of type K, into a single output value of type OutputT.
Combine.PerKey<K,InputT,OutputT> - Class in com.google.cloud.dataflow.sdk.transforms: PerKey<K, InputT, OutputT> takes a PCollection<KV<K, InputT>>, groups it by key, applies a combining function to the InputT values associated with each key to produce a combined OutputT value, and returns a PCollection<KV<K, OutputT>> representing a map from each distinct key of the input PCollection to the corresponding combined value.
Combine.PerKeyWithHotKeyFanout<K,InputT,OutputT> - Class in com.google.cloud.dataflow.sdk.transforms: Like Combine.PerKey, but sharding the combining of hot keys.
Combine.SimpleCombineFn<V> - Class in com.google.cloud.dataflow.sdk.transforms: Deprecated.
COMBINE_FN - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
CombineFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Combine.CombineFn
CombiningGroupingTable(long, PartialGroupByKeyOperation.GroupingKeyCreator<? super K>, PartialGroupByKeyOperation.PairInfo, PartialGroupByKeyOperation.Combiner<? super K, InputT, AccumT, ?>, PartialGroupByKeyOperation.SizeEstimator<? super K>, PartialGroupByKeyOperation.SizeEstimator<? super AccumT>) - Constructor for class com.google.cloud.dataflow.sdk.util.common.worker.PartialGroupByKeyOperation.CombiningGroupingTable
combiningValue(String, Coder<AccumT>, Combine.CombineFn<InputT, AccumT, OutputT>) - Static method in class com.google.cloud.dataflow.sdk.util.state.StateTags: Create a state tag for values that use a Combine.CombineFn to automatically merge multiple InputTs into a single OutputT.
combiningValueFromInputInternal(String, Coder<InputT>, Combine.CombineFn<InputT, AccumT, OutputT>) - Static method in class com.google.cloud.dataflow.sdk.util.state.StateTags: Create a state tag for values that use a Combine.CombineFn to automatically merge multiple InputTs into a single OutputT.
CombiningValueState<InputT,OutputT> - Interface in com.google.cloud.dataflow.sdk.util.state: State that combines multiple InputT values using a Combine.CombineFn to produce a single OutputT value.
CombiningValueStateInternal<InputT,AccumT,OutputT> - Interface in com.google.cloud.dataflow.sdk.util.state: State for a single value that is managed by a Combine.CombineFn.
commitWork(Windmill.CommitWorkRequest) - Method in class com.google.cloud.dataflow.sdk.runners.worker.windmill.WindmillServerStub: Commit the work, issuing any output productions, state modifications etc.
compare(T, T) - Method in class com.google.cloud.dataflow.sdk.transforms.Top.Largest
compare(T, T) - Method in class com.google.cloud.dataflow.sdk.transforms.Top.Smallest
compare(JobMessage, JobMessage) - Method in class com.google.cloud.dataflow.sdk.util.MonitoringUtil.TimeStampComparator
compare(KV<K, V>, KV<K, V>) - Method in class com.google.cloud.dataflow.sdk.values.KV.OrderByKey
compare(KV<K, V>, KV<K, V>) - Method in class com.google.cloud.dataflow.sdk.values.KV.OrderByValue
compareTo(ByteArrayShufflePosition) - Method in class com.google.cloud.dataflow.sdk.runners.worker.ByteArrayShufflePosition
compareTo(IntervalWindow) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.IntervalWindow
compareTo(Path) - Method in class com.google.cloud.dataflow.sdk.util.gcsfs.GcsPath
compareTo(TimerInternals.TimerData) - Method in class com.google.cloud.dataflow.sdk.util.TimerInternals.TimerData
COMPONENT_ENCODINGS - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
CompressedReader(CompressedSource<T>, FileBasedSource.FileBasedReader<T>) - Constructor for class com.google.cloud.dataflow.sdk.io.CompressedSource.CompressedReader: Create a CompressedReader from a CompressedSource and delegate reader.
CompressedSource<T> - Class in com.google.cloud.dataflow.sdk.io: A Source that reads from compressed files.
CompressedSource.CompressedReader<T> - Class in com.google.cloud.dataflow.sdk.io: Reader for a CompressedSource.
CompressedSource.CompressionMode - Enum in com.google.cloud.dataflow.sdk.io: Default compression types supported by the CompressedSource.
CompressedSource.DecompressingChannelFactory - Interface in com.google.cloud.dataflow.sdk.io: Factory interface for creating channels that decompress the content of an underlying channel.
COMPRESSION_TYPE - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
compressionStreamFactory - Variable in class com.google.cloud.dataflow.sdk.runners.worker.FileBasedReader.FileBasedIterator
computeTargetTimestamp(Instant) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.TimeTrigger
CONCAT_SOURCE_BASE_SPECS - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
CONCAT_SOURCE_SOURCES - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
Concatenate() - Constructor for class com.google.cloud.dataflow.sdk.transforms.View.Concatenate
ConcatReader<T> - Class in com.google.cloud.dataflow.sdk.runners.worker: A Reader that reads elements from a given set of encoded Sources.
ConcatReader(PipelineOptions, ExecutionContext, List<Source>) - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.ConcatReader: Create a ConcatReader using a given list of encoded Sources.
ConcatReaderFactory - Class in com.google.cloud.dataflow.sdk.runners.worker: Creates an ConcatReader from a CloudObject spec.
ConcatReaderFactory() - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.ConcatReaderFactory
CONFIDENCE_INTERVAL_SIGMA - Static variable in class com.google.cloud.dataflow.sdk.util.common.worker.PartialGroupByKeyOperation.SamplingSizeEstimator: The degree of confidence required in our expected value predictions before we allow under-sampling.
CONFIDENCE_INTERVAL_SIZE - Static variable in class com.google.cloud.dataflow.sdk.util.common.worker.PartialGroupByKeyOperation.SamplingSizeEstimator: The desired size of our confidence interval (relative to the measured expected value).
configure(DataflowWorkerLoggingOptions) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.logging.DataflowWorkerLoggingInitializer: Reconfigures logging with the passed in options.
consistentWithEquals() - Method in class com.google.cloud.dataflow.sdk.coders.BigEndianIntegerCoder
consistentWithEquals() - Method in class com.google.cloud.dataflow.sdk.coders.BigEndianLongCoder
consistentWithEquals() - Method in interface com.google.cloud.dataflow.sdk.coders.Coder: Returns true if the encoded bytes of two objects are equal only when they are also equal according to Object.equals().
consistentWithEquals() - Method in class com.google.cloud.dataflow.sdk.coders.DoubleCoder
consistentWithEquals() - Method in class com.google.cloud.dataflow.sdk.coders.DurationCoder
consistentWithEquals() - Method in class com.google.cloud.dataflow.sdk.coders.InstantCoder
consistentWithEquals() - Method in class com.google.cloud.dataflow.sdk.coders.KvCoder
consistentWithEquals() - Method in class com.google.cloud.dataflow.sdk.coders.StandardCoder
consistentWithEquals() - Method in class com.google.cloud.dataflow.sdk.coders.StringUtf8Coder
consistentWithEquals() - Method in class com.google.cloud.dataflow.sdk.coders.VarIntCoder
consistentWithEquals() - Method in class com.google.cloud.dataflow.sdk.coders.VarLongCoder
consistentWithEquals() - Method in class com.google.cloud.dataflow.sdk.coders.VoidCoder
constructName(String, String, String, int, int) - Static method in class com.google.cloud.dataflow.sdk.util.IOChannelUtils: Constructs a fully qualified name from components.
contains(Aggregator<?, ?>) - Method in class com.google.cloud.dataflow.sdk.runners.dataflow.DataflowAggregatorTransforms: Returns true if the provided Aggregator is used in the constructing Pipeline.
contains(PCollectionView<T>) - Method in class com.google.cloud.dataflow.sdk.runners.worker.DataflowSideInputReader
contains(IntervalWindow) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.IntervalWindow: Returns whether this window contains the given window.
contains(PCollectionView<T>) - Method in class com.google.cloud.dataflow.sdk.util.DirectSideInputReader
contains(PCollectionView<T>) - Method in class com.google.cloud.dataflow.sdk.util.NullSideInputReader
contains(PCollectionView<T>) - Method in interface com.google.cloud.dataflow.sdk.util.SideInputReader: Returns true if the given PCollectionView is valid for this reader.
contains(PCollectionView<T>) - Method in class com.google.cloud.dataflow.sdk.util.StreamingModeExecutionContext.StreamingModeSideInputReader
containsInAnyOrder(Iterable<T>) - Method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert.IterableAssert: Checks that the Iterable contains the expected elements, in any order.
containsInAnyOrder(T...) - Method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert.IterableAssert: Checks that the Iterable contains the expected elements, in any order.
Context(boolean) - Constructor for class com.google.cloud.dataflow.sdk.coders.Coder.Context
Context() - Constructor for class com.google.cloud.dataflow.sdk.transforms.DoFn.Context
Context() - Constructor for class com.google.cloud.dataflow.sdk.transforms.DoFnWithContext.Context
context - Variable in class com.google.cloud.dataflow.sdk.util.DoFnRunner: The context used for running the DoFn.
Context() - Constructor for class com.google.cloud.dataflow.sdk.util.ReduceFn.Context
copy() - Method in class com.google.cloud.dataflow.sdk.util.common.ForwardingReiterator: Returns a copy of the current Reiterator.
copy() - Method in class com.google.cloud.dataflow.sdk.util.common.PeekingReiterator
copy() - Method in interface com.google.cloud.dataflow.sdk.util.common.Reiterator: Returns a copy of the current Reiterator.
copy() - Method in interface com.google.cloud.dataflow.sdk.util.common.worker.ProgressTracker: Copies this ProgressTracker.
copy() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.Reader.AbstractReaderIterator
copy() - Method in interface com.google.cloud.dataflow.sdk.util.common.worker.Reader.ReaderIterator: Copies the current ReaderIterator.
copyToOutputFiles(List<String>, PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSink.FileBasedWriteOperation: Copy temporary files to final output filenames using the file naming template.
Count - Class in com.google.cloud.dataflow.sdk.transforms: PTransorms to count the elements in a PCollection.
Count() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Count
Count.PerElement<T> - Class in com.google.cloud.dataflow.sdk.transforms: Count.PerElement<T> takes a PCollection<T> and returns a PCollection<KV<T, Long>> representing a map from each distinct element of the input PCollection to the number of times that element occurs in the input.
countBytes(String) - Method in class com.google.cloud.dataflow.sdk.util.common.worker.OutputObjectAndByteCounter: Count output bytes.
Counter<T> - Class in com.google.cloud.dataflow.sdk.util.common: A Counter enables the aggregation of a stream of values over time.
Counter(String, Counter.AggregationKind) - Constructor for class com.google.cloud.dataflow.sdk.util.common.Counter
Counter.AggregationKind - Enum in com.google.cloud.dataflow.sdk.util.common: Possible kinds of counter aggregation.
Counter.CounterMean<T> - Interface in com.google.cloud.dataflow.sdk.util.common: The mean value of a Counter, represented as an aggregate value and a count.
CounterAggregator<InputT,AccumT,OutputT> - Class in com.google.cloud.dataflow.sdk.util: An implementation of the Aggregator interface that uses a Counter as the underlying representation.
CounterAggregator(String, Combine.CombineFn<? super InputT, AccumT, OutputT>, CounterSet.AddCounterMutator) - Constructor for class com.google.cloud.dataflow.sdk.util.CounterAggregator: Constructs a new aggregator with the given name and aggregation logic specified in the CombineFn argument.
CounterProvider<T> - Interface in com.google.cloud.dataflow.sdk.util.common: A counter provider can provide Counter instances.
CounterSet - Class in com.google.cloud.dataflow.sdk.util.common: A CounterSet maintains a set of Counters.
CounterSet(Counter<?>...) - Constructor for class com.google.cloud.dataflow.sdk.util.common.CounterSet: Constructs a CounterSet containing the given Counters.
CounterSet.AddCounterMutator - Class in com.google.cloud.dataflow.sdk.util.common: A nested class that supports adding additional counters into the enclosing CounterSet.
countMeanByte(String) - Method in class com.google.cloud.dataflow.sdk.util.common.worker.OutputObjectAndByteCounter: Count output mean byte.
countObject(String) - Method in class com.google.cloud.dataflow.sdk.util.common.worker.OutputObjectAndByteCounter: Count output objects.
create(List<? extends Coder<?>>) - Method in interface com.google.cloud.dataflow.sdk.coders.CoderFactory: Returns a Coder<?>, given argument coder to use for values of a particular type, given the Coders for each of the type's generic parameter types.
create(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.options.BlockingDataflowPipelineOptions.StandardOutputFactory
create(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions.DataflowClientFactory
create(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions.PathValidatorFactory
create(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions.StagerFactory
create(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.options.DataflowPipelineOptions.JobNameFactory
create(PipelineOptions) - Method in interface com.google.cloud.dataflow.sdk.options.DefaultValueFactory: Creates a default value for a getter marked with Default.InstanceFactory.
create(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.options.GcpOptions.CredentialDirFactory
create(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.options.GcpOptions.DefaultProjectFactory
create(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.options.GcpOptions.GcpUserCredentialsFactory
create(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.options.GcsOptions.ExecutorServiceFactory
create() - Method in class com.google.cloud.dataflow.sdk.options.PipelineOptionsFactory.Builder: Creates and returns an object that implements PipelineOptions using the values configured on this builder during construction.
create() - Static method in class com.google.cloud.dataflow.sdk.options.PipelineOptionsFactory: Creates and returns an object that implements PipelineOptions.
create(PipelineOptions) - Static method in class com.google.cloud.dataflow.sdk.Pipeline: Constructs a pipeline from the provided options.
create(PipelineOptions, CloudObject, Coder<WindowedValue<T>>, ExecutionContext) - Static method in class com.google.cloud.dataflow.sdk.runners.dataflow.BasicSerializableSourceFormat: Factory method allowing this class to satisfy the implicit contract of ReaderFactory.
create(DataflowPipelineOptions) - Static method in class com.google.cloud.dataflow.sdk.runners.DataflowPipeline: Creates and returns a new DataflowPipeline instance for tests.
create(Combine.GroupedValues<K, InputT, OutputT>, PCollection<KV<K, Iterable<InputT>>>, boolean, Random) - Static method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.TestCombineDoFn
create(PipelineOptions, CloudObject, Coder<T>, ExecutionContext) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.AvroReaderFactory
create(PipelineOptions, CloudObject, Coder<T>, ExecutionContext, CounterSet.AddCounterMutator) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.AvroSinkFactory
create(PipelineOptions, CloudObject, Coder<?>, ExecutionContext) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.BigQueryReaderFactory
create(PipelineOptions, CloudObject, Coder<T>, ExecutionContext) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.ConcatReaderFactory
create(PipelineOptions, CloudObject, Coder<WindowedValue<KV<K, Iterable<V>>>>, ExecutionContext) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.GroupingShuffleReaderFactory
create(PipelineOptions, CloudObject, Coder<T>, ExecutionContext) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.InMemoryReaderFactory
create(PipelineOptions, MapTask, DataflowExecutionContext) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.MapTaskExecutorFactory: Creates a new MapTaskExecutor from the given MapTask definition.
create() - Static method in class com.google.cloud.dataflow.sdk.runners.worker.MapTaskExecutorFactory.PairInfo
create(PipelineOptions, CloudObject, String, String, List<SideInputInfo>, List<MultiOutputInfo>, int, DataflowExecutionContext, CounterSet.AddCounterMutator, StateSampler) - Method in interface com.google.cloud.dataflow.sdk.runners.worker.ParDoFnFactory: Create a ParDoFn from standard parameters, corresponding to the specification provided to the worker by the Dataflow service.
create(PipelineOptions, CloudObject, String, String, List<SideInputInfo>, List<MultiOutputInfo>, int, DataflowExecutionContext, CounterSet.AddCounterMutator, StateSampler) - Method in class com.google.cloud.dataflow.sdk.runners.worker.ParDoFnFactory.DefaultFactory
create(PipelineOptions, CloudObject, Coder<WindowedValue<KV<K, V>>>, ExecutionContext) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.PartitioningShuffleReaderFactory
create(PipelineOptions, Source, ExecutionContext) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.ReaderFactory: Creates a Reader from a Dataflow API Source definition.
create(PipelineOptions, CloudObject, Coder<WindowedValue<T>>, ExecutionContext, CounterSet.AddCounterMutator) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.ShuffleSinkFactory
create(PipelineOptions, Sink, ExecutionContext, CounterSet.AddCounterMutator) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.SinkFactory: Creates a Sink from a Dataflow API Sink definition.
create(PipelineOptions, Source) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.SourceFormatFactory
create(PipelineOptions, SourceOperationRequest) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.SourceOperationExecutorFactory
create(PipelineOptions, CloudObject, Coder<T>, ExecutionContext) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.TextReaderFactory
create(Source) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.TextReaderFactory
create(String, String, String, int, boolean, String, String, Coder<V>) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.TextSink: Constructs a new TextSink.
create(PipelineOptions, CloudObject, Coder<T>, ExecutionContext, CounterSet.AddCounterMutator) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.TextSinkFactory
create(PipelineOptions, CloudObject, Coder<T>, ExecutionContext) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.UngroupedShuffleReaderFactory
create() - Static method in class com.google.cloud.dataflow.sdk.testing.TestPipeline: Creates and returns a new test pipeline.
create(int, ComparatorT) - Static method in class com.google.cloud.dataflow.sdk.transforms.ApproximateQuantiles.ApproximateQuantilesCombineFn: Returns an approximate quantiles combiner with the given compareFn and desired number of quantiles.
create(int) - Static method in class com.google.cloud.dataflow.sdk.transforms.ApproximateQuantiles.ApproximateQuantilesCombineFn: Like ApproximateQuantiles.ApproximateQuantilesCombineFn.create(int, Comparator), but sorts values using their natural ordering.
create(int, ComparatorT, long, double) - Static method in class com.google.cloud.dataflow.sdk.transforms.ApproximateQuantiles.ApproximateQuantilesCombineFn: Creates an approximate quantiles combiner with the given compareFn and desired number of quantiles.
Create<T> - Class in com.google.cloud.dataflow.sdk.transforms: Create<T> takes a collection of elements of type T known when the pipeline is constructed and returns a PCollection<T> containing the elements.
Create() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Create
create() - Static method in class com.google.cloud.dataflow.sdk.transforms.GroupByKey: Returns a GroupByKey<K, V> PTransform.
create() - Static method in class com.google.cloud.dataflow.sdk.transforms.join.CoGroupByKey: Returns a CoGroupByKey<K> PTransform.
create() - Static method in class com.google.cloud.dataflow.sdk.transforms.Keys: Returns a Keys<K> PTransform.
create() - Static method in class com.google.cloud.dataflow.sdk.transforms.KvSwap: Returns a KvSwap<K, V> PTransform.
create() - Static method in class com.google.cloud.dataflow.sdk.transforms.RemoveDuplicates: Returns a RemoveDuplicates<T> PTransform.
create() - Static method in class com.google.cloud.dataflow.sdk.transforms.Values: Returns a Values<V> PTransform.
create() - Static method in class com.google.cloud.dataflow.sdk.util.DirectModeExecutionContext
create(PipelineOptions, DoFn<InputT, OutputT>, SideInputReader, DoFnRunner.OutputManager, TupleTag<OutputT>, List<TupleTag<?>>, ExecutionContext.StepContext, CounterSet.AddCounterMutator, WindowingStrategy<?, ?>) - Static method in class com.google.cloud.dataflow.sdk.util.DoFnRunner
create(Trigger<W>) - Static method in class com.google.cloud.dataflow.sdk.util.ExecutableTrigger
create(String, String) - Method in class com.google.cloud.dataflow.sdk.util.FileIOChannelFactory
create(String, String) - Method in class com.google.cloud.dataflow.sdk.util.GcsIOChannelFactory
create(GcsPath, String) - Method in class com.google.cloud.dataflow.sdk.util.GcsUtil: Creates an object in GCS.
create(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.util.GcsUtil.GcsUtilFactory: Returns an instance of GcsUtil based on the PipelineOptions.
create(WindowingStrategy<?, W>, AppliedCombineFn<K, InputT, AccumT, OutputT>, Coder<K>) - Static method in class com.google.cloud.dataflow.sdk.util.GroupAlsoByWindowsDoFn: Construct a GroupAlsoByWindowsDoFn using the combineFn if available.
create(String, String) - Method in interface com.google.cloud.dataflow.sdk.util.IOChannelFactory: Returns a write channel for the given specification.
create(String, String) - Static method in class com.google.cloud.dataflow.sdk.util.IOChannelUtils: Creates a write channel for the given filename.
create(String, String, String, int, String) - Static method in class com.google.cloud.dataflow.sdk.util.IOChannelUtils: Creates a write channel for the given file components.
create(WindowingStrategy<?, W>, ReduceFn<?, ?, ?, W>) - Static method in class com.google.cloud.dataflow.sdk.util.NonEmptyPanes
create(WindowingStrategy<?, W>, AppliedCombineFn<K, InputT, AccumT, OutputT>, Coder<K>) - Static method in class com.google.cloud.dataflow.sdk.util.StreamingGroupAlsoByWindowsDoFn
create(PCollectionView<?>, Coder<T>) - Static method in class com.google.cloud.dataflow.sdk.util.StreamingPCollectionViewWriterFn
Create.TimestampedValues<T> - Class in com.google.cloud.dataflow.sdk.transforms: A PTransform that creates a PCollection whose elements have associated timestamps.
Create.Values<T> - Class in com.google.cloud.dataflow.sdk.transforms: A PTransform that creates a PCollection from a set of in-memory objects.
createAccumulator(WindowedValue<K>) - Method in class com.google.cloud.dataflow.sdk.runners.worker.MapTaskExecutorFactory.ValueCombiner
createAccumulator() - Method in class com.google.cloud.dataflow.sdk.transforms.ApproximateQuantiles.ApproximateQuantilesCombineFn
createAccumulator() - Method in class com.google.cloud.dataflow.sdk.transforms.ApproximateUnique.ApproximateUniqueCombineFn
createAccumulator() - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineDoubleFn
createAccumulator() - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineFn
createAccumulator() - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineIntegerFn
createAccumulator() - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineLongFn
createAccumulator() - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.CombineFn: Returns a new, mutable accumulator value, representing the accumulation of zero input values.
createAccumulator() - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.IterableCombineFn
createAccumulator(K) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.KeyedCombineFn: Returns a new, mutable accumulator value representing the accumulation of zero input values.
createAccumulator() - Method in class com.google.cloud.dataflow.sdk.transforms.Sample.FixedSizedSampleFn
createAccumulator() - Method in class com.google.cloud.dataflow.sdk.transforms.Top.TopCombineFn
createAccumulator() - Method in class com.google.cloud.dataflow.sdk.transforms.View.Concatenate
createAccumulator(K) - Method in interface com.google.cloud.dataflow.sdk.util.common.worker.PartialGroupByKeyOperation.Combiner
createAggregator(String, Combine.CombineFn<? super AggInputT, ?, AggOutputT>) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFn: Returns an Aggregator with aggregation logic specified by the Combine.CombineFn argument.
createAggregator(String, SerializableFunction<Iterable<AggInputT>, AggInputT>) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFn: Returns an Aggregator with the aggregation logic specified by the SerializableFunction argument.
createAggregator(String, Combine.CombineFn<? super AggInputT, ?, AggOutputT>) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnWithContext: Returns an Aggregator with aggregation logic specified by the Combine.CombineFn argument.
createAggregator(String, SerializableFunction<Iterable<AggInputT>, AggInputT>) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnWithContext: Returns an Aggregator with the aggregation logic specified by the SerializableFunction argument.
createAggregatorInternal(String, Combine.CombineFn<AggInputT, ?, AggOutputT>) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFn.Context: Creates an Aggregator in the DoFn context with the specified name and aggregation logic specified by Combine.CombineFn.
createCollectionSideInputInfo(Source...) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.SideInputUtils: Builds a SideInputInfo for a "collection" side input.
createDatumReader() - Method in class com.google.cloud.dataflow.sdk.coders.AvroCoder: Returns a new DatumReader that can be used to read from an Avro file directly.
createDatumWriter() - Method in class com.google.cloud.dataflow.sdk.coders.AvroCoder: Returns a new DatumWriter that can be used to write to an Avro file directly.
createDecompressingChannel(ReadableByteChannel) - Method in enum com.google.cloud.dataflow.sdk.io.CompressedSource.CompressionMode
createDecompressingChannel(ReadableByteChannel) - Method in interface com.google.cloud.dataflow.sdk.io.CompressedSource.DecompressingChannelFactory: Given a channel, create a channel that decompresses the content read from the channel.
createForDirectPipelineRunner(String, String, String, int, boolean, String, String, Coder<V>) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.TextSink: For DirectPipelineRunner only.
createForIterable(WindowingStrategy<?, W>, Coder<V>) - Static method in class com.google.cloud.dataflow.sdk.util.GroupAlsoByWindowsDoFn: Create a GroupAlsoByWindowsDoFn without a combine function.
createForIterable(WindowingStrategy<?, W>, Coder<V>) - Static method in class com.google.cloud.dataflow.sdk.util.StreamingGroupAlsoByWindowsDoFn
createForOnceTrigger(Trigger.OnceTrigger<W>, int) - Static method in class com.google.cloud.dataflow.sdk.util.ExecutableTrigger
createForSubrangeOfFile(String, long, long) - Method in class com.google.cloud.dataflow.sdk.io.AvroSource
createForSubrangeOfFile(String, long, long) - Method in class com.google.cloud.dataflow.sdk.io.BlockBasedSource: Creates a BlockBasedSource for the specified range in a single file.
createForSubrangeOfFile(String, long, long) - Method in class com.google.cloud.dataflow.sdk.io.CompressedSource: Creates a CompressedSource for a subrange of a file.
createForSubrangeOfFile(String, long, long) - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSource: Creates and returns a new FileBasedSource of the same type as the current FileBasedSource backed by a given file and an offset range.
createForSubrangeOfFile(String, long, long) - Method in class com.google.cloud.dataflow.sdk.io.XmlSource
createForTest() - Static method in class com.google.cloud.dataflow.sdk.runners.DirectPipeline: Creates and returns a new DirectPipeline instance for tests.
createForTest() - Static method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner: Constructs a runner with default properties for testing.
createForTest(String, boolean, String, String, Coder<V>) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.TextSink: For testing only.
createFromSystemProperties() - Static method in class com.google.cloud.dataflow.sdk.options.PipelineOptionsFactory: Deprecated.
for internal use only
createFromSystemPropertiesInternal() - Static method in class com.google.cloud.dataflow.sdk.options.PipelineOptionsFactory: Creates a set of DataflowWorkerHarnessOptions based of a set of known system properties.
createGroupingKey(WindowedValue<K>) - Method in class com.google.cloud.dataflow.sdk.runners.worker.MapTaskExecutorFactory.WindowingCoderGroupingKeyCreator
createGroupingKey(K) - Method in interface com.google.cloud.dataflow.sdk.util.common.worker.PartialGroupByKeyOperation.GroupingKeyCreator
createInputStream(InputStream) - Method in enum com.google.cloud.dataflow.sdk.io.TextIO.CompressionType
createInputStream(InputStream) - Method in interface com.google.cloud.dataflow.sdk.runners.worker.FileBasedReader.DecompressingStreamFactory: Create a decompressing InputStream from an existing InputStream.
createInputStream(InputStream) - Method in class com.google.cloud.dataflow.sdk.runners.worker.FileBasedReader.FilenameBasedStreamFactory
createIterator() - Method in class com.google.cloud.dataflow.sdk.util.common.ElementByteSizeObservableIterable: Derived classes override this method to return an iterator for this iterable.
createPackage(File, String, String) - Static method in class com.google.cloud.dataflow.sdk.util.PackageUtil: Creates a DataflowPackage containing information about how a classpath element should be staged.
createPane(boolean, boolean, PaneInfo.Timing) - Static method in class com.google.cloud.dataflow.sdk.transforms.windowing.PaneInfo
createPane(boolean, boolean, PaneInfo.Timing, long, long) - Static method in class com.google.cloud.dataflow.sdk.transforms.windowing.PaneInfo: Factory method to create a PaneInfo with the specified parameters.
createPrimitiveOutputInternal(Pipeline, WindowingStrategy<?, ?>, PCollection.IsBounded) - Static method in class com.google.cloud.dataflow.sdk.values.PCollection: Creates and returns a new PCollection for a primitive output.
createProcessContext(WindowedValue<InputT>) - Method in class com.google.cloud.dataflow.sdk.util.DoFnRunner: Returns a new DoFn.ProcessContext for the given element.
createReader(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.BoundedSource: Returns a new BoundedSource.BoundedReader that reads from this source.
createReader(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.Source
createReader(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSource
createReader(PipelineOptions, CheckpointMarkT) - Method in class com.google.cloud.dataflow.sdk.io.UnboundedSource: Create a new UnboundedSource.UnboundedReader to read from this source, resuming from the given checkpoint if present.
createSingleFileReader(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.AvroSource
createSingleFileReader(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.BlockBasedSource: Creates a BlockBasedReader.
createSingleFileReader(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.CompressedSource: Creates a CompressedReader to read a single file.
createSingleFileReader(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSource: Creates and returns an instance of a FileBasedReader implementation for the current source assuming the source represents a single file.
createSingleFileReader(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.XmlSource
createSingletonSideInputInfo(Source) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.SideInputUtils: Builds a SideInputInfo for a "singleton" side input.
createSourceForSubrange(long, long) - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSource
createSourceForSubrange(long, long) - Method in class com.google.cloud.dataflow.sdk.io.OffsetBasedSource: Returns an OffsetBasedSource for a subrange of the current source.
createSourceFromDictionary(Map<String, Object>) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.ConcatReaderFactory
createStepContext(String, String) - Method in class com.google.cloud.dataflow.sdk.util.BaseExecutionContext: Implementations should override this to create the specific type of BaseExecutionContext.StepContext they need.
createStepContext(String, String) - Method in class com.google.cloud.dataflow.sdk.util.BatchModeExecutionContext: Create a new ExecutionContext.StepContext.
createStepContext(String, String) - Method in class com.google.cloud.dataflow.sdk.util.DirectModeExecutionContext
createStepContext(String, String) - Method in class com.google.cloud.dataflow.sdk.util.StreamingModeExecutionContext
createTableEntry(K) - Method in class com.google.cloud.dataflow.sdk.util.common.worker.PartialGroupByKeyOperation.BufferingGroupingTable
createTableEntry(K) - Method in class com.google.cloud.dataflow.sdk.util.common.worker.PartialGroupByKeyOperation.CombiningGroupingTable
createWriteOperation(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.Sink
createWriteOperation(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSink: Return a subclass of FileBasedSink.FileBasedWriteOperation that will manage the write to the sink.
createWriteOperation(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.Sink: Returns an instance of a Sink.WriteOperation that can write to this Sink.
createWriteOperation(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.XmlSink.Bound: Creates an XmlSink.XmlWriteOperation.
createWriter(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSink.FileBasedWriteOperation: Clients must implement to return a subclass of FileBasedSink.FileBasedWriter.
createWriter(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.Sink.WriteOperation: Creates a new Sink.Writer to write a bundle of the input to the sink.
createWriter(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.XmlSink.XmlWriteOperation: Creates a XmlSink.XmlWriter with a marshaller for the type it will write.
CredentialDirFactory() - Constructor for class com.google.cloud.dataflow.sdk.options.GcpOptions.CredentialDirFactory
CredentialFactory - Interface in com.google.cloud.dataflow.sdk.util: Construct an oauth credential to be used by the SDK and the SDK workers.
Credentials - Class in com.google.cloud.dataflow.sdk.util: Provides support for loading credentials.
Credentials() - Constructor for class com.google.cloud.dataflow.sdk.util.Credentials
currentProcessingTime() - Method in class com.google.cloud.dataflow.sdk.util.BatchTimerInternals
currentProcessingTime() - Method in interface com.google.cloud.dataflow.sdk.util.ReduceFn.Timers: Returns the current processing time.
currentProcessingTime() - Method in interface com.google.cloud.dataflow.sdk.util.TimerInternals: Returns the current timestamp in the TimeDomain.PROCESSING_TIME time domain.
currentWatermarkTime() - Method in class com.google.cloud.dataflow.sdk.util.BatchTimerInternals
currentWatermarkTime() - Method in interface com.google.cloud.dataflow.sdk.util.TimerInternals: Returns an estimate of the current timestamp in the TimeDomain.EVENT_TIME time domain.
CUSTOM_SOURCE_FORMAT - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
CustomCoder<T> - Class in com.google.cloud.dataflow.sdk.coders: An abstract base class for writing Coders that encodes itself via java serialization.
CustomCoder() - Constructor for class com.google.cloud.dataflow.sdk.coders.CustomCoder

D

DATAFLOW_STORAGE_LOCATION - Static variable in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineOptions
DataflowAggregatorTransforms - Class in com.google.cloud.dataflow.sdk.runners.dataflow: A mapping relating Aggregators and the PTransform in which they are used.
DataflowAggregatorTransforms(Map<Aggregator<?, ?>, Collection<PTransform<?, ?>>>, Map<AppliedPTransform<?, ?, ?>, String>) - Constructor for class com.google.cloud.dataflow.sdk.runners.dataflow.DataflowAggregatorTransforms
DataflowAssert - Class in com.google.cloud.dataflow.sdk.testing: An assertion on the contents of a PCollection incorporated into the pipeline.
DataflowAssert.AssertRelation<ActualT,ExpectedT> - Interface in com.google.cloud.dataflow.sdk.testing: A binary predicate between types Actual and Expected.
DataflowAssert.IterableAssert<T> - Class in com.google.cloud.dataflow.sdk.testing: An assertion about the contents of a PCollectionView.
DataflowAssert.SingletonAssert<T> - Class in com.google.cloud.dataflow.sdk.testing: An assertion about the single value of type T associated with a PCollectionView.
DataflowClientFactory() - Constructor for class com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions.DataflowClientFactory
DataflowExecutionContext - Class in com.google.cloud.dataflow.sdk.runners.worker: Extensions to BatchModeExecutionContext specific to the Dataflow worker.
DataflowExecutionContext() - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.DataflowExecutionContext
DataflowJobAlreadyExistsException - Exception in com.google.cloud.dataflow.sdk.runners: An exception that is thrown if the unique job name constraint of the Dataflow service is broken because an existing job with the same job name is currently active.
DataflowJobAlreadyExistsException(DataflowPipelineJob, String) - Constructor for exception com.google.cloud.dataflow.sdk.runners.DataflowJobAlreadyExistsException
DataflowJobAlreadyUpdatedException - Exception in com.google.cloud.dataflow.sdk.runners: An exception that is thrown if the existing job has already been updated within the Dataflow service and is no longer able to be updated.
DataflowJobAlreadyUpdatedException(DataflowPipelineJob, String) - Constructor for exception com.google.cloud.dataflow.sdk.runners.DataflowJobAlreadyUpdatedException
DataflowJobCancelledException - Exception in com.google.cloud.dataflow.sdk.runners: Signals that a job run by a BlockingDataflowPipelineRunner was updated during execution.
DataflowJobCancelledException(DataflowPipelineJob, String) - Constructor for exception com.google.cloud.dataflow.sdk.runners.DataflowJobCancelledException
DataflowJobCancelledException(DataflowPipelineJob, String, Throwable) - Constructor for exception com.google.cloud.dataflow.sdk.runners.DataflowJobCancelledException
DataflowJobException - Exception in com.google.cloud.dataflow.sdk.runners: A RuntimeException that contains information about a DataflowPipelineJob.
DataflowJobExecutionException - Exception in com.google.cloud.dataflow.sdk.runners: Signals that a job run by a BlockingDataflowPipelineRunner fails during execution, and provides access to the failed job.
DataflowJobUpdatedException - Exception in com.google.cloud.dataflow.sdk.runners: Signals that a job run by a BlockingDataflowPipelineRunner was updated during execution.
DataflowJobUpdatedException(DataflowPipelineJob, String, DataflowPipelineJob) - Constructor for exception com.google.cloud.dataflow.sdk.runners.DataflowJobUpdatedException
DataflowJobUpdatedException(DataflowPipelineJob, String, DataflowPipelineJob, Throwable) - Constructor for exception com.google.cloud.dataflow.sdk.runners.DataflowJobUpdatedException
DataflowMetricUpdateExtractor - Class in com.google.cloud.dataflow.sdk.runners.dataflow: Methods for extracting the values of an Aggregator from a collection of MetricUpdates.
DataflowOutputCounter - Class in com.google.cloud.dataflow.sdk.runners.worker: A Dataflow-specific version of ElementCounter, which specifies the object counter name differently as PhysicalElementCount.
DataflowOutputCounter(String, CounterSet.AddCounterMutator) - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.DataflowOutputCounter
DataflowOutputCounter(String, ElementByteSizeObservable<?>, CounterSet.AddCounterMutator) - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.DataflowOutputCounter
DataflowPathValidator - Class in com.google.cloud.dataflow.sdk.util: GCP implementation of PathValidator.
DataflowPipeline - Class in com.google.cloud.dataflow.sdk.runners: A DataflowPipeline is a Pipeline that returns a DataflowPipelineJob when it is Pipeline.run().
DataflowPipelineDebugOptions - Interface in com.google.cloud.dataflow.sdk.options: Internal.
DataflowPipelineDebugOptions.DataflowClientFactory - Class in com.google.cloud.dataflow.sdk.options: Returns the default Dataflow client built from the passed in PipelineOptions.
DataflowPipelineDebugOptions.PathValidatorFactory - Class in com.google.cloud.dataflow.sdk.options: Creates a PathValidator object using the class specified in DataflowPipelineDebugOptions.getPathValidatorClass().
DataflowPipelineDebugOptions.StagerFactory - Class in com.google.cloud.dataflow.sdk.options: Creates a Stager object using the class specified in DataflowPipelineDebugOptions.getStagerClass().
DataflowPipelineJob - Class in com.google.cloud.dataflow.sdk.runners: A DataflowPipelineJob represents a job submitted to Dataflow using DataflowPipelineRunner.
DataflowPipelineJob(String, String, Dataflow, DataflowAggregatorTransforms) - Constructor for class com.google.cloud.dataflow.sdk.runners.DataflowPipelineJob: Constructs the job.
DataflowPipelineOptions - Interface in com.google.cloud.dataflow.sdk.options: Options that can be used to configure the DataflowPipeline.
DataflowPipelineOptions.JobNameFactory - Class in com.google.cloud.dataflow.sdk.options: Returns a normalized job name constructed from ApplicationNameOptions.getAppName(), the local system user name (if available), and the current time.
DataflowPipelineRegistrar - Class in com.google.cloud.dataflow.sdk.runners: Contains the PipelineOptionsRegistrar and PipelineRunnerRegistrar for the DataflowPipeline.
DataflowPipelineRegistrar.Options - Class in com.google.cloud.dataflow.sdk.runners: Register the DataflowPipelineOptions and BlockingDataflowPipelineOptions.
DataflowPipelineRegistrar.Runner - Class in com.google.cloud.dataflow.sdk.runners: Register the DataflowPipelineRunner and BlockingDataflowPipelineRunner.
DataflowPipelineRunner - Class in com.google.cloud.dataflow.sdk.runners: A PipelineRunner that executes the operations in the pipeline by first translating them to the Dataflow representation using the DataflowPipelineTranslator and then submitting them to a Dataflow service for execution.
DataflowPipelineRunner(DataflowPipelineOptions) - Constructor for class com.google.cloud.dataflow.sdk.runners.DataflowPipelineRunner
DataflowPipelineRunner.StreamingPubsubIOWrite<T> - Class in com.google.cloud.dataflow.sdk.runners: Specialized implementation for PubsubIO.Write for the Dataflow runner in streaming mode.
DataflowPipelineRunnerHooks - Class in com.google.cloud.dataflow.sdk.runners: An instance of this class can be passed to the DataflowPipelineRunner to add user defined hooks to be invoked at various times during pipeline execution.
DataflowPipelineRunnerHooks() - Constructor for class com.google.cloud.dataflow.sdk.runners.DataflowPipelineRunnerHooks
DataflowPipelineTranslator - Class in com.google.cloud.dataflow.sdk.runners: DataflowPipelineTranslator knows how to translate Pipeline objects into Cloud Dataflow Service API Jobs.
DataflowPipelineTranslator.JobSpecification - Class in com.google.cloud.dataflow.sdk.runners: The result of a job translation.
DataflowPipelineTranslator.TransformTranslator<TransformT extends PTransform> - Interface in com.google.cloud.dataflow.sdk.runners: A DataflowPipelineTranslator.TransformTranslator knows how to translate a particular subclass of PTransform for the Cloud Dataflow service.
DataflowPipelineTranslator.TranslationContext - Interface in com.google.cloud.dataflow.sdk.runners: The interface provided to registered callbacks for interacting with the DataflowPipelineRunner, including reading and writing the values of PCollections and side inputs (PCollectionViews).
DataflowPipelineWorkerPoolOptions - Interface in com.google.cloud.dataflow.sdk.options: Options that are used to configure the Dataflow pipeline worker pool.
DataflowPipelineWorkerPoolOptions.AutoscalingAlgorithmType - Enum in com.google.cloud.dataflow.sdk.options: Type of autoscaling algorithm to use.
DataflowPipelineWorkerPoolOptions.TeardownPolicy - Enum in com.google.cloud.dataflow.sdk.options: The policy for tearing down the workers spun up by the service.
DataflowReleaseInfo - Class in com.google.cloud.dataflow.sdk.util: Utilities for working with the Dataflow distribution.
DataflowServiceException - Exception in com.google.cloud.dataflow.sdk.runners: Signals there was an error retrieving information about a job from the Cloud Dataflow Service.
DataflowSideInputReader - Class in com.google.cloud.dataflow.sdk.runners.worker: A simple side input reader that re-reads a side input from its iterable each time it is requested.
DataflowWorker - Class in com.google.cloud.dataflow.sdk.runners.worker: This is a semi-abstract harness for executing WorkItem tasks in Java workers.
DataflowWorker(DataflowWorker.WorkUnitClient, DataflowWorkerHarnessOptions) - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.DataflowWorker
DataflowWorker.WorkUnitClient - Class in com.google.cloud.dataflow.sdk.runners.worker: Abstract base class describing a client for WorkItem work units.
DataflowWorkerHarness - Class in com.google.cloud.dataflow.sdk.runners.worker: This is a harness for executing WorkItem tasks in Java workers.
DataflowWorkerHarness() - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.DataflowWorkerHarness
DataflowWorkerHarnessOptions - Interface in com.google.cloud.dataflow.sdk.options: Options that are used exclusively within the Dataflow worker harness.
DataflowWorkerLoggingHandler - Class in com.google.cloud.dataflow.sdk.runners.worker.logging: Formats LogRecord into JSON format for Cloud Logging.
DataflowWorkerLoggingHandler(String) - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.logging.DataflowWorkerLoggingHandler: Constructs a handler that writes to a file.
DataflowWorkerLoggingHandler(OutputStream) - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.logging.DataflowWorkerLoggingHandler: Constructs a handler that writes to an arbitrary output stream.
DataflowWorkerLoggingInitializer - Class in com.google.cloud.dataflow.sdk.runners.worker.logging: Sets up java.util.logging configuration on the Dataflow worker with a file logger.
DataflowWorkerLoggingInitializer() - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.logging.DataflowWorkerLoggingInitializer
DataflowWorkerLoggingMDC - Class in com.google.cloud.dataflow.sdk.runners.worker.logging: Mapped diagnostic context for the Dataflow worker.
DataflowWorkerLoggingMDC() - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.logging.DataflowWorkerLoggingMDC
DataflowWorkerLoggingOptions - Interface in com.google.cloud.dataflow.sdk.options: Options that are used to control logging configuration on the Dataflow worker.
DataflowWorkerLoggingOptions.Level - Enum in com.google.cloud.dataflow.sdk.options: The set of log levels that can be used on the Dataflow worker.
DataflowWorkerLoggingOptions.WorkerLogLevelOverrides - Class in com.google.cloud.dataflow.sdk.options: Defines a log level override for a specific class, package, or name.
DataflowWorkProgressUpdater - Class in com.google.cloud.dataflow.sdk.runners.worker: DataflowWorkProgressUpdater implements the WorkProgressUpdater interface for the Cloud Dataflow system.
DataflowWorkProgressUpdater(WorkItem, WorkExecutor, DataflowWorker.WorkUnitClient, DataflowWorkerHarnessOptions) - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.DataflowWorkProgressUpdater
DATASTORE_BATCH_UPDATE_LIMIT - Static variable in class com.google.cloud.dataflow.sdk.io.DatastoreIO: Datastore has a limit of 500 mutations per batch operation, so we flush changes to Datastore every 500 entities.
DatastoreIO - Class in com.google.cloud.dataflow.sdk.io: PTransforms for reading and writing Google Cloud Datastore entities.
DatastoreIO() - Constructor for class com.google.cloud.dataflow.sdk.io.DatastoreIO
DatastoreIO.DatastoreReader - Class in com.google.cloud.dataflow.sdk.io: A Source.Reader over the records from a query of the datastore.
DatastoreIO.Sink - Class in com.google.cloud.dataflow.sdk.io: A Sink that writes a PCollection containing Entities to a Datastore kind.
DatastoreIO.Source - Class in com.google.cloud.dataflow.sdk.io: A Source that reads the result rows of a Datastore query as Entity objects.
DatastoreReader(DatastoreIO.Source, Datastore) - Constructor for class com.google.cloud.dataflow.sdk.io.DatastoreIO.DatastoreReader: Returns a DatastoreReader with Source and Datastore object set.
days(int) - Static method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows: Returns a WindowFn that windows elements into periods measured by days.
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.AvroCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.BigEndianIntegerCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.BigEndianLongCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.ByteArrayCoder
decode(InputStream, Coder.Context) - Method in interface com.google.cloud.dataflow.sdk.coders.Coder: Decodes a value of type T from the given input stream in the given context.
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.DelegateCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.DoubleCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.DurationCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.EntityCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.InstantCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.IterableLikeCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.JAXBCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.KvCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.MapCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.Proto2Coder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.SerializableCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.StringUtf8Coder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.TableRowJsonCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.TextualIntegerCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.VarIntCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.VarLongCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.VoidCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.ShardedKeyCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult.CoGbkResultCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.GlobalWindow.Coder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.PaneInfo.PaneInfoCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.util.TimerOrElement.TimerOrElementCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.util.ValueWithRecordId.ValueWithRecordIdCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.util.WindowedValue.FullWindowedValueCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.util.WindowedValue.ValueOnlyWindowedValueCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.values.TimestampedValue.TimestampedValueCoder
decodeFromBase64(Coder<T>, String) - Static method in class com.google.cloud.dataflow.sdk.util.CoderUtils: Parses a value from a base64-encoded String using the given coder.
decodeFromByteArray(Coder<T>, byte[]) - Static method in class com.google.cloud.dataflow.sdk.util.CoderUtils: Decodes the given bytes using the specified Coder, and returns the resulting decoded value.
decodeFromByteArray(Coder<T>, byte[], Coder.Context) - Static method in class com.google.cloud.dataflow.sdk.util.CoderUtils
decodeInt(InputStream) - Static method in class com.google.cloud.dataflow.sdk.util.VarInt: Decodes an integer value from the given stream.
decodeLong(InputStream) - Static method in class com.google.cloud.dataflow.sdk.util.VarInt: Decodes a long value from the given stream.
decodePane(byte) - Static method in class com.google.cloud.dataflow.sdk.transforms.windowing.PaneInfo
decodeToIterable(List<T>) - Method in class com.google.cloud.dataflow.sdk.coders.CollectionCoder
decodeToIterable(List<T>) - Method in class com.google.cloud.dataflow.sdk.coders.IterableCoder
decodeToIterable(List<T>) - Method in class com.google.cloud.dataflow.sdk.coders.IterableLikeCoder: Builds an instance of the coder's associated Iterable from a list of decoded elements.
decodeToIterable(List<T>) - Method in class com.google.cloud.dataflow.sdk.coders.ListCoder
decodeToIterable(List<T>) - Method in class com.google.cloud.dataflow.sdk.coders.SetCoder
Default - Annotation Type in com.google.cloud.dataflow.sdk.options: Default represents a set of annotations that can be used to annotate getter properties on PipelineOptions with information representing the default value to be returned if no value is specified.
Default.Boolean - Annotation Type in com.google.cloud.dataflow.sdk.options: This represents that the default of the option is the specified boolean primitive value.
Default.Byte - Annotation Type in com.google.cloud.dataflow.sdk.options: This represents that the default of the option is the specified byte primitive value.
Default.Character - Annotation Type in com.google.cloud.dataflow.sdk.options: This represents that the default of the option is the specified char primitive value.
Default.Class - Annotation Type in com.google.cloud.dataflow.sdk.options: This represents that the default of the option is the specified Class value.
Default.Double - Annotation Type in com.google.cloud.dataflow.sdk.options: This represents that the default of the option is the specified double primitive value.
Default.Enum - Annotation Type in com.google.cloud.dataflow.sdk.options: This represents that the default of the option is the specified enum.
Default.Float - Annotation Type in com.google.cloud.dataflow.sdk.options: This represents that the default of the option is the specified float primitive value.
Default.InstanceFactory - Annotation Type in com.google.cloud.dataflow.sdk.options: Value must be of type DefaultValueFactory and have a default constructor.
Default.Integer - Annotation Type in com.google.cloud.dataflow.sdk.options: This represents that the default of the option is the specified int primitive value.
Default.Long - Annotation Type in com.google.cloud.dataflow.sdk.options: This represents that the default of the option is the specified long primitive value.
Default.Short - Annotation Type in com.google.cloud.dataflow.sdk.options: This represents that the default of the option is the specified short primitive value.
Default.String - Annotation Type in com.google.cloud.dataflow.sdk.options: This represents that the default of the option is the specified String value.
DEFAULT_HOST - Static variable in class com.google.cloud.dataflow.sdk.io.DatastoreIO
DEFAULT_LEASE_DURATION_MILLIS - Static variable in class com.google.cloud.dataflow.sdk.util.common.worker.WorkProgressUpdater: The default lease duration to request from the external worker service (3 minutes).
DEFAULT_MAX_NUM_ELEMENTS - Static variable in class com.google.cloud.dataflow.sdk.transforms.ApproximateQuantiles.ApproximateQuantilesCombineFn: The cost (in time and space) to compute quantiles to a given accuracy is a function of the total number of elements in the data set.
DEFAULT_MIN_SAMPLED - Static variable in class com.google.cloud.dataflow.sdk.util.common.worker.PartialGroupByKeyOperation.SamplingSizeEstimator: Default number of elements that must be measured before elements are skipped.
DEFAULT_MULTIPLIER - Static variable in class com.google.cloud.dataflow.sdk.util.AttemptBoundedExponentialBackOff
DEFAULT_MULTIPLIER - Static variable in class com.google.cloud.dataflow.sdk.util.IntervalBoundedExponentialBackOff
DEFAULT_PUBSUB_CODER - Static variable in class com.google.cloud.dataflow.sdk.io.PubsubIO
DEFAULT_RANDOMIZATION_FACTOR - Static variable in class com.google.cloud.dataflow.sdk.util.AttemptBoundedExponentialBackOff
DEFAULT_RANDOMIZATION_FACTOR - Static variable in class com.google.cloud.dataflow.sdk.util.IntervalBoundedExponentialBackOff
DEFAULT_SAMPLING_PERIOD_MS - Static variable in class com.google.cloud.dataflow.sdk.util.common.worker.StateSampler
DEFAULT_STATUS_PORT - Static variable in class com.google.cloud.dataflow.sdk.runners.worker.DataflowWorker
DEFAULT_TEXT_CODER - Static variable in class com.google.cloud.dataflow.sdk.io.TextIO
DefaultCoder - Annotation Type in com.google.cloud.dataflow.sdk.coders: The DefaultCoder annotation specifies a default Coder class to handle encoding and decoding instances of the annotated class.
DefaultFactory() - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.ParDoFnFactory.DefaultFactory
DefaultProjectFactory() - Constructor for class com.google.cloud.dataflow.sdk.options.GcpOptions.DefaultProjectFactory
Defaults() - Constructor for class com.google.cloud.dataflow.sdk.util.SizedSideInputReader.Defaults
DefaultTrigger<W extends BoundedWindow> - Class in com.google.cloud.dataflow.sdk.transforms.windowing: A trigger that is equivalent to Repeatedly.forever(AfterWatermark.pastEndOfWindow()).
defaultValue() - Method in class com.google.cloud.dataflow.sdk.transforms.View.AsSingleton: Returns the default value of this transform, or null if there isn't one.
DefaultValueFactory<T> - Interface in com.google.cloud.dataflow.sdk.options: An interface used with Default.InstanceFactory annotation to specify the class that will be an instance factory to produce default values for a given getter on PipelineOptions.
DELAYED_UNTIL_TAG - Static variable in class com.google.cloud.dataflow.sdk.transforms.windowing.TimeTrigger
DelegateCoder<T,IntermediateT> - Class in com.google.cloud.dataflow.sdk.coders: A DelegateCoder<T, IntermediateT> wraps a Coder for IntermediateT and encodes/decodes values of type Ts by converting to/from IntermediateT and then encoding/decoding using the underlying Coder<IntermediateT>.
DelegateCoder(Coder<IntermediateT>, DelegateCoder.CodingFunction<T, IntermediateT>, DelegateCoder.CodingFunction<IntermediateT, T>) - Constructor for class com.google.cloud.dataflow.sdk.coders.DelegateCoder
DelegateCoder.CodingFunction<InputT,OutputT> - Interface in com.google.cloud.dataflow.sdk.coders: A CodingFunction<InputT, OutputT> is a serializable function from InputT to OutputT that may throw any Exception.
deleteTimer(TimerInternals.TimerData) - Method in class com.google.cloud.dataflow.sdk.util.BatchTimerInternals
deleteTimer(Instant, TimeDomain) - Method in interface com.google.cloud.dataflow.sdk.util.ReduceFn.Timers: Removes the timer set in this trigger context for the given window, timestmap and timeDomain.
deleteTimer(TimerInternals.TimerData) - Method in interface com.google.cloud.dataflow.sdk.util.TimerInternals: Deletes the given timer.
Description - Annotation Type in com.google.cloud.dataflow.sdk.options: Descriptions are used to generate human readable output when the --help command is specified.
deserialize(Map<String, Object>, Class<T>) - Static method in class com.google.cloud.dataflow.sdk.util.Serializer: Deserializes an object from a Dataflow structured encoding (represented in Java as a map).
deserializeFromByteArray(byte[], String) - Static method in class com.google.cloud.dataflow.sdk.util.SerializableUtils: Deserializes an object from the given array of bytes, e.g., as serialized using SerializableUtils.serializeToByteArray(java.io.Serializable), and returns it.
deserializeFromCloudSource(Map<String, Object>) - Static method in class com.google.cloud.dataflow.sdk.runners.dataflow.BasicSerializableSourceFormat
detectClassPathResourcesToStage(ClassLoader) - Static method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineRunner: Attempts to detect all the resources the class loader has access to.
DeterministicStandardCoder<T> - Class in com.google.cloud.dataflow.sdk.coders: A DeterministicStandardCoder is a StandardCoder that is deterministic, in the sense that for objects considered equal according to Object.equals(), the encoded bytes are also equal.
DeterministicStandardCoder() - Constructor for class com.google.cloud.dataflow.sdk.coders.DeterministicStandardCoder
dictionaryToCloudSource(Map<String, Object>) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.SourceTranslationUtils
DirectModeExecutionContext - Class in com.google.cloud.dataflow.sdk.util: ExecutionContext for use in direct mode.
DirectModeExecutionContext() - Constructor for class com.google.cloud.dataflow.sdk.util.DirectModeExecutionContext
DIRECTORY_CONTAINER - Static variable in class com.google.cloud.dataflow.sdk.io.ShardNameTemplate: Shard is a file within a directory.
DirectPipeline - Class in com.google.cloud.dataflow.sdk.runners: A DirectPipeline is a Pipeline that returns DirectPipelineRunner.EvaluationResults when it is Pipeline.run().
DirectPipelineOptions - Interface in com.google.cloud.dataflow.sdk.options: Options that can be used to configure the DirectPipeline.
DirectPipelineRegistrar - Class in com.google.cloud.dataflow.sdk.runners: Contains the PipelineOptionsRegistrar and PipelineRunnerRegistrar for the DirectPipeline.
DirectPipelineRegistrar.Options - Class in com.google.cloud.dataflow.sdk.runners: Register the DirectPipelineRunner.
DirectPipelineRegistrar.Runner - Class in com.google.cloud.dataflow.sdk.runners: Register the DirectPipelineOptions.
DirectPipelineRunner - Class in com.google.cloud.dataflow.sdk.runners: Executes the operations in the pipeline directly, in this process, without any optimization.
DirectPipelineRunner.EvaluationContext - Interface in com.google.cloud.dataflow.sdk.runners: The interface provided to registered callbacks for interacting with the DirectPipelineRunner, including reading and writing the values of PCollections and PCollectionViews.
DirectPipelineRunner.EvaluationResults - Interface in com.google.cloud.dataflow.sdk.runners: The interface provided to registered callbacks for interacting with the DirectPipelineRunner, including reading and writing the values of PCollections and PCollectionViews.
DirectPipelineRunner.TestCombineDoFn<K,InputT,AccumT,OutputT> - Class in com.google.cloud.dataflow.sdk.runners: The implementation may split the Combine.KeyedCombineFn into ADD, MERGE and EXTRACT phases ( see com.google.cloud.dataflow.sdk.runners.worker.CombineValuesFn).
DirectPipelineRunner.TransformEvaluator<TransformT extends PTransform> - Interface in com.google.cloud.dataflow.sdk.runners: An evaluator of a PTransform.
DirectPipelineRunner.ValueWithMetadata<V> - Class in com.google.cloud.dataflow.sdk.runners: An immutable (value, timestamp) pair, along with other metadata necessary for the implementation of DirectPipelineRunner.
DirectSideInputReader - Class in com.google.cloud.dataflow.sdk.util: Basic side input reader wrapping a PTuple of side input iterables.
DISALLOW_COMBINER_LIFTING - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
discardingFiredPanes() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window.Bound: Returns a new Window PTransform that uses the registered WindowFn and Triggering behavior, and that discards elements in a pane after they are triggered.
discardingFiredPanes() - Static method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window: Returns a new Window PTransform that uses the registered WindowFn and Triggering behavior, and that discards elements in a pane after they are triggered.
discardingFiredPanes() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window.Unbound: Returns a new Window PTransform that uses the registered WindowFn and Triggering behavior, and that discards elements in a pane after they are triggered.
DoFn<InputT,OutputT> - Class in com.google.cloud.dataflow.sdk.transforms: The argument to ParDo providing the code to use to process elements of the input PCollection.
DoFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.DoFn
DoFn.Context - Class in com.google.cloud.dataflow.sdk.transforms: Information accessible to all methods in this DoFn.
DoFn.ProcessContext - Class in com.google.cloud.dataflow.sdk.transforms: Information accessible when running DoFn.processElement(com.google.cloud.dataflow.sdk.transforms.DoFn<InputT, OutputT>.ProcessContext).
DoFn.RequiresWindowAccess - Interface in com.google.cloud.dataflow.sdk.transforms: Interface for signaling that a DoFn needs to access the window the element is being processed in, via DoFn.ProcessContext.window().
DoFnInfo<InputT,OutputT> - Class in com.google.cloud.dataflow.sdk.util: Wrapper class holding the necessary information to serialize a DoFn.
DoFnInfo(DoFn<InputT, OutputT>, WindowingStrategy<?, ?>) - Constructor for class com.google.cloud.dataflow.sdk.util.DoFnInfo
DoFnInfo(DoFn<InputT, OutputT>, WindowingStrategy<?, ?>, Iterable<PCollectionView<?>>, Coder<InputT>) - Constructor for class com.google.cloud.dataflow.sdk.util.DoFnInfo
DoFnReflector - Class in com.google.cloud.dataflow.sdk.transforms: Utility implementing the necessary reflection for working with DoFnWithContexts.
DoFnReflector() - Constructor for class com.google.cloud.dataflow.sdk.transforms.DoFnReflector
DoFnRunner<InputT,OutputT> - Class in com.google.cloud.dataflow.sdk.util: Runs a DoFn by constructing the appropriate contexts and passing them in.
DoFnRunner.ListOutputManager - Class in com.google.cloud.dataflow.sdk.util: An implementation of DoFnRunner.OutputManager using simple lists, for testing and in-memory contexts such as the DirectPipelineRunner.
DoFnRunner.OutputManager - Interface in com.google.cloud.dataflow.sdk.util: Information about how to create output receivers and output to them.
DoFnTester<InputT,OutputT> - Class in com.google.cloud.dataflow.sdk.transforms: A harness for unit-testing a DoFn.
DoFnWithContext<InputT,OutputT> - Class in com.google.cloud.dataflow.sdk.transforms: The argument to ParDo providing the code to use to process elements of the input PCollection.
DoFnWithContext() - Constructor for class com.google.cloud.dataflow.sdk.transforms.DoFnWithContext
DoFnWithContext.Context - Class in com.google.cloud.dataflow.sdk.transforms: Information accessible to all methods in this DoFnWithContext.
DoFnWithContext.ExtraContextFactory<InputT,OutputT> - Interface in com.google.cloud.dataflow.sdk.transforms: Interface for runner implementors to provide implementations of extra context information.
DoFnWithContext.FinishBundle - Annotation Type in com.google.cloud.dataflow.sdk.transforms: Annotation for the method to use to prepare an instance for processing a batch of elements.
DoFnWithContext.ProcessContext - Class in com.google.cloud.dataflow.sdk.transforms: Information accessible when running DoFn.processElement(com.google.cloud.dataflow.sdk.transforms.DoFn<InputT, OutputT>.ProcessContext).
DoFnWithContext.ProcessElement - Annotation Type in com.google.cloud.dataflow.sdk.transforms: Annotation for the method to use for processing elements.
DoFnWithContext.StartBundle - Annotation Type in com.google.cloud.dataflow.sdk.transforms: Annotation for the method to use to prepare an instance for processing a batch of elements.
DoubleCoder - Class in com.google.cloud.dataflow.sdk.coders: A DoubleCoder encodes Double values in 8 bytes using Java serialization.
DoubleMetric(String, double) - Constructor for class com.google.cloud.dataflow.sdk.util.common.Metric.DoubleMetric
doubles(String, Counter.AggregationKind) - Static method in class com.google.cloud.dataflow.sdk.util.common.Counter: Constructs a new Counter that aggregates Double values according to the desired aggregation kind.
doublesGlobally() - Static method in class com.google.cloud.dataflow.sdk.transforms.Max: Returns a PTransform that takes an input PCollection<Double> and returns a PCollection<Double> whose contents is the maximum of the input PCollection's elements, or Double.NEGATIVE_INFINITY if there are no elements.
doublesGlobally() - Static method in class com.google.cloud.dataflow.sdk.transforms.Min: Returns a PTransform that takes an input PCollection<Double> and returns a PCollection<Double> whose contents is the minimum of the input PCollection's elements, or Double.POSITIVE_INFINITY if there are no elements.
doublesGlobally() - Static method in class com.google.cloud.dataflow.sdk.transforms.Sum: Returns a PTransform that takes an input PCollection<Double> and returns a PCollection<Double> whose contents is the sum of the input PCollection's elements, or 0 if there are no elements.
doublesPerKey() - Static method in class com.google.cloud.dataflow.sdk.transforms.Max: Returns a PTransform that takes an input PCollection<KV<K, Double>> and returns a PCollection<KV<K, Double>> that contains an output element mapping each distinct key in the input PCollection to the maximum of the values associated with that key in the input PCollection.
doublesPerKey() - Static method in class com.google.cloud.dataflow.sdk.transforms.Min: Returns a PTransform that takes an input PCollection<KV<K, Double>> and returns a PCollection<KV<K, Double>> that contains an output element mapping each distinct key in the input PCollection to the minimum of the values associated with that key in the input PCollection.
doublesPerKey() - Static method in class com.google.cloud.dataflow.sdk.transforms.Sum: Returns a PTransform that takes an input PCollection<KV<K, Double>> and returns a PCollection<KV<K, Double>> that contains an output element mapping each distinct key in the input PCollection to the sum of the values associated with that key in the input PCollection.
DROPPED_DUE_TO_CLOSED_WINDOW_COUNTER - Static variable in class com.google.cloud.dataflow.sdk.util.ReduceFnRunner
DROPPED_DUE_TO_LATENESS_COUNTER - Static variable in class com.google.cloud.dataflow.sdk.util.ReduceFnRunner
DurationCoder - Class in com.google.cloud.dataflow.sdk.coders: A Coder for a joda Duration.
dynamicSplitResultToReport - Variable in class com.google.cloud.dataflow.sdk.util.common.worker.WorkProgressUpdater: The Reader.DynamicSplitResult to report to the service in the next progress update, or null if there is nothing to report (if no dynamic split happened since the last progress update).
DynamicSplitResultWithPosition(Reader.Position) - Constructor for class com.google.cloud.dataflow.sdk.util.common.worker.Reader.DynamicSplitResultWithPosition

E

element() - Method in class com.google.cloud.dataflow.sdk.transforms.DoFn.ProcessContext: Returns the input element to be processed.
element() - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnWithContext.ProcessContext: Returns the input element to be processed.
element() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Trigger.OnElementContext: The element being handled by this call to Trigger.onElement(com.google.cloud.dataflow.sdk.transforms.windowing.Trigger<W>.OnElementContext).
element() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.WindowFn.AssignContext: Returns the current element.
ELEMENT - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
element(ElemT) - Static method in class com.google.cloud.dataflow.sdk.util.TimerOrElement: Creates a new TimerOrElement<ElemT> representing an element.
element() - Method in class com.google.cloud.dataflow.sdk.util.TimerOrElement: If this is an element, returns it, otherwise throws an exception.
ElementByteSizeObservable<T> - Interface in com.google.cloud.dataflow.sdk.util.common: An interface for things that allow observing the size in bytes of encoded values of type T.
ElementByteSizeObservableCoder(Coder<T>) - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.MapTaskExecutorFactory.ElementByteSizeObservableCoder
ElementByteSizeObservableIterable<V,InputT extends ElementByteSizeObservableIterator<V>> - Class in com.google.cloud.dataflow.sdk.util.common: An abstract class used for iterables that notify observers about size in bytes of their elements, as they are being iterated over.
ElementByteSizeObservableIterable() - Constructor for class com.google.cloud.dataflow.sdk.util.common.ElementByteSizeObservableIterable
ElementByteSizeObservableIterator<V> - Class in com.google.cloud.dataflow.sdk.util.common: An abstract class used for iterators that notify observers about size in bytes of their elements, as they are being iterated over.
ElementByteSizeObservableIterator() - Constructor for class com.google.cloud.dataflow.sdk.util.common.ElementByteSizeObservableIterator
ElementByteSizeObserver - Class in com.google.cloud.dataflow.sdk.util.common: An observer that gets notified when additional bytes are read and/or used.
ElementByteSizeObserver(Counter<Long>) - Constructor for class com.google.cloud.dataflow.sdk.util.common.ElementByteSizeObserver
elementCountAtLeast(int) - Static method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterPane: Creates a trigger that fires when the pane contains at least countElems elements.
ElementCounter - Interface in com.google.cloud.dataflow.sdk.util.common.worker: Abstract interface that counts elements processed.
ELEMENTS - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
empty() - Static method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult: Returns an empty CoGbkResult.
empty(Pipeline) - Static method in class com.google.cloud.dataflow.sdk.transforms.join.KeyedPCollectionTuple: Returns an empty KeyedPCollectionTuple<K> on the given pipeline.
empty() - Static method in class com.google.cloud.dataflow.sdk.util.ApiSurface: Returns an empty ApiSurface.
empty() - Static method in class com.google.cloud.dataflow.sdk.util.NullSideInputReader
empty() - Static method in class com.google.cloud.dataflow.sdk.util.PTuple: Returns an empty PTuple.
empty(Pipeline) - Static method in class com.google.cloud.dataflow.sdk.values.PCollectionList: Returns an empty PCollectionList that is part of the given Pipeline.
empty(Pipeline) - Static method in class com.google.cloud.dataflow.sdk.values.PCollectionTuple: Returns an empty PCollectionTuple that is part of the given Pipeline.
empty() - Static method in class com.google.cloud.dataflow.sdk.values.TupleTagList: Returns an empty TupleTagList.
encode(T, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.AvroCoder
encode(Integer, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.BigEndianIntegerCoder
encode(Long, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.BigEndianLongCoder
encode(byte[], OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.ByteArrayCoder
encode(T, OutputStream, Coder.Context) - Method in interface com.google.cloud.dataflow.sdk.coders.Coder: Encodes the given value of type T onto the given output stream in the given context.
encode(T, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.DelegateCoder
encode(Double, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.DoubleCoder
encode(ReadableDuration, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.DurationCoder
encode(DatastoreV1.Entity, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.EntityCoder
encode(Instant, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.InstantCoder
encode(IterableT, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.IterableLikeCoder
encode(T, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.JAXBCoder
encode(KV<K, V>, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.KvCoder
encode(Map<K, V>, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.MapCoder
encode(T, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.Proto2Coder
encode(T, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.SerializableCoder
encode(String, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.StringUtf8Coder
encode(TableRow, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.TableRowJsonCoder
encode(Integer, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.TextualIntegerCoder
encode(Integer, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.VarIntCoder
encode(Long, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.VarLongCoder
encode(Void, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.VoidCoder
encode(BigQueryIO.ShardedKey<KeyT>, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.ShardedKeyCoder
encode(CoGbkResult, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult.CoGbkResultCoder
encode(GlobalWindow, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.GlobalWindow.Coder
encode(PaneInfo, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.PaneInfo.PaneInfoCoder
encode(TimerOrElement<T>, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.util.TimerOrElement.TimerOrElementCoder
encode(ValueWithRecordId<ValueT>, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.util.ValueWithRecordId.ValueWithRecordIdCoder
encode(int, OutputStream) - Static method in class com.google.cloud.dataflow.sdk.util.VarInt: Encodes the given value onto the stream.
encode(long, OutputStream) - Static method in class com.google.cloud.dataflow.sdk.util.VarInt: Encodes the given value onto the stream.
encode(WindowedValue<T>, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.util.WindowedValue.FullWindowedValueCoder
encode(WindowedValue<T>, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.util.WindowedValue.ValueOnlyWindowedValueCoder
encode(TimestampedValue<T>, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.values.TimestampedValue.TimestampedValueCoder
encodeAndOwn(byte[], OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.ByteArrayCoder: Encodes the provided value with the identical encoding to ByteArrayCoder.encode(byte[], java.io.OutputStream, com.google.cloud.dataflow.sdk.coders.Coder.Context), but with optimizations that take ownership of the value.
encodeBase64() - Method in class com.google.cloud.dataflow.sdk.runners.worker.ByteArrayShufflePosition
encodeToBase64(Coder<T>, T) - Static method in class com.google.cloud.dataflow.sdk.util.CoderUtils: Encodes the given value using the specified Coder, and returns the Base64 encoding of the encoded bytes.
encodeToByteArray(Coder<T>, T) - Static method in class com.google.cloud.dataflow.sdk.util.CoderUtils: Encodes the given value using the specified Coder, and returns the encoded bytes.
encodeToByteArray(Coder<T>, T, Coder.Context) - Static method in class com.google.cloud.dataflow.sdk.util.CoderUtils
ENCODING - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
ENCODING_ID - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
end() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.IntervalWindow: Returns the end of this window, exclusive.
END_INDEX - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
END_OFFSET - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
END_SHUFFLE_POSITION - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
endPosition - Variable in class com.google.cloud.dataflow.sdk.runners.worker.FileBasedReader
endsWith(Path) - Method in class com.google.cloud.dataflow.sdk.util.gcsfs.GcsPath
endsWith(String) - Method in class com.google.cloud.dataflow.sdk.util.gcsfs.GcsPath
ensureCoderSerializable(Coder<T>) - Method in interface com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.EvaluationContext: If the evaluation context is testing serializability, ensures that the argument Coder is serializable and deserializable by encoding it and then decoding it, and returning the result.
ensureElementEncodable(TypedPValue<T>, T) - Method in interface com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.EvaluationContext: Ensures that the element is encodable and decodable using the TypePValue's coder, by encoding it and decoding it, and returning the result.
ensureSerializable(FunctionT) - Method in interface com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.EvaluationContext: If the evaluation context is testing serializability, ensures that the argument function is serializable and deserializable by encoding it and then decoding it, and returning the result.
ensureSerializable(T) - Static method in class com.google.cloud.dataflow.sdk.util.SerializableUtils
ensureSerializable(Coder<?>) - Static method in class com.google.cloud.dataflow.sdk.util.SerializableUtils: Serializes a Coder and verifies that it can be correctly deserialized.
ensureSerializableByCoder(Coder<T>, T, String) - Method in interface com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.EvaluationContext: If the evaluation context is testing serializability, ensures that the given data is serializable and deserializable with the given Coder by encoding it and then decoding it, and returning the result.
ensureSerializableByCoder(Coder<T>, T, String) - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.TestCombineDoFn
ensureSerializableByCoder(Coder<T>, T, String) - Static method in class com.google.cloud.dataflow.sdk.util.SerializableUtils: Serializes an arbitrary T with the given Coder<T> and verifies that it can be correctly deserialized.
enterCompositeTransform(TransformTreeNode) - Method in interface com.google.cloud.dataflow.sdk.Pipeline.PipelineVisitor: Called for each composite transform after all topological predecessors have been visited but before any of the component transforms.
enterCompositeTransform(TransformTreeNode) - Method in class com.google.cloud.dataflow.sdk.runners.RecordingPipelineVisitor
EntityCoder - Class in com.google.cloud.dataflow.sdk.coders: An EntityCoder is a Coder for DatastoreV1.Entity objects.
entries - Variable in class com.google.cloud.dataflow.sdk.util.common.worker.ShuffleBatchReader.Batch
ENVIRONMENT_VERSION_JOB_TYPE_KEY - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
ENVIRONMENT_VERSION_MAJOR_KEY - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
equals(Object) - Method in class com.google.cloud.dataflow.sdk.coders.Proto2Coder
equals(Object) - Method in class com.google.cloud.dataflow.sdk.coders.SerializableCoder
equals(Object) - Method in class com.google.cloud.dataflow.sdk.coders.StandardCoder
equals(Object) - Method in class com.google.cloud.dataflow.sdk.runners.worker.ByteArrayShufflePosition
equals(Object) - Method in class com.google.cloud.dataflow.sdk.transforms.AppliedPTransform
equals(Object) - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult.CoGbkResultCoder
equals(Object) - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResultSchema
equals(Object) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterPane
equals(Object) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterProcessingTime
equals(Object) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.IntervalWindow
equals(Object) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.PaneInfo
equals(Object) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Trigger
equals(Object) - Method in class com.google.cloud.dataflow.sdk.util.common.Counter
equals(Object) - Method in class com.google.cloud.dataflow.sdk.util.common.worker.PartialGroupByKeyOperation.StructuralByteArray
equals(Object) - Method in class com.google.cloud.dataflow.sdk.util.common.worker.ShuffleEntry
equals(Object) - Method in class com.google.cloud.dataflow.sdk.util.gcsfs.GcsPath
equals(Object) - Method in class com.google.cloud.dataflow.sdk.util.PCollectionViewWindow
equals(Object) - Method in class com.google.cloud.dataflow.sdk.util.state.StateNamespaceForTest
equals(Object) - Method in class com.google.cloud.dataflow.sdk.util.state.StateNamespaces.GlobalNamespace
equals(Object) - Method in class com.google.cloud.dataflow.sdk.util.state.StateNamespaces.WindowAndTriggerNamespace
equals(Object) - Method in class com.google.cloud.dataflow.sdk.util.state.StateNamespaces.WindowNamespace
equals(Object) - Method in class com.google.cloud.dataflow.sdk.util.TimerInternals.TimerData
equals(Object) - Method in class com.google.cloud.dataflow.sdk.util.TimerOrElement
equals(Object) - Method in class com.google.cloud.dataflow.sdk.util.ValueWithRecordId
equals(Object) - Method in class com.google.cloud.dataflow.sdk.util.WindowedValue
equals(Object) - Method in class com.google.cloud.dataflow.sdk.values.KV
equals(Object) - Method in class com.google.cloud.dataflow.sdk.values.TimestampedValue
equals(Object) - Method in class com.google.cloud.dataflow.sdk.values.TupleTag
equals(Object) - Method in class com.google.cloud.dataflow.sdk.values.TypeDescriptor: Two type descriptor are equal if and only if they represent the same type.
ESCAPE1 - Static variable in class com.google.cloud.dataflow.sdk.runners.worker.OrderedCode
ESCAPE1_SEPARATOR - Static variable in class com.google.cloud.dataflow.sdk.runners.worker.OrderedCode
ESCAPE2 - Static variable in class com.google.cloud.dataflow.sdk.runners.worker.OrderedCode
estimateSize(T) - Method in class com.google.cloud.dataflow.sdk.runners.worker.MapTaskExecutorFactory.CoderSizeEstimator
estimateSize(T) - Method in class com.google.cloud.dataflow.sdk.util.common.worker.PartialGroupByKeyOperation.SamplingSizeEstimator
estimateSize(T) - Method in interface com.google.cloud.dataflow.sdk.util.common.worker.PartialGroupByKeyOperation.SizeEstimator
evaluate(TransformT, DirectPipelineRunner.EvaluationContext) - Method in interface com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.TransformEvaluator
evaluateReadHelper(Read.Bounded<T>, DirectPipelineRunner.EvaluationContext) - Static method in class com.google.cloud.dataflow.sdk.runners.dataflow.BasicSerializableSourceFormat
eventTimestamp() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Trigger.OnElementContext: The event timestamp of the element currently being processed.
every(Duration) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.SlidingWindows: Returns a new SlidingWindows with the original size, that assigns timestamps into half-open intervals of the form [N * period, N * period + size), where 0 is the epoch.
ExecutableTrigger<W extends BoundedWindow> - Class in com.google.cloud.dataflow.sdk.util: A wrapper around a trigger used during execution.
execute() - Method in class com.google.cloud.dataflow.sdk.runners.worker.SourceOperationExecutor
execute(Runnable) - Method in class com.google.cloud.dataflow.sdk.util.BoundedQueueExecutor
execute() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.MapTaskExecutor
execute() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.WorkExecutor: Executes the task.
executeRefreshToken() - Method in class com.google.cloud.dataflow.sdk.util.TestCredential
executeWithBackOff(AbstractGoogleClientRequest<T>, String, Object...) - Static method in class com.google.cloud.dataflow.sdk.util.BigQueryTableRowIterator
ExecutionContext - Interface in com.google.cloud.dataflow.sdk.util: Context for the current execution.
ExecutionContext.StepContext - Interface in com.google.cloud.dataflow.sdk.util: Per-step, per-key context used for retrieving state.
ExecutorServiceFactory() - Constructor for class com.google.cloud.dataflow.sdk.options.GcsOptions.ExecutorServiceFactory
expand() - Method in class com.google.cloud.dataflow.sdk.transforms.join.KeyedPCollectionTuple: Expands the component PCollections, stripping off any tag-specific information.
expand(GcsPath) - Method in class com.google.cloud.dataflow.sdk.util.GcsUtil: Expands a pattern into matched paths.
expand() - Method in class com.google.cloud.dataflow.sdk.values.PBegin
expand() - Method in class com.google.cloud.dataflow.sdk.values.PCollectionList
expand() - Method in class com.google.cloud.dataflow.sdk.values.PCollectionTuple
expand() - Method in class com.google.cloud.dataflow.sdk.values.PDone
expand() - Method in interface com.google.cloud.dataflow.sdk.values.PInput: Expands this PInput into a list of its component input PValues.
expand() - Method in interface com.google.cloud.dataflow.sdk.values.POutput: Expands this POutput into a list of its component output PValues.
expand() - Method in class com.google.cloud.dataflow.sdk.values.PValueBase
Experimental - Annotation Type in com.google.cloud.dataflow.sdk.annotations: Signifies that a public API (public class, method or field) is subject to incompatible changes, or even removal, in a future release.
Experimental.Kind - Enum in com.google.cloud.dataflow.sdk.annotations: An enumeration of various kinds of experimental APIs.
ExposedByteArrayInputStream - Class in com.google.cloud.dataflow.sdk.util: ByteArrayInputStream that allows accessing the entire internal buffer without copying.
ExposedByteArrayInputStream(byte[]) - Constructor for class com.google.cloud.dataflow.sdk.util.ExposedByteArrayInputStream
ExposedByteArrayOutputStream - Class in com.google.cloud.dataflow.sdk.util: ByteArrayOutputStream special cased to treat writes of a single byte-array specially.
ExposedByteArrayOutputStream() - Constructor for class com.google.cloud.dataflow.sdk.util.ExposedByteArrayOutputStream
extension - Variable in class com.google.cloud.dataflow.sdk.io.FileBasedSink: The extension to be used for the final output files.
extract(WindowedValue<K>, AccumT) - Method in class com.google.cloud.dataflow.sdk.runners.worker.MapTaskExecutorFactory.ValueCombiner
extract(K, AccumT) - Method in interface com.google.cloud.dataflow.sdk.util.common.worker.PartialGroupByKeyOperation.Combiner
extractAndRelease(ReduceFn<?, ?, ?, W>.Context) - Method in class com.google.cloud.dataflow.sdk.util.WatermarkHold: Get information from the watermark hold for outputting.
extractCloudMetric(Metric<?>, String) - Static method in class com.google.cloud.dataflow.sdk.util.CloudMetricUtils: Returns a MetricUpdate representing the given Metric.
extractCloudMetrics(Collection<Metric<?>>, String) - Static method in class com.google.cloud.dataflow.sdk.util.CloudMetricUtils: Returns a List of MetricUpdates representing the given Metrics.
extractCounter(Counter<?>, boolean) - Static method in class com.google.cloud.dataflow.sdk.util.CloudCounterUtils
extractCounters(CounterSet, boolean) - Static method in class com.google.cloud.dataflow.sdk.util.CloudCounterUtils
extractOrderedList() - Method in class com.google.cloud.dataflow.sdk.transforms.ApproximateUnique.ApproximateUniqueCombineFn.LargestUnique: Returns the values in the heap, ordered largest to smallest.
extractOutput(ApproximateUnique.ApproximateUniqueCombineFn.LargestUnique) - Method in class com.google.cloud.dataflow.sdk.transforms.ApproximateUnique.ApproximateUniqueCombineFn
extractOutput() - Method in interface com.google.cloud.dataflow.sdk.transforms.Combine.AccumulatingCombineFn.Accumulator: Returns the output value that is the result of combining all the input values represented by this accumulator.
extractOutput(AccumT) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.AccumulatingCombineFn
extractOutput(double[]) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineDoubleFn
extractOutput(Combine.Holder<V>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineFn
extractOutput(int[]) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineIntegerFn
extractOutput(long[]) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineLongFn
extractOutput(AccumT) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.CombineFn: Returns the output value that is the result of combining all the input values represented by the given accumulator.
extractOutput(List<V>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.IterableCombineFn
extractOutput(K, AccumT) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.KeyedCombineFn: Returns the output value that is the result of combining all the input values represented by the given accumulator.
extractOutput(Top.BoundedHeap<KV<Integer, T>, SerializableComparator<KV<Integer, T>>>) - Method in class com.google.cloud.dataflow.sdk.transforms.Sample.FixedSizedSampleFn
extractOutput(List<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.View.Concatenate

F

fetchSideInput(PCollectionView<T>, SideWindowT, String, StateFetcher.SideInputState) - Method in class com.google.cloud.dataflow.sdk.util.StateFetcher: Fetch the given side input, storing it in a process-level cache.
fewKeys() - Method in class com.google.cloud.dataflow.sdk.transforms.GroupByKey: Returns whether it groups just few keys.
FF_CHARACTER - Static variable in class com.google.cloud.dataflow.sdk.runners.worker.OrderedCode
FileBasedReader(FileBasedSource<T>) - Constructor for class com.google.cloud.dataflow.sdk.io.FileBasedSource.FileBasedReader: Subclasses should not perform IO operations at the constructor.
FileBasedReader<T> - Class in com.google.cloud.dataflow.sdk.runners.worker: Abstract base class for sources that read from files.
FileBasedReader(String, Long, Long, Coder<T>, boolean) - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.FileBasedReader
FileBasedReader.DecompressingStreamFactory - Interface in com.google.cloud.dataflow.sdk.runners.worker: Factory interface for creating a decompressing InputStream.
FileBasedReader.FileBasedIterator - Class in com.google.cloud.dataflow.sdk.runners.worker: Abstract base class for file-based source iterators.
FileBasedReader.FilenameBasedStreamFactory - Class in com.google.cloud.dataflow.sdk.runners.worker: Factory for creating decompressing input streams based on a filename and a TextIO.CompressionType.
FileBasedSink<T> - Class in com.google.cloud.dataflow.sdk.io: Abstract Sink for file-based output.
FileBasedSink(String, String) - Constructor for class com.google.cloud.dataflow.sdk.io.FileBasedSink: Construct a FileBasedSink with the given base output filename and extension.
FileBasedSink(String, String, String) - Constructor for class com.google.cloud.dataflow.sdk.io.FileBasedSink: Construct a FileBasedSink with the given base output filename, extension, and file naming template.
FileBasedSink.FileBasedWriteOperation<T> - Class in com.google.cloud.dataflow.sdk.io: Abstract Sink.WriteOperation that manages the process of writing to a FileBasedSink.
FileBasedSink.FileBasedWriteOperation.TemporaryFileRetention - Enum in com.google.cloud.dataflow.sdk.io: Options for handling of temporary output files.
FileBasedSink.FileBasedWriter<T> - Class in com.google.cloud.dataflow.sdk.io: Abstract Sink.Writer that writes a bundle to a FileBasedSink.
FileBasedSink.FileResult - Class in com.google.cloud.dataflow.sdk.io: Result of a single bundle write.
FileBasedSource<T> - Class in com.google.cloud.dataflow.sdk.io: A common base class for all file-based Sources.
FileBasedSource(String, long) - Constructor for class com.google.cloud.dataflow.sdk.io.FileBasedSource: Create a FileBaseSource based on a file or a file pattern specification.
FileBasedSource(String, long, long, long) - Constructor for class com.google.cloud.dataflow.sdk.io.FileBasedSource: Create a FileBasedSource based on a single file.
FileBasedSource.FileBasedReader<T> - Class in com.google.cloud.dataflow.sdk.io: A reader that implements code common to readers of FileBasedSources.
FileBasedSource.Mode - Enum in com.google.cloud.dataflow.sdk.io: A given FileBasedSource represents a file resource of one of these types.
FileBasedWriteOperation(FileBasedSink<T>) - Constructor for class com.google.cloud.dataflow.sdk.io.FileBasedSink.FileBasedWriteOperation: Construct a FileBasedWriteOperation using the same base filename for both temporary and output files.
FileBasedWriteOperation(FileBasedSink<T>, String) - Constructor for class com.google.cloud.dataflow.sdk.io.FileBasedSink.FileBasedWriteOperation: Construct a FileBasedWriteOperation.
FileBasedWriteOperation(FileBasedSink<T>, String, FileBasedSink.FileBasedWriteOperation.TemporaryFileRetention) - Constructor for class com.google.cloud.dataflow.sdk.io.FileBasedSink.FileBasedWriteOperation: Create a new FileBasedWriteOperation.
FileBasedWriter(FileBasedSink.FileBasedWriteOperation<T>) - Constructor for class com.google.cloud.dataflow.sdk.io.FileBasedSink.FileBasedWriter: Construct a new FileBasedWriter with a base filename.
FileIOChannelFactory - Class in com.google.cloud.dataflow.sdk.util: Implements IOChannelFactory for local files.
FileIOChannelFactory() - Constructor for class com.google.cloud.dataflow.sdk.util.FileIOChannelFactory
filename - Variable in class com.google.cloud.dataflow.sdk.runners.worker.FileBasedReader
FILENAME - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
FILENAME_PREFIX - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
FILENAME_SUFFIX - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
FilenameBasedStreamFactory(String, TextIO.CompressionType) - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.FileBasedReader.FilenameBasedStreamFactory
fileNamingTemplate - Variable in class com.google.cloud.dataflow.sdk.io.FileBasedSink: Naming template for output files.
FILEPATTERN - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
FileResult(String) - Constructor for class com.google.cloud.dataflow.sdk.io.FileBasedSink.FileResult
fileSize(GcsPath) - Method in class com.google.cloud.dataflow.sdk.util.GcsUtil: Returns the file size from GCS or throws FileNotFoundException if the resource does not exist.
Filter<T> - Class in com.google.cloud.dataflow.sdk.transforms: PTransforms for filtering from a PCollection the elements satisfying a predicate, or satisfying an inequality with a given value based on the elements' natural ordering.
Filter() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Filter
finalize(Iterable<FileBasedSink.FileResult>, PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSink.FileBasedWriteOperation: Finalizes writing by copying temporary output files to their final location and optionally removing temporary files.
finalize(Iterable<WriteT>, PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.Sink.WriteOperation: Given an Iterable of results from bundle writes, performs finalization after writing and closes the sink.
finalize() - Method in class com.google.cloud.dataflow.sdk.runners.worker.ApplianceShuffleReader
finalize() - Method in class com.google.cloud.dataflow.sdk.runners.worker.ApplianceShuffleWriter
finalizeCheckpoint() - Method in interface com.google.cloud.dataflow.sdk.io.UnboundedSource.CheckpointMark: Perform any finalization that needs to happen after a bundle of data read from the source has been processed and committed.
finish() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.Operation: Finishes this Operation's execution.
finish() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.ParDoOperation
finish() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.PartialGroupByKeyOperation
finish() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.WriteOperation
finishBundle() - Method in class com.google.cloud.dataflow.sdk.runners.worker.ParDoFnBase
finishBundle(DoFn<InputT, OutputT>.Context) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFn: Finishes processing this batch of elements.
finishBundle() - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnTester: Calls DoFn.finishBundle(com.google.cloud.dataflow.sdk.transforms.DoFn<InputT, OutputT>.Context) of the DoFn under test.
finishBundle(DoFn<InputT, OutputT>.Context) - Method in class com.google.cloud.dataflow.sdk.transforms.IntraBundleParallelization.MultiThreadedIntraBundleProcessingDoFn
finishBundle() - Method in interface com.google.cloud.dataflow.sdk.util.common.worker.ParDoFn
finishBundle() - Method in class com.google.cloud.dataflow.sdk.util.DoFnRunner: Calls DoFn.finishBundle(com.google.cloud.dataflow.sdk.transforms.DoFn<InputT, OutputT>.Context).
finishBundle() - Method in class com.google.cloud.dataflow.sdk.util.StreamingSideInputDoFnRunner
finishedInAnyMergingWindow() - Method in interface com.google.cloud.dataflow.sdk.transforms.windowing.Trigger.MergingTriggerInfo: Return true if the trigger is finished in any window being merged.
finishLazyUpdate(Object) - Method in class com.google.cloud.dataflow.sdk.runners.worker.DataflowOutputCounter
finishLazyUpdate(Object) - Method in interface com.google.cloud.dataflow.sdk.util.common.worker.ElementCounter: Finishes output counters lazy updates.
finishLazyUpdate(Object) - Method in class com.google.cloud.dataflow.sdk.util.common.worker.OutputObjectAndByteCounter
finishSpecifying() - Method in class com.google.cloud.dataflow.sdk.runners.TransformTreeNode: Finish specifying a transform.
finishSpecifying() - Method in class com.google.cloud.dataflow.sdk.transforms.join.KeyedPCollectionTuple
finishSpecifying() - Method in class com.google.cloud.dataflow.sdk.values.PBegin
finishSpecifying() - Method in class com.google.cloud.dataflow.sdk.values.PCollectionList
finishSpecifying() - Method in class com.google.cloud.dataflow.sdk.values.PCollectionTuple
finishSpecifying() - Method in interface com.google.cloud.dataflow.sdk.values.PInput: After building, finalizes this PInput to make it ready for being used as an input to a PTransform.
finishSpecifying() - Method in class com.google.cloud.dataflow.sdk.values.PValueBase
finishSpecifying() - Method in class com.google.cloud.dataflow.sdk.values.TypedPValue: After building, finalizes this PValue to make it ready for running.
finishSpecifyingOutput() - Method in class com.google.cloud.dataflow.sdk.values.PCollectionList
finishSpecifyingOutput() - Method in class com.google.cloud.dataflow.sdk.values.PCollectionTuple
finishSpecifyingOutput() - Method in interface com.google.cloud.dataflow.sdk.values.POutput: As part of applying the producing PTransform, finalizes this output to make it ready for being used as an input and for running.
finishSpecifyingOutput() - Method in class com.google.cloud.dataflow.sdk.values.POutputValueBase: Default behavior for finishSpecifyingOutput() is to do nothing.
finishState - Variable in class com.google.cloud.dataflow.sdk.util.common.worker.Operation
firstUnfinishedSubTrigger() - Method in interface com.google.cloud.dataflow.sdk.transforms.windowing.Trigger.TriggerInfo: Returns the first unfinished sub-trigger.
fixedSizeGlobally(int) - Static method in class com.google.cloud.dataflow.sdk.transforms.Sample: Returns a PTransform that takes a PCollection<T>, selects sampleSize elements, uniformly at random, and returns a PCollection<Iterable<T>> containing the selected elements.
fixedSizePerKey(int) - Static method in class com.google.cloud.dataflow.sdk.transforms.Sample: Returns a PTransform that takes an input PCollection<KV<K, V>> and returns a PCollection<KV<K, Iterable<V>>> that contains an output element mapping each distinct key in the input PCollection to a sample of sampleSize values associated with that key in the input PCollection, taken uniformly at random.
FixedWindows - Class in com.google.cloud.dataflow.sdk.transforms.windowing: A WindowFn that windows values into fixed-size timestamp-based windows.
Flatten - Class in com.google.cloud.dataflow.sdk.transforms: Flatten<T> takes multiple PCollection<T>s bundled into a PCollectionList<T> and returns a single PCollection<T> containing all the elements in all the input PCollections.
Flatten() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Flatten
Flatten.FlattenIterables<T> - Class in com.google.cloud.dataflow.sdk.transforms: FlattenIterables<T> takes a PCollection<Iterable<T>> and returns a PCollection<T> that contains all the elements from each iterable.
Flatten.FlattenPCollectionList<T> - Class in com.google.cloud.dataflow.sdk.transforms: A PTransform that flattens a PCollectionList into a PCollection containing all the elements of all the PCollections in its input.
flattenBaseSpecs(Source) - Static method in class com.google.cloud.dataflow.sdk.util.CloudSourceUtils: Returns a copy of the source with baseSpecs flattened into spec.
FlattenIterables() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Flatten.FlattenIterables
FlattenOperation - Class in com.google.cloud.dataflow.sdk.util.common.worker: A flatten operation.
FlattenOperation(String, OutputReceiver[], String, CounterSet.AddCounterMutator, StateSampler) - Constructor for class com.google.cloud.dataflow.sdk.util.common.worker.FlattenOperation
FlattenOperation(OutputReceiver, String, CounterSet.AddCounterMutator, StateSampler) - Constructor for class com.google.cloud.dataflow.sdk.util.common.worker.FlattenOperation: Invoked by tests.
flush() - Method in class com.google.cloud.dataflow.sdk.runners.worker.logging.DataflowWorkerLoggingHandler
flushState() - Method in class com.google.cloud.dataflow.sdk.util.StreamingModeExecutionContext
fn - Variable in class com.google.cloud.dataflow.sdk.util.common.worker.ParDoOperation
fn - Variable in class com.google.cloud.dataflow.sdk.util.DoFnRunner: The DoFn being run.
FOOTER - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
forBoolean(Boolean) - Static method in class com.google.cloud.dataflow.sdk.util.CloudObject: Constructs a CloudObject representing the given value.
forceExecute(Runnable) - Method in class com.google.cloud.dataflow.sdk.util.BoundedQueueExecutor
forClass(Class<?>) - Static method in class com.google.cloud.dataflow.sdk.util.CloudObject: Constructs a CloudObject to be used for serializing an instance of the supplied class for transport via the Dataflow API.
forClassName(String) - Static method in class com.google.cloud.dataflow.sdk.util.CloudObject: Constructs a CloudObject to be used for serializing data to be deserialized using the supplied class name the supplied class name for transport via the Dataflow API.
forCoder(Coder<T>) - Static method in class com.google.cloud.dataflow.sdk.coders.CoderFactories: Creates a CoderFactory that always returns the given coder.
forever(Trigger<W>) - Static method in class com.google.cloud.dataflow.sdk.transforms.windowing.Repeatedly: Create a composite trigger that repeatedly executes the trigger toRepeat, firing each time it fires and ignoring any indications to finish.
forFloat(Float) - Static method in class com.google.cloud.dataflow.sdk.util.CloudObject: Constructs a CloudObject representing the given value.
forFloat(Double) - Static method in class com.google.cloud.dataflow.sdk.util.CloudObject: Constructs a CloudObject representing the given value.
forInteger(Long) - Static method in class com.google.cloud.dataflow.sdk.util.CloudObject: Constructs a CloudObject representing the given value.
forInteger(Integer) - Static method in class com.google.cloud.dataflow.sdk.util.CloudObject: Constructs a CloudObject representing the given value.
forKey(K, Coder<K>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.KeyedCombineFn: Returns the a regular Combine.CombineFn that operates on a specific key.
forKnownType(Object) - Static method in class com.google.cloud.dataflow.sdk.util.CloudObject: Constructs a CloudObject representing the given value of a well-known cloud object type.
FORMAT - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
formatException(Throwable) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.logging.DataflowWorkerLoggingHandler: Formats the throwable as per Throwable.printStackTrace().
forString(String) - Static method in class com.google.cloud.dataflow.sdk.util.CloudObject: Constructs a CloudObject representing the given value.
forTrigger(ExecutableTrigger<W>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Trigger.OnElementContext: Create an OnElementContext for executing the given trigger.
forTrigger(ExecutableTrigger<W>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Trigger.OnMergeContext: Create an OnMergeContext for executing the given trigger.
forTrigger(ExecutableTrigger<W>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Trigger.OnTimerContext: Create an OnTimerContext for executing the given trigger.
forTrigger(ExecutableTrigger<W>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Trigger.TriggerContext: Create a sub-context for the given sub-trigger.
forValueWithCoder(T, Coder<T>) - Static method in class com.google.cloud.dataflow.sdk.util.MutationDetectors: Creates a new MutationDetector for the provided value that uses the provided Coder to perform deep copies and comparisons by serializing and deserializing values.
ForwardingReiterator<T> - Class in com.google.cloud.dataflow.sdk.util.common: A Reiterator that forwards to another Reiterator, useful for implementing Reiterator wrappers.
ForwardingReiterator(Reiterator<T>) - Constructor for class com.google.cloud.dataflow.sdk.util.common.ForwardingReiterator: Constructs a ForwardingReiterator.
from(String) - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Read.Bound: Returns a new AvroIO.Read PTransform that's like this one but that reads from the file(s) with the given name or pattern.
from(String) - Static method in class com.google.cloud.dataflow.sdk.io.AvroIO.Read: Returns an AvroIO.Read PTransform that reads from the file(s) with the given name or pattern.
from(String) - Static method in class com.google.cloud.dataflow.sdk.io.AvroSource: Creates an AvroSource that reads from the given file name or pattern ("glob").
from(String) - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Read.Bound: Sets the table specification.
from(TableReference) - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Read.Bound: Sets the table specification.
from(String) - Static method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Read: Reads a BigQuery table specified as "[project_id]:[dataset_id].[table_id]" or "[dataset_id].[table_id]" for tables within the current project.
from(TableReference) - Static method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Read: Reads a BigQuery table specified as a TableReference object.
from(FileBasedSource<T>) - Static method in class com.google.cloud.dataflow.sdk.io.CompressedSource: Creates a CompressedSource from an underlying FileBasedSource that must be further configured with CompressedSource.withDecompression(com.google.cloud.dataflow.sdk.io.CompressedSource.DecompressingChannelFactory).
from(BoundedSource<T>) - Method in class com.google.cloud.dataflow.sdk.io.Read.Builder: Returns a new Read.Bounded PTransform reading from the given BoundedSource.
from(UnboundedSource<T, ?>) - Method in class com.google.cloud.dataflow.sdk.io.Read.Builder: Returns a new Read.Unbounded PTransform reading from the given UnboundedSource.
from(BoundedSource<T>) - Static method in class com.google.cloud.dataflow.sdk.io.Read: Returns a new Read.Bounded PTransform reading from the given BoundedSource.
from(UnboundedSource<T, ?>) - Static method in class com.google.cloud.dataflow.sdk.io.Read: Returns a new Read.Unbounded PTransform reading from the given UnboundedSource.
from(String) - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Read.Bound: Returns a new TextIO.Read PTransform that's like this one but that reads from the file(s) with the given name or pattern.
from(String) - Static method in class com.google.cloud.dataflow.sdk.io.TextIO.Read: Returns a TextIO.Read PTransform that reads from the file(s) with the given name or pattern.
from(String) - Static method in class com.google.cloud.dataflow.sdk.io.XmlSource: Creates an XmlSource for a single XML file or a set of XML files defined by a Java "glob" file pattern.
from(Map<String, String>) - Static method in class com.google.cloud.dataflow.sdk.options.DataflowWorkerLoggingOptions.WorkerLogLevelOverrides: Expects a map keyed by logger Names with values representing Levels.
fromArgs(String[]) - Method in class com.google.cloud.dataflow.sdk.options.PipelineOptionsFactory.Builder: Sets the command line arguments to parse when constructing the PipelineOptions.
fromArgs(String[]) - Static method in class com.google.cloud.dataflow.sdk.options.PipelineOptionsFactory: Sets the command line arguments to parse when constructing the PipelineOptions.
fromBase64(String) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.ByteArrayShufflePosition
fromClass(Class<?>) - Method in class com.google.cloud.dataflow.sdk.util.InstanceBuilder: Sets the factory class to use for instance construction.
fromClassName(String) - Method in class com.google.cloud.dataflow.sdk.util.InstanceBuilder: Sets the class name to be constructed.
fromCloudDuration(String) - Static method in class com.google.cloud.dataflow.sdk.util.TimeUtil: Converts a Dataflow API duration string into a Duration.
fromCloudTime(String) - Static method in class com.google.cloud.dataflow.sdk.util.TimeUtil: Converts a time value received via the Dataflow API into the corresponding Instant.
fromComponents(String, String) - Static method in class com.google.cloud.dataflow.sdk.util.gcsfs.GcsPath: Creates a GcsPath from bucket and object components.
fromFactoryMethod(String) - Method in class com.google.cloud.dataflow.sdk.util.InstanceBuilder: Sets the name of the factory method used to construct the instance.
fromIterableInternal(Iterable<WindowedValue<?>>) - Method in interface com.google.cloud.dataflow.sdk.values.PCollectionView: For internal use only.
fromMetricUpdates(Aggregator<?, OutputT>, DataflowAggregatorTransforms, List<MetricUpdate>) - Static method in class com.google.cloud.dataflow.sdk.runners.dataflow.DataflowMetricUpdateExtractor: Extract the values of the provided Aggregator at each PTransform it was used in according to the provided DataflowAggregatorTransforms from the given list of MetricUpdates.
fromObject(StorageObject) - Static method in class com.google.cloud.dataflow.sdk.util.gcsfs.GcsPath: Creates a GcsPath from a StorageObject.
fromOptions(PipelineOptions) - Static method in class com.google.cloud.dataflow.sdk.runners.BlockingDataflowPipelineRunner: Constructs a runner from the provided options.
fromOptions(PipelineOptions) - Static method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineRunner: Construct a runner from the provided options.
fromOptions(DataflowPipelineOptions) - Static method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator: Constructs a translator from the provided options.
fromOptions(PipelineOptions) - Static method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner: Constructs a DirectPipelineRunner from the given options.
fromOptions(PipelineOptions) - Static method in class com.google.cloud.dataflow.sdk.runners.PipelineRunner: Constructs a runner from the provided options.
fromOptions(PipelineOptions) - Static method in class com.google.cloud.dataflow.sdk.testing.TestDataflowPipelineRunner: Constructs a runner from the provided options.
fromOptions(PipelineOptions) - Static method in class com.google.cloud.dataflow.sdk.util.DataflowPathValidator
fromOptions(PipelineOptions) - Static method in class com.google.cloud.dataflow.sdk.util.GcpCredentialFactory
fromOptions(PipelineOptions) - Static method in class com.google.cloud.dataflow.sdk.util.GcsStager
fromOptions(PipelineOptions) - Static method in class com.google.cloud.dataflow.sdk.util.NoopCredentialFactory
fromOptions(PipelineOptions) - Static method in class com.google.cloud.dataflow.sdk.util.NoopPathValidator
fromPath(String) - Static method in class com.google.cloud.dataflow.sdk.io.PubsubIO.PubsubSubscription
fromPath(String) - Static method in class com.google.cloud.dataflow.sdk.io.PubsubIO.PubsubTopic
fromQuery(String) - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Read.Bound: Sets the BigQuery query to be used.
fromQuery(String) - Static method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Read: Reads results received after executing the given query.
fromResourceName(String) - Static method in class com.google.cloud.dataflow.sdk.util.gcsfs.GcsPath: Creates a GcsPath from a OnePlatform resource name in string form.
fromSpec(Map<String, Object>) - Static method in class com.google.cloud.dataflow.sdk.util.CloudObject: Constructs a CloudObject by copying the supplied serialized object spec, which must represent an SDK object serialized for transport via the Dataflow API.
fromStaticMethods(Class<T>) - Static method in class com.google.cloud.dataflow.sdk.coders.CoderFactories: Creates a CoderFactory built from particular static methods of a class that implements Coder.
fromString(String, Coder<W>) - Static method in class com.google.cloud.dataflow.sdk.util.state.StateNamespaces: Convert a stringKey produced using StateNamespace.stringKey() on one of the namespaces produced by this class into the original StateNamespace.
fromUri(URI) - Static method in class com.google.cloud.dataflow.sdk.util.gcsfs.GcsPath: Creates a GcsPath from a URI.
fromUri(String) - Static method in class com.google.cloud.dataflow.sdk.util.gcsfs.GcsPath: Creates a GcsPath from a URI in string form.

G

GcpCredentialFactory - Class in com.google.cloud.dataflow.sdk.util: Construct an oauth credential to be used by the SDK and the SDK workers.
GcpOptions - Interface in com.google.cloud.dataflow.sdk.options: Options used to configure Google Cloud Platform project and credentials.
GcpOptions.CredentialDirFactory - Class in com.google.cloud.dataflow.sdk.options: Returns the default credential directory of ${user.home}/.store/data-flow.
GcpOptions.DefaultProjectFactory - Class in com.google.cloud.dataflow.sdk.options: Attempts to get infer the default project based upon the environment this application is executing within.
GcpOptions.GcpUserCredentialsFactory - Class in com.google.cloud.dataflow.sdk.options: Attempts to load the GCP credentials.
GcpUserCredentialsFactory() - Constructor for class com.google.cloud.dataflow.sdk.options.GcpOptions.GcpUserCredentialsFactory
GCS_URI - Static variable in class com.google.cloud.dataflow.sdk.util.gcsfs.GcsPath: Pattern that is used to parse a GCS URL.
GcsIOChannelFactory - Class in com.google.cloud.dataflow.sdk.util: Implements IOChannelFactory for GCS.
GcsIOChannelFactory(GcsOptions) - Constructor for class com.google.cloud.dataflow.sdk.util.GcsIOChannelFactory
GcsOptions - Interface in com.google.cloud.dataflow.sdk.options: Options used to configure Google Cloud Storage.
GcsOptions.ExecutorServiceFactory - Class in com.google.cloud.dataflow.sdk.options: Returns the default ExecutorService to use within the Dataflow SDK.
GcsPath - Class in com.google.cloud.dataflow.sdk.util.gcsfs: Implements the Java NIO Path API for Google Cloud Storage paths.
GcsPath(FileSystem, String, String) - Constructor for class com.google.cloud.dataflow.sdk.util.gcsfs.GcsPath: Constructs a GcsPath.
GcsStager - Class in com.google.cloud.dataflow.sdk.util: Utility class for staging files to GCS.
GcsUtil - Class in com.google.cloud.dataflow.sdk.util: Provides operations on GCS.
GcsUtil.GcsUtilFactory - Class in com.google.cloud.dataflow.sdk.util: This is a DefaultValueFactory able to create a GcsUtil using any transport flags specified on the PipelineOptions.
GcsUtilFactory() - Constructor for class com.google.cloud.dataflow.sdk.util.GcsUtil.GcsUtilFactory
generateDestinationFilenames(int) - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSink.FileBasedWriteOperation: Generate output bundle filenames.
generateInitialSplits(int, PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.UnboundedSource: Returns a list of UnboundedSource objects representing the instances of this source that should be used when executing the workflow.
get(int) - Method in class com.google.cloud.dataflow.sdk.util.common.TaggedReiteratorList
get(PCollectionView<T>, BoundedWindow) - Method in class com.google.cloud.dataflow.sdk.util.DirectSideInputReader
get(PCollectionView<T>, BoundedWindow) - Method in class com.google.cloud.dataflow.sdk.util.NullSideInputReader
get(TupleTag<V>) - Method in class com.google.cloud.dataflow.sdk.util.PTuple: Returns the value with the given tag in this PTuple.
get(PCollectionView<T>, BoundedWindow) - Method in interface com.google.cloud.dataflow.sdk.util.SideInputReader: Returns the value of the given PCollectionView for the given BoundedWindow.
get(PCollectionView<T>, BoundedWindow) - Method in class com.google.cloud.dataflow.sdk.util.SizedSideInputReader.Defaults
get() - Method in interface com.google.cloud.dataflow.sdk.util.state.MergeableState: Return the StateContents object to use for accessing the contents of the buffer.
get(StateNamespace, StateTag<StateT>) - Method in class com.google.cloud.dataflow.sdk.util.state.StateTable
get() - Method in interface com.google.cloud.dataflow.sdk.util.state.ValueState
get(PCollectionView<T>, BoundedWindow) - Method in class com.google.cloud.dataflow.sdk.util.StreamingModeExecutionContext.StreamingModeSideInputReader
get(int) - Method in class com.google.cloud.dataflow.sdk.values.PCollectionList: Returns the PCollection at the given index (origin zero).
get(TupleTag<T>) - Method in class com.google.cloud.dataflow.sdk.values.PCollectionTuple: Returns the PCollection associated with the given TupleTag in this PCollectionTuple.
get(int) - Method in class com.google.cloud.dataflow.sdk.values.TupleTagList: Returns the TupleTag at the given index (origin zero).
getAcceptedPosition() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.Reader.DynamicSplitResultWithPosition
getAccum() - Method in interface com.google.cloud.dataflow.sdk.util.state.CombiningValueStateInternal: Read the merged accumulator for this combining value.
getAccumulatorCoder(CoderRegistry, Coder<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.ApproximateQuantiles.ApproximateQuantilesCombineFn
getAccumulatorCoder(CoderRegistry, Coder<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.ApproximateUnique.ApproximateUniqueCombineFn
getAccumulatorCoder(CoderRegistry, Coder<Double>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineDoubleFn
getAccumulatorCoder(CoderRegistry, Coder<V>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineFn
getAccumulatorCoder(CoderRegistry, Coder<Integer>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineIntegerFn
getAccumulatorCoder(CoderRegistry, Coder<Long>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineLongFn
getAccumulatorCoder(CoderRegistry, Coder<InputT>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.CombineFn: Returns the Coder to use for accumulator AccumT values, or null if it is not able to be inferred.
getAccumulatorCoder(CoderRegistry, Coder<K>, Coder<InputT>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.KeyedCombineFn: Returns the Coder to use for accumulator AccumT values, or null if it is not able to be inferred.
getAccumulatorCoder(CoderRegistry, Coder<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.Sample.FixedSizedSampleFn
getAccumulatorCoder(CoderRegistry, Coder<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.Top.TopCombineFn
getAccumulatorCoder(CoderRegistry, Coder<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.View.Concatenate
getAccumulatorCoder() - Method in class com.google.cloud.dataflow.sdk.util.AppliedCombineFn
getAddCounterMutator() - Method in interface com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.EvaluationContext: Returns a mutator, which can be used to add additional counters to this EvaluationContext.
getAddCounterMutator() - Method in class com.google.cloud.dataflow.sdk.util.common.CounterSet: Returns an object that supports adding additional counters into this CounterSet.
getAggregate() - Method in interface com.google.cloud.dataflow.sdk.util.common.Counter.CounterMean: Gets the aggregate value of this CounterMean.
getAggregate() - Method in class com.google.cloud.dataflow.sdk.util.common.Counter: Returns the aggregated value, or the sum for MEAN aggregation, either total or, if delta, since the last update extraction or resetDelta.
getAggregators(DoFn<?, ?>) - Static method in class com.google.cloud.dataflow.sdk.transforms.AggregatorRetriever: Returns the Aggregators created by the provided DoFn.
getAggregatorStepNames(Aggregator<?, ?>) - Method in class com.google.cloud.dataflow.sdk.runners.dataflow.DataflowAggregatorTransforms: Gets the step names in which the Aggregator is used.
getAggregatorSteps() - Method in class com.google.cloud.dataflow.sdk.runners.AggregatorPipelineExtractor: Returns a Map mapping each Aggregator in the Pipeline to the PTransforms in which it is used.
getAggregatorValues(Aggregator<?, T>) - Method in interface com.google.cloud.dataflow.sdk.PipelineResult: Retrieves the current value of the provided Aggregator.
getAggregatorValues(Aggregator<?, OutputT>) - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineJob
getAlgorithm() - Method in enum com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions.AutoscalingAlgorithmType: Returns the string representation of this type.
getAll(TupleTag<V>) - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult: Returns the values from the table represented by the given TupleTag<V> as an Iterable<V> (which may be empty if there are no results).
getAll() - Method in class com.google.cloud.dataflow.sdk.util.PTuple: Returns an immutable Map from TupleTag to corresponding value, for all the members of this PTuple.
getAll() - Method in class com.google.cloud.dataflow.sdk.values.PCollectionList: Returns an immutable List of all the PCollections in this PCollectionList.
getAll() - Method in class com.google.cloud.dataflow.sdk.values.PCollectionTuple: Returns an immutable Map from TupleTag to corresponding PCollection, for all the members of this PCollectionTuple.
getAll() - Method in class com.google.cloud.dataflow.sdk.values.TupleTagList: Returns an immutable List of all the TupleTags in this TupleTagList.
getAllowedEncodings() - Method in interface com.google.cloud.dataflow.sdk.coders.Coder: A collection of encodings supported by Coder.decode(java.io.InputStream, com.google.cloud.dataflow.sdk.coders.Coder.Context) in addition to the encoding from Coder.getEncodingId() (which is assumed supported).
getAllowedEncodings() - Method in class com.google.cloud.dataflow.sdk.coders.DelegateCoder
getAllowedEncodings() - Method in class com.google.cloud.dataflow.sdk.coders.StandardCoder: A collection of encodings supported by Coder.decode(java.io.InputStream, com.google.cloud.dataflow.sdk.coders.Coder.Context) in addition to the value of StandardCoder.getEncodingId().
getAllowedLateness() - Method in class com.google.cloud.dataflow.sdk.util.WindowingStrategy
getAllowedTimestampSkew() - Method in class com.google.cloud.dataflow.sdk.transforms.DoFn: Returns the allowed timestamp skew duration, which is the maximum duration that timestamps can be shifted backward in DoFn.Context.outputWithTimestamp(OutputT, org.joda.time.Instant).
getAllowedTimestampSkew() - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnWithContext: Returns the allowed timestamp skew duration, which is the maximum duration that timestamps can be shifted backward in DoFnWithContext.Context.outputWithTimestamp(OutputT, org.joda.time.Instant).
getAllStepContexts() - Method in class com.google.cloud.dataflow.sdk.util.BaseExecutionContext: Returns a collection view of all of the BaseExecutionContext.StepContexts.
getAllStepContexts() - Method in interface com.google.cloud.dataflow.sdk.util.ExecutionContext: Returns a collection view of all of the ExecutionContext.StepContexts.
getAndPerformWork() - Method in class com.google.cloud.dataflow.sdk.runners.worker.DataflowWorker: Gets WorkItem and performs it; returns true if work was successfully completed.
getAndResetDelta() - Method in class com.google.cloud.dataflow.sdk.util.common.Counter: Resets the counter's delta value to have no values accumulated and returns the value of the delta prior to the reset.
getAndResetMeanDelta() - Method in class com.google.cloud.dataflow.sdk.util.common.Counter: Resets the counter's delta value to have no values accumulated and returns the value of the delta prior to the reset, for a MEAN counter.
getAnyExposurePath(Class<?>) - Method in class com.google.cloud.dataflow.sdk.util.ApiSurface: Returns a path from an exposed class to a root class.
getApiRootUrl() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions: The root URL for the Dataflow API.
getAppliedFn(CoderRegistry, Coder<? extends KV<K, ? extends Iterable<InputT>>>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.GroupedValues
getAppliedTransformForStepName(String) - Method in class com.google.cloud.dataflow.sdk.runners.dataflow.DataflowAggregatorTransforms: Gets the PTransform that was assigned the provided step name.
getAppName() - Method in interface com.google.cloud.dataflow.sdk.options.ApplicationNameOptions: Name of application, for display purposes.
getArgumentTypes(Method) - Method in class com.google.cloud.dataflow.sdk.values.TypeDescriptor: Returns a list of argument types for the given method, which must be a part of the class.
getAutoscalingAlgorithm() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions
getBase64Length(int) - Static method in class com.google.cloud.dataflow.sdk.util.Base64Utils: Returns an upper bound of the length of non-chunked Base64 encoded version of the string of the given length.
getBoolean(Map<String, Object>, String) - Static method in class com.google.cloud.dataflow.sdk.util.Structs
getBoolean(Map<String, Object>, String, Boolean) - Static method in class com.google.cloud.dataflow.sdk.util.Structs
getBucket() - Method in class com.google.cloud.dataflow.sdk.util.gcsfs.GcsPath: Returns the bucket name associated with this GCS path, or an empty string if this is a relative path component.
getByteCount() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.OutputObjectAndByteCounter
getByteCount() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.WriteOperation
getBytes(InputStream) - Static method in class com.google.cloud.dataflow.sdk.util.StreamUtils: Efficient converting stream to bytes.
getBytes(Map<String, Object>, String) - Static method in class com.google.cloud.dataflow.sdk.util.Structs
getBytes(Map<String, Object>, String, byte[]) - Static method in class com.google.cloud.dataflow.sdk.util.Structs
getBytesPerOffset() - Method in class com.google.cloud.dataflow.sdk.io.OffsetBasedSource: Returns approximately how many bytes of data correspond to a single offset in this source.
getCachedReader() - Method in class com.google.cloud.dataflow.sdk.util.StreamingModeExecutionContext
getCause() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.InvalidWindows: Returns the reason that this WindowFn is invalid.
getChannel(int) - Method in class com.google.cloud.dataflow.sdk.util.ShardingWritableByteChannel: Returns the WritableByteChannel associated with the given shard number.
getChannelFactory() - Method in class com.google.cloud.dataflow.sdk.io.CompressedSource
getCheckpointMark() - Method in class com.google.cloud.dataflow.sdk.io.UnboundedSource.UnboundedReader: Returns a UnboundedSource.CheckpointMark representing the progress of this UnboundedReader.
getCheckpointMarkCoder() - Method in class com.google.cloud.dataflow.sdk.io.UnboundedSource: Returns a Coder for encoding and decoding the checkpoints for this source, or null if the checkpoints do not need to be durably committed.
getClasses() - Method in class com.google.cloud.dataflow.sdk.values.TypeDescriptor: Returns a set of TypeDescriptors, one for each superclass (including this class).
getClassName() - Method in class com.google.cloud.dataflow.sdk.util.CloudObject: Gets the name of the Java class that this CloudObject represents.
getClosingBehavior() - Method in class com.google.cloud.dataflow.sdk.util.WindowingStrategy
getClosureOfInterfaces(Class<?>) - Static method in class com.google.cloud.dataflow.sdk.util.common.ReflectHelpers: Returns all interfaces of the given clazz.
getClosureOfMethodsOnInterface(Class<?>) - Static method in class com.google.cloud.dataflow.sdk.util.common.ReflectHelpers: Returns all the methods visible from iface.
getClosureOfMethodsOnInterfaces(Iterable<? extends Class<?>>) - Static method in class com.google.cloud.dataflow.sdk.util.common.ReflectHelpers: Returns all the methods visible from the provided interfaces.
getCodedType(TypeDescriptor) - Static method in class com.google.cloud.dataflow.sdk.util.CoderUtils: If coderType is a subclass of Coder<T> for a specific type T, returns T.class.
getCoder(TypeDescriptor<T>) - Method in interface com.google.cloud.dataflow.sdk.coders.CoderProvider: Provides a coder for a given class, if possible.
getCoder(TypeDescriptor<T>) - Method in class com.google.cloud.dataflow.sdk.coders.CoderRegistry: See CoderRegistry.getDefaultCoder(TypeDescriptor).
getCoder() - Method in class com.google.cloud.dataflow.sdk.coders.DelegateCoder: Returns the coder used to encode/decode the intermediate values produced/consumed by the coding functions of this DelegateCoder.
getCoder() - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read.Bound
getCoder() - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Write.Bound
getCoder() - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Write.Bound
getCoder() - Method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert.IterableAssert: Gets the coder, which may yet be absent.
getCoder() - Method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert.SingletonAssert: Gets the coder, which may yet be absent.
getCoder() - Static method in class com.google.cloud.dataflow.sdk.transforms.windowing.IntervalWindow: Returns a Coder suitable for IntervalWindow.
getCoder() - Method in class com.google.cloud.dataflow.sdk.values.PCollection: Returns the Coder used by this PCollection to encode and decode the values stored in it.
getCoder() - Method in class com.google.cloud.dataflow.sdk.values.TypedPValue: Returns the Coder used by this TypedPValue to encode and decode the values stored in it.
getCoderArguments() - Method in class com.google.cloud.dataflow.sdk.coders.AtomicCoder
getCoderArguments() - Method in class com.google.cloud.dataflow.sdk.coders.AvroCoder
getCoderArguments() - Method in interface com.google.cloud.dataflow.sdk.coders.Coder: If this is a Coder for a parameterized type, returns the list of Coders being used for each of the parameters, or returns null if this cannot be done or this is not a parameterized type.
getCoderArguments() - Method in class com.google.cloud.dataflow.sdk.coders.IterableLikeCoder
getCoderArguments() - Method in class com.google.cloud.dataflow.sdk.coders.KvCoder
getCoderArguments() - Method in class com.google.cloud.dataflow.sdk.coders.MapCoder
getCoderArguments() - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.ShardedKeyCoder
getCoderArguments() - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult.CoGbkResultCoder
getCoderArguments() - Method in class com.google.cloud.dataflow.sdk.util.TimerOrElement.TimerOrElementCoder
getCoderArguments() - Method in class com.google.cloud.dataflow.sdk.util.ValueWithRecordId.ValueWithRecordIdCoder
getCoderArguments() - Method in class com.google.cloud.dataflow.sdk.util.WindowedValue.FullWindowedValueCoder
getCoderArguments() - Method in class com.google.cloud.dataflow.sdk.util.WindowedValue.ValueOnlyWindowedValueCoder
getCoderArguments() - Method in class com.google.cloud.dataflow.sdk.values.TimestampedValue.TimestampedValueCoder
getCoderInternal() - Method in interface com.google.cloud.dataflow.sdk.values.PCollectionView: For internal use only.
getCoderRegistry() - Method in class com.google.cloud.dataflow.sdk.Pipeline: Returns the CoderRegistry that this Pipeline uses.
getCoGbkResultSchema() - Method in class com.google.cloud.dataflow.sdk.transforms.join.KeyedPCollectionTuple: Returns the CoGbkResultSchema associated with this KeyedPCollectionTuple.
getCollection() - Method in class com.google.cloud.dataflow.sdk.transforms.join.KeyedPCollectionTuple.TaggedKeyedPCollection: Returns the underlying PCollection of this TaggedKeyedPCollection.
getCombineFn() - Method in interface com.google.cloud.dataflow.sdk.transforms.Aggregator: Returns the Combine.CombineFn, which combines input elements in the aggregator.
getCombineFn() - Method in class com.google.cloud.dataflow.sdk.util.CounterAggregator
getComponents() - Method in class com.google.cloud.dataflow.sdk.coders.StandardCoder: Returns the list of Coders that are components of this Coder.
getComponents() - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult.CoGbkResultCoder
getComponents() - Method in class com.google.cloud.dataflow.sdk.util.WindowedValue.FullWindowedValueCoder
getComponentType() - Method in class com.google.cloud.dataflow.sdk.values.TypeDescriptor: Returns the component type if this type is an array type, otherwise returns null.
getCompressionType() - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Read.Bound
getCompressionTypeForAuto() - Method in class com.google.cloud.dataflow.sdk.runners.worker.FileBasedReader.FilenameBasedStreamFactory
getConfig(Windmill.GetConfigRequest) - Method in class com.google.cloud.dataflow.sdk.runners.worker.windmill.WindmillServerStub: Get configuration data from the server.
getContinuationTrigger(List<Trigger<W>>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterAll
getContinuationTrigger(List<Trigger<W>>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterEach
getContinuationTrigger(List<Trigger<W>>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterFirst
getContinuationTrigger(List<Trigger<W>>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterPane
getContinuationTrigger(List<Trigger<W>>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterProcessingTime
getContinuationTrigger(List<Trigger<W>>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.DefaultTrigger
getContinuationTrigger(List<Trigger<W>>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Repeatedly
getContinuationTrigger() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Trigger: Return a trigger to use after a GroupByKey to preserve the intention of this trigger.
getContinuationTrigger(List<Trigger<W>>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Trigger: Return the Trigger.getContinuationTrigger() of this Trigger.
getContinuationTrigger() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Trigger.OnceTrigger
getCount() - Method in interface com.google.cloud.dataflow.sdk.util.common.Counter.CounterMean: Gets the count of this CounterMean.
getCounter(String) - Method in class com.google.cloud.dataflow.sdk.transforms.Max.MaxDoubleFn
getCounter(String) - Method in class com.google.cloud.dataflow.sdk.transforms.Max.MaxIntegerFn
getCounter(String) - Method in class com.google.cloud.dataflow.sdk.transforms.Max.MaxLongFn
getCounter(String) - Method in class com.google.cloud.dataflow.sdk.transforms.Min.MinDoubleFn
getCounter(String) - Method in class com.google.cloud.dataflow.sdk.transforms.Min.MinIntegerFn
getCounter(String) - Method in class com.google.cloud.dataflow.sdk.transforms.Min.MinLongFn
getCounter(String) - Method in class com.google.cloud.dataflow.sdk.transforms.Sum.SumDoubleFn
getCounter(String) - Method in class com.google.cloud.dataflow.sdk.transforms.Sum.SumIntegerFn
getCounter(String) - Method in class com.google.cloud.dataflow.sdk.transforms.Sum.SumLongFn
getCounter(String) - Method in interface com.google.cloud.dataflow.sdk.util.common.CounterProvider
getCreateDisposition() - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.Bound: Returns the create disposition.
getCredential() - Method in interface com.google.cloud.dataflow.sdk.util.CredentialFactory
getCredential(GcpOptions) - Static method in class com.google.cloud.dataflow.sdk.util.Credentials: Initializes OAuth2 credentials.
getCredential() - Method in class com.google.cloud.dataflow.sdk.util.GcpCredentialFactory
getCredential() - Method in class com.google.cloud.dataflow.sdk.util.NoopCredentialFactory
getCredentialDir() - Method in interface com.google.cloud.dataflow.sdk.options.GcpOptions: Directory for storing dataflow credentials after execution of the OAuth 2 webflow.
getCredentialFactoryClass() - Method in interface com.google.cloud.dataflow.sdk.options.GcpOptions: The class of the credential factory that should be created and used to create credentials.
getCredentialId() - Method in interface com.google.cloud.dataflow.sdk.options.GcpOptions: This option controls which credential store to use when creating the credentials using the OAuth 2 webflow.
getCurrent() - Method in class com.google.cloud.dataflow.sdk.io.BlockBasedSource.BlockBasedReader
getCurrent() - Method in class com.google.cloud.dataflow.sdk.io.CompressedSource.CompressedReader: Gets the current record from the delegate reader.
getCurrent() - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.DatastoreReader
getCurrent() - Method in class com.google.cloud.dataflow.sdk.io.Source.Reader: Returns the value of the data item that was read by the last Source.Reader.start() or Source.Reader.advance() call.
getCurrent() - Method in class com.google.cloud.dataflow.sdk.runners.TransformHierarchy: Returns the last TransformTreeNode on the stack.
getCurrentBlock() - Method in class com.google.cloud.dataflow.sdk.io.AvroSource.AvroReader
getCurrentBlock() - Method in class com.google.cloud.dataflow.sdk.io.BlockBasedSource.BlockBasedReader: Returns the current block (the block that was read by the previous call to BlockBasedSource.BlockBasedReader.readNextBlock()).
getCurrentBlockOffset() - Method in class com.google.cloud.dataflow.sdk.io.AvroSource.AvroReader
getCurrentBlockOffset() - Method in class com.google.cloud.dataflow.sdk.io.BlockBasedSource.BlockBasedReader: Returns the largest offset such that starting to read from that offset includes the current block.
getCurrentBlockSize() - Method in class com.google.cloud.dataflow.sdk.io.AvroSource.AvroReader
getCurrentBlockSize() - Method in class com.google.cloud.dataflow.sdk.io.BlockBasedSource.BlockBasedReader: Returns the size of the current block in bytes as it is represented in the underlying file, if possible.
getCurrentOffset() - Method in class com.google.cloud.dataflow.sdk.io.BlockBasedSource.BlockBasedReader
getCurrentOffset() - Method in class com.google.cloud.dataflow.sdk.io.CompressedSource.CompressedReader: Returns the delegate reader's current offset in the decompressed input.
getCurrentOffset() - Method in class com.google.cloud.dataflow.sdk.io.OffsetBasedSource.OffsetBasedReader: Returns the starting offset of the current record, which has been read by the last successful Source.Reader.start() or Source.Reader.advance() call.
getCurrentRecord() - Method in class com.google.cloud.dataflow.sdk.io.BlockBasedSource.Block: Returns the current record.
getCurrentRecordId() - Method in class com.google.cloud.dataflow.sdk.io.UnboundedSource.UnboundedReader: Returns a unique identifier for the current record.
getCurrentSource() - Method in class com.google.cloud.dataflow.sdk.io.AvroSource.AvroReader
getCurrentSource() - Method in class com.google.cloud.dataflow.sdk.io.BoundedSource.BoundedReader
getCurrentSource() - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.DatastoreReader
getCurrentSource() - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSource.FileBasedReader
getCurrentSource() - Method in class com.google.cloud.dataflow.sdk.io.OffsetBasedSource.OffsetBasedReader
getCurrentSource() - Method in class com.google.cloud.dataflow.sdk.io.Source.Reader: Returns a Source describing the same input that this Reader reads (including items already read).
getCurrentSource() - Method in class com.google.cloud.dataflow.sdk.io.UnboundedSource.UnboundedReader: Returns the UnboundedSource that created this reader.
getCurrentTimestamp() - Method in class com.google.cloud.dataflow.sdk.io.BoundedSource.BoundedReader: By default, returns the minimum possible timestamp.
getCurrentTimestamp() - Method in class com.google.cloud.dataflow.sdk.io.Source.Reader: Returns the timestamp associated with the current data item.
getData(Windmill.GetDataRequest) - Method in class com.google.cloud.dataflow.sdk.runners.worker.windmill.WindmillServerStub: Get addition data such as state needed to process work.
getDataflowClient() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions: An instance of the Dataflow client.
getDataflowClient() - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineJob
getDataflowEndpoint() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions: Dataflow endpoint to use.
getDataflowJobFile() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions: The path to write the translated Dataflow job specification out to at job submission time.
getDatasetId() - Method in class com.google.cloud.dataflow.sdk.runners.worker.ApplianceShuffleReader
getDatasetId() - Method in class com.google.cloud.dataflow.sdk.runners.worker.ApplianceShuffleWriter
getDayOfMonth() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.MonthsWindows
getDayOfMonth() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.YearsWindows
getDefaultCoder(TypeDescriptor<T>) - Method in class com.google.cloud.dataflow.sdk.coders.CoderRegistry: Returns the Coder to use by default for values of the given type.
getDefaultCoder(TypeDescriptor<OutputT>, TypeDescriptor<InputT>, Coder<InputT>) - Method in class com.google.cloud.dataflow.sdk.coders.CoderRegistry: Returns the Coder to use by default for values of the given type, where the given context type uses the given context coder.
getDefaultCoder(Class<? extends T>, Class<T>, Map<Type, ? extends Coder<?>>, TypeVariable<?>) - Method in class com.google.cloud.dataflow.sdk.coders.CoderRegistry: Returns the Coder to use for the specified type parameter specialization of the subclass, given Coders to use for all other type parameters (if any).
getDefaultCoder(T) - Method in class com.google.cloud.dataflow.sdk.coders.CoderRegistry: Returns the Coder to use for the provided example value, if it can be determined.
getDefaultCoder(Class<T>) - Method in class com.google.cloud.dataflow.sdk.coders.CoderRegistry: Returns the Coder to use by default for values of the given class.
getDefaultCoders(Class<? extends T>, Class<T>, Map<Type, ? extends Coder<?>>) - Method in class com.google.cloud.dataflow.sdk.coders.CoderRegistry: Returns a Map from each of baseClass's type parameters to the Coder to use by default for it, in the context of subClass's specialization of baseClass.
getDefaultOutputCoder(SerializableFunction<InputT, OutputT>, Coder<InputT>) - Method in class com.google.cloud.dataflow.sdk.coders.CoderRegistry: Returns the Coder to use on elements produced by this function, given the coder used for its input elements.
getDefaultOutputCoder() - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Read.Bound
getDefaultOutputCoder() - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound
getDefaultOutputCoder() - Method in class com.google.cloud.dataflow.sdk.io.AvroSource
getDefaultOutputCoder() - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Read.Bound
getDefaultOutputCoder() - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.Bound
getDefaultOutputCoder() - Method in class com.google.cloud.dataflow.sdk.io.CompressedSource: Returns the delegate source's default output coder.
getDefaultOutputCoder() - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.Source
getDefaultOutputCoder() - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read.Bound
getDefaultOutputCoder() - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Write.Bound
getDefaultOutputCoder() - Method in class com.google.cloud.dataflow.sdk.io.Read.Bounded
getDefaultOutputCoder() - Method in class com.google.cloud.dataflow.sdk.io.Read.Unbounded
getDefaultOutputCoder() - Method in class com.google.cloud.dataflow.sdk.io.Source: Returns the default Coder to use for the data read from this source.
getDefaultOutputCoder() - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Read.Bound
getDefaultOutputCoder() - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Write.Bound
getDefaultOutputCoder() - Method in class com.google.cloud.dataflow.sdk.io.XmlSource
getDefaultOutputCoder(CoderRegistry, Coder<Double>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineDoubleFn
getDefaultOutputCoder(CoderRegistry, Coder<V>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineFn
getDefaultOutputCoder(CoderRegistry, Coder<Integer>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineIntegerFn
getDefaultOutputCoder(CoderRegistry, Coder<Long>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineLongFn
getDefaultOutputCoder(CoderRegistry, Coder<InputT>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.CombineFn: Returns the Coder to use by default for output OutputT values, or null if it is not able to be inferred.
getDefaultOutputCoder(PCollection<? extends KV<K, ? extends Iterable<InputT>>>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.GroupedValues
getDefaultOutputCoder(CoderRegistry, Coder<K>, Coder<InputT>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.KeyedCombineFn: Returns the Coder to use by default for output OutputT values, or null if it is not able to be inferred.
getDefaultOutputCoder(PInput) - Method in class com.google.cloud.dataflow.sdk.transforms.Create.Values
getDefaultOutputCoder(PCollectionList<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.Flatten.FlattenPCollectionList
getDefaultOutputCoder(PCollection<KV<K, V>>) - Method in class com.google.cloud.dataflow.sdk.transforms.GroupByKey
getDefaultOutputCoder(PCollection<KV<K, V>>) - Method in class com.google.cloud.dataflow.sdk.transforms.GroupByKey.GroupByKeyOnly
getDefaultOutputCoder(PCollection<? extends InputT>) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.Bound
getDefaultOutputCoder() - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.BoundMulti
getDefaultOutputCoder(PCollection<? extends InputT>, TypedPValue<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.BoundMulti
getDefaultOutputCoder() - Method in class com.google.cloud.dataflow.sdk.transforms.PTransform: Returns the default Coder to use for the output of this single-output PTransform.
getDefaultOutputCoder(InputT) - Method in class com.google.cloud.dataflow.sdk.transforms.PTransform: Returns the default Coder to use for the output of this single-output PTransform when applied to the given input.
getDefaultOutputCoder(InputT, TypedPValue<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.PTransform: Returns the default Coder to use for the given output of this single-output PTransform when applied to the given input.
getDefaultOutputCoder(CoderRegistry, Coder<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.Sample.FixedSizedSampleFn
getDefaultOutputCoder(CoderRegistry, Coder<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.View.Concatenate
getDefaultOutputCoder(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window.Bound
getDefaultWorkerLogLevel() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowWorkerLoggingOptions: This option controls the default log level of all loggers without a log level override.
getDictionary(Map<String, Object>, String) - Static method in class com.google.cloud.dataflow.sdk.util.Structs
getDictionary(Map<String, Object>, String, Map<String, Object>) - Static method in class com.google.cloud.dataflow.sdk.util.Structs
getDirectPipelineRunnerRandomSeed() - Method in interface com.google.cloud.dataflow.sdk.options.DirectPipelineOptions: The random seed to use for pseudorandom behaviors in the DirectPipelineRunner.
getDiskSizeGb() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions: Remote worker disk size, in gigabytes, or 0 to use the default size.
getDiskSourceImage() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions: Disk source image to use by VMs for jobs.
getDoFn() - Method in class com.google.cloud.dataflow.sdk.util.DoFnInfo
getDoFnClass(DoFn<?, ?>) - Static method in class com.google.cloud.dataflow.sdk.transforms.DoFnReflector
getDoFnInfo() - Method in class com.google.cloud.dataflow.sdk.runners.worker.ParDoFnBase: Creates a fresh DoFnInfo.
getDomain() - Method in class com.google.cloud.dataflow.sdk.util.TimerInternals.TimerData
getDynamicSplitResultToReport() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.WorkProgressUpdater
getElemCoder() - Method in class com.google.cloud.dataflow.sdk.coders.IterableLikeCoder
getElementCoder() - Method in class com.google.cloud.dataflow.sdk.util.TimerOrElement.TimerOrElementCoder
getElements() - Method in class com.google.cloud.dataflow.sdk.transforms.Create.Values
getEnableCloudDebugger() - Method in interface com.google.cloud.dataflow.sdk.options.CloudDebuggerOptions: Whether to enable the Cloud Debugger snapshot agent for the current job.
getEnclosingNode() - Method in class com.google.cloud.dataflow.sdk.runners.TransformTreeNode: Returns the enclosing composite transform node, or null if there is none.
getEncodedBytes() - Method in class com.google.cloud.dataflow.sdk.runners.worker.OrderedCode: Returns the encoded bytes that represent the current state of the OrderedCode.
getEncodedElementByteSize(Integer, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.BigEndianIntegerCoder
getEncodedElementByteSize(Long, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.BigEndianLongCoder
getEncodedElementByteSize(byte[], Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.ByteArrayCoder
getEncodedElementByteSize(Double, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.DoubleCoder
getEncodedElementByteSize(DatastoreV1.Entity, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.EntityCoder
getEncodedElementByteSize(T, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.StandardCoder: Returns the size in bytes of the encoded value using this coder.
getEncodedElementByteSize(String, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.StringUtf8Coder
getEncodedElementByteSize(TableRow, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.TableRowJsonCoder
getEncodedElementByteSize(Integer, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.TextualIntegerCoder
getEncodedElementByteSize(Integer, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.VarIntCoder
getEncodedElementByteSize(Long, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.VarLongCoder
getEncodedElementByteSize(Void, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.VoidCoder
getEncodingId() - Method in class com.google.cloud.dataflow.sdk.coders.AvroCoder: The encoding identifier is designed to support evolution as per the design of Avro In order to use this class effectively, carefully read the Avro documentation at Schema Resolution to ensure that the old and new schema match.
getEncodingId() - Method in interface com.google.cloud.dataflow.sdk.coders.Coder: An identifier for the binary format written by Coder.encode(T, java.io.OutputStream, com.google.cloud.dataflow.sdk.coders.Coder.Context).
getEncodingId() - Method in class com.google.cloud.dataflow.sdk.coders.CustomCoder
getEncodingId() - Method in class com.google.cloud.dataflow.sdk.coders.DelegateCoder: The encoding id for the binary format of the delegate coder is a combination of the underlying coder class and its encoding id.
getEncodingId() - Method in class com.google.cloud.dataflow.sdk.coders.JAXBCoder
getEncodingId() - Method in class com.google.cloud.dataflow.sdk.coders.Proto2Coder: The encoding identifier is designed to support evolution as per the design of Protocol Buffers.
getEncodingId() - Method in class com.google.cloud.dataflow.sdk.coders.SerializableCoder
getEncodingId() - Method in class com.google.cloud.dataflow.sdk.coders.StandardCoder: A unique identifier for the binary format written by Coder.encode(T, java.io.OutputStream, com.google.cloud.dataflow.sdk.coders.Coder.Context).
getEncodingId() - Method in class com.google.cloud.dataflow.sdk.coders.StringDelegateCoder: The encoding id is the fully qualified name of the encoded/decoded class.
getEndOffset() - Method in class com.google.cloud.dataflow.sdk.io.OffsetBasedSource: Returns the specified ending offset of the source.
getEstimatedSizeBytes(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.BoundedSource: An estimate of the total size (in bytes) of the data that would be read from this source.
getEstimatedSizeBytes(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.Source
getEstimatedSizeBytes(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSource
getEstimatedSizeBytes(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.OffsetBasedSource
getExecutionContext() - Method in class com.google.cloud.dataflow.sdk.runners.worker.ParDoFnBase
getExecutionContext() - Method in class com.google.cloud.dataflow.sdk.util.BaseExecutionContext.StepContext
getExecutionContext() - Method in interface com.google.cloud.dataflow.sdk.util.ExecutionContext.StepContext: The context in which this step is executing.
getExecutorService() - Method in interface com.google.cloud.dataflow.sdk.options.GcsOptions: The ExecutorService instance to use to create threads, can be overridden to specify an ExecutorService that is compatible with the users environment.
getExistingCounter(String) - Method in class com.google.cloud.dataflow.sdk.util.common.CounterSet: Returns the Counter with the given name in this CounterSet; returns null if no such Counter exists.
getExpandedOutputs() - Method in class com.google.cloud.dataflow.sdk.runners.TransformTreeNode: Returns the transform outputs, in expanded form.
getExperiments() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions: The list of backend experiments to enable.
getExposedClasses() - Method in class com.google.cloud.dataflow.sdk.util.ApiSurface: Returns exposed types in this set, including arrays and primitives as specified.
getFactory(String) - Static method in class com.google.cloud.dataflow.sdk.util.IOChannelUtils: Returns the IOChannelFactory associated with an input specification.
getFallbackCoderProvider() - Method in class com.google.cloud.dataflow.sdk.coders.CoderRegistry
getFilename() - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSink.FileResult
getFileName() - Method in class com.google.cloud.dataflow.sdk.util.gcsfs.GcsPath
getFilenamePrefix() - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound
getFilenamePrefix() - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Write.Bound
getFilenameSuffix() - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound
getFilenameSuffix() - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Write.Bound
getFileOrPatternSpec() - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSource
getFilepattern() - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Read.Bound
getFilepattern() - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Read.Bound
getFilesToStage() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions: List of local files to make available to workers.
getFileSystem() - Method in class com.google.cloud.dataflow.sdk.util.gcsfs.GcsPath
getFinishedMergingWindows() - Method in interface com.google.cloud.dataflow.sdk.transforms.windowing.Trigger.MergingTriggerInfo: Return the merging windows in which the trigger is finished.
getFirstIndexAfterSubtree() - Method in class com.google.cloud.dataflow.sdk.util.ExecutableTrigger
getFn() - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.GroupedValues: Returns the KeyedCombineFn used by this Combine operation.
getFn() - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.PerKey: Returns the KeyedCombineFn used by this Combine operation.
getFn() - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.Bound
getFn() - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.BoundMulti
getFn() - Method in class com.google.cloud.dataflow.sdk.util.AppliedCombineFn
getFractionConsumed() - Method in class com.google.cloud.dataflow.sdk.io.BlockBasedSource.BlockBasedReader
getFractionConsumed() - Method in class com.google.cloud.dataflow.sdk.io.BoundedSource.BoundedReader: Returns a value in [0, 1] representing approximately what fraction of the source (BoundedSource.BoundedReader.getCurrentSource()) this reader has read so far.
getFractionConsumed() - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.DatastoreReader
getFractionConsumed() - Method in class com.google.cloud.dataflow.sdk.io.OffsetBasedSource.OffsetBasedReader
getFractionConsumed() - Method in class com.google.cloud.dataflow.sdk.io.range.OffsetRangeTracker
getFractionConsumed() - Method in interface com.google.cloud.dataflow.sdk.io.range.RangeTracker: Returns the approximate fraction of positions in the source that have been consumed by successful RangeTracker.tryReturnRecordAt(boolean, PositionT) calls, or 0.0 if no such calls have happened.
getFractionConsumed() - Method in class com.google.cloud.dataflow.sdk.runners.worker.GroupingShuffleRangeTracker
getFractionOfBlockConsumed() - Method in class com.google.cloud.dataflow.sdk.io.BlockBasedSource.Block: Returns the fraction of the block already consumed (i.e., not including the current record), if possible, as a value in [0, 1].
getFullCoder(Coder<T>, Coder<? extends BoundedWindow>) - Static method in class com.google.cloud.dataflow.sdk.util.WindowedValue: Returns the Coder to use for a WindowedValue<T>, using the given valueCoder and windowCoder.
getFullName(PTransform<?, ?>) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Returns the full name of the currently being translated transform.
getFullName() - Method in class com.google.cloud.dataflow.sdk.runners.TransformTreeNode
getFullName() - Method in class com.google.cloud.dataflow.sdk.transforms.AppliedPTransform
getFullNameForTesting(PTransform<?, ?>) - Method in class com.google.cloud.dataflow.sdk.Pipeline: Deprecated.
getGapDuration() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Sessions
getGcloudCancelCommand(DataflowPipelineOptions, String) - Static method in class com.google.cloud.dataflow.sdk.util.MonitoringUtil
getGcpCredential() - Method in interface com.google.cloud.dataflow.sdk.options.GcpOptions: The credential instance that should be used to authenticate against GCP services.
getGcsEndpoint() - Method in interface com.google.cloud.dataflow.sdk.options.GcsOptions: GCS endpoint to use.
getGcsUtil() - Method in interface com.google.cloud.dataflow.sdk.options.GcsOptions: The GcsUtil instance that should be used to communicate with Google Cloud Storage.
getGoogleApiTrace() - Method in interface com.google.cloud.dataflow.sdk.options.GoogleApiDebugOptions: This option enables tracing of API calls to Google services used within the Dataflow SDK.
getGroupingTableBytes() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.PartialGroupByKeyOperation: Returns the amount of memory the grouping table currently consumes.
getId() - Method in interface com.google.cloud.dataflow.sdk.util.state.StateTag: Returns the identifier for this state cell.
getId() - Method in class com.google.cloud.dataflow.sdk.util.ValueWithRecordId
getId() - Method in class com.google.cloud.dataflow.sdk.values.TupleTag: Returns the id of this TupleTag.
getIdLabel() - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read.Bound
getIdLabel() - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Write.Bound
getIndex(TupleTag<?>) - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResultSchema: Returns the index for the given tuple tag, if the tag is present in this schema, -1 if it isn't.
getIndex() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.PaneInfo: The zero-based index of this trigger firing that produced this pane.
getInput(PTransform<InputT, ?>) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Returns the input of the currently being translated transform.
getInput(PTransform<InputT, ?>) - Method in interface com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.EvaluationContext: Returns the input of the currently being processed transform.
getInput() - Method in class com.google.cloud.dataflow.sdk.runners.TransformTreeNode: Returns the transform input, in unexpanded form.
getInput() - Method in class com.google.cloud.dataflow.sdk.transforms.AppliedPTransform
getInputCoder() - Method in class com.google.cloud.dataflow.sdk.util.DoFnInfo
getInputs() - Method in class com.google.cloud.dataflow.sdk.runners.TransformTreeNode: Returns a mapping of inputs to the producing nodes for all inputs to the transform.
getInputTypeDescriptor() - Method in class com.google.cloud.dataflow.sdk.transforms.DoFn: Returns a TypeDescriptor capturing what is known statically about the input type of this DoFn instance's most-derived class.
getInputTypeDescriptor() - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnWithContext: Returns a TypeDescriptor capturing what is known statically about the input type of this DoFnWithContext instance's most-derived class.
getInputTypeDescriptor() - Method in class com.google.cloud.dataflow.sdk.transforms.IntraBundleParallelization.MultiThreadedIntraBundleProcessingDoFn
getInstanceComponents(T) - Static method in class com.google.cloud.dataflow.sdk.coders.AtomicCoder: Returns a list of values contained in the provided example value, one per type parameter.
getInstanceComponents(Object) - Method in interface com.google.cloud.dataflow.sdk.coders.CoderFactory: Returns a list of objects contained in value, one per type argument, or null if none can be determined.
getInstanceComponents(Collection<T>) - Static method in class com.google.cloud.dataflow.sdk.coders.CollectionCoder: Returns the first element in this collection if it is non-empty, otherwise returns null.
getInstanceComponents(Iterable<T>) - Static method in class com.google.cloud.dataflow.sdk.coders.IterableCoder: Returns the first element in this iterable if it is non-empty, otherwise returns null.
getInstanceComponents(KV<K, V>) - Static method in class com.google.cloud.dataflow.sdk.coders.KvCoder
getInstanceComponents(List<T>) - Static method in class com.google.cloud.dataflow.sdk.coders.ListCoder: Returns the first element in this list if it is non-empty, otherwise returns null.
getInstanceComponents(Map<K, V>) - Static method in class com.google.cloud.dataflow.sdk.coders.MapCoder: Returns the key and value for an arbitrary element of this map, if it is non-empty, otherwise returns null.
getInstanceComponents(Set<T>) - Static method in class com.google.cloud.dataflow.sdk.coders.SetCoder: Returns the first element in this set if it is non-empty, otherwise returns null.
getInstanceComponents(TimestampedValue<T>) - Static method in class com.google.cloud.dataflow.sdk.values.TimestampedValue.TimestampedValueCoder
getInstanceComponentsHelper(IterableT) - Static method in class com.google.cloud.dataflow.sdk.coders.IterableLikeCoder: Returns the first element in this iterable-like if it is non-empty, otherwise returns null.
getInterfaces() - Method in class com.google.cloud.dataflow.sdk.values.TypeDescriptor: Returns a set of TypeDescriptors, one for each interface implemented by this class.
getIsLazy() - Method in class com.google.cloud.dataflow.sdk.util.common.ElementByteSizeObserver: Returns whether byte counting for the current element is lazy, that is, whether the observer gets notified of the element's byte count only as element's pieces are being processed or iterated over.
getJAXBClass() - Method in class com.google.cloud.dataflow.sdk.coders.JAXBCoder
getJob() - Method in exception com.google.cloud.dataflow.sdk.runners.DataflowJobException: Returns the failed job.
getJob() - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.JobSpecification
getJobId() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowWorkerHarnessOptions: The identity of the Dataflow job.
getJobId() - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineJob
getJobId() - Static method in class com.google.cloud.dataflow.sdk.runners.worker.logging.DataflowWorkerLoggingMDC: Gets the Job ID of the current thread.
getJobMessageOutput() - Method in interface com.google.cloud.dataflow.sdk.options.BlockingDataflowPipelineOptions: Output stream for job status messages.
getJobMessages(String, long) - Method in class com.google.cloud.dataflow.sdk.util.MonitoringUtil: Return job messages sorted in ascending order by timestamp.
getJobMonitoringPageURL(String, String) - Static method in class com.google.cloud.dataflow.sdk.util.MonitoringUtil
getJobName() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineOptions: The Dataflow job name is used as an idempotence key within the Dataflow service.
getJsonFactory() - Static method in class com.google.cloud.dataflow.sdk.util.Transport
getKey() - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.ValueWithMetadata: Returns the key associated with this element.
getKey() - Method in class com.google.cloud.dataflow.sdk.util.BatchModeExecutionContext: Returns the key of the work currently being processed.
getKey() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.ShuffleEntry
getKey() - Method in class com.google.cloud.dataflow.sdk.values.KV: Returns the key of this KV.
getKeyCoder() - Method in class com.google.cloud.dataflow.sdk.coders.KvCoder
getKeyCoder() - Method in class com.google.cloud.dataflow.sdk.coders.MapCoder
getKeyCoder() - Method in class com.google.cloud.dataflow.sdk.transforms.join.KeyedPCollectionTuple: Returns the key Coder for all PCollections in this KeyedPCollectionTuple.
getKeyedCollections() - Method in class com.google.cloud.dataflow.sdk.transforms.join.KeyedPCollectionTuple: Returns a list of TaggedKeyedPCollections for the PCollections contained in this KeyedPCollectionTuple.
getKeyFromInputPair(Object) - Method in class com.google.cloud.dataflow.sdk.runners.worker.MapTaskExecutorFactory.PairInfo
getKeyFromInputPair(Object) - Method in interface com.google.cloud.dataflow.sdk.util.common.worker.PartialGroupByKeyOperation.PairInfo
getKind() - Method in class com.google.cloud.dataflow.sdk.util.common.Counter: Returns the counter's aggregation kind.
getKindString() - Method in class com.google.cloud.dataflow.sdk.io.Read.Bounded
getKindString() - Method in class com.google.cloud.dataflow.sdk.io.Read.Unbounded
getKindString() - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineRunner.StreamingPubsubIOWrite
getKindString() - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.Bound
getKindString() - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.BoundMulti
getKindString() - Method in class com.google.cloud.dataflow.sdk.transforms.PTransform: Returns the name to use by default for this PTransform (not including the names of any enclosing PTransforms).
getKindString() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window.Bound
getKindString() - Method in class com.google.cloud.dataflow.sdk.values.PValueBase: Returns a String capturing the kind of this PValueBase.
getLastGroupStart() - Method in class com.google.cloud.dataflow.sdk.runners.worker.GroupingShuffleRangeTracker
getLeaseRenewalLatencyMargin() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.WorkProgressUpdater: Returns the maximum allowed time between a periodic progress update and the moment the current lease expires.
getLength(int) - Static method in class com.google.cloud.dataflow.sdk.util.VarInt: Returns the length of the encoding of the given value (in bytes).
getLength(long) - Static method in class com.google.cloud.dataflow.sdk.util.VarInt: Returns the length of the encoding of the given value (in bytes).
getLevenshteinDistance(String, String) - Static method in class com.google.cloud.dataflow.sdk.util.StringUtils: Calculate the Levenshtein distance between two strings.
getListOfMaps(Map<String, Object>, String, List<Map<String, Object>>) - Static method in class com.google.cloud.dataflow.sdk.util.Structs
getLong(Map<String, Object>, String) - Static method in class com.google.cloud.dataflow.sdk.util.Structs
getLong(Map<String, Object>, String, Long) - Static method in class com.google.cloud.dataflow.sdk.util.Structs
getMainOutputTag() - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.BoundMulti
getMaxEndOffset(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSource
getMaxEndOffset(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.OffsetBasedSource: Returns the exact ending offset of the current source.
getMaxNumRecords() - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read.Bound
getMaxNumWorkers() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions: The maximum number of workers to use when using workerpool autoscaling.
getMaxReadTime() - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read.Bound
getMaxReportingInterval() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.WorkProgressUpdater: Returns the maximum allowed time between two periodic progress updates.
getMean() - Method in class com.google.cloud.dataflow.sdk.util.common.Counter: Returns the mean in the form of a CounterMean, or null if this is not a MEAN counter.
getMeanByteCount() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.OutputObjectAndByteCounter
getMessage() - Method in class com.google.cloud.dataflow.sdk.coders.Coder.NonDeterministicException
getMinBundleSize() - Method in class com.google.cloud.dataflow.sdk.io.OffsetBasedSource: Returns the minimum bundle size that should be used when splitting the source into sub-sources.
getMinReportingInterval() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.WorkProgressUpdater: Returns the minimum allowed time between two periodic progress updates.
getMode() - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSource
getMode() - Method in class com.google.cloud.dataflow.sdk.util.WindowingStrategy
getMonthOfYear() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.YearsWindows
getName() - Method in interface com.google.cloud.dataflow.sdk.transforms.Aggregator: Returns the name of the Aggregator.
getName() - Method in class com.google.cloud.dataflow.sdk.transforms.PTransform: Returns the transform name.
getName() - Method in class com.google.cloud.dataflow.sdk.util.common.Counter: Returns the counter's name.
getName() - Method in class com.google.cloud.dataflow.sdk.util.common.Metric
getName() - Method in class com.google.cloud.dataflow.sdk.util.CounterAggregator
getName() - Method in class com.google.cloud.dataflow.sdk.util.DataflowReleaseInfo: Provides the SDK name.
getName(int) - Method in class com.google.cloud.dataflow.sdk.util.gcsfs.GcsPath
getName() - Method in class com.google.cloud.dataflow.sdk.values.PCollection: Returns the name of this PCollection.
getName() - Method in interface com.google.cloud.dataflow.sdk.values.PValue: Returns the name of this PValue.
getName() - Method in class com.google.cloud.dataflow.sdk.values.PValueBase: Returns the name of this PValueBase.
getNameCount() - Method in class com.google.cloud.dataflow.sdk.util.gcsfs.GcsPath
getNamespace() - Method in class com.google.cloud.dataflow.sdk.util.TimerInternals.TimerData
getNamespacesInUse() - Method in class com.google.cloud.dataflow.sdk.util.state.StateTable
getNetwork() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions: GCE network for launching workers.
getNewValue() - Method in exception com.google.cloud.dataflow.sdk.util.IllegalMutationException: The value after the illegal mutation.
getNextPaneInfo(ReduceFn<?, ?, ?, ?>.Context, boolean, boolean) - Method in class com.google.cloud.dataflow.sdk.util.PaneInfoTracker
getNonSpeculativeIndex() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.PaneInfo: The zero-based index of this trigger firing among non-speculative panes, i.e.
getNumber() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.DaysWindows
getNumber() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.MonthsWindows
getNumber() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.YearsWindows
getNumShards() - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound
getNumShards() - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Write.Bound
getNumShards() - Method in class com.google.cloud.dataflow.sdk.util.ShardingWritableByteChannel: Returns the number of output shards.
getNumWorkers() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions: Number of workers to use when executing the Dataflow job.
getObject() - Method in class com.google.cloud.dataflow.sdk.util.gcsfs.GcsPath: Returns the object name associated with this GCS path, or an empty string if no object is specified.
getObject(Map<String, Object>, String) - Static method in class com.google.cloud.dataflow.sdk.util.Structs
getObject(Map<String, Object>, String, Map<String, Object>) - Static method in class com.google.cloud.dataflow.sdk.util.Structs
getObjectCount() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.OutputObjectAndByteCounter
getOffset() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.FixedWindows
getOffset() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.SlidingWindows
getOnly(TupleTag<V>) - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult: If there is a singleton value for the given tag, returns it.
getOnly(TupleTag<V>, V) - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult: If there is a singleton value for the given tag, returns it.
getOnlyReceiver() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.OutputReceiver: Invoked by tests only.
getOptions() - Method in class com.google.cloud.dataflow.sdk.Pipeline: Returns the configured pipeline options.
getOrCreateTable(BigQueryIO.Write.WriteDisposition, BigQueryIO.Write.CreateDisposition, TableSchema) - Method in class com.google.cloud.dataflow.sdk.util.BigQueryTableInserter: Retrieves or creates the table.
getOriginalWindowFn() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.InvalidWindows: Returns the original windowFn that this InvalidWindows replaced.
getOutName(int) - Method in class com.google.cloud.dataflow.sdk.values.TupleTag: If this TupleTag is tagging output outputIndex of a PTransform, returns the name that should be used by default for the output.
getOutput(PTransform<?, OutputT>) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Returns the output of the currently being translated transform.
getOutput(PTransform<?, OutputT>) - Method in interface com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.EvaluationContext: Returns the output of the currently being processed transform.
getOutput() - Method in class com.google.cloud.dataflow.sdk.runners.TransformTreeNode: Returns the transform output, in unexpanded form.
getOutput() - Method in class com.google.cloud.dataflow.sdk.transforms.AppliedPTransform
getOutput(TupleTag<T>) - Method in class com.google.cloud.dataflow.sdk.util.DirectModeExecutionContext
getOutput(TupleTag<T>) - Method in class com.google.cloud.dataflow.sdk.util.DoFnRunner.ListOutputManager
getOutputBuilder() - Method in class com.google.cloud.dataflow.sdk.util.StreamingModeExecutionContext
getOutputCounters() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.WorkExecutor: Returns the set of output counters for this task.
getOutputMetrics() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.WorkExecutor: Returns a collection of output metrics for this task.
getOutputTime(Instant, GlobalWindow) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.GlobalWindows
getOutputTime(Instant, W) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.InvalidWindows
getOutputTime(Instant, W) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.PartitioningWindowFn
getOutputTime(Instant, IntervalWindow) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Sessions
getOutputTime(Instant, IntervalWindow) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.SlidingWindows: Ensure that later sliding windows have an output time that is past the end of earlier windows.
getOutputTime(Instant, W) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.WindowFn: Returns the output timestamp to use for data depending on the given inputTimestamp in the specified window.
getOutputType() - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.CombineFn: Returns a TypeDescriptor capturing what is known statically about the output type of this CombineFn instance's most-derived class.
getOutputTypeDescriptor() - Method in class com.google.cloud.dataflow.sdk.transforms.DoFn: Returns a TypeDescriptor capturing what is known statically about the output type of this DoFn instance's most-derived class.
getOutputTypeDescriptor() - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnWithContext: Returns a TypeDescriptor capturing what is known statically about the output type of this DoFnWithContext instance's most-derived class.
getOutputTypeDescriptor() - Method in class com.google.cloud.dataflow.sdk.transforms.IntraBundleParallelization.MultiThreadedIntraBundleProcessingDoFn
getOverriddenTransform() - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineRunner.StreamingPubsubIOWrite
getOverrideWindmillBinary() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions: Custom windmill_main binary to use with the streaming runner.
getPane() - Method in class com.google.cloud.dataflow.sdk.util.WindowedValue: Returns the pane of this WindowedValue in its window.
getParent() - Method in class com.google.cloud.dataflow.sdk.util.gcsfs.GcsPath: Returns the parent path, or null if this path does not have a parent.
getPathValidator() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions: The path validator instance that should be created and used to validate paths.
getPathValidatorClass() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions: The class of the validator that should be created and used to validate paths.
getPCollection(PCollection<T>) - Method in interface com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.EvaluationResults: Retrieves the value of the given PCollection.
getPCollectionList(PCollectionList<T>) - Method in interface com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.EvaluationResults: Retrieves the values of each PCollection in the given PCollectionList.
getPCollectionValuesWithMetadata(PCollection<T>) - Method in interface com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.EvaluationContext: Retrieves the value of the given PCollection, along with element metadata such as timestamps and windows.
getPCollectionView(PCollectionView<T>) - Method in interface com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.EvaluationResults: Retrieves the values indicated by the given PCollectionView.
getPCollectionWindowedValues(PCollection<T>) - Method in interface com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.EvaluationResults: Retrieves the windowed value of the given PCollection.
getPeriod() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.SlidingWindows
getPipeline() - Method in class com.google.cloud.dataflow.sdk.transforms.join.KeyedPCollectionTuple
getPipeline() - Method in class com.google.cloud.dataflow.sdk.values.PBegin
getPipeline() - Method in class com.google.cloud.dataflow.sdk.values.PCollectionList
getPipeline() - Method in class com.google.cloud.dataflow.sdk.values.PCollectionTuple
getPipeline() - Method in interface com.google.cloud.dataflow.sdk.values.PInput: Returns the owning Pipeline of this PInput.
getPipeline() - Method in interface com.google.cloud.dataflow.sdk.values.POutput: Returns the owning Pipeline of this POutput.
getPipeline() - Method in class com.google.cloud.dataflow.sdk.values.POutputValueBase
getPipelineOptions() - Method in interface com.google.cloud.dataflow.sdk.options.PipelineOptionsRegistrar
getPipelineOptions() - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineRegistrar.Options
getPipelineOptions() - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Returns the configured pipeline options.
getPipelineOptions() - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRegistrar.Options
getPipelineOptions() - Method in interface com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.EvaluationContext: Returns the configured pipeline options.
getPipelineOptions() - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner
getPipelineOptions() - Method in class com.google.cloud.dataflow.sdk.transforms.DoFn.Context: Returns the PipelineOptions specified with the PipelineRunner invoking this DoFn.
getPipelineOptions() - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnWithContext.Context: Returns the PipelineOptions specified with the PipelineRunner invoking this DoFnWithContext.
getPipelineRunners() - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineRegistrar.Runner
getPipelineRunners() - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRegistrar.Runner
getPipelineRunners() - Method in interface com.google.cloud.dataflow.sdk.runners.PipelineRunnerRegistrar
getPosition(ShufflePosition) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.ByteArrayShufflePosition
getPosition() - Method in class com.google.cloud.dataflow.sdk.runners.worker.ByteArrayShufflePosition
getPosition() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.ShuffleEntry
getPositionForFractionConsumed(double) - Method in class com.google.cloud.dataflow.sdk.io.range.OffsetRangeTracker: Returns a position P such that the range [start, P) represents approximately the given fraction of the range [start, end).
getProducingTransformInternal() - Method in class com.google.cloud.dataflow.sdk.values.POutputValueBase: Returns the AppliedPTransform that this POutputValueBase is an output of.
getProducingTransformInternal() - Method in interface com.google.cloud.dataflow.sdk.values.PValue: Returns the AppliedPTransform that this POutputValueBase is an output of.
getProgress() - Method in class com.google.cloud.dataflow.sdk.runners.worker.FileBasedReader.FileBasedIterator
getProgress() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.Reader.AbstractReaderIterator
getProgress() - Method in interface com.google.cloud.dataflow.sdk.util.common.worker.Reader.ReaderIterator: Returns a representation of how far this iterator is through the source.
getProgress() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.ReadOperation: Returns a (possibly slightly stale) value of the progress of the task.
getProject() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineOptions
getProject() - Method in interface com.google.cloud.dataflow.sdk.options.GcpOptions: Project id to use when launching jobs.
getProjectId() - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineJob
getPubsubRootUrl() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions: Root URL for use with the Pubsub API.
getQuery() - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Read.Bound
getRawType() - Method in class com.google.cloud.dataflow.sdk.values.TypeDescriptor: Returns the Class underlying the Type represented by this TypeDescriptor.
getReader() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.ReadOperation
getReaderCheckpoint(Coder<? extends UnboundedSource.CheckpointMark>) - Method in class com.google.cloud.dataflow.sdk.util.StreamingModeExecutionContext
getReadOperation() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.MapTaskExecutor
getReadyCommitCallbackIds() - Method in class com.google.cloud.dataflow.sdk.util.StreamingModeExecutionContext
getReasons() - Method in class com.google.cloud.dataflow.sdk.coders.Coder.NonDeterministicException
getReceiverCount() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.OutputReceiver: Invoked by tests only.
getRecordClass() - Method in class com.google.cloud.dataflow.sdk.io.XmlSource
getRecordElement() - Method in class com.google.cloud.dataflow.sdk.io.XmlSource
getRecordType() - Method in class com.google.cloud.dataflow.sdk.coders.SerializableCoder
getRegisteredOptions() - Static method in class com.google.cloud.dataflow.sdk.options.PipelineOptionsFactory
getReleaseInfo() - Static method in class com.google.cloud.dataflow.sdk.util.DataflowReleaseInfo: Returns an instance of DataflowReleaseInfo.
getReplacedByJob() - Method in exception com.google.cloud.dataflow.sdk.runners.DataflowJobUpdatedException: The new job that replaces the job terminated with this exception.
getReplacedByJob() - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineJob: Returns a new DataflowPipelineJob for the job that replaced this one, if applicable.
getResponse() - Method in class com.google.cloud.dataflow.sdk.runners.worker.SourceOperationExecutor
getRoot() - Method in class com.google.cloud.dataflow.sdk.util.gcsfs.GcsPath
getRootCause() - Method in exception com.google.cloud.dataflow.sdk.coders.CannotProvideCoderException: Returns the inner-most CannotProvideCoderException when they are deeply nested.
getRootClasses() - Method in class com.google.cloud.dataflow.sdk.util.ApiSurface: Returns all public classes originally belonging to the package in the ApiSurface.
getRootElement() - Method in class com.google.cloud.dataflow.sdk.io.XmlSource
getRunner() - Method in interface com.google.cloud.dataflow.sdk.options.PipelineOptions
getRunner() - Method in class com.google.cloud.dataflow.sdk.Pipeline: Returns the configured pipeline runner.
getRunner() - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipeline
getRunner() - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipeline
getSavedValue() - Method in exception com.google.cloud.dataflow.sdk.util.IllegalMutationException: The original value, before the illegal mutation.
getSchema() - Method in class com.google.cloud.dataflow.sdk.coders.AvroCoder: Returns the schema used by this coder.
getSchema() - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Read.Bound
getSchema() - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound
getSchema() - Method in class com.google.cloud.dataflow.sdk.io.AvroSource
getSchema() - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.Bound: Returns the table schema.
getSchema() - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult: Returns the schema used by this CoGbkResult.
getSdkApiSurface() - Static method in class com.google.cloud.dataflow.sdk.util.ApiSurface
getSecondaryKey() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.ShuffleEntry
getSecretsFile() - Method in interface com.google.cloud.dataflow.sdk.options.GcpOptions: This option controls which file to use when attempting to create the credentials using the OAuth 2 webflow.
getSerializedKey() - Method in class com.google.cloud.dataflow.sdk.util.StreamingModeExecutionContext
getServiceAccountKeyfile() - Method in interface com.google.cloud.dataflow.sdk.options.GcpOptions: This option controls which file to use when attempting to create the credentials using the service account method.
getServiceAccountName() - Method in interface com.google.cloud.dataflow.sdk.options.GcpOptions: This option controls which service account to use when attempting to create the credentials using the service account method.
getShardNameTemplate() - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound: Returns the current shard name template string.
getShardNameTemplate() - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Write.Bound: Returns the current shard name template string.
getShardTemplate() - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound
getShardTemplate() - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Write.Bound
getSideInputData(Windmill.GetDataRequest) - Method in class com.google.cloud.dataflow.sdk.runners.worker.MetricTrackingWindmillServerStub
getSideInputNotifications() - Method in class com.google.cloud.dataflow.sdk.util.StreamingModeExecutionContext
getSideInputReader(Iterable<? extends SideInputInfo>) - Method in class com.google.cloud.dataflow.sdk.runners.worker.DataflowExecutionContext: Returns a SideInputReader for all the side inputs described in the given SideInputInfo descriptors.
getSideInputReader(Iterable<? extends SideInputInfo>) - Method in class com.google.cloud.dataflow.sdk.util.StreamingModeExecutionContext
getSideInputReaderForViews(Iterable<? extends PCollectionView<?>>) - Method in class com.google.cloud.dataflow.sdk.runners.worker.DataflowExecutionContext: Returns a SideInputReader for all the provided views, where the execution context itself knows how to read data for the view.
getSideInputReaderForViews(Iterable<? extends PCollectionView<?>>) - Method in class com.google.cloud.dataflow.sdk.util.StreamingModeExecutionContext
getSideInputs() - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.Bound
getSideInputs() - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.BoundMulti
getSideInputViews() - Method in class com.google.cloud.dataflow.sdk.util.DoFnInfo
getSideInputWindow(BoundedWindow) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.GlobalWindows
getSideInputWindow(BoundedWindow) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.InvalidWindows
getSideInputWindow(BoundedWindow) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.PartitioningWindowFn
getSideInputWindow(BoundedWindow) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Sessions
getSideInputWindow(BoundedWindow) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.SlidingWindows: Return the earliest window that contains the end of the main-input window.
getSideInputWindow(BoundedWindow) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.WindowFn: Returns the window of the side input corresponding to the given window of the main input.
getSideOutput(TupleTag<T>) - Method in class com.google.cloud.dataflow.sdk.util.DirectModeExecutionContext
getSink() - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSink.FileBasedWriteOperation: Returns the FileBasedSink for this write operation.
getSink() - Method in class com.google.cloud.dataflow.sdk.io.Sink.WriteOperation: Returns the Sink that this write operation writes to.
getSink() - Method in class com.google.cloud.dataflow.sdk.io.XmlSink.XmlWriteOperation: Return the XmlSink.Bound for this write operation.
getSink() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.WriteOperation
getSize() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.FixedWindows
getSize() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.SlidingWindows
getSize() - Method in class com.google.cloud.dataflow.sdk.util.Sized
getSizeBytes(String) - Method in class com.google.cloud.dataflow.sdk.util.FileIOChannelFactory
getSizeBytes(String) - Method in class com.google.cloud.dataflow.sdk.util.GcsIOChannelFactory
getSizeBytes(String) - Method in interface com.google.cloud.dataflow.sdk.util.IOChannelFactory: Returns the size in bytes for the given specification.
getSizeBytes(String) - Static method in class com.google.cloud.dataflow.sdk.util.IOChannelUtils: Returns the size in bytes for the given specification.
getSized(PCollectionView<T>, BoundedWindow) - Method in class com.google.cloud.dataflow.sdk.runners.worker.DataflowSideInputReader: Gets a side input for a view and window by reading data according to the corresponding SideInputInfo, passing the result through the view's PCollectionView.fromIterableInternal(java.lang.Iterable<com.google.cloud.dataflow.sdk.util.WindowedValue<?>>) conversion method, and extracting the value for the appropriate window.
getSized(PCollectionView<T>, BoundedWindow) - Method in interface com.google.cloud.dataflow.sdk.util.SizedSideInputReader: Returns the value of the requested PCollectionView for the given BoundedWindow along with a rough estimate of the number of bytes of memory it consumes.
getSource() - Method in class com.google.cloud.dataflow.sdk.io.Read.Bounded: Returns the BoundedSource used to create this Read PTransform.
getSource() - Method in class com.google.cloud.dataflow.sdk.io.Read.Unbounded: Returns the UnboundedSource used to create this Read PTransform.
getSources() - Method in class com.google.cloud.dataflow.sdk.runners.worker.ConcatReader
getSpec() - Method in class com.google.cloud.dataflow.sdk.util.ExecutableTrigger: Return the underlying trigger specification corresponding to this ExecutableTrigger.
getStableUniqueNames() - Method in interface com.google.cloud.dataflow.sdk.options.PipelineOptions
getStageName() - Static method in class com.google.cloud.dataflow.sdk.runners.worker.logging.DataflowWorkerLoggingMDC: Gets the Stage Name of the current thread.
getStager() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions: The resource stager instance that should be created and used to stage resources.
getStagerClass() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions: The class responsible for staging resources to be accessible by workers during job execution.
getStagingLocation() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineOptions: GCS path for staging local files, e.g.
getStartDate() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.DaysWindows
getStartDate() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.MonthsWindows
getStartDate() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.YearsWindows
getStartOffset() - Method in class com.google.cloud.dataflow.sdk.io.OffsetBasedSource: Returns the starting offset of the source.
getStartPosition() - Method in class com.google.cloud.dataflow.sdk.io.range.OffsetRangeTracker
getStartPosition() - Method in interface com.google.cloud.dataflow.sdk.io.range.RangeTracker: Returns the starting position of the current range, inclusive.
getStartPosition() - Method in class com.google.cloud.dataflow.sdk.runners.worker.GroupingShuffleRangeTracker
getState() - Method in interface com.google.cloud.dataflow.sdk.PipelineResult: Retrieves the current state of the pipeline execution.
getState() - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineJob
getStateData(Windmill.GetDataRequest) - Method in class com.google.cloud.dataflow.sdk.runners.worker.MetricTrackingWindmillServerStub
getStepContext(String, String) - Method in class com.google.cloud.dataflow.sdk.util.BaseExecutionContext: Returns the BaseExecutionContext.StepContext associated with the given step.
getStepContext(String, String) - Method in interface com.google.cloud.dataflow.sdk.util.ExecutionContext: Returns the ExecutionContext.StepContext associated with the given step.
getStepName(PTransform<?, ?>) - Method in interface com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.EvaluationContext: Gets the step name for this transform.
getStepName() - Static method in class com.google.cloud.dataflow.sdk.runners.worker.logging.DataflowWorkerLoggingMDC: Gets the Step Name of the current thread.
getStepName() - Method in class com.google.cloud.dataflow.sdk.util.BaseExecutionContext.StepContext
getStepName() - Method in interface com.google.cloud.dataflow.sdk.util.ExecutionContext.StepContext: The name of the step.
getStepNames() - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.JobSpecification: Returns the mapping of AppliedPTransforms to the internal step name for that AppliedPTransform.
getStopPosition() - Method in class com.google.cloud.dataflow.sdk.io.range.OffsetRangeTracker
getStopPosition() - Method in interface com.google.cloud.dataflow.sdk.io.range.RangeTracker: Returns the ending position of the current range, exclusive.
getStopPosition() - Method in class com.google.cloud.dataflow.sdk.runners.worker.GroupingShuffleRangeTracker
getString(Map<String, Object>, String) - Static method in class com.google.cloud.dataflow.sdk.util.Structs
getString(Map<String, Object>, String, String) - Static method in class com.google.cloud.dataflow.sdk.util.Structs
getStrings(Map<String, Object>, String, List<String>) - Static method in class com.google.cloud.dataflow.sdk.util.Structs
getSubscription() - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read.Bound
getSubTriggerContaining(int) - Method in class com.google.cloud.dataflow.sdk.util.ExecutableTrigger
getSupertype(Class<? super T>) - Method in class com.google.cloud.dataflow.sdk.values.TypeDescriptor: Returns the generic form of a supertype.
getTable() - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Read.Bound: Returns the table to write.
getTable() - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.Bound: Returns the table reference.
getTag(int) - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResultSchema: Returns the JoinTupleTag at the given index.
getTag(T) - Method in interface com.google.cloud.dataflow.sdk.util.common.TaggedReiteratorList.TagExtractor
getTagInternal() - Method in interface com.google.cloud.dataflow.sdk.values.PCollectionView: A unique identifier, for internal use.
getTagsInUse(StateNamespace) - Method in class com.google.cloud.dataflow.sdk.util.state.StateTable
getTeardownPolicy() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions: The teardown policy for the VMs.
getTeardownPolicyName() - Method in enum com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions.TeardownPolicy
getTempDatasetId() - Method in interface com.google.cloud.dataflow.sdk.options.BigQueryOptions
getTempLocation() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineOptions: GCS path for temporary files, e.g.
getTimer() - Method in class com.google.cloud.dataflow.sdk.util.TimerOrElement: If this is a timer, returns the associated TimerInternals.TimerData.
getTimestamp() - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.ValueWithMetadata: Returns the timestamp associated with this element.
getTimestamp() - Method in class com.google.cloud.dataflow.sdk.util.TimerInternals.TimerData
getTimestamp() - Method in class com.google.cloud.dataflow.sdk.util.WindowedValue: Returns the timestamp of this WindowedValue.
getTimestamp() - Method in class com.google.cloud.dataflow.sdk.values.TimestampedValue
getTimestampLabel() - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read.Bound
getTimestampLabel() - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Write.Bound
getTimeZone() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.DaysWindows
getTimeZone() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.MonthsWindows
getTimeZone() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.YearsWindows
getTiming() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.PaneInfo: Return true if this is the last pane that will be produced in the associated window.
getTopic() - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read.Bound
getTopic() - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Write.Bound
getTotalValue(Combine.CombineFn<T, ?, T>) - Method in class com.google.cloud.dataflow.sdk.runners.AggregatorValues: Get the total value of this Aggregator by applying the specified Combine.CombineFn.
getTransform() - Method in class com.google.cloud.dataflow.sdk.runners.TransformTreeNode: Returns the transform associated with this transform node.
getTransform() - Method in class com.google.cloud.dataflow.sdk.transforms.AppliedPTransform
getTransformEvaluator(Class<TransformT>) - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner: Returns the TransformEvaluator to use for instances of the specified PTransform class, or null if none registered.
getTransformName() - Method in class com.google.cloud.dataflow.sdk.util.BaseExecutionContext.StepContext
getTransformName() - Method in interface com.google.cloud.dataflow.sdk.util.ExecutionContext.StepContext: The name of the transform for the step.
getTransformNameMapping() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions: Mapping of old PTranform names to new ones, specified as a semicolon-separated list of oldName=newName pairs.
getTransformTranslator(Class<TransformT>) - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator: Returns the DataflowPipelineTranslator.TransformTranslator to use for instances of the specified PTransform class, or null if none registered.
getTranslator() - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineRunner: Returns the DataflowPipelineTranslator associated with this object.
getTransport() - Static method in class com.google.cloud.dataflow.sdk.util.Transport
getTrigger() - Method in class com.google.cloud.dataflow.sdk.util.WindowingStrategy
getTriggerIndex() - Method in class com.google.cloud.dataflow.sdk.util.ExecutableTrigger
getTriggerIndex() - Method in class com.google.cloud.dataflow.sdk.util.state.StateNamespaces.WindowAndTriggerNamespace
getTriggerResult() - Method in enum com.google.cloud.dataflow.sdk.transforms.windowing.Trigger.MergeResult
getTupleTag() - Method in class com.google.cloud.dataflow.sdk.transforms.join.KeyedPCollectionTuple.TaggedKeyedPCollection: Returns the TupleTag of this TaggedKeyedPCollection.
getTupleTagList() - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResultSchema: Returns the TupleTagList tuple associated with this schema.
getType() - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound
getType() - Method in class com.google.cloud.dataflow.sdk.util.common.Counter: Returns the counter's type.
getType() - Method in class com.google.cloud.dataflow.sdk.values.TypeDescriptor: Returns the Type represented by this TypeDescriptor.
getTypeDescriptor() - Method in class com.google.cloud.dataflow.sdk.values.TupleTag: Returns a TypeDescriptor capturing what is known statically about the type of this TupleTag instance's most-derived class.
getTypeDescriptor() - Method in class com.google.cloud.dataflow.sdk.values.TypedPValue: Returns a TypeDescriptor<T> with some reflective information about T, if possible.
getTypeParameter(String) - Method in class com.google.cloud.dataflow.sdk.values.TypeDescriptor: Returns a TypeVariable for the named type parameter.
getUnionTag() - Method in class com.google.cloud.dataflow.sdk.transforms.join.RawUnionValue
getUpdate() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions: Whether to update the currently running pipeline with the same name as this one.
getValidate() - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Read.Bound: Returns true if table validation is enabled.
getValidate() - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.Bound: Returns true if table validation is enabled.
getValue() - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.ValueWithMetadata: Returns the value associated with this element.
getValue() - Method in class com.google.cloud.dataflow.sdk.transforms.join.RawUnionValue
getValue() - Method in class com.google.cloud.dataflow.sdk.util.common.Metric
getValue(T) - Method in interface com.google.cloud.dataflow.sdk.util.common.TaggedReiteratorList.TagExtractor
getValue() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.PartialGroupByKeyOperation.StructuralByteArray
getValue() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.ShuffleEntry
getValue() - Method in class com.google.cloud.dataflow.sdk.util.Sized
getValue() - Method in class com.google.cloud.dataflow.sdk.util.ValueWithRecordId
getValue() - Method in class com.google.cloud.dataflow.sdk.util.WindowedValue: Returns the value of this WindowedValue.
getValue() - Method in class com.google.cloud.dataflow.sdk.values.KV: Returns the value of this KV.
getValue() - Method in class com.google.cloud.dataflow.sdk.values.TimestampedValue
getValueCoder() - Method in class com.google.cloud.dataflow.sdk.coders.KvCoder
getValueCoder() - Method in class com.google.cloud.dataflow.sdk.coders.MapCoder
getValueCoder() - Method in class com.google.cloud.dataflow.sdk.util.ValueWithRecordId.ValueWithRecordIdCoder
getValueCoder() - Method in class com.google.cloud.dataflow.sdk.util.WindowedValue.WindowedValueCoder: Returns the value coder.
getValueFromInputPair(Object) - Method in class com.google.cloud.dataflow.sdk.runners.worker.MapTaskExecutorFactory.PairInfo
getValueFromInputPair(Object) - Method in interface com.google.cloud.dataflow.sdk.util.common.worker.PartialGroupByKeyOperation.PairInfo
getValueOnlyCoder(Coder<T>) - Static method in class com.google.cloud.dataflow.sdk.util.WindowedValue: Returns the ValueOnlyCoder from the given valueCoder.
getValues() - Method in class com.google.cloud.dataflow.sdk.runners.AggregatorValues: Get the values of the Aggregator at all steps it was used.
getValuesAtSteps() - Method in class com.google.cloud.dataflow.sdk.runners.AggregatorValues: Get the values of the Aggregator by the user name at each step it was used.
getValuesAtSteps() - Method in class com.google.cloud.dataflow.sdk.runners.dataflow.MapAggregatorValues
getVersion() - Method in class com.google.cloud.dataflow.sdk.util.DataflowReleaseInfo: Provides the SDK version.
getView() - Method in class com.google.cloud.dataflow.sdk.util.PCollectionViewWindow
getWatermark() - Method in class com.google.cloud.dataflow.sdk.io.UnboundedSource.UnboundedReader: Returns a lower bound on timestamps of future elements read by this reader.
getWatermarkThatGuaranteesFiring(W) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterAll
getWatermarkThatGuaranteesFiring(W) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterEach
getWatermarkThatGuaranteesFiring(W) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterFirst
getWatermarkThatGuaranteesFiring(W) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterPane
getWatermarkThatGuaranteesFiring(W) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterProcessingTime
getWatermarkThatGuaranteesFiring(W) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.DefaultTrigger
getWatermarkThatGuaranteesFiring(W) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Repeatedly
getWatermarkThatGuaranteesFiring(W) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Trigger: Returns a bound in watermark time by which this trigger would have fired at least once for a given window had there been input data.
getWindow() - Method in class com.google.cloud.dataflow.sdk.util.PCollectionViewWindow
getWindow() - Method in class com.google.cloud.dataflow.sdk.util.state.StateNamespaces.WindowAndTriggerNamespace
getWindow() - Method in class com.google.cloud.dataflow.sdk.util.state.StateNamespaces.WindowNamespace
getWindowCoder() - Method in class com.google.cloud.dataflow.sdk.util.WindowedValue.FullWindowedValueCoder
getWindowedValue() - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.ValueWithMetadata: Returns the WindowedValue associated with this element.
getWindowFn() - Method in class com.google.cloud.dataflow.sdk.util.WindowingStrategy
getWindowingStrategy() - Method in class com.google.cloud.dataflow.sdk.util.DoFnInfo
getWindowingStrategy() - Method in class com.google.cloud.dataflow.sdk.values.PCollection: Returns the WindowingStrategy of this PCollection.
getWindowingStrategyInternal() - Method in interface com.google.cloud.dataflow.sdk.values.PCollectionView: For internal use only.
getWindows() - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.ValueWithMetadata: Returns the collection of windows this element has been placed into.
getWindows() - Method in class com.google.cloud.dataflow.sdk.util.WindowedValue: Returns the windows of this WindowedValue.
getWindowsCoder() - Method in class com.google.cloud.dataflow.sdk.util.WindowedValue.FullWindowedValueCoder
getWork(Windmill.GetWorkRequest) - Method in class com.google.cloud.dataflow.sdk.runners.worker.windmill.WindmillServerStub: Get a batch of work to process.
getWork() - Method in class com.google.cloud.dataflow.sdk.util.StreamingModeExecutionContext
getWorkerCacheMb() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowWorkerHarnessOptions: The size of the worker's in-memory cache, in megabytes.
getWorkerDiskType() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions: Specifies what type of persistent disk should be used.
getWorkerId() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowWorkerHarnessOptions: The identity of the worker running this pipeline.
getWorkerId() - Static method in class com.google.cloud.dataflow.sdk.runners.worker.logging.DataflowWorkerLoggingMDC: Gets the Worker ID of the current thread.
getWorkerLogLevelOverrides() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowWorkerLoggingOptions: This option controls the log levels for specifically named loggers.
getWorkerMachineType() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions: Machine type to create Dataflow worker VMs as.
getWorkerProgress() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.MapTaskExecutor
getWorkerProgress() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.WorkExecutor: Returns the worker's current progress.
getWorkId() - Static method in class com.google.cloud.dataflow.sdk.runners.worker.logging.DataflowWorkerLoggingMDC: Gets the Work ID of the current thread.
getWorkItem() - Method in class com.google.cloud.dataflow.sdk.runners.worker.DataflowWorker.WorkUnitClient: Returns a new WorkItem unit for this Worker to work on or null if no work item is available.
getWorkToken() - Method in class com.google.cloud.dataflow.sdk.util.StreamingModeExecutionContext
getWorkUnitLeaseExpirationTimestamp() - Method in class com.google.cloud.dataflow.sdk.runners.worker.DataflowWorkProgressUpdater
getWorkUnitLeaseExpirationTimestamp() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.WorkProgressUpdater: Returns the current work item's lease expiration timestamp.
getWorkUnitSuggestedReportingInterval() - Method in class com.google.cloud.dataflow.sdk.runners.worker.DataflowWorkProgressUpdater
getWorkUnitSuggestedReportingInterval() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.WorkProgressUpdater: Returns the current work item's suggested progress reporting interval.
getWriteDisposition() - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.Bound: Returns the write disposition.
getWriteOperation() - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSink.FileBasedWriter: Return the FileBasedWriteOperation that this Writer belongs to.
getWriteOperation() - Method in class com.google.cloud.dataflow.sdk.io.Sink.Writer: Returns the write operation this writer belongs to.
getWriteOperation() - Method in class com.google.cloud.dataflow.sdk.io.XmlSink.XmlWriter: Return the XmlWriteOperation this write belongs to.
getWriterResultCoder() - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSink.FileBasedWriteOperation: Provides a coder for FileBasedSink.FileResult.
getWriterResultCoder() - Method in class com.google.cloud.dataflow.sdk.io.Sink.WriteOperation: Returns a coder for the writer result type.
getZone() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions: GCE availability zone for launching workers.
global() - Static method in class com.google.cloud.dataflow.sdk.util.state.StateNamespaces
globalDefault() - Static method in class com.google.cloud.dataflow.sdk.util.WindowingStrategy: Return a fully specified, default windowing strategy.
globally(int, ComparatorT) - Static method in class com.google.cloud.dataflow.sdk.transforms.ApproximateQuantiles: Returns a PTransform that takes a PCollection<T> and returns a PCollection<List<T>> whose single value is a List of the approximate N-tiles of the elements of the input PCollection.
globally(int) - Static method in class com.google.cloud.dataflow.sdk.transforms.ApproximateQuantiles: Like ApproximateQuantiles.globally(int, Comparator), but sorts using the elements' natural ordering.
globally(int) - Static method in class com.google.cloud.dataflow.sdk.transforms.ApproximateUnique: Returns a PTransform that takes a PCollection<T> and returns a PCollection<Long> containing a single value that is an estimate of the number of distinct elements in the input PCollection.
globally(double) - Static method in class com.google.cloud.dataflow.sdk.transforms.ApproximateUnique: Like ApproximateUnique.globally(int), but specifies the desired maximum estimation error instead of the sample size.
globally(SerializableFunction<Iterable<V>, V>) - Static method in class com.google.cloud.dataflow.sdk.transforms.Combine: Returns a Combine.Globally PTransform that uses the given SerializableFunction to combine all the elements in each window of the input PCollection into a single value in the output PCollection.
globally(Combine.CombineFn<? super InputT, ?, OutputT>) - Static method in class com.google.cloud.dataflow.sdk.transforms.Combine: Returns a Combine.Globally PTransform that uses the given SerializableFunction to combine all the elements in each window of the input PCollection into a single value in the output PCollection.
globally() - Static method in class com.google.cloud.dataflow.sdk.transforms.Count: Returns a Combine.Globally PTransform that counts the number of elements in its input PCollection.
globally() - Static method in class com.google.cloud.dataflow.sdk.transforms.Max: Returns a PTransform that takes an input PCollection<T> and returns a PCollection<T> whose contents is the maximum according to the natural ordering of T of the input PCollection's elements, or null if there are no elements.
globally(ComparatorT) - Static method in class com.google.cloud.dataflow.sdk.transforms.Max: Returns a PTransform that takes an input PCollection<T> and returns a PCollection<T> whose contents is the maximum of the input PCollection's elements, or null if there are no elements.
globally() - Static method in class com.google.cloud.dataflow.sdk.transforms.Mean: Returns a PTransform that takes an input PCollection<NumT> and returns a PCollection<Double> whose contents is the mean of the input PCollection's elements, or 0 if there are no elements.
globally() - Static method in class com.google.cloud.dataflow.sdk.transforms.Min: Returns a PTransform that takes an input PCollection<T> and returns a PCollection<T> whose contents is the minimum according to the natural ordering of T of the input PCollection's elements, or null if there are no elements.
globally(ComparatorT) - Static method in class com.google.cloud.dataflow.sdk.transforms.Min: Returns a PTransform that takes an input PCollection<T> and returns a PCollection<T> whose contents is the minimum of the input PCollection's elements, or null if there are no elements.
GlobalNamespace() - Constructor for class com.google.cloud.dataflow.sdk.util.state.StateNamespaces.GlobalNamespace
GlobalWindow - Class in com.google.cloud.dataflow.sdk.transforms.windowing: The default window into which all data is placed (via GlobalWindows).
GlobalWindow.Coder - Class in com.google.cloud.dataflow.sdk.transforms.windowing: GlobalWindow.Coder for encoding and decoding Windows.
GlobalWindows - Class in com.google.cloud.dataflow.sdk.transforms.windowing: Default WindowFn where all data is in the same window.
GlobalWindows() - Constructor for class com.google.cloud.dataflow.sdk.transforms.windowing.GlobalWindows
GoogleApiDebugOptions - Interface in com.google.cloud.dataflow.sdk.options: These options configure debug settings for Google API clients created within the Dataflow SDK.
GoogleApiDebugOptions.GoogleApiTracer - Class in com.google.cloud.dataflow.sdk.options: A GoogleClientRequestInitializer that adds the trace destination to Google API calls.
GoogleApiTracer() - Constructor for class com.google.cloud.dataflow.sdk.options.GoogleApiDebugOptions.GoogleApiTracer
greaterThan(T) - Static method in class com.google.cloud.dataflow.sdk.transforms.Filter: Returns a PTransform that takes an input PCollection<T> and returns a PCollection<T> with elements that are greater than a given value, based on the elements' natural ordering.
greaterThanEq(T) - Static method in class com.google.cloud.dataflow.sdk.transforms.Filter: Returns a PTransform that takes an input PCollection<T> and returns a PCollection<T> with elements that are greater than or equal to a given value, based on the elements' natural ordering.
GroupAlsoByWindow(WindowingStrategy<?, ?>) - Constructor for class com.google.cloud.dataflow.sdk.transforms.GroupByKey.GroupAlsoByWindow
GroupAlsoByWindowsDoFn<K,InputT,OutputT,W extends BoundedWindow> - Class in com.google.cloud.dataflow.sdk.util: DoFn that merges windows and groups elements in those windows, optionally combining values.
GroupAlsoByWindowsDoFn() - Constructor for class com.google.cloud.dataflow.sdk.util.GroupAlsoByWindowsDoFn
GroupByKey<K,V> - Class in com.google.cloud.dataflow.sdk.transforms: GroupByKey<K, V> takes a PCollection<KV<K, V>>, groups the values by key and windows, and returns a PCollection<KV<K, Iterable<V>>> representing a map from each distinct key and window of the input PCollection to an Iterable over all the values associated with that key in the input.
GroupByKey.GroupAlsoByWindow<K,V> - Class in com.google.cloud.dataflow.sdk.transforms: Helper transform that takes a collection of timestamp-ordered values associated with each key, groups the values by window, combines windows as needed, and for each window in each key, outputs a collection of key/value-list pairs implicitly assigned to the window and with the timestamp derived from that window.
GroupByKey.GroupByKeyOnly<K,V> - Class in com.google.cloud.dataflow.sdk.transforms: Primitive helper transform that groups by key only, ignoring any window assignments.
GroupByKey.ReifyTimestampsAndWindows<K,V> - Class in com.google.cloud.dataflow.sdk.transforms: Helper transform that makes timestamps and window assignments explicit in the value part of each key/value pair.
GroupByKey.SortValuesByTimestamp<K,V> - Class in com.google.cloud.dataflow.sdk.transforms: Helper transform that sorts the values associated with each key by timestamp.
GroupByKeyOnly() - Constructor for class com.google.cloud.dataflow.sdk.transforms.GroupByKey.GroupByKeyOnly
groupedValues(SerializableFunction<Iterable<V>, V>) - Static method in class com.google.cloud.dataflow.sdk.transforms.Combine: Returns a Combine.GroupedValues PTransform that takes a PCollection of KVs where a key maps to an Iterable of values, e.g., the result of a GroupByKey, then uses the given SerializableFunction to combine all the values associated with a key, ignoring the key.
groupedValues(Combine.CombineFn<? super InputT, ?, OutputT>) - Static method in class com.google.cloud.dataflow.sdk.transforms.Combine: Returns a Combine.GroupedValues PTransform that takes a PCollection of KVs where a key maps to an Iterable of values, e.g., the result of a GroupByKey, then uses the given CombineFn to combine all the values associated with a key, ignoring the key.
groupedValues(Combine.KeyedCombineFn<? super K, ? super InputT, ?, OutputT>) - Static method in class com.google.cloud.dataflow.sdk.transforms.Combine: Returns a Combine.GroupedValues PTransform that takes a PCollection of KVs where a key maps to an Iterable of values, e.g., the result of a GroupByKey, then uses the given KeyedCombineFn to combine all the values associated with each key.
GroupingShuffleEntryIterator - Class in com.google.cloud.dataflow.sdk.util.common.worker: An iterator through KeyGroupedShuffleEntries.
GroupingShuffleEntryIterator(Reiterator<ShuffleEntry>) - Constructor for class com.google.cloud.dataflow.sdk.util.common.worker.GroupingShuffleEntryIterator: Constructs a GroupingShuffleEntryIterator, given a Reiterator over ungrouped ShuffleEntries, assuming the ungrouped ShuffleEntries for a given key are consecutive.
GroupingShuffleRangeTracker - Class in com.google.cloud.dataflow.sdk.runners.worker: A RangeTracker for positions used by GroupingShuffleReader (ByteArrayShufflePosition).
GroupingShuffleRangeTracker(ByteArrayShufflePosition, ByteArrayShufflePosition) - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.GroupingShuffleRangeTracker
GroupingShuffleReader<K,V> - Class in com.google.cloud.dataflow.sdk.runners.worker: A source that reads from a shuffled dataset and yields key-grouped data.
GroupingShuffleReader(PipelineOptions, byte[], String, String, Coder<WindowedValue<KV<K, Iterable<V>>>>, BatchModeExecutionContext) - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.GroupingShuffleReader
GroupingShuffleReaderFactory - Class in com.google.cloud.dataflow.sdk.runners.worker: Creates a GroupingShuffleReader from a CloudObject spec.

H

has(TupleTag<V>) - Method in class com.google.cloud.dataflow.sdk.util.PTuple: Returns whether this PTuple contains a value with the given tag.
has(TupleTag<T>) - Method in class com.google.cloud.dataflow.sdk.values.PCollectionTuple: Returns whether this PCollectionTuple contains a PCollection with the given tag.
hasDefaultValue() - Method in class com.google.cloud.dataflow.sdk.transforms.View.AsSingleton: Returns whether this transform has a default value.
hashCode() - Method in class com.google.cloud.dataflow.sdk.coders.Proto2Coder
hashCode() - Method in class com.google.cloud.dataflow.sdk.coders.SerializableCoder
hashCode() - Method in class com.google.cloud.dataflow.sdk.coders.StandardCoder
hashCode() - Method in class com.google.cloud.dataflow.sdk.runners.worker.ByteArrayShufflePosition
hashCode() - Method in class com.google.cloud.dataflow.sdk.transforms.AppliedPTransform
hashCode() - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult.CoGbkResultCoder
hashCode() - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResultSchema
hashCode() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterPane
hashCode() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterProcessingTime
hashCode() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.IntervalWindow
hashCode() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.PaneInfo
hashCode() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Trigger
hashCode() - Method in class com.google.cloud.dataflow.sdk.util.common.Counter
hashCode() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.PartialGroupByKeyOperation.StructuralByteArray
hashCode() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.ShuffleEntry
hashCode() - Method in class com.google.cloud.dataflow.sdk.util.gcsfs.GcsPath
hashCode() - Method in class com.google.cloud.dataflow.sdk.util.PCollectionViewWindow
hashCode() - Method in class com.google.cloud.dataflow.sdk.util.state.StateNamespaceForTest
hashCode() - Method in class com.google.cloud.dataflow.sdk.util.state.StateNamespaces.GlobalNamespace
hashCode() - Method in class com.google.cloud.dataflow.sdk.util.state.StateNamespaces.WindowAndTriggerNamespace
hashCode() - Method in class com.google.cloud.dataflow.sdk.util.state.StateNamespaces.WindowNamespace
hashCode() - Method in class com.google.cloud.dataflow.sdk.util.TimerInternals.TimerData
hashCode() - Method in class com.google.cloud.dataflow.sdk.util.TimerOrElement
hashCode() - Method in class com.google.cloud.dataflow.sdk.util.ValueWithRecordId
hashCode() - Method in class com.google.cloud.dataflow.sdk.util.WindowedValue
hashCode() - Method in class com.google.cloud.dataflow.sdk.values.KV
hashCode() - Method in class com.google.cloud.dataflow.sdk.values.TimestampedValue
hashCode() - Method in class com.google.cloud.dataflow.sdk.values.TupleTag
hashCode() - Method in class com.google.cloud.dataflow.sdk.values.TypeDescriptor
hasNext() - Method in class com.google.cloud.dataflow.sdk.util.BigQueryTableRowIterator
hasNext() - Method in class com.google.cloud.dataflow.sdk.util.common.ForwardingReiterator
hasNext() - Method in class com.google.cloud.dataflow.sdk.util.common.PeekingReiterator
hasNext() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.AbstractBoundedReaderIterator
hasNext() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.GroupingShuffleEntryIterator
hasNext() - Method in interface com.google.cloud.dataflow.sdk.util.common.worker.Reader.ReaderIterator: Returns whether the source has any more elements.
hasNextImpl() - Method in class com.google.cloud.dataflow.sdk.runners.worker.FileBasedReader.FileBasedIterator
hasNextImpl() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.AbstractBoundedReaderIterator
hasRemainingEncodedBytes() - Method in class com.google.cloud.dataflow.sdk.runners.worker.OrderedCode: Returns true if this has more encoded bytes that haven't been read, false otherwise.
hasReplacementJob() - Method in enum com.google.cloud.dataflow.sdk.PipelineResult.State: Returns true if this job state indicates that a replacement job exists.
HEADER - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
Hidden - Annotation Type in com.google.cloud.dataflow.sdk.options: Methods and/or interfaces annotated with @Hidden will be suppressed from being output when --help is specified on the command-line.
holdForFinal(ReduceFn<?, ?, ?, W>.Context) - Method in class com.google.cloud.dataflow.sdk.util.WatermarkHold
holdForOnTime(ReduceFn<?, ?, ?, W>.Context) - Method in class com.google.cloud.dataflow.sdk.util.WatermarkHold

I

identity() - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineDoubleFn: Returns the identity element of this operation, i.e.
identity() - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineFn: Returns the value that should be used for the combine of the empty set.
identity() - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineIntegerFn: Returns the identity element of this operation, i.e.
identity() - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineLongFn: Returns the identity element of this operation, i.e.
identity() - Method in class com.google.cloud.dataflow.sdk.transforms.Max.MaxFn
identity() - Method in class com.google.cloud.dataflow.sdk.transforms.Min.MinFn
identity() - Method in class com.google.cloud.dataflow.sdk.transforms.Sum.SumDoubleFn
identity() - Method in class com.google.cloud.dataflow.sdk.transforms.Sum.SumIntegerFn
identity() - Method in class com.google.cloud.dataflow.sdk.transforms.Sum.SumLongFn
IDENTITY - Static variable in class com.google.cloud.dataflow.sdk.transforms.windowing.TimeTrigger
idLabel(String) - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read.Bound: Returns a new PubsubIO.Read PTransform that's like this one but reading unique ids from the given PubSub label.
idLabel(String) - Static method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read: Creates and returns a PubSubIO.Read PTransform where unique record identifiers are expected to be provided using the PubSub labeling API.
idLabel(String) - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Write.Bound: Returns a new PubsubIO.Write PTransform that's like this one but publishing record ids to the given PubSub label.
idLabel(String) - Static method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Write: If specified, Dataflow will add a Pubsub label to each output record containing a unique identifier for that record.
illegalArgumentException() - Method in class com.google.cloud.dataflow.sdk.util.common.Counter: Constructs an IllegalArgumentException explaining that this Counter's aggregation kind is not supported by its value type.
IllegalMutationException - Exception in com.google.cloud.dataflow.sdk.util: Thrown when a value appears to have been mutated, but that mutation is forbidden.
IllegalMutationException(String, Object, Object) - Constructor for exception com.google.cloud.dataflow.sdk.util.IllegalMutationException
IllegalMutationException(String, Object, Object, Throwable) - Constructor for exception com.google.cloud.dataflow.sdk.util.IllegalMutationException
in(Pipeline) - Static method in class com.google.cloud.dataflow.sdk.values.PBegin: Returns a PBegin in the given Pipeline.
in(Pipeline) - Static method in class com.google.cloud.dataflow.sdk.values.PDone: Creates a PDone in the given Pipeline.
includingClass(Class<?>) - Method in class com.google.cloud.dataflow.sdk.util.ApiSurface: Returns an ApiSurface like this one, but also including the given class.
includingPackage(String) - Method in class com.google.cloud.dataflow.sdk.util.ApiSurface: Returns an ApiSurface like this one, but also including the named package and all of its subpackages.
INDEX_OF_MAX - Static variable in class com.google.cloud.dataflow.sdk.io.ShardNameTemplate: Shard name containing the index and max.
INFINITY - Static variable in class com.google.cloud.dataflow.sdk.runners.worker.OrderedCode
INFINITY_ENCODED - Static variable in class com.google.cloud.dataflow.sdk.runners.worker.OrderedCode
initializationState - Variable in class com.google.cloud.dataflow.sdk.util.common.worker.Operation: The initialization state of this Operation.
initializationStateLock - Variable in class com.google.cloud.dataflow.sdk.util.common.worker.Operation: The lock protecting the initialization state.
initialize(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSink.FileBasedWriteOperation: Initialization of the sink.
initialize(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.Sink.WriteOperation: Performs initialization before writing to the sink.
initialize(AbstractGoogleClientRequest<?>) - Method in class com.google.cloud.dataflow.sdk.options.GoogleApiDebugOptions.GoogleApiTracer
initialize() - Static method in class com.google.cloud.dataflow.sdk.runners.worker.logging.DataflowWorkerLoggingInitializer: Sets up the initial logging configuration.
initialize(HttpRequest) - Method in class com.google.cloud.dataflow.sdk.util.RetryHttpRequestInitializer
InMemoryReader<T> - Class in com.google.cloud.dataflow.sdk.runners.worker: A source that yields a set of precomputed elements.
InMemoryReader(List<String>, Long, Long, Coder<T>) - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.InMemoryReader
InMemoryReaderFactory - Class in com.google.cloud.dataflow.sdk.runners.worker: Creates an InMemoryReader from a CloudObject spec.
inMemoryState - Variable in class com.google.cloud.dataflow.sdk.util.state.InMemoryStateInternals
InMemoryStateInternals - Class in com.google.cloud.dataflow.sdk.util.state: In-memory implementation of StateInternals.
InMemoryStateInternals() - Constructor for class com.google.cloud.dataflow.sdk.util.state.InMemoryStateInternals
inOrder(Trigger<W>...) - Static method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterEach
inPushback(Runtime) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.StreamingDataflowWorker
INPUT_CODER - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
INPUTS - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
insertAll(List<TableRow>) - Method in class com.google.cloud.dataflow.sdk.util.BigQueryTableInserter: Insert all rows from the given list.
insertAll(List<TableRow>, List<String>) - Method in class com.google.cloud.dataflow.sdk.util.BigQueryTableInserter: Insert all rows from the given list using specified insertIds if not null.
INSTANCE - Static variable in class com.google.cloud.dataflow.sdk.transforms.windowing.GlobalWindow.Coder
INSTANCE - Static variable in class com.google.cloud.dataflow.sdk.transforms.windowing.GlobalWindow
INSTANCE - Static variable in class com.google.cloud.dataflow.sdk.transforms.windowing.PaneInfo.PaneInfoCoder
InstanceBuilder<T> - Class in com.google.cloud.dataflow.sdk.util: Utility for creating objects dynamically.
InstantCoder - Class in com.google.cloud.dataflow.sdk.coders: A InstantCoder is a Coder for a joda Instant.
integersGlobally() - Static method in class com.google.cloud.dataflow.sdk.transforms.Max: Returns a PTransform that takes an input PCollection<Integer> and returns a PCollection<Integer> whose contents is the maximum of the input PCollection's elements, or Integer.MIN_VALUE if there are no elements.
integersGlobally() - Static method in class com.google.cloud.dataflow.sdk.transforms.Min: Returns a PTransform that takes an input PCollection<Integer> and returns a PCollection<Integer> whose contents is a single value that is the minimum of the input PCollection's elements, or Integer.MAX_VALUE if there are no elements.
integersGlobally() - Static method in class com.google.cloud.dataflow.sdk.transforms.Sum: Returns a PTransform that takes an input PCollection<Integer> and returns a PCollection<Integer> whose contents is the sum of the input PCollection's elements, or 0 if there are no elements.
integersPerKey() - Static method in class com.google.cloud.dataflow.sdk.transforms.Max: Returns a PTransform that takes an input PCollection<KV<K, Integer>> and returns a PCollection<KV<K, Integer>> that contains an output element mapping each distinct key in the input PCollection to the maximum of the values associated with that key in the input PCollection.
integersPerKey() - Static method in class com.google.cloud.dataflow.sdk.transforms.Min: Returns a PTransform that takes an input PCollection<KV<K, Integer>> and returns a PCollection<KV<K, Integer>> that contains an output element mapping each distinct key in the input PCollection to the minimum of the values associated with that key in the input PCollection.
integersPerKey() - Static method in class com.google.cloud.dataflow.sdk.transforms.Sum: Returns a PTransform that takes an input PCollection<KV<K, Integer>> and returns a PCollection<KV<K, Integer>> that contains an output element mapping each distinct key in the input PCollection to the sum of the values associated with that key in the input PCollection.
intersects(IntervalWindow) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.IntervalWindow: Returns whether this window intersects the given window.
IntervalBoundedExponentialBackOff - Class in com.google.cloud.dataflow.sdk.util: Implementation of BackOff that increases the back off period for each retry attempt using a randomization function that grows exponentially.
IntervalBoundedExponentialBackOff(int, long) - Constructor for class com.google.cloud.dataflow.sdk.util.IntervalBoundedExponentialBackOff
IntervalWindow - Class in com.google.cloud.dataflow.sdk.transforms.windowing: An implementation of BoundedWindow that represents an interval from IntervalWindow.start (inclusive) to IntervalWindow.end (exclusive).
IntervalWindow(Instant, Instant) - Constructor for class com.google.cloud.dataflow.sdk.transforms.windowing.IntervalWindow: Creates a new IntervalWindow that represents the half-open time interval [start, end).
IntervalWindow(Instant, ReadableDuration) - Constructor for class com.google.cloud.dataflow.sdk.transforms.windowing.IntervalWindow
into(WindowFn<? super T, ?>) - Static method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window: Creates a Window PTransform that uses the given WindowFn to window the data.
into(WindowFn<? super T, ?>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window.Unbound: Returns a new Window PTransform that's like this transform but that will use the given WindowFn, and that has its input and output types bound.
IntraBundleParallelization - Class in com.google.cloud.dataflow.sdk.transforms: Provides multi-threading of DoFns, using threaded execution to process multiple elements concurrently within a bundle.
IntraBundleParallelization() - Constructor for class com.google.cloud.dataflow.sdk.transforms.IntraBundleParallelization
IntraBundleParallelization.Bound<InputT,OutputT> - Class in com.google.cloud.dataflow.sdk.transforms: A PTransform that, when applied to a PCollection<InputT>, invokes a user-specified DoFn<InputT, OutputT> on all its elements, with all its outputs collected into an output PCollection<OutputT>.
IntraBundleParallelization.MultiThreadedIntraBundleProcessingDoFn<InputT,OutputT> - Class in com.google.cloud.dataflow.sdk.transforms: A multi-threaded DoFn wrapper.
IntraBundleParallelization.Unbound - Class in com.google.cloud.dataflow.sdk.transforms: An incomplete IntraBundleParallelization transform, with unbound input/output types.
ints(String, Counter.AggregationKind) - Static method in class com.google.cloud.dataflow.sdk.util.common.Counter: Constructs a new Counter that aggregates Integer, values according to the desired aggregation kind.
InvalidWindows<W extends BoundedWindow> - Class in com.google.cloud.dataflow.sdk.transforms.windowing: A WindowFn that represents an invalid pipeline state.
InvalidWindows(String, WindowFn<?, W>) - Constructor for class com.google.cloud.dataflow.sdk.transforms.windowing.InvalidWindows
invokeClear(Trigger<W>.TriggerContext) - Method in class com.google.cloud.dataflow.sdk.util.ExecutableTrigger: Invoke clear for the current this trigger.
invokeElement(Trigger<W>.OnElementContext) - Method in class com.google.cloud.dataflow.sdk.util.ExecutableTrigger: Invoke the Trigger.onElement(com.google.cloud.dataflow.sdk.transforms.windowing.Trigger<W>.OnElementContext) method for this trigger, ensuring that the bits are properly updated if the trigger finishes.
invokeMerge(Trigger<W>.OnMergeContext) - Method in class com.google.cloud.dataflow.sdk.util.ExecutableTrigger: Invoke the Trigger.onMerge(com.google.cloud.dataflow.sdk.transforms.windowing.Trigger<W>.OnMergeContext) method for this trigger, ensuring that the bits are properly updated.
invokeProcessElement(WindowedValue<InputT>) - Method in class com.google.cloud.dataflow.sdk.util.DoFnRunner
invokeProcessElement(WindowedValue<InputT>) - Method in class com.google.cloud.dataflow.sdk.util.StreamingSideInputDoFnRunner
invokeTimer(Trigger<W>.OnTimerContext) - Method in class com.google.cloud.dataflow.sdk.util.ExecutableTrigger: Invoke the Trigger.onTimer(com.google.cloud.dataflow.sdk.transforms.windowing.Trigger<W>.OnTimerContext) method for this trigger, ensuring that the bits are properly updated if the trigger finishes.
IOChannelFactory - Interface in com.google.cloud.dataflow.sdk.util: Defines a factory for working with read and write channels.
IOChannelUtils - Class in com.google.cloud.dataflow.sdk.util: Provides utilities for creating read and write channels.
IOChannelUtils() - Constructor for class com.google.cloud.dataflow.sdk.util.IOChannelUtils
is(T) - Method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert.SingletonAssert: Deprecated.
replaced by DataflowAssert.SingletonAssert.isEqualTo(T)
IS_APP_ENGINE - Static variable in class com.google.cloud.dataflow.sdk.util.AppEngineEnvironment: Deprecated.
IS_GENERATED - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
IS_PAIR_LIKE - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
IS_STREAM_LIKE - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
IS_WRAPPER - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
isAbsolute() - Method in class com.google.cloud.dataflow.sdk.util.gcsfs.GcsPath
isAllowedLatenessSpecified() - Method in class com.google.cloud.dataflow.sdk.util.WindowingStrategy
isArray() - Method in class com.google.cloud.dataflow.sdk.values.TypeDescriptor: Returns true if this type is known to be an array type.
isAtSplitPoint() - Method in class com.google.cloud.dataflow.sdk.io.BlockBasedSource.BlockBasedReader: Returns true if the reader is at a split point.
isAtSplitPoint() - Method in class com.google.cloud.dataflow.sdk.io.CompressedSource.CompressedReader: Returns true only for the first record; compressed sources cannot be split.
isAtSplitPoint() - Method in class com.google.cloud.dataflow.sdk.io.OffsetBasedSource.OffsetBasedReader: Returns whether the current record is at a split point (i.e., whether the current record would be the first record to be read by a source with a specified start offset of OffsetBasedSource.OffsetBasedReader.getCurrentOffset()).
isBounded() - Method in class com.google.cloud.dataflow.sdk.values.PCollection
isClosed(ReduceFn.StateContext) - Method in class com.google.cloud.dataflow.sdk.util.TriggerRunner: Return true if the trigger is closed in the window corresponding to the specified state.
isCompatible(Trigger<?>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterPane
isCompatible(WindowFn) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.DaysWindows
isCompatible(WindowFn) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.MonthsWindows
isCompatible(WindowFn) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.YearsWindows
isCompatible(Trigger<?>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.DefaultTrigger
isCompatible(WindowFn<?, ?>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.FixedWindows
isCompatible(WindowFn<?, ?>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.GlobalWindows
isCompatible(WindowFn<?, ?>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.InvalidWindows: InvalidWindows objects with the same originalWindowFn are compatible.
isCompatible(WindowFn<?, ?>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Sessions
isCompatible(WindowFn<?, ?>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.SlidingWindows
isCompatible(Trigger<?>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.TimeTrigger
isCompatible(Trigger<?>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Trigger: Returns whether this performs the same triggering as the given Trigger.
isCompatible(WindowFn<?, ?>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.WindowFn: Returns whether this performs the same merging as the given WindowFn.
isCompatible(ExecutableTrigger<W>) - Method in class com.google.cloud.dataflow.sdk.util.ExecutableTrigger
isCompatibleWith(Counter<?>) - Method in class com.google.cloud.dataflow.sdk.util.common.Counter: Returns whether this Counter is compatible with that Counter.
isCompositeNode() - Method in class com.google.cloud.dataflow.sdk.runners.TransformTreeNode: Returns true if this node represents a composite transform that does not perform processing of its own, but merely encapsulates a sub-pipeline (which may be empty).
isDisjoint(IntervalWindow) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.IntervalWindow: Returns whether this window is disjoint from the given window.
isEmpty() - Method in class com.google.cloud.dataflow.sdk.runners.worker.DataflowSideInputReader
isEmpty() - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult
isEmpty() - Method in class com.google.cloud.dataflow.sdk.transforms.join.KeyedPCollectionTuple
isEmpty() - Method in class com.google.cloud.dataflow.sdk.util.BigQueryTableInserter: Checks if a table is empty.
isEmpty() - Method in class com.google.cloud.dataflow.sdk.util.DirectSideInputReader
isEmpty(ReduceFn<?, ?, ?, W>.Context) - Method in class com.google.cloud.dataflow.sdk.util.NonEmptyPanes: Return true if the current pane for the window in context is non-empty.
isEmpty() - Method in class com.google.cloud.dataflow.sdk.util.NullSideInputReader
isEmpty() - Method in class com.google.cloud.dataflow.sdk.util.PTuple: Returns true if this PTuple is empty.
isEmpty(ReduceFn.StateContext) - Method in class com.google.cloud.dataflow.sdk.util.ReduceFn: Returns true if the there is no buffered state.
isEmpty() - Method in interface com.google.cloud.dataflow.sdk.util.SideInputReader: Returns true if there are no side inputs in this reader.
isEmpty() - Method in interface com.google.cloud.dataflow.sdk.util.state.MergeableState: Return true if this state is empty.
isEmpty() - Method in class com.google.cloud.dataflow.sdk.util.StreamingModeExecutionContext.StreamingModeSideInputReader
isEmptyForTesting(State) - Method in class com.google.cloud.dataflow.sdk.util.state.InMemoryStateInternals: Return true if the given state is empty.
isEqualTo(T) - Method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert.SingletonAssert: Checks that the value of this SingletonAssert's view is equal to the expected value.
isFinish() - Method in enum com.google.cloud.dataflow.sdk.transforms.windowing.Trigger.MergeResult
isFinish() - Method in enum com.google.cloud.dataflow.sdk.transforms.windowing.Trigger.TriggerResult
isFinish() - Method in class com.google.cloud.dataflow.sdk.util.TriggerRunner.Result
isFinished() - Method in interface com.google.cloud.dataflow.sdk.transforms.windowing.Trigger.TriggerInfo: Returns true if the current trigger is marked finished.
isFinishedSpecifyingInternal() - Method in class com.google.cloud.dataflow.sdk.values.PValueBase: Returns whether this PValueBase has been finalized, and its core properties, e.g., name, can no longer be changed.
isFire() - Method in enum com.google.cloud.dataflow.sdk.transforms.windowing.Trigger.MergeResult
isFire() - Method in enum com.google.cloud.dataflow.sdk.transforms.windowing.Trigger.TriggerResult
isFire() - Method in class com.google.cloud.dataflow.sdk.util.TriggerRunner.Result
isFirst() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.PaneInfo: Return true if this is the first pane produced for the associated window.
isGcsPatternSupported(String) - Method in class com.google.cloud.dataflow.sdk.util.GcsUtil: Returns true if the given GCS pattern is supported otherwise fails with an exception.
isKeyTokenInvalidException(Throwable) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.StreamingDataflowWorker: Returns whether an exception was caused by a StreamingDataflowWorker.KeyTokenInvalidException.
isLast() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.PaneInfo: Return true if this is the last pane that will be produced in the associated window.
isLoggable(LogRecord) - Method in class com.google.cloud.dataflow.sdk.runners.worker.logging.DataflowWorkerLoggingHandler: Check if a LogRecord will be logged.
isMerging() - Method in interface com.google.cloud.dataflow.sdk.transforms.windowing.Trigger.TriggerInfo: Returns true if the windowing strategy of the current PCollection is a merging WindowFn.
isModeSpecified() - Method in class com.google.cloud.dataflow.sdk.util.WindowingStrategy
isNamespaceInUse(StateNamespace) - Method in class com.google.cloud.dataflow.sdk.util.state.StateTable
isNonMerging() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.NonMergingWindowFn
isNonMerging() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.WindowFn: Returns true if this WindowFn never needs to merge any windows.
isOpen() - Method in class com.google.cloud.dataflow.sdk.util.ShardingWritableByteChannel
isReadSeekEfficient(String) - Method in class com.google.cloud.dataflow.sdk.util.FileIOChannelFactory
isReadSeekEfficient(String) - Method in class com.google.cloud.dataflow.sdk.util.GcsIOChannelFactory
isReadSeekEfficient(String) - Method in interface com.google.cloud.dataflow.sdk.util.IOChannelFactory: Returns true if the channel created when invoking method IOChannelFactory.open(java.lang.String) for the given file specification is guaranteed to be of type SeekableByteChannel and if seeking into positions of the channel is recommended.
isRegisterByteSizeObserverCheap(Integer, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.BigEndianIntegerCoder: Returns true since registerByteSizeObserver() runs in constant time.
isRegisterByteSizeObserverCheap(Long, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.BigEndianLongCoder: Returns true since registerByteSizeObserver() runs in constant time.
isRegisterByteSizeObserverCheap(byte[], Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.ByteArrayCoder: Returns true since registerByteSizeObserver() runs in constant time.
isRegisterByteSizeObserverCheap(T, Coder.Context) - Method in interface com.google.cloud.dataflow.sdk.coders.Coder: Returns whether Coder.registerByteSizeObserver(T, com.google.cloud.dataflow.sdk.util.common.ElementByteSizeObserver, com.google.cloud.dataflow.sdk.coders.Coder.Context) cheap enough to call for every element, that is, if this Coder can calculate the byte size of the element to be coded in roughly constant time (or lazily).
isRegisterByteSizeObserverCheap(Double, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.DoubleCoder: Returns true since registerByteSizeObserver() runs in constant time.
isRegisterByteSizeObserverCheap(ReadableDuration, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.DurationCoder
isRegisterByteSizeObserverCheap(Instant, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.InstantCoder
isRegisterByteSizeObserverCheap(IterableT, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.IterableLikeCoder: Returns whether iterable can use lazy counting, since that requires minimal extra computation.
isRegisterByteSizeObserverCheap(KV<K, V>, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.KvCoder: Returns whether both keyCoder and valueCoder are considered not expensive.
isRegisterByteSizeObserverCheap(T, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.StandardCoder: StandardCoder requires elements to be fully encoded and copied into a byte stream to determine the byte size of the element, which is considered expensive.
isRegisterByteSizeObserverCheap(Integer, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.VarIntCoder: Returns true since registerByteSizeObserver() runs in constant time.
isRegisterByteSizeObserverCheap(Long, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.VarLongCoder: Returns true since registerByteSizeObserver() runs in constant time.
isRegisterByteSizeObserverCheap(Void, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.VoidCoder: Returns true since registerByteSizeObserver() runs in constant time.
isRegisterByteSizeObserverCheap(T) - Method in class com.google.cloud.dataflow.sdk.runners.worker.MapTaskExecutorFactory.ElementByteSizeObservableCoder
isRegisterByteSizeObserverCheap(T) - Method in interface com.google.cloud.dataflow.sdk.util.common.ElementByteSizeObservable: Returns whether ElementByteSizeObservable.registerByteSizeObserver(T, com.google.cloud.dataflow.sdk.util.common.ElementByteSizeObserver) is cheap enough to call for every element, that is, if this ElementByteSizeObservable can calculate the byte size of the element to be coded in roughly constant time (or lazily).
isRegisterByteSizeObserverCheap(TimerOrElement<T>, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.util.TimerOrElement.TimerOrElementCoder
isRootNode() - Method in class com.google.cloud.dataflow.sdk.runners.TransformTreeNode
isSplittable() - Method in class com.google.cloud.dataflow.sdk.io.CompressedSource: Determines whether a single file represented by this source is splittable.
isSplittable() - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSource: Determines whether a file represented by this source is can be split into bundles.
isStreaming() - Method in interface com.google.cloud.dataflow.sdk.options.StreamingOptions
isSubtypeOf(TypeDescriptor<?>) - Method in class com.google.cloud.dataflow.sdk.values.TypeDescriptor: Return true if this type is a subtype of the given type.
isSupertypeOf(TypeDescriptor<?>) - Method in class com.google.cloud.dataflow.sdk.values.TypeDescriptor: Returns true if this type is assignable from the given type.
isTerminal() - Method in enum com.google.cloud.dataflow.sdk.PipelineResult.State: Returns if the job state can no longer complete work.
isTimer() - Method in class com.google.cloud.dataflow.sdk.util.TimerOrElement: Returns whether this is a timer or an element.
isTriggerSpecified() - Method in class com.google.cloud.dataflow.sdk.util.WindowingStrategy
isUnknown() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.PaneInfo: Return true if there is no timing information for the current PaneInfo.
isWholeStream - Variable in class com.google.cloud.dataflow.sdk.coders.Coder.Context: Whether the encoded or decoded value fills the remainder of the output or input (resp.) record/stream contents.
IterableAssert(PTransform<PBegin, PCollectionView<Iterable<T>>>, Pipeline) - Constructor for class com.google.cloud.dataflow.sdk.testing.DataflowAssert.IterableAssert
IterableCoder<T> - Class in com.google.cloud.dataflow.sdk.coders: An IterableCoder encodes any Iterable as the sequence of its elements, encoded according to the component coder.
IterableCoder(Coder<T>) - Constructor for class com.google.cloud.dataflow.sdk.coders.IterableCoder
IterableLikeCoder<T,IterableT extends Iterable<T>> - Class in com.google.cloud.dataflow.sdk.coders: An abstract base class with functionality for assembling a Coder for a class that implements Iterable.
IterableLikeCoder(Coder<T>) - Constructor for class com.google.cloud.dataflow.sdk.coders.IterableLikeCoder
iterables() - Static method in class com.google.cloud.dataflow.sdk.transforms.Flatten: Returns a PTransform that takes a PCollection<Iterable<T>> and returns a PCollection<T> containing all the elements from all the Iterables.
iterableView(Pipeline, WindowingStrategy<?, W>, Coder<T>) - Static method in class com.google.cloud.dataflow.sdk.util.PCollectionViews: Returns a PCollectionView<Iterable<T>> capable of processing elements encoded using the provided Coder and windowed using the provided WindowingStrategy.
iterator() - Method in class com.google.cloud.dataflow.sdk.runners.worker.AvroByteReader
iterator(DatumReader<T>) - Method in class com.google.cloud.dataflow.sdk.runners.worker.AvroReader
iterator() - Method in class com.google.cloud.dataflow.sdk.runners.worker.AvroReader
iterator() - Method in class com.google.cloud.dataflow.sdk.runners.worker.BigQueryReader
iterator() - Method in class com.google.cloud.dataflow.sdk.runners.worker.ConcatReader
iterator() - Method in class com.google.cloud.dataflow.sdk.runners.worker.FileBasedReader
iterator() - Method in class com.google.cloud.dataflow.sdk.runners.worker.GroupingShuffleReader
iterator() - Method in class com.google.cloud.dataflow.sdk.runners.worker.InMemoryReader
iterator() - Method in class com.google.cloud.dataflow.sdk.runners.worker.PartitioningShuffleReader
iterator() - Method in class com.google.cloud.dataflow.sdk.runners.worker.UngroupedShuffleReader
iterator() - Method in class com.google.cloud.dataflow.sdk.util.common.CounterSet
iterator() - Method in class com.google.cloud.dataflow.sdk.util.common.ElementByteSizeObservableIterable: Returns a new iterator for this iterable.
iterator() - Method in interface com.google.cloud.dataflow.sdk.util.common.Reiterable
iterator() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.Reader: Returns a ReaderIterator that allows reading from this source.
iterator() - Method in class com.google.cloud.dataflow.sdk.util.gcsfs.GcsPath

J

JAXBCoder<T> - Class in com.google.cloud.dataflow.sdk.coders: A coder for JAXB annotated objects.
JobNameFactory() - Constructor for class com.google.cloud.dataflow.sdk.options.DataflowPipelineOptions.JobNameFactory
JobSpecification(Job, Map<AppliedPTransform<?, ?, ?>, String>) - Constructor for class com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.JobSpecification
jobToString(Job) - Static method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator
jsonStringToByteArray(String) - Static method in class com.google.cloud.dataflow.sdk.util.StringUtils: Converts the given string, encoded using StringUtils.byteArrayToJsonString(byte[]), into a byte array.

K

key - Variable in class com.google.cloud.dataflow.sdk.util.common.worker.KeyGroupedShuffleEntries
key() - Method in class com.google.cloud.dataflow.sdk.util.ReduceFn.Context: Return the key that is being processed.
key() - Method in class com.google.cloud.dataflow.sdk.util.TimerOrElement: If this is a timer, returns its key, otherwise throws an exception.
KeyedCombineFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Combine.KeyedCombineFn
KeyedPCollectionTuple<K> - Class in com.google.cloud.dataflow.sdk.transforms.join: An immutable tuple of keyed PCollections with key type K.
KeyedPCollectionTuple.TaggedKeyedPCollection<K,V> - Class in com.google.cloud.dataflow.sdk.transforms.join: A utility class to help ensure coherence of tag and input PCollection types.
KeyGroupedShuffleEntries - Class in com.google.cloud.dataflow.sdk.util.common.worker: A collection of ShuffleEntries, all with the same key.
KeyGroupedShuffleEntries(byte[], byte[], Reiterable<ShuffleEntry>) - Constructor for class com.google.cloud.dataflow.sdk.util.common.worker.KeyGroupedShuffleEntries
Keys<K> - Class in com.google.cloud.dataflow.sdk.transforms: Keys<K> takes a PCollection of KV<K, V>s and returns a PCollection<K> of the keys.
keySizer - Variable in class com.google.cloud.dataflow.sdk.util.common.worker.PartialGroupByKeyOperation.BufferingGroupingTable
KeyTokenInvalidException(String) - Constructor for exception com.google.cloud.dataflow.sdk.runners.worker.StreamingDataflowWorker.KeyTokenInvalidException
kind - Variable in class com.google.cloud.dataflow.sdk.util.common.Counter: The kind of aggregation function to apply to this counter.
KIND_PAIR - Static variable in class com.google.cloud.dataflow.sdk.util.CoderUtils: Coder class-name alias for a key-value type.
KIND_STREAM - Static variable in class com.google.cloud.dataflow.sdk.util.CoderUtils: Coder class-name alias for a stream type.
KV<K,V> - Class in com.google.cloud.dataflow.sdk.values: An immutable key/value pair.
KV.OrderByKey<K extends Comparable<? super K>,V> - Class in com.google.cloud.dataflow.sdk.values: Orders the KV by the key.
KV.OrderByValue<K,V extends Comparable<? super V>> - Class in com.google.cloud.dataflow.sdk.values: Orders the KV by the value.
KvCoder<K,V> - Class in com.google.cloud.dataflow.sdk.coders: A KvCoder encodes KVs.
KvCoderBase<T> - Class in com.google.cloud.dataflow.sdk.coders: A abstract base class for KvCoder.
KvCoderBase() - Constructor for class com.google.cloud.dataflow.sdk.coders.KvCoderBase
KvSwap<K,V> - Class in com.google.cloud.dataflow.sdk.transforms: KvSwap<K, V> takes a PCollection<KV<K, V>> and returns a PCollection<KV<V, K>>, where all the keys and values have been swapped.

L

largest(int) - Static method in class com.google.cloud.dataflow.sdk.transforms.Top: Returns a PTransform that takes an input PCollection<T> and returns a PCollection<List<T>> with a single element containing the largest count elements of the input PCollection<T>, in decreasing order, sorted according to their natural order.
Largest() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Top.Largest
largestPerKey(int) - Static method in class com.google.cloud.dataflow.sdk.transforms.Top: Returns a PTransform that takes an input PCollection<KV<K, V>> and returns a PCollection<KV<K, List<V>>> that contains an output element mapping each distinct key in the input PCollection to the largest count values associated with that key in the input PCollection<KV<K, V>>, in decreasing order, sorted according to their natural order.
LargestUnique(long) - Constructor for class com.google.cloud.dataflow.sdk.transforms.ApproximateUnique.ApproximateUniqueCombineFn.LargestUnique: Creates a heap to track the largest sampleSize elements.
leaseRemainingTime(long) - Method in class com.google.cloud.dataflow.sdk.util.common.worker.WorkProgressUpdater: Computes the amount of time left, in milliseconds, before a lease with the specified expiration timestamp expires.
leaveCompositeTransform(TransformTreeNode) - Method in interface com.google.cloud.dataflow.sdk.Pipeline.PipelineVisitor: Called for each composite transform after all of its component transforms and their ouputs have been visited.
leaveCompositeTransform(TransformTreeNode) - Method in class com.google.cloud.dataflow.sdk.runners.RecordingPipelineVisitor
length() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.ShuffleEntry: Returns the size of this entry in bytes, excluding position.
lessThan(T) - Static method in class com.google.cloud.dataflow.sdk.transforms.Filter: Returns a PTransform that takes an input PCollection<T> and returns a PCollection<T> with elements that are less than a given value, based on the elements' natural ordering.
lessThanEq(T) - Static method in class com.google.cloud.dataflow.sdk.transforms.Filter: Returns a PTransform that takes an input PCollection<T> and returns a PCollection<T> with elements that are less than or equal to a given value, based on the elements' natural ordering.
ListCoder<T> - Class in com.google.cloud.dataflow.sdk.coders: A ListCoder encodes Lists.
listFuture(ByteString, String, Coder<T>) - Method in class com.google.cloud.dataflow.sdk.util.state.WindmillStateReader
ListOutputManager() - Constructor for class com.google.cloud.dataflow.sdk.util.DoFnRunner.ListOutputManager
longs(String, Counter.AggregationKind) - Static method in class com.google.cloud.dataflow.sdk.util.common.Counter: Constructs a new Counter that aggregates Long values according to the desired aggregation kind.
longsGlobally() - Static method in class com.google.cloud.dataflow.sdk.transforms.Max: Returns a PTransform that takes an input PCollection<Long> and returns a PCollection<Long> whose contents is the maximum of the input PCollection's elements, or Long.MIN_VALUE if there are no elements.
longsGlobally() - Static method in class com.google.cloud.dataflow.sdk.transforms.Min: Returns a PTransform that takes an input PCollection<Long> and returns a PCollection<Long> whose contents is the minimum of the input PCollection's elements, or Long.MAX_VALUE if there are no elements.
longsGlobally() - Static method in class com.google.cloud.dataflow.sdk.transforms.Sum: Returns a PTransform that takes an input PCollection<Long> and returns a PCollection<Long> whose contents is the sum of the input PCollection's elements, or 0 if there are no elements.
longsPerKey() - Static method in class com.google.cloud.dataflow.sdk.transforms.Max: Returns a PTransform that takes an input PCollection<KV<K, Long>> and returns a PCollection<KV<K, Long>> that contains an output element mapping each distinct key in the input PCollection to the maximum of the values associated with that key in the input PCollection.
longsPerKey() - Static method in class com.google.cloud.dataflow.sdk.transforms.Min: Returns a PTransform that takes an input PCollection<KV<K, Long>> and returns a PCollection<KV<K, Long>> that contains an output element mapping each distinct key in the input PCollection to the minimum of the values associated with that key in the input PCollection.
longsPerKey() - Static method in class com.google.cloud.dataflow.sdk.transforms.Sum: Returns a PTransform that takes an input PCollection<KV<K, Long>> and returns a PCollection<KV<K, Long>> that contains an output element mapping each distinct key in the input PCollection to the sum of the values associated with that key in the input PCollection.

M

main(String[]) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.DataflowWorkerHarness: Fetches and processes work units from the Dataflow service.
main(String[]) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.StreamingDataflowWorker
main(String[]) - Static method in class com.google.cloud.dataflow.sdk.util.ApiSurface
makeCloudEncoding(String, CloudObject...) - Static method in class com.google.cloud.dataflow.sdk.util.CoderUtils
makeOutputPair(Object, Object) - Method in class com.google.cloud.dataflow.sdk.runners.worker.MapTaskExecutorFactory.PairInfo
makeOutputPair(Object, Object) - Method in interface com.google.cloud.dataflow.sdk.util.common.worker.PartialGroupByKeyOperation.PairInfo
makeSystemTagInternal(StateTag<StateT>) - Static method in class com.google.cloud.dataflow.sdk.util.state.StateTags: Convert an arbitrary StateTag to a system-internal tag that is guaranteed not to collide with any user tags.
MapAggregatorValues<T> - Class in com.google.cloud.dataflow.sdk.runners.dataflow: An AggregatorValues implementation that is backed by an in-memory map.
MapAggregatorValues(Map<String, T>) - Constructor for class com.google.cloud.dataflow.sdk.runners.dataflow.MapAggregatorValues
MapCoder<K,V> - Class in com.google.cloud.dataflow.sdk.coders: A MapCoder encodes Maps.
MapCoderBase<T> - Class in com.google.cloud.dataflow.sdk.coders: A abstract base class for MapCoder.
MapCoderBase() - Constructor for class com.google.cloud.dataflow.sdk.coders.MapCoderBase
mappedTo(SerializableFunction<Instant, Instant>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.TimeTrigger: Adjust the time at which the trigger will fire.
MapTaskExecutor - Class in com.google.cloud.dataflow.sdk.util.common.worker: An executor for a map task, defined by a list of Operations.
MapTaskExecutor(List<Operation>, CounterSet, StateSampler) - Constructor for class com.google.cloud.dataflow.sdk.util.common.worker.MapTaskExecutor: Creates a new MapTaskExecutor.
MapTaskExecutorFactory - Class in com.google.cloud.dataflow.sdk.runners.worker: Creates a MapTaskExecutor from a MapTask definition.
MapTaskExecutorFactory() - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.MapTaskExecutorFactory
MapTaskExecutorFactory.CoderSizeEstimator<T> - Class in com.google.cloud.dataflow.sdk.runners.worker: Implements PGBKOp.SizeEstimator via Coder.
MapTaskExecutorFactory.ElementByteSizeObservableCoder<T> - Class in com.google.cloud.dataflow.sdk.runners.worker: Adapts a Coder to the ElementByteSizeObservable interface.
MapTaskExecutorFactory.PairInfo - Class in com.google.cloud.dataflow.sdk.runners.worker: Implements PGBKOp.PairInfo via KVs.
MapTaskExecutorFactory.ValueCombiner<K,InputT,AccumT,OutputT> - Class in com.google.cloud.dataflow.sdk.runners.worker: Implements PGBKOp.Combiner via Combine.KeyedCombineFn.
MapTaskExecutorFactory.WindowingCoderGroupingKeyCreator<K> - Class in com.google.cloud.dataflow.sdk.runners.worker: Implements PGBKOp.GroupingKeyCreator via Coder.
mapView(Pipeline, WindowingStrategy<?, W>, Coder<KV<K, V>>) - Static method in class com.google.cloud.dataflow.sdk.util.PCollectionViews: Returns a PCollectionView<Map<K, V>> capable of processing elements encoded using the provided Coder and windowed using the provided WindowingStrategy.
match(String) - Method in class com.google.cloud.dataflow.sdk.util.FileIOChannelFactory
match(String) - Method in class com.google.cloud.dataflow.sdk.util.GcsIOChannelFactory
match(String) - Method in interface com.google.cloud.dataflow.sdk.util.IOChannelFactory: Matches a specification, which may contain globs, against available resources.
matches(String) - Method in enum com.google.cloud.dataflow.sdk.io.TextIO.CompressionType: Determine if a given filename matches a compression type based on its extension.
Max - Class in com.google.cloud.dataflow.sdk.transforms: PTransforms for computing the maximum of the elements in a PCollection, or the maximum of the values associated with each key in a PCollection of KVs.
Max() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Max
Max.MaxDoubleFn - Class in com.google.cloud.dataflow.sdk.transforms: A CombineFn that computes the maximum of a collection of Doubles, useful as an argument to Combine.globally(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>) or Combine.perKey(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>).
Max.MaxFn<T> - Class in com.google.cloud.dataflow.sdk.transforms: A CombineFn that computes the maximum of a collection of elements of type T using an arbitrary Comparator, useful as an argument to Combine.globally(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>) or Combine.perKey(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>).
Max.MaxIntegerFn - Class in com.google.cloud.dataflow.sdk.transforms: A CombineFn that computes the maximum of a collection of Integers, useful as an argument to Combine.globally(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>) or Combine.perKey(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>).
Max.MaxLongFn - Class in com.google.cloud.dataflow.sdk.transforms: A CombineFn that computes the maximum of a collection of Longs, useful as an argument to Combine.globally(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>) or Combine.perKey(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>).
MaxDoubleFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Max.MaxDoubleFn
MaxIntegerFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Max.MaxIntegerFn
MaxLongFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Max.MaxLongFn
maxNumRecords(int) - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read.Bound: Sets the maximum number of records that will be read from Pubsub.
maxNumRecords(int) - Static method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read: Sets the maximum number of records that will be read from Pubsub.
maxReadTime(Duration) - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read.Bound: Sets the maximum duration during which records will be read from Pubsub.
maxReadTime(Duration) - Static method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read: Sets the maximum duration during which records will be read from Pubsub.
maxTimestamp() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.BoundedWindow: Returns the upper bound of timestamps for values in this window.
maxTimestamp() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.GlobalWindow
maxTimestamp() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.IntervalWindow: Returns the largest timestamp that can be included in this window.
Mean - Class in com.google.cloud.dataflow.sdk.transforms: PTransforms for computing the arithmetic mean (a.k.a.
merge(WindowedValue<K>, Iterable<AccumT>) - Method in class com.google.cloud.dataflow.sdk.runners.worker.MapTaskExecutorFactory.ValueCombiner
merge(Collection<W>, W) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.WindowFn.MergeContext: Signals to the framework that the windows in toBeMerged should be merged together to form mergeResult.
merge(K, Iterable<AccumT>) - Method in interface com.google.cloud.dataflow.sdk.util.common.worker.PartialGroupByKeyOperation.Combiner
MergeableState<InputT,OutputT> - Interface in com.google.cloud.dataflow.sdk.util.state: State that is automatically mergeable and supports buffering values.
mergeAccumulator(AccumT) - Method in interface com.google.cloud.dataflow.sdk.transforms.Combine.AccumulatingCombineFn.Accumulator: Adds the input values represented by the given accumulator into this accumulator.
mergeAccumulators(Iterable<ApproximateUnique.ApproximateUniqueCombineFn.LargestUnique>) - Method in class com.google.cloud.dataflow.sdk.transforms.ApproximateUnique.ApproximateUniqueCombineFn
mergeAccumulators(Iterable<AccumT>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.AccumulatingCombineFn
mergeAccumulators(Iterable<double[]>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineDoubleFn
mergeAccumulators(Iterable<Combine.Holder<V>>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineFn
mergeAccumulators(Iterable<int[]>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineIntegerFn
mergeAccumulators(Iterable<long[]>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineLongFn
mergeAccumulators(Iterable<AccumT>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.CombineFn: Returns an accumulator representing the accumulation of all the input values accumulated in the merging accumulators.
mergeAccumulators(Iterable<List<V>>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.IterableCombineFn
mergeAccumulators(K, Iterable<AccumT>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.KeyedCombineFn: Returns an accumulator representing the accumulation of all the input values accumulated in the merging accumulators.
mergeAccumulators(Iterable<Top.BoundedHeap<KV<Integer, T>, SerializableComparator<KV<Integer, T>>>>) - Method in class com.google.cloud.dataflow.sdk.transforms.Sample.FixedSizedSampleFn
mergeAccumulators(Iterable<List<T>>) - Method in class com.google.cloud.dataflow.sdk.transforms.View.Concatenate
MergeContext() - Constructor for class com.google.cloud.dataflow.sdk.transforms.windowing.WindowFn.MergeContext
mergedState(Iterable<StateNamespace>, StateNamespace, StateTag<T>) - Method in class com.google.cloud.dataflow.sdk.util.state.MergingStateInternals
mergedState(Iterable<StateNamespace>, StateNamespace, StateTag<T>) - Method in interface com.google.cloud.dataflow.sdk.util.state.StateInternals: Return state that reads from all the source namespaces.
mergeIfAppropriate(W, ActiveWindowSet.MergeCallback<W>) - Method in interface com.google.cloud.dataflow.sdk.util.ActiveWindowSet: Invoke merge on the associated WindowFn, and return true if the window still exists afterwards.
mergeIfAppropriate(W, ActiveWindowSet.MergeCallback<W>) - Method in class com.google.cloud.dataflow.sdk.util.MergingActiveWindowSet
mergeIfAppropriate(W, ActiveWindowSet.MergeCallback<W>) - Method in class com.google.cloud.dataflow.sdk.util.NonMergingActiveWindowSet
MergeOverlappingIntervalWindows - Class in com.google.cloud.dataflow.sdk.transforms.windowing: A WindowFn that merges overlapping IntervalWindows.
MergeOverlappingIntervalWindows() - Constructor for class com.google.cloud.dataflow.sdk.transforms.windowing.MergeOverlappingIntervalWindows
mergeWindows(WindowFn<Object, W>.MergeContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.InvalidWindows
mergeWindows(WindowFn<?, IntervalWindow>.MergeContext) - Static method in class com.google.cloud.dataflow.sdk.transforms.windowing.MergeOverlappingIntervalWindows: Merge overlapping intervals.
mergeWindows(WindowFn<T, W>.MergeContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.NonMergingWindowFn
mergeWindows(WindowFn<Object, IntervalWindow>.MergeContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Sessions
mergeWindows(WindowFn<T, W>.MergeContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.WindowFn: Does whatever merging of windows is necessary.
MergingActiveWindowSet<W extends BoundedWindow> - Class in com.google.cloud.dataflow.sdk.util: Implementation of ActiveWindowSet used with WindowFns that support merging.
MergingActiveWindowSet(WindowFn<Object, W>, StateInternals) - Constructor for class com.google.cloud.dataflow.sdk.util.MergingActiveWindowSet
MergingStateInternals - Class in com.google.cloud.dataflow.sdk.util.state: Abstract implementation of StateInternals that provides MergingStateInternals.mergedState(java.lang.Iterable<com.google.cloud.dataflow.sdk.util.state.StateNamespace>, com.google.cloud.dataflow.sdk.util.state.StateNamespace, com.google.cloud.dataflow.sdk.util.state.StateTag<T>) in terms of StateInternals.state(com.google.cloud.dataflow.sdk.util.state.StateNamespace, com.google.cloud.dataflow.sdk.util.state.StateTag<T>).
MergingStateInternals() - Constructor for class com.google.cloud.dataflow.sdk.util.state.MergingStateInternals
mergingWindows() - Method in class com.google.cloud.dataflow.sdk.util.ReduceFn.OnMergeContext: Return the collection of windows that were merged.
METHOD_FORMATTER - Static variable in class com.google.cloud.dataflow.sdk.util.common.ReflectHelpers: A Function that turns a method into a simple method signature.
Metric<T> - Class in com.google.cloud.dataflow.sdk.util.common: A metric (e.g., CPU usage) that can be reported by a worker.
Metric(String, T) - Constructor for class com.google.cloud.dataflow.sdk.util.common.Metric
Metric.DoubleMetric - Class in com.google.cloud.dataflow.sdk.util.common: A double-valued Metric.
MetricTrackingWindmillServerStub - Class in com.google.cloud.dataflow.sdk.runners.worker: Wrapper around a WindmillServerStub that tracks metrics for the number of in-flight requests.
MetricTrackingWindmillServerStub(WindmillServerStub) - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.MetricTrackingWindmillServerStub
mimeType - Variable in class com.google.cloud.dataflow.sdk.io.FileBasedSink.FileBasedWriter: The MIME type used in the creation of the output channel (if the file system supports it).
MimeTypes - Class in com.google.cloud.dataflow.sdk.util: Constants representing various mime types.
MimeTypes() - Constructor for class com.google.cloud.dataflow.sdk.util.MimeTypes
Min - Class in com.google.cloud.dataflow.sdk.transforms: PTransforms for computing the minimum of the elements in a PCollection, or the minimum of the values associated with each key in a PCollection of KVs.
Min() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Min
Min.MinDoubleFn - Class in com.google.cloud.dataflow.sdk.transforms: A CombineFn that computes the minimum of a collection of Doubles, useful as an argument to Combine.globally(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>) or Combine.perKey(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>).
Min.MinFn<T> - Class in com.google.cloud.dataflow.sdk.transforms: A CombineFn that computes the maximum of a collection of elements of type T using an arbitrary Comparator, useful as an argument to Combine.globally(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>) or Combine.perKey(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>).
Min.MinIntegerFn - Class in com.google.cloud.dataflow.sdk.transforms: A CombineFn that computes the minimum of a collection of Integers, useful as an argument to Combine.globally(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>) or Combine.perKey(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>).
Min.MinLongFn - Class in com.google.cloud.dataflow.sdk.transforms: A CombineFn that computes the minimum of a collection of Longs, useful as an argument to Combine.globally(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>) or Combine.perKey(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>).
MinDoubleFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Min.MinDoubleFn
MinIntegerFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Min.MinIntegerFn
MinLongFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Min.MinLongFn
modifyEnvironmentBeforeSubmission(Environment) - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineRunnerHooks: Allows the user to modify the environment of their job before their job is submitted to the service for execution.
MonitoringUtil - Class in com.google.cloud.dataflow.sdk.util: A helper class for monitoring jobs submitted to the service.
MonitoringUtil(String, Dataflow) - Constructor for class com.google.cloud.dataflow.sdk.util.MonitoringUtil: Construct a helper for monitoring.
MonitoringUtil.JobMessagesHandler - Interface in com.google.cloud.dataflow.sdk.util: An interface that can be used for defining callbacks to receive a list of JobMessages containing monitoring information.
MonitoringUtil.PrintHandler - Class in com.google.cloud.dataflow.sdk.util: A handler that prints monitoring messages to a stream.
MonitoringUtil.TimeStampComparator - Class in com.google.cloud.dataflow.sdk.util: Comparator for sorting rows in increasing order based on timestamp.
months(int) - Static method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows: Returns a WindowFn that windows elements into periods measured by months.
multimapView(Pipeline, WindowingStrategy<?, W>, Coder<KV<K, V>>) - Static method in class com.google.cloud.dataflow.sdk.util.PCollectionViews: Returns a PCollectionView<Map<K, Iterable<V>>> capable of processing elements encoded using the provided Coder and windowed using the provided WindowingStrategy.
MultiThreadedIntraBundleProcessingDoFn(DoFn<InputT, OutputT>, int) - Constructor for class com.google.cloud.dataflow.sdk.transforms.IntraBundleParallelization.MultiThreadedIntraBundleProcessingDoFn
MutationDetector - Interface in com.google.cloud.dataflow.sdk.util: An object for detecting illegal mutations.
MutationDetectors - Class in com.google.cloud.dataflow.sdk.util: Static methods for creating and working with MutationDetector.

N

name - Variable in class com.google.cloud.dataflow.sdk.transforms.PTransform: The base name of this PTransform, e.g., from ParDo.named(String), or from defaults, or null if not yet assigned.
name - Variable in class com.google.cloud.dataflow.sdk.util.common.Counter: The name of this counter.
named(String) - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Read.Bound: Returns a new AvroIO.Read PTransform that's like this one but with the given step name.
named(String) - Static method in class com.google.cloud.dataflow.sdk.io.AvroIO.Read: Returns an AvroIO.Read PTransform with the given step name.
named(String) - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound: Returns a new AvroIO.Write PTransform that's like this one but with the given step name.
named(String) - Static method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write: Returns an AvroIO.Write PTransform with the given step name.
named(String) - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Read.Bound: Sets the name associated with this transformation.
named(String) - Static method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Read
named(String) - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.Bound: Sets the name associated with this transformation.
named(String) - Static method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write: Sets the name associated with this transformation.
named(String) - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read.Bound: Returns a new PubsubIO.Read PTransform that's like this one but with the given step name.
named(String) - Static method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read
named(String) - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Write.Bound: Returns a new PubsubIO.Write PTransform that's like this one but with the given step name.
named(String) - Static method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Write
named(String) - Method in class com.google.cloud.dataflow.sdk.io.Read.Bounded: Returns a new Bounded PTransform that's like this one but has the given name.
named(String) - Static method in class com.google.cloud.dataflow.sdk.io.Read: Returns a new Read PTransform builder with the given name.
named(String) - Method in class com.google.cloud.dataflow.sdk.io.Read.Unbounded: Returns a new Unbounded PTransform that's like this one but has the given name.
named(String) - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Read.Bound: Returns a new TextIO.Read PTransform that's like this one but with the given step name.
named(String) - Static method in class com.google.cloud.dataflow.sdk.io.TextIO.Read: Returns a TextIO.Read PTransform with the given step name.
named(String) - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Write.Bound: Returns a new TextIO.Write PTransform that's like this one but with the given step name.
named(String) - Static method in class com.google.cloud.dataflow.sdk.io.TextIO.Write: Returns a TextIO.Write PTransform with the given step name.
named(String) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.Globally: Return a new Globally transform that's like this transform but with the specified name.
named(String) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.PerKey: Return a new Globally transform that's like this transform but with the specified name.
named(String) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.Bound: Returns a new ParDo PTransform that's like this PTransform but with the specified name.
named(String) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.BoundMulti: Returns a new multi-output ParDo PTransform that's like this PTransform but with the specified name.
named(String) - Static method in class com.google.cloud.dataflow.sdk.transforms.ParDo: Creates a ParDo PTransform with the given name.
named(String) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.Unbound: Returns a new ParDo transform that's like this transform but with the specified name.
named(String) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.UnboundMulti: Returns a new multi-output ParDo transform that's like this transform but with the specified name.
named(String) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window.Bound: Returns a new Window PTransform that's like this PTransform but with the specified name.
named(String) - Static method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window: Creates a Window PTransform with the given name.
named(String) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window.Unbound: Returns a new Window transform that's like this transform but with the specified name.
naturalOrder(T) - Static method in class com.google.cloud.dataflow.sdk.transforms.Max.MaxFn
naturalOrder() - Static method in class com.google.cloud.dataflow.sdk.transforms.Max.MaxFn
naturalOrder(T) - Static method in class com.google.cloud.dataflow.sdk.transforms.Min.MinFn
naturalOrder() - Static method in class com.google.cloud.dataflow.sdk.transforms.Min.MinFn
needsValidation() - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Read.Bound
needsValidation() - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound
needsValidation() - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Read.Bound
needsValidation() - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Write.Bound
NESTED - Static variable in class com.google.cloud.dataflow.sdk.coders.Coder.Context: The nested context.
nested() - Method in class com.google.cloud.dataflow.sdk.coders.Coder.Context
newBigQueryClient(BigQueryOptions) - Static method in class com.google.cloud.dataflow.sdk.util.Transport: Returns a BigQuery client builder.
newDataflowClient(DataflowPipelineOptions) - Static method in class com.google.cloud.dataflow.sdk.util.Transport: Returns a Google Cloud Dataflow client builder.
newPubsubClient(DataflowPipelineOptions) - Static method in class com.google.cloud.dataflow.sdk.util.Transport: Returns a Pubsub client builder.
newRawDataflowClient(DataflowPipelineOptions) - Static method in class com.google.cloud.dataflow.sdk.util.Transport: Returns a Dataflow client that does not automatically retry failed requests.
newReaderIteratorForFiles(IOChannelFactory, Collection<String>) - Method in class com.google.cloud.dataflow.sdk.runners.worker.FileBasedReader: Returns a new iterator for elements in the given files.
newReaderIteratorForFiles(IOChannelFactory, Collection<String>) - Method in class com.google.cloud.dataflow.sdk.runners.worker.TextReader
newReaderIteratorForRangeInFile(IOChannelFactory, String, long, Long) - Method in class com.google.cloud.dataflow.sdk.runners.worker.FileBasedReader: Returns a new iterator for elements in the given range in the given file.
newReaderIteratorForRangeInFile(IOChannelFactory, String, long, Long) - Method in class com.google.cloud.dataflow.sdk.runners.worker.TextReader
newStorageClient(GcsOptions) - Static method in class com.google.cloud.dataflow.sdk.util.Transport: Returns a Cloud Storage client builder.
newWith(List<SerializableFunction<Instant, Instant>>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterProcessingTime
newWith(List<SerializableFunction<Instant, Instant>>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.TimeTrigger: Method to create an updated version of this TimeTrigger modified to use the specified transform.
next() - Method in class com.google.cloud.dataflow.sdk.util.BigQueryTableRowIterator
next() - Method in class com.google.cloud.dataflow.sdk.util.common.ForwardingReiterator
next() - Method in class com.google.cloud.dataflow.sdk.util.common.PeekingReiterator
next() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.AbstractBoundedReaderIterator
next() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.GroupingShuffleEntryIterator
next() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.ProgressTrackingReiterator
next() - Method in interface com.google.cloud.dataflow.sdk.util.common.worker.Reader.ReaderIterator: Returns the next element.
nextBackOffMillis() - Method in class com.google.cloud.dataflow.sdk.util.AttemptAndTimeBoundedExponentialBackOff
nextBackOffMillis() - Method in class com.google.cloud.dataflow.sdk.util.AttemptBoundedExponentialBackOff
nextBackOffMillis() - Method in class com.google.cloud.dataflow.sdk.util.IntervalBoundedExponentialBackOff
nextElement - Variable in class com.google.cloud.dataflow.sdk.runners.worker.FileBasedReader.FileBasedIterator
nextImpl() - Method in class com.google.cloud.dataflow.sdk.runners.worker.FileBasedReader.FileBasedIterator
nextImpl() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.AbstractBoundedReaderIterator
nextProgressReportInterval(long, long) - Method in class com.google.cloud.dataflow.sdk.util.common.worker.WorkProgressUpdater: Computes the time before sending the next work progress update making sure that it falls between the [WorkProgressUpdater.getMinReportingInterval(), WorkProgressUpdater.getMaxReportingInterval()] interval.
nextStartPosition - Variable in class com.google.cloud.dataflow.sdk.util.common.worker.ShuffleBatchReader.Batch
NO_FIRING - Static variable in class com.google.cloud.dataflow.sdk.transforms.windowing.PaneInfo: PaneInfo to use for elements on (and before) initial window assignemnt (including elements read from sources) before they have passed through a GroupByKey and are associated with a particular trigger firing.
NON_PARALLEL_INPUTS - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
NonDeterministicException(Coder<?>, String, Coder.NonDeterministicException) - Constructor for class com.google.cloud.dataflow.sdk.coders.Coder.NonDeterministicException
NonDeterministicException(Coder<?>, String) - Constructor for class com.google.cloud.dataflow.sdk.coders.Coder.NonDeterministicException
NonDeterministicException(Coder<?>, List<String>) - Constructor for class com.google.cloud.dataflow.sdk.coders.Coder.NonDeterministicException
NonDeterministicException(Coder<?>, List<String>, Coder.NonDeterministicException) - Constructor for class com.google.cloud.dataflow.sdk.coders.Coder.NonDeterministicException
NonEmptyPanes<W extends BoundedWindow> - Class in com.google.cloud.dataflow.sdk.util: Tracks which windows have non-empty panes.
NonEmptyPanes() - Constructor for class com.google.cloud.dataflow.sdk.util.NonEmptyPanes
NonMergingActiveWindowSet<W extends BoundedWindow> - Class in com.google.cloud.dataflow.sdk.util: Implementation of ActiveWindowSet used with WindowFns that don't support merging.
NonMergingActiveWindowSet() - Constructor for class com.google.cloud.dataflow.sdk.util.NonMergingActiveWindowSet
NonMergingWindowFn<T,W extends BoundedWindow> - Class in com.google.cloud.dataflow.sdk.transforms.windowing: Abstract base class for WindowFns that do not merge windows.
NonMergingWindowFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.windowing.NonMergingWindowFn
NoopCredentialFactory - Class in com.google.cloud.dataflow.sdk.util: Construct an oauth credential to be used by the SDK and the SDK workers.
NoopCredentialFactory() - Constructor for class com.google.cloud.dataflow.sdk.util.NoopCredentialFactory
noopMutationDetector() - Static method in class com.google.cloud.dataflow.sdk.util.MutationDetectors: Creates a new MutationDetector that always succeeds.
NoopPathValidator - Class in com.google.cloud.dataflow.sdk.util: Noop implementation of PathValidator.
normalize() - Method in class com.google.cloud.dataflow.sdk.util.gcsfs.GcsPath
noteOutput(WindowedValue<?>) - Method in class com.google.cloud.dataflow.sdk.util.BaseExecutionContext: Hook for subclasses to implement that will be called whenever DoFn.Context.output(OutputT) is called.
noteOutput(WindowedValue<?>) - Method in class com.google.cloud.dataflow.sdk.util.BaseExecutionContext.StepContext
noteOutput(WindowedValue<?>) - Method in class com.google.cloud.dataflow.sdk.util.DirectModeExecutionContext
noteOutput(WindowedValue<?>) - Method in interface com.google.cloud.dataflow.sdk.util.ExecutionContext: Hook for subclasses to implement that will be called whenever DoFn.Context.output(OutputT) is called.
noteOutput(WindowedValue<?>) - Method in interface com.google.cloud.dataflow.sdk.util.ExecutionContext.StepContext: Hook for subclasses to implement that will be called whenever DoFn.Context.output(OutputT) is called.
noteSideOutput(TupleTag<?>, WindowedValue<?>) - Method in class com.google.cloud.dataflow.sdk.util.BaseExecutionContext: Hook for subclasses to implement that will be called whenever DoFn.Context.sideOutput(com.google.cloud.dataflow.sdk.values.TupleTag<T>, T) is called.
noteSideOutput(TupleTag<?>, WindowedValue<?>) - Method in class com.google.cloud.dataflow.sdk.util.BaseExecutionContext.StepContext
noteSideOutput(TupleTag<?>, WindowedValue<?>) - Method in class com.google.cloud.dataflow.sdk.util.DirectModeExecutionContext
noteSideOutput(TupleTag<?>, WindowedValue<?>) - Method in interface com.google.cloud.dataflow.sdk.util.ExecutionContext: Hook for subclasses to implement that will be called whenever DoFn.Context.sideOutput(com.google.cloud.dataflow.sdk.values.TupleTag<T>, T) is called.
noteSideOutput(TupleTag<?>, WindowedValue<?>) - Method in interface com.google.cloud.dataflow.sdk.util.ExecutionContext.StepContext: Hook for subclasses to implement that will be called whenever DoFn.Context.sideOutput(com.google.cloud.dataflow.sdk.values.TupleTag<T>, T) is called.
notifyElementRead(long) - Method in class com.google.cloud.dataflow.sdk.util.common.worker.GroupingShuffleEntryIterator: Notifies observers about a new element read.
notifyElementRead(long) - Method in class com.google.cloud.dataflow.sdk.util.common.worker.Reader: Utility method to notify observers about a new element, which has been read by this Reader, and its size in bytes.
notifyValueReturned(long) - Method in class com.google.cloud.dataflow.sdk.util.common.ElementByteSizeObservableIterator
NULL_CHARACTER - Static variable in class com.google.cloud.dataflow.sdk.runners.worker.OrderedCode
NullSideInputReader - Class in com.google.cloud.dataflow.sdk.util: A SideInputReader representing a well-defined set of views, but not storing any values for them.
NUM_SHARDS - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames

O

OBJECT_TYPE_NAME - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
of(Class<T>) - Static method in class com.google.cloud.dataflow.sdk.coders.AvroCoder: Returns an AvroCoder instance for the provided element class.
of(Schema) - Static method in class com.google.cloud.dataflow.sdk.coders.AvroCoder: Returns an AvroCoder instance for the Avro schema.
of(Class<T>, Schema) - Static method in class com.google.cloud.dataflow.sdk.coders.AvroCoder: Returns an AvroCoder instance for the provided element type using the provided Avro schema.
of(String, String) - Static method in class com.google.cloud.dataflow.sdk.coders.AvroCoder
of() - Static method in class com.google.cloud.dataflow.sdk.coders.BigEndianIntegerCoder
of() - Static method in class com.google.cloud.dataflow.sdk.coders.BigEndianLongCoder
of() - Static method in class com.google.cloud.dataflow.sdk.coders.ByteArrayCoder
of(Coder<T>) - Static method in class com.google.cloud.dataflow.sdk.coders.CollectionCoder
of(List<Object>) - Static method in class com.google.cloud.dataflow.sdk.coders.CollectionCoder
of(String, String, String, String) - Static method in class com.google.cloud.dataflow.sdk.coders.CustomCoder
of(Coder<IntermediateT>, DelegateCoder.CodingFunction<T, IntermediateT>, DelegateCoder.CodingFunction<IntermediateT, T>) - Static method in class com.google.cloud.dataflow.sdk.coders.DelegateCoder
of() - Static method in class com.google.cloud.dataflow.sdk.coders.DoubleCoder
of() - Static method in class com.google.cloud.dataflow.sdk.coders.DurationCoder
of() - Static method in class com.google.cloud.dataflow.sdk.coders.EntityCoder
of() - Static method in class com.google.cloud.dataflow.sdk.coders.InstantCoder
of(Coder<T>) - Static method in class com.google.cloud.dataflow.sdk.coders.IterableCoder
of(List<Coder<?>>) - Static method in class com.google.cloud.dataflow.sdk.coders.IterableCoder
of(Class<T>) - Static method in class com.google.cloud.dataflow.sdk.coders.JAXBCoder: Create a coder for a given type of JAXB annotated objects.
of(String) - Static method in class com.google.cloud.dataflow.sdk.coders.JAXBCoder: Constructor for JSON deserialization only.
of(Coder<K>, Coder<V>) - Static method in class com.google.cloud.dataflow.sdk.coders.KvCoder
of(List<Coder<?>>) - Static method in class com.google.cloud.dataflow.sdk.coders.KvCoder
of(String, boolean, List<Coder<?>>) - Static method in class com.google.cloud.dataflow.sdk.coders.KvCoderBase: A constructor used only for decoding from JSON.
of(Coder<T>) - Static method in class com.google.cloud.dataflow.sdk.coders.ListCoder
of(List<Coder<?>>) - Static method in class com.google.cloud.dataflow.sdk.coders.ListCoder
of(Coder<K>, Coder<V>) - Static method in class com.google.cloud.dataflow.sdk.coders.MapCoder: Produces a MapCoder with the given keyCoder and valueCoder.
of(List<Coder<?>>) - Static method in class com.google.cloud.dataflow.sdk.coders.MapCoder
of(String, List<Coder<?>>) - Static method in class com.google.cloud.dataflow.sdk.coders.MapCoderBase
of(Class<T>) - Static method in class com.google.cloud.dataflow.sdk.coders.Proto2Coder: Returns a Proto2Coder for the given Protobuf message class.
of(String, List<String>) - Static method in class com.google.cloud.dataflow.sdk.coders.Proto2Coder: Constructor for JSON deserialization only.
of(Class<T>) - Static method in class com.google.cloud.dataflow.sdk.coders.SerializableCoder: Returns a SerializableCoder instance for the provided element class.
of(String) - Static method in class com.google.cloud.dataflow.sdk.coders.SerializableCoder
of(Coder<T>) - Static method in class com.google.cloud.dataflow.sdk.coders.SetCoder: Produces a SetCoder with the given elementCoder.
of(List<Object>) - Static method in class com.google.cloud.dataflow.sdk.coders.SetCoder: Dynamically typed constructor for JSON deserialization.
of(Class<T>) - Static method in class com.google.cloud.dataflow.sdk.coders.StringDelegateCoder
of() - Static method in class com.google.cloud.dataflow.sdk.coders.StringUtf8Coder
of() - Static method in class com.google.cloud.dataflow.sdk.coders.TableRowJsonCoder
of() - Static method in class com.google.cloud.dataflow.sdk.coders.TextualIntegerCoder
of() - Static method in class com.google.cloud.dataflow.sdk.coders.VarIntCoder
of() - Static method in class com.google.cloud.dataflow.sdk.coders.VarLongCoder
of() - Static method in class com.google.cloud.dataflow.sdk.coders.VoidCoder
of(Coder<KeyT>) - Static method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.ShardedKeyCoder
of(List<Coder<KeyT>>) - Static method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.ShardedKeyCoder
of(WindowedValue<V>) - Static method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.ValueWithMetadata: Returns a new ValueWithMetadata with the WindowedValue.
of(byte[]) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.ByteArrayShufflePosition
of(Iterable<? extends SideInputInfo>, PipelineOptions, ExecutionContext) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.DataflowSideInputReader: Creates a new SideInputReader that will provide side inputs according to the provided SideInputInfo descriptors.
of(String, InputT, OutputT, TransformT) - Static method in class com.google.cloud.dataflow.sdk.transforms.AppliedPTransform
of(SerializableFunction<Iterable<V>, V>) - Static method in class com.google.cloud.dataflow.sdk.transforms.Combine.IterableCombineFn: Returns a CombineFn that uses the given SerializableFunction to combine values.
of(SerializableFunction<Iterable<V>, V>, int) - Static method in class com.google.cloud.dataflow.sdk.transforms.Combine.IterableCombineFn: Returns a CombineFn that uses the given SerializableFunction to combine values, attempting to buffer at least bufferSize values between invocations.
of(SerializableFunction<Iterable<V>, V>) - Static method in class com.google.cloud.dataflow.sdk.transforms.Combine.SimpleCombineFn: Deprecated.
of(Iterable<T>) - Static method in class com.google.cloud.dataflow.sdk.transforms.Create: Returns a new Create.Values transform that produces a PCollection containing elements of the provided Iterable.
of(T...) - Static method in class com.google.cloud.dataflow.sdk.transforms.Create: Returns a new Create.Values transform that produces a PCollection containing the specified elements.
of(Map<K, V>) - Static method in class com.google.cloud.dataflow.sdk.transforms.Create: Returns a new Create.Values transform that produces a PCollection of KVs corresponding to the keys and values of the specified Map.
of(Class<? extends DoFnWithContext>) - Static method in class com.google.cloud.dataflow.sdk.transforms.DoFnReflector
of(DoFn<InputT, OutputT>) - Static method in class com.google.cloud.dataflow.sdk.transforms.DoFnTester: Returns a DoFnTester supporting unit-testing of the given DoFn.
of(DoFnWithContext<InputT, OutputT>) - Static method in class com.google.cloud.dataflow.sdk.transforms.DoFnTester: Returns a DoFnTester supporting unit-testing of the given DoFn.
of(DoFn<InputT, OutputT>) - Method in class com.google.cloud.dataflow.sdk.transforms.IntraBundleParallelization.Bound: Returns a new IntraBundleParallelization PTransform like this one with the specified DoFn.
of(DoFn<InputT, OutputT>) - Static method in class com.google.cloud.dataflow.sdk.transforms.IntraBundleParallelization: Creates a IntraBundleParallelization PTransform for the given DoFn that processes elements using multiple threads.
of(DoFn<InputT, OutputT>) - Method in class com.google.cloud.dataflow.sdk.transforms.IntraBundleParallelization.Unbound: Returns a new IntraBundleParallelization PTransform like this one with the specified DoFn.
of(CoGbkResultSchema, UnionCoder) - Static method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult.CoGbkResultCoder: Returns a CoGbkResultCoder for the given schema and unionCoder.
of(List<Coder<?>>, CoGbkResultSchema) - Static method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult.CoGbkResultCoder
of(TupleTag<V>, List<V>) - Static method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult: Returns a new CoGbkResult that contains just the given tag and given data.
of(List<TupleTag<?>>) - Static method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResultSchema
of(TupleTag<InputT>, PCollection<KV<K, InputT>>) - Static method in class com.google.cloud.dataflow.sdk.transforms.join.KeyedPCollectionTuple: Returns a new KeyedPCollectionTuple<K> with the given tag and initial PCollection.
of(T, ComparatorT) - Static method in class com.google.cloud.dataflow.sdk.transforms.Max.MaxFn
of(ComparatorT) - Static method in class com.google.cloud.dataflow.sdk.transforms.Max.MaxFn
of(T, ComparatorT) - Static method in class com.google.cloud.dataflow.sdk.transforms.Min.MinFn
of(ComparatorT) - Static method in class com.google.cloud.dataflow.sdk.transforms.Min.MinFn
of(DoFn<InputT, OutputT>) - Static method in class com.google.cloud.dataflow.sdk.transforms.ParDo: Creates a ParDo PTransform that will invoke the given DoFn function.
of(DoFnWithContext<InputT, OutputT>) - Static method in class com.google.cloud.dataflow.sdk.transforms.ParDo: Creates a ParDo PTransform that will invoke the given DoFnWithContext function.
of(DoFn<InputT, OutputT>) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.Unbound: Returns a new ParDo PTransform that's like this transform but that will invoke the given DoFn function, and that has its input and output types bound.
of(DoFnWithContext<InputT, OutputT>) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.Unbound: Returns a new ParDo PTransform that's like this transform but which will invoke the given DoFnWithContext function, and which has its input and output types bound.
of(DoFn<InputT, OutputT>) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.UnboundMulti: Returns a new multi-output ParDo PTransform that's like this transform but that will invoke the given DoFn function, and that has its input type bound.
of(DoFnWithContext<InputT, OutputT>) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.UnboundMulti: Returns a new multi-output ParDo PTransform that's like this transform but which will invoke the given DoFnWithContext function, and which has its input type bound.
of(int, Partition.PartitionFn<? super T>) - Static method in class com.google.cloud.dataflow.sdk.transforms.Partition: Returns a new Partition PTransform that divides its input PCollection into the given number of partitions, using the given partitioning function.
of(int, ComparatorT) - Static method in class com.google.cloud.dataflow.sdk.transforms.Top: Returns a PTransform that takes an input PCollection<T> and returns a PCollection<List<T>> with a single element containing the largest count elements of the input PCollection<T>, in decreasing order, sorted using the given Comparator<T>.
of(PCollectionView<ViewT>) - Static method in class com.google.cloud.dataflow.sdk.transforms.View.CreatePCollectionView
of(Trigger.OnceTrigger<W>...) - Static method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterAll
of(Trigger.OnceTrigger<W>...) - Static method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterFirst
of() - Static method in class com.google.cloud.dataflow.sdk.transforms.windowing.DefaultTrigger: Returns the default trigger.
of(Duration) - Static method in class com.google.cloud.dataflow.sdk.transforms.windowing.FixedWindows: Partitions the timestamp space into half-open intervals of the form [N * size, (N + 1) * size), where 0 is the epoch.
of(Duration) - Static method in class com.google.cloud.dataflow.sdk.transforms.windowing.SlidingWindows: Assigns timestamps into half-open intervals of the form [N * period, N * period + size), where 0 is the epoch.
of(SerializableFunction<V, K>) - Static method in class com.google.cloud.dataflow.sdk.transforms.WithKeys: Returns a PTransform that takes a PCollection<V> and returns a PCollection<KV<K, V>>, where each of the values in the input PCollection has been paired with a key computed from the value by invoking the given SerializableFunction.
of(K) - Static method in class com.google.cloud.dataflow.sdk.transforms.WithKeys: Returns a PTransform that takes a PCollection<V> and returns a PCollection<KV<K, V>>, where each of the values in the input PCollection has been paired with the given key.
of(PTuple) - Static method in class com.google.cloud.dataflow.sdk.util.DirectSideInputReader
of(Iterable<? extends PCollectionView<?>>) - Static method in class com.google.cloud.dataflow.sdk.util.NullSideInputReader
of(PCollectionView<T>, BoundedWindow) - Static method in class com.google.cloud.dataflow.sdk.util.PCollectionViewWindow
of(TupleTag<V>, V) - Static method in class com.google.cloud.dataflow.sdk.util.PTuple: Returns a singleton PTuple containing the given value keyed by the given TupleTag.
of() - Static method in class com.google.cloud.dataflow.sdk.util.Reshuffle
of(T, long) - Static method in class com.google.cloud.dataflow.sdk.util.Sized
of(Iterable<? extends PCollectionView<?>>, StreamingModeExecutionContext) - Static method in class com.google.cloud.dataflow.sdk.util.StreamingModeExecutionContext.StreamingModeSideInputReader
of(StateNamespace, Instant, TimeDomain) - Static method in class com.google.cloud.dataflow.sdk.util.TimerInternals.TimerData: Construct the TimerKey for the given parameters.
of(Coder<T>) - Static method in class com.google.cloud.dataflow.sdk.util.TimerOrElement.TimerOrElementCoder: Creates a new TimerOrElement.Coder that wraps the given Coder.
of(List<Object>) - Static method in class com.google.cloud.dataflow.sdk.util.TimerOrElement.TimerOrElementCoder
of(Coder<ValueT>) - Static method in class com.google.cloud.dataflow.sdk.util.ValueWithRecordId.ValueWithRecordIdCoder
of(List<Coder<ValueT>>) - Static method in class com.google.cloud.dataflow.sdk.util.ValueWithRecordId.ValueWithRecordIdCoder
of(Coder<T>, Coder<? extends BoundedWindow>) - Static method in class com.google.cloud.dataflow.sdk.util.WindowedValue.FullWindowedValueCoder
of(List<Coder<?>>) - Static method in class com.google.cloud.dataflow.sdk.util.WindowedValue.FullWindowedValueCoder
of(V, Instant, Collection<? extends BoundedWindow>, PaneInfo) - Static method in class com.google.cloud.dataflow.sdk.util.WindowedValue: Returns a WindowedValue with the given value, timestamp, and windows.
of(V, Instant, BoundedWindow, PaneInfo) - Static method in class com.google.cloud.dataflow.sdk.util.WindowedValue: Returns a WindowedValue with the given value, timestamp, and window.
of(Coder<T>) - Static method in class com.google.cloud.dataflow.sdk.util.WindowedValue.ValueOnlyWindowedValueCoder
of(List<Coder<?>>) - Static method in class com.google.cloud.dataflow.sdk.util.WindowedValue.ValueOnlyWindowedValueCoder
of(WindowFn<T, W>) - Static method in class com.google.cloud.dataflow.sdk.util.WindowingStrategy
of(K, V) - Static method in class com.google.cloud.dataflow.sdk.values.KV: Returns a KV with the given key and value.
of(PCollection<T>) - Static method in class com.google.cloud.dataflow.sdk.values.PCollectionList: Returns a singleton PCollectionList containing the given PCollection.
of(Iterable<PCollection<T>>) - Static method in class com.google.cloud.dataflow.sdk.values.PCollectionList: Returns a PCollectionList containing the given PCollections, in order.
of(TupleTag<T>, PCollection<T>) - Static method in class com.google.cloud.dataflow.sdk.values.PCollectionTuple: Returns a singleton PCollectionTuple containing the given PCollection keyed by the given TupleTag.
of(V, Instant) - Static method in class com.google.cloud.dataflow.sdk.values.TimestampedValue: Returns a new TimestampedValue with the given value and timestamp.
of(Coder<T>) - Static method in class com.google.cloud.dataflow.sdk.values.TimestampedValue.TimestampedValueCoder
of(List<Object>) - Static method in class com.google.cloud.dataflow.sdk.values.TimestampedValue.TimestampedValueCoder
of(TupleTag<?>) - Static method in class com.google.cloud.dataflow.sdk.values.TupleTagList: Returns a singleton TupleTagList containing the given TupleTag.
of(List<TupleTag<?>>) - Static method in class com.google.cloud.dataflow.sdk.values.TupleTagList: Returns a TupleTagList containing the given TupleTags, in order.
of(Class<T>) - Static method in class com.google.cloud.dataflow.sdk.values.TypeDescriptor: Returns a TypeDescriptor representing the given type.
of(Type) - Static method in class com.google.cloud.dataflow.sdk.values.TypeDescriptor: Returns a TypeDescriptor representing the given type.
ofClass(Class<?>) - Static method in class com.google.cloud.dataflow.sdk.util.ApiSurface: Returns an ApiSurface object representing just the surface of the given class.
offset - Variable in class com.google.cloud.dataflow.sdk.runners.worker.FileBasedReader.FileBasedIterator
OFFSET_INFINITY - Static variable in class com.google.cloud.dataflow.sdk.io.range.OffsetRangeTracker: Offset corresponding to infinity.
OffsetBasedReader(OffsetBasedSource<T>) - Constructor for class com.google.cloud.dataflow.sdk.io.OffsetBasedSource.OffsetBasedReader
OffsetBasedSource<T> - Class in com.google.cloud.dataflow.sdk.io: A Source that uses offsets to define starting and ending positions.
OffsetBasedSource(long, long, long) - Constructor for class com.google.cloud.dataflow.sdk.io.OffsetBasedSource
OffsetBasedSource.OffsetBasedReader<T> - Class in com.google.cloud.dataflow.sdk.io: A Source.Reader that implements code common to readers of all OffsetBasedSources.
OffsetRangeTracker - Class in com.google.cloud.dataflow.sdk.io.range: A RangeTracker for non-negative positions of type long.
OffsetRangeTracker(long, long) - Constructor for class com.google.cloud.dataflow.sdk.io.range.OffsetRangeTracker: Creates an OffsetRangeTracker for the specified range.
ofInternal(Map<TupleTag<?>, ?>) - Static method in class com.google.cloud.dataflow.sdk.util.PTuple: Returns a PTuple with each of the given tags mapping to the corresponding value.
ofPackage(String) - Static method in class com.google.cloud.dataflow.sdk.util.ApiSurface: Returns an ApiSurface object representing the given package and all subpackages.
ofPrimitiveOutputsInternal(Pipeline, TupleTagList, WindowingStrategy<?, ?>, PCollection.IsBounded) - Static method in class com.google.cloud.dataflow.sdk.values.PCollectionTuple: Returns a PCollectionTuple with each of the given tags mapping to a new output PCollection.
ofRecordClass(Class<T>) - Method in class com.google.cloud.dataflow.sdk.io.XmlSink.Bound: Returns an XmlSink that writes objects of the class specified as XML elements.
ofType(Class<T>) - Static method in class com.google.cloud.dataflow.sdk.util.InstanceBuilder: Create an InstanceBuilder for the given type.
ofType(TypeDescriptor<T>) - Static method in class com.google.cloud.dataflow.sdk.util.InstanceBuilder: Create an InstanceBuilder for the given type.
oldWindows() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Trigger.OnMergeContext: The old windows that were merged.
ON_TIME_AND_ONLY_FIRING - Static variable in class com.google.cloud.dataflow.sdk.transforms.windowing.PaneInfo: PaneInfo to use when there will be exactly one firing and it is on time.
OnceTrigger(List<Trigger<W>>) - Constructor for class com.google.cloud.dataflow.sdk.transforms.windowing.Trigger.OnceTrigger
onElement(Trigger<W>.OnElementContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterAll
onElement(Trigger<W>.OnElementContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterEach
onElement(Trigger<W>.OnElementContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterFirst
onElement(Trigger<W>.OnElementContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterPane
onElement(Trigger<W>.OnElementContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterProcessingTime
onElement(Trigger<W>.OnElementContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.DefaultTrigger
onElement(Trigger<W>.OnElementContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Repeatedly
onElement(Trigger<W>.OnElementContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Trigger: Called immediately after an element is first incorporated into a window.
OnElementContext() - Constructor for class com.google.cloud.dataflow.sdk.transforms.windowing.Trigger.OnElementContext
onMerge(Trigger<W>.OnMergeContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterAll
onMerge(Trigger<W>.OnMergeContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterEach
onMerge(Trigger<W>.OnMergeContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterFirst
onMerge(Trigger<W>.OnMergeContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterPane
onMerge(Trigger<W>.OnMergeContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterProcessingTime
onMerge(Trigger<W>.OnMergeContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.DefaultTrigger
onMerge(Trigger<W>.OnMergeContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Repeatedly
onMerge(Trigger<W>.OnMergeContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Trigger: Called immediately after windows have been merged.
onMerge(Collection<W>, W, boolean) - Method in interface com.google.cloud.dataflow.sdk.util.ActiveWindowSet.MergeCallback
onMerge(ReduceFn<K, InputT, OutputT, W>.OnMergeContext) - Method in class com.google.cloud.dataflow.sdk.util.ReduceFn: Called when windows are merged.
onMerge(Collection<W>, W, boolean) - Method in class com.google.cloud.dataflow.sdk.util.ReduceFnRunner: Called when windows merge.
onMerge(ReduceFn<?, ?, ?, W>.OnMergeContext) - Method in class com.google.cloud.dataflow.sdk.util.TriggerRunner: Run the trigger merging logic as part of executing the specified merge.
OnMergeContext() - Constructor for class com.google.cloud.dataflow.sdk.transforms.windowing.Trigger.OnMergeContext
OnMergeContext() - Constructor for class com.google.cloud.dataflow.sdk.util.ReduceFn.OnMergeContext
onTimer(Trigger<W>.OnTimerContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterAll
onTimer(Trigger<W>.OnTimerContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterEach
onTimer(Trigger<W>.OnTimerContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterFirst
onTimer(Trigger<W>.OnTimerContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterPane
onTimer(Trigger<W>.OnTimerContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterProcessingTime
onTimer(Trigger<W>.OnTimerContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.DefaultTrigger
onTimer(Trigger<W>.OnTimerContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Repeatedly
onTimer(Trigger<W>.OnTimerContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Trigger: Called when a timer has fired for the current window.
onTimer(TimerInternals.TimerData) - Method in class com.google.cloud.dataflow.sdk.util.ReduceFnRunner: Called when a timer fires.
onTimer(ReduceFn<?, ?, ?, W>.Context, TimerInternals.TimerData) - Method in class com.google.cloud.dataflow.sdk.util.TriggerRunner: Run the trigger logic appropriate for receiving a timer with the specified destination ID.
OnTimerContext() - Constructor for class com.google.cloud.dataflow.sdk.transforms.windowing.Trigger.OnTimerContext
onTrigger(ReduceFn<K, InputT, OutputT, W>.OnTriggerContext) - Method in class com.google.cloud.dataflow.sdk.util.ReduceFn: Called when triggers fire.
OnTriggerContext() - Constructor for class com.google.cloud.dataflow.sdk.util.ReduceFn.OnTriggerContext
open(String) - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSink.FileBasedWriter: Opens the channel.
open(String) - Method in class com.google.cloud.dataflow.sdk.io.Sink.Writer: Performs bundle initialization.
open(String) - Method in class com.google.cloud.dataflow.sdk.util.FileIOChannelFactory
open(String) - Method in class com.google.cloud.dataflow.sdk.util.GcsIOChannelFactory
open(GcsPath) - Method in class com.google.cloud.dataflow.sdk.util.GcsUtil: Opens an object in GCS.
open(String) - Method in interface com.google.cloud.dataflow.sdk.util.IOChannelFactory: Returns a read channel for the given specification.
Operation - Class in com.google.cloud.dataflow.sdk.util.common.worker: The abstract base class for Operations, which correspond to Instructions in the original MapTask InstructionGraph.
Operation(String, OutputReceiver[], String, CounterSet.AddCounterMutator, StateSampler) - Constructor for class com.google.cloud.dataflow.sdk.util.common.worker.Operation
Operation.InitializationState - Enum in com.google.cloud.dataflow.sdk.util.common.worker: The possible initialization states of an Operation.
operationName - Variable in class com.google.cloud.dataflow.sdk.util.common.worker.Operation: The name of this operation.
operations - Variable in class com.google.cloud.dataflow.sdk.util.common.worker.MapTaskExecutor: The operations in the map task, in execution order.
Options() - Constructor for class com.google.cloud.dataflow.sdk.runners.DataflowPipelineRegistrar.Options
Options() - Constructor for class com.google.cloud.dataflow.sdk.runners.DirectPipelineRegistrar.Options
OrderByKey() - Constructor for class com.google.cloud.dataflow.sdk.values.KV.OrderByKey
OrderByValue() - Constructor for class com.google.cloud.dataflow.sdk.values.KV.OrderByValue
OrderedCode - Class in com.google.cloud.dataflow.sdk.runners.worker: This module provides routines for encoding a sequence of typed entities into a byte array.
OrderedCode() - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.OrderedCode: Creates OrderedCode from scractch.
OrderedCode(byte[]) - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.OrderedCode: Creates OrderedCode from a given encoded byte array.
orFinally(Trigger.OnceTrigger<W>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Trigger: Specify an ending condition for this trigger.
OUTER - Static variable in class com.google.cloud.dataflow.sdk.coders.Coder.Context: The outer context.
output(OutputT) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFn.Context: Adds the given element to the main output PCollection.
output(OutputT) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnWithContext.Context: Adds the given element to the main output PCollection.
output(TupleTag<T>, WindowedValue<T>) - Method in class com.google.cloud.dataflow.sdk.util.DoFnRunner.ListOutputManager
output(TupleTag<T>, WindowedValue<T>) - Method in interface com.google.cloud.dataflow.sdk.util.DoFnRunner.OutputManager: Outputs a single element to the receiver indicated by the given TupleTag.
OUTPUT - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
output(OutputT) - Method in class com.google.cloud.dataflow.sdk.util.ReduceFn.OnTriggerContext: Output the given value in the current window.
OUTPUT_INFO - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
OUTPUT_NAME - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
OutputObjectAndByteCounter - Class in com.google.cloud.dataflow.sdk.util.common.worker: An ElementCounter that counts output objects, bytes, and mean bytes.
OutputObjectAndByteCounter(ElementByteSizeObservable<?>, CounterSet.AddCounterMutator) - Constructor for class com.google.cloud.dataflow.sdk.util.common.worker.OutputObjectAndByteCounter
OutputReceiver - Class in com.google.cloud.dataflow.sdk.util.common.worker: Receiver that forwards each input it receives to each of a list of output Receivers.
OutputReceiver() - Constructor for class com.google.cloud.dataflow.sdk.util.common.worker.OutputReceiver
OutputReference - Class in com.google.cloud.dataflow.sdk.util: A representation used by Steps to reference the output of other Steps.
OutputReference(String, String) - Constructor for class com.google.cloud.dataflow.sdk.util.OutputReference
outputWindowedValue(OutputT, Instant, Collection<? extends BoundedWindow>, PaneInfo) - Method in interface com.google.cloud.dataflow.sdk.util.WindowingInternals: Output the value at the specified timestamp in the listed windows.
outputWithTimestamp(OutputT, Instant) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFn.Context: Adds the given element to the main output PCollection, with the given timestamp.
outputWithTimestamp(OutputT, Instant) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnWithContext.Context: Adds the given element to the main output PCollection, with the given timestamp.

P

PackageUtil - Class in com.google.cloud.dataflow.sdk.util: Helper routines for packages.
PackageUtil() - Constructor for class com.google.cloud.dataflow.sdk.util.PackageUtil
pane() - Method in class com.google.cloud.dataflow.sdk.transforms.DoFn.ProcessContext: Returns information about the pane within this window into which the input element has been assigned.
pane - Variable in class com.google.cloud.dataflow.sdk.util.WindowedValue
pane() - Method in interface com.google.cloud.dataflow.sdk.util.WindowingInternals: Access the pane of the current window(s).
PaneInfo - Class in com.google.cloud.dataflow.sdk.transforms.windowing: Provides information about the pane this value belongs to.
paneInfo() - Method in class com.google.cloud.dataflow.sdk.util.ReduceFn.OnTriggerContext: Returns the PaneInfo for the trigger firing being processed.
PaneInfo.PaneInfoCoder - Class in com.google.cloud.dataflow.sdk.transforms.windowing: A Coder for encoding PaneInfo instances.
PaneInfo.Timing - Enum in com.google.cloud.dataflow.sdk.transforms.windowing: Enumerates the possibilities for how the timing of this pane firing related to the watermark.
PaneInfoCoder() - Constructor for class com.google.cloud.dataflow.sdk.transforms.windowing.PaneInfo.PaneInfoCoder
PaneInfoTracker - Class in com.google.cloud.dataflow.sdk.util: Encapsulates the logic for tracking the current PaneInfo and producing new PaneInfo for a trigger firing.
PaneInfoTracker(TimerInternals) - Constructor for class com.google.cloud.dataflow.sdk.util.PaneInfoTracker
PARALLEL_INPUT - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
ParDo - Class in com.google.cloud.dataflow.sdk.transforms: ParDo is the core element-wise transform in Google Cloud Dataflow, invoking a user-specified function (from I to Output) on each of the elements of the input PCollection<InputT> to produce zero or more output elements, all of which are collected into the output PCollection<OutputT>.
ParDo() - Constructor for class com.google.cloud.dataflow.sdk.transforms.ParDo
ParDo.Bound<InputT,OutputT> - Class in com.google.cloud.dataflow.sdk.transforms: A PTransform that, when applied to a PCollection<InputT>, invokes a user-specified DoFn<InputT, OutputT> on all its elements, with all its outputs collected into an output PCollection<OutputT>.
ParDo.BoundMulti<InputT,OutputT> - Class in com.google.cloud.dataflow.sdk.transforms: A PTransform that, when applied to a PCollection<InputT>, invokes a user-specified DoFn<InputT, OutputT> on all its elements, which can emit elements to any of the PTransform's main and side output PCollections, which are bundled into a result PCollectionTuple.
ParDo.Unbound - Class in com.google.cloud.dataflow.sdk.transforms: An incomplete ParDo transform, with unbound input/output types.
ParDo.UnboundMulti<OutputT> - Class in com.google.cloud.dataflow.sdk.transforms: An incomplete multi-output ParDo transform, with unbound input type.
ParDoFn - Interface in com.google.cloud.dataflow.sdk.util.common.worker: Interface for functions invocable by ParDoOperation instances.
ParDoFnBase - Class in com.google.cloud.dataflow.sdk.runners.worker: A base class providing simple set up, processing, and tear down for a wrapped DoFn.
ParDoFnBase(PipelineOptions, SideInputReader, List<String>, String, String, ExecutionContext, CounterSet.AddCounterMutator) - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.ParDoFnBase: Creates a ParDoFnBase using basic information about the step being executed.
ParDoFnFactory - Interface in com.google.cloud.dataflow.sdk.runners.worker: Creates a ParDoFn from a CloudObject spec.
ParDoFnFactory.DefaultFactory - Class in com.google.cloud.dataflow.sdk.runners.worker: A factory that dispatches to all known factories in the Dataflow SDK based on the value of CloudObject.getClassName() for the specified DoFn.
ParDoOperation - Class in com.google.cloud.dataflow.sdk.util.common.worker: A ParDo mapping function.
ParDoOperation(String, ParDoFn, OutputReceiver[], String, CounterSet.AddCounterMutator, StateSampler) - Constructor for class com.google.cloud.dataflow.sdk.util.common.worker.ParDoOperation
parseShuffleKind(String) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.ShuffleSink
parseTableSpec(String) - Static method in class com.google.cloud.dataflow.sdk.io.BigQueryIO: Parse a table specification in the form "[project_id]:[dataset_id].[table_id]" or "[dataset_id].[table_id]".
PartialGroupByKeyOperation - Class in com.google.cloud.dataflow.sdk.util.common.worker: A partial group-by-key operation.
PartialGroupByKeyOperation(String, PartialGroupByKeyOperation.GroupingKeyCreator<?>, PartialGroupByKeyOperation.SizeEstimator<?>, PartialGroupByKeyOperation.SizeEstimator<?>, PartialGroupByKeyOperation.PairInfo, OutputReceiver[], String, CounterSet.AddCounterMutator, StateSampler) - Constructor for class com.google.cloud.dataflow.sdk.util.common.worker.PartialGroupByKeyOperation
PartialGroupByKeyOperation(String, PartialGroupByKeyOperation.GroupingKeyCreator<?>, PartialGroupByKeyOperation.SizeEstimator<?>, PartialGroupByKeyOperation.SizeEstimator<?>, PartialGroupByKeyOperation.Combiner, PartialGroupByKeyOperation.PairInfo, OutputReceiver[], String, CounterSet.AddCounterMutator, StateSampler) - Constructor for class com.google.cloud.dataflow.sdk.util.common.worker.PartialGroupByKeyOperation
PartialGroupByKeyOperation(String, PartialGroupByKeyOperation.GroupingKeyCreator<?>, PartialGroupByKeyOperation.SizeEstimator<?>, PartialGroupByKeyOperation.SizeEstimator<?>, double, PartialGroupByKeyOperation.Combiner, PartialGroupByKeyOperation.PairInfo, OutputReceiver[], String, CounterSet.AddCounterMutator, StateSampler) - Constructor for class com.google.cloud.dataflow.sdk.util.common.worker.PartialGroupByKeyOperation
PartialGroupByKeyOperation(PartialGroupByKeyOperation.GroupingKeyCreator<?>, PartialGroupByKeyOperation.SizeEstimator<?>, PartialGroupByKeyOperation.SizeEstimator<?>, PartialGroupByKeyOperation.PairInfo, OutputReceiver, String, CounterSet.AddCounterMutator, StateSampler) - Constructor for class com.google.cloud.dataflow.sdk.util.common.worker.PartialGroupByKeyOperation: Invoked by tests.
PartialGroupByKeyOperation(PartialGroupByKeyOperation.GroupingKeyCreator<?>, PartialGroupByKeyOperation.SizeEstimator<?>, PartialGroupByKeyOperation.SizeEstimator<?>, PartialGroupByKeyOperation.Combiner, PartialGroupByKeyOperation.PairInfo, OutputReceiver, String, CounterSet.AddCounterMutator, StateSampler) - Constructor for class com.google.cloud.dataflow.sdk.util.common.worker.PartialGroupByKeyOperation: Invoked by tests.
PartialGroupByKeyOperation.BufferingGroupingTable<K,V> - Class in com.google.cloud.dataflow.sdk.util.common.worker: A grouping table that simply buffers all inserted values in a list.
PartialGroupByKeyOperation.Combiner<K,InputT,AccumT,OutputT> - Interface in com.google.cloud.dataflow.sdk.util.common.worker: Provides client-specific operations for combining values.
PartialGroupByKeyOperation.CombiningGroupingTable<K,InputT,AccumT> - Class in com.google.cloud.dataflow.sdk.util.common.worker: A grouping table that uses the given combiner to combine values in place.
PartialGroupByKeyOperation.GroupingKeyCreator<K> - Interface in com.google.cloud.dataflow.sdk.util.common.worker: Provides client-specific operations for grouping keys.
PartialGroupByKeyOperation.PairInfo - Interface in com.google.cloud.dataflow.sdk.util.common.worker: Provides client-specific operations for working with elements that are key/value or key/values pairs.
PartialGroupByKeyOperation.SamplingSizeEstimator<T> - Class in com.google.cloud.dataflow.sdk.util.common.worker: Implements size estimation by adaptively delegating to an underlying (potentially more expensive) estimator for some elements and returning the average value for others.
PartialGroupByKeyOperation.SizeEstimator<T> - Interface in com.google.cloud.dataflow.sdk.util.common.worker: Provides client-specific operations for size estimates.
PartialGroupByKeyOperation.StructuralByteArray - Class in com.google.cloud.dataflow.sdk.util.common.worker: A wrapper around a byte[] that uses structural, value-based equality rather than byte[]'s normal object identity.
Partition<T> - Class in com.google.cloud.dataflow.sdk.transforms: Partition takes a PCollection<T> and a PartitionFn, uses the PartitionFn to split the elements of the input PCollection into N partitions, and returns a PCollectionList<T> that bundles N PCollection<T>s containing the split elements.
Partition.PartitionFn<T> - Interface in com.google.cloud.dataflow.sdk.transforms: A function object that chooses an output partition for an element.
partitionFor(T, int) - Method in interface com.google.cloud.dataflow.sdk.transforms.Partition.PartitionFn: Chooses the partition into which to put the given element.
PartitioningShuffleReader<K,V> - Class in com.google.cloud.dataflow.sdk.runners.worker: A source that reads from a key-sharded dataset, and returns KVs without any values grouping.
PartitioningShuffleReader(PipelineOptions, byte[], String, String, Coder<WindowedValue<KV<K, V>>>) - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.PartitioningShuffleReader
PartitioningShuffleReaderFactory - Class in com.google.cloud.dataflow.sdk.runners.worker: Creates a PartitioningShuffleReader from a CloudObject spec.
PartitioningWindowFn<T,W extends BoundedWindow> - Class in com.google.cloud.dataflow.sdk.transforms.windowing: A WindowFn that places each value into exactly one window based on its timestamp and never merges windows.
PartitioningWindowFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.windowing.PartitioningWindowFn
pastEndOfWindow() - Static method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterWatermark: Creates a trigger that fires when the watermark passes the end of the window.
pastFirstElementInPane() - Static method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterProcessingTime: Creates a trigger that fires when the current processing time passes the processing time at which this trigger saw the first element in a pane.
PathValidator - Interface in com.google.cloud.dataflow.sdk.util: Interface for controlling validation of paths.
PathValidatorFactory() - Constructor for class com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions.PathValidatorFactory
PBegin - Class in com.google.cloud.dataflow.sdk.values: PBegin is used as the "input" to a root PTransform that is the first operation in a Pipeline, such as TextIO.Read or Create.
PBegin(Pipeline) - Constructor for class com.google.cloud.dataflow.sdk.values.PBegin: Constructs a PBegin in the given Pipeline.
PCollection<T> - Class in com.google.cloud.dataflow.sdk.values: A PCollection<T> is an immutable collection of values of type T.
PCollection.IsBounded - Enum in com.google.cloud.dataflow.sdk.values: The PCollection IsBounded property.
PCollectionList<T> - Class in com.google.cloud.dataflow.sdk.values: A PCollectionList<T> is an immutable list of homogeneously typed PCollection<T>s.
pCollections() - Static method in class com.google.cloud.dataflow.sdk.transforms.Flatten: Returns a PTransform that flattens a PCollectionList into a PCollection containing all the elements of all the PCollections in its input.
PCollectionTuple - Class in com.google.cloud.dataflow.sdk.values: A PCollectionTuple is an immutable tuple of heterogeneously-typed PCollections, "keyed" by TupleTags.
PCollectionView<T> - Interface in com.google.cloud.dataflow.sdk.values: A PCollectionView<T> is an immutable view of a PCollection as a value of type T that can be accessed e.g.
PCollectionViews - Class in com.google.cloud.dataflow.sdk.util: Implementations of PCollectionView shared across the SDK.
PCollectionViews() - Constructor for class com.google.cloud.dataflow.sdk.util.PCollectionViews
PCollectionViewWindow<T> - Class in com.google.cloud.dataflow.sdk.util: A pair of a PCollectionView and a BoundedWindow, which can be thought of as window "of" the view.
PDone - Class in com.google.cloud.dataflow.sdk.values: PDone is the output of a PTransform that doesn't have a non-trival result, e.g., a Write.
peek() - Method in class com.google.cloud.dataflow.sdk.util.common.PeekingReiterator: Returns the element that would be returned by PeekingReiterator.next(), without actually consuming the element.
PeekingReiterator<T> - Class in com.google.cloud.dataflow.sdk.util.common: A Reiterator that supports one-element lookahead during iteration.
PeekingReiterator(Reiterator<T>) - Constructor for class com.google.cloud.dataflow.sdk.util.common.PeekingReiterator
peekOutputElements() - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnTester: Returns the elements output so far to the main output.
peekSideOutputElements(TupleTag<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnTester: Returns the elements output so far to the side output with the given tag.
perElement() - Static method in class com.google.cloud.dataflow.sdk.transforms.Count: Returns a Count.PerElement PTransform that counts the number of occurrences of each element in its input PCollection.
PerElement() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Count.PerElement
performSourceOperation(SourceFormat.OperationRequest) - Method in class com.google.cloud.dataflow.sdk.runners.dataflow.BasicSerializableSourceFormat: Executes a protocol-level split SourceOperationRequest for bounded sources by deserializing its source to a BoundedSource, splitting it, and serializing results back.
performSourceOperation(SourceFormat.OperationRequest) - Method in interface com.google.cloud.dataflow.sdk.util.common.worker.SourceFormat: Performs an operation on the specification of a source.
perKey(int, ComparatorT) - Static method in class com.google.cloud.dataflow.sdk.transforms.ApproximateQuantiles: Returns a PTransform that takes a PCollection<KV<K, V>> and returns a PCollection<KV<K, List<V>>> that contains an output element mapping each distinct key in the input PCollection to a List of the approximate N-tiles of the values associated with that key in the input PCollection.
perKey(int) - Static method in class com.google.cloud.dataflow.sdk.transforms.ApproximateQuantiles: Like ApproximateQuantiles.perKey(int, Comparator), but sorts values using the their natural ordering.
perKey(int) - Static method in class com.google.cloud.dataflow.sdk.transforms.ApproximateUnique: Returns a PTransform that takes a PCollection<KV<K, V>> and returns a PCollection<KV<K, Long>> that contains an output element mapping each distinct key in the input PCollection to an estimate of the number of distinct values associated with that key in the input PCollection.
perKey(double) - Static method in class com.google.cloud.dataflow.sdk.transforms.ApproximateUnique: Like ApproximateUnique.perKey(int), but specifies the desired maximum estimation error instead of the sample size.
perKey(SerializableFunction<Iterable<V>, V>) - Static method in class com.google.cloud.dataflow.sdk.transforms.Combine: Returns a Combine.PerKey PTransform that first groups its input PCollection of KVs by keys and windows, then invokes the given function on each of the values lists to produce a combined value, and then returns a PCollection of KVs mapping each distinct key to its combined value for each window.
perKey(Combine.CombineFn<? super InputT, ?, OutputT>) - Static method in class com.google.cloud.dataflow.sdk.transforms.Combine: Returns a Combine.PerKey PTransform that first groups its input PCollection of KVs by keys and windows, then invokes the given function on each of the values lists to produce a combined value, and then returns a PCollection of KVs mapping each distinct key to its combined value for each window.
perKey(Combine.KeyedCombineFn<? super K, ? super InputT, ?, OutputT>) - Static method in class com.google.cloud.dataflow.sdk.transforms.Combine: Returns a Combine.PerKey PTransform that first groups its input PCollection of KVs by keys and windows, then invokes the given function on each of the key/values-lists pairs to produce a combined value, and then returns a PCollection of KVs mapping each distinct key to its combined value for each window.
perKey() - Static method in class com.google.cloud.dataflow.sdk.transforms.Count: Returns a Combine.PerKey PTransform that counts the number of elements associated with each key of its input PCollection.
perKey() - Static method in class com.google.cloud.dataflow.sdk.transforms.Max: Returns a PTransform that takes an input PCollection<KV<K, T>> and returns a PCollection<KV<K, T>> that contains an output element mapping each distinct key in the input PCollection to the maximum according to the natural ordering of T of the values associated with that key in the input PCollection.
perKey(ComparatorT) - Static method in class com.google.cloud.dataflow.sdk.transforms.Max: Returns a PTransform that takes an input PCollection<KV<K, T>> and returns a PCollection<KV<K, T>> that contains one output element per key mapping each to the maximum of the values associated with that key in the input PCollection.
perKey() - Static method in class com.google.cloud.dataflow.sdk.transforms.Mean: Returns a PTransform that takes an input PCollection<KV<K, N>> and returns a PCollection<KV<K, Double>> that contains an output element mapping each distinct key in the input PCollection to the mean of the values associated with that key in the input PCollection.
perKey() - Static method in class com.google.cloud.dataflow.sdk.transforms.Min: Returns a PTransform that takes an input PCollection<KV<K, T>> and returns a PCollection<KV<K, T>> that contains an output element mapping each distinct key in the input PCollection to the minimum according to the natural ordering of T of the values associated with that key in the input PCollection.
perKey(ComparatorT) - Static method in class com.google.cloud.dataflow.sdk.transforms.Min: Returns a PTransform that takes an input PCollection<KV<K, T>> and returns a PCollection<KV<K, T>> that contains one output element per key mapping each to the minimum of the values associated with that key in the input PCollection.
perKey(int, ComparatorT) - Static method in class com.google.cloud.dataflow.sdk.transforms.Top: Returns a PTransform that takes an input PCollection<KV<K, V>> and returns a PCollection<KV<K, List<V>>> that contains an output element mapping each distinct key in the input PCollection to the largest count values associated with that key in the input PCollection<KV<K, V>>, in decreasing order, sorted using the given Comparator<V>.
persist() - Method in interface com.google.cloud.dataflow.sdk.util.ActiveWindowSet: Save any state changes needed.
persist() - Method in class com.google.cloud.dataflow.sdk.util.MergingActiveWindowSet
persist() - Method in class com.google.cloud.dataflow.sdk.util.NonMergingActiveWindowSet
persist() - Method in class com.google.cloud.dataflow.sdk.util.ReduceFnRunner: Make sure that all the state built up in this runner has been persisted.
persist(Windmill.WorkItemCommitRequest.Builder) - Method in class com.google.cloud.dataflow.sdk.util.state.WindmillStateInternals
persistFinishedSet(ReduceFn.StateContext) - Method in class com.google.cloud.dataflow.sdk.util.TriggerRunner.Result
PHASE - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
PInput - Interface in com.google.cloud.dataflow.sdk.values: The interface for things that might be input to a PTransform.
Pipeline - Class in com.google.cloud.dataflow.sdk: A Pipeline manages a DAG of PTransforms, and the PCollections that the PTransforms consume and produce.
Pipeline(PipelineRunner<?>) - Constructor for class com.google.cloud.dataflow.sdk.Pipeline: Deprecated.
replaced by Pipeline.Pipeline(PipelineRunner, PipelineOptions)
Pipeline(PipelineRunner<?>, PipelineOptions) - Constructor for class com.google.cloud.dataflow.sdk.Pipeline
Pipeline.PipelineExecutionException - Exception in com.google.cloud.dataflow.sdk: Thrown during pipeline execution, whenever user code within a pipeline throws an exception.
Pipeline.PipelineVisitor - Interface in com.google.cloud.dataflow.sdk: A Pipeline.PipelineVisitor can be passed into Pipeline.traverseTopologically(com.google.cloud.dataflow.sdk.Pipeline.PipelineVisitor) to be called for each of the transforms and values in the Pipeline.
PipelineExecutionException(Throwable) - Constructor for exception com.google.cloud.dataflow.sdk.Pipeline.PipelineExecutionException: Wraps cause into a PipelineExecutionException.
PipelineOptions - Interface in com.google.cloud.dataflow.sdk.options: PipelineOptions are used to configure Pipelines.
PipelineOptions.CheckEnabled - Enum in com.google.cloud.dataflow.sdk.options: Enumeration of the possible states for a given check.
PipelineOptionsFactory - Class in com.google.cloud.dataflow.sdk.options: Constructs a PipelineOptions or any derived interface that is composable to any other derived interface of PipelineOptions via the PipelineOptions.as(java.lang.Class<T>) method.
PipelineOptionsFactory() - Constructor for class com.google.cloud.dataflow.sdk.options.PipelineOptionsFactory
PipelineOptionsFactory.Builder - Class in com.google.cloud.dataflow.sdk.options: A fluent PipelineOptions builder.
PipelineOptionsRegistrar - Interface in com.google.cloud.dataflow.sdk.options: PipelineOptions creators have the ability to automatically have their PipelineOptions registered with this SDK by creating a ServiceLoader entry and a concrete implementation of this interface.
PipelineOptionsValidator - Class in com.google.cloud.dataflow.sdk.options: Validates that the PipelineOptions conforms to all the Validation criteria.
PipelineOptionsValidator() - Constructor for class com.google.cloud.dataflow.sdk.options.PipelineOptionsValidator
PipelineResult - Interface in com.google.cloud.dataflow.sdk: Result of Pipeline.run().
PipelineResult.State - Enum in com.google.cloud.dataflow.sdk: Named constants for common values for the job state.
PipelineRunner<ResultT extends PipelineResult> - Class in com.google.cloud.dataflow.sdk.runners: A PipelineRunner can execute, translate, or otherwise process a Pipeline.
PipelineRunner() - Constructor for class com.google.cloud.dataflow.sdk.runners.PipelineRunner
PipelineRunnerRegistrar - Interface in com.google.cloud.dataflow.sdk.runners: PipelineRunner creators have the ability to automatically have their PipelineRunner registered with this SDK by creating a ServiceLoader entry and a concrete implementation of this interface.
plusDelayOf(Duration) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.TimeTrigger: Adds some delay to the original target time.
popNode() - Method in class com.google.cloud.dataflow.sdk.runners.TransformHierarchy: Removes the last TransformTreeNode from the stack.
position - Variable in class com.google.cloud.dataflow.sdk.util.common.worker.KeyGroupedShuffleEntries
POutput - Interface in com.google.cloud.dataflow.sdk.values: The interface for things that might be output from a PTransform.
POutputValueBase - Class in com.google.cloud.dataflow.sdk.values: A POutputValueBase is the abstract base class of PTransform outputs.
POutputValueBase(Pipeline) - Constructor for class com.google.cloud.dataflow.sdk.values.POutputValueBase
POutputValueBase() - Constructor for class com.google.cloud.dataflow.sdk.values.POutputValueBase: No-arg constructor for Java serialization only.
prefetchForMerge(ReduceFn.MergingStateContext) - Method in class com.google.cloud.dataflow.sdk.util.TriggerRunner
prefetchForTimer(ReduceFn.StateContext) - Method in class com.google.cloud.dataflow.sdk.util.TriggerRunner
prefetchForValue(ReduceFn.StateContext) - Method in class com.google.cloud.dataflow.sdk.util.TriggerRunner
prefetchOnElement(ReduceFn.StateContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterPane
prefetchOnElement(ReduceFn.StateContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterProcessingTime
prefetchOnElement(ReduceFn.StateContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Trigger: Called to allow the trigger to prefetch any state it will likely need to read from during an Trigger.onElement(com.google.cloud.dataflow.sdk.transforms.windowing.Trigger<W>.OnElementContext) call.
prefetchOnMerge(ReduceFn.MergingStateContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterPane
prefetchOnMerge(ReduceFn.MergingStateContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterProcessingTime
prefetchOnMerge(ReduceFn.MergingStateContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Trigger: Called to allow the trigger to prefetch any state it will likely need to read from during an Trigger.onMerge(com.google.cloud.dataflow.sdk.transforms.windowing.Trigger<W>.OnMergeContext) call.
prefetchOnTimer(ReduceFn.StateContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterPane
prefetchOnTimer(ReduceFn.StateContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterProcessingTime
prefetchOnTimer(ReduceFn.StateContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Trigger: Called to allow the trigger to prefetch any state it will likely need to read from during an Trigger.onTimer(com.google.cloud.dataflow.sdk.transforms.windowing.Trigger<W>.OnTimerContext) call.
prefetchOnTrigger(ReduceFn.StateContext) - Method in class com.google.cloud.dataflow.sdk.util.ReduceFn: Called before onTrigger is invoked to provide an opportunity to prefetch any needed state.
prepareWrite(WritableByteChannel) - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSink.FileBasedWriter: Called with the channel that a subclass will write its header, footer, and values to.
prepareWrite(WritableByteChannel) - Method in class com.google.cloud.dataflow.sdk.io.XmlSink.XmlWriter: Creates the output stream that elements will be written to.
primary - Variable in class com.google.cloud.dataflow.sdk.runners.dataflow.BasicSerializableSourceFormat.BoundedSourceSplit
PrintHandler(PrintStream) - Constructor for class com.google.cloud.dataflow.sdk.util.MonitoringUtil.PrintHandler: Construct the handler.
printHelp(PrintStream) - Static method in class com.google.cloud.dataflow.sdk.options.PipelineOptionsFactory: Outputs the set of registered options with the PipelineOptionsFactory with a description for each one if available to the output stream.
printHelp(PrintStream, Class<? extends PipelineOptions>) - Static method in class com.google.cloud.dataflow.sdk.options.PipelineOptionsFactory: Outputs the set of options available to be set for the passed in PipelineOptions interface.
printHtml(PrintWriter) - Method in class com.google.cloud.dataflow.sdk.runners.worker.MetricTrackingWindmillServerStub
process(Object) - Method in class com.google.cloud.dataflow.sdk.util.common.worker.FlattenOperation
process(Object) - Method in class com.google.cloud.dataflow.sdk.util.common.worker.OutputReceiver
process(Object) - Method in class com.google.cloud.dataflow.sdk.util.common.worker.ParDoOperation
process(Object) - Method in class com.google.cloud.dataflow.sdk.util.common.worker.PartialGroupByKeyOperation
process(Object) - Method in interface com.google.cloud.dataflow.sdk.util.common.worker.Receiver: Processes the element.
process(Object) - Method in class com.google.cloud.dataflow.sdk.util.common.worker.WriteOperation
process(List<JobMessage>) - Method in interface com.google.cloud.dataflow.sdk.util.MonitoringUtil.JobMessagesHandler: Process the rows.
process(List<JobMessage>) - Method in class com.google.cloud.dataflow.sdk.util.MonitoringUtil.PrintHandler
processBatch(InputT...) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnTester: A convenience operation that first calls DoFnTester.startBundle(), then calls DoFnTester.processElement(InputT) on each of the arguments, then calls DoFnTester.finishBundle(), then returns the result of DoFnTester.takeOutputElements().
ProcessContext() - Constructor for class com.google.cloud.dataflow.sdk.transforms.DoFn.ProcessContext
ProcessContext() - Constructor for class com.google.cloud.dataflow.sdk.transforms.DoFnWithContext.ProcessContext
processElement(DoFn<KV<K, Iterable<InputT>>, KV<K, OutputT>>.ProcessContext) - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.TestCombineDoFn
processElement(Object) - Method in class com.google.cloud.dataflow.sdk.runners.worker.ParDoFnBase
processElement(DoFn<InputT, OutputT>.ProcessContext) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFn: Processes one input element.
processElement(InputT) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnTester: Calls DoFn.processElement(com.google.cloud.dataflow.sdk.transforms.DoFn<InputT, OutputT>.ProcessContext) on the DoFn under test, in a context where DoFn.ProcessContext.element() returns the given element.
processElement(DoFn<InputT, OutputT>.ProcessContext) - Method in class com.google.cloud.dataflow.sdk.transforms.IntraBundleParallelization.MultiThreadedIntraBundleProcessingDoFn
processElement(DoFn<T, T>.ProcessContext) - Method in class com.google.cloud.dataflow.sdk.util.AssignWindowsDoFn
processElement(Object) - Method in interface com.google.cloud.dataflow.sdk.util.common.worker.ParDoFn
processElement(WindowedValue<InputT>) - Method in class com.google.cloud.dataflow.sdk.util.DoFnRunner: Calls DoFn.processElement(com.google.cloud.dataflow.sdk.transforms.DoFn<InputT, OutputT>.ProcessContext) with a ProcessContext containing the current element.
processElement(WindowedValue<InputT>) - Method in class com.google.cloud.dataflow.sdk.util.ReduceFnRunner
processElement(DoFn<KV<K, V>, KV<K, WindowedValue<V>>>.ProcessContext) - Method in class com.google.cloud.dataflow.sdk.util.ReifyTimestampAndWindowsDoFn
processElement(DoFn<Iterable<T>, T>.ProcessContext) - Method in class com.google.cloud.dataflow.sdk.util.StreamingPCollectionViewWriterFn
processState - Variable in class com.google.cloud.dataflow.sdk.util.common.worker.Operation
processValue(ReduceFn<K, InputT, OutputT, W>.ProcessValueContext) - Method in class com.google.cloud.dataflow.sdk.util.ReduceFn: Called for each value of type InputT associated with the current key.
processValue(ReduceFn<?, ?, ?, W>.ProcessValueContext) - Method in class com.google.cloud.dataflow.sdk.util.TriggerRunner: Run the trigger logic to deal with a new value.
ProcessValueContext() - Constructor for class com.google.cloud.dataflow.sdk.util.ReduceFn.ProcessValueContext
producesSortedKeys(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.AvroSource
producesSortedKeys(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.BoundedSource: Whether this source is known to produce key/value pairs with the (encoded) keys in lexicographically sorted order.
producesSortedKeys(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.CompressedSource: Returns whether the delegate source produces sorted keys.
producesSortedKeys(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.Source
producesSortedKeys(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.XmlSource
progressReportIntervalMs - Variable in class com.google.cloud.dataflow.sdk.util.common.worker.WorkProgressUpdater: The time period until the next work progress update.
progressTracker - Variable in class com.google.cloud.dataflow.sdk.runners.worker.FileBasedReader.FileBasedIterator
ProgressTracker<T> - Interface in com.google.cloud.dataflow.sdk.util.common.worker: Provides an interface to an object capable of tracking progress through a collection of elements to be processed.
ProgressTrackerGroup<T> - Class in com.google.cloud.dataflow.sdk.util.common.worker: Implements a group of linked ProgressTrackers that collectively track how far a processing loop has gotten through the elements it's processing.
ProgressTrackerGroup() - Constructor for class com.google.cloud.dataflow.sdk.util.common.worker.ProgressTrackerGroup
ProgressTrackingReiterator<T> - Class in com.google.cloud.dataflow.sdk.util.common.worker: Implements a Reiterator that uses a ProgressTracker to track how far it's gotten through some base Reiterator.
ProgressTrackingReiterator(Reiterator<T>, ProgressTracker<T>) - Constructor for class com.google.cloud.dataflow.sdk.util.common.worker.ProgressTrackingReiterator
PROJECT_ID_REGEXP - Static variable in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineRunner: Project IDs must contain lowercase letters, digits, or dashes.
PropertyNames - Class in com.google.cloud.dataflow.sdk.util: Constant property names used by the SDK in CloudWorkflow specifications.
PropertyNames() - Constructor for class com.google.cloud.dataflow.sdk.util.PropertyNames
Proto2Coder<T extends com.google.protobuf.Message> - Class in com.google.cloud.dataflow.sdk.coders: An encoder using Google Protocol Buffers 2 binary format.
PROVIDER - Static variable in class com.google.cloud.dataflow.sdk.coders.AvroCoder
PROVIDER - Static variable in class com.google.cloud.dataflow.sdk.coders.SerializableCoder: A CoderProvider that constructs a SerializableCoder for any class that implements serializable.
pruningClass(Class<?>) - Method in class com.google.cloud.dataflow.sdk.util.ApiSurface: Returns an ApiSurface like this one, but pruning references from the provided class.
pruningClassName(String) - Method in class com.google.cloud.dataflow.sdk.util.ApiSurface: Returns an ApiSurface like this one, but pruning references from the named class.
pruningPattern(Pattern) - Method in class com.google.cloud.dataflow.sdk.util.ApiSurface: Returns an ApiSurface like this one, but pruning transitive references from classes whose full name (including package) begins with the provided prefix.
pruningPattern(String) - Method in class com.google.cloud.dataflow.sdk.util.ApiSurface: See {@link #pruningPattern(Pattern).
pruningPrefix(String) - Method in class com.google.cloud.dataflow.sdk.util.ApiSurface: Returns an ApiSurface like this one, but pruning transitive references from classes whose full name (including package) begins with the provided prefix.
PTransform<InputT extends PInput,OutputT extends POutput> - Class in com.google.cloud.dataflow.sdk.transforms: A PTransform<InputT, OutputT> is an operation that takes an InputT (some subtype of PInput) and produces an OutputT (some subtype of POutput).
PTransform() - Constructor for class com.google.cloud.dataflow.sdk.transforms.PTransform
PTransform(String) - Constructor for class com.google.cloud.dataflow.sdk.transforms.PTransform
PTuple - Class in com.google.cloud.dataflow.sdk.util: A PTuple is an immutable tuple of heterogeneously-typed values, "keyed" by TupleTags.
publish(LogRecord) - Method in class com.google.cloud.dataflow.sdk.runners.worker.logging.DataflowWorkerLoggingHandler
PUBSUB_ID_LABEL - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
PUBSUB_SUBSCRIPTION - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
PUBSUB_TIMESTAMP_LABEL - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
PUBSUB_TOPIC - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
PubsubIO - Class in com.google.cloud.dataflow.sdk.io: Read and Write PTransforms for Pub/Sub streams.
PubsubIO() - Constructor for class com.google.cloud.dataflow.sdk.io.PubsubIO
PubsubIO.PubsubSubscription - Class in com.google.cloud.dataflow.sdk.io: Class representing a Pubsub Subscription.
PubsubIO.PubsubTopic - Class in com.google.cloud.dataflow.sdk.io: Class representing a Pubsub Topic.
PubsubIO.Read - Class in com.google.cloud.dataflow.sdk.io: A PTransform that continuously reads from a Pubsub stream and returns a PCollection<String> containing the items from the stream.
PubsubIO.Read.Bound<T> - Class in com.google.cloud.dataflow.sdk.io: A PTransform that reads from a PubSub source and returns a unbounded PCollection containing the items from the stream.
PubsubIO.Write - Class in com.google.cloud.dataflow.sdk.io: A PTransform that continuously writes a PCollection<String> to a Pubsub stream.
PubsubIO.Write.Bound<T> - Class in com.google.cloud.dataflow.sdk.io: A PTransform that writes an unbounded PCollection<String> to a PubSub stream.
PubsubIOTranslator - Class in com.google.cloud.dataflow.sdk.runners.dataflow: Pubsub transform support code for the Dataflow backend.
PubsubIOTranslator() - Constructor for class com.google.cloud.dataflow.sdk.runners.dataflow.PubsubIOTranslator
PubsubIOTranslator.ReadTranslator<T> - Class in com.google.cloud.dataflow.sdk.runners.dataflow: Implements PubsubIO Read translation for the Dataflow backend.
PubsubIOTranslator.WriteTranslator<T> - Class in com.google.cloud.dataflow.sdk.runners.dataflow: Implements PubsubIO Write translation for the Dataflow backend.
PubsubTopic(PubsubIO.PubsubTopic.Type, String, String) - Constructor for class com.google.cloud.dataflow.sdk.io.PubsubIO.PubsubTopic
pushNode(TransformTreeNode) - Method in class com.google.cloud.dataflow.sdk.runners.TransformHierarchy: Add a TransformTreeNode to the stack.
PValue - Interface in com.google.cloud.dataflow.sdk.values: A PValue is the interface to values that can be input and output from PTransforms.
PValueBase - Class in com.google.cloud.dataflow.sdk.values: A PValueBase is an abstract base class that provides sensible default implementations for methods of PValue.
PValueBase(Pipeline) - Constructor for class com.google.cloud.dataflow.sdk.values.PValueBase
PValueBase() - Constructor for class com.google.cloud.dataflow.sdk.values.PValueBase: No-arg constructor for Java serialization only.

R

randomizeIfUnordered(List<T>, boolean) - Method in interface com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.EvaluationContext: If the evaluation context is testing unorderedness, randomly permutes the order of the elements, in a copy if !inPlaceAllowed, and returns the permuted list, otherwise returns the argument unchanged.
RangeTracker<PositionT> - Interface in com.google.cloud.dataflow.sdk.io.range: A RangeTracker is a thread-safe helper object for implementing dynamic work rebalancing in position-based BoundedSource.BoundedReader subclasses.
rangeTracker - Variable in class com.google.cloud.dataflow.sdk.runners.worker.FileBasedReader.FileBasedIterator
RawUnionValue - Class in com.google.cloud.dataflow.sdk.transforms.join: This corresponds to an integer union tag and value.
RawUnionValue(int, Object) - Constructor for class com.google.cloud.dataflow.sdk.transforms.join.RawUnionValue: Constructs a partial union from the given union tag and value.
Read() - Constructor for class com.google.cloud.dataflow.sdk.io.AvroIO.Read
Read() - Constructor for class com.google.cloud.dataflow.sdk.io.BigQueryIO.Read
read() - Static method in class com.google.cloud.dataflow.sdk.io.DatastoreIO: Returns an empty DatastoreIO.Read builder with the default host.
Read() - Constructor for class com.google.cloud.dataflow.sdk.io.PubsubIO.Read
Read - Class in com.google.cloud.dataflow.sdk.io: A PTransform for reading from a Source.
Read() - Constructor for class com.google.cloud.dataflow.sdk.io.Read
Read() - Constructor for class com.google.cloud.dataflow.sdk.io.TextIO.Read
read(ShufflePosition, ShufflePosition) - Method in class com.google.cloud.dataflow.sdk.util.common.worker.BatchingShuffleEntryReader
read(ShufflePosition, ShufflePosition) - Method in class com.google.cloud.dataflow.sdk.util.common.worker.CachingShuffleBatchReader
read(ShufflePosition, ShufflePosition) - Method in interface com.google.cloud.dataflow.sdk.util.common.worker.ShuffleBatchReader: Reads a batch of data from a shuffle dataset.
read(ShufflePosition, ShufflePosition) - Method in interface com.google.cloud.dataflow.sdk.util.common.worker.ShuffleEntryReader: Returns an iterator that reads a range of entries from a shuffle dataset.
read() - Method in interface com.google.cloud.dataflow.sdk.util.state.StateContents: Read the current value.
Read.Bounded<T> - Class in com.google.cloud.dataflow.sdk.io: PTransform that reads from a BoundedSource.
Read.Builder - Class in com.google.cloud.dataflow.sdk.io: Helper class for building Read transforms.
Read.Unbounded<T> - Class in com.google.cloud.dataflow.sdk.io: PTransform that reads from a UnboundedSource.
readAll() - Method in class com.google.cloud.dataflow.sdk.util.ExposedByteArrayInputStream: Read all remaining bytes.
readBytes() - Method in class com.google.cloud.dataflow.sdk.runners.worker.OrderedCode: Returns the next byte array item from its encoded byte array store and removes the item from the store.
readBytes(int) - Method in class com.google.cloud.dataflow.sdk.runners.worker.OrderedCode: Reads (unencoded) len bytes.
readElement() - Method in class com.google.cloud.dataflow.sdk.runners.worker.FileBasedReader.FileBasedIterator: Reads the next element.
readElemsFromReader(Reader<T>) - Static method in class com.google.cloud.dataflow.sdk.util.ReaderUtils: Reads all elements from the given Reader.
readElemsFromSource(PipelineOptions, Source) - Static method in class com.google.cloud.dataflow.sdk.util.CloudSourceUtils: Creates a Reader from the given Dataflow Source API definition and reads all elements from it.
Reader() - Constructor for class com.google.cloud.dataflow.sdk.io.Source.Reader
Reader<T> - Class in com.google.cloud.dataflow.sdk.util.common.worker: Abstract base class for readers.
Reader() - Constructor for class com.google.cloud.dataflow.sdk.util.common.worker.Reader
reader - Variable in class com.google.cloud.dataflow.sdk.util.common.worker.ReadOperation: The Reader this operation reads from.
Reader.AbstractReaderIterator<T> - Class in com.google.cloud.dataflow.sdk.util.common.worker: An abstract base class for ReaderIterator implementations.
Reader.DynamicSplitRequest - Interface in com.google.cloud.dataflow.sdk.util.common.worker: A framework-specific way to specify how Reader.ReaderIterator.requestDynamicSplit(com.google.cloud.dataflow.sdk.util.common.worker.Reader.DynamicSplitRequest) should split the input into a primary and residual part.
Reader.DynamicSplitResult - Interface in com.google.cloud.dataflow.sdk.util.common.worker: A framework-specific way to specify how Reader.ReaderIterator.requestDynamicSplit(com.google.cloud.dataflow.sdk.util.common.worker.Reader.DynamicSplitRequest) has split the input into a primary and residual part.
Reader.DynamicSplitResultWithPosition - Class in com.google.cloud.dataflow.sdk.util.common.worker: A Reader.DynamicSplitResult that specifies the boundary between the primary and residual parts of the input using a Reader.Position.
Reader.Position - Interface in com.google.cloud.dataflow.sdk.util.common.worker: A representation of a position in an iteration through a Reader.
Reader.Progress - Interface in com.google.cloud.dataflow.sdk.util.common.worker: A representation of how far a ReaderIterator is through a Reader.
Reader.ReaderIterator<T> - Interface in com.google.cloud.dataflow.sdk.util.common.worker: A stateful iterator over the data in a Reader.
ReaderFactory - Class in com.google.cloud.dataflow.sdk.runners.worker: Constructs a Reader from a Dataflow API Source definition.
readerProgressToCloudProgress(Reader.Progress) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.SourceTranslationUtils
ReaderUtils - Class in com.google.cloud.dataflow.sdk.util: Utilities for working with Reader objects.
ReaderUtils() - Constructor for class com.google.cloud.dataflow.sdk.util.ReaderUtils
readFrom(String, DatastoreV1.Query) - Static method in class com.google.cloud.dataflow.sdk.io.DatastoreIO: Returns a PTransform that reads Datastore entities from the query against the given dataset.
readFrom(String, String, DatastoreV1.Query) - Static method in class com.google.cloud.dataflow.sdk.io.DatastoreIO: Returns a PTransform that reads Datastore entities from the query against the given dataset and host.
readFromFileWithClass(String, Class<T>) - Static method in class com.google.cloud.dataflow.sdk.io.AvroSource: Creates a Read transform that will read from an AvroSource that is configured to read records of the given type from a file pattern.
readFromSource(FileBasedSource<T>, CompressedSource.DecompressingChannelFactory) - Static method in class com.google.cloud.dataflow.sdk.io.CompressedSource: Creates a Read transform that reads from a CompressedSource that reads from an underlying FileBasedSource after decompressing it with a CompressedSource.DecompressingChannelFactory.
readIncludingPosition(byte[], byte[]) - Method in class com.google.cloud.dataflow.sdk.runners.worker.ApplianceShuffleReader
readInfinity() - Method in class com.google.cloud.dataflow.sdk.runners.worker.OrderedCode: Removes INFINITY item from its internal encoded byte array store if present.
readNextBlock() - Method in class com.google.cloud.dataflow.sdk.io.AvroSource.AvroReader
readNextBlock() - Method in class com.google.cloud.dataflow.sdk.io.BlockBasedSource.BlockBasedReader: Read the next block from the input.
readNextRecord() - Method in class com.google.cloud.dataflow.sdk.io.BlockBasedSource.Block: Reads the next record from the block and returns true iff one exists.
readNextRecord() - Method in class com.google.cloud.dataflow.sdk.io.BlockBasedSource.BlockBasedReader
readNextRecord() - Method in class com.google.cloud.dataflow.sdk.io.CompressedSource.CompressedReader: Reads the next record via the delegate reader.
readNextRecord() - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSource.FileBasedReader: Reads the next record from the channel provided by FileBasedSource.FileBasedReader.startReading(java.nio.channels.ReadableByteChannel).
readNumIncreasing() - Method in class com.google.cloud.dataflow.sdk.runners.worker.OrderedCode: Returns the next long item (encoded in big-endian format via writeNumIncreasing(long)) from its internal encoded byte array store and removes the item from the store.
ReadOperation - Class in com.google.cloud.dataflow.sdk.util.common.worker: A read operation.
ReadOperation(String, Reader<?>, OutputReceiver[], String, CounterSet.AddCounterMutator, StateSampler) - Constructor for class com.google.cloud.dataflow.sdk.util.common.worker.ReadOperation
readSideInput(PipelineOptions, SideInputInfo, Observer, ExecutionContext) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.SideInputUtils: Reads the given side input, producing the contents associated with a a PCollectionView.
readSideInput(PipelineOptions, SideInputInfo, ExecutionContext) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.SideInputUtils
readSignedNumIncreasing() - Method in class com.google.cloud.dataflow.sdk.runners.worker.OrderedCode: Returns the next long item (encoded via writeSignedNumIncreasing(long)) from its internal encoded byte array store and removes the item from the store.
readTrailingBytes() - Method in class com.google.cloud.dataflow.sdk.runners.worker.OrderedCode: Returns the trailing byte array item from its internal encoded byte array store and removes the item from the store.
ReadTranslator() - Constructor for class com.google.cloud.dataflow.sdk.runners.dataflow.AvroIOTranslator.ReadTranslator
ReadTranslator() - Constructor for class com.google.cloud.dataflow.sdk.runners.dataflow.BigQueryIOTranslator.ReadTranslator
ReadTranslator() - Constructor for class com.google.cloud.dataflow.sdk.runners.dataflow.PubsubIOTranslator.ReadTranslator
ReadTranslator - Class in com.google.cloud.dataflow.sdk.runners.dataflow: Translator for the Read PTransform for the Dataflow back-end.
ReadTranslator() - Constructor for class com.google.cloud.dataflow.sdk.runners.dataflow.ReadTranslator
ReadTranslator() - Constructor for class com.google.cloud.dataflow.sdk.runners.dataflow.TextIOTranslator.ReadTranslator
Receiver - Interface in com.google.cloud.dataflow.sdk.util.common.worker: Abstract interface of things that accept inputs one at a time via process().
receivers - Variable in class com.google.cloud.dataflow.sdk.util.common.worker.Operation: The array of consuming receivers, one per operation output "port" (e.g., DoFn main or side output).
ReceivingOperation - Class in com.google.cloud.dataflow.sdk.util.common.worker: The abstract base class for Operations that have inputs and implement process().
ReceivingOperation(String, OutputReceiver[], String, CounterSet.AddCounterMutator, StateSampler) - Constructor for class com.google.cloud.dataflow.sdk.util.common.worker.ReceivingOperation
recordAsOutput(AppliedPTransform<?, ?, ?>) - Method in class com.google.cloud.dataflow.sdk.values.PCollectionList
recordAsOutput(AppliedPTransform<?, ?, ?>) - Method in class com.google.cloud.dataflow.sdk.values.PCollectionTuple
recordAsOutput(AppliedPTransform<?, ?, ?>) - Method in interface com.google.cloud.dataflow.sdk.values.POutput: Records that this POutput is an output of the given PTransform.
recordAsOutput(AppliedPTransform<?, ?, ?>) - Method in class com.google.cloud.dataflow.sdk.values.POutputValueBase: Records that this POutputValueBase is an output with the given name of the given AppliedPTransform.
recordAsOutput(AppliedPTransform<?, ?, ?>) - Method in class com.google.cloud.dataflow.sdk.values.PValueBase
recordAsOutput(AppliedPTransform<?, ?, ?>, String) - Method in class com.google.cloud.dataflow.sdk.values.PValueBase: Records that this POutputValueBase is an output with the given name of the given AppliedPTransform in the given Pipeline.
recordContent(ReduceFn<?, ?, ?, W>.Context) - Method in class com.google.cloud.dataflow.sdk.util.NonEmptyPanes: Record that some content has been added to the window in context, and therefore the current pane is not empty.
RecordingPipelineVisitor - Class in com.google.cloud.dataflow.sdk.runners: Provides a simple Pipeline.PipelineVisitor that records the transformation tree.
RecordingPipelineVisitor() - Constructor for class com.google.cloud.dataflow.sdk.runners.RecordingPipelineVisitor
ReduceFn<K,InputT,OutputT,W extends BoundedWindow> - Class in com.google.cloud.dataflow.sdk.util: Specification for processing to happen after elements have been grouped by key.
ReduceFn() - Constructor for class com.google.cloud.dataflow.sdk.util.ReduceFn
ReduceFn.Context - Class in com.google.cloud.dataflow.sdk.util: Information accessible to all the processing methods in this ReduceFn.
ReduceFn.MergingStateContext - Interface in com.google.cloud.dataflow.sdk.util: Interface for interacting with persistent state within ReduceFn.onMerge(com.google.cloud.dataflow.sdk.util.ReduceFn<K, InputT, OutputT, W>.OnMergeContext).
ReduceFn.OnMergeContext - Class in com.google.cloud.dataflow.sdk.util: Information accessible within ReduceFn.onMerge(com.google.cloud.dataflow.sdk.util.ReduceFn<K, InputT, OutputT, W>.OnMergeContext).
ReduceFn.OnTriggerContext - Class in com.google.cloud.dataflow.sdk.util: Information accessible within ReduceFn.onTrigger(com.google.cloud.dataflow.sdk.util.ReduceFn<K, InputT, OutputT, W>.OnTriggerContext).
ReduceFn.ProcessValueContext - Class in com.google.cloud.dataflow.sdk.util: Information accessible within ReduceFn.processValue(com.google.cloud.dataflow.sdk.util.ReduceFn<K, InputT, OutputT, W>.ProcessValueContext).
ReduceFn.StateContext - Interface in com.google.cloud.dataflow.sdk.util: Interface for interacting with persistent state.
ReduceFn.Timers - Interface in com.google.cloud.dataflow.sdk.util: Interface for interacting with time.
ReduceFnRunner<K,InputT,OutputT,W extends BoundedWindow> - Class in com.google.cloud.dataflow.sdk.util: Manages the execution of a ReduceFn after a GroupByKey.GroupByKeyOnly has partitioned the PCollection by key.
ReduceFnRunner(K, WindowingStrategy<?, W>, TimerInternals, WindowingInternals<?, KV<K, OutputT>>, Aggregator<Long, Long>, Aggregator<Long, Long>, ReduceFn<K, InputT, OutputT, W>) - Constructor for class com.google.cloud.dataflow.sdk.util.ReduceFnRunner
ReflectHelpers - Class in com.google.cloud.dataflow.sdk.util.common: Utilities for working with with Classes and Methods.
ReflectHelpers() - Constructor for class com.google.cloud.dataflow.sdk.util.common.ReflectHelpers
register(Class<? extends PipelineOptions>) - Static method in class com.google.cloud.dataflow.sdk.options.PipelineOptionsFactory: This registers the interface with this factory.
register(WatchService, WatchEvent.Kind<?>[], WatchEvent.Modifier...) - Method in class com.google.cloud.dataflow.sdk.util.gcsfs.GcsPath
register(WatchService, WatchEvent.Kind<?>...) - Method in class com.google.cloud.dataflow.sdk.util.gcsfs.GcsPath
registerByteSizeObserver(T, ElementByteSizeObserver, Coder.Context) - Method in interface com.google.cloud.dataflow.sdk.coders.Coder: Notifies the ElementByteSizeObserver about the byte size of the encoded value using this Coder.
registerByteSizeObserver(ReadableDuration, ElementByteSizeObserver, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.DurationCoder
registerByteSizeObserver(Instant, ElementByteSizeObserver, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.InstantCoder
registerByteSizeObserver(IterableT, ElementByteSizeObserver, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.IterableLikeCoder: Notifies ElementByteSizeObserver about the byte size of the encoded value using this coder.
registerByteSizeObserver(KV<K, V>, ElementByteSizeObserver, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.KvCoder: Notifies ElementByteSizeObserver about the byte size of the encoded value using this coder.
registerByteSizeObserver(Map<K, V>, ElementByteSizeObserver, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.MapCoder: Notifies ElementByteSizeObserver about the byte size of the encoded value using this coder.
registerByteSizeObserver(T, ElementByteSizeObserver, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.StandardCoder: Notifies ElementByteSizeObserver about the byte size of the encoded value using this coder.
registerByteSizeObserver(T, ElementByteSizeObserver) - Method in class com.google.cloud.dataflow.sdk.runners.worker.MapTaskExecutorFactory.ElementByteSizeObservableCoder
registerByteSizeObserver(T, ElementByteSizeObserver) - Method in interface com.google.cloud.dataflow.sdk.util.common.ElementByteSizeObservable: Notifies the ElementByteSizeObserver about the byte size of the encoded value using this ElementByteSizeObservable.
registerByteSizeObserver(TimerOrElement<T>, ElementByteSizeObserver, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.util.TimerOrElement.TimerOrElementCoder
registerByteSizeObserver(WindowedValue<T>, ElementByteSizeObserver, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.util.WindowedValue.FullWindowedValueCoder
registerByteSizeObserver(WindowedValue<T>, ElementByteSizeObserver, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.util.WindowedValue.ValueOnlyWindowedValueCoder
registerCoder(Class<?>, Class<?>) - Method in class com.google.cloud.dataflow.sdk.coders.CoderRegistry: Registers coderClazz as the default Coder class to handle encoding and decoding instances of clazz, overriding prior registrations if any exist.
registerCoder(Class<?>, CoderFactory) - Method in class com.google.cloud.dataflow.sdk.coders.CoderRegistry: Registers coderFactory as the default CoderFactory to produce Coder instances to decode and encode instances of clazz.
registerCoder(Class<T>, Coder<T>) - Method in class com.google.cloud.dataflow.sdk.coders.CoderRegistry: Register the provided Coder for encoding all values of the specified Class.
registerDefaultTransformEvaluator(Class<TransformT>, DirectPipelineRunner.TransformEvaluator<? super TransformT>) - Static method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner: Records that instances of the specified PTransform class should be evaluated by default by the corresponding TransformEvaluator.
registerStandardCoders() - Method in class com.google.cloud.dataflow.sdk.coders.CoderRegistry: Registers standard Coders with this CoderRegistry.
registerStandardIOFactories(PipelineOptions) - Static method in class com.google.cloud.dataflow.sdk.util.IOChannelUtils: Registers standard factories globally.
registerTransformEvaluator(Class<TransformT>, DirectPipelineRunner.TransformEvaluator<TransformT>) - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner: Records that instances of the specified PTransform class should be evaluated by the corresponding TransformEvaluator.
registerTransformTranslator(Class<TransformT>, DataflowPipelineTranslator.TransformTranslator<? extends TransformT>) - Static method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator: Records that instances of the specified PTransform class should be translated by default by the corresponding DataflowPipelineTranslator.TransformTranslator.
ReifyTimestampAndWindowsDoFn<K,V> - Class in com.google.cloud.dataflow.sdk.util: DoFn that makes timestamps and window assignments explicit in the value part of each key/value pair.
ReifyTimestampAndWindowsDoFn() - Constructor for class com.google.cloud.dataflow.sdk.util.ReifyTimestampAndWindowsDoFn
ReifyTimestampsAndWindows() - Constructor for class com.google.cloud.dataflow.sdk.transforms.GroupByKey.ReifyTimestampsAndWindows
Reiterable<T> - Interface in com.google.cloud.dataflow.sdk.util.common: An Iterable that returns Reiterator iterators.
Reiterator<T> - Interface in com.google.cloud.dataflow.sdk.util.common: An Iterator with the ability to copy its iteration state.
relativize(Path) - Method in class com.google.cloud.dataflow.sdk.util.gcsfs.GcsPath
releaseFinal(ReduceFn<?, ?, ?, W>.Context) - Method in class com.google.cloud.dataflow.sdk.util.WatermarkHold
releaseOnTime(ReduceFn<?, ?, ?, W>.Context) - Method in class com.google.cloud.dataflow.sdk.util.WatermarkHold
remerge() - Static method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window: Creates a Window PTransform that does not change assigned windows, but will cause windows to be merged again as part of the next GroupByKey.
Remerge() - Constructor for class com.google.cloud.dataflow.sdk.transforms.windowing.Window.Remerge
remove(W) - Method in interface com.google.cloud.dataflow.sdk.util.ActiveWindowSet: Remove a window from the ActiveWindowSet.
remove() - Method in class com.google.cloud.dataflow.sdk.util.BigQueryTableRowIterator
remove() - Method in class com.google.cloud.dataflow.sdk.util.common.ForwardingReiterator
remove() - Method in class com.google.cloud.dataflow.sdk.util.common.PeekingReiterator
remove() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.GroupingShuffleEntryIterator
remove(W) - Method in class com.google.cloud.dataflow.sdk.util.MergingActiveWindowSet
remove(W) - Method in class com.google.cloud.dataflow.sdk.util.NonMergingActiveWindowSet
RemoveDuplicates<T> - Class in com.google.cloud.dataflow.sdk.transforms: RemoveDuplicates<T> takes a PCollection<T> and returns a PCollection<T> that has all the elements of the input but with duplicate elements removed such that each element is unique within each window.
RemoveDuplicates() - Constructor for class com.google.cloud.dataflow.sdk.transforms.RemoveDuplicates
removeTemporaryFiles(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSink.FileBasedWriteOperation: Removes temporary output files.
Repeatedly<W extends BoundedWindow> - Class in com.google.cloud.dataflow.sdk.transforms.windowing: Repeat a trigger, either until some condition is met or forever.
report(T) - Method in class com.google.cloud.dataflow.sdk.util.common.worker.ProgressTrackerGroup: Reports the indicated element.
reportProgressHelper() - Method in class com.google.cloud.dataflow.sdk.runners.worker.DataflowWorkProgressUpdater
reportProgressHelper() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.WorkProgressUpdater: Reports the current work progress to the worker service.
reportStats(Windmill.ReportStatsRequest) - Method in class com.google.cloud.dataflow.sdk.runners.worker.windmill.WindmillServerStub: Report execution information to the server.
reportWorkItemStatus(WorkItemStatus) - Method in class com.google.cloud.dataflow.sdk.runners.worker.DataflowWorker.WorkUnitClient: Reports a WorkItemStatus for an assigned WorkItem.
requestDynamicSplit(Reader.DynamicSplitRequest) - Method in class com.google.cloud.dataflow.sdk.runners.worker.FileBasedReader.FileBasedIterator
requestDynamicSplit(Reader.DynamicSplitRequest) - Method in class com.google.cloud.dataflow.sdk.util.common.worker.MapTaskExecutor
requestDynamicSplit(Reader.DynamicSplitRequest) - Method in class com.google.cloud.dataflow.sdk.util.common.worker.Reader.AbstractReaderIterator
requestDynamicSplit(Reader.DynamicSplitRequest) - Method in interface com.google.cloud.dataflow.sdk.util.common.worker.Reader.ReaderIterator: Attempts to split the input in two parts: the "primary" part and the "residual" part.
requestDynamicSplit(Reader.DynamicSplitRequest) - Method in class com.google.cloud.dataflow.sdk.util.common.worker.ReadOperation: Relays the split request to ReaderIterator.
requestDynamicSplit(Reader.DynamicSplitRequest) - Method in class com.google.cloud.dataflow.sdk.util.common.worker.WorkExecutor: See Reader.ReaderIterator.requestDynamicSplit(com.google.cloud.dataflow.sdk.util.common.worker.Reader.DynamicSplitRequest).
requestedLeaseDurationMs - Variable in class com.google.cloud.dataflow.sdk.util.common.worker.WorkProgressUpdater: The lease duration to request from the external worker service.
requiresDeduping() - Method in class com.google.cloud.dataflow.sdk.io.UnboundedSource: Returns whether this source requires explicit deduping.
reset() - Method in class com.google.cloud.dataflow.sdk.util.AttemptBoundedExponentialBackOff
reset() - Method in class com.google.cloud.dataflow.sdk.util.ExposedByteArrayOutputStream
reset() - Method in class com.google.cloud.dataflow.sdk.util.IntervalBoundedExponentialBackOff
resetMeanToValue(long, T) - Method in class com.google.cloud.dataflow.sdk.util.common.Counter: Resets the aggregation stream to this new value.
resetToValue(T) - Method in class com.google.cloud.dataflow.sdk.util.common.Counter: Resets the aggregation stream to this new value.
resetTree() - Method in interface com.google.cloud.dataflow.sdk.transforms.windowing.Trigger.TriggerInfo: Clears all keyed state for triggers in the current sub-tree and unsets all the associated finished bits.
Reshuffle<K,V> - Class in com.google.cloud.dataflow.sdk.util: A PTransform to reshuffle the elements based on their key.
residual - Variable in class com.google.cloud.dataflow.sdk.runners.dataflow.BasicSerializableSourceFormat.BoundedSourceSplit
resolve(String, String) - Method in class com.google.cloud.dataflow.sdk.util.FileIOChannelFactory
resolve(Path) - Method in class com.google.cloud.dataflow.sdk.util.gcsfs.GcsPath
resolve(String) - Method in class com.google.cloud.dataflow.sdk.util.gcsfs.GcsPath
resolve(String, String) - Method in class com.google.cloud.dataflow.sdk.util.GcsIOChannelFactory
resolve(String, String) - Method in interface com.google.cloud.dataflow.sdk.util.IOChannelFactory: Resolve the given other against the path.
resolve(String, String) - Static method in class com.google.cloud.dataflow.sdk.util.IOChannelUtils: Resolve the given other against the path.
resolveSibling(Path) - Method in class com.google.cloud.dataflow.sdk.util.gcsfs.GcsPath
resolveSibling(String) - Method in class com.google.cloud.dataflow.sdk.util.gcsfs.GcsPath
resolveType(Type) - Method in class com.google.cloud.dataflow.sdk.values.TypeDescriptor: Returns a TypeDescriptor representing the given type, with type variables resolved according to the specialization in this type.
RetryHttpRequestInitializer - Class in com.google.cloud.dataflow.sdk.util: Implements a request initializer that adds retry handlers to all HttpRequests.
RetryHttpRequestInitializer(HttpRequestInitializer) - Constructor for class com.google.cloud.dataflow.sdk.util.RetryHttpRequestInitializer
RetryHttpRequestInitializer(HttpRequestInitializer, Collection<Integer>) - Constructor for class com.google.cloud.dataflow.sdk.util.RetryHttpRequestInitializer
run() - Method in class com.google.cloud.dataflow.sdk.Pipeline: Runs the Pipeline.
run(Pipeline) - Method in class com.google.cloud.dataflow.sdk.runners.BlockingDataflowPipelineRunner: Processes the given Pipeline, returning the results.
run() - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipeline
run(Pipeline) - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineRunner
run() - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipeline
run(Pipeline) - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner
run(Pipeline) - Method in class com.google.cloud.dataflow.sdk.runners.PipelineRunner: Processes the given Pipeline, returning the results.
run(Pipeline) - Method in class com.google.cloud.dataflow.sdk.testing.TestDataflowPipelineRunner
run() - Method in class com.google.cloud.dataflow.sdk.testing.TestPipeline: Runs this TestPipeline, unwrapping any AssertionError that is raised during testing.
run() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.StateSampler
RunnableOnService - Interface in com.google.cloud.dataflow.sdk.testing: Category tag for tests that can be run on the DataflowPipelineRunner if the runIntegrationTestOnService System property is set to true.
Runner() - Constructor for class com.google.cloud.dataflow.sdk.runners.DataflowPipelineRegistrar.Runner
Runner() - Constructor for class com.google.cloud.dataflow.sdk.runners.DirectPipelineRegistrar.Runner
runReadLoop() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.ReadOperation
runStatusServer(int) - Method in class com.google.cloud.dataflow.sdk.runners.worker.DataflowWorker: Runs the status server to report worker health on the specified port.
runStatusServer(int) - Method in class com.google.cloud.dataflow.sdk.runners.worker.StreamingDataflowWorker
runWindowFn(WindowFn<T, W>, List<Long>) - Static method in class com.google.cloud.dataflow.sdk.testing.WindowFnTestUtils: Runs the WindowFn over the provided input, returning a map of windows to the timestamps in those windows.

S

Sample - Class in com.google.cloud.dataflow.sdk.transforms: PTransforms for taking samples of the elements in a PCollection, or samples of the values associated with each key in a PCollection of KVs.
Sample() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Sample
Sample.FixedSizedSampleFn<T> - Class in com.google.cloud.dataflow.sdk.transforms: CombineFn that computes a fixed-size sample of a collection of values.
Sample.SampleAny<T> - Class in com.google.cloud.dataflow.sdk.transforms: A PTransform that takes a PCollection<T> and a limit, and produces a new PCollection<T> containing up to limit elements of the input PCollection.
sampleElement() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.OutputObjectAndByteCounter
SamplingSizeEstimator(PartialGroupByKeyOperation.SizeEstimator<T>, double, double) - Constructor for class com.google.cloud.dataflow.sdk.util.common.worker.PartialGroupByKeyOperation.SamplingSizeEstimator
SamplingSizeEstimator(PartialGroupByKeyOperation.SizeEstimator<T>, double, double, long, Random) - Constructor for class com.google.cloud.dataflow.sdk.util.common.worker.PartialGroupByKeyOperation.SamplingSizeEstimator
SANE_CLASSPATH_SIZE - Static variable in class com.google.cloud.dataflow.sdk.util.PackageUtil: A reasonable upper bound on the number of jars required to launch a Dataflow job.
satisfies(SerializableFunction<Iterable<T>, Void>) - Method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert.IterableAssert: Applies a SerializableFunction to check the elements of the Iterable.
satisfies(DataflowAssert.AssertRelation<Iterable<T>, Iterable<T>>, Iterable<T>) - Method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert.IterableAssert: Applies a SerializableFunction to check the elements of the Iterable.
satisfies(SerializableFunction<T, Void>) - Method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert.SingletonAssert: Applies a SerializableFunction to check the value of this SingletonAssert's view.
satisfies(DataflowAssert.AssertRelation<T, T>, T) - Method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert.SingletonAssert: Applies an DataflowAssert.AssertRelation to check the provided relation against the value of this assert and the provided expected value.
saw(T) - Method in interface com.google.cloud.dataflow.sdk.util.common.worker.ProgressTracker: Reports an element to this ProgressTracker, as the element is about to be processed.
SCALAR_FIELD_NAME - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
SCHEME - Static variable in class com.google.cloud.dataflow.sdk.util.gcsfs.GcsPath
scopedState(int) - Method in class com.google.cloud.dataflow.sdk.util.common.worker.StateSampler: Returns an AutoCloseable StateSampler.ScopedState that will perform a state transition to the given state, and will automatically reset the state to the prior state upon closing.
seeker - Variable in class com.google.cloud.dataflow.sdk.runners.worker.FileBasedReader.FileBasedIterator
SEPARATOR - Static variable in class com.google.cloud.dataflow.sdk.runners.worker.OrderedCode
SerializableCoder<T extends Serializable> - Class in com.google.cloud.dataflow.sdk.coders: A SerializableCoder is a Coder for a Java class that implements Serializable.
SerializableCoder(Class<T>) - Constructor for class com.google.cloud.dataflow.sdk.coders.SerializableCoder
SerializableComparator<T> - Interface in com.google.cloud.dataflow.sdk.transforms: A Comparator that is also Serializable.
SerializableFunction<InputT,OutputT> - Interface in com.google.cloud.dataflow.sdk.transforms: A function that computes an output value of type OutputT from an input value of type InputT and is Serializable.
SerializableUtils - Class in com.google.cloud.dataflow.sdk.util: Utilities for working with Serializables.
SerializableUtils() - Constructor for class com.google.cloud.dataflow.sdk.util.SerializableUtils
SERIALIZED_FN - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
Serializer - Class in com.google.cloud.dataflow.sdk.util: Utility for converting objects between Java and Cloud representations.
Serializer() - Constructor for class com.google.cloud.dataflow.sdk.util.Serializer
serializeToByteArray(Serializable) - Static method in class com.google.cloud.dataflow.sdk.util.SerializableUtils: Serializes the argument into an array of bytes, and returns it.
serializeToCloudSource(Source<?>, PipelineOptions) - Static method in class com.google.cloud.dataflow.sdk.runners.dataflow.BasicSerializableSourceFormat
Sessions - Class in com.google.cloud.dataflow.sdk.transforms.windowing: A WindowFn windowing values into sessions separated by Sessions.gapDuration-long periods with no elements.
set(long...) - Static method in class com.google.cloud.dataflow.sdk.testing.WindowFnTestUtils: Creates a Set of elements to be used as expected output in WindowFnTestUtils.runWindowFn(com.google.cloud.dataflow.sdk.transforms.windowing.WindowFn<T, W>, java.util.List<java.lang.Long>).
set(T) - Method in interface com.google.cloud.dataflow.sdk.util.state.ValueState
SET_PROJECT_FROM_OPTIONS_WARNING - Static variable in class com.google.cloud.dataflow.sdk.io.BigQueryIO
setActiveReader(UnboundedSource.UnboundedReader<?>) - Method in class com.google.cloud.dataflow.sdk.util.StreamingModeExecutionContext
setApiRootUrl(String) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions
setAppName(String) - Method in interface com.google.cloud.dataflow.sdk.options.ApplicationNameOptions
setAutoscalingAlgorithm(DataflowPipelineWorkerPoolOptions.AutoscalingAlgorithmType) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions
SetCoder<T> - Class in com.google.cloud.dataflow.sdk.coders: A SetCoder<T> encodes any Set<T> as an encoding of an iterable of its elements.
SetCoder(Coder<T>) - Constructor for class com.google.cloud.dataflow.sdk.coders.SetCoder
setCoder(Coder<T>) - Method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert.IterableAssert: Sets the coder to use for elements of type T, as needed for internal purposes.
setCoder(Coder<T>) - Method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert.SingletonAssert: Sets the coder to use for elements of type T, as needed for internal purposes.
setCoder(Coder<T>) - Method in class com.google.cloud.dataflow.sdk.values.PCollection: Sets the Coder used by this PCollection to encode and decode the values stored in it.
setCoder(Coder<T>) - Method in class com.google.cloud.dataflow.sdk.values.TypedPValue: Sets the Coder used by this TypedPValue to encode and decode the values stored in it.
setCoderRegistry(CoderRegistry) - Method in class com.google.cloud.dataflow.sdk.Pipeline: Sets the CoderRegistry that this Pipeline uses.
setCredentialDir(String) - Method in interface com.google.cloud.dataflow.sdk.options.GcpOptions
setCredentialFactoryClass(Class<? extends CredentialFactory>) - Method in interface com.google.cloud.dataflow.sdk.options.GcpOptions
setCredentialId(String) - Method in interface com.google.cloud.dataflow.sdk.options.GcpOptions
setDataflowClient(Dataflow) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions
setDataflowEndpoint(String) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions
setDataflowJobFile(String) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions
setDefaultWorkerLogLevel(DataflowWorkerLoggingOptions.Level) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowWorkerLoggingOptions
setDirectPipelineRunnerRandomSeed(Long) - Method in interface com.google.cloud.dataflow.sdk.options.DirectPipelineOptions
setDiskSizeGb(int) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions
setDiskSourceImage(String) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions
setEnableCloudDebugger(boolean) - Method in interface com.google.cloud.dataflow.sdk.options.CloudDebuggerOptions
setEndtimeMillis(long) - Method in class com.google.cloud.dataflow.sdk.util.AttemptAndTimeBoundedExponentialBackOff
setExecutorService(ExecutorService) - Method in interface com.google.cloud.dataflow.sdk.options.GcsOptions
setExperiments(List<String>) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions
setFallbackCoderProvider(CoderProvider) - Method in class com.google.cloud.dataflow.sdk.coders.CoderRegistry
setFilesToStage(List<String>) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions
setFileSystem(FileSystem) - Method in class com.google.cloud.dataflow.sdk.util.gcsfs.GcsPath
setFinished(boolean) - Method in interface com.google.cloud.dataflow.sdk.transforms.windowing.Trigger.TriggerInfo: Sets the finished bit for the current trigger.
setGcpCredential(Credential) - Method in interface com.google.cloud.dataflow.sdk.options.GcpOptions
setGcsEndpoint(String) - Method in interface com.google.cloud.dataflow.sdk.options.GcsOptions
setGcsUtil(GcsUtil) - Method in interface com.google.cloud.dataflow.sdk.options.GcsOptions
setGoogleApiTrace(GoogleApiDebugOptions.GoogleApiTracer) - Method in interface com.google.cloud.dataflow.sdk.options.GoogleApiDebugOptions
setHooks(DataflowPipelineRunnerHooks) - Method in class com.google.cloud.dataflow.sdk.runners.BlockingDataflowPipelineRunner: Sets callbacks to invoke during execution see DataflowPipelineRunnerHooks.
setHooks(DataflowPipelineRunnerHooks) - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineRunner: Sets callbacks to invoke during execution see DataflowPipelineRunnerHooks.
setIOFactory(String, IOChannelFactory) - Static method in class com.google.cloud.dataflow.sdk.util.IOChannelUtils: Associates a scheme with an IOChannelFactory.
setIsBoundedInternal(PCollection.IsBounded) - Method in class com.google.cloud.dataflow.sdk.values.PCollection: Sets the PCollection.IsBounded of this PCollection.
setJobId(String) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowWorkerHarnessOptions
setJobId(String) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.logging.DataflowWorkerLoggingMDC: Sets the Job ID of the current thread, which will be inherited by child threads.
setJobMessageOutput(PrintStream) - Method in interface com.google.cloud.dataflow.sdk.options.BlockingDataflowPipelineOptions
setJobName(String) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineOptions
setKey(Object) - Method in class com.google.cloud.dataflow.sdk.util.BatchModeExecutionContext: Sets the key of the work currently being processed.
setLazy() - Method in class com.google.cloud.dataflow.sdk.util.common.ElementByteSizeObserver: Sets byte counting for the current element as lazy.
setMaxGroupingTableBytes(long) - Method in class com.google.cloud.dataflow.sdk.util.common.worker.PartialGroupByKeyOperation: Sets the maximum amount of memory the grouping table is allowed to consume before it has to be flushed.
setMaxNumWorkers(int) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions
setName(String) - Method in class com.google.cloud.dataflow.sdk.values.PCollection: Sets the name of this PCollection.
setName(String) - Method in class com.google.cloud.dataflow.sdk.values.PValueBase: Sets the name of this PValueBase.
setNetwork(String) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions
setNumWorkers(int) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions
setOutput(TransformTreeNode, POutput) - Method in class com.google.cloud.dataflow.sdk.runners.TransformHierarchy: Sets the output of a transform node.
setOutput(POutput) - Method in class com.google.cloud.dataflow.sdk.runners.TransformTreeNode: Adds an output to the transform node.
setOverrideWindmillBinary(String) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions
setPathValidator(PathValidator) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions
setPathValidatorClass(Class<? extends PathValidator>) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions
setPCollection(PCollection<T>, List<T>) - Method in interface com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.EvaluationContext: Shorthand for setting the value of a PCollection where the elements do not have timestamps or windows.
setPCollectionValuesWithMetadata(PCollection<T>, List<DirectPipelineRunner.ValueWithMetadata<T>>) - Method in interface com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.EvaluationContext: Sets the value of the given PCollection, where each element also has a timestamp and collection of windows.
setPCollectionView(PCollectionView<T>, Iterable<WindowedValue<ElemT>>) - Method in interface com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.EvaluationContext: Sets the value associated with the given PCollectionView.
setPCollectionWindowedValue(PCollection<T>, List<WindowedValue<T>>) - Method in interface com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.EvaluationContext: Sets the value of the given PCollection, where each element also has a timestamp and collection of windows.
setProgressUpdatePeriodMs(long) - Method in class com.google.cloud.dataflow.sdk.util.common.worker.ReadOperation: Controls the frequency at which progress is updated.
setProject(String) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineOptions
setProject(String) - Method in interface com.google.cloud.dataflow.sdk.options.GcpOptions
setPubsubRootUrl(String) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions
setRunner(Class<? extends PipelineRunner<?>>) - Method in interface com.google.cloud.dataflow.sdk.options.PipelineOptions
setSecretsFile(String) - Method in interface com.google.cloud.dataflow.sdk.options.GcpOptions
setServiceAccountKeyfile(String) - Method in interface com.google.cloud.dataflow.sdk.options.GcpOptions
setServiceAccountName(String) - Method in interface com.google.cloud.dataflow.sdk.options.GcpOptions
setSideInput(PCollectionView<?>, Iterable<WindowedValue<?>>) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnTester: Registers the values of a side input PCollectionView to pass to the DoFn under test.
setSideInputInGlobalWindow(PCollectionView<?>, Iterable<?>) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnTester: Registers the values for a side input PCollectionView to pass to the DoFn under test.
setSideInputs(Map<PCollectionView<?>, Iterable<WindowedValue<?>>>) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnTester: Registers the tuple of values of the side input PCollectionViews to pass to the DoFn under test.
setSideOutputTags(TupleTagList) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnTester: Registers the list of TupleTags that can be used by the DoFn under test to output to side output PCollections.
setStableUniqueNames(PipelineOptions.CheckEnabled) - Method in interface com.google.cloud.dataflow.sdk.options.PipelineOptions
setStageName(String) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.logging.DataflowWorkerLoggingMDC: Sets the Stage Name of the current thread, which will be inherited by child threads.
setStager(Stager) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions
setStagerClass(Class<? extends Stager>) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions
setStagingLocation(String) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineOptions
setState(int) - Method in class com.google.cloud.dataflow.sdk.util.common.worker.StateSampler: Sets the current thread state.
setState(String) - Method in class com.google.cloud.dataflow.sdk.util.common.worker.StateSampler: Sets the current thread state.
setStateSamplerAndOperationName(StateSampler, String) - Method in class com.google.cloud.dataflow.sdk.util.common.worker.Reader: Sets the state sampler and the state sampler operation name.
setStepName(String) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.logging.DataflowWorkerLoggingMDC: Sets the Step Name of the current thread, which will be inherited by child threads.
setStorageClient(Storage) - Method in class com.google.cloud.dataflow.sdk.util.GcsUtil
setStreaming(boolean) - Method in interface com.google.cloud.dataflow.sdk.options.StreamingOptions
setTeardownPolicy(DataflowPipelineWorkerPoolOptions.TeardownPolicy) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions
setTempDatasetId(String) - Method in interface com.google.cloud.dataflow.sdk.options.BigQueryOptions
setTempLocation(String) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineOptions
setTimer(TimerInternals.TimerData) - Method in class com.google.cloud.dataflow.sdk.util.BatchTimerInternals
setTimer(Instant, TimeDomain) - Method in interface com.google.cloud.dataflow.sdk.util.ReduceFn.Timers: Sets a timer to fire when the watermark or processing time is beyond the given timestamp.
setTimer(TimerInternals.TimerData) - Method in interface com.google.cloud.dataflow.sdk.util.TimerInternals: Writes out a timer to be fired when the watermark reaches the given timestamp.
setTransformNameMapping(Map<String, String>) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions
setTypeDescriptorInternal(TypeDescriptor<T>) - Method in class com.google.cloud.dataflow.sdk.values.PCollection: Sets the TypeDescriptor<T> for this PCollection<T>, so that the enclosing PCollectionTuple, PCollectionList<T>, or PTransform<?, PCollection<T>>, etc., can provide more detailed reflective information.
setTypeDescriptorInternal(TypeDescriptor<T>) - Method in class com.google.cloud.dataflow.sdk.values.TypedPValue: Sets the TypeDescriptor<T> associated with this class.
setUpdate(boolean) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions
setupDelegateAggregators() - Method in class com.google.cloud.dataflow.sdk.transforms.DoFn.Context: Sets up Aggregators created by the DoFn so they are usable within this context.
setWindowingStrategyInternal(WindowingStrategy<?, ?>) - Method in class com.google.cloud.dataflow.sdk.values.PCollection: Sets the WindowingStrategy of this PCollection.
setWorkerCacheMb(Integer) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowWorkerHarnessOptions
setWorkerDiskType(String) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions
setWorkerId(String) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowWorkerHarnessOptions
setWorkerId(String) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.logging.DataflowWorkerLoggingMDC: Sets the Worker ID of the current thread, which will be inherited by child threads.
setWorkerLogLevelOverrides(DataflowWorkerLoggingOptions.WorkerLogLevelOverrides) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowWorkerLoggingOptions
setWorkerMachineType(String) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions
setWorkId(String) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.logging.DataflowWorkerLoggingMDC: Sets the Work ID of the current thread, which will be inherited by child threads.
setZone(String) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions
SHARD_NAME_TEMPLATE - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
ShardedKeyCoder(Coder<KeyT>) - Constructor for class com.google.cloud.dataflow.sdk.io.BigQueryIO.ShardedKeyCoder
ShardingWritableByteChannel - Class in com.google.cloud.dataflow.sdk.util: Implements a WritableByteChannel that may contain multiple output shards.
ShardingWritableByteChannel() - Constructor for class com.google.cloud.dataflow.sdk.util.ShardingWritableByteChannel
ShardNameTemplate - Class in com.google.cloud.dataflow.sdk.io: Standard shard naming templates.
ShardNameTemplate() - Constructor for class com.google.cloud.dataflow.sdk.io.ShardNameTemplate
SHUFFLE_KIND - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
SHUFFLE_READER_CONFIG - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
SHUFFLE_WRITER_CONFIG - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
ShuffleBatchReader - Interface in com.google.cloud.dataflow.sdk.util.common.worker: ShuffleBatchReader provides an interface for reading a batch of key/value entries from a shuffle dataset.
ShuffleBatchReader.Batch - Class in com.google.cloud.dataflow.sdk.util.common.worker: The result returned by #read.
ShuffleEntry - Class in com.google.cloud.dataflow.sdk.util.common.worker: Entry written to/read from a shuffle dataset.
ShuffleEntry(byte[], byte[], byte[]) - Constructor for class com.google.cloud.dataflow.sdk.util.common.worker.ShuffleEntry
ShuffleEntry(byte[], byte[], byte[], byte[]) - Constructor for class com.google.cloud.dataflow.sdk.util.common.worker.ShuffleEntry
ShuffleEntryReader - Interface in com.google.cloud.dataflow.sdk.util.common.worker: ShuffleEntryReader provides an interface for reading key/value entries from a shuffle dataset.
ShufflePosition - Interface in com.google.cloud.dataflow.sdk.util.common.worker: Represents a position in a stream of ShuffleEntries.
ShuffleSink<T> - Class in com.google.cloud.dataflow.sdk.runners.worker: A sink that writes to a shuffle dataset.
ShuffleSink(PipelineOptions, byte[], ShuffleSink.ShuffleKind, Coder<WindowedValue<T>>, CounterSet.AddCounterMutator) - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.ShuffleSink
ShuffleSinkFactory - Class in com.google.cloud.dataflow.sdk.runners.worker: Creates a ShuffleSink from a CloudObject spec.
sideInput() - Method in class com.google.cloud.dataflow.sdk.runners.worker.MetricTrackingWindmillServerStub
sideInput(PCollectionView<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFn.ProcessContext: Returns the value of the side input for the window corresponding to the window of the main input element.
sideInput(PCollectionView<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnWithContext.ProcessContext: Returns the value of the side input.
SideInputReader - Interface in com.google.cloud.dataflow.sdk.util: The interface to objects that provide side inputs.
SideInputUtils - Class in com.google.cloud.dataflow.sdk.runners.worker: Utilities for working with side inputs.
SideInputUtils() - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.SideInputUtils
sideOutput(TupleTag<T>, T) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFn.Context: Adds the given element to the side output PCollection with the given tag.
sideOutput(TupleTag<T>, T) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnWithContext.Context: Adds the given element to the side output PCollection with the given tag.
sideOutputWithTimestamp(TupleTag<T>, T, Instant) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFn.Context: Adds the given element to the specified side output PCollection, with the given timestamp.
sideOutputWithTimestamp(TupleTag<T>, T, Instant) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnWithContext.Context: Adds the given element to the specified side output PCollection, with the given timestamp.
SimpleCombineFn(SerializableFunction<Iterable<V>, V>) - Constructor for class com.google.cloud.dataflow.sdk.transforms.Combine.SimpleCombineFn: Deprecated.
SingletonAssert(DataflowAssert.CreateActual<?, T>, Pipeline) - Constructor for class com.google.cloud.dataflow.sdk.testing.DataflowAssert.SingletonAssert
singletonView(Pipeline, WindowingStrategy<?, W>, boolean, T, Coder<T>) - Static method in class com.google.cloud.dataflow.sdk.util.PCollectionViews: Returns a PCollectionView<T> capable of processing elements encoded using the provided Coder and windowed using the provided * WindowingStrategy.
sink() - Static method in class com.google.cloud.dataflow.sdk.io.DatastoreIO: Returns a new DatastoreIO.Sink builder using the default host.
Sink(String, String) - Constructor for class com.google.cloud.dataflow.sdk.io.DatastoreIO.Sink: Constructs a Sink with given host and dataset.
sink - Variable in class com.google.cloud.dataflow.sdk.io.FileBasedSink.FileBasedWriteOperation: The Sink that this WriteOperation will write to.
Sink<T> - Class in com.google.cloud.dataflow.sdk.io: A Sink represents a resource that can be written to using the Write transform.
Sink() - Constructor for class com.google.cloud.dataflow.sdk.io.Sink
Sink<T> - Class in com.google.cloud.dataflow.sdk.util.common.worker: Abstract base class for Sinks.
Sink() - Constructor for class com.google.cloud.dataflow.sdk.util.common.worker.Sink
sink - Variable in class com.google.cloud.dataflow.sdk.util.common.worker.WriteOperation: The Sink this operation writes to.
Sink.SinkWriter<ElemT> - Interface in com.google.cloud.dataflow.sdk.util.common.worker: Writes to a Sink.
Sink.WriteOperation<T,WriteT> - Class in com.google.cloud.dataflow.sdk.io: A Sink.WriteOperation defines the process of a parallel write of objects to a Sink.
Sink.Writer<T,WriteT> - Class in com.google.cloud.dataflow.sdk.io: A Writer writes a bundle of elements from a PCollection to a sink.
SinkFactory - Class in com.google.cloud.dataflow.sdk.runners.worker: Constructs a Sink from a Dataflow service protocol Sink definition.
size() - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResultSchema: Returns the number of columns for this schema.
size() - Method in class com.google.cloud.dataflow.sdk.util.common.CounterSet
size() - Method in class com.google.cloud.dataflow.sdk.util.common.TaggedReiteratorList
size() - Method in class com.google.cloud.dataflow.sdk.values.PCollectionList: Returns the number of PCollections in this PCollectionList.
size() - Method in class com.google.cloud.dataflow.sdk.values.TupleTagList: Returns the number of TupleTags in this TupleTagList.
Sized<T> - Class in com.google.cloud.dataflow.sdk.util: A T with an accompanying size estimate.
SizedSideInputReader - Interface in com.google.cloud.dataflow.sdk.util: Extension to SideInputReader that can approximate the size of the side input.
SizedSideInputReader.Defaults - Class in com.google.cloud.dataflow.sdk.util: Abstract class providing default implementations for methods of SizedSideInputReader.
SlidingWindows - Class in com.google.cloud.dataflow.sdk.transforms.windowing: A WindowFn that windows values into possibly overlapping fixed-size timestamp-based windows.
smallest(int) - Static method in class com.google.cloud.dataflow.sdk.transforms.Top: Returns a PTransform that takes an input PCollection<T> and returns a PCollection<List<T>> with a single element containing the smallest count elements of the input PCollection<T>, in increasing order, sorted according to their natural order.
Smallest() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Top.Smallest
smallestPerKey(int) - Static method in class com.google.cloud.dataflow.sdk.transforms.Top: Returns a PTransform that takes an input PCollection<KV<K, V>> and returns a PCollection<KV<K, List<V>>> that contains an output element mapping each distinct key in the input PCollection to the smallest count values associated with that key in the input PCollection<KV<K, V>>, in increasing order, sorted according to their natural order.
SortValuesByTimestamp() - Constructor for class com.google.cloud.dataflow.sdk.transforms.GroupByKey.SortValuesByTimestamp
Source<T> - Class in com.google.cloud.dataflow.sdk.io: Base class for defining input formats and creating a Source for reading the input.
Source() - Constructor for class com.google.cloud.dataflow.sdk.io.Source
Source.Reader<T> - Class in com.google.cloud.dataflow.sdk.io: The interface that readers of custom input sources must implement.
SOURCE_DOES_NOT_NEED_SPLITTING - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
SOURCE_ESTIMATED_SIZE_BYTES - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
SOURCE_IS_INFINITE - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
SOURCE_METADATA - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
SOURCE_NAME - Static variable in class com.google.cloud.dataflow.sdk.runners.worker.ConcatReader
SOURCE_PRODUCES_SORTED_KEYS - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
SOURCE_SPEC - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
SOURCE_STEP_INPUT - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
SourceFormat - Interface in com.google.cloud.dataflow.sdk.util.common.worker: An interface for sources that can perform operations on source specifications, such as splitting the source and computing its metadata.
SourceFormat.OperationRequest - Interface in com.google.cloud.dataflow.sdk.util.common.worker: A representation of an operation on the specification of a source, e.g.
SourceFormat.OperationResponse - Interface in com.google.cloud.dataflow.sdk.util.common.worker: A representation of the result of a SourceOperationRequest.
SourceFormat.SourceSpec - Interface in com.google.cloud.dataflow.sdk.util.common.worker: A representation of a specification of a source.
SourceFormatFactory - Class in com.google.cloud.dataflow.sdk.runners.worker: Creates SourceFormat objects from Source.
SourceOperationExecutor - Class in com.google.cloud.dataflow.sdk.runners.worker: An executor for a source operation, defined by a SourceOperationRequest.
SourceOperationExecutor(PipelineOptions, SourceOperationRequest, CounterSet) - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.SourceOperationExecutor
SourceOperationExecutorFactory - Class in com.google.cloud.dataflow.sdk.runners.worker: Creates a SourceOperationExecutor from a SourceOperation.
SourceOperationExecutorFactory() - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.SourceOperationExecutorFactory
sourceOperationRequestToCloudSourceOperationRequest(SourceFormat.OperationRequest) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.SourceTranslationUtils
sourceOperationResponseToCloudSourceOperationResponse(SourceFormat.OperationResponse) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.SourceTranslationUtils
sourceSpecToCloudSource(SourceFormat.SourceSpec) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.SourceTranslationUtils
SourceTranslationUtils - Class in com.google.cloud.dataflow.sdk.runners.worker: Utilities for representing input-specific objects using Dataflow model protos.
SourceTranslationUtils() - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.SourceTranslationUtils
sourceWindows(W) - Method in interface com.google.cloud.dataflow.sdk.util.ActiveWindowSet: Return the set of windows that were merged to produce window.
sourceWindows(W) - Method in class com.google.cloud.dataflow.sdk.util.MergingActiveWindowSet
sourceWindows(W) - Method in class com.google.cloud.dataflow.sdk.util.NonMergingActiveWindowSet
span(IntervalWindow) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.IntervalWindow: Returns the minimal window that includes both this window and the given window.
SPLIT_RESPONSE_TOO_LARGE_ERROR - Static variable in class com.google.cloud.dataflow.sdk.runners.worker.SourceOperationExecutor
splitAtFraction(double) - Method in class com.google.cloud.dataflow.sdk.io.BoundedSource.BoundedReader: Tells the reader to narrow the range of the input it's going to read and give up the remainder, so that the new range would contain approximately the given fraction of the amount of data in the current range.
splitAtFraction(double) - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.DatastoreReader
splitAtFraction(double) - Method in class com.google.cloud.dataflow.sdk.io.OffsetBasedSource.OffsetBasedReader
splitIntoBundles(long, PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.BoundedSource: Splits the source into bundles of approximately given size (in bytes).
splitIntoBundles(long, PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.Source
splitIntoBundles(long, PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSource
splitIntoBundles(long, PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.OffsetBasedSource
splitRequestToApproximateProgress(Reader.DynamicSplitRequest) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.SourceTranslationUtils
stageClasspathElements(Collection<String>, String) - Static method in class com.google.cloud.dataflow.sdk.util.PackageUtil: Transfers the classpath elements to the staging location.
stageFiles() - Method in class com.google.cloud.dataflow.sdk.util.GcsStager
stageFiles() - Method in interface com.google.cloud.dataflow.sdk.util.Stager
Stager - Interface in com.google.cloud.dataflow.sdk.util: Interface for staging files needed for running a Dataflow pipeline.
StagerFactory() - Constructor for class com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions.StagerFactory
StandardCoder<T> - Class in com.google.cloud.dataflow.sdk.coders: A StandardCoder is a Coder that defines equality, hashing, and printing via the class name and recursively using StandardCoder.getComponents().
StandardCoder() - Constructor for class com.google.cloud.dataflow.sdk.coders.StandardCoder
StandardOutputFactory() - Constructor for class com.google.cloud.dataflow.sdk.options.BlockingDataflowPipelineOptions.StandardOutputFactory
start() - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.DatastoreReader
start() - Method in class com.google.cloud.dataflow.sdk.io.OffsetBasedSource.OffsetBasedReader
start() - Method in class com.google.cloud.dataflow.sdk.io.Source.Reader: Initializes the reader and advances the reader to the first record.
start() - Method in class com.google.cloud.dataflow.sdk.io.UnboundedSource.UnboundedReader: Initializes the reader and advances the reader to the first record.
start() - Method in class com.google.cloud.dataflow.sdk.runners.worker.StreamingDataflowWorker
start() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.IntervalWindow: Returns the start of this window, inclusive.
start() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.Operation: Starts this Operation's execution.
start() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.ParDoOperation
start() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.ProgressTrackerGroup
start() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.ReadOperation
start() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.WriteOperation
start(Windmill.WorkItem, Instant, WindmillStateReader, Windmill.WorkItemCommitRequest.Builder) - Method in class com.google.cloud.dataflow.sdk.util.StreamingModeExecutionContext
START_INDEX - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
START_OFFSET - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
START_SHUFFLE_POSITION - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
startBatchAndBlock() - Method in class com.google.cloud.dataflow.sdk.util.state.WindmillStateReader
startBundle(Receiver...) - Method in class com.google.cloud.dataflow.sdk.runners.worker.ParDoFnBase
startBundle(DoFn<InputT, OutputT>.Context) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFn: Prepares this DoFn instance for processing a batch of elements.
startBundle() - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnTester: Calls DoFn.startBundle(com.google.cloud.dataflow.sdk.transforms.DoFn<InputT, OutputT>.Context) on the DoFn under test.
startBundle(DoFn<InputT, OutputT>.Context) - Method in class com.google.cloud.dataflow.sdk.transforms.IntraBundleParallelization.MultiThreadedIntraBundleProcessingDoFn
startBundle(Receiver...) - Method in interface com.google.cloud.dataflow.sdk.util.common.worker.ParDoFn
startBundle() - Method in class com.google.cloud.dataflow.sdk.util.DoFnRunner: Calls DoFn.startBundle(com.google.cloud.dataflow.sdk.transforms.DoFn<InputT, OutputT>.Context).
startBundle() - Method in class com.google.cloud.dataflow.sdk.util.StreamingSideInputDoFnRunner
startImpl() - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSource.FileBasedReader
startImpl() - Method in class com.google.cloud.dataflow.sdk.io.OffsetBasedSource.OffsetBasedReader: Same as BoundedReader#start, except OffsetBasedSource.OffsetBasedReader base class takes care of coordinating against concurrent calls to OffsetBasedSource.OffsetBasedReader.splitAtFraction(double).
startPosition - Variable in class com.google.cloud.dataflow.sdk.runners.worker.FileBasedReader
startReading(ReadableByteChannel) - Method in class com.google.cloud.dataflow.sdk.io.AvroSource.AvroReader: Starts reading from the provided channel.
startReading(ReadableByteChannel) - Method in class com.google.cloud.dataflow.sdk.io.CompressedSource.CompressedReader: Creates a decompressing channel from the input channel and passes it to its delegate reader's FileBasedSource.FileBasedReader.startReading(ReadableByteChannel).
startReading(ReadableByteChannel) - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSource.FileBasedReader: Performs any initialization of the subclass of FileBasedReader that involves IO operations.
startReportingProgress() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.WorkProgressUpdater: Starts sending work progress updates to the worker service.
startState - Variable in class com.google.cloud.dataflow.sdk.util.common.worker.Operation
startsWith(Path) - Method in class com.google.cloud.dataflow.sdk.util.gcsfs.GcsPath
startsWith(String) - Method in class com.google.cloud.dataflow.sdk.util.gcsfs.GcsPath
state() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Trigger.OnMergeContext
state() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Trigger.TriggerContext: Returns the interface for accessing persistent state.
state() - Method in class com.google.cloud.dataflow.sdk.util.ReduceFn.Context: Return the interface for accessing state.
state() - Method in class com.google.cloud.dataflow.sdk.util.ReduceFn.OnMergeContext: Return the interface for accessing state.
state(StateNamespace, StateTag<T>) - Method in class com.google.cloud.dataflow.sdk.util.state.InMemoryStateInternals
State - Interface in com.google.cloud.dataflow.sdk.util.state: Base interface for all state locations.
state(StateNamespace, StateTag<T>) - Method in interface com.google.cloud.dataflow.sdk.util.state.StateInternals: Return the state associated with address in the specified namespace.
state(StateNamespace, StateTag<T>) - Method in class com.google.cloud.dataflow.sdk.util.state.WindmillStateInternals
StateContents<T> - Interface in com.google.cloud.dataflow.sdk.util.state: A StateContents is produced by the read methods on all State objects.
stateContentsOf(T) - Static method in class com.google.cloud.dataflow.sdk.util.ReduceFnRunner
StateFetcher - Class in com.google.cloud.dataflow.sdk.util: Class responsible for fetching state from the windmill server.
StateFetcher(MetricTrackingWindmillServerStub) - Constructor for class com.google.cloud.dataflow.sdk.util.StateFetcher
StateFetcher(MetricTrackingWindmillServerStub, Cache<StateFetcher.SideInputId, StateFetcher.SideInputCacheEntry>) - Constructor for class com.google.cloud.dataflow.sdk.util.StateFetcher
StateFetcher.SideInputState - Enum in com.google.cloud.dataflow.sdk.util: Indicates the caller's knowledge of whether a particular side input has been computed.
stateForName(String) - Method in class com.google.cloud.dataflow.sdk.util.common.worker.StateSampler: Returns the state associated with a name; creating a new state if necessary.
stateInternals() - Method in class com.google.cloud.dataflow.sdk.util.BaseExecutionContext.StepContext
stateInternals() - Method in interface com.google.cloud.dataflow.sdk.util.ExecutionContext.StepContext
StateInternals - Interface in com.google.cloud.dataflow.sdk.util.state: StateInternals describes the functionality a runner needs to provide for the State API to be supported.
stateInternals() - Method in interface com.google.cloud.dataflow.sdk.util.WindowingInternals
StateNamespace - Interface in com.google.cloud.dataflow.sdk.util.state: A namespace used for scoping state stored with StateInternals.
StateNamespaceForTest - Class in com.google.cloud.dataflow.sdk.util.state: A simple StateNamespace used for testing.
StateNamespaceForTest(String) - Constructor for class com.google.cloud.dataflow.sdk.util.state.StateNamespaceForTest
StateNamespaces - Class in com.google.cloud.dataflow.sdk.util.state: Factory methods for creating the StateNamespaces.
StateNamespaces.GlobalNamespace - Class in com.google.cloud.dataflow.sdk.util.state: StateNamespace that is global to the current key being processed.
StateNamespaces.WindowAndTriggerNamespace<W extends BoundedWindow> - Class in com.google.cloud.dataflow.sdk.util.state: StateNamespace that is scoped to a particular window and trigger index.
StateNamespaces.WindowNamespace<W extends BoundedWindow> - Class in com.google.cloud.dataflow.sdk.util.state: StateNamespace that is scoped to a specific window.
stateSampler - Variable in class com.google.cloud.dataflow.sdk.util.common.worker.MapTaskExecutor: The StateSampler for tracking where time is being spent, or null.
stateSampler - Variable in class com.google.cloud.dataflow.sdk.util.common.worker.Operation
stateSampler - Variable in class com.google.cloud.dataflow.sdk.util.common.worker.Reader: StateSampler object for readers interested in further breaking down of the state space at a finer granularity.
StateSampler - Class in com.google.cloud.dataflow.sdk.util.common.worker: A StateSampler object may be used to obtain an approximate breakdown of the time spent by an execution context in various states, as a fraction of the total time.
StateSampler(String, CounterSet.AddCounterMutator, long) - Constructor for class com.google.cloud.dataflow.sdk.util.common.worker.StateSampler: Constructs a new StateSampler that can be used to obtain an approximate breakdown of the time spent by an execution context in various states, as a fraction of the total time.
StateSampler(String, CounterSet.AddCounterMutator) - Constructor for class com.google.cloud.dataflow.sdk.util.common.worker.StateSampler: Constructs a new StateSampler that can be used to obtain an approximate breakdown of the time spent by an execution context in various states, as a fraction of the total time.
StateSampler.ScopedState - Class in com.google.cloud.dataflow.sdk.util.common.worker: A nested class that is used to account for states and state transitions based on lexical scopes.
stateSamplerOperationName - Variable in class com.google.cloud.dataflow.sdk.util.common.worker.Reader: Name to be used as a prefix with stateSampler.
StateTable - Class in com.google.cloud.dataflow.sdk.util.state: Table mapping StateNamespace and StateTag<?> to a State instance.
StateTable() - Constructor for class com.google.cloud.dataflow.sdk.util.state.StateTable
StateTag<StateT extends State> - Interface in com.google.cloud.dataflow.sdk.util.state: An address for persistent state.
StateTag.StateBinder - Interface in com.google.cloud.dataflow.sdk.util.state: Visitor for binding a StateTag and to the associated State.
StateTags - Class in com.google.cloud.dataflow.sdk.util.state: Static utility methods for creating StateTag instances.
StepContext(ExecutionContext, String, String) - Constructor for class com.google.cloud.dataflow.sdk.util.BaseExecutionContext.StepContext
stop() - Method in class com.google.cloud.dataflow.sdk.runners.worker.StreamingDataflowWorker
stopReportingProgress() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.WorkProgressUpdater: Stops sending work progress updates to the worker service.
storeCurrentPaneInfo(ReduceFn<?, ?, ?, ?>.Context, PaneInfo) - Method in class com.google.cloud.dataflow.sdk.util.PaneInfoTracker
stream - Variable in class com.google.cloud.dataflow.sdk.runners.worker.FileBasedReader.FileBasedIterator
StreamingDataflowWorker - Class in com.google.cloud.dataflow.sdk.runners.worker: Implements a Streaming Dataflow worker.
StreamingDataflowWorker(List<MapTask>, WindmillServerStub, DataflowWorkerHarnessOptions) - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.StreamingDataflowWorker
StreamingDataflowWorker.KeyTokenInvalidException - Exception in com.google.cloud.dataflow.sdk.runners.worker: Indicates that the key token was invalid when data was attempted to be fetched.
StreamingGroupAlsoByWindowsDoFn<K,InputT,OutputT,W extends BoundedWindow> - Class in com.google.cloud.dataflow.sdk.util: DoFn that merges windows and groups elements in those windows.
StreamingGroupAlsoByWindowsDoFn() - Constructor for class com.google.cloud.dataflow.sdk.util.StreamingGroupAlsoByWindowsDoFn
StreamingModeExecutionContext - Class in com.google.cloud.dataflow.sdk.util: ExecutionContext for use in streaming mode.
StreamingModeExecutionContext(StateFetcher, ConcurrentMap<ByteString, UnboundedSource.UnboundedReader<?>>, ConcurrentMap<String, String>) - Constructor for class com.google.cloud.dataflow.sdk.util.StreamingModeExecutionContext
StreamingModeExecutionContext.StreamingModeSideInputReader - Class in com.google.cloud.dataflow.sdk.util: A SideInputReader that fetches side inputs from the streaming worker's cache.
StreamingOptions - Interface in com.google.cloud.dataflow.sdk.options: Options used to configure streaming.
StreamingPCollectionViewWriterFn<T> - Class in com.google.cloud.dataflow.sdk.util: Utility DoFn for writing streaming PCollectionViews.
StreamingPubsubIOWrite(PubsubIO.Write.Bound<T>) - Constructor for class com.google.cloud.dataflow.sdk.runners.DataflowPipelineRunner.StreamingPubsubIOWrite: Builds an instance of this class from the overridden transform.
StreamingSideInputDoFnRunner<InputT,OutputT,W extends BoundedWindow> - Class in com.google.cloud.dataflow.sdk.util: Runs a DoFn by constructing the appropriate contexts and passing them in.
StreamingSideInputDoFnRunner(PipelineOptions, DoFnInfo<InputT, OutputT>, SideInputReader, DoFnRunner.OutputManager, TupleTag<OutputT>, List<TupleTag<?>>, ExecutionContext.StepContext, CounterSet.AddCounterMutator) - Constructor for class com.google.cloud.dataflow.sdk.util.StreamingSideInputDoFnRunner
StreamUtils - Class in com.google.cloud.dataflow.sdk.util: Utility functions for stream operations.
StringDelegateCoder<T> - Class in com.google.cloud.dataflow.sdk.coders: A StringDelegateCoder<T> wraps a Coder<String> and encodes/decodes values of type T via string representations.
StringDelegateCoder(Class<T>) - Constructor for class com.google.cloud.dataflow.sdk.coders.StringDelegateCoder
stringKey() - Method in interface com.google.cloud.dataflow.sdk.util.state.StateNamespace: Return a String representation of the key.
stringKey() - Method in class com.google.cloud.dataflow.sdk.util.state.StateNamespaceForTest
stringKey() - Method in class com.google.cloud.dataflow.sdk.util.state.StateNamespaces.GlobalNamespace
stringKey() - Method in class com.google.cloud.dataflow.sdk.util.state.StateNamespaces.WindowAndTriggerNamespace
stringKey() - Method in class com.google.cloud.dataflow.sdk.util.state.StateNamespaces.WindowNamespace
StringUtf8Coder - Class in com.google.cloud.dataflow.sdk.coders: A StringUtf8Coder encodes Java Strings in UTF-8 encoding.
StringUtils - Class in com.google.cloud.dataflow.sdk.util: Utilities for working with JSON and other human-readable string formats.
StringUtils() - Constructor for class com.google.cloud.dataflow.sdk.util.StringUtils
STRIP_TRAILING_NEWLINES - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
stripIds() - Static method in class com.google.cloud.dataflow.sdk.util.ValueWithRecordId
Structs - Class in com.google.cloud.dataflow.sdk.util: A collection of static methods for manipulating datastructure representations transferred via the Dataflow API.
StructuralByteArray(byte[]) - Constructor for class com.google.cloud.dataflow.sdk.util.common.worker.PartialGroupByKeyOperation.StructuralByteArray
structuralValue(byte[]) - Method in class com.google.cloud.dataflow.sdk.coders.ByteArrayCoder
structuralValue(T) - Method in interface com.google.cloud.dataflow.sdk.coders.Coder: Returns an object with an Object.equals() method that represents structural equality on the argument.
structuralValue(T) - Method in class com.google.cloud.dataflow.sdk.coders.DelegateCoder
structuralValue(KV<K, V>) - Method in class com.google.cloud.dataflow.sdk.coders.KvCoder
structuralValue(T) - Method in class com.google.cloud.dataflow.sdk.coders.StandardCoder
structuralValueConsistentWithEquals(Coder<T>, T, T) - Static method in class com.google.cloud.dataflow.sdk.testing.CoderProperties
structuralValueConsistentWithEqualsInContext(Coder<T>, Coder.Context, T, T) - Static method in class com.google.cloud.dataflow.sdk.testing.CoderProperties
subpath(int, int) - Method in class com.google.cloud.dataflow.sdk.util.gcsfs.GcsPath
subscription(String) - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read.Bound: Returns a new PubsubIO.Read PTransform that's like this one but reading from the given subscription.
subscription(String) - Static method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read: Creates and returns a PubsubIO.Read PTransform for reading from a specific Pubsub subscription.
subTrigger(int) - Method in interface com.google.cloud.dataflow.sdk.transforms.windowing.Trigger.TriggerInfo: Access the executable version of the specified sub-trigger.
subTriggers - Variable in class com.google.cloud.dataflow.sdk.transforms.windowing.Trigger
subTriggers() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Trigger
subTriggers() - Method in interface com.google.cloud.dataflow.sdk.transforms.windowing.Trigger.TriggerInfo: Access the executable versions of the sub-triggers of the current trigger.
subTriggers() - Method in class com.google.cloud.dataflow.sdk.util.ExecutableTrigger
Sum - Class in com.google.cloud.dataflow.sdk.transforms: PTransforms for computing the sum of the elements in a PCollection, or the sum of the values associated with each key in a PCollection of KVs.
Sum() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Sum
Sum.SumDoubleFn - Class in com.google.cloud.dataflow.sdk.transforms: A SerializableFunction that computes the sum of an Iterable of Doubles, useful as an argument to Combine.globally(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>) or Combine.perKey(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>).
Sum.SumIntegerFn - Class in com.google.cloud.dataflow.sdk.transforms: A SerializableFunction that computes the sum of an Iterable of Integers, useful as an argument to Combine.globally(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>) or Combine.perKey(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>).
Sum.SumLongFn - Class in com.google.cloud.dataflow.sdk.transforms: A SerializableFunction that computes the sum of an Iterable of Longs, useful as an argument to Combine.globally(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>) or Combine.perKey(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>).
SumDoubleFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Sum.SumDoubleFn
SumIntegerFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Sum.SumIntegerFn
SumLongFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Sum.SumLongFn
supportsRestart() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.FlattenOperation
supportsRestart() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.MapTaskExecutor
supportsRestart() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.Operation: Returns true if this Operation can be started again after it is finished.
supportsRestart() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.ParDoOperation
supportsRestart() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.PartialGroupByKeyOperation
supportsRestart() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.Reader: Returns whether this Reader can be restarted.
supportsRestart() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.ReadOperation
supportsRestart() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.Sink: Returns whether this Sink can be restarted.
supportsRestart() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.WriteOperation
switchStateKey(Object) - Method in class com.google.cloud.dataflow.sdk.util.BatchModeExecutionContext
switchStateKey(Object) - Method in class com.google.cloud.dataflow.sdk.util.DirectModeExecutionContext
SystemDoFnInternal - Annotation Type in com.google.cloud.dataflow.sdk.util: Annotation to mark DoFns as an internal component of the Dataflow SDK.

T

TableRowJsonCoder - Class in com.google.cloud.dataflow.sdk.coders: A TableRowJsonCoder encodes BigQuery TableRow objects.
TaggedKeyedPCollection(TupleTag<V>, PCollection<KV<K, V>>) - Constructor for class com.google.cloud.dataflow.sdk.transforms.join.KeyedPCollectionTuple.TaggedKeyedPCollection
TaggedReiteratorList - Class in com.google.cloud.dataflow.sdk.util.common: Provides a view a of re-iterable of tagged values, with monotonically increasing tags, as a list of tagged re-iterables.
TaggedReiteratorList(Reiterator<T>, TaggedReiteratorList.TagExtractor<T>) - Constructor for class com.google.cloud.dataflow.sdk.util.common.TaggedReiteratorList
TaggedReiteratorList(Reiterator<T>, TaggedReiteratorList.TagExtractor<T>, int) - Constructor for class com.google.cloud.dataflow.sdk.util.common.TaggedReiteratorList
TaggedReiteratorList.TagExtractor<T> - Interface in com.google.cloud.dataflow.sdk.util.common: Interface for extracting the tag and value from an opaque element.
takeOutputElements() - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnTester: Returns the elements output so far to the main output.
takeSideOutputElements(TupleTag<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnTester: Returns the elements output so far to the side output with the given tag.
TEMPORARY_FILENAME_SEPARATOR - Static variable in class com.google.cloud.dataflow.sdk.io.FileBasedSink.FileBasedWriteOperation: Name separator for temporary files.
temporaryFileRetention - Variable in class com.google.cloud.dataflow.sdk.io.FileBasedSink.FileBasedWriteOperation: Option to keep or remove temporary output files.
TestCombineDoFn(Combine.KeyedCombineFn<? super K, ? super InputT, AccumT, OutputT>, Coder<AccumT>, boolean, Random) - Constructor for class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.TestCombineDoFn
TestCredential - Class in com.google.cloud.dataflow.sdk.util: Fake credential, for use in testing.
TestCredential() - Constructor for class com.google.cloud.dataflow.sdk.util.TestCredential
TestCredential(String) - Constructor for class com.google.cloud.dataflow.sdk.util.TestCredential
TestDataflowPipelineOptions - Interface in com.google.cloud.dataflow.sdk.testing: A set of options used to configure the TestPipeline.
TestDataflowPipelineRunner - Class in com.google.cloud.dataflow.sdk.testing: TestDataflowPipelineRunner is a pipeline runner that wraps a DataflowPipelineRunner when running tests against the TestPipeline.
TestPipeline - Class in com.google.cloud.dataflow.sdk.testing: A creator of test pipelines that can be used inside of tests that can be configured to run locally or against the live service.
TEXT - Static variable in class com.google.cloud.dataflow.sdk.util.MimeTypes
TextIO - Class in com.google.cloud.dataflow.sdk.io: PTransforms for reading and writing text files.
TextIO() - Constructor for class com.google.cloud.dataflow.sdk.io.TextIO
TextIO.CompressionType - Enum in com.google.cloud.dataflow.sdk.io: Possible text file compression types.
TextIO.Read - Class in com.google.cloud.dataflow.sdk.io: A PTransform that reads from a text file (or multiple text files matching a pattern) and returns a PCollection containing the decoding of each of the lines of the text file(s).
TextIO.Read.Bound<T> - Class in com.google.cloud.dataflow.sdk.io: A PTransform that reads from a text file (or multiple text files matching a pattern) and returns a bounded PCollection containing the decoding of each of the lines of the text file(s).
TextIO.Write - Class in com.google.cloud.dataflow.sdk.io: A PTransform that writes a PCollection to a text file (or multiple text files matching a sharding pattern), with each PCollection element being encoded into its own line.
TextIO.Write.Bound<T> - Class in com.google.cloud.dataflow.sdk.io: A PTransform that writes a bounded PCollection to a text file (or multiple text files matching a sharding pattern), with each PCollection element being encoded into its own line.
TextIOTranslator - Class in com.google.cloud.dataflow.sdk.runners.dataflow: TextIO transform support code for the Dataflow backend.
TextIOTranslator() - Constructor for class com.google.cloud.dataflow.sdk.runners.dataflow.TextIOTranslator
TextIOTranslator.ReadTranslator - Class in com.google.cloud.dataflow.sdk.runners.dataflow: Implements TextIO Read translation for the Dataflow backend.
TextIOTranslator.WriteTranslator - Class in com.google.cloud.dataflow.sdk.runners.dataflow: Implements TextIO Write translation for the Dataflow backend.
TextReader<T> - Class in com.google.cloud.dataflow.sdk.runners.worker: A source that reads text files.
TextReader(String, boolean, Long, Long, Coder<T>, TextIO.CompressionType) - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.TextReader
TextReader(String, boolean, Long, Long, Coder<T>, boolean, TextIO.CompressionType) - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.TextReader
TextReaderFactory - Class in com.google.cloud.dataflow.sdk.runners.worker: Creates a TextReader from a CloudObject spec.
TextSink<T> - Class in com.google.cloud.dataflow.sdk.runners.worker: A sink that writes text files.
TextSinkFactory - Class in com.google.cloud.dataflow.sdk.runners.worker: Creates a TextSink from a CloudObject spec.
TextualIntegerCoder - Class in com.google.cloud.dataflow.sdk.coders: A TextualIntegerCoder encodes Integers as their textual, decimal, representation.
TextualIntegerCoder() - Constructor for class com.google.cloud.dataflow.sdk.coders.TextualIntegerCoder
that(PCollection<T>) - Static method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert: Constructs an DataflowAssert.IterableAssert for the elements of the provided PCollection.
thatIterable(PCollectionView<Iterable<T>>) - Static method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert: Constructs an DataflowAssert.IterableAssert for the value of the provided PCollectionView PCollectionView<Iterable<T>>.
thatMap(PCollection<KV<K, V>>) - Static method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert: Constructs a DataflowAssert.SingletonAssert for the value of the provided PCollection, which must have at most one value per key.
thatMultimap(PCollection<KV<K, V>>) - Static method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert: Constructs a DataflowAssert.SingletonAssert for the value of the provided PCollection.
thatSingleton(PCollection<T>) - Static method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert: Constructs a DataflowAssert.SingletonAssert for the value of the provided PCollection PCollection<T>, which must be a singleton.
thatSingletonIterable(PCollection<? extends Iterable<T>>) - Static method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert: Constructs an DataflowAssert.IterableAssert for the value of the provided PCollection which must contain a single Iterable<T> value.
timeDomain() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Trigger.OnTimerContext: Returns the time domain that thet timer was set for.
TimeDomain - Enum in com.google.cloud.dataflow.sdk.util: TimeDomain specifies whether an operation is based on timestamps of elements or current "real-world" time as reported while processing.
timer(Object, TimerInternals.TimerData) - Static method in class com.google.cloud.dataflow.sdk.util.TimerOrElement: Creates a new TimerOrElement<ElemT> representing a timer.
timerInternals() - Method in class com.google.cloud.dataflow.sdk.util.BaseExecutionContext.StepContext
timerInternals() - Method in interface com.google.cloud.dataflow.sdk.util.ExecutionContext.StepContext
TimerInternals - Interface in com.google.cloud.dataflow.sdk.util: Encapsulate interaction with time within the execution environment.
timerInternals() - Method in interface com.google.cloud.dataflow.sdk.util.WindowingInternals: Return the timer manager provided by the underlying system, or null if Timers need to be emulated.
TimerInternals.TimerData - Class in com.google.cloud.dataflow.sdk.util: Data about a timer as represented within TimerInternals.
TimerOrElement<ElemT> - Class in com.google.cloud.dataflow.sdk.util: Class representing either a timer, or arbitrary element.
TimerOrElement.TimerOrElementCoder<T> - Class in com.google.cloud.dataflow.sdk.util: Coder that forwards ByteSizeObserver calls to an underlying element coder.
timers() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Trigger.TriggerContext: Returns the interface for accessing timers.
timers() - Method in class com.google.cloud.dataflow.sdk.util.ReduceFn.Context: Return the interface for accessing timers.
timestamp() - Method in class com.google.cloud.dataflow.sdk.transforms.DoFn.ProcessContext: Returns the timestamp of the input element.
timestamp() - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnWithContext.ProcessContext: Returns the timestamp of the input element.
timestamp() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Trigger.OnTimerContext: Returns the time that the timer was set for.
timestamp() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.WindowFn.AssignContext: Returns the timestamp of the current element.
timestamp() - Method in class com.google.cloud.dataflow.sdk.util.ReduceFn.ProcessValueContext: Return the timestamp associated with the value.
TIMESTAMP_MAX_VALUE - Static variable in class com.google.cloud.dataflow.sdk.transforms.windowing.BoundedWindow
TIMESTAMP_MIN_VALUE - Static variable in class com.google.cloud.dataflow.sdk.transforms.windowing.BoundedWindow
TimeStampComparator() - Constructor for class com.google.cloud.dataflow.sdk.util.MonitoringUtil.TimeStampComparator
timestamped(Iterable<TimestampedValue<T>>) - Static method in class com.google.cloud.dataflow.sdk.transforms.Create: Returns a new Create.TimestampedValues transform that produces a PCollection containing the elements of the provided Iterable with the specified timestamps.
timestamped(TimestampedValue<T>...) - Static method in class com.google.cloud.dataflow.sdk.transforms.Create: Returns a new Create.TimestampedValues transform that produces a PCollection containing the specified elements with the specified timestamps.
timestamped(Iterable<T>, Iterable<Long>) - Static method in class com.google.cloud.dataflow.sdk.transforms.Create: Returns a new root transform that produces a PCollection containing the specified elements with the specified timestamps.
TimestampedValue<V> - Class in com.google.cloud.dataflow.sdk.values: An immutable (value, timestamp) pair.
TimestampedValue(V, Instant) - Constructor for class com.google.cloud.dataflow.sdk.values.TimestampedValue
TimestampedValue.TimestampedValueCoder<T> - Class in com.google.cloud.dataflow.sdk.values: A Coder for TimestampedValue.
timestampedValueInGlobalWindow(V, Instant) - Static method in class com.google.cloud.dataflow.sdk.util.WindowedValue: Returns a WindowedValue with the given value and timestamp, GlobalWindow and default pane.
timestampLabel(String) - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read.Bound: Returns a new PubsubIO.Read PTransform that's like this one but reading timestamps from the given PubSub label.
timestampLabel(String) - Static method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read: Creates and returns a PubsubIO.Read PTransform where record timestamps are expected to be provided using the PubSub labeling API.
timestampLabel(String) - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Write.Bound: Returns a new PubsubIO.Write PTransform that's like this one but publishing timestamps to the given PubSub label.
timestampLabel(String) - Static method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Write: If specified, Dataflow will add a Pubsub label to each output record specifying the logical timestamp of the record.
timestampMappers - Variable in class com.google.cloud.dataflow.sdk.transforms.windowing.TimeTrigger: A list of timestampMappers m1, m2, m3, ...
TimeTrigger<W extends BoundedWindow> - Class in com.google.cloud.dataflow.sdk.transforms.windowing: Support for manipulating the time at which time-based Triggers fire.
TimeTrigger(List<SerializableFunction<Instant, Instant>>) - Constructor for class com.google.cloud.dataflow.sdk.transforms.windowing.TimeTrigger
TimeUtil - Class in com.google.cloud.dataflow.sdk.util: A helper class for converting between Dataflow API and SDK time representations.
to(String) - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound: Returns a new AvroIO.Write PTransform that's like this one but that writes to the file(s) with the given filename prefix.
to(String) - Static method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write: Returns an AvroIO.Write PTransform that writes to the file(s) with the given prefix.
to(String) - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.Bound: Specifies the table specification.
to(TableReference) - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.Bound: Specifies the table to be written to.
to(SerializableFunction<BoundedWindow, String>) - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.Bound
to(String) - Static method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write: Creates a write transformation for the given table specification.
to(TableReference) - Static method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write: Creates a write transformation for the given table.
to(SerializableFunction<BoundedWindow, String>) - Static method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write: Creates a write transformation from a function that maps windows to table specifications.
to(String) - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Write.Bound: Returns a new TextIO.Write PTransform that's like this one but that writes to the file(s) with the given filename prefix.
to(String) - Static method in class com.google.cloud.dataflow.sdk.io.TextIO.Write: Returns a TextIO.Write PTransform that writes to the file(s) with the given prefix.
to(Sink<T>) - Static method in class com.google.cloud.dataflow.sdk.transforms.Write: Creates a Write transform that writes to the given Sink.
toAbsolutePath() - Method in class com.google.cloud.dataflow.sdk.util.gcsfs.GcsPath
toByteArray() - Method in class com.google.cloud.dataflow.sdk.util.ExposedByteArrayOutputStream
toCloudDuration(ReadableDuration) - Static method in class com.google.cloud.dataflow.sdk.util.TimeUtil: Converts a ReadableDuration into a Dataflow API duration string.
toCloudPosition(Reader.Position) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.SourceTranslationUtils
toCloudTime(ReadableInstant) - Static method in class com.google.cloud.dataflow.sdk.util.TimeUtil: Converts a ReadableInstant into a Dateflow API time value.
toDoFn(DoFnWithContext<InputT, OutputT>) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnReflector: Create a DoFn that the DoFnWithContext.
toDynamicSplitRequest(ApproximateProgress) - Static method in class com.google.cloud.dataflow.sdk.runners.worker.SourceTranslationUtils
toFile() - Method in class com.google.cloud.dataflow.sdk.util.gcsfs.GcsPath
toFilenamePrefix(String) - Method in class com.google.cloud.dataflow.sdk.io.XmlSink.Bound: Returns an XmlSink that writes to files with the given prefix.
TOO_MANY_SOURCE_SPLITS_ERROR - Static variable in class com.google.cloud.dataflow.sdk.runners.dataflow.BasicSerializableSourceFormat
Top - Class in com.google.cloud.dataflow.sdk.transforms: PTransforms for finding the largest (or smallest) set of elements in a PCollection, or the largest (or smallest) set of values associated with each key in a PCollection of KVs.
Top() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Top
Top.Largest<T extends Comparable<? super T>> - Class in com.google.cloud.dataflow.sdk.transforms: A Serializable Comparator that that uses the compared elements' natural ordering.
Top.Smallest<T extends Comparable<? super T>> - Class in com.google.cloud.dataflow.sdk.transforms: Serializable Comparator that that uses the reverse of the compared elements' natural ordering.
Top.TopCombineFn<T,ComparatorT extends Comparator<T> & Serializable> - Class in com.google.cloud.dataflow.sdk.transforms: CombineFn for Top transforms that combines a bunch of Ts into a single count-long List<T>, using compareFn to choose the largest Ts.
TopCombineFn(int, ComparatorT) - Constructor for class com.google.cloud.dataflow.sdk.transforms.Top.TopCombineFn
topic(String) - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read.Bound: Returns a new PubsubIO.Read PTransform that's like this one but reading from the give topic.
topic(String) - Static method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read: Creates and returns a PubsubIO.Read PTransform for reading from a Pubsub topic with the specified publisher topic.
topic(String) - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Write.Bound: Returns a new PubsubIO.Write PTransform that's like this one but writing to the given topic.
topic(String) - Static method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Write: The topic to publish to.
toRealPath(LinkOption...) - Method in class com.google.cloud.dataflow.sdk.util.gcsfs.GcsPath
toResourceName() - Method in class com.google.cloud.dataflow.sdk.util.gcsfs.GcsPath
toSourceSplit(BasicSerializableSourceFormat.BoundedSourceSplit<?>, PipelineOptions) - Static method in class com.google.cloud.dataflow.sdk.runners.dataflow.BasicSerializableSourceFormat
toState(String) - Static method in class com.google.cloud.dataflow.sdk.util.MonitoringUtil
toString() - Method in class com.google.cloud.dataflow.sdk.coders.DelegateCoder
toString() - Method in class com.google.cloud.dataflow.sdk.coders.StandardCoder
toString() - Method in class com.google.cloud.dataflow.sdk.coders.StringDelegateCoder
toString() - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.Source
toString() - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSource
toString() - Method in class com.google.cloud.dataflow.sdk.io.OffsetBasedSource
toString() - Method in class com.google.cloud.dataflow.sdk.io.range.OffsetRangeTracker
toString() - Method in class com.google.cloud.dataflow.sdk.Pipeline
toString() - Method in class com.google.cloud.dataflow.sdk.runners.BlockingDataflowPipelineRunner
toString() - Method in class com.google.cloud.dataflow.sdk.runners.dataflow.BasicSerializableSourceFormat.BoundedSourceSplit
toString() - Method in class com.google.cloud.dataflow.sdk.runners.dataflow.MapAggregatorValues
toString() - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipeline
toString() - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineRunner
toString() - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator
toString() - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipeline
toString() - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner
toString() - Method in class com.google.cloud.dataflow.sdk.runners.worker.ByteArrayShufflePosition
toString() - Method in class com.google.cloud.dataflow.sdk.runners.worker.GroupingShuffleRangeTracker
toString() - Method in class com.google.cloud.dataflow.sdk.testing.TestDataflowPipelineRunner
toString() - Method in class com.google.cloud.dataflow.sdk.testing.TestPipeline
toString() - Method in class com.google.cloud.dataflow.sdk.transforms.AppliedPTransform
toString() - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult
toString() - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResultSchema
toString() - Method in class com.google.cloud.dataflow.sdk.transforms.join.RawUnionValue
toString() - Method in class com.google.cloud.dataflow.sdk.transforms.PTransform
toString() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterPane
toString() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterProcessingTime
toString() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.IntervalWindow
toString() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.PaneInfo
toString() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Trigger
toString() - Method in class com.google.cloud.dataflow.sdk.util.BatchTimerInternals
toString() - Method in class com.google.cloud.dataflow.sdk.util.common.Counter: Returns a string representation of the Counter.
toString() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.PartialGroupByKeyOperation.StructuralByteArray
toString() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.Reader.DynamicSplitResultWithPosition
toString() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.ShuffleEntry
toString() - Method in class com.google.cloud.dataflow.sdk.util.ExecutableTrigger
toString() - Method in class com.google.cloud.dataflow.sdk.util.gcsfs.GcsPath
toString() - Method in class com.google.cloud.dataflow.sdk.util.state.StateNamespaces.GlobalNamespace
toString() - Method in class com.google.cloud.dataflow.sdk.util.state.StateNamespaces.WindowAndTriggerNamespace
toString() - Method in class com.google.cloud.dataflow.sdk.util.state.StateNamespaces.WindowNamespace
toString() - Method in class com.google.cloud.dataflow.sdk.util.TimerInternals.TimerData
toString() - Method in class com.google.cloud.dataflow.sdk.util.ValueWithRecordId
toString() - Method in class com.google.cloud.dataflow.sdk.util.WindowedValue
toString() - Method in class com.google.cloud.dataflow.sdk.util.WindowingStrategy
toString() - Method in class com.google.cloud.dataflow.sdk.values.KV
toString() - Method in class com.google.cloud.dataflow.sdk.values.PValueBase
toString() - Method in class com.google.cloud.dataflow.sdk.values.TimestampedValue
toString() - Method in class com.google.cloud.dataflow.sdk.values.TupleTag
toString() - Method in class com.google.cloud.dataflow.sdk.values.TypeDescriptor
toTableReference(SerializableFunction<BoundedWindow, TableReference>) - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.Bound
toTableReference(SerializableFunction<BoundedWindow, TableReference>) - Static method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write: Creates a write transformation from a function that maps windows to TableReference objects.
toTableSpec(TableReference) - Static method in class com.google.cloud.dataflow.sdk.io.BigQueryIO: Returns a canonical string representation of the TableReference.
toUri() - Method in class com.google.cloud.dataflow.sdk.util.gcsfs.GcsPath
TransformHierarchy - Class in com.google.cloud.dataflow.sdk.runners: Captures information about a collection of transformations and their associated PValues.
TransformHierarchy() - Constructor for class com.google.cloud.dataflow.sdk.runners.TransformHierarchy
transforms - Variable in class com.google.cloud.dataflow.sdk.runners.RecordingPipelineVisitor
TransformTreeNode - Class in com.google.cloud.dataflow.sdk.runners: Provides internal tracking of transform relationships with helper methods for initialization and ordered visitation.
TransformTreeNode(TransformTreeNode, PTransform<?, ?>, String, PInput) - Constructor for class com.google.cloud.dataflow.sdk.runners.TransformTreeNode: Creates a new TransformTreeNode with the given parent and transform.
translate(AvroIO.Read.Bound, DataflowPipelineTranslator.TranslationContext) - Method in class com.google.cloud.dataflow.sdk.runners.dataflow.AvroIOTranslator.ReadTranslator
translate(AvroIO.Write.Bound, DataflowPipelineTranslator.TranslationContext) - Method in class com.google.cloud.dataflow.sdk.runners.dataflow.AvroIOTranslator.WriteTranslator
translate(BigQueryIO.Read.Bound, DataflowPipelineTranslator.TranslationContext) - Method in class com.google.cloud.dataflow.sdk.runners.dataflow.BigQueryIOTranslator.ReadTranslator
translate(BigQueryIO.Write.Bound, DataflowPipelineTranslator.TranslationContext) - Method in class com.google.cloud.dataflow.sdk.runners.dataflow.BigQueryIOTranslator.WriteTranslator
translate(PubsubIO.Read.Bound, DataflowPipelineTranslator.TranslationContext) - Method in class com.google.cloud.dataflow.sdk.runners.dataflow.PubsubIOTranslator.ReadTranslator
translate(DataflowPipelineRunner.StreamingPubsubIOWrite, DataflowPipelineTranslator.TranslationContext) - Method in class com.google.cloud.dataflow.sdk.runners.dataflow.PubsubIOTranslator.WriteTranslator
translate(Read.Bounded<?>, DataflowPipelineTranslator.TranslationContext) - Method in class com.google.cloud.dataflow.sdk.runners.dataflow.ReadTranslator
translate(TextIO.Read.Bound, DataflowPipelineTranslator.TranslationContext) - Method in class com.google.cloud.dataflow.sdk.runners.dataflow.TextIOTranslator.ReadTranslator
translate(TextIO.Write.Bound, DataflowPipelineTranslator.TranslationContext) - Method in class com.google.cloud.dataflow.sdk.runners.dataflow.TextIOTranslator.WriteTranslator
translate(TransformT, DataflowPipelineTranslator.TranslationContext) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TransformTranslator
translate(Pipeline, List<DataflowPackage>) - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator: Translates a Pipeline into a JobSpecification.
translateReadHelper(Source<T>, PTransform<?, ? extends PValue>, DataflowPipelineTranslator.TranslationContext) - Static method in class com.google.cloud.dataflow.sdk.runners.dataflow.BasicSerializableSourceFormat
Transport - Class in com.google.cloud.dataflow.sdk.util: Helpers for cloud communication.
Transport() - Constructor for class com.google.cloud.dataflow.sdk.util.Transport
traverseTopologically(Pipeline.PipelineVisitor) - Method in class com.google.cloud.dataflow.sdk.Pipeline: Invokes the PipelineVisitor's Pipeline.PipelineVisitor.visitTransform(com.google.cloud.dataflow.sdk.runners.TransformTreeNode) and Pipeline.PipelineVisitor.visitValue(com.google.cloud.dataflow.sdk.values.PValue, com.google.cloud.dataflow.sdk.runners.TransformTreeNode) operations on each of this Pipeline's PTransforms and PValues, in forward topological order.
Trigger<W extends BoundedWindow> - Class in com.google.cloud.dataflow.sdk.transforms.windowing: Triggers control when the elements for a specific key and window are output.
Trigger(List<Trigger<W>>) - Constructor for class com.google.cloud.dataflow.sdk.transforms.windowing.Trigger
trigger() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Trigger.OnMergeContext
trigger() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Trigger.TriggerContext: Returns the interface for accessing trigger info.
Trigger.MergeResult - Enum in com.google.cloud.dataflow.sdk.transforms.windowing: TriggerResult enumerates the possible result a trigger can have when it is merged.
Trigger.MergingTriggerInfo<W extends BoundedWindow> - Interface in com.google.cloud.dataflow.sdk.transforms.windowing: Interact with properties of the trigger being executed, with extensions to deal with the merging windows.
Trigger.OnceTrigger<W extends BoundedWindow> - Class in com.google.cloud.dataflow.sdk.transforms.windowing: Triggers that are guaranteed to fire at most once should extend from this, rather than the general Trigger class to indicate that behavior.
Trigger.OnElementContext - Class in com.google.cloud.dataflow.sdk.transforms.windowing: Details about an invocation of Trigger.onElement(com.google.cloud.dataflow.sdk.transforms.windowing.Trigger<W>.OnElementContext).
Trigger.OnMergeContext - Class in com.google.cloud.dataflow.sdk.transforms.windowing: Details about an invocation of Trigger.onMerge(com.google.cloud.dataflow.sdk.transforms.windowing.Trigger<W>.OnMergeContext).
Trigger.OnTimerContext - Class in com.google.cloud.dataflow.sdk.transforms.windowing: Details about an invocation of Trigger.onTimer(com.google.cloud.dataflow.sdk.transforms.windowing.Trigger<W>.OnTimerContext).
Trigger.TriggerContext - Class in com.google.cloud.dataflow.sdk.transforms.windowing: Information accessible to all of the callbacks that are executed on a Trigger.
Trigger.TriggerInfo<W extends BoundedWindow> - Interface in com.google.cloud.dataflow.sdk.transforms.windowing: Interface for accessing information about the trigger being executed and other triggers in the same tree.
Trigger.TriggerResult - Enum in com.google.cloud.dataflow.sdk.transforms.windowing: TriggerResult enumerates the possible result a trigger can have when it is executed.
TriggerContext() - Constructor for class com.google.cloud.dataflow.sdk.transforms.windowing.Trigger.TriggerContext
triggering(Trigger<?>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window.Bound: Sets a non-default trigger for this Window PTransform.
triggering(Trigger<?>) - Static method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window: Sets a non-default trigger for this Window PTransform.
triggering(Trigger<?>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window.Unbound: Sets a non-default trigger for this Window PTransform.
TriggerRunner<W extends BoundedWindow> - Class in com.google.cloud.dataflow.sdk.util: Executes a trigger within the context provided by ReduceFnRunner.
TriggerRunner(ExecutableTrigger<W>, TriggerContextFactory<W>) - Constructor for class com.google.cloud.dataflow.sdk.util.TriggerRunner
TriggerRunner.Result - Class in com.google.cloud.dataflow.sdk.util: Result of trigger execution.
tryCreateTable(TableSchema) - Method in class com.google.cloud.dataflow.sdk.util.BigQueryTableInserter: Tries to create the BigQuery table.
tryReturnRecordAt(boolean, Long) - Method in class com.google.cloud.dataflow.sdk.io.range.OffsetRangeTracker
tryReturnRecordAt(boolean, long) - Method in class com.google.cloud.dataflow.sdk.io.range.OffsetRangeTracker
tryReturnRecordAt(boolean, PositionT) - Method in interface com.google.cloud.dataflow.sdk.io.range.RangeTracker: Atomically determines whether a record at the given position can be returned and updates internal state.
tryReturnRecordAt(boolean, ByteArrayShufflePosition) - Method in class com.google.cloud.dataflow.sdk.runners.worker.GroupingShuffleRangeTracker
trySplitAtPosition(Long) - Method in class com.google.cloud.dataflow.sdk.io.range.OffsetRangeTracker
trySplitAtPosition(long) - Method in class com.google.cloud.dataflow.sdk.io.range.OffsetRangeTracker
trySplitAtPosition(PositionT) - Method in interface com.google.cloud.dataflow.sdk.io.range.RangeTracker: Atomically splits the current range [RangeTracker.getStartPosition(), RangeTracker.getStopPosition()) into a "primary" part [RangeTracker.getStartPosition(), splitPosition) and a "residual" part [splitPosition, RangeTracker.getStopPosition()), assuming the current last-consumed position is within [RangeTracker.getStartPosition(), splitPosition) (i.e., splitPosition has not been consumed yet).
trySplitAtPosition(ByteArrayShufflePosition) - Method in class com.google.cloud.dataflow.sdk.runners.worker.GroupingShuffleRangeTracker
TUPLE_TAGS - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
TupleTag<V> - Class in com.google.cloud.dataflow.sdk.values: A TupleTag is a typed tag to use as the key of a heterogeneously typed tuple, like PCollectionTuple or Its generic type parameter allows tracking the static type of things stored in tuples.
TupleTag() - Constructor for class com.google.cloud.dataflow.sdk.values.TupleTag: Constructs a new TupleTag, with a fresh unique id.
TupleTag(String) - Constructor for class com.google.cloud.dataflow.sdk.values.TupleTag: Constructs a new TupleTag with the given id.
TupleTagList - Class in com.google.cloud.dataflow.sdk.values: A TupleTagList is an immutable list of heterogeneously typed TupleTags.
type - Variable in class com.google.cloud.dataflow.sdk.util.OutputReference
TYPE_SIMPLE_DESCRIPTION - Static variable in class com.google.cloud.dataflow.sdk.util.common.ReflectHelpers: A Function that formats types.
TypeDescriptor<T> - Class in com.google.cloud.dataflow.sdk.values: A description of a Java type, including actual generic parameters where possible.
TypeDescriptor() - Constructor for class com.google.cloud.dataflow.sdk.values.TypeDescriptor: Creates a TypeDescriptor representing the type parameter T.
TypeDescriptor(Class<?>) - Constructor for class com.google.cloud.dataflow.sdk.values.TypeDescriptor: Creates a TypeDescriptor representing the type parameter T, which should resolve to a concrete type in the context of the class clazz.
TypedPValue<T> - Class in com.google.cloud.dataflow.sdk.values: A TypedPValue<T> is the abstract base class of things that store some number of values of type T.
TypedPValue(Pipeline) - Constructor for class com.google.cloud.dataflow.sdk.values.TypedPValue

U

UnboundedReader() - Constructor for class com.google.cloud.dataflow.sdk.io.UnboundedSource.UnboundedReader
UnboundedSource<OutputT,CheckpointMarkT extends UnboundedSource.CheckpointMark> - Class in com.google.cloud.dataflow.sdk.io: A Source that reads an unbounded amount of input and, because of that, supports some additional operations such as checkpointing, watermarks, and record ids.
UnboundedSource() - Constructor for class com.google.cloud.dataflow.sdk.io.UnboundedSource
UnboundedSource.CheckpointMark - Interface in com.google.cloud.dataflow.sdk.io: A marker representing the progress and state of an UnboundedSource.UnboundedReader.
UnboundedSource.UnboundedReader<OutputT> - Class in com.google.cloud.dataflow.sdk.io: A Reader that reads an unbounded amount of input.
unfinishedSubTriggers() - Method in interface com.google.cloud.dataflow.sdk.transforms.windowing.Trigger.TriggerInfo: Returns an iterable over the unfinished sub-triggers of the current trigger.
UngroupedShuffleReader<T> - Class in com.google.cloud.dataflow.sdk.runners.worker: A source that reads from a shuffled dataset, without any key grouping.
UngroupedShuffleReader(PipelineOptions, byte[], String, String, Coder<T>) - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.UngroupedShuffleReader
UngroupedShuffleReaderFactory - Class in com.google.cloud.dataflow.sdk.runners.worker: Creates an UngroupedShuffleReader from a CloudObject spec.
update(Object) - Method in class com.google.cloud.dataflow.sdk.runners.worker.DataflowOutputCounter
update(Object) - Method in class com.google.cloud.dataflow.sdk.util.common.ElementByteSizeObserver: Updates the observer with a context specified, but without an instance of the Observable.
update(Observable, Object) - Method in class com.google.cloud.dataflow.sdk.util.common.ElementByteSizeObserver
update(Object) - Method in interface com.google.cloud.dataflow.sdk.util.common.worker.ElementCounter: Updates output counters.
update(Object) - Method in class com.google.cloud.dataflow.sdk.util.common.worker.OutputObjectAndByteCounter
updateWindowingStrategy(WindowingStrategy<?, ?>) - Method in class com.google.cloud.dataflow.sdk.transforms.GroupByKey
useDefaultBufferSize - Variable in class com.google.cloud.dataflow.sdk.runners.worker.FileBasedReader
USER_FN - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
USER_NAME - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
UserCodeException - Exception in com.google.cloud.dataflow.sdk.util: An exception that was thrown in user-code.
UserCodeException(Throwable) - Constructor for exception com.google.cloud.dataflow.sdk.util.UserCodeException
USES_KEYED_STATE - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
usesSingleWindow() - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnReflector

V

validate() - Method in class com.google.cloud.dataflow.sdk.io.AvroSource
validate(PInput) - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Read.Bound: Validates the current PTransform.
validate() - Method in class com.google.cloud.dataflow.sdk.io.CompressedSource: Validates that the delegate source is a valid source and that the channel factory is not null.
validate(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.Sink: Ensures the host and dataset are set.
validate() - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.Source
validate(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSink: Perform pipeline-construction-time validation.
validate() - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSource
validate() - Method in class com.google.cloud.dataflow.sdk.io.OffsetBasedSource
validate(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.Sink: Ensures that the sink is valid and can be written to before the write operation begins.
validate() - Method in class com.google.cloud.dataflow.sdk.io.Source: Checks that this source is valid, before it can be used in a pipeline.
validate(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.XmlSink.Bound: Validates that the root element, class to bind to a JAXB context, and filenamePrefix have been set and that the class can be bound in a JAXB context.
validate() - Method in class com.google.cloud.dataflow.sdk.io.XmlSource
validate(Class<T>, PipelineOptions) - Static method in class com.google.cloud.dataflow.sdk.options.PipelineOptionsValidator: Validates that the passed PipelineOptions conforms to all the validation criteria from the passed in interface.
validate(PCollection<KV<K, V>>) - Method in class com.google.cloud.dataflow.sdk.transforms.GroupByKey
validate(InputT) - Method in class com.google.cloud.dataflow.sdk.transforms.PTransform: Called before invoking apply (which may be intercepted by the runner) to verify this transform is fully specified and applicable to the specified input.
validate(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.View.AsIterable
validate(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.View.AsList
validate(PCollection<KV<K, V>>) - Method in class com.google.cloud.dataflow.sdk.transforms.View.AsMap
validate(PCollection<KV<K, V>>) - Method in class com.google.cloud.dataflow.sdk.transforms.View.AsMultimap
validate(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.View.AsSingleton
validate(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window.Bound
VALIDATE_SINK - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
VALIDATE_SOURCE - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
validateGetOutputTimestamp(WindowFn<T, W>, long) - Static method in class com.google.cloud.dataflow.sdk.testing.WindowFnTestUtils: Assigns the given timestamp to windows using the specified windowFn, and verifies that result of windowFn.getOutputTimestamp for later windows (as defined by maxTimestamp won't prevent the watermark from passing the end of earlier windows.
validateInputFilePatternSupported(String) - Method in class com.google.cloud.dataflow.sdk.util.DataflowPathValidator: Validates the the input GCS path is accessible and that the path is well formed.
validateInputFilePatternSupported(String) - Method in class com.google.cloud.dataflow.sdk.util.NoopPathValidator
validateInputFilePatternSupported(String) - Method in interface com.google.cloud.dataflow.sdk.util.PathValidator: Validate that a file pattern is conforming.
validateNonInterferingOutputTimes(WindowFn<T, W>, long) - Static method in class com.google.cloud.dataflow.sdk.testing.WindowFnTestUtils: Assigns the given timestamp to windows using the specified windowFn, and verifies that result of windowFn.getOutputTimestamp for each window is within the proper bound.
validateOutputFilePrefixSupported(String) - Method in class com.google.cloud.dataflow.sdk.util.DataflowPathValidator: Validates the the output GCS path is accessible and that the path is well formed.
validateOutputFilePrefixSupported(String) - Method in class com.google.cloud.dataflow.sdk.util.NoopPathValidator
validateOutputFilePrefixSupported(String) - Method in interface com.google.cloud.dataflow.sdk.util.PathValidator: Validate that an output file prefix is conforming.
Validation - Annotation Type in com.google.cloud.dataflow.sdk.options: Validation represents a set of annotations that can be used to annotate getter properties on PipelineOptions with information representing the validation criteria to be used when validating with the PipelineOptionsValidator.
Validation.Required - Annotation Type in com.google.cloud.dataflow.sdk.options: This criteria specifies that the value must be not null.
VALUE - Static variable in class com.google.cloud.dataflow.sdk.util.PropertyNames
value() - Method in class com.google.cloud.dataflow.sdk.util.ReduceFn.ProcessValueContext: Return the actual value being processed.
value(String, Coder<T>) - Static method in class com.google.cloud.dataflow.sdk.util.state.StateTags: Create a simple state tag for values of type T.
value - Variable in class com.google.cloud.dataflow.sdk.util.WindowedValue
valueFuture(ByteString, String, Coder<T>) - Method in class com.google.cloud.dataflow.sdk.util.state.WindmillStateReader
valueInEmptyWindows(V) - Static method in class com.google.cloud.dataflow.sdk.util.WindowedValue: Returns a WindowedValue with the given value in no windows, and the default timestamp and pane.
valueInEmptyWindows(V, PaneInfo) - Static method in class com.google.cloud.dataflow.sdk.util.WindowedValue: Returns a WindowedValue with the given value in no windows, and the default timestamp and the specified pane.
valueInGlobalWindow(V) - Static method in class com.google.cloud.dataflow.sdk.util.WindowedValue: Returns a WindowedValue with the given value in the GlobalWindow using the default timestamp and pane.
valueInGlobalWindow(V, PaneInfo) - Static method in class com.google.cloud.dataflow.sdk.util.WindowedValue: Returns a WindowedValue with the given value in the GlobalWindow using the default timestamp and the specified pane.
valueOf(String) - Static method in enum com.google.cloud.dataflow.sdk.annotations.Experimental.Kind: Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.CreateDisposition: Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.WriteDisposition: Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.google.cloud.dataflow.sdk.io.CompressedSource.CompressionMode: Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.google.cloud.dataflow.sdk.io.FileBasedSink.FileBasedWriteOperation.TemporaryFileRetention: Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.google.cloud.dataflow.sdk.io.FileBasedSource.Mode: Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.google.cloud.dataflow.sdk.io.TextIO.CompressionType: Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions.AutoscalingAlgorithmType: Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions.TeardownPolicy: Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.google.cloud.dataflow.sdk.options.DataflowWorkerLoggingOptions.Level: Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.google.cloud.dataflow.sdk.options.PipelineOptions.CheckEnabled: Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.google.cloud.dataflow.sdk.PipelineResult.State: Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.google.cloud.dataflow.sdk.transforms.windowing.PaneInfo.Timing: Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.google.cloud.dataflow.sdk.transforms.windowing.Trigger.MergeResult: Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.google.cloud.dataflow.sdk.transforms.windowing.Trigger.TriggerResult: Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.google.cloud.dataflow.sdk.transforms.windowing.Window.ClosingBehavior: Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.google.cloud.dataflow.sdk.util.common.Counter.AggregationKind: Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.google.cloud.dataflow.sdk.util.common.worker.Operation.InitializationState: Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.google.cloud.dataflow.sdk.util.StateFetcher.SideInputState: Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.google.cloud.dataflow.sdk.util.TimeDomain: Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.google.cloud.dataflow.sdk.util.WindowingStrategy.AccumulationMode: Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.google.cloud.dataflow.sdk.values.PCollection.IsBounded: Returns the enum constant of this type with the specified name.
values() - Static method in enum com.google.cloud.dataflow.sdk.annotations.Experimental.Kind: Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.CreateDisposition: Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.WriteDisposition: Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum com.google.cloud.dataflow.sdk.io.CompressedSource.CompressionMode: Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum com.google.cloud.dataflow.sdk.io.FileBasedSink.FileBasedWriteOperation.TemporaryFileRetention: Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum com.google.cloud.dataflow.sdk.io.FileBasedSource.Mode: Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum com.google.cloud.dataflow.sdk.io.TextIO.CompressionType: Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions.AutoscalingAlgorithmType: Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions.TeardownPolicy: Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum com.google.cloud.dataflow.sdk.options.DataflowWorkerLoggingOptions.Level: Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum com.google.cloud.dataflow.sdk.options.PipelineOptions.CheckEnabled: Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum com.google.cloud.dataflow.sdk.PipelineResult.State: Returns an array containing the constants of this enum type, in the order they are declared.
values - Variable in class com.google.cloud.dataflow.sdk.runners.RecordingPipelineVisitor
Values<V> - Class in com.google.cloud.dataflow.sdk.transforms: Values<V> takes a PCollection of KV<K, V>s and returns a PCollection<V> of the values.
values() - Static method in enum com.google.cloud.dataflow.sdk.transforms.windowing.PaneInfo.Timing: Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum com.google.cloud.dataflow.sdk.transforms.windowing.Trigger.MergeResult: Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum com.google.cloud.dataflow.sdk.transforms.windowing.Trigger.TriggerResult: Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum com.google.cloud.dataflow.sdk.transforms.windowing.Window.ClosingBehavior: Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum com.google.cloud.dataflow.sdk.util.common.Counter.AggregationKind: Returns an array containing the constants of this enum type, in the order they are declared.
values - Variable in class com.google.cloud.dataflow.sdk.util.common.worker.KeyGroupedShuffleEntries
values() - Static method in enum com.google.cloud.dataflow.sdk.util.common.worker.Operation.InitializationState: Returns an array containing the constants of this enum type, in the order they are declared.
values() - Method in class com.google.cloud.dataflow.sdk.util.state.StateTable
values() - Static method in enum com.google.cloud.dataflow.sdk.util.StateFetcher.SideInputState: Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum com.google.cloud.dataflow.sdk.util.TimeDomain: Returns an array containing the constants of this enum type, in the order they are declared.
Values - Class in com.google.cloud.dataflow.sdk.util: A collection of static methods for manipulating value representations transfered via the Dataflow API.
values() - Static method in enum com.google.cloud.dataflow.sdk.util.WindowingStrategy.AccumulationMode: Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum com.google.cloud.dataflow.sdk.values.PCollection.IsBounded: Returns an array containing the constants of this enum type, in the order they are declared.
valueSizer - Variable in class com.google.cloud.dataflow.sdk.util.common.worker.PartialGroupByKeyOperation.BufferingGroupingTable
ValueState<T> - Interface in com.google.cloud.dataflow.sdk.util.state: sTate holding a single value.
ValueWithRecordId<ValueT> - Class in com.google.cloud.dataflow.sdk.util: Immutable struct containing a value as well as a unique id identifying the value.
ValueWithRecordId(ValueT, byte[]) - Constructor for class com.google.cloud.dataflow.sdk.util.ValueWithRecordId
ValueWithRecordId.ValueWithRecordIdCoder<ValueT> - Class in com.google.cloud.dataflow.sdk.util: A Coder for ValueWithRecordId, using a wrapped value Coder.
ValueWithRecordIdCoder(Coder<ValueT>) - Constructor for class com.google.cloud.dataflow.sdk.util.ValueWithRecordId.ValueWithRecordIdCoder
VarInt - Class in com.google.cloud.dataflow.sdk.util: Variable-length encoding for integers.
VarInt() - Constructor for class com.google.cloud.dataflow.sdk.util.VarInt
VarIntCoder - Class in com.google.cloud.dataflow.sdk.coders: A VarIntCoder encodes Integers using between 1 and 5 bytes.
VarLongCoder - Class in com.google.cloud.dataflow.sdk.coders: A VarLongCoder encodes longs using between 1 and 10 bytes.
verifyDatasetPresence(BigQueryOptions, TableReference) - Static method in class com.google.cloud.dataflow.sdk.io.BigQueryIO
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.AvroCoder: Raises an exception describing reasons why the type may not be deterministically encoded using the given Schema, the directBinaryEncoder, and the ReflectDatumWriter or GenericDatumWriter.
verifyDeterministic() - Method in interface com.google.cloud.dataflow.sdk.coders.Coder: Throw Coder.NonDeterministicException if the coding is not deterministic.
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.CustomCoder
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.DelegateCoder: A delegate coder is deterministic if the underlying coder is deterministic.
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.DeterministicStandardCoder: As a DeterministicStandardCoder is presumed deterministic, this method does nothing.
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.DoubleCoder: Floating-point operations are not guaranteed to be deterministic, even if the storage format might be, so floating point representations are not recommended for use in operations that require deterministic inputs.
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.EntityCoder: A datastore kind can hold arbitrary Object instances, which makes the encoding non-deterministic.
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.IterableLikeCoder: Encoding is not deterministic for the general Iterable case, as it depends upon the type of iterable.
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.KvCoder
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.ListCoder: List sizes are always known, so ListIterable may be deterministic while the general IterableLikeCoder is not.
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.MapCoder: Not all maps have a deterministic encoding.
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.SerializableCoder
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.SetCoder: Not all sets have a deterministic encoding.
verifyDeterministic(String, Iterable<Coder<?>>) - Method in class com.google.cloud.dataflow.sdk.coders.StandardCoder
verifyDeterministic(String, Coder<?>...) - Method in class com.google.cloud.dataflow.sdk.coders.StandardCoder
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.StringUtf8Coder
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.TableRowJsonCoder: TableCell can hold arbitrary Object instances, which makes the encoding non-deterministic.
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.TextualIntegerCoder
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.VarLongCoder
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.ShardedKeyCoder
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult.CoGbkResultCoder
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.util.TimerOrElement.TimerOrElementCoder
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.util.ValueWithRecordId.ValueWithRecordIdCoder
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.util.WindowedValue.FullWindowedValueCoder
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.util.WindowedValue.ValueOnlyWindowedValueCoder
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.values.TimestampedValue.TimestampedValueCoder
verifyPath(String) - Method in class com.google.cloud.dataflow.sdk.util.DataflowPathValidator
verifyPath(String) - Method in class com.google.cloud.dataflow.sdk.util.NoopPathValidator
verifyPath(String) - Method in interface com.google.cloud.dataflow.sdk.util.PathValidator: Validate that a path is a valid path and that the path is accessible.
verifyTablePresence(BigQueryOptions, TableReference) - Static method in class com.google.cloud.dataflow.sdk.io.BigQueryIO
verifyUnmodified() - Method in interface com.google.cloud.dataflow.sdk.util.MutationDetector
View - Class in com.google.cloud.dataflow.sdk.transforms: Transforms for creating PCollectionViews from PCollections, for consuming the contents of those PCollections as side inputs to ParDo transforms.
View.AsIterable<T> - Class in com.google.cloud.dataflow.sdk.transforms: A PTransform that produces a PCollectionView of a singleton PCollection yielding the single element it contains.
View.AsList<T> - Class in com.google.cloud.dataflow.sdk.transforms: A PTransform that produces a PCollectionView of a singleton PCollection yielding the single element it contains.
View.AsMap<K,V> - Class in com.google.cloud.dataflow.sdk.transforms: A PTransform that produces a PCollectionView of a keyed PCollection yielding a map from each key to its unique associated value.
View.AsMultimap<K,V> - Class in com.google.cloud.dataflow.sdk.transforms: A PTransform that produces a PCollectionView of a keyed PCollection yielding a map of keys to all associated values.
View.AsSingleton<T> - Class in com.google.cloud.dataflow.sdk.transforms: A PTransform that produces a PCollectionView of a singleton PCollection yielding the single element it contains.
View.Concatenate<T> - Class in com.google.cloud.dataflow.sdk.transforms: Combiner that combines Ts into a single List<T> containing all inputs.
View.CreatePCollectionView<ElemT,ViewT> - Class in com.google.cloud.dataflow.sdk.transforms: Creates a primitive PCollectionView.
visit(Pipeline.PipelineVisitor, Set<PValue>) - Method in class com.google.cloud.dataflow.sdk.runners.TransformHierarchy: Visits all nodes in the transform hierarchy, in transitive order.
visit(Pipeline.PipelineVisitor, Set<PValue>) - Method in class com.google.cloud.dataflow.sdk.runners.TransformTreeNode: Visit the transform node.
visitTransform(TransformTreeNode) - Method in interface com.google.cloud.dataflow.sdk.Pipeline.PipelineVisitor: Called for each primitive transform after all of its topological predecessors and inputs have been visited.
visitTransform(TransformTreeNode) - Method in class com.google.cloud.dataflow.sdk.runners.RecordingPipelineVisitor
visitValue(PValue, TransformTreeNode) - Method in interface com.google.cloud.dataflow.sdk.Pipeline.PipelineVisitor: Called for each value after the transform that produced the value has been visited.
visitValue(PValue, TransformTreeNode) - Method in class com.google.cloud.dataflow.sdk.runners.RecordingPipelineVisitor
VoidCoder - Class in com.google.cloud.dataflow.sdk.coders: A VoidCoder encodes Voids.

W

waitToFinish(long, TimeUnit, MonitoringUtil.JobMessagesHandler) - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineJob: Waits for the job to finish and return the final status.
watermarkFuture(ByteString, String) - Method in class com.google.cloud.dataflow.sdk.util.state.WindmillStateReader
WatermarkHold<W extends BoundedWindow> - Class in com.google.cloud.dataflow.sdk.util: Implements the logic needed to hold the output watermark back to emit values with specific timestamps.
WatermarkHold(WindowingStrategy<?, W>) - Constructor for class com.google.cloud.dataflow.sdk.util.WatermarkHold
watermarkStateInternal(String) - Static method in class com.google.cloud.dataflow.sdk.util.state.StateTags: Create a state tag for holding the watermark.
WatermarkStateInternal - Interface in com.google.cloud.dataflow.sdk.util.state: State for holding up the watermark to the minimum of input Instants.
weeks(int, int) - Static method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows: Returns a WindowFn that windows elements into periods measured by weeks.
WindmillServerStub - Class in com.google.cloud.dataflow.sdk.runners.worker.windmill: Stub for communicating with a Windmill server.
WindmillServerStub() - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.windmill.WindmillServerStub
WindmillStateInternals - Class in com.google.cloud.dataflow.sdk.util.state: Implementation of StateInternals using Windmill to manage the underlying data.
WindmillStateInternals(String, boolean, WindmillStateReader) - Constructor for class com.google.cloud.dataflow.sdk.util.state.WindmillStateInternals
WindmillStateReader - Class in com.google.cloud.dataflow.sdk.util.state: Reads persistent state from Windmill.
WindmillStateReader(MetricTrackingWindmillServerStub, String, ByteString, long) - Constructor for class com.google.cloud.dataflow.sdk.util.state.WindmillStateReader
window() - Method in class com.google.cloud.dataflow.sdk.transforms.DoFn.ProcessContext: Returns the window into which the input element has been assigned.
window() - Method in interface com.google.cloud.dataflow.sdk.transforms.DoFnWithContext.ExtraContextFactory: Construct the BoundedWindow to use within a DoFnWithContext that needs it.
window() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Trigger.TriggerContext: The window that the current context is executing in.
Window - Class in com.google.cloud.dataflow.sdk.transforms.windowing: Window logically divides up or groups the elements of a PCollection into finite windows according to a WindowFn.
Window() - Constructor for class com.google.cloud.dataflow.sdk.transforms.windowing.Window
window() - Method in class com.google.cloud.dataflow.sdk.util.ReduceFn.Context: The window that is being processed.
window(Coder<W>, W) - Static method in class com.google.cloud.dataflow.sdk.util.state.StateNamespaces
Window.Bound<T> - Class in com.google.cloud.dataflow.sdk.transforms.windowing: A PTransform that windows the elements of a PCollection<T>, into finite windows according to a user-specified WindowFn<T, B>.
Window.ClosingBehavior - Enum in com.google.cloud.dataflow.sdk.transforms.windowing: Specifies the conditions under which a final pane will be created when a window is permanently closed.
Window.Remerge<T> - Class in com.google.cloud.dataflow.sdk.transforms.windowing: PTransform that does not change assigned windows, but will cause windows to be merged again as part of the next GroupByKey.
Window.Unbound - Class in com.google.cloud.dataflow.sdk.transforms.windowing: An incomplete Window transform, with unbound input/output type.
windowAndTrigger(Coder<W>, W, int) - Static method in class com.google.cloud.dataflow.sdk.util.state.StateNamespaces
windowCoder() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.DaysWindows
windowCoder() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.MonthsWindows
windowCoder() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.YearsWindows
windowCoder() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.FixedWindows
windowCoder() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.GlobalWindows
windowCoder() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.InvalidWindows
windowCoder() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Sessions
windowCoder() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.SlidingWindows
windowCoder() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.WindowFn: Returns the Coder used for serializing the windows used by this windowFn.
WindowedValue<V> - Class in com.google.cloud.dataflow.sdk.util: An immutable triple of value, timestamp, and windows.
WindowedValue.FullWindowedValueCoder<T> - Class in com.google.cloud.dataflow.sdk.util: Coder for WindowedValue.
WindowedValue.ValueOnlyWindowedValueCoder<T> - Class in com.google.cloud.dataflow.sdk.util: Coder for WindowedValue.
WindowedValue.WindowedValueCoder<T> - Class in com.google.cloud.dataflow.sdk.util: Abstract class for WindowedValue coder.
WindowFn<T,W extends BoundedWindow> - Class in com.google.cloud.dataflow.sdk.transforms.windowing: The argument to the Window transform used to assign elements into windows and to determine how windows are merged.
WindowFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.windowing.WindowFn
WindowFn.AssignContext - Class in com.google.cloud.dataflow.sdk.transforms.windowing: Information available when running WindowFn.assignWindows(com.google.cloud.dataflow.sdk.transforms.windowing.WindowFn<T, W>.AssignContext).
WindowFn.MergeContext - Class in com.google.cloud.dataflow.sdk.transforms.windowing: Information available when running WindowFn.mergeWindows(com.google.cloud.dataflow.sdk.transforms.windowing.WindowFn<T, W>.MergeContext).
WindowFnTestUtils - Class in com.google.cloud.dataflow.sdk.testing: A utility class for testing WindowFns.
WindowFnTestUtils() - Constructor for class com.google.cloud.dataflow.sdk.testing.WindowFnTestUtils
WindowingCoderGroupingKeyCreator(Coder<K>) - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.MapTaskExecutorFactory.WindowingCoderGroupingKeyCreator
windowingInternals() - Method in class com.google.cloud.dataflow.sdk.transforms.DoFn.ProcessContext: Returns the process context to use for implementing windowing.
windowingInternals() - Method in interface com.google.cloud.dataflow.sdk.transforms.DoFnWithContext.ExtraContextFactory: Construct the WindowingInternals to use within a DoFnWithContext that needs it.
WindowingInternals<InputT,OutputT> - Interface in com.google.cloud.dataflow.sdk.util: Interface that may be required by some (internal) DoFns to implement windowing.
windowingStrategy() - Method in class com.google.cloud.dataflow.sdk.util.ReduceFn.Context: Access the current WindowingStrategy.
WindowingStrategy<T,W extends BoundedWindow> - Class in com.google.cloud.dataflow.sdk.util: A WindowingStrategy describes the windowing behavior for a specific collection of values.
WindowingStrategy.AccumulationMode - Enum in com.google.cloud.dataflow.sdk.util: The accumulation modes that can be used with windowing.
windows() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.WindowFn.AssignContext: Returns the windows the current element was in, prior to this WindowFn being called.
windows() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.WindowFn.MergeContext: Returns the current set of windows.
windows() - Method in interface com.google.cloud.dataflow.sdk.util.WindowingInternals: Access the windows the element is being processed in without "exploding" it.
withAccumulatorCoder(Combine.KeyedCombineFn<? super K, ? super InputT, AccumT, OutputT>, Coder<AccumT>) - Static method in class com.google.cloud.dataflow.sdk.util.AppliedCombineFn
withAllowedLateness(Duration) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window.Bound: Override the amount of lateness allowed for data elements in the pipeline.
withAllowedLateness(Duration, Window.ClosingBehavior) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window.Bound: Override the amount of lateness allowed for data elements in the pipeline.
withAllowedLateness(Duration) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window.Unbound: Override the amount of lateness allowed for data elements in the pipeline.
withAllowedLateness(Duration, Window.ClosingBehavior) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window.Unbound: Override the amount of lateness allowed for data elements in the pipeline.
withAllowedLateness(Duration) - Static method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window: Override the amount of lateness allowed for data elements in the pipeline.
withAllowedLateness(Duration) - Method in class com.google.cloud.dataflow.sdk.util.WindowingStrategy: Returns a WindowingStrategy identical to this but with the allowed lateness set to allowedLateness.
withArg(Class<? super ArgT>, ArgT) - Method in class com.google.cloud.dataflow.sdk.util.InstanceBuilder: Adds an argument to be passed to the factory method.
withClosingBehavior(Window.ClosingBehavior) - Method in class com.google.cloud.dataflow.sdk.util.WindowingStrategy
withCoder(Coder<X>) - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read.Bound: Returns a new PubsubIO.Read PTransform that's like this one but that uses the given Coder<X> to decode each record into a value of type X.
withCoder(Coder<T>) - Static method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read: Creates and returns a PubsubIO.Read PTransform that uses the given Coder<T> to decode PubSub record into a value of type T.
withCoder(Coder<X>) - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Write.Bound: Returns a new PubsubIO.Write PTransform that's like this one but that uses the given Coder<X> to encode each of the elements of the input PCollection<X> into an output record.
withCoder(Coder<T>) - Static method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Write: Returns a TextIO.Write PTransform that uses the given Coder<T> to encode each of the elements of the input PCollection<T> into an output PubSub record.
withCoder(Coder<X>) - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Read.Bound: Returns a new TextIO.Read PTransform that's like this one but that uses the given Coder<X> to decode each of the lines of the file into a value of type X.
withCoder(Coder<T>) - Static method in class com.google.cloud.dataflow.sdk.io.TextIO.Read: Returns a TextIO.Read PTransform that uses the given Coder<T> to decode each of the lines of the file into a value of type T.
withCoder(Coder<X>) - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Write.Bound: Returns a new TextIO.Write PTransform that's like this one but that uses the given Coder<X> to encode each of the elements of the input PCollection<X> into an output text line.
withCoder(Coder<T>) - Static method in class com.google.cloud.dataflow.sdk.io.TextIO.Write: Returns a TextIO.Write PTransform that uses the given Coder<T> to encode each of the elements of the input PCollection<T> into an output text line.
withCoder(Coder<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.Create.TimestampedValues: Returns a Create.TimestampedValues PTransform like this one that uses the given Coder<T> to decode each of the objects into a value of type T.
withCoder(Coder<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.Create.Values: Returns a Create.Values PTransform like this one that uses the given Coder<T> to decode each of the objects into a value of type T.
withCompressionType(TextIO.CompressionType) - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Read.Bound: Returns a new TextIO.Read PTransform that's like this one but reads from input sources using the specified compression type.
withCompressionType(TextIO.CompressionType) - Static method in class com.google.cloud.dataflow.sdk.io.TextIO.Read: Returns a TextIO.Read PTransform that reads from a file with the specified compression type.
withCreateDisposition(BigQueryIO.Write.CreateDisposition) - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.Bound: Specifies options for creating the table.
withCreateDisposition(BigQueryIO.Write.CreateDisposition) - Static method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write: Specifies options for creating the table.
withDataset(String) - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.Sink: Returns a Sink that is like this one, but will write to the specified dataset.
withDataset(String) - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.Source
withDecompression(CompressedSource.DecompressingChannelFactory) - Method in class com.google.cloud.dataflow.sdk.io.CompressedSource: Return a CompressedSource that is like this one but will decompress its underlying file with the given CompressedSource.DecompressingChannelFactory.
withDefaultValue(T) - Method in class com.google.cloud.dataflow.sdk.transforms.View.AsSingleton: Default value to return for windows with no value in them.
withEncodabilityTesting(boolean) - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner: Enable runtime testing to verify that all values can be encoded.
withEpsilon(double) - Method in class com.google.cloud.dataflow.sdk.transforms.ApproximateQuantiles.ApproximateQuantilesCombineFn: Returns an ApproximateQuantilesCombineFn that's like this one except that it uses the specified epsilon value.
withExtensionsFrom(Iterable<Class<?>>) - Method in class com.google.cloud.dataflow.sdk.coders.Proto2Coder: Produces a Proto2Coder like this one, but with the extensions from the given classes registered.
withExtensionsFrom(Class<?>...) - Method in class com.google.cloud.dataflow.sdk.coders.Proto2Coder: See Proto2Coder.withExtensionsFrom(Iterable).
withFanout(int) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.Globally: Returns a PTransform identical to this, but that uses an intermediate node to combine parts of the data to reduce load on the final global combine step.
withGapDuration(Duration) - Static method in class com.google.cloud.dataflow.sdk.transforms.windowing.Sessions: Creates a Sessions WindowFn with the specified gap duration.
withHost(String) - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.Sink: Returns a Sink that is like this one, but will use the given host.
withHost(String) - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.Source
withHotKeyFanout(SerializableFunction<? super K, Integer>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.PerKey: If a single key has disproportionately many values, it may become a bottleneck, especially in streaming mode.
withHotKeyFanout(int) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.PerKey: Like Combine.PerKey.withHotKeyFanout(SerializableFunction), but returning the given constant value for every key.
withInputCoder(Combine.KeyedCombineFn<? super K, ? super InputT, AccumT, OutputT>, CoderRegistry, KvCoder<K, InputT>) - Static method in class com.google.cloud.dataflow.sdk.util.AppliedCombineFn
withKey(Object) - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.ValueWithMetadata: Returns a new ValueWithMetadata with the implicit key associated with this value set.
WithKeys<K,V> - Class in com.google.cloud.dataflow.sdk.transforms: WithKeys<K, V> takes a PCollection<V>, and either a constant key of type K or a function from V to K, and returns a PCollection<KV<K, V>>, where each of the values in the input PCollection has been paired with either the constant key or a key computed from the value.
withMaxInputSize(long) - Method in class com.google.cloud.dataflow.sdk.transforms.ApproximateQuantiles.ApproximateQuantilesCombineFn: Returns an ApproximateQuantilesCombineFn that's like this one except that it uses the specified maxNumElements value.
withMaxNumRecords(long) - Method in class com.google.cloud.dataflow.sdk.io.Read.Unbounded: Returns a new BoundedReadFromUnboundedSource that reads a bounded amount of data from the given UnboundedSource.
withMaxParallelism(int) - Method in class com.google.cloud.dataflow.sdk.transforms.IntraBundleParallelization.Bound: Returns a new IntraBundleParallelization PTransform like this one with the specified maximum concurrency level.
withMaxParallelism(int) - Method in class com.google.cloud.dataflow.sdk.transforms.IntraBundleParallelization.Unbound: Returns a new IntraBundleParallelization PTransform like this one with the specified maximum concurrency level.
withMaxParallelism(int) - Static method in class com.google.cloud.dataflow.sdk.transforms.IntraBundleParallelization: Creates a IntraBundleParallelization PTransform with the specified maximum concurrency level.
withMaxReadTime(Duration) - Method in class com.google.cloud.dataflow.sdk.io.Read.Unbounded: Returns a new BoundedReadFromUnboundedSource that reads a bounded amount of data from the given UnboundedSource.
withMinBundleSize(long) - Method in class com.google.cloud.dataflow.sdk.io.AvroSource: Returns an AvroSource that's like this one but uses the supplied minimum bundle size.
withMinBundleSize(long) - Method in class com.google.cloud.dataflow.sdk.io.XmlSource: Sets a parameter minBundleSize for the minimum bundle size of the source.
withMockEstimateSizeBytes(Long) - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.Source: For testing only.
withMode(WindowingStrategy.AccumulationMode) - Method in class com.google.cloud.dataflow.sdk.util.WindowingStrategy: Returns a WindowingStrategy identical to this but with the accumulation mode set to mode.
withNumShards(int) - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound: Returns a new AvroIO.Write PTransform that's like this one but that uses the provided shard count.
withNumShards(int) - Static method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write: Returns an AvroIO.Write PTransform that uses the provided shard count.
withNumShards(int) - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Write.Bound: Returns a new TextIO.Write PTransform that's like this one but that uses the provided shard count.
withNumShards(int) - Static method in class com.google.cloud.dataflow.sdk.io.TextIO.Write: Returns a TextIO.Write PTransform that uses the provided shard count.
withOffset(Duration) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.FixedWindows: Partitions the timestamp space into half-open intervals of the form [N * size + offset, (N + 1) * size + offset), where 0 is the epoch.
withOffset(Duration) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.SlidingWindows: Assigns timestamps into half-open intervals of the form [N * period + offset, N * period + offset + size).
withoutDefaults() - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.Globally: Returns a PTransform identical to this, but that does not attempt to provide a default value in the case of empty input.
withOutputTags(TupleTag<OutputT>, TupleTagList) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.Bound: Returns a new multi-output ParDo PTransform that's like this PTransform but with the specified main and side output tags.
withOutputTags(TupleTag<OutputT>, TupleTagList) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.Unbound: Returns a new multi-output ParDo transform that's like this transform but with the specified main and side output tags.
withOutputTags(TupleTag<OutputT>, TupleTagList) - Static method in class com.google.cloud.dataflow.sdk.transforms.ParDo: Creates a multi-output ParDo PTransform whose output PCollections will be referenced using the given main output and side output tags.
withoutSharding() - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound: Returns a new AvroIO.Write PTransform that's like this one but that forces a single file as output.
withoutSharding() - Static method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write: Returns an AvroIO.Write PTransform that forces a single file as output.
withoutSharding() - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Write.Bound: Returns a new TextIO.Write PTransform that's like this one but that forces a single file as output.
withoutSharding() - Static method in class com.google.cloud.dataflow.sdk.io.TextIO.Write: Returns a TextIO.Write PTransform that forces a single file as output.
withoutSideInputs() - Static method in class com.google.cloud.dataflow.sdk.runners.worker.DataflowExecutionContext: Returns a DataflowExecutionContext that does not support side inputs at all, for situations when side inputs are not relevant, such as testing.
withoutStrictParsing() - Method in class com.google.cloud.dataflow.sdk.options.PipelineOptionsFactory.Builder: During parsing of the arguments, we will skip over improperly formatted and unknown arguments.
withoutValidation() - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Read.Bound: Returns a new TextIO.Read PTransform that's like this one but that has GCS input path validation on pipeline creation disabled.
withoutValidation() - Static method in class com.google.cloud.dataflow.sdk.io.AvroIO.Read: Returns a AvroIO.Read PTransform that has GCS path validation on pipeline creation disabled.
withoutValidation() - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound: Returns a new TextIO.Write PTransform that's like this one but that has GCS output path validation on pipeline creation disabled.
withoutValidation() - Static method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write: Returns a AvroIO.Write PTransform that has GCS path validation on pipeline creation disabled.
withoutValidation() - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Read.Bound: Disable table validation.
withoutValidation() - Static method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Read: Disables BigQuery table validation, which is enabled by default.
withoutValidation() - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.Bound: Disable table validation.
withoutValidation() - Static method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write: Disables BigQuery table validation, which is enabled by default.
withoutValidation() - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Read.Bound: Returns a new TextIO.Read PTransform that's like this one but that has GCS path validation on pipeline creation disabled.
withoutValidation() - Static method in class com.google.cloud.dataflow.sdk.io.TextIO.Read: Returns a TextIO.Read PTransform that has GCS path validation on pipeline creation disabled.
withoutValidation() - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Write.Bound: Returns a new TextIO.Write PTransform that's like this one but that has GCS output path validation on pipeline creation disabled.
withoutValidation() - Static method in class com.google.cloud.dataflow.sdk.io.TextIO.Write: Returns a TextIO.Write PTransform that has GCS path validation on pipeline creation disabled.
withQuery(DatastoreV1.Query) - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.Source
withRecordClass(Class<T>) - Method in class com.google.cloud.dataflow.sdk.io.XmlSource: Sets a JAXB annotated class that can be populated using a record of the provided XML file.
withRecordElement(String) - Method in class com.google.cloud.dataflow.sdk.io.XmlSource: Sets name of the record element of the XML document.
withRepresentativeValueFn(SerializableFunction<T, IdT>) - Static method in class com.google.cloud.dataflow.sdk.transforms.RemoveDuplicates: Returns a RemoveDuplicates<T, IdT> PTransform.
withRootElement(String) - Method in class com.google.cloud.dataflow.sdk.io.XmlSink.Bound: Returns an XmlSink that writes XML files with an enclosing root element of the supplied name.
withRootElement(String) - Method in class com.google.cloud.dataflow.sdk.io.XmlSource: Sets name of the root element of the XML document.
withSchema(Class<X>) - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Read.Bound: Returns a new AvroIO.Read PTransform that's like this one but that reads Avro file(s) containing records whose type is the specified Avro-generated class.
withSchema(Schema) - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Read.Bound: Returns a new AvroIO.Read PTransform that's like this one but that reads Avro file(s) containing records of the specified schema.
withSchema(String) - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Read.Bound: Returns a new AvroIO.Read PTransform that's like this one but that reads Avro file(s) containing records of the specified schema in a JSON-encoded string form.
withSchema(Class<T>) - Static method in class com.google.cloud.dataflow.sdk.io.AvroIO.Read: Returns an AvroIO.Read PTransform that reads Avro file(s) containing records whose type is the specified Avro-generated class.
withSchema(Schema) - Static method in class com.google.cloud.dataflow.sdk.io.AvroIO.Read: Returns an AvroIO.Read PTransform that reads Avro file(s) containing records of the specified schema.
withSchema(String) - Static method in class com.google.cloud.dataflow.sdk.io.AvroIO.Read: Returns an AvroIO.Read PTransform that reads Avro file(s) containing records of the specified schema in a JSON-encoded string form.
withSchema(Class<X>) - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound: Returns a new AvroIO.Write PTransform that's like this one but that writes to Avro file(s) containing records whose type is the specified Avro-generated class.
withSchema(Schema) - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound: Returns a new AvroIO.Write PTransform that's like this one but that writes to Avro file(s) containing records of the specified schema.
withSchema(String) - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound: Returns a new AvroIO.Write PTransform that's like this one but that writes to Avro file(s) containing records of the specified schema in a JSON-encoded string form.
withSchema(Class<T>) - Static method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write: Returns an AvroIO.Write PTransform that writes Avro file(s) containing records whose type is the specified Avro-generated class.
withSchema(Schema) - Static method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write: Returns an AvroIO.Write PTransform that writes Avro file(s) containing records of the specified schema.
withSchema(String) - Static method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write: Returns an AvroIO.Write PTransform that writes Avro file(s) containing records of the specified schema in a JSON-encoded string form.
withSchema(String) - Method in class com.google.cloud.dataflow.sdk.io.AvroSource: Returns an AvroSource that's like this one but reads files containing records that conform to the given schema.
withSchema(Schema) - Method in class com.google.cloud.dataflow.sdk.io.AvroSource: Returns an AvroSource that's like this one but reads files containing records that conform to the given schema.
withSchema(Class<X>) - Method in class com.google.cloud.dataflow.sdk.io.AvroSource: Returns an AvroSource that's like this one but reads files containing records of the type of the given class.
withSchema(TableSchema) - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.Bound: Specifies the table schema, used if the table is created.
withSchema(TableSchema) - Static method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write: Specifies a table schema to use in table creation.
withSerializabilityTesting(boolean) - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner: Enable runtime testing to verify that all functions and Coder instances can be serialized.
withShardNameTemplate(String) - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound: Returns a new AvroIO.Write PTransform that's like this one but that uses the given shard name template.
withShardNameTemplate(String) - Static method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write: Returns an AvroIO.Write PTransform that uses the given shard name template.
withShardNameTemplate(String) - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Write.Bound: Returns a new TextIO.Write PTransform that's like this one but that uses the given shard name template.
withShardNameTemplate(String) - Static method in class com.google.cloud.dataflow.sdk.io.TextIO.Write: Returns a TextIO.Write PTransform that uses the given shard name template.
withSideInputs(PCollectionView<?>...) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.Bound: Returns a new ParDo PTransform that's like this PTransform but with the specified side inputs.
withSideInputs(Iterable<? extends PCollectionView<?>>) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.Bound: Returns a new ParDo PTransform that's like this PTransform but with the specified side inputs.
withSideInputs(PCollectionView<?>...) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.BoundMulti: Returns a new multi-output ParDo PTransform that's like this PTransform but with the specified side inputs.
withSideInputs(Iterable<? extends PCollectionView<?>>) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.BoundMulti: Returns a new multi-output ParDo PTransform that's like this PTransform but with the specified side inputs.
withSideInputs(PCollectionView<?>...) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.Unbound: Returns a new ParDo transform that's like this transform but with the specified side inputs.
withSideInputs(Iterable<? extends PCollectionView<?>>) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.Unbound: Returns a new ParDo transform that's like this transform but with the specified side inputs.
withSideInputs(PCollectionView<?>...) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.UnboundMulti: Returns a new multi-output ParDo transform that's like this transform but with the specified side inputs.
withSideInputs(Iterable<? extends PCollectionView<?>>) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.UnboundMulti: Returns a new multi-output ParDo transform that's like this transform but with the specified side inputs.
withSideInputs(PCollectionView<?>...) - Static method in class com.google.cloud.dataflow.sdk.transforms.ParDo: Creates a ParDo PTransform with the given side inputs.
withSideInputs(Iterable<? extends PCollectionView<?>>) - Static method in class com.google.cloud.dataflow.sdk.transforms.ParDo: Creates a ParDo with the given side inputs.
withSingletonValues() - Method in class com.google.cloud.dataflow.sdk.transforms.View.AsMap: Deprecated.
this method simply returns this AsMap unmodified
withStartingDay(int, int, int) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.DaysWindows
withStartingMonth(int, int) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.MonthsWindows
withStartingYear(int) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.YearsWindows
withSuffix(String) - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound: Returns a new AvroIO.Write PTransform that's like this one but that writes to the file(s) with the given filename suffix.
withSuffix(String) - Static method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write: Returns an AvroIO.Write PTransform that writes to the file(s) with the given filename suffix.
withSuffix(String) - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Write.Bound: Returns a new TextIO.Write PTransform that's like this one but that writes to the file(s) with the given filename suffix.
withSuffix(String) - Static method in class com.google.cloud.dataflow.sdk.io.TextIO.Write: Returns a TextIO.Write PTransform that writes to the file(s) with the given filename suffix.
withTimeZone(DateTimeZone) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.DaysWindows
withTimeZone(DateTimeZone) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.MonthsWindows
withTimeZone(DateTimeZone) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.YearsWindows
withTrigger(Trigger<?>) - Method in class com.google.cloud.dataflow.sdk.util.WindowingStrategy: Returns a WindowingStrategy identical to this but with the trigger set to wildcardTrigger.
withUnorderednessTesting(boolean) - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner: Enable runtime testing to verify that functions do not depend on order of the elements.
withValidation() - Method in class com.google.cloud.dataflow.sdk.options.PipelineOptionsFactory.Builder: After creation we will validate that PipelineOptions conforms to all the validation criteria from <T>.
withValidation() - Method in class com.google.cloud.dataflow.sdk.options.PipelineOptionsFactory: After creation we will validate that PipelineOptions conforms to all the validation criteria from <T>.
withValue(T) - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.ValueWithMetadata: Returns a new ValueWithMetadata that is a copy of this one, but with a different value.
withValue(V) - Method in class com.google.cloud.dataflow.sdk.util.WindowedValue: Returns a new WindowedValue that is a copy of this one, but with a different value.
withValueCoder(Coder<V>) - Method in class com.google.cloud.dataflow.sdk.util.WindowedValue.FullWindowedValueCoder
withValueCoder(Coder<V>) - Method in class com.google.cloud.dataflow.sdk.util.WindowedValue.ValueOnlyWindowedValueCoder
withValueCoder(Coder<V>) - Method in class com.google.cloud.dataflow.sdk.util.WindowedValue.WindowedValueCoder: Returns a new WindowedValueCoder that is a copy of this one, but with a different value coder.
withWindowFn(WindowFn<?, ?>) - Method in class com.google.cloud.dataflow.sdk.util.WindowingStrategy: Returns a WindowingStrategy identical to this but with the window function set to wildcardWindowFn.
withWriteDisposition(BigQueryIO.Write.WriteDisposition) - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.Bound: Specifies options for writing the table.
withWriteDisposition(BigQueryIO.Write.WriteDisposition) - Static method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write: Specifies options for writing to the table.
worker - Variable in class com.google.cloud.dataflow.sdk.util.common.worker.WorkProgressUpdater: Worker providing the work progress updates.
WorkerLogLevelOverrides() - Constructor for class com.google.cloud.dataflow.sdk.options.DataflowWorkerLoggingOptions.WorkerLogLevelOverrides
WorkExecutor - Class in com.google.cloud.dataflow.sdk.util.common.worker: Abstract executor for WorkItem tasks.
WorkExecutor(CounterSet) - Constructor for class com.google.cloud.dataflow.sdk.util.common.worker.WorkExecutor: Constructs a new WorkExecutor task.
WorkProgressUpdater - Class in com.google.cloud.dataflow.sdk.util.common.worker: WorkProgressUpdater allows a work executor to send work progress updates to the worker service.
WorkProgressUpdater(WorkExecutor) - Constructor for class com.google.cloud.dataflow.sdk.util.common.worker.WorkProgressUpdater
workString() - Method in class com.google.cloud.dataflow.sdk.runners.worker.DataflowWorkProgressUpdater
workString() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.WorkProgressUpdater: Returns a string representation of the work item whose progress is being updated, for use in logging messages.
WorkUnitClient() - Constructor for class com.google.cloud.dataflow.sdk.runners.worker.DataflowWorker.WorkUnitClient
Write() - Constructor for class com.google.cloud.dataflow.sdk.io.AvroIO.Write
Write() - Constructor for class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write
Write() - Constructor for class com.google.cloud.dataflow.sdk.io.PubsubIO.Write
write(T) - Method in class com.google.cloud.dataflow.sdk.io.Sink.Writer: Called for each value in the bundle.
Write() - Constructor for class com.google.cloud.dataflow.sdk.io.TextIO.Write
write() - Static method in class com.google.cloud.dataflow.sdk.io.XmlSink: Returns a builder for an XmlSink.
write(T) - Method in class com.google.cloud.dataflow.sdk.io.XmlSink.XmlWriter: Writes a value to the stream.
write(byte[]) - Method in class com.google.cloud.dataflow.sdk.runners.worker.ApplianceShuffleWriter
Write - Class in com.google.cloud.dataflow.sdk.transforms: A PTransform that writes to a Sink.
Write() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Write
write(byte[], int, int) - Method in class com.google.cloud.dataflow.sdk.util.ExposedByteArrayOutputStream
write(int) - Method in class com.google.cloud.dataflow.sdk.util.ExposedByteArrayOutputStream
write(ByteBuffer) - Method in class com.google.cloud.dataflow.sdk.util.ShardingWritableByteChannel: Writes a buffer to all shards.
Write.Bound<T> - Class in com.google.cloud.dataflow.sdk.transforms: A PTransform that writes to a Sink.
writeAndOwn(byte[]) - Method in class com.google.cloud.dataflow.sdk.util.ExposedByteArrayOutputStream: Write b to the stream and take the ownership of b.
writeBytes(byte[]) - Method in class com.google.cloud.dataflow.sdk.runners.worker.OrderedCode: Adds the given byte array item to the OrderedCode.
writeFooter() - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSink.FileBasedWriter: Writes footer at the end of output files.
writeFooter() - Method in class com.google.cloud.dataflow.sdk.io.XmlSink.XmlWriter: Writes the root element closing tag.
writeHeader() - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSink.FileBasedWriter: Writes header at the beginning of output files.
writeHeader() - Method in class com.google.cloud.dataflow.sdk.io.XmlSink.XmlWriter: Writes the root element opening tag.
writeInfinity() - Method in class com.google.cloud.dataflow.sdk.runners.worker.OrderedCode: Encodes and appends INFINITY item to its internal encoded byte array store.
writeNumIncreasing(long) - Method in class com.google.cloud.dataflow.sdk.runners.worker.OrderedCode: Encodes the long item, in big-endian format, and appends the result to its internal encoded byte array store.
writeOf(Class<T>, String, String) - Static method in class com.google.cloud.dataflow.sdk.io.XmlSink: Returns an XmlSink that writes objects as XML entities.
WriteOperation() - Constructor for class com.google.cloud.dataflow.sdk.io.Sink.WriteOperation
WriteOperation - Class in com.google.cloud.dataflow.sdk.util.common.worker: A write operation.
WriteOperation(String, Sink<?>, OutputReceiver[], String, CounterSet.AddCounterMutator, StateSampler) - Constructor for class com.google.cloud.dataflow.sdk.util.common.worker.WriteOperation
WriteOperation(Sink<?>, String, CounterSet.AddCounterMutator, StateSampler) - Constructor for class com.google.cloud.dataflow.sdk.util.common.worker.WriteOperation: Invoked by tests.
writePCollectionViewData(TupleTag<?>, Iterable<WindowedValue<T>>, Coder<Iterable<WindowedValue<T>>>, W, Coder<W>) - Method in class com.google.cloud.dataflow.sdk.util.BaseExecutionContext.StepContext
writePCollectionViewData(TupleTag<?>, Iterable<WindowedValue<T>>, Coder<Iterable<WindowedValue<T>>>, W, Coder<W>) - Method in interface com.google.cloud.dataflow.sdk.util.ExecutionContext.StepContext: Writes the given PCollectionView data to a globally accessible location.
writePCollectionViewData(TupleTag<?>, Iterable<WindowedValue<T>>, Coder<T>) - Method in interface com.google.cloud.dataflow.sdk.util.WindowingInternals: Write the given PCollectionView data to a location accessible by other workers.
Writer() - Constructor for class com.google.cloud.dataflow.sdk.io.Sink.Writer
writer() - Method in class com.google.cloud.dataflow.sdk.runners.worker.AvroByteSink
writer(DatumWriter<T>) - Method in class com.google.cloud.dataflow.sdk.runners.worker.AvroSink
writer() - Method in class com.google.cloud.dataflow.sdk.runners.worker.AvroSink
writer(ShuffleEntryWriter, String) - Method in class com.google.cloud.dataflow.sdk.runners.worker.ShuffleSink: Returns a SinkWriter that allows writing to this ShuffleSink, using the given ShuffleEntryWriter.
writer() - Method in class com.google.cloud.dataflow.sdk.runners.worker.ShuffleSink
writer() - Method in class com.google.cloud.dataflow.sdk.runners.worker.TextSink
writer() - Method in class com.google.cloud.dataflow.sdk.util.common.worker.Sink: Returns a Writer that allows writing to this Sink.
writeSignedNumIncreasing(long) - Method in class com.google.cloud.dataflow.sdk.runners.worker.OrderedCode: Encodes the long item, in big-endian format, and appends the result to its internal encoded byte array store.
writeTo(String) - Static method in class com.google.cloud.dataflow.sdk.io.DatastoreIO: Returns a new Write transform that will write to a Sink.
writeToShard(int, ByteBuffer) - Method in class com.google.cloud.dataflow.sdk.util.ShardingWritableByteChannel: Writes the buffer to the given shard.
writeTrailingBytes(byte[]) - Method in class com.google.cloud.dataflow.sdk.runners.worker.OrderedCode: Appends the byte array item to its internal encoded byte array store.
WriteTranslator() - Constructor for class com.google.cloud.dataflow.sdk.runners.dataflow.AvroIOTranslator.WriteTranslator
WriteTranslator() - Constructor for class com.google.cloud.dataflow.sdk.runners.dataflow.BigQueryIOTranslator.WriteTranslator
WriteTranslator() - Constructor for class com.google.cloud.dataflow.sdk.runners.dataflow.PubsubIOTranslator.WriteTranslator
WriteTranslator() - Constructor for class com.google.cloud.dataflow.sdk.runners.dataflow.TextIOTranslator.WriteTranslator

X

XML_EXTENSION - Static variable in class com.google.cloud.dataflow.sdk.io.XmlSink
XmlSink - Class in com.google.cloud.dataflow.sdk.io: A Sink that outputs records as XML-formatted elements.
XmlSink() - Constructor for class com.google.cloud.dataflow.sdk.io.XmlSink
XmlSink.Bound<T> - Class in com.google.cloud.dataflow.sdk.io: A FileBasedSink that writes objects as XML elements.
XmlSink.XmlWriteOperation<T> - Class in com.google.cloud.dataflow.sdk.io: Sink.WriteOperation for XML Sinks.
XmlSink.XmlWriter<T> - Class in com.google.cloud.dataflow.sdk.io: A Sink.Writer that can write objects as XML elements.
XmlSource<T> - Class in com.google.cloud.dataflow.sdk.io: A source that can be used to read XML files.
XmlWriteOperation(XmlSink.Bound<T>) - Constructor for class com.google.cloud.dataflow.sdk.io.XmlSink.XmlWriteOperation
XmlWriter(XmlSink.XmlWriteOperation<T>, Marshaller) - Constructor for class com.google.cloud.dataflow.sdk.io.XmlSink.XmlWriter

Y

years(int) - Static method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows: Returns a WindowFn that windows elements into periods measured by years.

A B C D E F G H I J K L M N O P R S T U V W X Y