Index (Google Cloud Dataflow SDK API)

A B C D E F G H I J K L M N O P R S T V W Y

A

add(Long) - Method in class com.google.cloud.dataflow.sdk.transforms.ApproximateUnique.ApproximateUniqueCombineFn.LargestUnique: Adds a value to the heap, returning whether the value is (large enough to be) in the heap.
addCollectionToSingletonOutput(String, PValue, PValue) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Adds an output with the given name to the previously added CollectionToSingleton Dataflow step, consuming the specified input PValue and producing the specified output PValue.
addComposite(TransformTreeNode) - Method in class com.google.cloud.dataflow.sdk.runners.TransformTreeNode: Adds a composite operation to the transform node.
addEncodingInput(Coder<?>) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Sets the encoding for the current Dataflow step.
addInput(String, Boolean) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Adds an input with the given name and value to the current Dataflow step.
addInput(String, String) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Adds an input with the given name and value to the current Dataflow step.
addInput(String, Long) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Adds an input with the given name and value to the current Dataflow step.
addInput(String, PInput) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Adds an input with the given name to the previously added Dataflow step, coming from the specified input PValue.
addInput(String, Map<String, Object>) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Adds an input which is a dictionary of strings to objects.
addInput(String, List<? extends Map<String, Object>>) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Adds an input which is a list of objects.
addInput(TransformTreeNode, PInput) - Method in class com.google.cloud.dataflow.sdk.runners.TransformHierarchy: Adds an input to the given node.
addInput(ApproximateUnique.ApproximateUniqueCombineFn.LargestUnique, T) - Method in class com.google.cloud.dataflow.sdk.transforms.ApproximateUnique.ApproximateUniqueCombineFn
addInput(VI) - Method in interface com.google.cloud.dataflow.sdk.transforms.Combine.AccumulatingCombineFn.Accumulator: Adds the given input value to this accumulator, modifying this accumulator.
addInput(VA, VI) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.AccumulatingCombineFn
addInput(double[], Double) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineDoubleFn
addInput(Combine.BinaryCombineFn.Holder<V>, V) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineFn
addInput(int[], Integer) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineIntegerFn
addInput(long[], Long) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineLongFn
addInput(VA, VI) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.CombineFn: Adds the given input value to the given accumulator, returning the new accumulator value.
addInput(K, VA, VI) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.KeyedCombineFn: Adds the given input value to the given accumulator, modifying the accumulator.
addInput(List<V>, V) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.SimpleCombineFn
addInput(Top.TopCombineFn<KV<Integer, T>>.Heap, T) - Method in class com.google.cloud.dataflow.sdk.transforms.Sample.FixedSizedSampleFn
addInputProducer(PValue, TransformTreeNode) - Method in class com.google.cloud.dataflow.sdk.runners.TransformTreeNode: Adds an input to the transform node.
addInputsRandomly(Combine.KeyedCombineFn<? super K, ? super VI, VA, ?>, K, Iterable<VI>, Random) - Static method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.TestCombineDoFn
addOutput(String, PValue) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Adds an output with the given name to the previously added Dataflow step, producing the specified output PValue, including its Coder if a TypedPValue.
addStep(PTransform<?, ?>, String) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Adds a step to the Dataflow workflow for the given transform, with the given Dataflow step type.
addStep(PTransform<?, ? extends PValue>, Step) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Adds a pre-defined step to the Dataflow workflow.
addValue(VI) - Method in interface com.google.cloud.dataflow.sdk.transforms.Aggregator: Adds a new value into the Aggregator.
addValueInternal(PValue) - Method in class com.google.cloud.dataflow.sdk.Pipeline: Adds the given PValue to this Pipeline.
addValueOnlyOutput(String, PValue) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Adds an output with the given name to the previously added Dataflow step, producing the specified output PValue, including its Coder if a TypedPValue.
advance() - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.DatastoreReader
advance() - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSource.FileBasedReader
advance() - Method in interface com.google.cloud.dataflow.sdk.io.Source.Reader: Advances the iterator to the next valid record.
Aggregator<VI> - Interface in com.google.cloud.dataflow.sdk.transforms: An Aggregator enables arbitrary monitoring in user code.
and(TupleTag<V>, List<V>) - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult: Returns a new CoGbkResult based on this, with the given tag and given data added to it.
and(TupleTag<V>, PCollection<KV<K, V>>) - Method in class com.google.cloud.dataflow.sdk.transforms.join.KeyedPCollectionTuple: Returns a new KeyedPCollections<K> that is the same as this, appended with the given PCollection.
and(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.values.PCollectionList: Returns a new PCollectionList that has all the PCollections of this PCollectionList plus the given PCollection appended to the end.
and(Iterable<PCollection<T>>) - Method in class com.google.cloud.dataflow.sdk.values.PCollectionList: Returns a new PCollectionList that has all the PCollections of this PCollectionList plus the given PCollections appended to the end, in order.
and(TupleTag<T>, PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.values.PCollectionTuple: Returns a new PCollectionTuple that has all the PCollections and tags of this PCollectionTuple plus the given PCollection and tag.
and(TupleTag<?>) - Method in class com.google.cloud.dataflow.sdk.values.TupleTagList: Returns a new TupleTagList that has all the TupleTags of this TupleTagList plus the given TupleTag appended to the end.
and(List<TupleTag<?>>) - Method in class com.google.cloud.dataflow.sdk.values.TupleTagList: Returns a new TupleTagList that has all the TupleTags of this TupleTagList plus the given TupleTags appended to the end, in order.
ApplicationNameOptions - Interface in com.google.cloud.dataflow.sdk.options: Options that allow setting the application name.
apply(Input) - Method in interface com.google.cloud.dataflow.sdk.coders.DelegateCoder.CodingFunction
apply(PInput) - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Read.Bound
apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound
apply(PInput) - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Read.Bound
apply(PCollection<TableRow>) - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.Bound
apply(PCollection<DatastoreV1.Entity>) - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.Sink
apply(PInput) - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read.Bound
apply(PCollection<String>) - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Write.Bound
apply(PInput) - Method in class com.google.cloud.dataflow.sdk.io.ReadSource.Bound
apply(PInput) - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Read.Bound
apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Write.Bound
apply(PTransform<? super PBegin, Output>) - Method in class com.google.cloud.dataflow.sdk.Pipeline: Starts using this pipeline with a root PTransform such as TextIO.Read or Create.
apply(PTransform<Input, Output>, Input) - Method in class com.google.cloud.dataflow.sdk.runners.BlockingDataflowPipelineRunner
apply(PTransform<Input, Output>, Input) - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineRunner
apply(PTransform<Input, Output>, Input) - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner
apply(PTransform<Input, Output>, Input) - Method in class com.google.cloud.dataflow.sdk.runners.PipelineRunner: Applies a transform to the given input, returning the output.
apply(Actual) - Method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert.AssertThat
apply(double, double) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineDoubleFn: Applies the binary operation to the two operands, returning the result.
apply(V, V) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineFn: Applies the binary operation to the two operands, returning the result.
apply(int, int) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineIntegerFn: Applies the binary operation to the two operands, returning the result.
apply(long, long) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineLongFn: Applies the binary operation to the two operands, returning the result.
apply(Iterable<? extends VI>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.CombineFn: Applies this CombineFn to a collection of input values to produce a combined output value.
apply(PCollection<VI>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.Globally
apply(PCollection<VI>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.GloballyAsSingletonView
apply(PCollection<? extends KV<K, ? extends Iterable<VI>>>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.GroupedValues
apply(K, Iterable<? extends VI>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.KeyedCombineFn: Applies this KeyedCombineFn to a key and a collection of input values to produce a combined output value.
apply(PCollection<KV<K, VI>>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.PerKey
apply(PCollection<KV<K, VI>>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.PerKeyWithHotKeys
apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.Count.Globally
apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.Count.PerElement
apply(PInput) - Method in class com.google.cloud.dataflow.sdk.transforms.Create
apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.First
apply(PCollection<Iterable<T>>) - Method in class com.google.cloud.dataflow.sdk.transforms.Flatten.FlattenIterables
apply(PCollectionList<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.Flatten.FlattenPCollectionList
apply(PCollection<KV<K, V>>) - Method in class com.google.cloud.dataflow.sdk.transforms.GroupByKey
apply(PCollection<KV<K, Iterable<WindowedValue<V>>>>) - Method in class com.google.cloud.dataflow.sdk.transforms.GroupByKey.GroupAlsoByWindow
apply(PCollection<KV<K, V>>) - Method in class com.google.cloud.dataflow.sdk.transforms.GroupByKey.GroupByKeyOnly
apply(PCollection<KV<K, V>>) - Method in class com.google.cloud.dataflow.sdk.transforms.GroupByKey.ReifyTimestampsAndWindows
apply(PCollection<KV<K, Iterable<WindowedValue<V>>>>) - Method in class com.google.cloud.dataflow.sdk.transforms.GroupByKey.SortValuesByTimestamp
apply(KeyedPCollectionTuple<K>) - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGroupByKey
apply(PTransform<KeyedPCollectionTuple<K>, O>) - Method in class com.google.cloud.dataflow.sdk.transforms.join.KeyedPCollectionTuple: Applies the given transform to this input.
apply(PCollection<? extends KV<K, ?>>) - Method in class com.google.cloud.dataflow.sdk.transforms.Keys
apply(PCollection<KV<A, B>>) - Method in class com.google.cloud.dataflow.sdk.transforms.KvSwap
apply(N, N) - Method in class com.google.cloud.dataflow.sdk.transforms.Max.MaxFn
apply(N, N) - Method in class com.google.cloud.dataflow.sdk.transforms.Min.MinFn
apply(PCollection<? extends I>) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.Bound
apply(PCollection<? extends I>) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.BoundMulti
apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.Partition
apply(Input) - Method in class com.google.cloud.dataflow.sdk.transforms.PTransform: Applies this PTransform on the given Input, and returns its Output.
apply(PCollection<? extends I>) - Method in class com.google.cloud.dataflow.sdk.transforms.RateLimiting.RateLimitingTransform
apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.RemoveDuplicates
apply(I) - Method in interface com.google.cloud.dataflow.sdk.transforms.SerializableFunction: Returns the result of invoking this function on the given input.
apply(double, double) - Method in class com.google.cloud.dataflow.sdk.transforms.Sum.SumDoubleFn
apply(int, int) - Method in class com.google.cloud.dataflow.sdk.transforms.Sum.SumIntegerFn
apply(long, long) - Method in class com.google.cloud.dataflow.sdk.transforms.Sum.SumLongFn
apply(PCollection<? extends KV<?, V>>) - Method in class com.google.cloud.dataflow.sdk.transforms.Values
apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.View.AsIterable
apply(PCollection<KV<K, V>>) - Method in class com.google.cloud.dataflow.sdk.transforms.View.AsMultimap
apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.View.AsSingleton
apply(PCollection<KV<K, VI>>) - Method in class com.google.cloud.dataflow.sdk.transforms.View.AsSingletonMap
apply(PCollection<R>) - Method in class com.google.cloud.dataflow.sdk.transforms.View.CreatePCollectionView
apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window.Bound
apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window.Remerge
apply(PCollection<V>) - Method in class com.google.cloud.dataflow.sdk.transforms.WithKeys
apply(PTransform<? super PBegin, Output>) - Method in class com.google.cloud.dataflow.sdk.values.PBegin: Applies the given PTransform to this input PBegin, and returns the PTransform's Output.
apply(PTransform<? super PCollection<T>, Output>) - Method in class com.google.cloud.dataflow.sdk.values.PCollection: Applies the given PTransform to this input PCollection, and returns the PTransform's Output.
apply(PTransform<PCollectionList<T>, Output>) - Method in class com.google.cloud.dataflow.sdk.values.PCollectionList: Applies the given PTransform to this input PCollectionList<T>, and returns the PTransform's Output.
apply(PTransform<PCollectionTuple, Output>) - Method in class com.google.cloud.dataflow.sdk.values.PCollectionTuple: Applies the given PTransform to this input PCollectionTuple, and returns the PTransform's Output.
applyHelper(PInput, boolean) - Method in class com.google.cloud.dataflow.sdk.transforms.Create
applyHelper(PCollection<KV<K, V>>, boolean, boolean) - Method in class com.google.cloud.dataflow.sdk.transforms.GroupByKey
applyTransform(Input, PTransform<? super Input, Output>) - Static method in class com.google.cloud.dataflow.sdk.Pipeline: Applies the given PTransform to the given Input, and returns its Output.
ApproximateQuantiles - Class in com.google.cloud.dataflow.sdk.transforms: PTransforms for getting an idea of a PCollection's data distribution using approximate N-tiles, either globally or per-key.
ApproximateQuantiles() - Constructor for class com.google.cloud.dataflow.sdk.transforms.ApproximateQuantiles
ApproximateQuantiles.ApproximateQuantilesCombineFn<T,C extends java.util.Comparator<T> & java.io.Serializable> - Class in com.google.cloud.dataflow.sdk.transforms: The ApproximateQuantilesCombineFn combiner gives an idea of the distribution of a collection of values using approximate N-tiles.
ApproximateUnique - Class in com.google.cloud.dataflow.sdk.transforms: PTransforms for estimating the number of distinct elements in a PCollection, or the number of distinct values associated with each key in a PCollection of KVs.
ApproximateUnique() - Constructor for class com.google.cloud.dataflow.sdk.transforms.ApproximateUnique
ApproximateUnique.ApproximateUniqueCombineFn<T> - Class in com.google.cloud.dataflow.sdk.transforms: CombineFn that computes an estimate of the number of distinct values that were combined.
ApproximateUnique.ApproximateUniqueCombineFn(long, Coder<T>) - Constructor for class com.google.cloud.dataflow.sdk.transforms.ApproximateUnique.ApproximateUniqueCombineFn
ApproximateUnique.ApproximateUniqueCombineFn.LargestUnique - Class in com.google.cloud.dataflow.sdk.transforms: A heap utility class to efficiently track the largest added elements.
ApproximateUnique.ApproximateUniqueCombineFn.LargestUnique(long) - Constructor for class com.google.cloud.dataflow.sdk.transforms.ApproximateUnique.ApproximateUniqueCombineFn.LargestUnique: Creates a heap to track the largest sampleSize elements.
as(Class<T>) - Method in interface com.google.cloud.dataflow.sdk.options.PipelineOptions: Transforms this object into an object of type <T>.
as(Class<T>) - Static method in class com.google.cloud.dataflow.sdk.options.PipelineOptionsFactory: Creates and returns an object which implements <T>.
as(Class<T>) - Method in class com.google.cloud.dataflow.sdk.options.PipelineOptionsFactory.Builder: Creates and returns an object which implements <T> using the values configured on this builder during construction.
asCloudObject() - Method in class com.google.cloud.dataflow.sdk.coders.AvroCoder
asCloudObject() - Method in interface com.google.cloud.dataflow.sdk.coders.Coder: Returns the CloudObject that represents this Coder.
asCloudObject() - Method in class com.google.cloud.dataflow.sdk.coders.CustomCoder
asCloudObject() - Method in class com.google.cloud.dataflow.sdk.coders.IterableCoder
asCloudObject() - Method in class com.google.cloud.dataflow.sdk.coders.KvCoder
asCloudObject() - Method in class com.google.cloud.dataflow.sdk.coders.SerializableCoder
asCloudObject() - Method in class com.google.cloud.dataflow.sdk.coders.StandardCoder
asCloudObject() - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult.CoGbkResultCoder
asCloudObject() - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResultSchema
asCloudObject() - Method in class com.google.cloud.dataflow.sdk.values.TupleTag
asIterable() - Static method in class com.google.cloud.dataflow.sdk.transforms.View: Returns a View.AsIterable that takes a PCollection as input and produces a PCollectionView of the values, to be consumed as an iterable side input.
asKeyedFn() - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.CombineFn: Converts this CombineFn into an equivalent Combine.KeyedCombineFn, which ignores the keys passed to it and combines the values according to this CombineFn.
asMap() - Static method in class com.google.cloud.dataflow.sdk.transforms.View: Returns an View.AsMultimap that takes a PCollection as input and produces a PCollectionView of the values to be consumed as a Map<K, Iterable<V>> side input.
asOutputReference(PValue) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Encode a PValue reference as an output reference.
assertFor(Expected) - Method in interface com.google.cloud.dataflow.sdk.testing.DataflowAssert.AssertRelation
assignWindow(Instant) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.DaysWindows
assignWindow(Instant) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.MonthsWindows
assignWindow(Instant) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.YearsWindows
assignWindow(Instant) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.FixedWindows
assignWindow(Instant) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.PartitioningWindowFn: Returns the single window to which elements with this timestamp belong.
assignWindows(WindowFn<Object, GlobalWindow>.AssignContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.GlobalWindows
assignWindows(WindowFn<Object, W>.AssignContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.InvalidWindows
assignWindows(WindowFn<T, W>.AssignContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.PartitioningWindowFn
assignWindows(WindowFn<Object, IntervalWindow>.AssignContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Sessions
assignWindows(WindowFn<Object, IntervalWindow>.AssignContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.SlidingWindows
assignWindows(WindowFn<T, W>.AssignContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.WindowFn: Given a timestamp and element, returns the set of windows into which it should be placed.
asSingleton() - Static method in class com.google.cloud.dataflow.sdk.transforms.View: Returns a View.AsSingleton transform that takes a singleton PCollection as input and produces a PCollectionView of the single value, to be consumed as a side input.
asSingletonView() - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.Globally: Returns a PTransform that produces a PCollectionView whose elements are the result of combining elements per-window in the input PCollection.
AtomicCoder<T> - Class in com.google.cloud.dataflow.sdk.coders: An AtomicCoder is one that has no component Coders or other state.
AtomicCoder() - Constructor for class com.google.cloud.dataflow.sdk.coders.AtomicCoder
AvroCoder<T> - Class in com.google.cloud.dataflow.sdk.coders: An encoder using Avro binary format.
AvroCoder(Class<T>, Schema) - Constructor for class com.google.cloud.dataflow.sdk.coders.AvroCoder
AvroCoder.AvroDeterminismChecker - Class in com.google.cloud.dataflow.sdk.coders: Helper class encapsulating the various pieces of state maintained by the recursive walk used for checking if the encoding will be deterministic.
AvroCoder.AvroDeterminismChecker() - Constructor for class com.google.cloud.dataflow.sdk.coders.AvroCoder.AvroDeterminismChecker
AvroIO - Class in com.google.cloud.dataflow.sdk.io: Transforms for reading and writing Avro files.
AvroIO() - Constructor for class com.google.cloud.dataflow.sdk.io.AvroIO
AvroIO.Read - Class in com.google.cloud.dataflow.sdk.io: A root PTransform that reads from an Avro file (or multiple Avro files matching a pattern) and returns a PCollection containing the decoding of each record.
AvroIO.Read() - Constructor for class com.google.cloud.dataflow.sdk.io.AvroIO.Read
AvroIO.Read.Bound<T> - Class in com.google.cloud.dataflow.sdk.io: A PTransform that reads from an Avro file (or multiple Avro files matching a pattern) and returns a bounded PCollection containing the decoding of each record.
AvroIO.Write - Class in com.google.cloud.dataflow.sdk.io: A root PTransform that writes a PCollection to an Avro file (or multiple Avro files matching a sharding pattern).
AvroIO.Write() - Constructor for class com.google.cloud.dataflow.sdk.io.AvroIO.Write
AvroIO.Write.Bound<T> - Class in com.google.cloud.dataflow.sdk.io: A PTransform that writes a bounded PCollection to an Avro file (or multiple Avro files matching a sharding pattern).

B

begin() - Method in class com.google.cloud.dataflow.sdk.Pipeline: Returns a PBegin owned by this Pipeline.
beginningOnDay(int) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.MonthsWindows
beginningOnDay(int, int) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.YearsWindows
BigEndianIntegerCoder - Class in com.google.cloud.dataflow.sdk.coders: A BigEndianIntegerCoder encodes Integers in 4 bytes, big-endian.
BigEndianLongCoder - Class in com.google.cloud.dataflow.sdk.coders: A BigEndianLongCoder encodes Longs in 8 bytes, big-endian.
BigQueryIO - Class in com.google.cloud.dataflow.sdk.io: Transformations for reading and writing BigQuery tables.
BigQueryIO() - Constructor for class com.google.cloud.dataflow.sdk.io.BigQueryIO
BigQueryIO.Read - Class in com.google.cloud.dataflow.sdk.io: A PTransform that reads from a BigQuery table and returns a PCollection<TableRow> containing each of the rows of the table.
BigQueryIO.Read() - Constructor for class com.google.cloud.dataflow.sdk.io.BigQueryIO.Read
BigQueryIO.Read.Bound - Class in com.google.cloud.dataflow.sdk.io: A PTransform that reads from a BigQuery table and returns a bounded PCollection<TableRow>.
BigQueryIO.Write - Class in com.google.cloud.dataflow.sdk.io: A PTransform that writes a PCollection<TableRow> containing rows to a BigQuery table.
BigQueryIO.Write() - Constructor for class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write
BigQueryIO.Write.Bound - Class in com.google.cloud.dataflow.sdk.io: A PTransform that can write either a bounded or unbounded PCollection<TableRow>s to a BigQuery table.
BigQueryIO.Write.Bound() - Constructor for class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.Bound
BigQueryIO.Write.CreateDisposition - Enum in com.google.cloud.dataflow.sdk.io: An enumeration type for the BigQuery create disposition strings publicly documented as CREATE_NEVER, and CREATE_IF_NEEDED.
BigQueryIO.Write.WriteDisposition - Enum in com.google.cloud.dataflow.sdk.io: An enumeration type for the BigQuery write disposition strings publicly documented as WRITE_TRUNCATE, WRITE_APPEND, and WRITE_EMPTY.
BigQueryOptions - Interface in com.google.cloud.dataflow.sdk.options: Properties needed when using BigQuery with the Dataflow SDK.
BlockingDataflowPipelineOptions - Interface in com.google.cloud.dataflow.sdk.options: Options which are used to configure the BlockingDataflowPipelineRunner.
BlockingDataflowPipelineOptions.StandardOutputFactory - Class in com.google.cloud.dataflow.sdk.options: Returns a default of System.out.
BlockingDataflowPipelineOptions.StandardOutputFactory() - Constructor for class com.google.cloud.dataflow.sdk.options.BlockingDataflowPipelineOptions.StandardOutputFactory
BlockingDataflowPipelineRunner - Class in com.google.cloud.dataflow.sdk.runners: A PipelineRunner that's like DataflowPipelineRunner but that waits for the launched job to finish.
BlockingDataflowPipelineRunner(DataflowPipelineRunner, MonitoringUtil.JobMessagesHandler) - Constructor for class com.google.cloud.dataflow.sdk.runners.BlockingDataflowPipelineRunner
BlockingDataflowPipelineRunner.PipelineJobState - Class in com.google.cloud.dataflow.sdk.runners: Holds the status of a run request.
BlockingDataflowPipelineRunner.PipelineJobState(MonitoringUtil.JobState) - Constructor for class com.google.cloud.dataflow.sdk.runners.BlockingDataflowPipelineRunner.PipelineJobState
BoundedWindow - Class in com.google.cloud.dataflow.sdk.transforms.windowing: A BoundedWindow represents a finite grouping of elements, with an upper bound (larger timestamps represent more recent data) on the timestamps of elements that can be placed in the window.
BoundedWindow() - Constructor for class com.google.cloud.dataflow.sdk.transforms.windowing.BoundedWindow
by(C) - Static method in class com.google.cloud.dataflow.sdk.transforms.Filter: Returns a PTransform that takes an input PCollection<T> and returns a PCollection<T> with elements that satisfy the given predicate.
ByteArrayCoder - Class in com.google.cloud.dataflow.sdk.coders: A ByteArrayCoder encodes byte[] objects.
ByteOffsetBasedSource<T> - Class in com.google.cloud.dataflow.sdk.io: A source that uses byte offsets to define starting and ending positions.
ByteOffsetBasedSource(long, long, long) - Constructor for class com.google.cloud.dataflow.sdk.io.ByteOffsetBasedSource
ByteOffsetBasedSource.ByteOffsetBasedReader<T> - Class in com.google.cloud.dataflow.sdk.io: A reader that implements code common to readers of all ByteOffsetBasedSources.
ByteOffsetBasedSource.ByteOffsetBasedReader(ByteOffsetBasedSource<T>) - Constructor for class com.google.cloud.dataflow.sdk.io.ByteOffsetBasedSource.ByteOffsetBasedReader

C

CalendarWindows - Class in com.google.cloud.dataflow.sdk.transforms.windowing: A collection of WindowFns that windows values into calendar-based windows such as spans of days, months, or years.
CalendarWindows() - Constructor for class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows
CalendarWindows.DaysWindows - Class in com.google.cloud.dataflow.sdk.transforms.windowing: A WindowFn that windows elements into periods measured by days.
CalendarWindows.MonthsWindows - Class in com.google.cloud.dataflow.sdk.transforms.windowing: A WindowFn that windows elements into periods measured by months.
CalendarWindows.YearsWindows - Class in com.google.cloud.dataflow.sdk.transforms.windowing: A WindowFn that windows elements into periods measured by years.
check(TypeToken<?>, Schema) - Method in class com.google.cloud.dataflow.sdk.coders.AvroCoder.AvroDeterminismChecker
clearOutputElements() - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnTester: Clears the record of the elements output so far to the main output.
clearSideOutputElements(TupleTag<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnTester: Clears the record of the elements output so far to the side output with the given tag.
close() - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.DatastoreReader
close() - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSource.FileBasedReader: Closes any ReadableByteChannel created for the current reader.
close() - Method in interface com.google.cloud.dataflow.sdk.io.Source.Reader: Closes the iterator.
CloudDebuggerOptions - Interface in com.google.cloud.dataflow.sdk.options: Options for controlling Cloud Debugger.
CloudDebuggerOptions.DebuggerConfig - Class in com.google.cloud.dataflow.sdk.options: Return a JSON string for the Debugger metadata item.
CloudDebuggerOptions.DebuggerConfig() - Constructor for class com.google.cloud.dataflow.sdk.options.CloudDebuggerOptions.DebuggerConfig
CodedTupleTag<T> - Class in com.google.cloud.dataflow.sdk.values: A TupleTag combined with the Coder to use for values associated with the tag.
CodedTupleTagMap - Class in com.google.cloud.dataflow.sdk.values: A mapping of CodedTupleTags to associated values.
Coder<T> - Interface in com.google.cloud.dataflow.sdk.coders: A Coder<T> defines how to encode and decode values of type T into byte streams.
Coder.Context - Class in com.google.cloud.dataflow.sdk.coders: The context in which encoding or decoding is being done.
Coder.Context(boolean) - Constructor for class com.google.cloud.dataflow.sdk.coders.Coder.Context
Coder.NonDeterministicException - Class in com.google.cloud.dataflow.sdk.coders: Exception thrown by Coder.verifyDeterministic() if the encoding is not deterministic.
Coder.NonDeterministicException(Coder<?>, String, Coder.NonDeterministicException) - Constructor for class com.google.cloud.dataflow.sdk.coders.Coder.NonDeterministicException
Coder.NonDeterministicException(Coder<?>, String) - Constructor for class com.google.cloud.dataflow.sdk.coders.Coder.NonDeterministicException
Coder.NonDeterministicException(Coder<?>, List<String>) - Constructor for class com.google.cloud.dataflow.sdk.coders.Coder.NonDeterministicException
Coder.NonDeterministicException(Coder<?>, List<String>, Coder.NonDeterministicException) - Constructor for class com.google.cloud.dataflow.sdk.coders.Coder.NonDeterministicException
CoderException - Exception in com.google.cloud.dataflow.sdk.coders: A CoderException is thrown if there is a problem encoding or decoding a value.
CoderException(String) - Constructor for exception com.google.cloud.dataflow.sdk.coders.CoderException
CoderException(String, Throwable) - Constructor for exception com.google.cloud.dataflow.sdk.coders.CoderException
CoderException(Throwable) - Constructor for exception com.google.cloud.dataflow.sdk.coders.CoderException
CoderRegistry - Class in com.google.cloud.dataflow.sdk.coders: A CoderRegistry allows registering the default Coder to use for a Java class, and looking up and instantiating the default Coder for a Java type.
CoderRegistry() - Constructor for class com.google.cloud.dataflow.sdk.coders.CoderRegistry
CoderRegistry.CoderFactory - Class in com.google.cloud.dataflow.sdk.coders: A factory for default Coders for values of a particular class.
CoderRegistry.CoderFactory() - Constructor for class com.google.cloud.dataflow.sdk.coders.CoderRegistry.CoderFactory
CoderRegistry.ConstantCoderFactory - Class in com.google.cloud.dataflow.sdk.coders: A factory that always returns the coder with which it is instantiated.
CoderRegistry.ConstantCoderFactory(Coder<?>) - Constructor for class com.google.cloud.dataflow.sdk.coders.CoderRegistry.ConstantCoderFactory
CoGbkResult - Class in com.google.cloud.dataflow.sdk.transforms.join: A row result of a CoGroupByKey.
CoGbkResult(CoGbkResultSchema, Iterable<RawUnionValue>) - Constructor for class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult: A row in the PCollection resulting from a CoGroupByKey transform.
CoGbkResult(CoGbkResultSchema, Iterable<RawUnionValue>, int) - Constructor for class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult
CoGbkResult.CoGbkResultCoder - Class in com.google.cloud.dataflow.sdk.transforms.join: A coder for CoGbkResults.
CoGbkResultSchema - Class in com.google.cloud.dataflow.sdk.transforms.join: A schema for the results of a CoGroupByKey.
CoGbkResultSchema(TupleTagList) - Constructor for class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResultSchema: Builds a schema from a tuple of TupleTag<?>s.
CoGroupByKey<K> - Class in com.google.cloud.dataflow.sdk.transforms.join: A transform that performs a CoGroupByKey on a tuple of tables.
CollectionCoder<T> - Class in com.google.cloud.dataflow.sdk.coders: A CollectionCoder encodes Collections.
CollectionCoder(Coder<T>) - Constructor for class com.google.cloud.dataflow.sdk.coders.CollectionCoder
com.google.cloud.dataflow.sdk - package com.google.cloud.dataflow.sdk: Provides a simple, powerful model for building both batch and streaming parallel data processing Pipelines.
com.google.cloud.dataflow.sdk.coders - package com.google.cloud.dataflow.sdk.coders: Defines Coders to specify how data is encoded to and decoded from byte strings.
com.google.cloud.dataflow.sdk.io - package com.google.cloud.dataflow.sdk.io: Defines transforms for reading and writing common storage formats, including AvroIO, BigQueryIO, and TextIO.
com.google.cloud.dataflow.sdk.options - package com.google.cloud.dataflow.sdk.options: Defines PipelineOptions for configuring pipeline execution.
com.google.cloud.dataflow.sdk.runners - package com.google.cloud.dataflow.sdk.runners: Defines runners for executing Pipelines in different modes, including DirectPipelineRunner and DataflowPipelineRunner.
com.google.cloud.dataflow.sdk.testing - package com.google.cloud.dataflow.sdk.testing: Defines utilities for unit testing Dataflow pipelines.
com.google.cloud.dataflow.sdk.transforms - package com.google.cloud.dataflow.sdk.transforms: Defines PTransforms for transforming data in a pipeline.
com.google.cloud.dataflow.sdk.transforms.join - package com.google.cloud.dataflow.sdk.transforms.join: Defines the CoGroupByKey transform for joining multiple PCollections.
com.google.cloud.dataflow.sdk.transforms.windowing - package com.google.cloud.dataflow.sdk.transforms.windowing: Defines the Window transform for dividing the elements in a PCollection into windows.
com.google.cloud.dataflow.sdk.values - package com.google.cloud.dataflow.sdk.values: Defines PCollection and other classes for representing data in a Pipeline.
Combine - Class in com.google.cloud.dataflow.sdk.transforms: PTransforms for combining PCollection elements globally and per-key.
Combine() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Combine
Combine.AccumulatingCombineFn<VI,VA extends Combine.AccumulatingCombineFn.Accumulator<VI,VA,VO>,VO> - Class in com.google.cloud.dataflow.sdk.transforms: A CombineFn that uses a subclass of Combine.AccumulatingCombineFn.Accumulator as its accumulator type.
Combine.AccumulatingCombineFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Combine.AccumulatingCombineFn
Combine.AccumulatingCombineFn.Accumulator<VI,VA,VO> - Interface in com.google.cloud.dataflow.sdk.transforms: The type of mutable accumulator values used by this AccumulatingCombineFn.
Combine.BinaryCombineDoubleFn - Class in com.google.cloud.dataflow.sdk.transforms: An abstract subclass of CombineFn for implementing combiners that are more easily expressed as binary operations on doubles.
Combine.BinaryCombineDoubleFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineDoubleFn
Combine.BinaryCombineFn<V> - Class in com.google.cloud.dataflow.sdk.transforms: An abstract subclass of CombineFn for implementing combiners that are more easily expressed as binary operations.
Combine.BinaryCombineFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineFn
Combine.BinaryCombineIntegerFn - Class in com.google.cloud.dataflow.sdk.transforms: An abstract subclass of CombineFn for implementing combiners that are more easily expressed as binary operations on ints.
Combine.BinaryCombineIntegerFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineIntegerFn
Combine.BinaryCombineLongFn - Class in com.google.cloud.dataflow.sdk.transforms: An abstract subclass of CombineFn for implementing combiners that are more easily expressed as binary operations on longs.
Combine.BinaryCombineLongFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineLongFn
Combine.CombineFn<VI,VA,VO> - Class in com.google.cloud.dataflow.sdk.transforms: A CombineFn<VI, VA, VO> specifies how to combine a collection of input values of type VI into a single output value of type VO.
Combine.CombineFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Combine.CombineFn
Combine.Globally<VI,VO> - Class in com.google.cloud.dataflow.sdk.transforms: Combine.Globally<VI, VO> takes a PCollection<VI> and returns a PCollection<VO> whose elements are the result of combining all the elements in each window of the input PCollection, using a specified CombineFn.
Combine.GloballyAsSingletonView<VI,VO> - Class in com.google.cloud.dataflow.sdk.transforms: Combine.GloballyAsSingletonView<VI, VO> takes a PCollection<VI> and returns a PCollectionView<VO> whose elements are the result of combining all the elements in each window of the input PCollection, using a specified CombineFn.
Combine.GroupedValues<K,VI,VO> - Class in com.google.cloud.dataflow.sdk.transforms: GroupedValues<K, VI, VO> takes a PCollection<KV<K, Iterable<VI>>>, such as the result of GroupByKey, applies a specified KeyedCombineFn<K, VI, VA, VO> to each of the input KV<K, Iterable<VI>> elements to produce a combined output KV<K, VO> element, and returns a PCollection<KV<K, VO>> containing all the combined output elements.
Combine.KeyedCombineFn<K,VI,VA,VO> - Class in com.google.cloud.dataflow.sdk.transforms: A KeyedCombineFn<K, VI, VA, VO> specifies how to combine a collection of input values of type VI, associated with a key of type K, into a single output value of type VO.
Combine.KeyedCombineFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Combine.KeyedCombineFn
Combine.PerKey<K,VI,VO> - Class in com.google.cloud.dataflow.sdk.transforms: PerKey<K, VI, VO> takes a PCollection<KV<K, VI>>, groups it by key, applies a combining function to the VI values associated with each key to produce a combined VO value, and returns a PCollection<KV<K, VO>> representing a map from each distinct key of the input PCollection to the corresponding combined value.
Combine.PerKeyWithHotKeys<K,VI,VO> - Class in com.google.cloud.dataflow.sdk.transforms: Like Combine.PerKey, but sharding the combining of hot keys.
Combine.SimpleCombineFn<V> - Class in com.google.cloud.dataflow.sdk.transforms: Converts a SerializableFunction from Iterable<V>s to Vs into a simple Combine.CombineFn over Vs.
compare(T, T) - Method in class com.google.cloud.dataflow.sdk.transforms.Top.Largest
compare(T, T) - Method in class com.google.cloud.dataflow.sdk.transforms.Top.Smallest
compare(KV<K, V>, KV<K, V>) - Method in class com.google.cloud.dataflow.sdk.values.KV.OrderByKey
compare(KV<K, V>, KV<K, V>) - Method in class com.google.cloud.dataflow.sdk.values.KV.OrderByValue
compareTo(IntervalWindow) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.IntervalWindow
computeMetadataString() - Method in class com.google.cloud.dataflow.sdk.options.CloudDebuggerOptions.DebuggerConfig: Compute the string of Debugger config.
contains(IntervalWindow) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.IntervalWindow: Returns whether this window contains the given window.
containsInAnyOrder(Iterable<T>) - Method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert.IterableAssert: Checks that the Iterable contains the expected elements, in any order.
containsInAnyOrder(T...) - Method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert.IterableAssert: Checks that the Iterable contains the expected elements, in any order.
Count - Class in com.google.cloud.dataflow.sdk.transforms: Count transforms can be used to count the number of elements in a PCollection.
Count() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Count
Count.Globally<T> - Class in com.google.cloud.dataflow.sdk.transforms: Count.Globally<T> takes a PCollection<T> and returns a PCollection<Long> containing a single element which is the total number of elements in the PCollection.
Count.Globally() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Count.Globally
Count.PerElement<T> - Class in com.google.cloud.dataflow.sdk.transforms: Count.PerElement<T> takes a PCollection<T> and returns a PCollection<KV<T, Long>> representing a map from each distinct element of the input PCollection to the number of times that element occurs in the input.
Count.PerElement() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Count.PerElement
create(List<? extends Coder<?>>) - Method in class com.google.cloud.dataflow.sdk.coders.CoderRegistry.CoderFactory: Returns the default Coder to use for values of a particular type, given the Coders for each of the type's generic parameter types.
create(List<? extends Coder<?>>) - Method in class com.google.cloud.dataflow.sdk.coders.CoderRegistry.ConstantCoderFactory
create(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.options.BlockingDataflowPipelineOptions.StandardOutputFactory
create(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions.DataflowClientFactory
create(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions.PathValidatorFactory
create(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions.StagerFactory
create(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.options.DataflowPipelineOptions.JobNameFactory
create(String) - Static method in class com.google.cloud.dataflow.sdk.options.DataflowWorkerLoggingOptions.WorkerLogLevelOverride: Expects a value of the form Name#Level.
create(PipelineOptions) - Method in interface com.google.cloud.dataflow.sdk.options.DefaultValueFactory: Creates a default value for a getter marked with Default.InstanceFactory.
create(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.options.GcpOptions.CredentialDirFactory
create(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.options.GcpOptions.GcpUserCredentialsFactory
create(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.options.GcsOptions.ExecutorServiceFactory
create(AbstractGoogleClient, String) - Static method in class com.google.cloud.dataflow.sdk.options.GoogleApiDebugOptions.GoogleApiTracer: Creates a GoogleApiDebugOptions.GoogleApiTracer which sets the trace token on all calls which match the given client type.
create(AbstractGoogleClientRequest<?>, String) - Static method in class com.google.cloud.dataflow.sdk.options.GoogleApiDebugOptions.GoogleApiTracer: Creates a GoogleApiDebugOptions.GoogleApiTracer which sets the trace token on all calls which match for the given request type.
create(String) - Static method in class com.google.cloud.dataflow.sdk.options.GoogleApiDebugOptions.GoogleApiTracer: Creates a GoogleClientRequestInitializer which adds the trace token based upon the passed in value.
create() - Method in class com.google.cloud.dataflow.sdk.options.PipelineOptionsFactory.Builder: Creates and returns an object which implements PipelineOptions using the values configured on this builder during construction.
create() - Static method in class com.google.cloud.dataflow.sdk.options.PipelineOptionsFactory: Creates and returns an object which implements PipelineOptions.
create(PipelineOptions) - Static method in class com.google.cloud.dataflow.sdk.Pipeline: Constructs a pipeline from the provided options.
create(DataflowPipelineOptions) - Static method in class com.google.cloud.dataflow.sdk.runners.DataflowPipeline: Creates and returns a new DataflowPipeline instance for tests.
create(Combine.GroupedValues<K, VI, VO>, boolean) - Static method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.TestCombineDoFn
create() - Static method in class com.google.cloud.dataflow.sdk.testing.TestPipeline: Creates and returns a new test pipeline.
create(int, C) - Static method in class com.google.cloud.dataflow.sdk.transforms.ApproximateQuantiles.ApproximateQuantilesCombineFn: Returns an approximate quantiles combiner with the given compareFn and desired number of quantiles.
create(int) - Static method in class com.google.cloud.dataflow.sdk.transforms.ApproximateQuantiles.ApproximateQuantilesCombineFn: Like ApproximateQuantiles.ApproximateQuantilesCombineFn.create(int, Comparator), but sorts values using their natural ordering.
create(int, C, long, double) - Static method in class com.google.cloud.dataflow.sdk.transforms.ApproximateQuantiles.ApproximateQuantilesCombineFn: Creates an approximate quantiles combiner with the given compareFn and desired number of quantiles.
Create<T> - Class in com.google.cloud.dataflow.sdk.transforms: Create<T> takes a collection of elements of type T known when the pipeline is constructed and returns a PCollection<T> containing the elements.
create() - Static method in class com.google.cloud.dataflow.sdk.transforms.Flatten: Deprecated.
create() - Static method in class com.google.cloud.dataflow.sdk.transforms.GroupByKey: Returns a GroupByKey<K, V> PTransform.
create() - Static method in class com.google.cloud.dataflow.sdk.transforms.join.CoGroupByKey: Returns a CoGroupByKey<K> PTransform.
create() - Static method in class com.google.cloud.dataflow.sdk.transforms.Keys: Returns a Keys<K> PTransform.
create() - Static method in class com.google.cloud.dataflow.sdk.transforms.KvSwap: Returns a KvSwap<A, B> PTransform.
create() - Static method in class com.google.cloud.dataflow.sdk.transforms.RemoveDuplicates: Returns a RemoveDuplicates<T> PTransform.
create() - Static method in class com.google.cloud.dataflow.sdk.transforms.Values: Returns a Values<V> PTransform.
createAccumulator() - Method in class com.google.cloud.dataflow.sdk.transforms.ApproximateQuantiles.ApproximateQuantilesCombineFn
createAccumulator() - Method in class com.google.cloud.dataflow.sdk.transforms.ApproximateUnique.ApproximateUniqueCombineFn
createAccumulator() - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineDoubleFn
createAccumulator() - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineFn
createAccumulator() - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineIntegerFn
createAccumulator() - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineLongFn
createAccumulator() - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.CombineFn: Returns a new, mutable accumulator value, representing the accumulation of zero input values.
createAccumulator(K) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.KeyedCombineFn: Returns a new, mutable accumulator value representing the accumulation of zero input values.
createAccumulator() - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.SimpleCombineFn
createAccumulator() - Method in class com.google.cloud.dataflow.sdk.transforms.Mean.MeanFn
createAccumulator() - Method in class com.google.cloud.dataflow.sdk.transforms.Sample.FixedSizedSampleFn
createAccumulator() - Method in class com.google.cloud.dataflow.sdk.transforms.Top.TopCombineFn
createAggregator(String, Combine.CombineFn<? super AI, AA, AO>) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFn.Context: Returns an aggregator with aggregation logic specified by the CombineFn argument.
createAggregator(String, SerializableFunction<Iterable<AI>, AO>) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFn.Context: Returns an aggregator with aggregation logic specified by the SerializableFunction argument.
createBasicReader(PipelineOptions, Coder<DatastoreV1.Entity>, ExecutionContext) - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.Source
createBasicReader(PipelineOptions, Coder<T>, ExecutionContext) - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSource
createBasicReader(PipelineOptions, Coder<T>, ExecutionContext) - Method in class com.google.cloud.dataflow.sdk.io.Source: Creates a basic (non-windowed) reader for this source.
createDatumReader() - Method in class com.google.cloud.dataflow.sdk.coders.AvroCoder: Returns a new DatumReader that can be used to read from an Avro file directly.
createDatumWriter() - Method in class com.google.cloud.dataflow.sdk.coders.AvroCoder: Returns a new DatumWriter that can be used to write to an Avro file directly.
createForSubrangeOfFile(String, long, long) - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSource: Creates and returns a new FileBasedSource of the same type as the current FileBasedSource backed by a given file and an offset range.
createForTest() - Static method in class com.google.cloud.dataflow.sdk.runners.DirectPipeline: Creates and returns a new DirectPipeline instance for tests.
createForTest() - Static method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner: Constructs a runner with default properties for testing.
createFromSystemProperties() - Static method in class com.google.cloud.dataflow.sdk.options.PipelineOptionsFactory: Deprecated.
createInputStream(InputStream) - Method in enum com.google.cloud.dataflow.sdk.io.TextIO.CompressionType
createPrimitiveOutputInternal(WindowFn<?, ?>) - Static method in class com.google.cloud.dataflow.sdk.values.PCollection: Creates and returns a new PCollection for a primitive output.
createSingleFileReader(PipelineOptions, Coder<T>, ExecutionContext) - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSource: Creates and returns an instance of a FileBasedReader implementation for the current source assuming the source represents a single file.
createSourceForSubrange(long, long) - Method in class com.google.cloud.dataflow.sdk.io.ByteOffsetBasedSource: Returns a ByteOffsetBasedSource for a subrange of the current source.
createSourceForSubrange(long, long) - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSource
createWindowedReader(PipelineOptions, Coder<WindowedValue<T>>, ExecutionContext) - Method in class com.google.cloud.dataflow.sdk.io.Source: Creates a windowed reader for this source.
CustomCoder<T> - Class in com.google.cloud.dataflow.sdk.coders: An abstract base class for writing Coders that encodes itself via java serialization.
CustomCoder() - Constructor for class com.google.cloud.dataflow.sdk.coders.CustomCoder

D

DataflowAssert - Class in com.google.cloud.dataflow.sdk.testing: An assertion on the contents of a PCollection incorporated into the pipeline.
DataflowAssert.AssertRelation<Actual,Expected> - Interface in com.google.cloud.dataflow.sdk.testing: A serializable function implementing a binary predicate between types Actual and Expected.
DataflowAssert.AssertThat<Actual,Expected> - Class in com.google.cloud.dataflow.sdk.testing: A SerializableFunction that performs an Assert.assertThat() operation using a Matcher operation.
DataflowAssert.IterableAssert<T> - Class in com.google.cloud.dataflow.sdk.testing: An assertion about the contents of a PCollectionView<Iterable<T>>.
DataflowAssert.IterableAssert(PCollectionView<Iterable<T>>) - Constructor for class com.google.cloud.dataflow.sdk.testing.DataflowAssert.IterableAssert
DataflowAssert.SingletonAssert<T> - Class in com.google.cloud.dataflow.sdk.testing: An assertion about the single value of type T associated with a PCollectionView<T>.
DataflowAssert.SingletonAssert(PCollectionView<T>) - Constructor for class com.google.cloud.dataflow.sdk.testing.DataflowAssert.SingletonAssert
DataflowPipeline - Class in com.google.cloud.dataflow.sdk.runners: A DataflowPipeline, which returns a DataflowPipelineJob subclass of PipelineResult from Pipeline.run().
DataflowPipelineDebugOptions - Interface in com.google.cloud.dataflow.sdk.options: Internal.
DataflowPipelineDebugOptions.DataflowClientFactory - Class in com.google.cloud.dataflow.sdk.options: Returns the default Dataflow client built from the passed in PipelineOptions.
DataflowPipelineDebugOptions.DataflowClientFactory() - Constructor for class com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions.DataflowClientFactory
DataflowPipelineDebugOptions.PathValidatorFactory - Class in com.google.cloud.dataflow.sdk.options: Creates a PathValidator object using the class specified in DataflowPipelineDebugOptions.getPathValidatorClass().
DataflowPipelineDebugOptions.PathValidatorFactory() - Constructor for class com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions.PathValidatorFactory
DataflowPipelineDebugOptions.StagerFactory - Class in com.google.cloud.dataflow.sdk.options: Creates a Stager object using the class specified in DataflowPipelineDebugOptions.getStagerClass().
DataflowPipelineDebugOptions.StagerFactory() - Constructor for class com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions.StagerFactory
DataflowPipelineJob - Class in com.google.cloud.dataflow.sdk.runners: A DataflowPipelineJob represents a job submitted to Dataflow using DataflowPipelineRunner.
DataflowPipelineJob(String, String, Dataflow) - Constructor for class com.google.cloud.dataflow.sdk.runners.DataflowPipelineJob: Construct the job.
DataflowPipelineOptions - Interface in com.google.cloud.dataflow.sdk.options: Options which can be used to configure the DataflowPipeline.
DataflowPipelineOptions.JobNameFactory - Class in com.google.cloud.dataflow.sdk.options: Returns a normalized job name constructed from ApplicationNameOptions.getAppName(), the local system user name (if available), and the current time.
DataflowPipelineOptions.JobNameFactory() - Constructor for class com.google.cloud.dataflow.sdk.options.DataflowPipelineOptions.JobNameFactory
DataflowPipelineRegistrar - Class in com.google.cloud.dataflow.sdk.runners: Contains the PipelineOptionsRegistrar and PipelineRunnerRegistrar for the DataflowPipeline.
DataflowPipelineRegistrar.Options - Class in com.google.cloud.dataflow.sdk.runners: Register the DataflowPipelineOptions and BlockingDataflowPipelineOptions.
DataflowPipelineRegistrar.Options() - Constructor for class com.google.cloud.dataflow.sdk.runners.DataflowPipelineRegistrar.Options
DataflowPipelineRegistrar.Runner - Class in com.google.cloud.dataflow.sdk.runners: Register the DataflowPipelineRunner and BlockingDataflowPipelineRunner.
DataflowPipelineRegistrar.Runner() - Constructor for class com.google.cloud.dataflow.sdk.runners.DataflowPipelineRegistrar.Runner
DataflowPipelineRunner - Class in com.google.cloud.dataflow.sdk.runners: A PipelineRunner that executes the operations in the pipeline by first translating them to the Dataflow representation using the DataflowPipelineTranslator and then submitting them to a Dataflow service for execution.
DataflowPipelineRunnerHooks - Class in com.google.cloud.dataflow.sdk.runners: An instance of this class can be passed to the DataflowPipeline runner to add user defined hooks to be invoked at various times during pipeline execution.
DataflowPipelineRunnerHooks() - Constructor for class com.google.cloud.dataflow.sdk.runners.DataflowPipelineRunnerHooks
DataflowPipelineTranslator - Class in com.google.cloud.dataflow.sdk.runners: DataflowPipelineTranslator knows how to translate Pipeline objects into Dataflow API Jobs.
DataflowPipelineTranslator.TransformTranslator<PT extends PTransform> - Interface in com.google.cloud.dataflow.sdk.runners: A translator of a PTransform.
DataflowPipelineTranslator.TranslationContext - Interface in com.google.cloud.dataflow.sdk.runners: The interface provided to registered callbacks for interacting with the DataflowPipelineRunner, including reading and writing the values of PCollections and side inputs (PCollectionViews).
DataflowPipelineWorkerPoolOptions - Interface in com.google.cloud.dataflow.sdk.options: Options which are used to configure the Dataflow pipeline worker pool.
DataflowPipelineWorkerPoolOptions.AutoscalingAlgorithmType - Enum in com.google.cloud.dataflow.sdk.options: Type of autoscaling algorithm to use.
DataflowPipelineWorkerPoolOptions.ClusterManagerApiType - Enum in com.google.cloud.dataflow.sdk.options: Type of API for handling cluster management, i.e.
DataflowPipelineWorkerPoolOptions.TeardownPolicy - Enum in com.google.cloud.dataflow.sdk.options: The policy for tearing down the workers spun up by the service.
DataflowWorkerHarnessOptions - Interface in com.google.cloud.dataflow.sdk.options: Options which are used exclusively within the Dataflow worker harness.
DataflowWorkerLoggingOptions - Interface in com.google.cloud.dataflow.sdk.options: Options which are used to control logging configuration on the Dataflow worker.
DataflowWorkerLoggingOptions.Level - Enum in com.google.cloud.dataflow.sdk.options: The set of log levels which can be used on the Dataflow worker.
DataflowWorkerLoggingOptions.WorkerLogLevelOverride - Class in com.google.cloud.dataflow.sdk.options: Defines a log level override for a specific class, package, or name.
DATASTORE_BATCH_UPDATE_LIMIT - Static variable in class com.google.cloud.dataflow.sdk.io.DatastoreIO: Datastore has a limit of 500 mutations per batch operation, so we flush changes to Datastore every 500 entities.
DatastoreIO - Class in com.google.cloud.dataflow.sdk.io: Transforms for reading and writing Google Cloud Datastore entities.
DatastoreIO() - Constructor for class com.google.cloud.dataflow.sdk.io.DatastoreIO
DatastoreIO.DatastoreReader - Class in com.google.cloud.dataflow.sdk.io: A reader over the records from a query of the datastore.
DatastoreIO.DatastoreReader(DatastoreV1.Query, Datastore) - Constructor for class com.google.cloud.dataflow.sdk.io.DatastoreIO.DatastoreReader: Returns a DatastoreIterator with query and Datastore object set.
DatastoreIO.Sink - Class in com.google.cloud.dataflow.sdk.io: A PTransform that writes a PCollection<Entity> containing entities to a Datastore kind.
DatastoreIO.Source - Class in com.google.cloud.dataflow.sdk.io: A source that reads the result rows of a Datastore query as Entity objects.
days(int) - Static method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows: Returns a WindowFn that windows elements into periods measured by days.
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.AvroCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.BigEndianIntegerCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.BigEndianLongCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.ByteArrayCoder
decode(InputStream, Coder.Context) - Method in interface com.google.cloud.dataflow.sdk.coders.Coder: Decodes a value of type T from the given input stream in the given context.
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.DelegateCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.DoubleCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.EntityCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.InstantCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.IterableLikeCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.KvCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.MapCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.Proto2Coder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.SerializableCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.StringUtf8Coder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.TableRowJsonCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.TextualIntegerCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.VarIntCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.VarLongCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.VoidCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult.CoGbkResultCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.GlobalWindow.Coder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.values.TimestampedValue.TimestampedValueCoder
decodeToIterable(List<T>) - Method in class com.google.cloud.dataflow.sdk.coders.CollectionCoder
decodeToIterable(List<T>) - Method in class com.google.cloud.dataflow.sdk.coders.IterableCoder
decodeToIterable(List<T>) - Method in class com.google.cloud.dataflow.sdk.coders.IterableLikeCoder: Builds an instance of the coder's associated Iterable from a list of decoded elements.
decodeToIterable(List<T>) - Method in class com.google.cloud.dataflow.sdk.coders.ListCoder
decodeToIterable(List<T>) - Method in class com.google.cloud.dataflow.sdk.coders.SetCoder
Default - Annotation Type in com.google.cloud.dataflow.sdk.options: Default represents a set of annotations which can be used to annotate getter properties on PipelineOptions with information representing the default value to be returned if no value is specified.
Default.Boolean - Annotation Type in com.google.cloud.dataflow.sdk.options: This represents that the default of the option is the specified boolean primitive value.
Default.Byte - Annotation Type in com.google.cloud.dataflow.sdk.options: This represents that the default of the option is the specified byte primitive value.
Default.Character - Annotation Type in com.google.cloud.dataflow.sdk.options: This represents that the default of the option is the specified char primitive value.
Default.Class - Annotation Type in com.google.cloud.dataflow.sdk.options: This represents that the default of the option is the specified Class value.
Default.Double - Annotation Type in com.google.cloud.dataflow.sdk.options: This represents that the default of the option is the specified double primitive value.
Default.Enum - Annotation Type in com.google.cloud.dataflow.sdk.options: This represents that the default of the option is the specified enum.
Default.Float - Annotation Type in com.google.cloud.dataflow.sdk.options: This represents that the default of the option is the specified float primitive value.
Default.InstanceFactory - Annotation Type in com.google.cloud.dataflow.sdk.options: Value must be of type DefaultValueFactory and have a default constructor.
Default.Integer - Annotation Type in com.google.cloud.dataflow.sdk.options: This represents that the default of the option is the specified int primitive value.
Default.Long - Annotation Type in com.google.cloud.dataflow.sdk.options: This represents that the default of the option is the specified long primitive value.
Default.Short - Annotation Type in com.google.cloud.dataflow.sdk.options: This represents that the default of the option is the specified short primitive value.
Default.String - Annotation Type in com.google.cloud.dataflow.sdk.options: This represents that the default of the option is the specified String value.
DEFAULT_HOST - Static variable in class com.google.cloud.dataflow.sdk.io.DatastoreIO
DEFAULT_MAX_NUM_ELEMENTS - Static variable in class com.google.cloud.dataflow.sdk.transforms.ApproximateQuantiles.ApproximateQuantilesCombineFn: The cost (in time and space) to compute quantiles to a given accuracy is a function of the total number of elements in the data set.
DEFAULT_TEXT_CODER - Static variable in class com.google.cloud.dataflow.sdk.io.TextIO
DefaultCoder - Annotation Type in com.google.cloud.dataflow.sdk.coders: Specifies a default Coder class to handle encoding and decoding instances of the annotated class.
DefaultValueFactory<T> - Interface in com.google.cloud.dataflow.sdk.options: An interface used with Default.InstanceFactory annotation to specify the class which will be an instance factory to produce default values for a given getter on PipelineOptions.
DelegateCoder<T,DT> - Class in com.google.cloud.dataflow.sdk.coders: A DelegateCoder<T, DT> wraps a Coder<DT> and encodes/decodes values of type Ts by converting to/from DT and then encoding/decoding using the underlying Coder<DT>.
DelegateCoder(Coder<DT>, DelegateCoder.CodingFunction<T, DT>, DelegateCoder.CodingFunction<DT, T>) - Constructor for class com.google.cloud.dataflow.sdk.coders.DelegateCoder
DelegateCoder.CodingFunction<Input,Output> - Interface in com.google.cloud.dataflow.sdk.coders: A CodingFunction<Input, Output> is a serializable function from Input to Output that may throw any Exception.
Description - Annotation Type in com.google.cloud.dataflow.sdk.options: Descriptions are used to generate human readable output when the --help command is specified.
detectClassPathResourcesToStage(ClassLoader) - Static method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineRunner: Attempts to detect all the resources the class loader has access to.
DIRECTORY_CONTAINER - Static variable in class com.google.cloud.dataflow.sdk.io.ShardNameTemplate: Shard is a file within a directory.
DirectPipeline - Class in com.google.cloud.dataflow.sdk.runners: A DirectPipeline, which returns a DirectPipelineRunner.EvaluationResults subclass of PipelineResult from Pipeline.run().
DirectPipelineOptions - Interface in com.google.cloud.dataflow.sdk.options: Options which can be used to configure the DirectPipeline.
DirectPipelineRegistrar - Class in com.google.cloud.dataflow.sdk.runners: Contains the PipelineOptionsRegistrar and PipelineRunnerRegistrar for the DirectPipeline.
DirectPipelineRegistrar.Options - Class in com.google.cloud.dataflow.sdk.runners: Register the DirectPipelineRunner.
DirectPipelineRegistrar.Options() - Constructor for class com.google.cloud.dataflow.sdk.runners.DirectPipelineRegistrar.Options
DirectPipelineRegistrar.Runner - Class in com.google.cloud.dataflow.sdk.runners: Register the DirectPipelineOptions.
DirectPipelineRegistrar.Runner() - Constructor for class com.google.cloud.dataflow.sdk.runners.DirectPipelineRegistrar.Runner
DirectPipelineRunner - Class in com.google.cloud.dataflow.sdk.runners: Executes the operations in the pipeline directly, in this process, without any optimization.
DirectPipelineRunner.EvaluationContext - Interface in com.google.cloud.dataflow.sdk.runners: The interface provided to registered callbacks for interacting with the DirectPipelineRunner, including reading and writing the values of PCollections and PCollectionViews.
DirectPipelineRunner.EvaluationResults - Interface in com.google.cloud.dataflow.sdk.runners: The interface provided to registered callbacks for interacting with the DirectPipelineRunner, including reading and writing the values of PCollections and PCollectionViews.
DirectPipelineRunner.TestCombineDoFn<K,VI,VA,VO> - Class in com.google.cloud.dataflow.sdk.runners: The implementation may split the KeyedCombineFn into ADD, MERGE and EXTRACT phases (see CombineValuesFn).
DirectPipelineRunner.TestCombineDoFn(Combine.KeyedCombineFn<? super K, ? super VI, VA, VO>, Coder<VA>, boolean) - Constructor for class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.TestCombineDoFn
DirectPipelineRunner.TransformEvaluator<PT extends PTransform> - Interface in com.google.cloud.dataflow.sdk.runners: An evaluator of a PTransform.
DirectPipelineRunner.ValueWithMetadata<V> - Class in com.google.cloud.dataflow.sdk.runners: An immutable (value, timestamp) pair, along with other metadata necessary for the implementation of DirectPipelineRunner.
DoFn<I,O> - Class in com.google.cloud.dataflow.sdk.transforms: The argument to ParDo providing the code to use to process elements of the input PCollection.
DoFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.DoFn
DoFn.Context - Class in com.google.cloud.dataflow.sdk.transforms: Information accessible to all methods in this DoFn.
DoFn.Context() - Constructor for class com.google.cloud.dataflow.sdk.transforms.DoFn.Context
DoFn.KeyedState - Interface in com.google.cloud.dataflow.sdk.transforms: Interface for interacting with keyed state.
DoFn.ProcessContext - Class in com.google.cloud.dataflow.sdk.transforms: Information accessible when running DoFn.processElement(com.google.cloud.dataflow.sdk.transforms.DoFn<I, O>.ProcessContext).
DoFn.ProcessContext() - Constructor for class com.google.cloud.dataflow.sdk.transforms.DoFn.ProcessContext
DoFn.RequiresKeyedState - Interface in com.google.cloud.dataflow.sdk.transforms: Interface for signaling that a DoFn needs to maintain per-key state, accessed via DoFn.ProcessContext.keyedState().
DoFn.RequiresWindowAccess - Interface in com.google.cloud.dataflow.sdk.transforms: Interface for signaling that a DoFn needs to access the window the element is being processed in, via DoFn.ProcessContext.window().
DoFnTester<I,O> - Class in com.google.cloud.dataflow.sdk.transforms: A harness for unit-testing a DoFn.
DoubleCoder - Class in com.google.cloud.dataflow.sdk.coders: A DoubleCoder encodes Doubles in 8 bytes.
doublesGlobally() - Static method in class com.google.cloud.dataflow.sdk.transforms.Max: Returns a PTransform that takes an input PCollection<Double> and returns a PCollection<Double> whose contents is the maximum of the input PCollection's elements, or Double.MIN_VALUE if there are no elements.
doublesGlobally() - Static method in class com.google.cloud.dataflow.sdk.transforms.Min: Returns a PTransform that takes an input PCollection<Double> and returns a PCollection<Double> whose contents is the minimum of the input PCollection's elements, or Double.MAX_VALUE if there are no elements.
doublesGlobally() - Static method in class com.google.cloud.dataflow.sdk.transforms.Sum: Returns a PTransform that takes an input PCollection<Double> and returns a PCollection<Double> whose contents is the sum of the input PCollection's elements, or 0 if there are no elements.
doublesPerKey() - Static method in class com.google.cloud.dataflow.sdk.transforms.Max: Returns a PTransform that takes an input PCollection<KV<K, Double>> and returns a PCollection<KV<K, Double>> that contains an output element mapping each distinct key in the input PCollection to the maximum of the values associated with that key in the input PCollection.
doublesPerKey() - Static method in class com.google.cloud.dataflow.sdk.transforms.Min: Returns a PTransform that takes an input PCollection<KV<K, Double>> and returns a PCollection<KV<K, Double>> that contains an output element mapping each distinct key in the input PCollection to the minimum of the values associated with that key in the input PCollection.
doublesPerKey() - Static method in class com.google.cloud.dataflow.sdk.transforms.Sum: Returns a PTransform that takes an input PCollection<KV<K, Double>> and returns a PCollection<KV<K, Double>> that contains an output element mapping each distinct key in the input PCollection to the sum of the values associated with that key in the input PCollection.
dropLateData(boolean) - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read.Bound: Returns a new PubsubIO.Read PTransform that's like this one but with the specified setting for dropLateData.
dropLateData(boolean) - Static method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read: If true, then late-arriving data from this source will be dropped.

E

element() - Method in class com.google.cloud.dataflow.sdk.transforms.DoFn.ProcessContext: Returns the input element to be processed.
element() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.WindowFn.AssignContext: Returns the current element.
empty() - Static method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult: Returns an empty CoGbkResult.
empty(Pipeline) - Static method in class com.google.cloud.dataflow.sdk.transforms.join.KeyedPCollectionTuple: Returns an empty KeyedPCollections<K> on the given pipeline.
empty(Pipeline) - Static method in class com.google.cloud.dataflow.sdk.values.PCollectionList: Returns an empty PCollectionList that is part of the given Pipeline.
empty(Pipeline) - Static method in class com.google.cloud.dataflow.sdk.values.PCollectionTuple: Returns an empty PCollectionTuple that is part of the given Pipeline.
empty() - Static method in class com.google.cloud.dataflow.sdk.values.TupleTagList: Returns an empty TupleTagList.
encode(T, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.AvroCoder
encode(Integer, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.BigEndianIntegerCoder
encode(Long, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.BigEndianLongCoder
encode(byte[], OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.ByteArrayCoder
encode(T, OutputStream, Coder.Context) - Method in interface com.google.cloud.dataflow.sdk.coders.Coder: Encodes the given value of type T onto the given output stream in the given context.
encode(T, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.DelegateCoder
encode(Double, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.DoubleCoder
encode(DatastoreV1.Entity, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.EntityCoder
encode(Instant, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.InstantCoder
encode(IT, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.IterableLikeCoder
encode(KV<K, V>, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.KvCoder
encode(Map<K, V>, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.MapCoder
encode(T, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.Proto2Coder
encode(T, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.SerializableCoder
encode(String, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.StringUtf8Coder
encode(TableRow, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.TableRowJsonCoder
encode(Integer, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.TextualIntegerCoder
encode(Integer, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.VarIntCoder
encode(Long, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.VarLongCoder
encode(Void, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.VoidCoder
encode(CoGbkResult, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult.CoGbkResultCoder
encode(GlobalWindow, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.GlobalWindow.Coder
encode(TimestampedValue<T>, OutputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.values.TimestampedValue.TimestampedValueCoder
end() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.IntervalWindow: Returns the end of this window, exclusive.
ensureCoderSerializable(Coder<T>) - Method in interface com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.EvaluationContext: If the evaluation context is testing serializability, ensures that the argument Coder is serializable and deserializable by encoding it and then decoding it, and returning the result.
ensureElementEncodable(TypedPValue<T>, T) - Method in interface com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.EvaluationContext: Ensures that the element is encodable and decodable using the TypePValue's coder, by encoding it and decoding it, and returning the result.
ensureSerializable(Fn) - Method in interface com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.EvaluationContext: If the evaluation context is testing serializability, ensures that the argument function is serializable and deserializable by encoding it and then decoding it, and returning the result.
ensureSerializableByCoder(Coder<T>, T, String) - Method in interface com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.EvaluationContext: If the evaluation context is testing serializability, ensures that the given data is serializable and deserializable with the given Coder by encoding it and then decoding it, and returning the result.
ensureSerializableByCoder(Coder<T>, T, String) - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.TestCombineDoFn
enterCompositeTransform(TransformTreeNode) - Method in interface com.google.cloud.dataflow.sdk.Pipeline.PipelineVisitor
enterCompositeTransform(TransformTreeNode) - Method in class com.google.cloud.dataflow.sdk.runners.RecordingPipelineVisitor
EntityCoder - Class in com.google.cloud.dataflow.sdk.coders: An EntityCoder encodes/decodes Datastore Entity objects.
equals(Object) - Method in class com.google.cloud.dataflow.sdk.coders.SerializableCoder
equals(Object) - Method in class com.google.cloud.dataflow.sdk.coders.StandardCoder
equals(Object) - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult.CoGbkResultCoder
equals(Object) - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResultSchema
equals(Object) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.IntervalWindow
equals(Object) - Method in class com.google.cloud.dataflow.sdk.values.KV
equals(Object) - Method in class com.google.cloud.dataflow.sdk.values.TupleTag
evaluate(PT, DirectPipelineRunner.EvaluationContext) - Method in interface com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.TransformEvaluator
every(Duration) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.SlidingWindows: Returns a new SlidingWindows with the original size, that assigns timestamps into half-open intervals of the form [N * period, N * period + size), where 0 is the epoch.
expand() - Method in class com.google.cloud.dataflow.sdk.transforms.join.KeyedPCollectionTuple: Expands the component PCollections, stripping off any tag-specific information.
expand() - Method in class com.google.cloud.dataflow.sdk.values.PBegin
expand() - Method in class com.google.cloud.dataflow.sdk.values.PCollectionList
expand() - Method in class com.google.cloud.dataflow.sdk.values.PCollectionTuple
expand() - Method in class com.google.cloud.dataflow.sdk.values.PDone
expand() - Method in interface com.google.cloud.dataflow.sdk.values.PInput: Expands this PInput into a list of its component input PValues.
expand() - Method in interface com.google.cloud.dataflow.sdk.values.POutput: Expands this POutput into a list of its component output PValues.
expand() - Method in class com.google.cloud.dataflow.sdk.values.PValueBase
extractOrderedList() - Method in class com.google.cloud.dataflow.sdk.transforms.ApproximateUnique.ApproximateUniqueCombineFn.LargestUnique: Returns the values in the heap, ordered largest to smallest.
extractOutput(ApproximateUnique.ApproximateUniqueCombineFn.LargestUnique) - Method in class com.google.cloud.dataflow.sdk.transforms.ApproximateUnique.ApproximateUniqueCombineFn
extractOutput() - Method in interface com.google.cloud.dataflow.sdk.transforms.Combine.AccumulatingCombineFn.Accumulator: Returns the output value that is the result of combining all the input values represented by this accumulator.
extractOutput(VA) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.AccumulatingCombineFn
extractOutput(double[]) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineDoubleFn
extractOutput(Combine.BinaryCombineFn.Holder<V>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineFn
extractOutput(int[]) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineIntegerFn
extractOutput(long[]) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineLongFn
extractOutput(VA) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.CombineFn: Returns the output value that is the result of combining all the input values represented by the given accumulator.
extractOutput(K, VA) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.KeyedCombineFn: Returns the output value that is the result of combining all the input values represented by the given accumulator.
extractOutput(List<V>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.SimpleCombineFn
extractOutput(Top.TopCombineFn<KV<Integer, T>>.Heap) - Method in class com.google.cloud.dataflow.sdk.transforms.Sample.FixedSizedSampleFn

F

FileBasedSource<T> - Class in com.google.cloud.dataflow.sdk.io: A common base class for all file-based Sources.
FileBasedSource(boolean, String, long, long, long) - Constructor for class com.google.cloud.dataflow.sdk.io.FileBasedSource: Create a FileBasedSource based on a file or a file pattern specification.
FileBasedSource.FileBasedReader<T> - Class in com.google.cloud.dataflow.sdk.io: A reader that implements code common to readers of FileBasedSources.
FileBasedSource.FileBasedReader(FileBasedSource<T>) - Constructor for class com.google.cloud.dataflow.sdk.io.FileBasedSource.FileBasedReader: Subclasses should not perform IO operations at the constructor.
FileBasedSource.Mode - Enum in com.google.cloud.dataflow.sdk.io: A given FileBasedSource represents a file resource of one of these types.
Filter<T> - Class in com.google.cloud.dataflow.sdk.transforms: PTransforms for filtering from a PCollection the elements satisfying a predicate, or satisfying an inequality with a given value based on the elements' natural ordering.
Filter() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Filter
finishBundle(DoFn<I, O>.Context) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFn: Finishes processing this batch of elements.
finishBundle() - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnTester: Calls DoFn.finishBundle(com.google.cloud.dataflow.sdk.transforms.DoFn<I, O>.Context) of the DoFn under test.
finishBundle(DoFn<I, O>.Context) - Method in class com.google.cloud.dataflow.sdk.transforms.RateLimiting.RateLimitingDoFn
finishSpecifying() - Method in class com.google.cloud.dataflow.sdk.runners.TransformTreeNode: Finish specifying a transform.
finishSpecifying() - Method in class com.google.cloud.dataflow.sdk.transforms.GroupByKey.GroupByKeyOnly
finishSpecifying() - Method in class com.google.cloud.dataflow.sdk.transforms.join.KeyedPCollectionTuple
finishSpecifying() - Method in class com.google.cloud.dataflow.sdk.transforms.PTransform: After building, finalizes this PTransform to make it ready for running.
finishSpecifying() - Method in class com.google.cloud.dataflow.sdk.values.PBegin
finishSpecifying() - Method in class com.google.cloud.dataflow.sdk.values.PCollectionList
finishSpecifying() - Method in class com.google.cloud.dataflow.sdk.values.PCollectionTuple
finishSpecifying() - Method in interface com.google.cloud.dataflow.sdk.values.PInput: After building, finalizes this PInput to make it ready for being used as an input to a PTransform.
finishSpecifying() - Method in class com.google.cloud.dataflow.sdk.values.PValueBase
finishSpecifying() - Method in class com.google.cloud.dataflow.sdk.values.TypedPValue: After building, finalizes this PValue to make it ready for running.
finishSpecifyingOutput() - Method in class com.google.cloud.dataflow.sdk.values.PCollectionList
finishSpecifyingOutput() - Method in class com.google.cloud.dataflow.sdk.values.PCollectionTuple
finishSpecifyingOutput() - Method in interface com.google.cloud.dataflow.sdk.values.POutput: As part of finishing the producing PTransform, finalizes this PTransform output to make it ready for being used as an input and for running.
finishSpecifyingOutput() - Method in class com.google.cloud.dataflow.sdk.values.POutputValueBase: Default behavior for finishSpecifyingOutput() is to do nothing.
First<T> - Class in com.google.cloud.dataflow.sdk.transforms: First<T> takes a PCollection<T> and a limit, and produces a new PCollection<T> containing up to limit elements of the input PCollection.
fixedSizeGlobally(int) - Static method in class com.google.cloud.dataflow.sdk.transforms.Sample: Returns a PTransform that takes a PCollection<T>, selects sampleSize elements, uniformly at random, and returns a PCollection<Iterable<T>> containing the selected elements.
fixedSizePerKey(int) - Static method in class com.google.cloud.dataflow.sdk.transforms.Sample: Returns a PTransform that takes an input PCollection<KV<K, V>> and returns a PCollection<KV<K, Iterable<V>>> that contains an output element mapping each distinct key in the input PCollection to a sample of sampleSize values associated with that key in the input PCollection, taken uniformly at random.
FixedWindows - Class in com.google.cloud.dataflow.sdk.transforms.windowing: A WindowFn that windows values into fixed-size timestamp-based windows.
Flatten - Class in com.google.cloud.dataflow.sdk.transforms: Flatten<T> takes multiple PCollection<T>s bundled into a PCollectionList<T> and returns a single PCollection<T> containing all the elements in all the input PCollections.
Flatten() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Flatten
Flatten.FlattenIterables<T> - Class in com.google.cloud.dataflow.sdk.transforms: FlattenIterables<T> takes a PCollection<Iterable<T>> and returns a PCollection<T> that contains all the elements from each iterable.
Flatten.FlattenIterables() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Flatten.FlattenIterables
Flatten.FlattenPCollectionList<T> - Class in com.google.cloud.dataflow.sdk.transforms: A PTransform that flattens a PCollectionList into a PCollection containing all the elements of all the PCollections in its input.
forClass(Class<?>, DataflowWorkerLoggingOptions.Level) - Static method in class com.google.cloud.dataflow.sdk.options.DataflowWorkerLoggingOptions.WorkerLogLevelOverride: Overrides the default log level for the passed in class.
forName(String, DataflowWorkerLoggingOptions.Level) - Static method in class com.google.cloud.dataflow.sdk.options.DataflowWorkerLoggingOptions.WorkerLogLevelOverride: Overrides the default log level for the passed in name.
forPackage(Package, DataflowWorkerLoggingOptions.Level) - Static method in class com.google.cloud.dataflow.sdk.options.DataflowWorkerLoggingOptions.WorkerLogLevelOverride: Overrides the default log level for the passed in package.
from(String) - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Read.Bound: Returns a new AvroIO.Read PTransform that's like this one but that reads from the file(s) with the given name or pattern.
from(String) - Static method in class com.google.cloud.dataflow.sdk.io.AvroIO.Read: Returns an AvroIO.Read PTransform that reads from the file(s) with the given name or pattern.
from(String) - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Read.Bound: Sets the table specification.
from(TableReference) - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Read.Bound: Sets the table specification.
from(String) - Static method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Read: Reads a BigQuery table specified as "[project_id]:[dataset_id].[table_id]" or "[dataset_id].[table_id]" for tables within the current project.
from(TableReference) - Static method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Read: Reads a BigQuery table specified as a TableReference object.
from(Source<T>) - Method in class com.google.cloud.dataflow.sdk.io.ReadSource.Bound: Returns a new ReadSource PTransform that's like this one but reads from the given Source.
from(Source<T>) - Static method in class com.google.cloud.dataflow.sdk.io.ReadSource: Returns a new unnamed ReadSource.Bound PTransform reading from the given Source.
from(String) - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Read.Bound: Returns a new TextIO.Read PTransform that's like this one but that reads from the file(s) with the given name or pattern.
from(String) - Static method in class com.google.cloud.dataflow.sdk.io.TextIO.Read: Returns a TextIO.Read PTransform that reads from the file(s) with the given name or pattern.
fromArgs(String[]) - Method in class com.google.cloud.dataflow.sdk.options.PipelineOptionsFactory.Builder: Sets the command line arguments to parse when constructing the PipelineOptions.
fromArgs(String[]) - Static method in class com.google.cloud.dataflow.sdk.options.PipelineOptionsFactory: Sets the command line arguments to parse when constructing the PipelineOptions.
fromIterableInternal(Iterable<WindowedValue<?>>) - Method in interface com.google.cloud.dataflow.sdk.values.PCollectionView: For internal use only.
fromOptions(PipelineOptions) - Static method in class com.google.cloud.dataflow.sdk.runners.BlockingDataflowPipelineRunner: Constructs a runner from the provided options.
fromOptions(PipelineOptions) - Static method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineRunner: Construct a runner from the provided options.
fromOptions(DataflowPipelineOptions) - Static method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator: Constructs a translator from the provided options.
fromOptions(PipelineOptions) - Static method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner: Constructs a DirectPipelineRunner from the given options.
fromOptions(PipelineOptions) - Static method in class com.google.cloud.dataflow.sdk.runners.PipelineRunner: Constructs a runner from the provided options.

G

GcpOptions - Interface in com.google.cloud.dataflow.sdk.options: Options used to configure Google Cloud Platform project and credentials.
GcpOptions.CredentialDirFactory - Class in com.google.cloud.dataflow.sdk.options: Returns the default credential directory of ${user.home}/.store/data-flow.
GcpOptions.CredentialDirFactory() - Constructor for class com.google.cloud.dataflow.sdk.options.GcpOptions.CredentialDirFactory
GcpOptions.GcpUserCredentialsFactory - Class in com.google.cloud.dataflow.sdk.options: Attempts to load the GCP credentials.
GcpOptions.GcpUserCredentialsFactory() - Constructor for class com.google.cloud.dataflow.sdk.options.GcpOptions.GcpUserCredentialsFactory
GcsOptions - Interface in com.google.cloud.dataflow.sdk.options: Options used to configure Google Cloud Storage.
GcsOptions.ExecutorServiceFactory - Class in com.google.cloud.dataflow.sdk.options: Returns the default ExecutorService to use within the Dataflow SDK.
GcsOptions.ExecutorServiceFactory() - Constructor for class com.google.cloud.dataflow.sdk.options.GcsOptions.ExecutorServiceFactory
get(CodedTupleTag<T>) - Method in class com.google.cloud.dataflow.sdk.values.CodedTupleTagMap: Returns the value associated with the given tag in this CodedTupleTagMap, or null if the tag has no asssociated value.
get(int) - Method in class com.google.cloud.dataflow.sdk.values.PCollectionList: Returns the PCollection at the given index (origin zero).
get(TupleTag<T>) - Method in class com.google.cloud.dataflow.sdk.values.PCollectionTuple: Returns the PCollection with the given tag in this PCollectionTuple.
get(int) - Method in class com.google.cloud.dataflow.sdk.values.TupleTagList: Returns the TupleTag at the given index (origin zero).
getAccumulatorCoder(CoderRegistry, Coder<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.ApproximateQuantiles.ApproximateQuantilesCombineFn
getAccumulatorCoder(CoderRegistry, Coder<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.ApproximateUnique.ApproximateUniqueCombineFn
getAccumulatorCoder(CoderRegistry, Coder<Double>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineDoubleFn
getAccumulatorCoder(CoderRegistry, Coder<V>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineFn
getAccumulatorCoder(CoderRegistry, Coder<Integer>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineIntegerFn
getAccumulatorCoder(CoderRegistry, Coder<Long>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineLongFn
getAccumulatorCoder(CoderRegistry, Coder<VI>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.CombineFn: Returns the Coder to use for accumulator VA values, or null if it is not able to be inferred.
getAccumulatorCoder() - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.GroupedValues
getAccumulatorCoder(CoderRegistry, Coder<K>, Coder<VI>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.KeyedCombineFn: Returns the Coder to use for accumulator VA values, or null if it is not able to be inferred.
getAccumulatorCoder(CoderRegistry, Coder<N>) - Method in class com.google.cloud.dataflow.sdk.transforms.Mean.MeanFn
getAccumulatorCoder(CoderRegistry, Coder<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.Sample.FixedSizedSampleFn
getAccumulatorCoder(CoderRegistry, Coder<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.Top.TopCombineFn
getAddCounterMutator() - Method in interface com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.EvaluationContext: Returns a mutator, which can be used to add additional counters to this EvaluationContext.
getAlgorithm() - Method in enum com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions.AutoscalingAlgorithmType: Returns the string representation of this type.
getAll(TupleTag<V>) - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult: Returns the values from the table represented by the given TupleTag<V> as an Iterable<V> (which may be empty if there are no results).
getAll() - Method in class com.google.cloud.dataflow.sdk.values.PCollectionList: Returns an immutable List of all the PCollections in this PCollectionList.
getAll() - Method in class com.google.cloud.dataflow.sdk.values.PCollectionTuple: Returns an immutable Map from TupleTag to corresponding PCollection, for all the members of this PCollectionTuple.
getAll() - Method in class com.google.cloud.dataflow.sdk.values.TupleTagList: Returns an immutable List of all the TupleTags in this TupleTagList.
getAllowedTimestampSkew() - Method in class com.google.cloud.dataflow.sdk.transforms.DoFn: Returns the allowed timestamp skew duration, which is the maximum duration that timestamps can be shifted backward in DoFn.Context.outputWithTimestamp(O, org.joda.time.Instant).
getApiRootUrl() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions: The endpoint to use with the Dataflow API.
getApiServiceName() - Method in enum com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions.ClusterManagerApiType
getAppName() - Method in interface com.google.cloud.dataflow.sdk.options.ApplicationNameOptions: Name of application, for display purposes.
getAutoscalingAlgorithm() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions
getCause() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.InvalidWindows: Returns the reason that this WindowFn is invalid.
getCdbgVersion() - Method in interface com.google.cloud.dataflow.sdk.options.CloudDebuggerOptions: User defined application version.
getClusterManagerApi() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions: Type of API for handling cluster management, i.e.
getCoder() - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Write.Bound
getCoder() - Method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert.IterableAssert: Gets the coder, which may yet be absent.
getCoder() - Method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert.SingletonAssert: Gets the coder, which may yet be absent.
getCoder() - Static method in class com.google.cloud.dataflow.sdk.transforms.windowing.IntervalWindow: Returns a Coder suitable for encoding IntervalWindows.
getCoder() - Method in class com.google.cloud.dataflow.sdk.values.CodedTupleTag: Returns the Coder used for values associated with this tag.
getCoder() - Method in class com.google.cloud.dataflow.sdk.values.PCollection: Returns the Coder used by this PCollection to encode and decode the values stored in it.
getCoder() - Method in class com.google.cloud.dataflow.sdk.values.TypedPValue: Returns the Coder used by this TypedPValue to encode and decode the values stored in it.
getCoderArguments() - Method in class com.google.cloud.dataflow.sdk.coders.AtomicCoder
getCoderArguments() - Method in class com.google.cloud.dataflow.sdk.coders.AvroCoder
getCoderArguments() - Method in interface com.google.cloud.dataflow.sdk.coders.Coder: If this is a Coder for a parameterized type, returns the list of Coders being used for each of the parameters, or returns null if this cannot be done or this is not a parameterized type.
getCoderArguments() - Method in class com.google.cloud.dataflow.sdk.coders.IterableLikeCoder
getCoderArguments() - Method in class com.google.cloud.dataflow.sdk.coders.KvCoder
getCoderArguments() - Method in class com.google.cloud.dataflow.sdk.coders.MapCoder
getCoderArguments() - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult.CoGbkResultCoder
getCoderArguments() - Method in class com.google.cloud.dataflow.sdk.values.TimestampedValue.TimestampedValueCoder
getCoderRegistry() - Method in class com.google.cloud.dataflow.sdk.Pipeline: Returns the CoderRegistry that this Pipeline uses.
getCoderRegistry() - Method in class com.google.cloud.dataflow.sdk.transforms.PTransform: Deprecated.
use pipeline.getCoderRegistry()
getCoGbkResultSchema() - Method in class com.google.cloud.dataflow.sdk.transforms.join.KeyedPCollectionTuple: Returns the CoGbkResultSchema associated with this KeyedPCollections.
getCollection() - Method in class com.google.cloud.dataflow.sdk.transforms.join.KeyedPCollectionTuple.TaggedKeyedPCollection: Returns the underlying PCollection of this TaggedKeyedPCollection.
getComponents() - Method in class com.google.cloud.dataflow.sdk.coders.StandardCoder: Returns the list of Coders that are components of this Coder.
getComponents() - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult.CoGbkResultCoder
getCompressionType() - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Read.Bound
getCreateDisposition() - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.Bound: Returns the create disposition.
getCredentialDir() - Method in interface com.google.cloud.dataflow.sdk.options.GcpOptions: Directory for storing dataflow credentials after execution of the OAuth 2 webflow.
getCredentialFactoryClass() - Method in interface com.google.cloud.dataflow.sdk.options.GcpOptions: The class of the credential factory that should be created and used to create credentials.
getCredentialId() - Method in interface com.google.cloud.dataflow.sdk.options.GcpOptions: This option controls which credential store to use when creating the credentials using the OAuth 2 webflow.
getCurrent() - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.DatastoreReader
getCurrent() - Method in interface com.google.cloud.dataflow.sdk.io.Source.Reader: Returns the value of the data item which was read by the last Source.Reader.start() or Source.Reader.advance() call.
getCurrent() - Method in class com.google.cloud.dataflow.sdk.runners.TransformHierarchy: Returns the last TransformTreeNode on the stack.
getCurrentOffset() - Method in class com.google.cloud.dataflow.sdk.io.ByteOffsetBasedSource.ByteOffsetBasedReader: Returns the current offset of the reader.
getDataflowClient() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions: An instance of the Dataflow client.
getDataflowClient() - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineJob
getDataflowEndpoint() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions: Dataflow endpoint to use.
getDataflowJobFile() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions: The path to write the translated Dataflow job specification out to at job submission time.
getDefaultCoder(TypeToken<T>) - Method in class com.google.cloud.dataflow.sdk.coders.CoderRegistry: Returns the Coder to use by default for values of the given type, or null if there is no default Coder.
getDefaultCoder(TypeToken<O>, TypeToken<I>, Coder<I>) - Method in class com.google.cloud.dataflow.sdk.coders.CoderRegistry: Returns the Coder to use by default for values of the given type, where the given context type uses the given context coder, or null if there is no default Coder.
getDefaultCoder(Class<? extends T>, Class<T>, Coder<?>...) - Method in class com.google.cloud.dataflow.sdk.coders.CoderRegistry: Returns the Coder to use for the last type parameter specialization of the subclass given Coders to use for all other type parameters specializations (if any).
getDefaultCoder(Class<? extends T>, Class<T>, Map<String, ? extends Coder<?>>, String) - Method in class com.google.cloud.dataflow.sdk.coders.CoderRegistry: Returns the Coder to use for the specified type parameter specialization of the subclass, given Coders to use for all other type parameters (if any).
getDefaultCoder(T) - Method in class com.google.cloud.dataflow.sdk.coders.CoderRegistry: Returns the Coder to use for the provided example value, if it can be determined, otherwise returns null.
getDefaultCoders(Class<? extends T>, Class<T>, Map<String, ? extends Coder<?>>) - Method in class com.google.cloud.dataflow.sdk.coders.CoderRegistry: Returns a Map from each of baseClass's type parameters to the Coder to use by default for it, in the context of subClass's specialization of baseClass.
getDefaultCoders(Class<? extends T>, Class<T>, Coder<?>[]) - Method in class com.google.cloud.dataflow.sdk.coders.CoderRegistry: Returns an array listing, for each of baseClass's type parameters, the Coder to use by default for it, in the context of subClass's specialization of baseClass.
getDefaultName() - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.Bound
getDefaultName() - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.BoundMulti
getDefaultName() - Method in class com.google.cloud.dataflow.sdk.transforms.PTransform: Returns the name to use by default for this PTransform (not including the names of any enclosing PTransforms).
getDefaultOutputCoder(SerializableFunction<I, O>, Coder<I>) - Method in class com.google.cloud.dataflow.sdk.coders.CoderRegistry: Returns the Coder to use on elements produced by this function, given the coder used for its input elements.
getDefaultOutputCoder() - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Read.Bound
getDefaultOutputCoder() - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound
getDefaultOutputCoder() - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Read.Bound
getDefaultOutputCoder() - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.Bound
getDefaultOutputCoder() - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.Sink
getDefaultOutputCoder() - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.Source
getDefaultOutputCoder() - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read.Bound
getDefaultOutputCoder() - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Write.Bound
getDefaultOutputCoder() - Method in class com.google.cloud.dataflow.sdk.io.ReadSource.Bound
getDefaultOutputCoder() - Method in class com.google.cloud.dataflow.sdk.io.Source: Returns the default Coder to use for the data read from this source.
getDefaultOutputCoder() - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Read.Bound
getDefaultOutputCoder() - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Write.Bound
getDefaultOutputCoder(CoderRegistry, Coder<Double>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineDoubleFn
getDefaultOutputCoder(CoderRegistry, Coder<V>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineFn
getDefaultOutputCoder(CoderRegistry, Coder<Integer>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineIntegerFn
getDefaultOutputCoder(CoderRegistry, Coder<Long>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineLongFn
getDefaultOutputCoder(CoderRegistry, Coder<VI>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.CombineFn: Returns the Coder to use by default for output VO values, or null if it is not able to be inferred.
getDefaultOutputCoder() - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.GroupedValues
getDefaultOutputCoder(CoderRegistry, Coder<K>, Coder<VI>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.KeyedCombineFn: Returns the Coder to use by default for output VO values, or null if it is not able to be inferred.
getDefaultOutputCoder() - Method in class com.google.cloud.dataflow.sdk.transforms.Create
getDefaultOutputCoder() - Method in class com.google.cloud.dataflow.sdk.transforms.Flatten.FlattenPCollectionList
getDefaultOutputCoder() - Method in class com.google.cloud.dataflow.sdk.transforms.GroupByKey.GroupByKeyOnly
getDefaultOutputCoder() - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.Bound
getDefaultOutputCoder() - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.BoundMulti
getDefaultOutputCoder() - Method in class com.google.cloud.dataflow.sdk.transforms.PTransform: Returns the default Coder to use for the output of this single-output PTransform, or null if none can be inferred.
getDefaultOutputCoder(TypedPValue<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.PTransform: Returns the default Coder to use for the given output of this single-output PTransform, or null if none can be inferred.
getDefaultOutputCoder(CoderRegistry, Coder<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.Sample.FixedSizedSampleFn
getDefaultOutputCoder() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window.Bound
getDefaultWorkerLogLevel() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowWorkerLoggingOptions: This option controls the default log level of all loggers without a log level override.
getDiskSizeGb() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions: Remote worker disk size, in gigabytes, or 0 to use the default size.
getDiskSourceImage() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions: Disk source image to use by VMs for jobs.
getDropLateData() - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read.Bound
getDropLateDataExplicit() - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read.Bound
getElemCoder() - Method in class com.google.cloud.dataflow.sdk.coders.IterableLikeCoder
getElements() - Method in class com.google.cloud.dataflow.sdk.transforms.Create
getEnclosingNode() - Method in class com.google.cloud.dataflow.sdk.runners.TransformTreeNode: Returns the enclosing composite transform node, or null if there is none.
getEncodedElementByteSize(Integer, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.BigEndianIntegerCoder
getEncodedElementByteSize(Long, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.BigEndianLongCoder
getEncodedElementByteSize(byte[], Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.ByteArrayCoder
getEncodedElementByteSize(Double, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.DoubleCoder
getEncodedElementByteSize(DatastoreV1.Entity, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.EntityCoder
getEncodedElementByteSize(T, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.StandardCoder: Returns the size in bytes of the encoded value using this coder.
getEncodedElementByteSize(String, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.StringUtf8Coder
getEncodedElementByteSize(TableRow, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.TableRowJsonCoder
getEncodedElementByteSize(Integer, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.TextualIntegerCoder
getEncodedElementByteSize(Integer, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.VarIntCoder
getEncodedElementByteSize(Long, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.VarLongCoder
getEncodedElementByteSize(Void, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.VoidCoder
getEndOffset() - Method in class com.google.cloud.dataflow.sdk.io.ByteOffsetBasedSource: Returns the specified ending offset of the source.
getEstimatedSizeBytes(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.Source
getEstimatedSizeBytes(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSource
getEstimatedSizeBytes(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.Source: An estimate of the total size (in bytes) of the data that would be read from this source.
getExecutorService() - Method in interface com.google.cloud.dataflow.sdk.options.GcsOptions: The ExecutorService instance to use to create threads, can be overridden to specify an ExecutorService which is compatible with the users environment.
getExpandedOutputs() - Method in class com.google.cloud.dataflow.sdk.runners.TransformTreeNode: Returns the transform outputs, in expanded form.
getExperiments() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions: The list of backend experiments to enable.
getFilenamePrefix() - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound
getFilenamePrefix() - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Write.Bound
getFilenameSuffix() - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound
getFilenameSuffix() - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Write.Bound
getFileOrPatternSpec() - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSource
getFilepattern() - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Read.Bound
getFilepattern() - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Read.Bound
getFilesToStage() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions: List of local files to make available to workers.
getFixedSizeCoder(Duration) - Static method in class com.google.cloud.dataflow.sdk.transforms.windowing.IntervalWindow: Returns a Coder for encoding interval windows of fixed size (which is more efficient than IntervalWindow.getCoder() as it only needs to encode one endpoint).
getFn() - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.GroupedValues: Returns the KeyedCombineFn used by this Combine operation.
getFn() - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.PerKey: Returns the KeyedCombineFn used by this Combine operation.
getFn() - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.Bound
getFn() - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.BoundMulti
getFullName(PTransform<?, ?>) - Method in class com.google.cloud.dataflow.sdk.Pipeline: Returns the fully qualified name of a transform.
getFullName() - Method in class com.google.cloud.dataflow.sdk.runners.TransformTreeNode
getGCloudPath() - Method in interface com.google.cloud.dataflow.sdk.options.GcpOptions
getGcpCredential() - Method in interface com.google.cloud.dataflow.sdk.options.GcpOptions: The credential instance that should be used to authenticate against GCP services.
getGcsUtil() - Method in interface com.google.cloud.dataflow.sdk.options.GcsOptions: The GcsUtil instance that should be used to communicate with Google Cloud Storage.
getGoogleApiTrace() - Method in interface com.google.cloud.dataflow.sdk.options.GoogleApiDebugOptions: This option enables tracing of API calls to Google services used within the Dataflow SDK.
getId() - Method in class com.google.cloud.dataflow.sdk.values.TupleTag: Returns the id of this TupleTag.
getIdLabel() - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read.Bound
getIdLabel() - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Write.Bound
getIndex(TupleTag<?>) - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResultSchema: Returns the index for the given tuple tag, if the tag is present in this schema, -1 if it isn't.
getInput(PTransform<?, ?>) - Method in class com.google.cloud.dataflow.sdk.Pipeline: Returns the input associated with a transform.
getInput() - Method in class com.google.cloud.dataflow.sdk.runners.TransformTreeNode: Returns the transform input, in unexpanded form.
getInput() - Method in class com.google.cloud.dataflow.sdk.transforms.PTransform: Returns the input of this transform.
getInputs() - Method in class com.google.cloud.dataflow.sdk.runners.TransformTreeNode: Returns a mapping of inputs to the producing nodes for all inputs to the transform.
getInstanceComponents(T) - Static method in class com.google.cloud.dataflow.sdk.coders.AtomicCoder: Returns a list of values contained in the provided example value, one per type parameter.
getInstanceComponents(Object) - Method in class com.google.cloud.dataflow.sdk.coders.CoderRegistry.CoderFactory: Returns a list of objects contained in value, one per type argument, or null if none can be determined.
getInstanceComponents(Object) - Method in class com.google.cloud.dataflow.sdk.coders.CoderRegistry.ConstantCoderFactory
getInstanceComponents(Collection<T>) - Static method in class com.google.cloud.dataflow.sdk.coders.CollectionCoder: Returns the first element in this collection if it is non-empty, otherwise returns null.
getInstanceComponents(Iterable<T>) - Static method in class com.google.cloud.dataflow.sdk.coders.IterableCoder: Returns the first element in this iterable if it is non-empty, otherwise returns null.
getInstanceComponents(KV<K, V>) - Static method in class com.google.cloud.dataflow.sdk.coders.KvCoder
getInstanceComponents(List<T>) - Static method in class com.google.cloud.dataflow.sdk.coders.ListCoder: Returns the first element in this list if it is non-empty, otherwise returns null.
getInstanceComponents(Map<K, V>) - Static method in class com.google.cloud.dataflow.sdk.coders.MapCoder: Returns the key and value for an arbitrary element of this map, if it is non-empty, otherwise returns null.
getInstanceComponents(Set<T>) - Static method in class com.google.cloud.dataflow.sdk.coders.SetCoder: Returns the first element in this set if it is non-empty, otherwise returns null.
getInstanceComponents(TimestampedValue<T>) - Static method in class com.google.cloud.dataflow.sdk.values.TimestampedValue.TimestampedValueCoder
getInstanceComponentsHelper(IT) - Static method in class com.google.cloud.dataflow.sdk.coders.IterableLikeCoder: Returns the first element in this iterable-like if it is non-empty, otherwise returns null.
getJobId() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowWorkerHarnessOptions: The identity of the Dataflow job.
getJobId() - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineJob
getJobMessageOutput() - Method in interface com.google.cloud.dataflow.sdk.options.BlockingDataflowPipelineOptions: Output stream for job status messages.
getJobName() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineOptions: The Dataflow job name is used as an idempotence key within the Dataflow service.
getJobState() - Method in class com.google.cloud.dataflow.sdk.runners.BlockingDataflowPipelineRunner.PipelineJobState
getKey() - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.ValueWithMetadata: Returns the key associated with this element.
getKey() - Method in class com.google.cloud.dataflow.sdk.values.KV: Returns the key of this KV.
getKeyCoder() - Method in class com.google.cloud.dataflow.sdk.coders.KvCoder
getKeyCoder() - Method in class com.google.cloud.dataflow.sdk.coders.MapCoder
getKeyCoder() - Method in class com.google.cloud.dataflow.sdk.transforms.join.KeyedPCollectionTuple: Returns the KeyCoder for all PCollections in this KeyedPCollections.
getKeyedCollections() - Method in class com.google.cloud.dataflow.sdk.transforms.join.KeyedPCollectionTuple: Returns a list of TaggedKeyedPCollections for the PCollections contained in this KeyedPCollections<K>.
getKindString() - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Read.Bound
getKindString() - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound
getKindString() - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Read.Bound
getKindString() - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.Bound
getKindString() - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.Sink
getKindString() - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read.Bound
getKindString() - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Write.Bound
getKindString() - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Read.Bound
getKindString() - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Write.Bound
getKindString() - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.Globally
getKindString() - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.GloballyAsSingletonView
getKindString() - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.PerKey
getKindString() - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.PerKeyWithHotKeys
getKindString() - Method in class com.google.cloud.dataflow.sdk.transforms.Count.PerElement
getKindString() - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.Bound
getKindString() - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.BoundMulti
getKindString() - Method in class com.google.cloud.dataflow.sdk.transforms.PTransform: Returns a string describing what kind of PTransform this is.
getKindString() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window.Bound
getKindString() - Method in class com.google.cloud.dataflow.sdk.values.PValueBase: Returns a String capturing the kind of this PValueBase.
getLevel() - Method in class com.google.cloud.dataflow.sdk.options.DataflowWorkerLoggingOptions.WorkerLogLevelOverride
getMainOutputTag() - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.BoundMulti
getMaxEndOffset(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.ByteOffsetBasedSource: Returns the exact ending offset of the current source.
getMaxEndOffset(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSource
getMaxNumWorkers() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions: The maximum number of workers to use when using workerpool autoscaling.
getMessage() - Method in class com.google.cloud.dataflow.sdk.coders.Coder.NonDeterministicException
getMinBundleSize() - Method in class com.google.cloud.dataflow.sdk.io.ByteOffsetBasedSource: Returns the minimum bundle size that should be used when splitting the source into sub-sources.
getMode() - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSource
getName() - Method in class com.google.cloud.dataflow.sdk.options.DataflowWorkerLoggingOptions.WorkerLogLevelOverride
getName() - Method in class com.google.cloud.dataflow.sdk.transforms.PTransform: Returns the transform name.
getName() - Method in class com.google.cloud.dataflow.sdk.values.PCollection: Returns the name of this PCollection.
getName() - Method in interface com.google.cloud.dataflow.sdk.values.PValue
getName() - Method in class com.google.cloud.dataflow.sdk.values.PValueBase: Returns the name of this PValueBase.
getNode(PTransform<?, ?>) - Method in class com.google.cloud.dataflow.sdk.runners.TransformHierarchy: Returns the TransformTreeNode associated with a given transform.
getNumShards() - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound
getNumShards() - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Write.Bound
getNumWorkers() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions: Number of workers to use when executing the Dataflow job.
getOnly(TupleTag<V>) - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult: If there is a singleton value for the given tag, returns it.
getOnly(TupleTag<V>, V) - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult: If there is a singleton value for the given tag, returns it.
getOptions() - Method in class com.google.cloud.dataflow.sdk.Pipeline: Returns the configured pipeline options.
getOriginalWindowFn() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.InvalidWindows: Returns the original windowFn that this InvalidWindows replaced.
getOutName(int) - Method in class com.google.cloud.dataflow.sdk.values.TupleTag: If this TupleTag is tagging output outputIndex of a PTransform, returns the name that should be used by default for the output.
getOutput(PTransform<?, ?>) - Method in class com.google.cloud.dataflow.sdk.Pipeline: Returns the output associated with a transform.
getOutput() - Method in class com.google.cloud.dataflow.sdk.runners.TransformTreeNode: Returns the transform output, in unexpanded form.
getOutput() - Method in class com.google.cloud.dataflow.sdk.transforms.PTransform: Returns the output of this transform.
getPathValidator() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions: The path validator instance that should be created and used to validate paths.
getPathValidatorClass() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions: The class of the validator that should be created and used to validate paths.
getPCollection(PCollection<T>) - Method in interface com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.EvaluationResults: Retrieves the value of the given PCollection.
getPCollectionList(PCollectionList<T>) - Method in interface com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.EvaluationResults: Retrieves the values of each PCollection in the given PCollectionList.
getPCollectionValuesWithMetadata(PCollection<T>) - Method in interface com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.EvaluationContext: Retrieves the value of the given PCollection, along with element metadata such as timestamps and windows.
getPCollectionView(PCollectionView<T>) - Method in interface com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.EvaluationResults: Retrieves the values indicated by the given PCollectionView.
getPCollectionWindowedValues(PCollection<T>) - Method in interface com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.EvaluationResults: Retrieves the windowed value of the given PCollection.
getPipeline() - Method in class com.google.cloud.dataflow.sdk.transforms.join.KeyedPCollectionTuple
getPipeline() - Method in class com.google.cloud.dataflow.sdk.transforms.PTransform: Deprecated.
getPipeline() - Method in class com.google.cloud.dataflow.sdk.values.PBegin
getPipeline() - Method in class com.google.cloud.dataflow.sdk.values.PCollectionList
getPipeline() - Method in class com.google.cloud.dataflow.sdk.values.PCollectionTuple
getPipeline() - Method in interface com.google.cloud.dataflow.sdk.values.PInput: Returns the owning Pipeline of this PInput.
getPipeline() - Method in class com.google.cloud.dataflow.sdk.values.PValueBase: Returns the owning Pipeline of this PValueBase.
getPipelineOptions() - Method in interface com.google.cloud.dataflow.sdk.options.PipelineOptionsRegistrar
getPipelineOptions() - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineRegistrar.Options
getPipelineOptions() - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Returns the configured pipeline options.
getPipelineOptions() - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRegistrar.Options
getPipelineOptions() - Method in interface com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.EvaluationContext: Returns the configured pipeline options.
getPipelineOptions() - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner
getPipelineOptions() - Method in class com.google.cloud.dataflow.sdk.transforms.DoFn.Context: Returns the PipelineOptions specified with the PipelineRunner invoking this DoFn.
getPipelineRunners() - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineRegistrar.Runner
getPipelineRunners() - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRegistrar.Runner
getPipelineRunners() - Method in interface com.google.cloud.dataflow.sdk.runners.PipelineRunnerRegistrar
getProducingTransformInternal() - Method in class com.google.cloud.dataflow.sdk.values.POutputValueBase: Returns the PTransform that this POutputValueBase is an output of.
getProducingTransformInternal() - Method in interface com.google.cloud.dataflow.sdk.values.PValue: Returns the PTransform that this PValue is an output of.
getProject() - Method in interface com.google.cloud.dataflow.sdk.options.GcpOptions: Project id to use when launching jobs.
getProjectId() - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineJob
getReasons() - Method in class com.google.cloud.dataflow.sdk.coders.Coder.NonDeterministicException
getRecordType() - Method in class com.google.cloud.dataflow.sdk.coders.SerializableCoder
getRegisteredOptions() - Static method in class com.google.cloud.dataflow.sdk.options.PipelineOptionsFactory
getRunner() - Method in interface com.google.cloud.dataflow.sdk.options.PipelineOptions
getRunner() - Method in class com.google.cloud.dataflow.sdk.Pipeline: Returns the configured pipeline runner.
getRunner() - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipeline
getRunner() - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipeline
getSchema() - Method in class com.google.cloud.dataflow.sdk.coders.AvroCoder: Returns the schema used by this coder.
getSchema() - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Read.Bound
getSchema() - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound
getSchema() - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.Bound: Returns the table schema.
getSchema() - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult: Returns the schema used by this CoGbkResult.
getSecretsFile() - Method in interface com.google.cloud.dataflow.sdk.options.GcpOptions: This option controls which file to use when attempting to create the credentials using the OAuth 2 webflow.
getServiceAccountKeyfile() - Method in interface com.google.cloud.dataflow.sdk.options.GcpOptions: This option controls which file to use when attempting to create the credentials using the service account method.
getServiceAccountName() - Method in interface com.google.cloud.dataflow.sdk.options.GcpOptions: This option controls which service account to use when attempting to create the credentials using the service account method.
getShardNameTemplate() - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound: Returns the current shard name template string.
getShardNameTemplate() - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Write.Bound: Returns the current shard name template string.
getShardTemplate() - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound
getShardTemplate() - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Write.Bound
getSideInputs() - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.Bound
getSideInputs() - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.BoundMulti
getSideInputWindow(BoundedWindow) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.GlobalWindows
getSideInputWindow(BoundedWindow) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.WindowFn: Returns the window of the side input corresponding to the given window of the main input.
getSource() - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSource.FileBasedReader
getSource() - Method in class com.google.cloud.dataflow.sdk.io.ReadSource.Bound: Returns the Source used to create this ReadSource PTransform.
getStager() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions: The resource stager instance that should be created and used to stage resources.
getStagerClass() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions: The class responsible for staging resources to be accessible by workers during job execution.
getStagingLocation() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineOptions: GCS path for staging local files, e.g.
getStartOffset() - Method in class com.google.cloud.dataflow.sdk.io.ByteOffsetBasedSource: Returns the starting offset of the source.
getStepName(PTransform<?, ?>) - Method in interface com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.EvaluationContext: Gets the step name for this transform.
getSubscription() - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read.Bound
getTable() - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Read.Bound: Returns the table to write.
getTable() - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.Bound: Returns the table reference.
getTag(int) - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResultSchema: Returns the JoinTupleTag at the given index.
getTagInternal() - Method in interface com.google.cloud.dataflow.sdk.values.PCollectionView: A unique identifier, for internal use.
getTeardownPolicy() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions: The teardown policy for the VMs.
getTeardownPolicyName() - Method in enum com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions.TeardownPolicy
getTempDatasetId() - Method in interface com.google.cloud.dataflow.sdk.options.BigQueryOptions
getTempLocation() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineOptions: GCS path for temporary files, e.g.
getTimestamp() - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.ValueWithMetadata: Returns the timestamp associated with this element.
getTimestamp() - Method in class com.google.cloud.dataflow.sdk.values.TimestampedValue
getTimestampLabel() - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read.Bound
getTimestampLabel() - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Write.Bound
getTopic() - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read.Bound
getTopic() - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Write.Bound
getTransform() - Method in class com.google.cloud.dataflow.sdk.runners.TransformTreeNode: Returns the transform associated with this transform node.
getTransformEvaluator(Class<PT>) - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner: Returns the TransformEvaluator to use for instances of the specified PTransform class, or null if none registered.
getTransformTranslator(Class<PT>) - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator: Returns the TransformTranslator to use for instances of the specified PTransform class, or null if none registered.
getTranslator() - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineRunner: Returns the DataflowPipelineTranslator associated with this object.
getTupleTag() - Method in class com.google.cloud.dataflow.sdk.transforms.join.KeyedPCollectionTuple.TaggedKeyedPCollection: Returns the TupleTag of this TaggedKeyedPCollection.
getTupleTagList() - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResultSchema: Returns the TupleTagList tuple associated with this schema.
getType() - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound
getTypeToken() - Method in class com.google.cloud.dataflow.sdk.values.TupleTag: Returns a TypeToken capturing what is known statically about the type of this TupleTag instance's most-derived class.
getTypeToken() - Method in class com.google.cloud.dataflow.sdk.values.TypedPValue: Returns a TypeToken<T> with some reflective information about T, if possible.
getUnionTag() - Method in class com.google.cloud.dataflow.sdk.transforms.join.RawUnionValue
getValidate() - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Read.Bound: Returns true if table validation is enabled.
getValidate() - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.Bound: Returns true if table validation is enabled.
getValue() - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.ValueWithMetadata: Returns the value associated with this element.
getValue() - Method in class com.google.cloud.dataflow.sdk.transforms.join.RawUnionValue
getValue() - Method in class com.google.cloud.dataflow.sdk.values.KV: Returns the value of this KV.
getValue() - Method in class com.google.cloud.dataflow.sdk.values.TimestampedValue
getValueCoder() - Method in class com.google.cloud.dataflow.sdk.coders.KvCoder
getValueCoder() - Method in class com.google.cloud.dataflow.sdk.coders.MapCoder
getVersion() - Method in class com.google.cloud.dataflow.sdk.options.CloudDebuggerOptions.DebuggerConfig
getWindowedValue() - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.ValueWithMetadata: Returns the WindowedValue associated with this element.
getWindowFn() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window.Bound: Returns the user-specified WindowFn.
getWindowFn() - Method in class com.google.cloud.dataflow.sdk.values.PCollection: Returns the WindowFn of this PCollection.
getWindowFnInternal() - Method in interface com.google.cloud.dataflow.sdk.values.PCollectionView: For internal use only.
getWindows() - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.ValueWithMetadata: Returns the collection of windows this element has been placed into.
getWorkerDiskType() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions: Specifies what type of persistent disk should be used.
getWorkerId() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowWorkerHarnessOptions: The identity of the worker running this pipeline.
getWorkerLogLevelOverrides() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowWorkerLoggingOptions: This option controls the log levels for specifically named loggers.
getWorkerMachineType() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions: Machine type to create Dataflow worker VMs as.
getWorkerPoolType() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions: Specifies what type of worker pool should be used.
getWriteDisposition() - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.Bound: Returns the write disposition.
getZone() - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions: GCE availability zone for launching workers.
globally(int, C) - Static method in class com.google.cloud.dataflow.sdk.transforms.ApproximateQuantiles: Returns a PTransform that takes a PCollection<T> and returns a PCollection<List<T>> whose single value is a List of the approximate N-tiles of the elements of the input PCollection.
globally(int) - Static method in class com.google.cloud.dataflow.sdk.transforms.ApproximateQuantiles: Like ApproximateQuantiles.globally(int, Comparator), but sorts using the elements' natural ordering.
globally(int) - Static method in class com.google.cloud.dataflow.sdk.transforms.ApproximateUnique: Returns a PTransform that takes a PCollection<T> and returns a PCollection<Long> containing a single value that is an estimate of the number of distinct elements in the input PCollection.
globally(double) - Static method in class com.google.cloud.dataflow.sdk.transforms.ApproximateUnique: Like ApproximateUnique.globally(int), but specifies the desired maximum estimation error instead of the sample size.
globally(SerializableFunction<Iterable<V>, V>) - Static method in class com.google.cloud.dataflow.sdk.transforms.Combine: Returns a Combine.Globally PTransform that uses the given SerializableFunction to combine all the elements in each window of the input PCollection into a single value in the output PCollection.
globally(Combine.CombineFn<? super VI, ?, VO>) - Static method in class com.google.cloud.dataflow.sdk.transforms.Combine: Returns a Combine.Globally PTransform that uses the given SerializableFunction to combine all the elements in each window of the input PCollection into a single value in the output PCollection.
globally() - Static method in class com.google.cloud.dataflow.sdk.transforms.Count: Returns a Count.Globally PTransform that counts the number of elements in its input PCollection.
globally() - Static method in class com.google.cloud.dataflow.sdk.transforms.Mean: Returns a PTransform that takes an input PCollection<N> and returns a PCollection<Double> whose contents is the mean of the input PCollection's elements, or 0 if there are no elements.
GlobalWindow - Class in com.google.cloud.dataflow.sdk.transforms.windowing: The default window into which all data is placed (via GlobalWindows).
GlobalWindow.Coder - Class in com.google.cloud.dataflow.sdk.transforms.windowing: Coder for encoding and decoding Windows.
GlobalWindows - Class in com.google.cloud.dataflow.sdk.transforms.windowing: Default WindowFn where all data is in the same window.
GlobalWindows() - Constructor for class com.google.cloud.dataflow.sdk.transforms.windowing.GlobalWindows
GoogleApiDebugOptions - Interface in com.google.cloud.dataflow.sdk.options: These options configure debug settings for Google API clients created within the Dataflow SDK.
GoogleApiDebugOptions.GoogleApiTracer - Class in com.google.cloud.dataflow.sdk.options: A GoogleClientRequestInitializer which adds the 'trace' token to Google API calls.
greaterThan(T) - Static method in class com.google.cloud.dataflow.sdk.transforms.Filter: Returns a PTransform that takes an input PCollection<T> and returns a PCollection<T> with elements that are greater than a given value, based on the elements' natural ordering.
greaterThanEq(T) - Static method in class com.google.cloud.dataflow.sdk.transforms.Filter: Returns a PTransform that takes an input PCollection<T> and returns a PCollection<T> with elements that are greater than or equal to a given value, based on the elements' natural ordering.
GroupByKey<K,V> - Class in com.google.cloud.dataflow.sdk.transforms: GroupByKey<K, V> takes a PCollection<KV<K, V>>, groups the values by key and windows, and returns a PCollection<KV<K, Iterable<V>>> representing a map from each distinct key and window of the input PCollection to an Iterable over all the values associated with that key in the input.
GroupByKey() - Constructor for class com.google.cloud.dataflow.sdk.transforms.GroupByKey
GroupByKey.GroupAlsoByWindow<K,V> - Class in com.google.cloud.dataflow.sdk.transforms: Helper transform that takes a collection of timestamp-ordered values associated with each key, groups the values by window, combines windows as needed, and for each window in each key, outputs a collection of key/value-list pairs implicitly assigned to the window and with the timestamp derived from that window.
GroupByKey.GroupAlsoByWindow(WindowFn<?, ?>) - Constructor for class com.google.cloud.dataflow.sdk.transforms.GroupByKey.GroupAlsoByWindow
GroupByKey.GroupByKeyOnly<K,V> - Class in com.google.cloud.dataflow.sdk.transforms: Primitive helper transform that groups by key only, ignoring any window assignments.
GroupByKey.GroupByKeyOnly() - Constructor for class com.google.cloud.dataflow.sdk.transforms.GroupByKey.GroupByKeyOnly
GroupByKey.ReifyTimestampsAndWindows<K,V> - Class in com.google.cloud.dataflow.sdk.transforms: Helper transform that makes timestamps and window assignments explicit in the value part of each key/value pair.
GroupByKey.ReifyTimestampsAndWindows() - Constructor for class com.google.cloud.dataflow.sdk.transforms.GroupByKey.ReifyTimestampsAndWindows
GroupByKey.SortValuesByTimestamp<K,V> - Class in com.google.cloud.dataflow.sdk.transforms: Helper transform that sorts the values associated with each key by timestamp.
GroupByKey.SortValuesByTimestamp() - Constructor for class com.google.cloud.dataflow.sdk.transforms.GroupByKey.SortValuesByTimestamp
groupedValues(SerializableFunction<Iterable<V>, V>) - Static method in class com.google.cloud.dataflow.sdk.transforms.Combine: Returns a Combine.GroupedValues PTransform that takes a PCollection of KVs where a key maps to an Iterable of values, e.g., the result of a GroupByKey, then uses the given SerializableFunction to combine all the values associated with a key, ignoring the key.
groupedValues(Combine.CombineFn<? super VI, ?, VO>) - Static method in class com.google.cloud.dataflow.sdk.transforms.Combine: Returns a Combine.GroupedValues PTransform that takes a PCollection of KVs where a key maps to an Iterable of values, e.g., the result of a GroupByKey, then uses the given CombineFn to combine all the values associated with a key, ignoring the key.
groupedValues(Combine.KeyedCombineFn<? super K, ? super VI, ?, VO>) - Static method in class com.google.cloud.dataflow.sdk.transforms.Combine: Returns a Combine.GroupedValues PTransform that takes a PCollection of KVs where a key maps to an Iterable of values, e.g., the result of a GroupByKey, then uses the given KeyedCombineFn to combine all the values associated with each key.

H

has(TupleTag<T>) - Method in class com.google.cloud.dataflow.sdk.values.PCollectionTuple: Returns whether this PCollectionTuple contains a PCollection with the given tag.
hashCode() - Method in class com.google.cloud.dataflow.sdk.coders.StandardCoder
hashCode() - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResultSchema
hashCode() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.IntervalWindow
hashCode() - Method in class com.google.cloud.dataflow.sdk.values.KV
hashCode() - Method in class com.google.cloud.dataflow.sdk.values.TupleTag
Hidden - Annotation Type in com.google.cloud.dataflow.sdk.options: Methods and/or interfaces annotated with @Hidden will be suppressed from being output when --help is specified on the command-line.

I

identity() - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineDoubleFn: Returns the identity element of this operation, i.e.
identity() - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineFn: Returns the value that should be used for the combine of the empty set.
identity() - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineIntegerFn: Returns the identity element of this operation, i.e.
identity() - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineLongFn: Returns the identity element of this operation, i.e.
identity() - Method in class com.google.cloud.dataflow.sdk.transforms.Max.MaxFn
identity() - Method in class com.google.cloud.dataflow.sdk.transforms.Min.MinFn
identity() - Method in class com.google.cloud.dataflow.sdk.transforms.Sum.SumDoubleFn
identity() - Method in class com.google.cloud.dataflow.sdk.transforms.Sum.SumIntegerFn
identity() - Method in class com.google.cloud.dataflow.sdk.transforms.Sum.SumLongFn
idLabel(String) - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read.Bound: Returns a new PubsubIO.Read PTransform that's like this one but reading unique ids from the given PubSub label.
idLabel(String) - Static method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read: Creates and returns a PubSubIO.Read PTransform where unique record identifiers are expected to be provided using the PubSub labeling API.
idLabel(String) - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Write.Bound: Returns a new PubsubIO.Write PTransform that's like this one but publishing record ids to the given PubSub label.
idLabel(String) - Static method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Write: If specified, Dataflow will add a Pubsub label to each output record containing a unique identifier for that record.
in(Pipeline) - Static method in class com.google.cloud.dataflow.sdk.values.PBegin: Returns a PBegin in the given Pipeline.
INDEX_OF_MAX - Static variable in class com.google.cloud.dataflow.sdk.io.ShardNameTemplate: Shard name containing the index and max.
initialize(AbstractGoogleClientRequest<?>) - Method in class com.google.cloud.dataflow.sdk.options.GoogleApiDebugOptions.GoogleApiTracer
INSTANCE - Static variable in class com.google.cloud.dataflow.sdk.transforms.windowing.GlobalWindow.Coder
INSTANCE - Static variable in class com.google.cloud.dataflow.sdk.transforms.windowing.GlobalWindow
InstantCoder - Class in com.google.cloud.dataflow.sdk.coders: A InstantCoder encodes joda Instant.
integersGlobally() - Static method in class com.google.cloud.dataflow.sdk.transforms.Max: Returns a PTransform that takes an input PCollection<Integer> and returns a PCollection<Integer> whose contents is the maximum of the input PCollection's elements, or Integer.MIN_VALUE if there are no elements.
integersGlobally() - Static method in class com.google.cloud.dataflow.sdk.transforms.Min: Returns a PTransform that takes an input PCollection<Integer> and returns a PCollection<Integer> whose contents is a single value that is the minimum of the input PCollection's elements, or Integer.MAX_VALUE if there are no elements.
integersGlobally() - Static method in class com.google.cloud.dataflow.sdk.transforms.Sum: Returns a PTransform that takes an input PCollection<Integer> and returns a PCollection<Integer> whose contents is the sum of the input PCollection's elements, or 0 if there are no elements.
integersPerKey() - Static method in class com.google.cloud.dataflow.sdk.transforms.Max: Returns a PTransform that takes an input PCollection<KV<K, Integer>> and returns a PCollection<KV<K, Integer>> that contains an output element mapping each distinct key in the input PCollection to the maximum of the values associated with that key in the input PCollection.
integersPerKey() - Static method in class com.google.cloud.dataflow.sdk.transforms.Min: Returns a PTransform that takes an input PCollection<KV<K, Integer>> and returns a PCollection<KV<K, Integer>> that contains an output element mapping each distinct key in the input PCollection to the minimum of the values associated with that key in the input PCollection.
integersPerKey() - Static method in class com.google.cloud.dataflow.sdk.transforms.Sum: Returns a PTransform that takes an input PCollection<KV<K, Integer>> and returns a PCollection<KV<K, Integer>> that contains an output element mapping each distinct key in the input PCollection to the sum of the values associated with that key in the input PCollection.
intersects(IntervalWindow) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.IntervalWindow: Returns whether this window intersects the given window.
IntervalWindow - Class in com.google.cloud.dataflow.sdk.transforms.windowing: An implementation of BoundedWindow that represents an interval from IntervalWindow.start (inclusive) to IntervalWindow.end (exclusive).
IntervalWindow(Instant, Instant) - Constructor for class com.google.cloud.dataflow.sdk.transforms.windowing.IntervalWindow: Creates a new IntervalWindow that represents the half-open time interval [start, end).
IntervalWindow(Instant, Duration) - Constructor for class com.google.cloud.dataflow.sdk.transforms.windowing.IntervalWindow
into(WindowFn<? super T, ?>) - Static method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window: Creates a Window PTransform that uses the given WindowFn to window the data.
into(WindowFn<? super T, ?>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window.Unbound: Returns a new Window PTransform that's like this transform but which will use the given WindowFn, and which has its input and output types bound.
InvalidWindows<W extends BoundedWindow> - Class in com.google.cloud.dataflow.sdk.transforms.windowing: A WindowFn that represents an invalid pipeline state.
InvalidWindows(String, WindowFn<?, W>) - Constructor for class com.google.cloud.dataflow.sdk.transforms.windowing.InvalidWindows
is(T) - Method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert.SingletonAssert: Deprecated.
isAtSplitPoint() - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSource.FileBasedReader: Specifies if the current record of the reader is at a split point.
isCompatible(WindowFn) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.DaysWindows
isCompatible(WindowFn) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.MonthsWindows
isCompatible(WindowFn) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.YearsWindows
isCompatible(WindowFn<?, ?>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.FixedWindows
isCompatible(WindowFn) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.GlobalWindows
isCompatible(WindowFn<?, ?>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.InvalidWindows: InvalidWindows objects with the same originalWindowFn are compatible.
isCompatible(WindowFn<?, ?>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Sessions
isCompatible(WindowFn<?, ?>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.SlidingWindows
isCompatible(WindowFn<?, ?>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.WindowFn: Returns whether this performs the same merging as the given WindowFn.
isCompositeNode() - Method in class com.google.cloud.dataflow.sdk.runners.TransformTreeNode: Returns true if this node represents a composite transform.
isDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.AvroCoder: Deprecated.
isDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.BigEndianIntegerCoder
isDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.BigEndianLongCoder
isDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.ByteArrayCoder
isDeterministic() - Method in interface com.google.cloud.dataflow.sdk.coders.Coder: Deprecated.
Coder.verifyDeterministic() should be used instead to produce explanations of why a given Coder is non-deterministic.
isDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.CustomCoder: Deprecated.
isDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.DelegateCoder: Deprecated.
isDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.DoubleCoder: Deprecated.
isDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.EntityCoder: Deprecated.
isDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.InstantCoder: Deprecated.
isDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.IterableLikeCoder: Deprecated.
isDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.KvCoder: Deprecated.
isDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.ListCoder: Deprecated.
isDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.MapCoder: Deprecated.
isDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.SerializableCoder: Deprecated.
isDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.SetCoder: Deprecated.
isDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.StringUtf8Coder: Deprecated.
isDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.TableRowJsonCoder: Deprecated.
isDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.TextualIntegerCoder: Deprecated.
isDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.VarIntCoder: Deprecated.
isDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.VarLongCoder: Deprecated.
isDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.VoidCoder: Deprecated.
isDeterministic() - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult.CoGbkResultCoder: Deprecated.
isDeterministic() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.GlobalWindow.Coder
isDeterministic() - Method in class com.google.cloud.dataflow.sdk.values.TimestampedValue.TimestampedValueCoder: Deprecated.
isDisjoint(IntervalWindow) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.IntervalWindow: Returns whether this window is disjoint from the given window.
isEmpty() - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult
isEmpty() - Method in class com.google.cloud.dataflow.sdk.transforms.join.KeyedPCollectionTuple
isEqualTo(T) - Method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert.SingletonAssert: Checks that the value of this SingletonAssert's view is equal to the expected value.
isFinishedSpecifyingInternal() - Method in class com.google.cloud.dataflow.sdk.values.PValueBase: Returns whether this PValueBase has been finalized, and its core properties, e.g., name, can no longer be changed.
isRegisterByteSizeObserverCheap(Integer, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.BigEndianIntegerCoder: Returns true since registerByteSizeObserver() runs in constant time.
isRegisterByteSizeObserverCheap(Long, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.BigEndianLongCoder: Returns true since registerByteSizeObserver() runs in constant time.
isRegisterByteSizeObserverCheap(byte[], Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.ByteArrayCoder: Returns true since registerByteSizeObserver() runs in constant time.
isRegisterByteSizeObserverCheap(T, Coder.Context) - Method in interface com.google.cloud.dataflow.sdk.coders.Coder: Returns whether Coder.registerByteSizeObserver(T, com.google.cloud.dataflow.sdk.util.common.ElementByteSizeObserver, com.google.cloud.dataflow.sdk.coders.Coder.Context) cheap enough to call for every element, that is, if this Coder can calculate the byte size of the element to be coded in roughly constant time (or lazily).
isRegisterByteSizeObserverCheap(Double, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.DoubleCoder: Returns true since registerByteSizeObserver() runs in constant time.
isRegisterByteSizeObserverCheap(IT, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.IterableLikeCoder: Returns whether iterable can use lazy counting, since that requires minimal extra computation.
isRegisterByteSizeObserverCheap(KV<K, V>, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.KvCoder: Returns whether both keyCoder and valueCoder are considered not expensive.
isRegisterByteSizeObserverCheap(T, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.StandardCoder: StandardCoder requires elements to be fully encoded and copied into a byte stream to determine the byte size of the element, which is considered expensive.
isRegisterByteSizeObserverCheap(Integer, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.VarIntCoder: Returns true since registerByteSizeObserver() runs in constant time.
isRegisterByteSizeObserverCheap(Long, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.VarLongCoder: Returns true since registerByteSizeObserver() runs in constant time.
isRegisterByteSizeObserverCheap(Void, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.VoidCoder: Returns true since registerByteSizeObserver() runs in constant time.
isStreaming() - Method in interface com.google.cloud.dataflow.sdk.options.StreamingOptions
isWholeStream - Variable in class com.google.cloud.dataflow.sdk.coders.Coder.Context: Whether the encoded or decoded value fills the remainder of the output or input (resp.) record/stream contents.
IterableCoder<T> - Class in com.google.cloud.dataflow.sdk.coders: An IterableCoder encodes Iterables.
IterableCoder(Coder<T>) - Constructor for class com.google.cloud.dataflow.sdk.coders.IterableCoder
IterableLikeCoder<T,IT extends java.lang.Iterable<T>> - Class in com.google.cloud.dataflow.sdk.coders: The base class of Coders for Iterable subclasses.
IterableLikeCoder(Coder<T>) - Constructor for class com.google.cloud.dataflow.sdk.coders.IterableLikeCoder
iterables() - Static method in class com.google.cloud.dataflow.sdk.transforms.Flatten: Returns a PTransform that takes a PCollection<Iterable<T>> and returns a PCollection<T> containing all the elements from all the Iterables.

J

jobToString(Job) - Static method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator

K

KeyedPCollectionTuple<K> - Class in com.google.cloud.dataflow.sdk.transforms.join: Represents an immutable tuple of keyed PCollections (i.e.
KeyedPCollectionTuple.TaggedKeyedPCollection<K,V> - Class in com.google.cloud.dataflow.sdk.transforms.join: A utility class to help ensure coherence of tag and input PCollection types.
KeyedPCollectionTuple.TaggedKeyedPCollection(TupleTag<V>, PCollection<KV<K, V>>) - Constructor for class com.google.cloud.dataflow.sdk.transforms.join.KeyedPCollectionTuple.TaggedKeyedPCollection
keyedState() - Method in class com.google.cloud.dataflow.sdk.transforms.DoFn.ProcessContext: Returns this DoFn's state associated with the input element's key.
Keys<K> - Class in com.google.cloud.dataflow.sdk.transforms: Keys<K> takes a PCollection of KV<K, V>s and returns a PCollection<K> of the keys.
KV<K,V> - Class in com.google.cloud.dataflow.sdk.values: An immutable key/value pair.
KV.OrderByKey<K extends java.lang.Comparable<? super K>,V> - Class in com.google.cloud.dataflow.sdk.values: Orders the KV by the key.
KV.OrderByKey() - Constructor for class com.google.cloud.dataflow.sdk.values.KV.OrderByKey
KV.OrderByValue<K,V extends java.lang.Comparable<? super V>> - Class in com.google.cloud.dataflow.sdk.values: Orders the KV by the value.
KV.OrderByValue() - Constructor for class com.google.cloud.dataflow.sdk.values.KV.OrderByValue
KvCoder<K,V> - Class in com.google.cloud.dataflow.sdk.coders: A KvCoder encodes KVs.
KvCoderBase<T> - Class in com.google.cloud.dataflow.sdk.coders: A abstract base class for KvCoder.
KvCoderBase() - Constructor for class com.google.cloud.dataflow.sdk.coders.KvCoderBase
KvSwap<A,B> - Class in com.google.cloud.dataflow.sdk.transforms: KvSwap<A, B> takes a PCollection<KV<A, B>> and returns a PCollection<KV<B, A>>, where all the keys and values have been swapped.

L

largest(int) - Static method in class com.google.cloud.dataflow.sdk.transforms.Top: Returns a PTransform that takes an input PCollection<T> and returns a PCollection<List<T>> with a single element containing the largest count elements of the input PCollection<T>, in decreasing order, sorted according to their natural order.
largestPerKey(int) - Static method in class com.google.cloud.dataflow.sdk.transforms.Top: Returns a PTransform that takes an input PCollection<KV<K, V>> and returns a PCollection<KV<K, List<V>>> that contains an output element mapping each distinct key in the input PCollection to the largest count values associated with that key in the input PCollection<KV<K, V>>, in decreasing order, sorted according to their natural order.
leaveCompositeTransform(TransformTreeNode) - Method in interface com.google.cloud.dataflow.sdk.Pipeline.PipelineVisitor
leaveCompositeTransform(TransformTreeNode) - Method in class com.google.cloud.dataflow.sdk.runners.RecordingPipelineVisitor
lessThan(T) - Static method in class com.google.cloud.dataflow.sdk.transforms.Filter: Returns a PTransform that takes an input PCollection<T> and returns a PCollection<T> with elements that are less than a given value, based on the elements' natural ordering.
lessThanEq(T) - Static method in class com.google.cloud.dataflow.sdk.transforms.Filter: Returns a PTransform that takes an input PCollection<T> and returns a PCollection<T> with elements that are less than or equal to a given value, based on the elements' natural ordering.
ListCoder<T> - Class in com.google.cloud.dataflow.sdk.coders: A ListCoder encodes Lists.
longsGlobally() - Static method in class com.google.cloud.dataflow.sdk.transforms.Max: Returns a PTransform that takes an input PCollection<Long> and returns a PCollection<Long> whose contents is the maximum of the input PCollection's elements, or Long.MIN_VALUE if there are no elements.
longsGlobally() - Static method in class com.google.cloud.dataflow.sdk.transforms.Min: Returns a PTransform that takes an input PCollection<Long> and returns a PCollection<Long> whose contents is the minimum of the input PCollection's elements, or Long.MAX_VALUE if there are no elements.
longsGlobally() - Static method in class com.google.cloud.dataflow.sdk.transforms.Sum: Returns a PTransform that takes an input PCollection<Long> and returns a PCollection<Long> whose contents is the sum of the input PCollection's elements, or 0 if there are no elements.
longsPerKey() - Static method in class com.google.cloud.dataflow.sdk.transforms.Max: Returns a PTransform that takes an input PCollection<KV<K, Long>> and returns a PCollection<KV<K, Long>> that contains an output element mapping each distinct key in the input PCollection to the maximum of the values associated with that key in the input PCollection.
longsPerKey() - Static method in class com.google.cloud.dataflow.sdk.transforms.Min: Returns a PTransform that takes an input PCollection<KV<K, Long>> and returns a PCollection<KV<K, Long>> that contains an output element mapping each distinct key in the input PCollection to the minimum of the values associated with that key in the input PCollection.
longsPerKey() - Static method in class com.google.cloud.dataflow.sdk.transforms.Sum: Returns a PTransform that takes an input PCollection<KV<K, Long>> and returns a PCollection<KV<K, Long>> that contains an output element mapping each distinct key in the input PCollection to the sum of the values associated with that key in the input PCollection.
lookup(CodedTupleTag<T>) - Method in interface com.google.cloud.dataflow.sdk.transforms.DoFn.KeyedState: Returns the value associated with the given tag in this KeyedState, or null if the tag has no asssociated value.
lookup(List<? extends CodedTupleTag<?>>) - Method in interface com.google.cloud.dataflow.sdk.transforms.DoFn.KeyedState: Returns a map from the given tags to the values associated with those tags in this KeyedState.

M

MapCoder<K,V> - Class in com.google.cloud.dataflow.sdk.coders: A MapCoder encodes Maps.
MapCoderBase<T> - Class in com.google.cloud.dataflow.sdk.coders: A abstract base class for MapCoder.
MapCoderBase() - Constructor for class com.google.cloud.dataflow.sdk.coders.MapCoderBase
matches(String) - Method in enum com.google.cloud.dataflow.sdk.io.TextIO.CompressionType: Determine if a given filename matches a compression type based on its extension.
Max - Class in com.google.cloud.dataflow.sdk.transforms: PTransforms for computing the maximum of the elements in a PCollection, or the maximum of the values associated with each key in a PCollection of KVs.
Max() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Max
Max.MaxDoubleFn - Class in com.google.cloud.dataflow.sdk.transforms: A CombineFn that computes the maximum of a collection of Doubles, useful as an argument to Combine.globally(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>) or Combine.perKey(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>).
Max.MaxDoubleFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Max.MaxDoubleFn
Max.MaxFn<N extends java.lang.Comparable<N>> - Class in com.google.cloud.dataflow.sdk.transforms: A CombineFn that computes the maximum of a set of elements of type N, useful as an argument to Combine.globally(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>) or Combine.perKey(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>).
Max.MaxFn(N) - Constructor for class com.google.cloud.dataflow.sdk.transforms.Max.MaxFn: Constructs a combining function that computes the maximum over a collection of values of type N, given the smallest value of type N, which is the identity value for the maximum operation over Ns.
Max.MaxIntegerFn - Class in com.google.cloud.dataflow.sdk.transforms: A CombineFn that computes the maximum of a collection of Integers, useful as an argument to Combine.globally(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>) or Combine.perKey(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>).
Max.MaxIntegerFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Max.MaxIntegerFn
Max.MaxLongFn - Class in com.google.cloud.dataflow.sdk.transforms: A CombineFn that computes the maximum of a collection of Longs, useful as an argument to Combine.globally(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>) or Combine.perKey(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>).
Max.MaxLongFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Max.MaxLongFn
maxTimestamp() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.BoundedWindow: Returns the upper bound of timestamps for values in this window.
maxTimestamp() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.GlobalWindow
maxTimestamp() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.IntervalWindow: Returns the largest timestamp that can be included in this window.
Mean - Class in com.google.cloud.dataflow.sdk.transforms: PTransforms for computing the arithmetic mean (a.k.a.
Mean() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Mean
Mean.MeanFn<N extends java.lang.Number> - Class in com.google.cloud.dataflow.sdk.transforms: A Combine.CombineFn that computes the arithmetic mean (a.k.a.
Mean.MeanFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Mean.MeanFn: Constructs a combining function that computes the mean over a collection of values of type N.
merge(Collection<W>, W) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.WindowFn.MergeContext: Signals to the framework that the windows in toBeMerged should be merged together to form mergeResult.
mergeAccumulator(VA) - Method in interface com.google.cloud.dataflow.sdk.transforms.Combine.AccumulatingCombineFn.Accumulator: Adds the input values represented by the given accumulator into this accumulator.
mergeAccumulators(Iterable<ApproximateUnique.ApproximateUniqueCombineFn.LargestUnique>) - Method in class com.google.cloud.dataflow.sdk.transforms.ApproximateUnique.ApproximateUniqueCombineFn
mergeAccumulators(Iterable<VA>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.AccumulatingCombineFn
mergeAccumulators(Iterable<double[]>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineDoubleFn
mergeAccumulators(Iterable<Combine.BinaryCombineFn.Holder<V>>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineFn
mergeAccumulators(Iterable<int[]>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineIntegerFn
mergeAccumulators(Iterable<long[]>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineLongFn
mergeAccumulators(Iterable<VA>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.CombineFn: Returns an accumulator representing the accumulation of all the input values accumulated in the merging accumulators.
mergeAccumulators(K, Iterable<VA>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.KeyedCombineFn: Returns an accumulator representing the accumulation of all the input values accumulated in the merging accumulators.
mergeAccumulators(Iterable<List<V>>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.SimpleCombineFn
mergeAccumulators(Iterable<Top.TopCombineFn<KV<Integer, T>>.Heap>) - Method in class com.google.cloud.dataflow.sdk.transforms.Sample.FixedSizedSampleFn
MergeOverlappingIntervalWindows - Class in com.google.cloud.dataflow.sdk.transforms.windowing: A WindowFn that merges overlapping IntervalWindows.
MergeOverlappingIntervalWindows() - Constructor for class com.google.cloud.dataflow.sdk.transforms.windowing.MergeOverlappingIntervalWindows
mergeWindows(WindowFn<Object, W>.MergeContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.InvalidWindows
mergeWindows(WindowFn<?, IntervalWindow>.MergeContext) - Static method in class com.google.cloud.dataflow.sdk.transforms.windowing.MergeOverlappingIntervalWindows: Merge overlapping intervals.
mergeWindows(WindowFn<T, W>.MergeContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.NonMergingWindowFn
mergeWindows(WindowFn<Object, IntervalWindow>.MergeContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Sessions
mergeWindows(WindowFn<T, W>.MergeContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.WindowFn: Does whatever merging of windows is necessary.
Min - Class in com.google.cloud.dataflow.sdk.transforms: PTransforms for computing the minimum of the elements in a PCollection, or the minimum of the values associated with each key in a PCollection of KVs.
Min() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Min
Min.MinDoubleFn - Class in com.google.cloud.dataflow.sdk.transforms: A CombineFn that computes the minimum of a collection of Doubles, useful as an argument to Combine.globally(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>) or Combine.perKey(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>).
Min.MinDoubleFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Min.MinDoubleFn
Min.MinFn<N extends java.lang.Comparable<N>> - Class in com.google.cloud.dataflow.sdk.transforms: A CombineFn that computes the minimum of a collection of elements of type N, useful as an argument to Combine.globally(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>) or Combine.perKey(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>).
Min.MinFn(N) - Constructor for class com.google.cloud.dataflow.sdk.transforms.Min.MinFn: Constructs a combining function that computes the minimum over a collection of values of type N, given the largest value of type N, which is the identity value for the minimum operation over Ns.
Min.MinIntegerFn - Class in com.google.cloud.dataflow.sdk.transforms: A CombineFn that computes the minimum of a collection of Integers, useful as an argument to Combine.globally(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>) or Combine.perKey(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>).
Min.MinIntegerFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Min.MinIntegerFn
Min.MinLongFn - Class in com.google.cloud.dataflow.sdk.transforms: A CombineFn that computes the minimum of a collection of Longs, useful as an argument to Combine.globally(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>) or Combine.perKey(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>).
Min.MinLongFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Min.MinLongFn
modifyEnvironmentBeforeSubmission(Environment) - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineRunnerHooks: Allows the user to modify the environment of their job before their job is submitted to the service for execution.
months(int) - Static method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows: Returns a WindowFn that windows elements into periods measured by months.

N

name - Variable in class com.google.cloud.dataflow.sdk.transforms.PTransform: The base name of this PTransform, e.g., from ParDo.named(String), or from defaults, or null if not yet assigned.
named(String) - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Read.Bound: Returns a new AvroIO.Read PTransform that's like this one but with the given step name.
named(String) - Static method in class com.google.cloud.dataflow.sdk.io.AvroIO.Read: Returns an AvroIO.Read PTransform with the given step name.
named(String) - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound: Returns a new AvroIO.Write PTransform that's like this one but with the given step name.
named(String) - Static method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write: Returns an AvroIO.Write PTransform with the given step name.
named(String) - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Read.Bound: Sets the name associated with this transformation.
named(String) - Static method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Read
named(String) - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.Bound: Sets the name associated with this transformation.
named(String) - Static method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write: Sets the name associated with this transformation.
named(String) - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.Sink: Returns a DatastoreIO.Write PTransform with the name associated with this PTransform.
named(String) - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read.Bound: Returns a new PubsubIO.Read PTransform that's like this one but with the given step name.
named(String) - Static method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read
named(String) - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Write.Bound: Returns a new PubsubIO.Write PTransform that's like this one but with the given step name.
named(String) - Static method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Write
named(String) - Method in class com.google.cloud.dataflow.sdk.io.ReadSource.Bound: Returns a new ReadSource PTransform that's like this one but has the given name.
named(String) - Static method in class com.google.cloud.dataflow.sdk.io.ReadSource: Returns a new ReadSource.Bound PTransform with the given name.
named(String) - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Read.Bound: Returns a new TextIO.Read PTransform that's like this one but with the given step name.
named(String) - Static method in class com.google.cloud.dataflow.sdk.io.TextIO.Read: Returns a TextIO.Read PTransform with the given step name.
named(String) - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Write.Bound: Returns a new TextIO.Write PTransform that's like this one but with the given step name.
named(String) - Static method in class com.google.cloud.dataflow.sdk.io.TextIO.Write: Returns a TextIO.Write PTransform with the given step name.
named(String) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.Bound: Returns a new ParDo PTransform that's like this PTransform but with the specified name.
named(String) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.BoundMulti: Returns a new multi-output ParDo PTransform that's like this PTransform but with the specified name.
named(String) - Static method in class com.google.cloud.dataflow.sdk.transforms.ParDo: Creates a ParDo PTransform with the given name.
named(String) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.Unbound: Returns a new ParDo transform that's like this transform but with the specified name.
named(String) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.UnboundMulti: Returns a new multi-output ParDo transform that's like this transform but with the specified name.
named(String) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window.Bound: Returns a new Window PTransform that's like this PTransform but with the specified name.
named(String) - Static method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window: Creates a Window PTransform with the given name.
named(String) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window.Unbound: Returns a new Window transform that's like this transform but with the specified name.
needsValidation() - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Read.Bound
needsValidation() - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound
needsValidation() - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Read.Bound
needsValidation() - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Write.Bound
NESTED - Static variable in class com.google.cloud.dataflow.sdk.coders.Coder.Context: The nested context.
nested() - Method in class com.google.cloud.dataflow.sdk.coders.Coder.Context
NonMergingWindowFn<T,W extends BoundedWindow> - Class in com.google.cloud.dataflow.sdk.transforms.windowing: Abstract base class for WindowFns that do not merge windows.
NonMergingWindowFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.windowing.NonMergingWindowFn

O

of(Class<T>) - Static method in class com.google.cloud.dataflow.sdk.coders.AvroCoder: Returns an AvroCoder instance for the provided element type.
of(Schema) - Static method in class com.google.cloud.dataflow.sdk.coders.AvroCoder: Returns an AvroCoder instance for the Avro schema.
of(Class<T>, Schema) - Static method in class com.google.cloud.dataflow.sdk.coders.AvroCoder: Returns an AvroCoder instance for the provided element type using the provided Avro schema.
of(String, String) - Static method in class com.google.cloud.dataflow.sdk.coders.AvroCoder
of() - Static method in class com.google.cloud.dataflow.sdk.coders.BigEndianIntegerCoder
of() - Static method in class com.google.cloud.dataflow.sdk.coders.BigEndianLongCoder
of() - Static method in class com.google.cloud.dataflow.sdk.coders.ByteArrayCoder
of(Coder<T>) - Static method in class com.google.cloud.dataflow.sdk.coders.CollectionCoder
of(List<Object>) - Static method in class com.google.cloud.dataflow.sdk.coders.CollectionCoder
of(String, String, String) - Static method in class com.google.cloud.dataflow.sdk.coders.CustomCoder
of(Coder<DT>, DelegateCoder.CodingFunction<T, DT>, DelegateCoder.CodingFunction<DT, T>) - Static method in class com.google.cloud.dataflow.sdk.coders.DelegateCoder
of() - Static method in class com.google.cloud.dataflow.sdk.coders.DoubleCoder
of() - Static method in class com.google.cloud.dataflow.sdk.coders.EntityCoder
of() - Static method in class com.google.cloud.dataflow.sdk.coders.InstantCoder
of(Coder<T>) - Static method in class com.google.cloud.dataflow.sdk.coders.IterableCoder
of(List<Coder<?>>) - Static method in class com.google.cloud.dataflow.sdk.coders.IterableCoder
of(Coder<K>, Coder<V>) - Static method in class com.google.cloud.dataflow.sdk.coders.KvCoder
of(List<Coder<?>>) - Static method in class com.google.cloud.dataflow.sdk.coders.KvCoder
of(String, boolean, List<Coder<?>>) - Static method in class com.google.cloud.dataflow.sdk.coders.KvCoderBase
of(Coder<T>) - Static method in class com.google.cloud.dataflow.sdk.coders.ListCoder
of(List<Coder<?>>) - Static method in class com.google.cloud.dataflow.sdk.coders.ListCoder
of(Coder<K>, Coder<V>) - Static method in class com.google.cloud.dataflow.sdk.coders.MapCoder: Produces a MapCoder with the given keyCoder and valueCoder.
of(List<Coder<?>>) - Static method in class com.google.cloud.dataflow.sdk.coders.MapCoder
of(String, List<Coder<?>>) - Static method in class com.google.cloud.dataflow.sdk.coders.MapCoderBase
of(Class<T>) - Static method in class com.google.cloud.dataflow.sdk.coders.Proto2Coder: Produces a new Proto2Coder instance, for a given Protobuf message class.
of(Class<T>) - Static method in class com.google.cloud.dataflow.sdk.coders.SerializableCoder: Returns a SerializableCoder instance for the provided element type.
of(String) - Static method in class com.google.cloud.dataflow.sdk.coders.SerializableCoder
of(Coder<T>) - Static method in class com.google.cloud.dataflow.sdk.coders.SetCoder: Produces a SetCoder with the given elementCoder.
of(List<Object>) - Static method in class com.google.cloud.dataflow.sdk.coders.SetCoder: Dynamically typed constructor for JSON deserialization.
of(Class<T>) - Static method in class com.google.cloud.dataflow.sdk.coders.StringDelegateCoder
of() - Static method in class com.google.cloud.dataflow.sdk.coders.StringUtf8Coder
of() - Static method in class com.google.cloud.dataflow.sdk.coders.TableRowJsonCoder
of() - Static method in class com.google.cloud.dataflow.sdk.coders.TextualIntegerCoder
of() - Static method in class com.google.cloud.dataflow.sdk.coders.VarIntCoder
of() - Static method in class com.google.cloud.dataflow.sdk.coders.VarLongCoder
of() - Static method in class com.google.cloud.dataflow.sdk.coders.VoidCoder
of(WindowedValue<V>) - Static method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.ValueWithMetadata: Returns a new ValueWithMetadata with the WindowedValue.
of(SerializableFunction<Iterable<V>, V>) - Static method in class com.google.cloud.dataflow.sdk.transforms.Combine.SimpleCombineFn: Returns a CombineFn that uses the given SerializableFunction to combine values.
of(Iterable<T>) - Static method in class com.google.cloud.dataflow.sdk.transforms.Create: Returns a new Create root transform that produces a PCollection containing the specified elements.
of(T...) - Static method in class com.google.cloud.dataflow.sdk.transforms.Create: Returns a new Create root transform that produces a PCollection containing the specified elements.
of(Map<K, V>) - Static method in class com.google.cloud.dataflow.sdk.transforms.Create: Returns a new Create root transform that produces a PCollection of KVs corresponding to the keys and values of the specified Map.
of(DoFn<I, O>) - Static method in class com.google.cloud.dataflow.sdk.transforms.DoFnTester: Returns a DoFnTester supporting unit-testing of the given DoFn.
of(long) - Static method in class com.google.cloud.dataflow.sdk.transforms.First: Returns a First<T> PTransform.
of(CoGbkResultSchema, UnionCoder) - Static method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult.CoGbkResultCoder: Returns a CoGbkResultCoder for the given schema and unionCoder.
of(List<Coder<?>>, CoGbkResultSchema) - Static method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult.CoGbkResultCoder
of(TupleTag<V>, List<V>) - Static method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult: Returns a new CoGbkResult that contains just the given tag the given data.
of(List<TupleTag<?>>) - Static method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResultSchema
of(TupleTag<VI>, PCollection<KV<K, VI>>) - Static method in class com.google.cloud.dataflow.sdk.transforms.join.KeyedPCollectionTuple: Returns a new KeyedPCollections<K> with the given tag and initial PCollection.
of(DoFn<I, O>) - Static method in class com.google.cloud.dataflow.sdk.transforms.ParDo: Creates a ParDo PTransform that will invoke the given DoFn function.
of(DoFn<I, O>) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.Unbound: Returns a new ParDo PTransform that's like this transform but which will invoke the given DoFn function, and which has its input and output types bound.
of(DoFn<I, O>) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.UnboundMulti: Returns a new multi-output ParDo PTransform that's like this transform but which will invoke the given DoFn function, and which has its input type bound.
of(int, Partition.PartitionFn<? super T>) - Static method in class com.google.cloud.dataflow.sdk.transforms.Partition: Returns a new Partition PTransform that divides its input PCollection into the given number of partitions, using the given partitioning function.
of(int, C) - Static method in class com.google.cloud.dataflow.sdk.transforms.Top: Returns a PTransform that takes an input PCollection<T> and returns a PCollection<List<T>> with a single element containing the largest count elements of the input PCollection<T>, in decreasing order, sorted using the given Comparator<T>.
of(Duration) - Static method in class com.google.cloud.dataflow.sdk.transforms.windowing.FixedWindows: Partitions the timestamp space into half-open intervals of the form [N * size, (N + 1) * size), where 0 is the epoch.
of(Duration) - Static method in class com.google.cloud.dataflow.sdk.transforms.windowing.SlidingWindows: Assigns timestamps into half-open intervals of the form [N * period, N * period + size), where 0 is the epoch.
of(SerializableFunction<V, K>) - Static method in class com.google.cloud.dataflow.sdk.transforms.WithKeys: Returns a PTransform that takes a PCollection<V> and returns a PCollection<KV<K, V>>, where each of the values in the input PCollection has been paired with a key computed from the value by invoking the given SerializableFunction.
of(K) - Static method in class com.google.cloud.dataflow.sdk.transforms.WithKeys: Returns a PTransform that takes a PCollection<V> and returns a PCollection<KV<K, V>>, where each of the values in the input PCollection has been paired with the given key.
of(String, Coder<T>) - Static method in class com.google.cloud.dataflow.sdk.values.CodedTupleTag: Returns a CodedTupleTag with the given id which uses the given Coder whenever a value associated with the tag needs to be serialized.
of(Map<CodedTupleTag<?>, Object>) - Static method in class com.google.cloud.dataflow.sdk.values.CodedTupleTagMap: Returns a CodedTupleTagMap containing the given mappings.
of(K, V) - Static method in class com.google.cloud.dataflow.sdk.values.KV: Returns a KV with the given key and value.
of(PCollection<T>) - Static method in class com.google.cloud.dataflow.sdk.values.PCollectionList: Returns a singleton PCollectionList containing the given PCollection.
of(Iterable<PCollection<T>>) - Static method in class com.google.cloud.dataflow.sdk.values.PCollectionList: Returns a PCollectionList containing the given PCollections, in order.
of(TupleTag<T>, PCollection<T>) - Static method in class com.google.cloud.dataflow.sdk.values.PCollectionTuple: Returns a singleton PCollectionTuple containing the given PCollection keyed by the given TupleTag.
of(V, Instant) - Static method in class com.google.cloud.dataflow.sdk.values.TimestampedValue: Returns a new TimestampedValue with the given value and timestamp.
of(Coder<T>) - Static method in class com.google.cloud.dataflow.sdk.values.TimestampedValue.TimestampedValueCoder
of(List<Object>) - Static method in class com.google.cloud.dataflow.sdk.values.TimestampedValue.TimestampedValueCoder
of(TupleTag<?>) - Static method in class com.google.cloud.dataflow.sdk.values.TupleTagList: Returns a singleton TupleTagList containing the given TupleTag.
of(List<TupleTag<?>>) - Static method in class com.google.cloud.dataflow.sdk.values.TupleTagList: Returns a TupleTagList containing the given TupleTags, in order.
ofPrimitiveOutputsInternal(TupleTagList, WindowFn<?, ?>) - Static method in class com.google.cloud.dataflow.sdk.values.PCollectionTuple: Returns a PCollectionTuple with each of the given tags mapping to a new output PCollection.
OUTER - Static variable in class com.google.cloud.dataflow.sdk.coders.Coder.Context: The outer context.
output(O) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFn.Context: Adds the given element to the main output PCollection.
outputWithTimestamp(O, Instant) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFn.Context: Adds the given element to the main output PCollection, with the given timestamp.

P

ParDo - Class in com.google.cloud.dataflow.sdk.transforms: ParDo is the core element-wise transform in Google Cloud Dataflow, invoking a user-specified function (from I to O) on each of the elements of the input PCollection<I> to produce zero or more output elements, all of which are collected into the output PCollection<O>.
ParDo() - Constructor for class com.google.cloud.dataflow.sdk.transforms.ParDo
ParDo.Bound<I,O> - Class in com.google.cloud.dataflow.sdk.transforms: A PTransform that, when applied to a PCollection<I>, invokes a user-specified DoFn<I, O> on all its elements, with all its outputs collected into an output PCollection<O>.
ParDo.BoundMulti<I,O> - Class in com.google.cloud.dataflow.sdk.transforms: A PTransform that, when applied to a PCollection<I>, invokes a user-specified DoFn<I, O> on all its elements, which can emit elements to any of the PTransform's main and side output PCollections, which are bundled into a result PCollectionTuple.
ParDo.Unbound - Class in com.google.cloud.dataflow.sdk.transforms: An incomplete ParDo transform, with unbound input/output types.
ParDo.UnboundMulti<O> - Class in com.google.cloud.dataflow.sdk.transforms: An incomplete multi-output ParDo transform, with unbound input type.
parseTableSpec(String) - Static method in class com.google.cloud.dataflow.sdk.io.BigQueryIO: Parse a table specification in the form "[project_id]:[dataset_id].[table_id]" or "[dataset_id].[table_id]".
Partition<T> - Class in com.google.cloud.dataflow.sdk.transforms: Partition takes a PCollection<T> and a PartitionFn, uses the PartitionFn to split the elements of the input PCollection into N partitions, and returns a PCollectionList<T> that bundles N PCollection<T>s containing the split elements.
Partition.PartitionFn<T> - Interface in com.google.cloud.dataflow.sdk.transforms: A function object that chooses an output partition for an element.
partitionFor(T, int) - Method in interface com.google.cloud.dataflow.sdk.transforms.Partition.PartitionFn: Chooses the partition into which to put the given element.
PartitioningWindowFn<T,W extends BoundedWindow> - Class in com.google.cloud.dataflow.sdk.transforms.windowing: A WindowFn that places each value into exactly one window based on its timestamp and never merges windows.
PartitioningWindowFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.windowing.PartitioningWindowFn
PBegin - Class in com.google.cloud.dataflow.sdk.values: PBegin is used as the "input" to a root PTransform which is the first operation in a Pipeline, such as TextIO.Read or Create.
PBegin(Pipeline) - Constructor for class com.google.cloud.dataflow.sdk.values.PBegin: Constructs a PBegin in the given Pipeline.
PCollection<T> - Class in com.google.cloud.dataflow.sdk.values: A PCollection<T> is an immutable collection of values of type T.
PCollectionList<T> - Class in com.google.cloud.dataflow.sdk.values: A PCollectionList<T> is an immutable list of homogeneously typed PCollection<T>s.
pCollections() - Static method in class com.google.cloud.dataflow.sdk.transforms.Flatten: Returns a PTransform that flattens a PCollectionList into a PCollection containing all the elements of all the PCollections in its input.
PCollectionTuple - Class in com.google.cloud.dataflow.sdk.values: A PCollectionTuple is an immutable tuple of heterogeneously-typed PCollections, "keyed" by TupleTags.
PCollectionView<T> - Interface in com.google.cloud.dataflow.sdk.values: A PCollectionView<T> is an immutable view of a PCollection that can be accessed e.g.
PDone - Class in com.google.cloud.dataflow.sdk.values: PDone is the output of a PTransform that doesn't have a non-trival result, e.g., a Write.
PDone() - Constructor for class com.google.cloud.dataflow.sdk.values.PDone
peekOutputElements() - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnTester: Returns the elements output so far to the main output.
peekSideOutputElements(TupleTag<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnTester: Returns the elements output so far to the side output with the given tag.
perElement() - Static method in class com.google.cloud.dataflow.sdk.transforms.Count: Returns a Count.PerElement PTransform that counts the number of occurrences of each element in its input PCollection.
perKey(int, C) - Static method in class com.google.cloud.dataflow.sdk.transforms.ApproximateQuantiles: Returns a PTransform that takes a PCollection<KV<K, V>> and returns a PCollection<KV<K, List<V>>> that contains an output element mapping each distinct key in the input PCollection to a List of the approximate N-tiles of the values associated with that key in the input PCollection.
perKey(int) - Static method in class com.google.cloud.dataflow.sdk.transforms.ApproximateQuantiles: Like ApproximateQuantiles.perKey(int, Comparator), but sorts values using the their natural ordering.
perKey(int) - Static method in class com.google.cloud.dataflow.sdk.transforms.ApproximateUnique: Returns a PTransform that takes a PCollection<KV<K, V>> and returns a PCollection<KV<K, Long>> that contains an output element mapping each distinct key in the input PCollection to an estimate of the number of distinct values associated with that key in the input PCollection.
perKey(double) - Static method in class com.google.cloud.dataflow.sdk.transforms.ApproximateUnique: Like ApproximateUnique.perKey(int), but specifies the desired maximum estimation error instead of the sample size.
perKey(SerializableFunction<Iterable<V>, V>) - Static method in class com.google.cloud.dataflow.sdk.transforms.Combine: Returns a Combine.PerKey PTransform that first groups its input PCollection of KVs by keys and windows, then invokes the given function on each of the values lists to produce a combined value, and then returns a PCollection of KVs mapping each distinct key to its combined value for each window.
perKey(Combine.CombineFn<? super VI, ?, VO>) - Static method in class com.google.cloud.dataflow.sdk.transforms.Combine: Returns a Combine.PerKey PTransform that first groups its input PCollection of KVs by keys and windows, then invokes the given function on each of the values lists to produce a combined value, and then returns a PCollection of KVs mapping each distinct key to its combined value for each window.
perKey(Combine.KeyedCombineFn<? super K, ? super VI, ?, VO>) - Static method in class com.google.cloud.dataflow.sdk.transforms.Combine: Returns a Combine.PerKey PTransform that first groups its input PCollection of KVs by keys and windows, then invokes the given function on each of the key/values-lists pairs to produce a combined value, and then returns a PCollection of KVs mapping each distinct key to its combined value for each window.
perKey() - Static method in class com.google.cloud.dataflow.sdk.transforms.Mean: Returns a PTransform that takes an input PCollection<KV<K, N>> and returns a PCollection<KV<K, Double>> that contains an output element mapping each distinct key in the input PCollection to the mean of the values associated with that key in the input PCollection.
perKey(int, C) - Static method in class com.google.cloud.dataflow.sdk.transforms.Top: Returns a PTransform that takes an input PCollection<KV<K, V>> and returns a PCollection<KV<K, List<V>>> that contains an output element mapping each distinct key in the input PCollection to the largest count values associated with that key in the input PCollection<KV<K, V>>, in decreasing order, sorted using the given Comparator<V>.
perWorker(DoFn<I, O>) - Static method in class com.google.cloud.dataflow.sdk.transforms.RateLimiting: Creates a new per-worker rate-limiting transform for the given DoFn.
PInput - Interface in com.google.cloud.dataflow.sdk.values: The abstract interface of things that might be input to a PTransform.
Pipeline - Class in com.google.cloud.dataflow.sdk: A Pipeline manages a DAG of PTransforms, and the PCollections that the PTransforms consume and produce.
Pipeline(PipelineRunner<?>) - Constructor for class com.google.cloud.dataflow.sdk.Pipeline: Deprecated.
Pipeline(PipelineRunner<?>, PipelineOptions) - Constructor for class com.google.cloud.dataflow.sdk.Pipeline
Pipeline.PipelineVisitor - Interface in com.google.cloud.dataflow.sdk: A PipelineVisitor can be passed into Pipeline.traverseTopologically(com.google.cloud.dataflow.sdk.Pipeline.PipelineVisitor) to be called for each of the transforms and values in the Pipeline.
PipelineOptions - Interface in com.google.cloud.dataflow.sdk.options: Dataflow SDK pipeline configuration options.
PipelineOptionsFactory - Class in com.google.cloud.dataflow.sdk.options: Constructs a PipelineOptions or any derived interface which is composable to any other derived interface of PipelineOptions via the PipelineOptions.as(java.lang.Class<T>) method.
PipelineOptionsFactory() - Constructor for class com.google.cloud.dataflow.sdk.options.PipelineOptionsFactory
PipelineOptionsFactory.Builder - Class in com.google.cloud.dataflow.sdk.options: A fluent PipelineOptions builder.
PipelineOptionsRegistrar - Interface in com.google.cloud.dataflow.sdk.options: PipelineOptions creators have the ability to automatically have their PipelineOptions registered with this SDK by creating a ServiceLoader entry and a concrete implementation of this interface.
PipelineOptionsValidator - Class in com.google.cloud.dataflow.sdk.options: Validates that the PipelineOptions conforms to all the Validation criteria.
PipelineOptionsValidator() - Constructor for class com.google.cloud.dataflow.sdk.options.PipelineOptionsValidator
PipelineResult - Interface in com.google.cloud.dataflow.sdk: Result of Pipeline.run().
PipelineRunner<Results extends PipelineResult> - Class in com.google.cloud.dataflow.sdk.runners: A PipelineRunner can execute, translate, or otherwise process a Pipeline.
PipelineRunner() - Constructor for class com.google.cloud.dataflow.sdk.runners.PipelineRunner
PipelineRunnerRegistrar - Interface in com.google.cloud.dataflow.sdk.runners: PipelineRunner creators have the ability to automatically have their PipelineRunner registered with this SDK by creating a ServiceLoader entry and a concrete implementation of this interface.
popNode() - Method in class com.google.cloud.dataflow.sdk.runners.TransformHierarchy: Removes the last TransformTreeNode from the stack.
POutput - Interface in com.google.cloud.dataflow.sdk.values: The abstract interface of things that might be output from a PTransform.
POutputValueBase - Class in com.google.cloud.dataflow.sdk.values: A POutputValueBase is the abstract base class of PTransform outputs.
POutputValueBase() - Constructor for class com.google.cloud.dataflow.sdk.values.POutputValueBase
printHelp(PrintStream) - Static method in class com.google.cloud.dataflow.sdk.options.PipelineOptionsFactory: Outputs the set of registered options with the PipelineOptionsFactory with a description for each one if available to the output stream.
printHelp(PrintStream, Class<? extends PipelineOptions>) - Static method in class com.google.cloud.dataflow.sdk.options.PipelineOptionsFactory: Outputs the set of options available to be set for the passed in PipelineOptions interface.
processBatch(I...) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnTester: A convenience operation that first calls DoFnTester.startBundle(), then calls DoFnTester.processElement(I) on each of the arguments, then calls DoFnTester.finishBundle(), then returns the result of DoFnTester.takeOutputElements().
processElement(DoFn<KV<K, Iterable<VI>>, KV<K, VO>>.ProcessContext) - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.TestCombineDoFn
processElement(DoFn<I, O>.ProcessContext) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFn: Processes an input element.
processElement(I) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnTester: Calls DoFn.processElement(com.google.cloud.dataflow.sdk.transforms.DoFn<I, O>.ProcessContext) on the DoFn under test, in a context where DoFn.ProcessContext.element() returns the given element.
processElement(DoFn<I, O>.ProcessContext) - Method in class com.google.cloud.dataflow.sdk.transforms.RateLimiting.RateLimitingDoFn
producesSortedKeys(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.Source
producesSortedKeys(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.Source: Whether this source is known to produce key/value pairs with the (encoded) keys in lexicographically sorted order.
Proto2Coder<T extends com.google.protobuf.Message> - Class in com.google.cloud.dataflow.sdk.coders: An encoder using Google Protocol Buffers 2 binary format.
PTransform<Input extends PInput,Output extends POutput> - Class in com.google.cloud.dataflow.sdk.transforms: A PTransform<Input, Output> is an operation that takes an Input (some subtype of PInput) and produces an Output (some subtype of POutput).
PTransform() - Constructor for class com.google.cloud.dataflow.sdk.transforms.PTransform
PTransform(String) - Constructor for class com.google.cloud.dataflow.sdk.transforms.PTransform
PubsubIO - Class in com.google.cloud.dataflow.sdk.io: Read and Write transforms for Pub/Sub streams.
PubsubIO() - Constructor for class com.google.cloud.dataflow.sdk.io.PubsubIO
PubsubIO.Read - Class in com.google.cloud.dataflow.sdk.io: A PTransform that continuously reads from a Pubsub stream and returns a PCollection<String> containing the items from the stream.
PubsubIO.Read() - Constructor for class com.google.cloud.dataflow.sdk.io.PubsubIO.Read
PubsubIO.Read.Bound - Class in com.google.cloud.dataflow.sdk.io: A PTransform that reads from a PubSub source and returns a unbounded PCollection containing the items from the stream.
PubsubIO.Validator - Class in com.google.cloud.dataflow.sdk.io: Utility class to validate topic and subscription names.
PubsubIO.Validator() - Constructor for class com.google.cloud.dataflow.sdk.io.PubsubIO.Validator
PubsubIO.Write - Class in com.google.cloud.dataflow.sdk.io: A PTransform that continuously writes a PCollection<String> to a Pubsub stream.
PubsubIO.Write() - Constructor for class com.google.cloud.dataflow.sdk.io.PubsubIO.Write
PubsubIO.Write.Bound - Class in com.google.cloud.dataflow.sdk.io: A PTransfrom that writes a unbounded PCollection<String> to a PubSub stream.
pushNode(TransformTreeNode) - Method in class com.google.cloud.dataflow.sdk.runners.TransformHierarchy: Add a TransformTreeNode to the stack.
PValue - Interface in com.google.cloud.dataflow.sdk.values: A PValue is the interface to values that can be input and output from PTransforms.
PValueBase - Class in com.google.cloud.dataflow.sdk.values: A PValueBase is an abstract base class that provides sensible default implementations for methods of PValue.
PValueBase() - Constructor for class com.google.cloud.dataflow.sdk.values.PValueBase

R

randomizeIfUnordered(List<T>, boolean) - Method in interface com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.EvaluationContext: If the evaluation context is testing unorderedness, randomly permutes the order of the elements, in a copy if !inPlaceAllowed, and returns the permuted list, otherwise returns the argument unchanged.
RateLimiting - Class in com.google.cloud.dataflow.sdk.transforms: Provides rate-limiting of user functions, using threaded execution and a RateLimiter to process elements at the desired rate.
RateLimiting() - Constructor for class com.google.cloud.dataflow.sdk.transforms.RateLimiting
RateLimiting.RateLimitingDoFn<I,O> - Class in com.google.cloud.dataflow.sdk.transforms: A rate-limiting DoFn wrapper.
RateLimiting.RateLimitingDoFn(DoFn<I, O>, double, int) - Constructor for class com.google.cloud.dataflow.sdk.transforms.RateLimiting.RateLimitingDoFn
RateLimiting.RateLimitingTransform<I,O> - Class in com.google.cloud.dataflow.sdk.transforms: A PTransform which applies rate limiting to a DoFn.
RateLimiting.RateLimitingTransform(DoFn<I, O>) - Constructor for class com.google.cloud.dataflow.sdk.transforms.RateLimiting.RateLimitingTransform
RawUnionValue - Class in com.google.cloud.dataflow.sdk.transforms.join: This corresponds to an integer union tag and value.
RawUnionValue(int, Object) - Constructor for class com.google.cloud.dataflow.sdk.transforms.join.RawUnionValue: Constructs a partial union from the given union tag and value.
read() - Static method in class com.google.cloud.dataflow.sdk.io.DatastoreIO: Returns an empty DatastoreIO.Read builder with the default host.
readFrom(String, DatastoreV1.Query) - Static method in class com.google.cloud.dataflow.sdk.io.DatastoreIO: Returns a PTransform which reads Datastore entities from the query against the given dataset.
readFrom(String, String, DatastoreV1.Query) - Static method in class com.google.cloud.dataflow.sdk.io.DatastoreIO: Returns a PTransform which reads Datastore entities from the query against the given dataset and host.
readNextRecord() - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSource.FileBasedReader: Reads the next record from the channel provided by FileBasedSource.FileBasedReader.startReading(java.nio.channels.ReadableByteChannel).
ReadSource - Class in com.google.cloud.dataflow.sdk.io: The PTransform for reading from a Source.
ReadSource() - Constructor for class com.google.cloud.dataflow.sdk.io.ReadSource
ReadSource.Bound<T> - Class in com.google.cloud.dataflow.sdk.io: Implementation of the ReadSource PTransform builder.
recordAsOutput(Pipeline, PTransform<?, ?>) - Method in class com.google.cloud.dataflow.sdk.values.PCollectionList
recordAsOutput(Pipeline, PTransform<?, ?>) - Method in class com.google.cloud.dataflow.sdk.values.PCollectionTuple
recordAsOutput(Pipeline, PTransform<?, ?>) - Method in interface com.google.cloud.dataflow.sdk.values.POutput: Records that this POutput is an output of the given PTransform in the given Pipeline.
recordAsOutput(Pipeline, PTransform<?, ?>) - Method in class com.google.cloud.dataflow.sdk.values.POutputValueBase: Records that this POutputValueBase is an output with the given name of the given PTransform in the given Pipeline.
recordAsOutput(Pipeline, PTransform<?, ?>) - Method in class com.google.cloud.dataflow.sdk.values.PValueBase
recordAsOutput(Pipeline, PTransform<?, ?>, String) - Method in class com.google.cloud.dataflow.sdk.values.PValueBase: Records that this POutputValueBase is an output with the given name of the given PTransform in the given Pipeline.
recordAsOutput(Pipeline, PTransform<?, ?>, String) - Method in class com.google.cloud.dataflow.sdk.values.TypedPValue
RecordingPipelineVisitor - Class in com.google.cloud.dataflow.sdk.runners: Provides a simple PipelineVisitor which records the transformation tree.
RecordingPipelineVisitor() - Constructor for class com.google.cloud.dataflow.sdk.runners.RecordingPipelineVisitor
register(Class<? extends PipelineOptions>) - Static method in class com.google.cloud.dataflow.sdk.options.PipelineOptionsFactory: This registers the interface with this factory.
registerByteSizeObserver(T, ElementByteSizeObserver, Coder.Context) - Method in interface com.google.cloud.dataflow.sdk.coders.Coder: Notifies the ElementByteSizeObserver about the byte size of the encoded value using this Coder.
registerByteSizeObserver(IT, ElementByteSizeObserver, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.IterableLikeCoder: Notifies ElementByteSizeObserver about the byte size of the encoded value using this coder.
registerByteSizeObserver(KV<K, V>, ElementByteSizeObserver, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.KvCoder: Notifies ElementByteSizeObserver about the byte size of the encoded value using this coder.
registerByteSizeObserver(Map<K, V>, ElementByteSizeObserver, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.MapCoder: Notifies ElementByteSizeObserver about the byte size of the encoded value using this coder.
registerByteSizeObserver(T, ElementByteSizeObserver, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.StandardCoder: Notifies ElementByteSizeObserver about the byte size of the encoded value using this coder.
registerCoder(Class<?>, Class<?>) - Method in class com.google.cloud.dataflow.sdk.coders.CoderRegistry: Registers coderClazz as the default Coder<T> class to handle encoding and decoding instances of clazz of type T.
registerCoder(Class<?>, CoderRegistry.CoderFactory) - Method in class com.google.cloud.dataflow.sdk.coders.CoderRegistry
registerCoder(Class<?>, Coder<?>) - Method in class com.google.cloud.dataflow.sdk.coders.CoderRegistry
registerDefaultTransformEvaluator(Class<PT>, DirectPipelineRunner.TransformEvaluator<PT>) - Static method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner: Records that instances of the specified PTransform class should be evaluated by default by the corresponding TransformEvaluator.
registerStandardCoders() - Method in class com.google.cloud.dataflow.sdk.coders.CoderRegistry: Registers standard Coders with this CoderRegistry.
registerTransformEvaluator(Class<PT>, DirectPipelineRunner.TransformEvaluator<PT>) - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner: Records that instances of the specified PTransform class should be evaluated by the corresponding TransformEvaluator.
registerTransformTranslator(Class<PT>, DataflowPipelineTranslator.TransformTranslator<? extends PT>) - Static method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator: Records that instances of the specified PTransform class should be translated by default by the corresponding TransformTranslator.
remerge() - Static method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window: Creates a Window PTransform that does not change assigned windows, but will cause windows to be merged again as part of the next GroupByKey.
remove(CodedTupleTag<T>) - Method in interface com.google.cloud.dataflow.sdk.transforms.DoFn.KeyedState: Removes the data associated with the given tag from KeyedState.
RemoveDuplicates<T> - Class in com.google.cloud.dataflow.sdk.transforms: RemoveDuplicates<T> takes a PCollection<T> and returns a PCollection<T> that has all the elements of the input but with duplicate elements removed such that each element is unique within each window.
run() - Method in class com.google.cloud.dataflow.sdk.Pipeline: Runs the Pipeline.
run(Pipeline) - Method in class com.google.cloud.dataflow.sdk.runners.BlockingDataflowPipelineRunner
run() - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipeline
run(Pipeline) - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineRunner
run() - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipeline
run(Pipeline) - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner
run(Pipeline) - Method in class com.google.cloud.dataflow.sdk.runners.PipelineRunner: Processes the given Pipeline, returning the results.
run(Pipeline) - Method in class com.google.cloud.dataflow.sdk.testing.TestDataflowPipelineRunner
RunnableOnService - Interface in com.google.cloud.dataflow.sdk.testing: Category tag for tests that can be run on the DataflowPipelineRunner if the runIntegrationTestOnService System property is set to true.
runWindowFn(WindowFn<T, W>, List<Long>) - Static method in class com.google.cloud.dataflow.sdk.testing.WindowFnTestUtils: Runs the WindowFn over the provided input, returning a map of windows to the timestamps in those windows.

S

Sample - Class in com.google.cloud.dataflow.sdk.transforms: PTransforms for taking samples of the elements in a PCollection, or samples of the values associated with each key in a PCollection of KVs.
Sample() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Sample
Sample.FixedSizedSampleFn<T> - Class in com.google.cloud.dataflow.sdk.transforms: CombineFn that computes a fixed-size sample of a collection of values.
satisfies(SerializableFunction<Iterable<T>, Void>) - Method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert.IterableAssert: Applies a SerializableFunction to check the elements of the Iterable.
satisfies(DataflowAssert.AssertRelation<Iterable<T>, Iterable<T>>, Iterable<T>) - Method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert.IterableAssert: Applies a SerializableFunction to check the elements of the Iterable.
satisfies(SerializableFunction<T, Void>) - Method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert.SingletonAssert: Applies a SerializableFunction to check the value of this SingletonAssert's view.
satisfies(DataflowAssert.AssertRelation<T, T>, T) - Method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert.SingletonAssert: Applies an DataflowAssert.AssertRelation to check the provided relation against the value of this assert and the provided expected value.
SerializableCoder<T extends java.io.Serializable> - Class in com.google.cloud.dataflow.sdk.coders: An encoder of Serializable objects.
SerializableCoder(Class<T>) - Constructor for class com.google.cloud.dataflow.sdk.coders.SerializableCoder
SerializableComparator<T> - Interface in com.google.cloud.dataflow.sdk.transforms: A Serializable Comparator.
SerializableFunction<I,O> - Interface in com.google.cloud.dataflow.sdk.transforms: A function that computes an output value based on an input value, and is Serializable.
Sessions - Class in com.google.cloud.dataflow.sdk.transforms.windowing: A WindowFn windowing values into sessions separated by Sessions.gapDuration-long periods with no elements.
set(long...) - Static method in class com.google.cloud.dataflow.sdk.testing.WindowFnTestUtils: Creates a Set of elements to be used as expected output in WindowFnTestUtils.runWindowFn(com.google.cloud.dataflow.sdk.transforms.windowing.WindowFn<T, W>, java.util.List<java.lang.Long>).
setApiRootUrl(String) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions
setAppName(String) - Method in interface com.google.cloud.dataflow.sdk.options.ApplicationNameOptions
setAutoscalingAlgorithm(DataflowPipelineWorkerPoolOptions.AutoscalingAlgorithmType) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions
setCdbgVersion(String) - Method in interface com.google.cloud.dataflow.sdk.options.CloudDebuggerOptions
setClusterManagerApi(DataflowPipelineWorkerPoolOptions.ClusterManagerApiType) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions
SetCoder<T> - Class in com.google.cloud.dataflow.sdk.coders: A SetCoder encodes Sets.
SetCoder(Coder<T>) - Constructor for class com.google.cloud.dataflow.sdk.coders.SetCoder
setCoder(Coder<T>) - Method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert.IterableAssert: Sets the coder to use for elements of type T, as needed for internal purposes.
setCoder(Optional<Coder<T>>) - Method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert.IterableAssert: Sets the coder to use for elements of type T, as needed for internal purposes.
setCoder(Coder<T>) - Method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert.SingletonAssert: Sets the coder to use for elements of type T, as needed for internal purposes.
setCoder(Optional<Coder<T>>) - Method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert.SingletonAssert: Sets the coder to use for elements of type T, as needed for internal purposes.
setCoder(Coder<T>) - Method in class com.google.cloud.dataflow.sdk.values.PCollection: Sets the Coder used by this PCollection to encode and decode the values stored in it.
setCoder(Coder<T>) - Method in class com.google.cloud.dataflow.sdk.values.TypedPValue: Sets the Coder used by this TypedPValue to encode and decode the values stored in it.
setCoderRegistry(CoderRegistry) - Method in class com.google.cloud.dataflow.sdk.Pipeline: Sets the CoderRegistry that this Pipeline uses.
setCredentialDir(String) - Method in interface com.google.cloud.dataflow.sdk.options.GcpOptions
setCredentialFactoryClass(Class<? extends CredentialFactory>) - Method in interface com.google.cloud.dataflow.sdk.options.GcpOptions
setCredentialId(String) - Method in interface com.google.cloud.dataflow.sdk.options.GcpOptions
setDataflowClient(Dataflow) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions
setDataflowEndpoint(String) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions
setDataflowJobFile(String) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions
setDefaultWorkerLogLevel(DataflowWorkerLoggingOptions.Level) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowWorkerLoggingOptions
setDiskSizeGb(int) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions
setDiskSourceImage(String) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions
setExecutorService(ExecutorService) - Method in interface com.google.cloud.dataflow.sdk.options.GcsOptions
setExperiments(List<String>) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions
setFilesToStage(List<String>) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions
setGCloudPath(String) - Method in interface com.google.cloud.dataflow.sdk.options.GcpOptions
setGcpCredential(Credential) - Method in interface com.google.cloud.dataflow.sdk.options.GcpOptions
setGcsUtil(GcsUtil) - Method in interface com.google.cloud.dataflow.sdk.options.GcsOptions
setGoogleApiTrace(GoogleApiDebugOptions.GoogleApiTracer...) - Method in interface com.google.cloud.dataflow.sdk.options.GoogleApiDebugOptions
setHooks(DataflowPipelineRunnerHooks) - Method in class com.google.cloud.dataflow.sdk.runners.BlockingDataflowPipelineRunner: Sets callbacks to invoke during execution see DataflowPipelineRunnerHooks.
setHooks(DataflowPipelineRunnerHooks) - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineRunner: Sets callbacks to invoke during execution see DataflowPipelineRunnerHooks.
setJobId(String) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowWorkerHarnessOptions
setJobMessageOutput(PrintStream) - Method in interface com.google.cloud.dataflow.sdk.options.BlockingDataflowPipelineOptions
setJobName(String) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineOptions
setMaxNumWorkers(int) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions
setName(String) - Method in class com.google.cloud.dataflow.sdk.transforms.PTransform: Sets the base name of this PTransform.
setName(String) - Method in class com.google.cloud.dataflow.sdk.values.PCollection: Sets the name of this PCollection.
setName(String) - Method in class com.google.cloud.dataflow.sdk.values.PValueBase: Sets the name of this PValueBase.
setNumWorkers(int) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions
setOutput(TransformTreeNode, POutput) - Method in class com.google.cloud.dataflow.sdk.runners.TransformHierarchy: Sets the output of a transform node.
setOutput(POutput) - Method in class com.google.cloud.dataflow.sdk.runners.TransformTreeNode: Adds an output to the transform node.
setPathValidator(PathValidator) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions
setPathValidatorClass(Class<? extends PathValidator>) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions
setPCollection(PCollection<T>, List<T>) - Method in interface com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.EvaluationContext: Shorthand for setting the value of a PCollection where the elements do not have timestamps or windows.
setPCollectionValuesWithMetadata(PCollection<T>, List<DirectPipelineRunner.ValueWithMetadata<T>>) - Method in interface com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.EvaluationContext: Sets the value of the given PCollection, where each element also has a timestamp and collection of windows.
setPCollectionView(PCollectionView<T>, Iterable<WindowedValue<R>>) - Method in interface com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.EvaluationContext: Sets the value associated with the given PCollectionView.
setPCollectionWindowedValue(PCollection<T>, List<WindowedValue<T>>) - Method in interface com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.EvaluationContext: Sets the value of the given PCollection, where each element also has a timestamp and collection of windows.
setPipeline(Pipeline) - Method in class com.google.cloud.dataflow.sdk.transforms.PTransform: Deprecated.
setPipelineInternal(Pipeline) - Method in class com.google.cloud.dataflow.sdk.values.PCollection: Sets the Pipeline for this PCollection.
setPipelineInternal(Pipeline) - Method in interface com.google.cloud.dataflow.sdk.values.PValue
setPipelineInternal(Pipeline) - Method in class com.google.cloud.dataflow.sdk.values.PValueBase: Sets the owning Pipeline of this PValueBase.
setPipelineInternal(Pipeline) - Method in class com.google.cloud.dataflow.sdk.values.TypedPValue
setProject(String) - Method in interface com.google.cloud.dataflow.sdk.options.GcpOptions
setRunner(Class<? extends PipelineRunner<?>>) - Method in interface com.google.cloud.dataflow.sdk.options.PipelineOptions
setSecretsFile(String) - Method in interface com.google.cloud.dataflow.sdk.options.GcpOptions
setServiceAccountKeyfile(String) - Method in interface com.google.cloud.dataflow.sdk.options.GcpOptions
setServiceAccountName(String) - Method in interface com.google.cloud.dataflow.sdk.options.GcpOptions
setSideInput(PCollectionView<?>, Iterable<WindowedValue<?>>) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnTester: Registers the values of a side input PCollectionView to pass to the DoFn under test.
setSideInputInGlobalWindow(PCollectionView<?>, Iterable<?>) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnTester: Registers the values for a side input PCollectionView to pass to the DoFn under test.
setSideInputs(Map<PCollectionView<?>, Iterable<WindowedValue<?>>>) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnTester: Registers the tuple of values of the side input PCollectionViews to pass to the DoFn under test.
setSideOutputTags(TupleTagList) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnTester: Registers the list of TupleTags that can be used by the DoFn under test to output to side output PCollections.
setStager(Stager) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions
setStagerClass(Class<? extends Stager>) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions
setStagingLocation(String) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineOptions
setStreaming(boolean) - Method in interface com.google.cloud.dataflow.sdk.options.StreamingOptions
setTeardownPolicy(DataflowPipelineWorkerPoolOptions.TeardownPolicy) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions
setTempDatasetId(String) - Method in interface com.google.cloud.dataflow.sdk.options.BigQueryOptions
setTempLocation(String) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineOptions
setTypeTokenInternal(TypeToken<T>) - Method in class com.google.cloud.dataflow.sdk.values.PCollection: Sets the TypeToken<T> for this PCollection<T>, so that the enclosing PCollectionTuple, PCollectionList<T>, or PTransform<?, PCollection<T>>, etc., can provide more detailed reflective information.
setTypeTokenInternal(TypeToken<T>) - Method in class com.google.cloud.dataflow.sdk.values.TypedPValue: Sets the TypeToken<T> associated with this class.
setVersion(String) - Method in class com.google.cloud.dataflow.sdk.options.CloudDebuggerOptions.DebuggerConfig
setWindowFnInternal(WindowFn<?, ?>) - Method in class com.google.cloud.dataflow.sdk.values.PCollection: Sets the WindowFn of this PCollection.
setWorkerDiskType(String) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions
setWorkerId(String) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowWorkerHarnessOptions
setWorkerLogLevelOverrides(DataflowWorkerLoggingOptions.WorkerLogLevelOverride...) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowWorkerLoggingOptions
setWorkerMachineType(String) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions
setWorkerPoolType(String) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions
setZone(String) - Method in interface com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions
ShardNameTemplate - Class in com.google.cloud.dataflow.sdk.io: Standard shard naming templates.
ShardNameTemplate() - Constructor for class com.google.cloud.dataflow.sdk.io.ShardNameTemplate
sideInput(PCollectionView<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFn.ProcessContext: Returns the value of the side input for the window corresponding to the window of the main input element.
sideOutput(TupleTag<T>, T) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFn.Context: Adds the given element to the side output PCollection with the given tag.
sideOutputWithTimestamp(TupleTag<T>, T, Instant) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFn.Context: Adds the given element to the specified side output PCollection, with the given timestamp.
size() - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResultSchema: Returns the number of columms for this schema.
size() - Method in class com.google.cloud.dataflow.sdk.values.PCollectionList: Returns the number of PCollections in this PCollectionList.
size() - Method in class com.google.cloud.dataflow.sdk.values.TupleTagList: Returns the number of TupleTags in this TupleTagList.
SlidingWindows - Class in com.google.cloud.dataflow.sdk.transforms.windowing: A WindowFn that windows values into possibly overlapping fixed-size timestamp-based windows.
smallest(int) - Static method in class com.google.cloud.dataflow.sdk.transforms.Top: Returns a PTransform that takes an input PCollection<T> and returns a PCollection<List<T>> with a single element containing the smallest count elements of the input PCollection<T>, in increasing order, sorted according to their natural order.
smallestPerKey(int) - Static method in class com.google.cloud.dataflow.sdk.transforms.Top: Returns a PTransform that takes an input PCollection<KV<K, V>> and returns a PCollection<KV<K, List<V>>> that contains an output element mapping each distinct key in the input PCollection to the smallest count values associated with that key in the input PCollection<KV<K, V>>, in increasing order, sorted according to their natural order.
Source<T> - Class in com.google.cloud.dataflow.sdk.io: Base class for defining input formats, with custom logic for splitting the input into bundles (parts of the input, each of which may be processed on a different worker) and creating a Source for reading the input.
Source() - Constructor for class com.google.cloud.dataflow.sdk.io.Source
Source.Reader<T> - Interface in com.google.cloud.dataflow.sdk.io: The interface which readers of custom input sources must implement.
span(IntervalWindow) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.IntervalWindow: Returns the minimal window that includes both this window and the given window.
splitIntoBundles(long, PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.ByteOffsetBasedSource
splitIntoBundles(long, PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.Source
splitIntoBundles(long, PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSource
splitIntoBundles(long, PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.io.Source: Splits the source into bundles.
StandardCoder<T> - Class in com.google.cloud.dataflow.sdk.coders: A StandardCoder is one that defines equality, hashing, and printing via the class name and recursively using StandardCoder.getComponents().
StandardCoder() - Constructor for class com.google.cloud.dataflow.sdk.coders.StandardCoder
start() - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.DatastoreReader
start() - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSource.FileBasedReader
start() - Method in interface com.google.cloud.dataflow.sdk.io.Source.Reader: Initializes the reader and advances the reader to the first record.
start() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.IntervalWindow: Returns the start of this window, inclusive.
startBundle(DoFn<I, O>.Context) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFn: Prepares this DoFn instance for processing a batch of elements.
startBundle() - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnTester: Calls DoFn.startBundle(com.google.cloud.dataflow.sdk.transforms.DoFn<I, O>.Context) on the DoFn under test.
startBundle(DoFn<I, O>.Context) - Method in class com.google.cloud.dataflow.sdk.transforms.RateLimiting.RateLimitingDoFn
startReading(ReadableByteChannel) - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSource.FileBasedReader: Performs any initialization of the subclass of FileBasedReader that involves IO operations.
store(CodedTupleTag<T>, T) - Method in interface com.google.cloud.dataflow.sdk.transforms.DoFn.KeyedState: Updates this KeyedState in place so that the given tag maps to the given value.
StreamingOptions - Interface in com.google.cloud.dataflow.sdk.options: Options used to configure streaming.
StringDelegateCoder<T> - Class in com.google.cloud.dataflow.sdk.coders: A StringDelegateCoder<T> wraps a Coder<String> and encodes/decodes values of type T via string representations.
StringDelegateCoder(Class<T>) - Constructor for class com.google.cloud.dataflow.sdk.coders.StringDelegateCoder
StringUtf8Coder - Class in com.google.cloud.dataflow.sdk.coders: A StringUtf8Coder encodes Java Strings in UTF-8 encoding.
subscription(String) - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read.Bound: Returns a new PubsubIO.Read PTransform that's like this one but reading from the given subscription.
subscription(String) - Static method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read: Creates and returns a PubsubIO.Read PTransform for reading from a specific Pubsub subscription.
Sum - Class in com.google.cloud.dataflow.sdk.transforms: PTransforms for computing the sum of the elements in a PCollection, or the sum of the values associated with each key in a PCollection of KVs.
Sum() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Sum
Sum.SumDoubleFn - Class in com.google.cloud.dataflow.sdk.transforms: A SerializableFunction that computes the sum of an Iterable of Doubles, useful as an argument to Combine.globally(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>) or Combine.perKey(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>).
Sum.SumDoubleFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Sum.SumDoubleFn
Sum.SumIntegerFn - Class in com.google.cloud.dataflow.sdk.transforms: A SerializableFunction that computes the sum of an Iterable of Integers, useful as an argument to Combine.globally(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>) or Combine.perKey(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>).
Sum.SumIntegerFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Sum.SumIntegerFn
Sum.SumLongFn - Class in com.google.cloud.dataflow.sdk.transforms: A SerializableFunction that computes the sum of an Iterable of Longs, useful as an argument to Combine.globally(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>) or Combine.perKey(com.google.cloud.dataflow.sdk.transforms.SerializableFunction<java.lang.Iterable<V>, V>).
Sum.SumLongFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Sum.SumLongFn

T

TableRowJsonCoder - Class in com.google.cloud.dataflow.sdk.coders: A TableRowJsonCoder encodes BigQuery TableRow objects.
takeOutputElements() - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnTester: Returns the elements output so far to the main output.
takeSideOutputElements(TupleTag<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnTester: Returns the elements output so far to the side output with the given tag.
TestDataflowPipelineOptions - Interface in com.google.cloud.dataflow.sdk.testing: A set of options used to configure the TestPipeline.
TestDataflowPipelineRunner - Class in com.google.cloud.dataflow.sdk.testing: TestDataflowPipelineRunner is a pipeline runner that wraps a DataflowPipelineRunner when running tests against the TestPipeline.
TestPipeline - Class in com.google.cloud.dataflow.sdk.testing: A creator of test pipelines which can be used inside of tests that can be configured to run locally or against the live service.
TextIO - Class in com.google.cloud.dataflow.sdk.io: Transforms for reading and writing text files.
TextIO() - Constructor for class com.google.cloud.dataflow.sdk.io.TextIO
TextIO.CompressionType - Enum in com.google.cloud.dataflow.sdk.io: Possible text file compression types.
TextIO.Read - Class in com.google.cloud.dataflow.sdk.io: A root PTransform that reads from a text file (or multiple text files matching a pattern) and returns a PCollection containing the decoding of each of the lines of the text file(s).
TextIO.Read() - Constructor for class com.google.cloud.dataflow.sdk.io.TextIO.Read
TextIO.Read.Bound<T> - Class in com.google.cloud.dataflow.sdk.io: A root PTransform that reads from a text file (or multiple text files matching a pattern) and returns a bounded PCollection containing the decoding of each of the lines of the text file(s).
TextIO.Write - Class in com.google.cloud.dataflow.sdk.io: A PTransform that writes a PCollection to a text file (or multiple text files matching a sharding pattern), with each PCollection element being encoded into its own line.
TextIO.Write() - Constructor for class com.google.cloud.dataflow.sdk.io.TextIO.Write
TextIO.Write.Bound<T> - Class in com.google.cloud.dataflow.sdk.io: A PTransform that writes a bounded PCollection to a text file (or multiple text files matching a sharding pattern), with each PCollection element being encoded into its own line.
TextualIntegerCoder - Class in com.google.cloud.dataflow.sdk.coders: A TextualIntegerCoder encodes Integers as text.
that(PCollection<T>) - Static method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert: Constructs an DataflowAssert.IterableAssert for the elements of the provided PCollection<T>.
thatIterable(PCollectionView<Iterable<T>>) - Static method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert: Constructs an DataflowAssert.IterableAssert for the value of the provided PCollectionView PCollectionView<Iterable<T>>.
thatSingleton(PCollection<T>) - Static method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert: Constructs a DataflowAssert.SingletonAssert for the value of the provided PCollection PCollection<T>, which must be a singleton.
thatSingletonIterable(PCollection<Iterable<T>>) - Static method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert: Constructs an DataflowAssert.IterableAssert for the value of the provided PCollection<Iterable<T>>, which must be a singleton.
timestamp() - Method in class com.google.cloud.dataflow.sdk.transforms.DoFn.ProcessContext: Returns the timestamp of the input element.
timestamp() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.WindowFn.AssignContext: Returns the timestamp of the current element.
TIMESTAMP_MAX_VALUE - Static variable in class com.google.cloud.dataflow.sdk.transforms.windowing.BoundedWindow
TIMESTAMP_MIN_VALUE - Static variable in class com.google.cloud.dataflow.sdk.transforms.windowing.BoundedWindow
timestamped(Iterable<TimestampedValue<T>>) - Static method in class com.google.cloud.dataflow.sdk.transforms.Create: Returns a new root transform that produces a PCollection containing the specified elements with the specified timestamps.
timestamped(TimestampedValue<T>...) - Static method in class com.google.cloud.dataflow.sdk.transforms.Create: Returns a new root transform that produces a PCollection containing the specified elements with the specified timestamps.
timestamped(Iterable<T>, Iterable<Long>) - Static method in class com.google.cloud.dataflow.sdk.transforms.Create: Returns a new root transform that produces a PCollection containing the specified elements with the specified timestamps.
TimestampedValue<V> - Class in com.google.cloud.dataflow.sdk.values: An immutable (value, timestamp) pair.
TimestampedValue(V, Instant) - Constructor for class com.google.cloud.dataflow.sdk.values.TimestampedValue
TimestampedValue.TimestampedValueCoder<T> - Class in com.google.cloud.dataflow.sdk.values: Coder for TimestampedValue.
timestampLabel(String) - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read.Bound: Returns a new PubsubIO.Read PTransform that's like this one but reading timestamps from the given PubSub label.
timestampLabel(String) - Static method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read: Creates and returns a PubsubIO.Read PTransform where record timestamps are expected to be provided using the PubSub labeling API.
timestampLabel(String) - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Write.Bound: Returns a new PubsubIO.Write PTransform that's like this one but publishing timestamps to the given PubSub label.
timestampLabel(String) - Static method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Write: If specified, Dataflow will add a Pubsub label to each output record specifying the logical timestamp of the record.
to(String) - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound: Returns a new AvroIO.Write PTransform that's like this one but that writes to the file(s) with the given filename prefix.
to(String) - Static method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write: Returns an AvroIO.Write PTransform that writes to the file(s) with the given prefix.
to(String) - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.Bound: Specifies the table specification.
to(TableReference) - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.Bound: Specifies the table to be written to.
to(String) - Static method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write: Creates a write transformation for the given table specification.
to(TableReference) - Static method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write: Creates a write transformation for the given table.
to(String) - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.Sink: Returns a DatastoreIO.Write PTransform with given datasetId.
to(String) - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Write.Bound: Returns a new TextIO.Write PTransform that's like this one but that writes to the file(s) with the given filename prefix.
to(String) - Static method in class com.google.cloud.dataflow.sdk.io.TextIO.Write: Returns a TextIO.Write PTransform that writes to the file(s) with the given prefix.
Top - Class in com.google.cloud.dataflow.sdk.transforms: PTransforms for finding the largest (or smallest) set of elements in a PCollection, or the largest (or smallest) set of values associated with each key in a PCollection of KVs.
Top() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Top
Top.Largest<T extends java.lang.Comparable<T>> - Class in com.google.cloud.dataflow.sdk.transforms: Serializable Comparator that that uses the compared elements' natural ordering.
Top.Largest() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Top.Largest
Top.Smallest<T extends java.lang.Comparable<T>> - Class in com.google.cloud.dataflow.sdk.transforms: Serializable Comparator that that uses the reverse of the compared elements' natural ordering.
Top.Smallest() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Top.Smallest
Top.TopCombineFn<T> - Class in com.google.cloud.dataflow.sdk.transforms: CombineFn for Top transforms that combines a bunch of Ts into a single count-long List<T>, using compareFn to choose the largest Ts.
Top.TopCombineFn(int, C) - Constructor for class com.google.cloud.dataflow.sdk.transforms.Top.TopCombineFn
topic(String) - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read.Bound: Returns a new PubsubIO.Read PTransform that's like this one but reading from the give topic.
topic(String) - Static method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read: Creates and returns a PubsubIO.Read PTransform for reading from a Pubsub topic with the specified publisher topic.
topic(String) - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Write.Bound: Returns a new PubsubIO.Write PTransform that's like this one but writing to the given topic.
topic(String) - Static method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Write: The topic to publish to.
toString() - Method in class com.google.cloud.dataflow.sdk.coders.DelegateCoder
toString() - Method in class com.google.cloud.dataflow.sdk.coders.StandardCoder
toString() - Method in class com.google.cloud.dataflow.sdk.coders.StringDelegateCoder
toString() - Method in class com.google.cloud.dataflow.sdk.io.ByteOffsetBasedSource
toString() - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.Source
toString() - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSource
toString() - Method in class com.google.cloud.dataflow.sdk.options.DataflowWorkerLoggingOptions.WorkerLogLevelOverride
toString() - Method in class com.google.cloud.dataflow.sdk.options.GoogleApiDebugOptions.GoogleApiTracer
toString() - Method in class com.google.cloud.dataflow.sdk.Pipeline
toString() - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineRunner
toString() - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator
toString() - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner
toString() - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult
toString() - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResultSchema
toString() - Method in class com.google.cloud.dataflow.sdk.transforms.join.RawUnionValue
toString() - Method in class com.google.cloud.dataflow.sdk.transforms.PTransform
toString() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.IntervalWindow
toString() - Method in class com.google.cloud.dataflow.sdk.values.CodedTupleTag
toString() - Method in class com.google.cloud.dataflow.sdk.values.KV
toString() - Method in class com.google.cloud.dataflow.sdk.values.PValueBase
toString() - Method in class com.google.cloud.dataflow.sdk.values.TupleTag
toTableSpec(TableReference) - Static method in class com.google.cloud.dataflow.sdk.io.BigQueryIO: Returns a canonical string representation of the TableReference.
TransformHierarchy - Class in com.google.cloud.dataflow.sdk.runners: Captures information about a collection of transformations and their associated PValues.
TransformHierarchy() - Constructor for class com.google.cloud.dataflow.sdk.runners.TransformHierarchy
transforms - Variable in class com.google.cloud.dataflow.sdk.runners.RecordingPipelineVisitor
TransformTreeNode - Class in com.google.cloud.dataflow.sdk.runners: Provides internal tracking of transform relationships with helper methods for initialization and ordered visitation.
TransformTreeNode(TransformTreeNode, PTransform<?, ?>, String, PInput) - Constructor for class com.google.cloud.dataflow.sdk.runners.TransformTreeNode: Creates a new TransformTreeNode with the given parent and transform.
translate(PT, DataflowPipelineTranslator.TranslationContext) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TransformTranslator
translate(Pipeline, List<DataflowPackage>) - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator: Translates a Pipeline into a Job.
traverseTopologically(Pipeline.PipelineVisitor) - Method in class com.google.cloud.dataflow.sdk.Pipeline: Invokes the PipelineVisitor's Pipeline.PipelineVisitor.visitTransform(com.google.cloud.dataflow.sdk.runners.TransformTreeNode) and Pipeline.PipelineVisitor.visitValue(com.google.cloud.dataflow.sdk.values.PValue, com.google.cloud.dataflow.sdk.runners.TransformTreeNode) operations on each of this Pipeline's PTransforms and PValues, in forward topological order.
TupleTag<V> - Class in com.google.cloud.dataflow.sdk.values: A TupleTag is a typed tag to use as the key of a heterogeneously typed tuple, like PCollectionTuple or Its generic type parameter allows tracking the static type of things stored in tuples.
TupleTag() - Constructor for class com.google.cloud.dataflow.sdk.values.TupleTag: Constructs a new TupleTag, with a fresh unique id.
TupleTag(String) - Constructor for class com.google.cloud.dataflow.sdk.values.TupleTag: Constructs a new TupleTag with the given id.
TupleTagList - Class in com.google.cloud.dataflow.sdk.values: A TupleTagList is an immutable list of heterogeneously typed TupleTags.
TypedPValue<T> - Class in com.google.cloud.dataflow.sdk.values: A TypedPValue<T> is the abstract base class of things that store some number of values of type T.
TypedPValue() - Constructor for class com.google.cloud.dataflow.sdk.values.TypedPValue

V

validate() - Method in class com.google.cloud.dataflow.sdk.io.ByteOffsetBasedSource
validate() - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.Source
validate() - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSource
validate() - Method in class com.google.cloud.dataflow.sdk.io.Source: Checks that this source is valid, before it can be used in a pipeline.
validate(Class<T>, PipelineOptions) - Static method in class com.google.cloud.dataflow.sdk.options.PipelineOptionsValidator: Validates that the passed PipelineOptions conforms to all the validation criteria from the passed in interface.
validateSubscriptionName(String) - Static method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Validator
validateTopicName(String) - Static method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Validator
Validation - Annotation Type in com.google.cloud.dataflow.sdk.options: Validation represents a set of annotations which can be used to annotate getter properties on PipelineOptions with information representing the validation criteria to be used when validating with the PipelineOptionsValidator.
Validation.Required - Annotation Type in com.google.cloud.dataflow.sdk.options: This criteria specifies that the value must be not null.
valueOf(String) - Static method in enum com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.CreateDisposition: Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.WriteDisposition: Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.google.cloud.dataflow.sdk.io.FileBasedSource.Mode: Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.google.cloud.dataflow.sdk.io.TextIO.CompressionType: Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions.AutoscalingAlgorithmType: Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions.ClusterManagerApiType: Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions.TeardownPolicy: Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.google.cloud.dataflow.sdk.options.DataflowWorkerLoggingOptions.Level: Returns the enum constant of this type with the specified name.
values() - Static method in enum com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.CreateDisposition: Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.WriteDisposition: Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum com.google.cloud.dataflow.sdk.io.FileBasedSource.Mode: Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum com.google.cloud.dataflow.sdk.io.TextIO.CompressionType: Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions.AutoscalingAlgorithmType: Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions.ClusterManagerApiType: Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum com.google.cloud.dataflow.sdk.options.DataflowPipelineWorkerPoolOptions.TeardownPolicy: Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum com.google.cloud.dataflow.sdk.options.DataflowWorkerLoggingOptions.Level: Returns an array containing the constants of this enum type, in the order they are declared.
values - Variable in class com.google.cloud.dataflow.sdk.runners.RecordingPipelineVisitor
Values<V> - Class in com.google.cloud.dataflow.sdk.transforms: Values<V> takes a PCollection of KV<K, V>s and returns a PCollection<V> of the values.
VarIntCoder - Class in com.google.cloud.dataflow.sdk.coders: A VarIntCoder encodes Integers using between 1 and 5 bytes.
VarLongCoder - Class in com.google.cloud.dataflow.sdk.coders: A VarLongCoder encodes longs using between 1 and 10 bytes.
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.AvroCoder: Raises an exception describing reasons why the type may not be deterministically encoded using the given Schema, the directBinaryEncoder, and the ReflectDatumWriter or GenericDatumWriter.
verifyDeterministic() - Method in interface com.google.cloud.dataflow.sdk.coders.Coder: Throw Coder.NonDeterministicException if the coding is not deterministic.
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.DelegateCoder
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.DoubleCoder
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.EntityCoder
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.InstantCoder
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.IterableLikeCoder
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.KvCoder
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.ListCoder
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.MapCoder
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.SerializableCoder
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.SetCoder
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.StandardCoder
verifyDeterministic(String, Iterable<Coder<?>>) - Method in class com.google.cloud.dataflow.sdk.coders.StandardCoder
verifyDeterministic(String, Coder<?>...) - Method in class com.google.cloud.dataflow.sdk.coders.StandardCoder
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.StringUtf8Coder
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.TableRowJsonCoder
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.TextualIntegerCoder
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.VarIntCoder
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.VarLongCoder
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.coders.VoidCoder
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult.CoGbkResultCoder
verifyDeterministic() - Method in class com.google.cloud.dataflow.sdk.values.TimestampedValue.TimestampedValueCoder
View - Class in com.google.cloud.dataflow.sdk.transforms: Transforms for creating PCollectionViews from PCollections, for consuming the contents of those PCollections as side inputs to ParDo transforms.
View.AsIterable<T> - Class in com.google.cloud.dataflow.sdk.transforms: A PTransform that produces a PCollectionView of a singleton PCollection yielding the single element it contains.
View.AsMultimap<K,V> - Class in com.google.cloud.dataflow.sdk.transforms: A PTransform that produces a PCollectionView of a keyed PCollection yielding a map of keys to all associated values.
View.AsSingleton<T> - Class in com.google.cloud.dataflow.sdk.transforms: A PTransform that produces a PCollectionView of a singleton PCollection yielding the single element it contains.
View.AsSingletonMap<K,VI,VO> - Class in com.google.cloud.dataflow.sdk.transforms: A PTransform that produces a PCollectionView of a keyed PCollection yielding a map of keys to a single associated values.
View.CreatePCollectionView<R,T> - Class in com.google.cloud.dataflow.sdk.transforms: Creates a primitive PCollectionView.
View.CreatePCollectionView(PCollectionView<T>) - Constructor for class com.google.cloud.dataflow.sdk.transforms.View.CreatePCollectionView
visit(Pipeline.PipelineVisitor, Set<PValue>) - Method in class com.google.cloud.dataflow.sdk.runners.TransformHierarchy: Visits all nodes in the transform hierarchy, in transitive order.
visit(Pipeline.PipelineVisitor, Set<PValue>) - Method in class com.google.cloud.dataflow.sdk.runners.TransformTreeNode: Visit the transform node.
visitTransform(TransformTreeNode) - Method in interface com.google.cloud.dataflow.sdk.Pipeline.PipelineVisitor
visitTransform(TransformTreeNode) - Method in class com.google.cloud.dataflow.sdk.runners.RecordingPipelineVisitor
visitValue(PValue, TransformTreeNode) - Method in interface com.google.cloud.dataflow.sdk.Pipeline.PipelineVisitor
visitValue(PValue, TransformTreeNode) - Method in class com.google.cloud.dataflow.sdk.runners.RecordingPipelineVisitor
VoidCoder - Class in com.google.cloud.dataflow.sdk.coders: A VoidCoder encodes Voids.

W

waitToFinish(long, TimeUnit, MonitoringUtil.JobMessagesHandler) - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineJob: Wait for the job to finish and return the final status.
weeks(int, int) - Static method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows: Returns a WindowFn that windows elements into periods measured by weeks.
window() - Method in class com.google.cloud.dataflow.sdk.transforms.DoFn.ProcessContext: Returns the window into which the input element has been assigned.
Window - Class in com.google.cloud.dataflow.sdk.transforms.windowing: Window logically divides up or groups the elements of a PCollection into finite windows according to a WindowFn.
Window() - Constructor for class com.google.cloud.dataflow.sdk.transforms.windowing.Window
Window.Bound<T> - Class in com.google.cloud.dataflow.sdk.transforms.windowing: A PTransform that windows the elements of a PCollection<T>, into finite windows according to a user-specified WindowFn<T, B>.
Window.Remerge<T> - Class in com.google.cloud.dataflow.sdk.transforms.windowing: PTransform that does not change assigned windows, but will cause windows to be merged again as part of the next GroupByKey.
Window.Remerge() - Constructor for class com.google.cloud.dataflow.sdk.transforms.windowing.Window.Remerge
Window.Unbound - Class in com.google.cloud.dataflow.sdk.transforms.windowing: An incomplete Window transform, with unbound input/output type.
windowCoder() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.DaysWindows
windowCoder() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.MonthsWindows
windowCoder() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.YearsWindows
windowCoder() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.FixedWindows
windowCoder() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.GlobalWindows
windowCoder() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.InvalidWindows
windowCoder() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Sessions
windowCoder() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.SlidingWindows
windowCoder() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.WindowFn: Returns the Coder used for serializing the windows used by this windowFn.
WindowFn<T,W extends BoundedWindow> - Class in com.google.cloud.dataflow.sdk.transforms.windowing: The argument to the Window transform used to assign elements into windows and to determine how windows are merged.
WindowFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.windowing.WindowFn
WindowFn.AssignContext - Class in com.google.cloud.dataflow.sdk.transforms.windowing: Information available when running WindowFn.assignWindows(com.google.cloud.dataflow.sdk.transforms.windowing.WindowFn<T, W>.AssignContext).
WindowFn.AssignContext() - Constructor for class com.google.cloud.dataflow.sdk.transforms.windowing.WindowFn.AssignContext
WindowFn.MergeContext - Class in com.google.cloud.dataflow.sdk.transforms.windowing: Information available when running WindowFn.mergeWindows(com.google.cloud.dataflow.sdk.transforms.windowing.WindowFn<T, W>.MergeContext).
WindowFn.MergeContext() - Constructor for class com.google.cloud.dataflow.sdk.transforms.windowing.WindowFn.MergeContext
WindowFnTestUtils - Class in com.google.cloud.dataflow.sdk.testing: A utility class for testing WindowFns.
WindowFnTestUtils() - Constructor for class com.google.cloud.dataflow.sdk.testing.WindowFnTestUtils
windows() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.WindowFn.AssignContext: Returns the windows the current element was in, prior to this AssignFn being called.
windows() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.WindowFn.MergeContext: Returns the current set of windows.
withCoder(Coder<T1>) - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Read.Bound: Returns a new TextIO.Read PTransform that's like this one but that uses the given Coder<T1> to decode each of the lines of the file into a value of type T1.
withCoder(Coder<T>) - Static method in class com.google.cloud.dataflow.sdk.io.TextIO.Read: Returns a TextIO.Read PTransform that uses the given Coder<T> to decode each of the lines of the file into a value of type T.
withCoder(Coder<T1>) - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Write.Bound: Returns a new TextIO.Write PTransform that's like this one but that uses the given Coder<T1> to encode each of the elements of the input PCollection<T1> into an output text line.
withCoder(Coder<T>) - Static method in class com.google.cloud.dataflow.sdk.io.TextIO.Write: Returns a TextIO.Write PTransform that uses the given Coder<T> to encode each of the elements of the input PCollection<T> into an output text line.
withCombiner(Combine.CombineFn<V, ?, VO>) - Method in class com.google.cloud.dataflow.sdk.transforms.View.AsMultimap: Returns a PTransform creating a view as a Map<K, VO> rather than a Map<K, Iterable<V>> by applying the given combiner to the set of values associated with each key.
withCompressionType(TextIO.CompressionType) - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Read.Bound: Returns a new TextIO.Read PTransform that's like this one but reads from input sources using the specified compression type.
withCompressionType(TextIO.CompressionType) - Static method in class com.google.cloud.dataflow.sdk.io.TextIO.Read: Returns a TextIO.Read PTransform that reads from a file with the specified compression type.
withCreateDisposition(BigQueryIO.Write.CreateDisposition) - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.Bound: Specifies options for creating the table.
withCreateDisposition(BigQueryIO.Write.CreateDisposition) - Static method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write: Specifies options for creating the table.
withDataset(String) - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.Source
withDefaultValue(T) - Method in class com.google.cloud.dataflow.sdk.transforms.View.AsSingleton: Default value to return for windows with no value in them.
withEncodabilityTesting(boolean) - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner: Enable runtime testing to verify that all values can be encoded.
withEpsilon(double) - Method in class com.google.cloud.dataflow.sdk.transforms.ApproximateQuantiles.ApproximateQuantilesCombineFn: Returns an ApproximateQuantilesCombineFn that's like this one except that it uses the specified epsilon value.
withExtensionsFrom(Class<?>...) - Method in class com.google.cloud.dataflow.sdk.coders.Proto2Coder: Adds custom Protobuf extensions to the coder.
withGapDuration(Duration) - Static method in class com.google.cloud.dataflow.sdk.transforms.windowing.Sessions: Creates a Sessions WindowFn with the specified gap duration.
withHost(String) - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.Sink: Returns a new DatastoreIO.Write PTransform with specified host.
withHost(String) - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.Source
withHotKeys(SerializableFunction<? super K, Integer>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.PerKey: If a single key has disproportionately many values, it may become a bottleneck, especially in streaming mode.
withHotKeys(int) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.PerKey: Like Combine.PerKey.withHotKeys(SerializableFunction), but returning the given constant value for every key.
withKey(Object) - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.ValueWithMetadata: Returns a new ValueWithMetadata with the implicit key associated with this value set.
WithKeys<K,V> - Class in com.google.cloud.dataflow.sdk.transforms: WithKeys<K, V> takes a PCollection<V>, and either a constant key of type K or a function from V to K, and returns a PCollection<KV<K, V>>, where each of the values in the input PCollection has been paired with either the constant key or a key computed from the value.
withMaxInputSize(long) - Method in class com.google.cloud.dataflow.sdk.transforms.ApproximateQuantiles.ApproximateQuantilesCombineFn: Returns an ApproximateQuantilesCombineFn that's like this one except that it uses the specified maxNumElements value.
withMaxParallelism(int) - Method in class com.google.cloud.dataflow.sdk.transforms.RateLimiting.RateLimitingTransform: Modifies this RateLimitingTransform, specifying a maximum per-worker parallelism.
withMockEstimateSizeBytes(Supplier<Long>) - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.Source: For testing only.
withName(String) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.Globally
withName(String) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.GloballyAsSingletonView
withName(String) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.PerKey
withName(String) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.PerKeyWithHotKeys
withName(String) - Method in class com.google.cloud.dataflow.sdk.transforms.PTransform: Sets the base name of this PTransform and returns itself.
withNumShards(int) - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound: Returns a new AvroIO.Write PTransform that's like this one but that uses the provided shard count.
withNumShards(int) - Static method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write: Returns an AvroIO.Write PTransform that uses the provided shard count.
withNumShards(int) - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Write.Bound: Returns a new TextIO.Write PTransform that's like this one but that uses the provided shard count.
withNumShards(int) - Static method in class com.google.cloud.dataflow.sdk.io.TextIO.Write: Returns a TextIO.Write PTransform that uses the provided shard count.
withOffset(Duration) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.FixedWindows: Partitions the timestamp space into half-open intervals of the form [N * size + offset, (N + 1) * size + offset), where 0 is the epoch.
withOffset(Duration) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.SlidingWindows: Assigns timestamps into half-open intervals of the form [N * period + offset, N * period + offset + size).
withoutDefaults() - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.Globally: Returns a PTransform identical to this, but that does not attempt to provide a default value in the case of empty input.
withOutputTags(TupleTag<O>, TupleTagList) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.Bound: Returns a new multi-output ParDo PTransform that's like this PTransform but with the specified main and side output tags.
withOutputTags(TupleTag<O>, TupleTagList) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.Unbound: Returns a new multi-output ParDo transform that's like this transform but with the specified main and side output tags.
withOutputTags(TupleTag<O>, TupleTagList) - Static method in class com.google.cloud.dataflow.sdk.transforms.ParDo: Creates a multi-output ParDo PTransform whose output PCollections will be referenced using the given main output and side output tags.
withoutSharding() - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound: Returns a new AvroIO.Write PTransform that's like this one but that forces a single file as output.
withoutSharding() - Static method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write: Returns an AvroIO.Write PTransform that forces a single file as output.
withoutSharding() - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Write.Bound: Returns a new TextIO.Write PTransform that's like this one but that forces a single file as output.
withoutSharding() - Static method in class com.google.cloud.dataflow.sdk.io.TextIO.Write: Returns a TextIO.Write PTransform that forces a single file as output.
withoutStrictParsing() - Method in class com.google.cloud.dataflow.sdk.options.PipelineOptionsFactory.Builder: During parsing of the arguments, we will skip over improperly formatted and unknown arguments.
withoutValidation() - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Read.Bound: Returns a new TextIO.Read PTransform that's like this one but that has GCS input path validation on pipeline creation disabled.
withoutValidation() - Static method in class com.google.cloud.dataflow.sdk.io.AvroIO.Read: Returns a AvroIO.Read PTransform that has GCS path validation on pipeline creation disabled.
withoutValidation() - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound: Returns a new TextIO.Write PTransform that's like this one but that has GCS output path validation on pipeline creation disabled.
withoutValidation() - Static method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write: Returns a AvroIO.Write PTransform that has GCS path validation on pipeline creation disabled.
withoutValidation() - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Read.Bound: Disable table validation.
withoutValidation() - Static method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Read: Disables BigQuery table validation which is enabled by default.
withoutValidation() - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.Bound: Disable table validation.
withoutValidation() - Static method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write: Disables BigQuery table validation which is enabled by default.
withoutValidation() - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Read.Bound: Returns a new TextIO.Read PTransform that's like this one but that has GCS path validation on pipeline creation disabled.
withoutValidation() - Static method in class com.google.cloud.dataflow.sdk.io.TextIO.Read: Returns a TextIO.Read PTransform that has GCS path validation on pipeline creation disabled.
withoutValidation() - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Write.Bound: Returns a new TextIO.Write PTransform that's like this one but that has GCS output path validation on pipeline creation disabled.
withoutValidation() - Static method in class com.google.cloud.dataflow.sdk.io.TextIO.Write: Returns a TextIO.Write PTransform that has GCS path validation on pipeline creation disabled.
withQuery(DatastoreV1.Query) - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.Source
withRateLimit(double) - Method in class com.google.cloud.dataflow.sdk.transforms.RateLimiting.RateLimitingTransform: Modifies this RateLimitingTransform, specifying a maximum per-worker element processing rate.
withSchema(Class<T1>) - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Read.Bound: Returns a new AvroIO.Read PTransform that's like this one but that reads Avro file(s) containing records whose type is the specified Avro-generated class.
withSchema(Schema) - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Read.Bound: Returns a new AvroIO.Read PTransform that's like this one but that reads Avro file(s) containing records of the specified schema.
withSchema(String) - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Read.Bound: Returns a new AvroIO.Read PTransform that's like this one but that reads Avro file(s) containing records of the specified schema in a JSON-encoded string form.
withSchema(Class<T>) - Static method in class com.google.cloud.dataflow.sdk.io.AvroIO.Read: Returns an AvroIO.Read PTransform that reads Avro file(s) containing records whose type is the specified Avro-generated class.
withSchema(Schema) - Static method in class com.google.cloud.dataflow.sdk.io.AvroIO.Read: Returns an AvroIO.Read PTransform that reads Avro file(s) containing records of the specified schema.
withSchema(String) - Static method in class com.google.cloud.dataflow.sdk.io.AvroIO.Read: Returns an AvroIO.Read PTransform that reads Avro file(s) containing records of the specified schema in a JSON-encoded string form.
withSchema(Class<T1>) - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound: Returns a new AvroIO.Write PTransform that's like this one but that writes to Avro file(s) containing records whose type is the specified Avro-generated class.
withSchema(Schema) - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound: Returns a new AvroIO.Write PTransform that's like this one but that writes to Avro file(s) containing records of the specified schema.
withSchema(String) - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound: Returns a new AvroIO.Write PTransform that's like this one but that writes to Avro file(s) containing records of the specified schema in a JSON-encoded string form.
withSchema(Class<T>) - Static method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write: Returns an AvroIO.Write PTransform that writes Avro file(s) containing records whose type is the specified Avro-generated class.
withSchema(Schema) - Static method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write: Returns an AvroIO.Write PTransform that writes Avro file(s) containing records of the specified schema.
withSchema(String) - Static method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write: Returns an AvroIO.Write PTransform that writes Avro file(s) containing records of the specified schema in a JSON-encoded string form.
withSchema(TableSchema) - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.Bound: Specifies the table schema, used if the table is created.
withSchema(TableSchema) - Static method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write: Specifies a table schema to use in table creation.
withSerializabilityTesting(boolean) - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner: Enable runtime testing to verify that all functions and Coder instances can be serialized.
withShardNameTemplate(String) - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound: Returns a new AvroIO.Write PTransform that's like this one but that uses the given shard name template.
withShardNameTemplate(String) - Static method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write: Returns an AvroIO.Write PTransform that uses the given shard name template.
withShardNameTemplate(String) - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Write.Bound: Returns a new TextIO.Write PTransform that's like this one but that uses the given shard name template.
withShardNameTemplate(String) - Static method in class com.google.cloud.dataflow.sdk.io.TextIO.Write: Returns a TextIO.Write PTransform that uses the given shard name template.
withSideInputs(PCollectionView<?>...) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.Bound: Returns a new ParDo PTransform that's like this PTransform but with the specified side inputs.
withSideInputs(Iterable<? extends PCollectionView<?>>) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.Bound: Returns a new ParDo PTransform that's like this PTransform but with the specified side inputs.
withSideInputs(PCollectionView<?>...) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.BoundMulti: Returns a new multi-output ParDo PTransform that's like this PTransform but with the specified side inputs.
withSideInputs(Iterable<? extends PCollectionView<?>>) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.BoundMulti: Returns a new multi-output ParDo PTransform that's like this PTransform but with the specified side inputs.
withSideInputs(PCollectionView<?>...) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.Unbound: Returns a new ParDo transform that's like this transform but with the specified side inputs.
withSideInputs(Iterable<? extends PCollectionView<?>>) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.Unbound: Returns a new ParDo transform that's like this transform but with the specified side inputs.
withSideInputs(PCollectionView<?>...) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.UnboundMulti: Returns a new multi-output ParDo transform that's like this transform but with the specified side inputs.
withSideInputs(Iterable<? extends PCollectionView<?>>) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.UnboundMulti: Returns a new multi-output ParDo transform that's like this transform but with the specified side inputs.
withSideInputs(PCollectionView<?>...) - Static method in class com.google.cloud.dataflow.sdk.transforms.ParDo: Creates a ParDo PTransform with the given side inputs.
withSideInputs(Iterable<? extends PCollectionView<?>>) - Static method in class com.google.cloud.dataflow.sdk.transforms.ParDo: Creates a ParDo with the given side inputs.
withSingletonValues() - Method in class com.google.cloud.dataflow.sdk.transforms.View.AsMultimap: Returns a PTransform creating a view as a Map<K, V> rather than a Map<K, Iterable<V>>.
withStartingDay(int, int, int) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.DaysWindows
withStartingMonth(int, int) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.MonthsWindows
withStartingYear(int) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.YearsWindows
withSuffix(String) - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound: Returns a new AvroIO.Write PTransform that's like this one but that writes to the file(s) with the given filename suffix.
withSuffix(String) - Static method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write: Returns an AvroIO.Write PTransform that writes to the file(s) with the given filename suffix.
withSuffix(String) - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Write.Bound: Returns a new TextIO.Write PTransform that's like this one but that writes to the file(s) with the given filename suffix.
withSuffix(String) - Static method in class com.google.cloud.dataflow.sdk.io.TextIO.Write: Returns a TextIO.Write PTransform that writes to the file(s) with the given filename suffix.
withTimeZone(DateTimeZone) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.DaysWindows
withTimeZone(DateTimeZone) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.MonthsWindows
withTimeZone(DateTimeZone) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.YearsWindows
withUnorderednessTesting(boolean) - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner: Enable runtime testing to verify that functions do not depend on order of the elements.
withValidation() - Method in class com.google.cloud.dataflow.sdk.options.PipelineOptionsFactory.Builder: After creation we will validate that PipelineOptions conforms to all the validation criteria from <T>.
withValidation() - Method in class com.google.cloud.dataflow.sdk.options.PipelineOptionsFactory: After creation we will validate that PipelineOptions conforms to all the validation criteria from <T>.
withValue(T) - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.ValueWithMetadata: Returns a new ValueWithMetadata that is a copy of this one, but with a different value.
withWriteDisposition(BigQueryIO.Write.WriteDisposition) - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.Bound: Specifies options for writing the table.
withWriteDisposition(BigQueryIO.Write.WriteDisposition) - Static method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write: Specifies options for writing to the table.
write() - Static method in class com.google.cloud.dataflow.sdk.io.DatastoreIO: Returns a new DatastoreIO.Sink builder using the default host.
writeTo(String) - Static method in class com.google.cloud.dataflow.sdk.io.DatastoreIO: Returns a new DatastoreIO.Sink builder using the default host and given dataset.

Y

years(int) - Static method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows: Returns a WindowFn that windows elements into periods measured by years.

A B C D E F G H I J K L M N O P R S T V W Y