Index (Google Cloud Dataflow SDK API)

A B C D E F G H I J K L M N O P R S T V W Y

A

add(Long) - Method in class com.google.cloud.dataflow.sdk.transforms.ApproximateUnique.ApproximateUniqueCombineFn.LargestUnique: Adds a value to the heap, returning whether the value is (large enough to be) in the heap.
addCollectionToSingletonOutput(String, PValue, PValue) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Adds an output with the given name to the previously added CollectionToSingleton Dataflow step, consuming the specified input PValue and producing the specified output PValue.
addComposite(TransformTreeNode) - Method in class com.google.cloud.dataflow.sdk.runners.TransformTreeNode: Adds a composite operation to the transform node.
addEncodingInput(Coder<?>) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Sets the encoding for the current Dataflow step.
addInput(String, Boolean) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Adds an input with the given name and value to the current Dataflow step.
addInput(String, String) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Adds an input with the given name and value to the current Dataflow step.
addInput(String, Long) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Adds an input with the given name and value to the current Dataflow step.
addInput(String, PInput) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Adds an input with the given name to the previously added Dataflow step, coming from the specified input PValue.
addInput(String, Map<String, Object>) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Adds an input which is a dictionary of strings to objects.
addInput(String, List<? extends Map<String, Object>>) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Adds an input which is a list of objects.
addInput(TransformTreeNode, PInput) - Method in class com.google.cloud.dataflow.sdk.runners.TransformHierarchy: Adds an input to the given node.
addInput(ApproximateUnique.ApproximateUniqueCombineFn.LargestUnique, T) - Method in class com.google.cloud.dataflow.sdk.transforms.ApproximateUnique.ApproximateUniqueCombineFn
addInput(VI) - Method in interface com.google.cloud.dataflow.sdk.transforms.Combine.AccumulatingCombineFn.Accumulator: Adds the given input value to this accumulator, modifying this accumulator.
addInput(VA, VI) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.AccumulatingCombineFn
addInput(VA, VI) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.CombineFn: Adds the given input value to the given accumulator, modifying the accumulator.
addInput(K, VA, VI) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.KeyedCombineFn: Adds the given input value to the given accumulator, modifying the accumulator.
addInput(Top.TopCombineFn<KV<Integer, T>>.Heap, T) - Method in class com.google.cloud.dataflow.sdk.transforms.Sample.FixedSizedSampleFn
addInputProducer(PValue, TransformTreeNode) - Method in class com.google.cloud.dataflow.sdk.runners.TransformTreeNode: Adds an input to the transform node.
addInputsRandomly(Combine.KeyedCombineFn<? super K, ? super VI, VA, ?>, K, Iterable<VI>, Random) - Static method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.TestCombineDoFn
addOutput(String, PValue) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Adds an output with the given name to the previously added Dataflow step, producing the specified output PValue, including its Coder if a TypedPValue.
addStep(PTransform<?, ?>, String) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Adds a step to the Dataflow workflow for the given transform, with the given Dataflow step type.
addStep(PTransform<?, ? extends PValue>, Step) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Adds a pre-defined step to the Dataflow workflow.
addValue(VI) - Method in interface com.google.cloud.dataflow.sdk.transforms.Aggregator: Adds a new value into the Aggregator.
addValueInternal(PValue) - Method in class com.google.cloud.dataflow.sdk.Pipeline: Adds the given PValue to this Pipeline.
addValueOnlyOutput(String, PValue) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Adds an output with the given name to the previously added Dataflow step, producing the specified output PValue, including its Coder if a TypedPValue.
advance() - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.DatastoreReader
advance() - Method in interface com.google.cloud.dataflow.sdk.io.Source.Reader: Advances the iterator to the next valid record.
Aggregator<VI> - Interface in com.google.cloud.dataflow.sdk.transforms: An Aggregator enables arbitrary monitoring in user code.
and(TupleTag<V>, List<V>) - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult: Returns a new CoGbkResult based on this, with the given tag and given data added to it.
and(TupleTag<V>, PCollection<KV<K, V>>) - Method in class com.google.cloud.dataflow.sdk.transforms.join.KeyedPCollectionTuple: Returns a new KeyedPCollections<K> that is the same as this, appended with the given PCollection.
and(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.values.PCollectionList: Returns a new PCollectionList that has all the PCollections of this PCollectionList plus the given PCollection appended to the end.
and(Iterable<PCollection<T>>) - Method in class com.google.cloud.dataflow.sdk.values.PCollectionList: Returns a new PCollectionList that has all the PCollections of this PCollectionList plus the given PCollections appended to the end, in order.
and(TupleTag<T>, PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.values.PCollectionTuple: Returns a new PCollectionTuple that has all the PCollections and tags of this PCollectionTuple plus the given PCollection and tag.
and(TupleTag<?>) - Method in class com.google.cloud.dataflow.sdk.values.TupleTagList: Returns a new TupleTagList that has all the TupleTags of this TupleTagList plus the given TupleTag appended to the end.
and(List<TupleTag<?>>) - Method in class com.google.cloud.dataflow.sdk.values.TupleTagList: Returns a new TupleTagList that has all the TupleTags of this TupleTagList plus the given TupleTags appended to the end, in order.
ApplicationNameOptions - Interface in com.google.cloud.dataflow.sdk.options: Options that allow setting the application name.
apply(Input) - Method in interface com.google.cloud.dataflow.sdk.coders.DelegateCoder.CodingFunction
apply(PInput) - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Read.Bound
apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound
apply(PInput) - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Read.Bound
apply(PCollection<TableRow>) - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.Bound
apply(PCollection<DatastoreV1.Entity>) - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.Sink
apply(PInput) - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read.Bound
apply(PCollection<String>) - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Write.Bound
apply(PInput) - Method in class com.google.cloud.dataflow.sdk.io.ReadSource.Bound
apply(PInput) - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Read.Bound
apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Write.Bound
apply(PTransform<? super PBegin, Output>) - Method in class com.google.cloud.dataflow.sdk.Pipeline: Starts using this pipeline with a root PTransform such as TextIO.Read or Create.
apply(PTransform<Input, Output>, Input) - Method in class com.google.cloud.dataflow.sdk.runners.BlockingDataflowPipelineRunner
apply(PTransform<Input, Output>, Input) - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineRunner
apply(PTransform<Input, Output>, Input) - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner
apply(PTransform<Input, Output>, Input) - Method in class com.google.cloud.dataflow.sdk.runners.PipelineRunner: Applies a transform to the given input, returning the output.
apply(Actual) - Method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert.AssertThat
apply(Iterable<? extends VI>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.CombineFn: Applies this CombineFn to a collection of input values to produce a combined output value.
apply(PCollection<VI>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.Globally
apply(PCollection<? extends KV<K, ? extends Iterable<VI>>>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.GroupedValues
apply(K, Iterable<? extends VI>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.KeyedCombineFn: Applies this KeyedCombineFn to a key and a collection of input values to produce a combined output value.
apply(PCollection<KV<K, VI>>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.PerKey
apply(PCollection<KV<K, VI>>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.PerKeyWithHotKeys
apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.Count.Globally
apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.Count.PerElement
apply(PInput) - Method in class com.google.cloud.dataflow.sdk.transforms.Create
apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.First
apply(PCollection<Iterable<T>>) - Method in class com.google.cloud.dataflow.sdk.transforms.Flatten.FlattenIterables
apply(PCollectionList<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.Flatten.FlattenPCollectionList
apply(PCollection<KV<K, V>>) - Method in class com.google.cloud.dataflow.sdk.transforms.GroupByKey
apply(PCollection<KV<K, Iterable<WindowedValue<V>>>>) - Method in class com.google.cloud.dataflow.sdk.transforms.GroupByKey.GroupAlsoByWindow
apply(PCollection<KV<K, V>>) - Method in class com.google.cloud.dataflow.sdk.transforms.GroupByKey.GroupByKeyOnly
apply(PCollection<KV<K, V>>) - Method in class com.google.cloud.dataflow.sdk.transforms.GroupByKey.ReifyTimestampsAndWindows
apply(PCollection<KV<K, Iterable<WindowedValue<V>>>>) - Method in class com.google.cloud.dataflow.sdk.transforms.GroupByKey.SortValuesByTimestamp
apply(KeyedPCollectionTuple<K>) - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGroupByKey
apply(PTransform<KeyedPCollectionTuple<K>, O>) - Method in class com.google.cloud.dataflow.sdk.transforms.join.KeyedPCollectionTuple: Applies the given transform to this input.
apply(PCollection<? extends KV<K, ?>>) - Method in class com.google.cloud.dataflow.sdk.transforms.Keys
apply(PCollection<KV<A, B>>) - Method in class com.google.cloud.dataflow.sdk.transforms.KvSwap
apply(Iterable<N>) - Method in class com.google.cloud.dataflow.sdk.transforms.Max.MaxFn
apply(Iterable<N>) - Method in class com.google.cloud.dataflow.sdk.transforms.Min.MinFn
apply(PCollection<? extends I>) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.Bound
apply(PCollection<? extends I>) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.BoundMulti
apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.Partition
apply(Input) - Method in class com.google.cloud.dataflow.sdk.transforms.PTransform: Applies this PTransform on the given Input, and returns its Output.
apply(PCollection<? extends I>) - Method in class com.google.cloud.dataflow.sdk.transforms.RateLimiting.RateLimitingTransform
apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.RemoveDuplicates
apply(I) - Method in interface com.google.cloud.dataflow.sdk.transforms.SerializableFunction: Returns the result of invoking this function on the given input.
apply(Iterable<Double>) - Method in class com.google.cloud.dataflow.sdk.transforms.Sum.SumDoubleFn
apply(Iterable<Integer>) - Method in class com.google.cloud.dataflow.sdk.transforms.Sum.SumIntegerFn
apply(Iterable<Long>) - Method in class com.google.cloud.dataflow.sdk.transforms.Sum.SumLongFn
apply(PCollection<? extends KV<?, V>>) - Method in class com.google.cloud.dataflow.sdk.transforms.Values
apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.View.AsIterable
apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.View.AsSingleton
apply(PCollection<R>) - Method in class com.google.cloud.dataflow.sdk.transforms.View.CreatePCollectionView
apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window.Bound
apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window.Remerge
apply(PCollection<V>) - Method in class com.google.cloud.dataflow.sdk.transforms.WithKeys
apply(PTransform<? super PBegin, Output>) - Method in class com.google.cloud.dataflow.sdk.values.PBegin: Applies the given PTransform to this input PBegin, and returns the PTransform's Output.
apply(PTransform<? super PCollection<T>, Output>) - Method in class com.google.cloud.dataflow.sdk.values.PCollection: Applies the given PTransform to this input PCollection, and returns the PTransform's Output.
apply(PTransform<PCollectionList<T>, Output>) - Method in class com.google.cloud.dataflow.sdk.values.PCollectionList: Applies the given PTransform to this input PCollectionList<T>, and returns the PTransform's Output.
apply(PTransform<PCollectionTuple, Output>) - Method in class com.google.cloud.dataflow.sdk.values.PCollectionTuple: Applies the given PTransform to this input PCollectionTuple, and returns the PTransform's Output.
applyHelper(PCollection<KV<K, V>>, boolean, boolean) - Method in class com.google.cloud.dataflow.sdk.transforms.GroupByKey
applyTransform(Input, PTransform<? super Input, Output>) - Static method in class com.google.cloud.dataflow.sdk.Pipeline: Applies the given PTransform to the given Input, and returns its Output.
ApproximateQuantiles - Class in com.google.cloud.dataflow.sdk.transforms: PTransforms for getting an idea of a PCollection's data distribution using approximate N-tiles, either globally or per-key.
ApproximateQuantiles() - Constructor for class com.google.cloud.dataflow.sdk.transforms.ApproximateQuantiles
ApproximateQuantiles.ApproximateQuantilesCombineFn<T,C extends java.util.Comparator<T> & java.io.Serializable> - Class in com.google.cloud.dataflow.sdk.transforms: The ApproximateQuantilesCombineFn combiner gives an idea of the distribution of a collection of values using approximate N-tiles.
ApproximateUnique - Class in com.google.cloud.dataflow.sdk.transforms: PTransforms for estimating the number of distinct elements in a PCollection, or the number of distinct values associated with each key in a PCollection of KVs.
ApproximateUnique() - Constructor for class com.google.cloud.dataflow.sdk.transforms.ApproximateUnique
ApproximateUnique.ApproximateUniqueCombineFn<T> - Class in com.google.cloud.dataflow.sdk.transforms: CombineFn that computes an estimate of the number of distinct values that were combined.
ApproximateUnique.ApproximateUniqueCombineFn(long, Coder<T>) - Constructor for class com.google.cloud.dataflow.sdk.transforms.ApproximateUnique.ApproximateUniqueCombineFn
ApproximateUnique.ApproximateUniqueCombineFn.LargestUnique - Class in com.google.cloud.dataflow.sdk.transforms: A heap utility class to efficiently track the largest added elements.
ApproximateUnique.ApproximateUniqueCombineFn.LargestUnique(long) - Constructor for class com.google.cloud.dataflow.sdk.transforms.ApproximateUnique.ApproximateUniqueCombineFn.LargestUnique: Creates a heap to track the largest sampleSize elements.
as(Class<T>) - Method in interface com.google.cloud.dataflow.sdk.options.PipelineOptions: Transforms this object into an object of type .
as(Class<T>) - Static method in class com.google.cloud.dataflow.sdk.options.PipelineOptionsFactory: Creates and returns an object which implements <T>.
as(Class<T>) - Method in class com.google.cloud.dataflow.sdk.options.PipelineOptionsFactory.Builder: Creates and returns an object which implements <T> using the values configured on this builder during construction.
asCloudObject() - Method in class com.google.cloud.dataflow.sdk.coders.AvroCoder
asCloudObject() - Method in interface com.google.cloud.dataflow.sdk.coders.Coder: Returns the CloudObject that represents this Coder.
asCloudObject() - Method in class com.google.cloud.dataflow.sdk.coders.CustomCoder
asCloudObject() - Method in class com.google.cloud.dataflow.sdk.coders.IterableCoder
asCloudObject() - Method in class com.google.cloud.dataflow.sdk.coders.KvCoder
asCloudObject() - Method in class com.google.cloud.dataflow.sdk.coders.SerializableCoder
asCloudObject() - Method in class com.google.cloud.dataflow.sdk.coders.StandardCoder
asCloudObject() - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult.CoGbkResultCoder
asCloudObject() - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResultSchema
asCloudObject() - Method in class com.google.cloud.dataflow.sdk.values.TupleTag
asIterable() - Static method in class com.google.cloud.dataflow.sdk.transforms.View: Returns a View.AsIterable that takes a PCollection as input and produces a PCollectionView of the values, to be consumed as an iterable side input.
asKeyedFn() - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.CombineFn: Converts this CombineFn into an equivalent Combine.KeyedCombineFn, which ignores the keys passed to it and combines the values according to this CombineFn.
asOutputReference(PValue) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext: Encode a PValue reference as an output reference.
assertFor(Expected) - Method in interface com.google.cloud.dataflow.sdk.testing.DataflowAssert.AssertRelation
assignWindow(Instant) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.DaysWindows
assignWindow(Instant) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.MonthsWindows
assignWindow(Instant) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.YearsWindows
assignWindow(Instant) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.FixedWindows
assignWindow(Instant) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.PartitioningWindowFn: Returns the single window to which elements with this timestamp belong.
assignWindows(WindowFn<Object, GlobalWindow>.AssignContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.GlobalWindows
assignWindows(WindowFn<Object, W>.AssignContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.InvalidWindows
assignWindows(WindowFn<T, W>.AssignContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.PartitioningWindowFn
assignWindows(WindowFn<Object, IntervalWindow>.AssignContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Sessions
assignWindows(WindowFn<Object, IntervalWindow>.AssignContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.SlidingWindows
assignWindows(WindowFn<T, W>.AssignContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.WindowFn: Given a timestamp and element, returns the set of windows into which it should be placed.
asSingleton() - Static method in class com.google.cloud.dataflow.sdk.transforms.View: Returns a View.AsSingleton transform that takes a singleton PCollection as input and produces a PCollectionView of the single value, to be consumed as a side input.
AtomicCoder<T> - Class in com.google.cloud.dataflow.sdk.coders: An AtomicCoder is one that has no component Coders or other state.
AtomicCoder() - Constructor for class com.google.cloud.dataflow.sdk.coders.AtomicCoder
AvroCoder<T> - Class in com.google.cloud.dataflow.sdk.coders: An encoder using Avro binary format.
AvroCoder(Class<T>, Schema) - Constructor for class com.google.cloud.dataflow.sdk.coders.AvroCoder
AvroCoder.AvroDeterminismChecker - Class in com.google.cloud.dataflow.sdk.coders: Helper class encapsulating the various pieces of state maintained by the recursive walk used for checking if the encoding will be deterministic.
AvroCoder.AvroDeterminismChecker() - Constructor for class com.google.cloud.dataflow.sdk.coders.AvroCoder.AvroDeterminismChecker
AvroIO - Class in com.google.cloud.dataflow.sdk.io: Transforms for reading and writing Avro files.
AvroIO() - Constructor for class com.google.cloud.dataflow.sdk.io.AvroIO
AvroIO.Read - Class in com.google.cloud.dataflow.sdk.io: A root PTransform that reads from an Avro file (or multiple Avro files matching a pattern) and returns a PCollection containing the decoding of each record.
AvroIO.Read() - Constructor for class com.google.cloud.dataflow.sdk.io.AvroIO.Read
AvroIO.Read.Bound<T> - Class in com.google.cloud.dataflow.sdk.io: A PTransform that reads from an Avro file (or multiple Avro files matching a pattern) and returns a bounded PCollection containing the decoding of each record.
AvroIO.Write - Class in com.google.cloud.dataflow.sdk.io: A root PTransform that writes a PCollection to an Avro file (or multiple Avro files matching a sharding pattern).
AvroIO.Write() - Constructor for class com.google.cloud.dataflow.sdk.io.AvroIO.Write
AvroIO.Write.Bound<T> - Class in com.google.cloud.dataflow.sdk.io: A PTransform that writes a bounded PCollection to an Avro file (or multiple Avro files matching a sharding pattern).

B

begin() - Method in class com.google.cloud.dataflow.sdk.Pipeline: Returns a PBegin owned by this Pipeline.
beginningOnDay(int) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.MonthsWindows
beginningOnDay(int, int) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.YearsWindows
BigEndianIntegerCoder - Class in com.google.cloud.dataflow.sdk.coders: A BigEndianIntegerCoder encodes Integers in 4 bytes, big-endian.
BigEndianLongCoder - Class in com.google.cloud.dataflow.sdk.coders: A BigEndianLongCoder encodes Longs in 8 bytes, big-endian.
BigQueryIO - Class in com.google.cloud.dataflow.sdk.io: Transformations for reading and writing BigQuery tables.
BigQueryIO() - Constructor for class com.google.cloud.dataflow.sdk.io.BigQueryIO
BigQueryIO.Read - Class in com.google.cloud.dataflow.sdk.io: A PTransform that reads from a BigQuery table and returns a PCollection<TableRow> containing each of the rows of the table.
BigQueryIO.Read() - Constructor for class com.google.cloud.dataflow.sdk.io.BigQueryIO.Read
BigQueryIO.Read.Bound - Class in com.google.cloud.dataflow.sdk.io: A PTransform that reads from a BigQuery table and returns a bounded PCollection<TableRow>.
BigQueryIO.Write - Class in com.google.cloud.dataflow.sdk.io: A PTransform that writes a PCollection<TableRow> containing rows to a BigQuery table.
BigQueryIO.Write() - Constructor for class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write
BigQueryIO.Write.Bound - Class in com.google.cloud.dataflow.sdk.io: A PTransform that can write either a bounded or unbounded PCollection<TableRow>s to a BigQuery table.
BigQueryIO.Write.Bound() - Constructor for class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.Bound
BigQueryIO.Write.CreateDisposition - Enum in com.google.cloud.dataflow.sdk.io: An enumeration type for the BigQuery create disposition strings publicly documented as CREATE_NEVER, and CREATE_IF_NEEDED.
BigQueryIO.Write.WriteDisposition - Enum in com.google.cloud.dataflow.sdk.io: An enumeration type for the BigQuery write disposition strings publicly documented as WRITE_TRUNCATE, WRITE_APPEND, and WRITE_EMPTY.
BigQueryOptions - Interface in com.google.cloud.dataflow.sdk.options: Properties needed when using BigQuery with the Dataflow SDK.
BlockingDataflowPipelineOptions - Interface in com.google.cloud.dataflow.sdk.options: Options which are used to configure the BlockingDataflowPipelineRunner.
BlockingDataflowPipelineOptions.StandardOutputFactory - Class in com.google.cloud.dataflow.sdk.options: Returns a default of System.out.
BlockingDataflowPipelineOptions.StandardOutputFactory() - Constructor for class com.google.cloud.dataflow.sdk.options.BlockingDataflowPipelineOptions.StandardOutputFactory
BlockingDataflowPipelineRunner - Class in com.google.cloud.dataflow.sdk.runners: A PipelineRunner that's like DataflowPipelineRunner but that waits for the launched job to finish.
BlockingDataflowPipelineRunner(DataflowPipelineRunner, MonitoringUtil.JobMessagesHandler) - Constructor for class com.google.cloud.dataflow.sdk.runners.BlockingDataflowPipelineRunner
BlockingDataflowPipelineRunner.PipelineJobState - Class in com.google.cloud.dataflow.sdk.runners: Holds the status of a run request.
BlockingDataflowPipelineRunner.PipelineJobState(MonitoringUtil.JobState) - Constructor for class com.google.cloud.dataflow.sdk.runners.BlockingDataflowPipelineRunner.PipelineJobState
BoundedWindow - Class in com.google.cloud.dataflow.sdk.transforms.windowing: A BoundedWindow represents a finite grouping of elements, with an upper bound (larger timestamps represent more recent data) on the timestamps of elements that can be placed in the window.
BoundedWindow() - Constructor for class com.google.cloud.dataflow.sdk.transforms.windowing.BoundedWindow
by(C) - Static method in class com.google.cloud.dataflow.sdk.transforms.Filter: Returns a PTransform that takes an input PCollection<T> and returns a PCollection<T> with elements that satisfy the given predicate.
ByteArrayCoder - Class in com.google.cloud.dataflow.sdk.coders: A ByteArrayCoder encodes byte[] objects.

C

CalendarWindows - Class in com.google.cloud.dataflow.sdk.transforms.windowing: A collection of WindowFns that windows values into calendar-based windows such as spans of days, months, or years.
CalendarWindows() - Constructor for class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows
CalendarWindows.DaysWindows - Class in com.google.cloud.dataflow.sdk.transforms.windowing: A WindowFn that windows elements into periods measured by days.
CalendarWindows.MonthsWindows - Class in com.google.cloud.dataflow.sdk.transforms.windowing: A WindowFn that windows elements into periods measured by months.
CalendarWindows.YearsWindows - Class in com.google.cloud.dataflow.sdk.transforms.windowing: A WindowFn that windows elements into periods measured by years.
check(TypeToken<?>, Schema) - Method in class com.google.cloud.dataflow.sdk.coders.AvroCoder.AvroDeterminismChecker
clearOutputElements() - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnTester: Clears the record of the elements output so far to the main output.
clearSideOutputElements(TupleTag<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnTester: Clears the record of the elements output so far to the side output with the given tag.
close() - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.DatastoreReader
close() - Method in interface com.google.cloud.dataflow.sdk.io.Source.Reader: Closes the iterator.
CloudDebuggerOptions - Interface in com.google.cloud.dataflow.sdk.options: Options for controlling Cloud Debugger.
CloudDebuggerOptions.DebuggerConfig - Class in com.google.cloud.dataflow.sdk.options: Return a JSON string for the Debugger metadata item.
CloudDebuggerOptions.DebuggerConfig() - Constructor for class com.google.cloud.dataflow.sdk.options.CloudDebuggerOptions.DebuggerConfig
CodedTupleTag<T> - Class in com.google.cloud.dataflow.sdk.values: A TupleTag combined with the Coder to use for values associated with the tag.
CodedTupleTagMap - Class in com.google.cloud.dataflow.sdk.values: A mapping of CodedTupleTags to associated values.
Coder<T> - Interface in com.google.cloud.dataflow.sdk.coders: A Coder<T> defines how to encode and decode values of type T into byte streams.
Coder.Context - Class in com.google.cloud.dataflow.sdk.coders: The context in which encoding or decoding is being done.
Coder.Context(boolean) - Constructor for class com.google.cloud.dataflow.sdk.coders.Coder.Context
Coder.NonDeterministicException - Class in com.google.cloud.dataflow.sdk.coders: Exception thrown by Coder.verifyDeterministic() if the encoding is not deterministic.
Coder.NonDeterministicException(Coder<?>, String, Coder.NonDeterministicException) - Constructor for class com.google.cloud.dataflow.sdk.coders.Coder.NonDeterministicException
Coder.NonDeterministicException(Coder<?>, String) - Constructor for class com.google.cloud.dataflow.sdk.coders.Coder.NonDeterministicException
Coder.NonDeterministicException(Coder<?>, List<String>) - Constructor for class com.google.cloud.dataflow.sdk.coders.Coder.NonDeterministicException
Coder.NonDeterministicException(Coder<?>, List<String>, Coder.NonDeterministicException) - Constructor for class com.google.cloud.dataflow.sdk.coders.Coder.NonDeterministicException
CoderException - Exception in com.google.cloud.dataflow.sdk.coders: A CoderException is thrown if there is a problem encoding or decoding a value.
CoderException(String) - Constructor for exception com.google.cloud.dataflow.sdk.coders.CoderException
CoderException(String, Throwable) - Constructor for exception com.google.cloud.dataflow.sdk.coders.CoderException
CoderException(Throwable) - Constructor for exception com.google.cloud.dataflow.sdk.coders.CoderException
CoderRegistry - Class in com.google.cloud.dataflow.sdk.coders: A CoderRegistry allows registering the default Coder to use for a Java class, and looking up and instantiating the default Coder for a Java type.
CoderRegistry() - Constructor for class com.google.cloud.dataflow.sdk.coders.CoderRegistry
CoderRegistry.CoderFactory - Class in com.google.cloud.dataflow.sdk.coders: A factory for default Coders for values of a particular class.
CoderRegistry.CoderFactory() - Constructor for class com.google.cloud.dataflow.sdk.coders.CoderRegistry.CoderFactory
CoderRegistry.ConstantCoderFactory - Class in com.google.cloud.dataflow.sdk.coders: A factory that always returns the coder with which it is instantiated.
CoderRegistry.ConstantCoderFactory(Coder<?>) - Constructor for class com.google.cloud.dataflow.sdk.coders.CoderRegistry.ConstantCoderFactory
CoGbkResult - Class in com.google.cloud.dataflow.sdk.transforms.join: A row result of a CoGroupByKey.
CoGbkResult(CoGbkResultSchema, Iterable<RawUnionValue>) - Constructor for class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult: A row in the PCollection resulting from a CoGroupByKey transform.
CoGbkResult.CoGbkResultCoder - Class in com.google.cloud.dataflow.sdk.transforms.join: A coder for CoGbkResults.
CoGbkResultSchema - Class in com.google.cloud.dataflow.sdk.transforms.join: A schema for the results of a CoGroupByKey.
CoGbkResultSchema(TupleTagList) - Constructor for class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResultSchema: Builds a schema from a tuple of TupleTag<?>s.
CoGroupByKey<K> - Class in com.google.cloud.dataflow.sdk.transforms.join: A transform that performs a CoGroupByKey on a tuple of tables.
CollectionCoder<T> - Class in com.google.cloud.dataflow.sdk.coders: A CollectionCoder encodes Collections.
CollectionCoder(Coder<T>) - Constructor for class com.google.cloud.dataflow.sdk.coders.CollectionCoder
com.google.cloud.dataflow.sdk - package com.google.cloud.dataflow.sdk: Provides a simple, powerful model for building both batch and streaming parallel data processing Pipelines.
com.google.cloud.dataflow.sdk.coders - package com.google.cloud.dataflow.sdk.coders: Defines Coders to specify how data is encoded to and decoded from byte strings.
com.google.cloud.dataflow.sdk.io - package com.google.cloud.dataflow.sdk.io: Defines transforms for reading and writing common storage formats, including AvroIO, BigQueryIO, and TextIO.
com.google.cloud.dataflow.sdk.options - package com.google.cloud.dataflow.sdk.options: Defines PipelineOptions for configuring pipeline execution.
com.google.cloud.dataflow.sdk.runners - package com.google.cloud.dataflow.sdk.runners: Defines runners for executing Pipelines in different modes, including DirectPipelineRunner and DataflowPipelineRunner.
com.google.cloud.dataflow.sdk.testing - package com.google.cloud.dataflow.sdk.testing: Defines utilities for unit testing Dataflow pipelines.
com.google.cloud.dataflow.sdk.transforms - package com.google.cloud.dataflow.sdk.transforms: Defines PTransforms for transforming data in a pipeline.
com.google.cloud.dataflow.sdk.transforms.join - package com.google.cloud.dataflow.sdk.transforms.join: Defines the CoGroupByKey transform for joining multiple PCollections.
com.google.cloud.dataflow.sdk.transforms.windowing - package com.google.cloud.dataflow.sdk.transforms.windowing: Defines the Window transform for dividing the elements in a PCollection into windows.
com.google.cloud.dataflow.sdk.values - package com.google.cloud.dataflow.sdk.values: Defines PCollection and other classes for representing data in a Pipeline.
Combine - Class in com.google.cloud.dataflow.sdk.transforms: PTransforms for combining PCollection elements globally and per-key.
Combine() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Combine
Combine.AccumulatingCombineFn<VI,VA extends Combine.AccumulatingCombineFn.Accumulator<VI,VA,VO>,VO> - Class in com.google.cloud.dataflow.sdk.transforms: A CombineFn that uses a subclass of Combine.AccumulatingCombineFn.Accumulator as its accumulator type.
Combine.AccumulatingCombineFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Combine.AccumulatingCombineFn
Combine.AccumulatingCombineFn.Accumulator<VI,VA,VO> - Interface in com.google.cloud.dataflow.sdk.transforms: The type of mutable accumulator values used by this AccumulatingCombineFn.
Combine.CombineFn<VI,VA,VO> - Class in com.google.cloud.dataflow.sdk.transforms: A CombineFn<VI, VA, VO> specifies how to combine a collection of input values of type VI into a single output value of type VO.
Combine.CombineFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Combine.CombineFn
Combine.Globally<VI,VO> - Class in com.google.cloud.dataflow.sdk.transforms: Combine.Globally<VI, VO> takes a PCollection<VI> and returns a PCollection<VO> whose single element is the result of combining all the elements of the input PCollection, using a specified CombineFn.
Combine.GroupedValues<K,VI,VO> - Class in com.google.cloud.dataflow.sdk.transforms: GroupedValues<K, VI, VO> takes a PCollection<KV<K, Iterable<VI>>>, such as the result of GroupByKey, applies a specified KeyedCombineFn to each of the input KV<K, Iterable<VI>> elements to produce a combined output KV<K, VO> element, and returns a PCollection<KV<K, VO>> containing all the combined output elements.
Combine.KeyedCombineFn<K,VI,VA,VO> - Class in com.google.cloud.dataflow.sdk.transforms: A KeyedCombineFn<K, VI, VA, VO> specifies how to combine a collection of input values of type VI, associated with a key of type K, into a single output value of type VO.
Combine.KeyedCombineFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Combine.KeyedCombineFn
Combine.PerKey<K,VI,VO> - Class in com.google.cloud.dataflow.sdk.transforms: PerKey<K, VI, VO> takes a PCollection<KV<K, VI>>, groups it by key, applies a combining function to the VI values associated with each key to produce a combined VO value, and returns a PCollection<KV<K, VO>> representing a map from each distinct key of the input PCollection to the corresponding combined value.
Combine.PerKeyWithHotKeys<K,VI,VO> - Class in com.google.cloud.dataflow.sdk.transforms: Like Combine.PerKey, but sharding the combining of hot keys.
compare(T, T) - Method in class com.google.cloud.dataflow.sdk.transforms.Top.Largest
compare(T, T) - Method in class com.google.cloud.dataflow.sdk.transforms.Top.Smallest
compare(KV<K, V>, KV<K, V>) - Method in class com.google.cloud.dataflow.sdk.values.KV.OrderByKey
compare(KV<K, V>, KV<K, V>) - Method in class com.google.cloud.dataflow.sdk.values.KV.OrderByValue
compareTo(IntervalWindow) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.IntervalWindow
computeMetadataString() - Method in class com.google.cloud.dataflow.sdk.options.CloudDebuggerOptions.DebuggerConfig: Compute the string of Debugger config.
contains(IntervalWindow) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.IntervalWindow: Returns whether this window contains the given window.
containsInAnyOrder(Iterable<T>) - Method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert.IterableAssert: Checks that the Iterable contains the expected elements, in any order.
containsInAnyOrder(T...) - Method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert.IterableAssert: Checks that the Iterable contains the expected elements, in any order.
containsInOrder(T...) - Method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert.IterableAssert: Checks that the Iterable contains the expected elements, in the specified order.
containsInOrder(Iterable<T>) - Method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert.IterableAssert: Checks that the Iterable contains the expected elements, in the specified order.
Count - Class in com.google.cloud.dataflow.sdk.transforms: Count<T> takes a PCollection<T> and returns a PCollection<KV<T, Long>> representing a map from each distinct element of the input PCollection to the number of times that element occurs in the input.
Count() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Count
Count.Globally<T> - Class in com.google.cloud.dataflow.sdk.transforms: Count.Globally<T> takes a PCollection<T> and returns a PCollection<Long> containing a single element which is the total number of elements in the PCollection.
Count.Globally() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Count.Globally
Count.PerElement<T> - Class in com.google.cloud.dataflow.sdk.transforms: Count.PerElement<T> takes a PCollection<T> and returns a PCollection<KV<T, Long>> representing a map from each distinct element of the input PCollection to the number of times that element occurs in the input.
Count.PerElement() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Count.PerElement
create(List<? extends Coder<?>>) - Method in class com.google.cloud.dataflow.sdk.coders.CoderRegistry.CoderFactory: Returns the default Coder to use for values of a particular type, given the Coders for each of the type's generic parameter types.
create(List<? extends Coder<?>>) - Method in class com.google.cloud.dataflow.sdk.coders.CoderRegistry.ConstantCoderFactory
create(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.options.BlockingDataflowPipelineOptions.StandardOutputFactory
create(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions.PathValidatorFactory
create(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions.StagerFactory
create(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.options.DataflowPipelineOptions.DataflowClientFactory
create(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.options.DataflowPipelineOptions.JobNameFactory
create(String) - Static method in class com.google.cloud.dataflow.sdk.options.DataflowWorkerLoggingOptions.WorkerLogLevelOverride: Expects a value of the form Name#Level.
create(PipelineOptions) - Method in interface com.google.cloud.dataflow.sdk.options.DefaultValueFactory: Creates a default value for a getter marked with Default.InstanceFactory.
create(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.options.GcpOptions.CredentialDirFactory
create(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.options.GcpOptions.GcpUserCredentialsFactory
create(PipelineOptions) - Method in class com.google.cloud.dataflow.sdk.options.GcsOptions.ExecutorServiceFactory
create(AbstractGoogleClient, String) - Static method in class com.google.cloud.dataflow.sdk.options.GoogleApiDebugOptions.GoogleApiTracer: Creates a GoogleApiDebugOptions.GoogleApiTracer which sets the trace token on all calls which match the given client type.
create(AbstractGoogleClientRequest<?>, String) - Static method in class com.google.cloud.dataflow.sdk.options.GoogleApiDebugOptions.GoogleApiTracer: Creates a GoogleApiDebugOptions.GoogleApiTracer which sets the trace token on all calls which match for the given request type.
create(String) - Static method in class com.google.cloud.dataflow.sdk.options.GoogleApiDebugOptions.GoogleApiTracer: Creates a GoogleClientRequestInitializer which adds the trace token based upon the passed in value.
create() - Method in class com.google.cloud.dataflow.sdk.options.PipelineOptionsFactory.Builder: Creates and returns an object which implements PipelineOptions using the values configured on this builder during construction.
create() - Static method in class com.google.cloud.dataflow.sdk.options.PipelineOptionsFactory: Creates and returns an object which implements PipelineOptions.
create(PipelineOptions) - Static method in class com.google.cloud.dataflow.sdk.Pipeline: Constructs a pipeline from the provided options.
create(DataflowPipelineOptions) - Static method in class com.google.cloud.dataflow.sdk.runners.DataflowPipeline: Creates and returns a new DataflowPipeline instance for tests.
create(Combine.GroupedValues<K, VI, VO>, boolean) - Static method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.TestCombineDoFn
create() - Static method in class com.google.cloud.dataflow.sdk.testing.TestPipeline: Creates and returns a new test pipeline.
create(int, C) - Static method in class com.google.cloud.dataflow.sdk.transforms.ApproximateQuantiles.ApproximateQuantilesCombineFn: Returns an approximate quantiles combiner with the given compareFn and desired number of quantiles.
create(int) - Static method in class com.google.cloud.dataflow.sdk.transforms.ApproximateQuantiles.ApproximateQuantilesCombineFn: Like ApproximateQuantiles.ApproximateQuantilesCombineFn.create(int, Comparator), but sorts values using their natural ordering.
create(int, C, long, double) - Static method in class com.google.cloud.dataflow.sdk.transforms.ApproximateQuantiles.ApproximateQuantilesCombineFn: Creates an approximate quantiles combiner with the given compareFn and desired number of quantiles.
Create<T> - Class in com.google.cloud.dataflow.sdk.transforms: Create<T> takes a collection of elements of type T known when the pipeline is constructed and returns a PCollection<T> containing the elements.
create() - Static method in class com.google.cloud.dataflow.sdk.transforms.Flatten: Deprecated.
create() - Static method in class com.google.cloud.dataflow.sdk.transforms.GroupByKey: Returns a GroupByKey<K, V> PTransform.
create() - Static method in class com.google.cloud.dataflow.sdk.transforms.join.CoGroupByKey: Returns a CoGroupByKey<K> PTransform.
create() - Static method in class com.google.cloud.dataflow.sdk.transforms.Keys: Returns a Keys<K> PTransform.
create() - Static method in class com.google.cloud.dataflow.sdk.transforms.KvSwap: Returns a KvSwap<A, B> PTransform.
create() - Static method in class com.google.cloud.dataflow.sdk.transforms.RemoveDuplicates: Returns a RemoveDuplicates<T> PTransform.
create() - Static method in class com.google.cloud.dataflow.sdk.transforms.Values: Returns a Values<V> PTransform.
createAccumulator() - Method in class com.google.cloud.dataflow.sdk.transforms.ApproximateQuantiles.ApproximateQuantilesCombineFn
createAccumulator() - Method in class com.google.cloud.dataflow.sdk.transforms.ApproximateUnique.ApproximateUniqueCombineFn
createAccumulator() - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.CombineFn: Returns a new, mutable accumulator value, representing the accumulation of zero input values.
createAccumulator(K) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.KeyedCombineFn: Returns a new, mutable accumulator value representing the accumulation of zero input values.
createAccumulator() - Method in class com.google.cloud.dataflow.sdk.transforms.Mean.MeanFn
createAccumulator() - Method in class com.google.cloud.dataflow.sdk.transforms.Sample.FixedSizedSampleFn
createAccumulator() - Method in class com.google.cloud.dataflow.sdk.transforms.Top.TopCombineFn
createAggregator(String, Combine.CombineFn<? super AI, AA, AO>) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFn.Context: Returns an aggregator with aggregation logic specified by the CombineFn argument.
createAggregator(String, SerializableFunction<Iterable<AI>, AO>) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFn.Context: Returns an aggregator with aggregation logic specified by the SerializableFunction argument.
createBasicReader(PipelineOptions, Coder<DatastoreV1.Entity>, ExecutionContext) - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.Source
createBasicReader(PipelineOptions, Coder<T>, ExecutionContext) - Method in class com.google.cloud.dataflow.sdk.io.Source: Creates a basic (non-windowed) reader for this source.
createDatumReader() - Method in class com.google.cloud.dataflow.sdk.coders.AvroCoder: Returns a new DatumReader that can be used to read from an Avro file directly.
createDatumWriter() - Method in class com.google.cloud.dataflow.sdk.coders.AvroCoder: Returns a new DatumWriter that can be used to write to an Avro file directly.
createForTest() - Static method in class com.google.cloud.dataflow.sdk.runners.DirectPipeline: Creates and returns a new DirectPipeline instance for tests.
createForTest() - Static method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner: Constructs a runner with default properties for testing.
createFromSystemProperties() - Static method in class com.google.cloud.dataflow.sdk.options.PipelineOptionsFactory: Deprecated.
createInputStream(InputStream) - Method in enum com.google.cloud.dataflow.sdk.io.TextIO.CompressionType
createPrimitiveOutputInternal(WindowFn<?, ?>) - Static method in class com.google.cloud.dataflow.sdk.values.PCollection: Creates and returns a new PCollection for a primitive output.
createWindowedReader(PipelineOptions, Coder<WindowedValue<T>>, ExecutionContext) - Method in class com.google.cloud.dataflow.sdk.io.Source: Creates a windowed reader for this source.
CustomCoder<T> - Class in com.google.cloud.dataflow.sdk.coders: An abstract base class for writing Coders that encodes itself via java serialization.
CustomCoder() - Constructor for class com.google.cloud.dataflow.sdk.coders.CustomCoder

D

DataflowAssert - Class in com.google.cloud.dataflow.sdk.testing: An assertion on the contents of a PCollection incorporated into the pipeline.
DataflowAssert.AssertRelation<Actual,Expected> - Interface in com.google.cloud.dataflow.sdk.testing: A serializable function implementing a binary predicate between types Actual and Expected.
DataflowAssert.AssertThat<Actual,Expected> - Class in com.google.cloud.dataflow.sdk.testing: A SerializableFunction that performs an Assert.assertThat() operation using a Matcher operation.
DataflowAssert.IterableAssert<T> - Class in com.google.cloud.dataflow.sdk.testing: An assertion about the contents of a PCollectionView<, ?>.
DataflowAssert.IterableAssert(PCollectionView<Iterable<T>, ?>) - Constructor for class com.google.cloud.dataflow.sdk.testing.DataflowAssert.IterableAssert
DataflowAssert.SingletonAssert<T> - Class in com.google.cloud.dataflow.sdk.testing: An assertion about the single value of type T associated with a PCollectionView.
DataflowAssert.SingletonAssert(PCollectionView<T, ?>) - Constructor for class com.google.cloud.dataflow.sdk.testing.DataflowAssert.SingletonAssert
DataflowPipeline - Class in com.google.cloud.dataflow.sdk.runners: A DataflowPipeline, which returns a DataflowPipelineJob subclass of PipelineResult from Pipeline.run().
DataflowPipelineDebugOptions - Interface in com.google.cloud.dataflow.sdk.options: Options used for testing and debugging the Dataflow SDK.
DataflowPipelineDebugOptions.PathValidatorFactory - Class in com.google.cloud.dataflow.sdk.options: Creates a PathValidator object using the class specified in DataflowPipelineDebugOptions.getPathValidatorClass().
DataflowPipelineDebugOptions.PathValidatorFactory() - Constructor for class com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions.PathValidatorFactory
DataflowPipelineDebugOptions.StagerFactory - Class in com.google.cloud.dataflow.sdk.options: Creates a Stager object using the class specified in DataflowPipelineDebugOptions.getStagerClass().
DataflowPipelineDebugOptions.StagerFactory() - Constructor for class com.google.cloud.dataflow.sdk.options.DataflowPipelineDebugOptions.StagerFactory
DataflowPipelineJob - Class in com.google.cloud.dataflow.sdk.runners: A DataflowPipelineJob represents a job submitted to Dataflow using DataflowPipelineRunner.
DataflowPipelineJob(String, String, Dataflow) - Constructor for class com.google.cloud.dataflow.sdk.runners.DataflowPipelineJob: Construct the job.
DataflowPipelineOptions - Interface in com.google.cloud.dataflow.sdk.options: Options which can be used to configure the DataflowPipeline.
DataflowPipelineOptions.DataflowClientFactory - Class in com.google.cloud.dataflow.sdk.options: Returns the default Dataflow client built from the passed in PipelineOptions.
DataflowPipelineOptions.DataflowClientFactory() - Constructor for class com.google.cloud.dataflow.sdk.options.DataflowPipelineOptions.DataflowClientFactory
DataflowPipelineOptions.JobNameFactory - Class in com.google.cloud.dataflow.sdk.options: Returns a normalized job name constructed from ApplicationNameOptions.getAppName(), the local system user name (if available), and the current time.
DataflowPipelineOptions.JobNameFactory() - Constructor for class com.google.cloud.dataflow.sdk.options.DataflowPipelineOptions.JobNameFactory
DataflowPipelineRegistrar - Class in com.google.cloud.dataflow.sdk.runners: Contains the PipelineOptionsRegistrar and PipelineRunnerRegistrar for the DataflowPipeline.
DataflowPipelineRegistrar.Options - Class in com.google.cloud.dataflow.sdk.runners: Register the DataflowPipelineOptions and BlockingDataflowPipelineOptions.
DataflowPipelineRegistrar.Options() - Constructor for class com.google.cloud.dataflow.sdk.runners.DataflowPipelineRegistrar.Options
DataflowPipelineRegistrar.Runner - Class in com.google.cloud.dataflow.sdk.runners: Register the DataflowPipelineRunner and BlockingDataflowPipelineRunner.
DataflowPipelineRegistrar.Runner() - Constructor for class com.google.cloud.dataflow.sdk.runners.DataflowPipelineRegistrar.Runner
DataflowPipelineRunner - Class in com.google.cloud.dataflow.sdk.runners: A PipelineRunner that executes the operations in the pipeline by first translating them to the Dataflow representation using the DataflowPipelineTranslator and then submitting them to a Dataflow service for execution.
DataflowPipelineRunnerHooks - Class in com.google.cloud.dataflow.sdk.runners: An instance of this class can be passed to the DataflowPipeline runner to add user defined hooks to be invoked at various times during pipeline execution.
DataflowPipelineRunnerHooks() - Constructor for class com.google.cloud.dataflow.sdk.runners.DataflowPipelineRunnerHooks
DataflowPipelineTranslator - Class in com.google.cloud.dataflow.sdk.runners: DataflowPipelineTranslator knows how to translate Pipeline objects into Dataflow API Jobs.
DataflowPipelineTranslator.TransformTranslator<PT extends PTransform> - Interface in com.google.cloud.dataflow.sdk.runners: A translator of a PTransform.
DataflowPipelineTranslator.TranslationContext - Interface in com.google.cloud.dataflow.sdk.runners: The interface provided to registered callbacks for interacting with the DataflowPipelineRunner, including reading and writing the values of PCollections and side inputs (PCollectionViews).
DataflowPipelineWorkerPoolOptions - Interface in com.google.cloud.dataflow.sdk.options: Options which are used to configure the Dataflow pipeline worker pool.
DataflowPipelineWorkerPoolOptions.AutoscalingAlgorithmType - Enum in com.google.cloud.dataflow.sdk.options: Type of autoscaling algorithm to use.
DataflowPipelineWorkerPoolOptions.ClusterManagerApiType - Enum in com.google.cloud.dataflow.sdk.options: Type of API for handling cluster management,i.e.
DataflowPipelineWorkerPoolOptions.TeardownPolicy - Enum in com.google.cloud.dataflow.sdk.options: The policy for tearing down the workers spun up by the service.
DataflowWorkerHarnessOptions - Interface in com.google.cloud.dataflow.sdk.options: Options which are used exclusively within the Dataflow worker harness.
DataflowWorkerLoggingOptions - Interface in com.google.cloud.dataflow.sdk.options: Options which are used to control logging configuration on the Dataflow worker.
DataflowWorkerLoggingOptions.Level - Enum in com.google.cloud.dataflow.sdk.options: The set of log levels which can be used on the Dataflow worker.
DataflowWorkerLoggingOptions.WorkerLogLevelOverride - Class in com.google.cloud.dataflow.sdk.options: Defines a log level override for a specific class, package, or name.
DATASTORE_BATCH_UPDATE_LIMIT - Static variable in class com.google.cloud.dataflow.sdk.io.DatastoreIO: Datastore has a limit of 500 mutations per batch operation, so we flush changes to Datastore every 500 entities.
DatastoreIO - Class in com.google.cloud.dataflow.sdk.io: Transforms for reading and writing Google Cloud Datastore entities.
DatastoreIO() - Constructor for class com.google.cloud.dataflow.sdk.io.DatastoreIO
DatastoreIO.DatastoreReader - Class in com.google.cloud.dataflow.sdk.io: An iterator over the records from a query of the datastore.
DatastoreIO.DatastoreReader(DatastoreV1.Query, Datastore) - Constructor for class com.google.cloud.dataflow.sdk.io.DatastoreIO.DatastoreReader: Returns a DatastoreIterator with query and Datastore object set.
DatastoreIO.Sink - Class in com.google.cloud.dataflow.sdk.io: A PTransform that writes a PCollection<Entity> containing entities to a Datastore kind.
DatastoreIO.Source - Class in com.google.cloud.dataflow.sdk.io: A source that reads the result rows of a Datastore query as Entity objects.
days(int) - Static method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows: Returns a WindowFn that windows elements into periods measured by days.
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.AvroCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.BigEndianIntegerCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.BigEndianLongCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.ByteArrayCoder
decode(InputStream, Coder.Context) - Method in interface com.google.cloud.dataflow.sdk.coders.Coder: Decodes a value of type T from the given input stream in the given context.
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.DelegateCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.DoubleCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.EntityCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.InstantCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.IterableLikeCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.KvCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.MapCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.SerializableCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.StringUtf8Coder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.TableRowJsonCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.TextualIntegerCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.VarIntCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.VarLongCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.coders.VoidCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult.CoGbkResultCoder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.GlobalWindow.Coder
decode(InputStream, Coder.Context) - Method in class com.google.cloud.dataflow.sdk.values.TimestampedValue.TimestampedValueCoder
decodeToIterable(List<T>) - Method in class com.google.cloud.dataflow.sdk.coders.CollectionCoder
decodeToIterable(List<T>) - Method in class com.google.cloud.dataflow.sdk.coders.IterableCoder
decodeToIterable(List<T>) - Method in class com.google.cloud.dataflow.sdk.coders.IterableLikeCoder: Builds an instance of the coder's associated Iterable from a list of decoded elements.
decodeToIterable(List<T>) - Method in class com.google.cloud.dataflow.sdk.coders.ListCoder
decodeToIterable(List<T>) - Method in class com.google.cloud.dataflow.sdk.coders.SetCoder
Default - Annotation Type in com.google.cloud.dataflow.sdk.options: Default represents a set of annotations which can be used to annotate getter properties on PipelineOptions with information representing the default value to be returned if no value is specified.
Default.Boolean - Annotation Type in com.google.cloud.dataflow.sdk.options: This represents that the default of the option is the specified boolean primitive value.
Default.Byte - Annotation Type in com.google.cloud.dataflow.sdk.options: This represents that the default of the option is the specified byte primitive value.
Default.Character - Annotation Type in com.google.cloud.dataflow.sdk.options: This represents that the default of the option is the specified char primitive value.
Default.Class - Annotation Type in com.google.cloud.dataflow.sdk.options: This represents that the default of the option is the specified Class value.
Default.Double - Annotation Type in com.google.cloud.dataflow.sdk.options: This represents that the default of the option is the specified double primitive value.
Default.Enum - Annotation Type in com.google.cloud.dataflow.sdk.options: This represents that the default of the option is the specified enum.
Default.Float - Annotation Type in com.google.cloud.dataflow.sdk.options: This represents that the default of the option is the specified float primitive value.
Default.InstanceFactory - Annotation Type in com.google.cloud.dataflow.sdk.options: Value must be of type DefaultValueFactory and have a default constructor.
Default.Integer - Annotation Type in com.google.cloud.dataflow.sdk.options: This represents that the default of the option is the specified int primitive value.
Default.Long - Annotation Type in com.google.cloud.dataflow.sdk.options: This represents that the default of the option is the specified long primitive value.
Default.Short - Annotation Type in com.google.cloud.dataflow.sdk.options: This represents that the default of the option is the specified short primitive value.
Default.String - Annotation Type in com.google.cloud.dataflow.sdk.options: This represents that the default of the option is the specified String value.
DEFAULT_HOST - Static variable in class com.google.cloud.dataflow.sdk.io.DatastoreIO
DEFAULT_MAX_NUM_ELEMENTS - Static variable in class com.google.cloud.dataflow.sdk.transforms.ApproximateQuantiles.ApproximateQuantilesCombineFn: The cost (in time and space) to compute quantiles to a given accuracy is a function of the total number of elements in the data set.
DEFAULT_TEXT_CODER - Static variable in class com.google.cloud.dataflow.sdk.io.TextIO
DefaultCoder - Annotation Type in com.google.cloud.dataflow.sdk.coders: Specifies a default Coder class to handle encoding and decoding instances of the annotated class.
DefaultValueFactory<T> - Interface in com.google.cloud.dataflow.sdk.options: An interface used with Default.InstanceFactory annotation to specify the class which will be an instance factory to produce default values for a given getter on PipelineOptions.
DelegateCoder<T,DT> - Class in com.google.cloud.dataflow.sdk.coders: A DelegateCoder<T, DT> wraps a Coder
and encodes/decodes values of type Ts by converting to/from DT and then encoding/decoding using the underlying Coder
.