Encapsulate an accumulator, similar to Hadoop counters.
Encapsulate context of one or more Accumulators in an SCollectionWithAccumulator.
Type class for T
that can be used in an Accumulator.
Encapsulate files on Google Cloud Storage that can be distributed to all workers.
Extra functions available on SCollections of Doubles through an implicit conversion.
Extra functions available on SCollections of (key, value) pairs through an implicit conversion.
A Scala wrapper for PCollection, the basic abstraction in Dataflow.
An enhanced SCollection that provides access to one or more Accumulators for some transforms.
An enhanced SCollection that uses an intermediate node to combine parts of the data to reduce load on the final global combine step.
An enhanced SCollection that uses an intermediate node to combine "hot" keys partially before performing the full combine.
An enhanced SCollection that provides access to one or more SideInputs for some transforms.
An enhanced SCollection that provides access to one or more SideOutputs for some transforms.
Encapsulate an SCollection when it is being used as a side input.
Encapsulate context of one or more SideInputs in an SCollectionWithSideInput.
Encapsulate a side output for a transform.
Encapsulate output of one or more SideOutputs in an SCollectionWithSideOutput.
Encapsulate context of one or more SideOutputs in an SCollectionWithSideOutput.
Convenience functions for creating SCollections.
Companion object for SideOutput.