Encapsulate arbitrary data that can be distributed to all workers.
Extra functions available on SCollections of Double
s through an implicit conversion.
Extra functions available on SCollections of (key, value) pairs through an implicit conversion.
A Scala wrapper for PCollection.
A Scala wrapper for PCollection. Represents an
immutable, partitioned collection of elements that can be operated on in parallel. This class
contains the basic operations available on all SCollections, such as map
, filter
, and
sum
. In addition, PairSCollectionFunctions contains operations available only on
SCollections of key-value pairs, such as groupByKey
and join
;
DoubleSCollectionFunctions contains operations available only on SCollections of Double
s.
An enhanced SCollection that uses an intermediate node to combine parts of the data to reduce load on the final global combine step.
An enhanced SCollection that uses an intermediate node to combine "hot" keys partially before performing the full combine.
An enhanced SCollection that provides access to one or more SideInputs for some transforms.
An enhanced SCollection that provides access to one or more SideInputs for some transforms. SideInputs are accessed via the additional SideInputContext argument.
An enhanced SCollection that provides access to one or more SideOutputs for some transforms.
An enhanced SCollection that provides access to one or more SideOutputs for some transforms. SideOutputs are accessed via the additional SideOutputContext argument. SCollections of the SideOutputs are accessed via the additional SideOutputCollections return value.
Encapsulate an SCollection when it is being used as a side input.
Encapsulate context of one or more SideInputs in an SCollectionWithSideInput.
Encapsulate a side output for a transform.
Encapsulate output of one or more SideOutputs in an SCollectionWithSideOutput.
Encapsulate context of one or more SideOutputs in an SCollectionWithSideOutput.
Trait for setting custom names on transforms.
Window options for an SCollection.
An enhanced SCollection that provides access to window information via WindowedValue.
Value with window information to be used inside a WindowedSCollection.
Convenience functions for creating SCollections.
Companion object for SideOutput.
Encapsulate arbitrary data that can be distributed to all workers. Similar to Hadoop distributed cache.