Encapsulate parsed commandline arguments.
An enhanced ScioContext with distributed cache features.
Main entry point for Scio functionality.
Main entry point for Scio functionality. A ScioContext represents a pipeline and can be used to create SCollections and distributed caches on that cluster.
Represent a Scio pipeline result.
Wait for Tap to be available and get Tap reference from Future
.
Wait for nested Tap to be available, flatten result and get Tap
reference from Future
.
A simple command line argument parser.
A simple command line argument parser.
Arguments can be either properties (--key=value1,value2,...
) or booleans (--test
).
Convenience object for creating ScioContext and Args.
Companion object for ScioContext.
Utility object for creating metrics.
Utility object for creating metrics. The main types available are org.apache.beam.sdk.metrics.Counter, org.apache.beam.sdk.metrics.Distribution and org.apache.beam.sdk.metrics.Gauge.
Semigroup for Array[Double]
.
Semigroup for Array[Float]
.
Semigroup for Array[Int]
.
Semigroup for Array[Long]
.
This package contains the schema types for metrics collected during a pipeline run.
Scala version.
Scio version.
Main package for public APIs. Import all.
import com.spotify.scio._