Encapsulate parsed commandline arguments.
An enhanced ScioContext with distributed cache features.
Runner specific context.
Represent a Beam runner specific result.
Main entry point for Scio functionality.
Main entry point for Scio functionality. A ScioContext represents a pipeline and can be used to create SCollections and distributed caches on that cluster.
ScioExecutionContext is the result of ScioContext#run().
ScioExecutionContext is the result of ScioContext#run().
This is a handle to the underlying running job and allows getting the state, checking if it's completed and to wait for it's execution.
Represent a Scio pipeline result.
Wait for nested Tap to be available, flatten result and get Tap
reference from Future
.
A simple command line argument parser.
A simple command line argument parser.
Arguments can be either properties (--key=value1,value2,...
) or booleans (--test
).
This object was generated by sbt-buildinfo.
Convenience object for creating ScioContext and Args.
Converters for Beam Java SDK APIs.
Converters for Beam Java SDK APIs. Import all.
import com.spotify.scio.JavaConverters._
Companion object for ScioContext.
Utility object for creating metrics.
Utility object for creating metrics. The main types available are org.apache.beam.sdk.metrics.Counter, org.apache.beam.sdk.metrics.Distribution and org.apache.beam.sdk.metrics.Gauge.
This package contains the schema types for metrics collected during a pipeline run.
Main package for transforms APIs.
Main package for transforms APIs. Import all.
Main package for public APIs. Import all.
import com.spotify.scio._