Test pipeline components with a ScioContext.
Test pipeline components with a ScioContext.
code that tests the components and verifies the result
runWithContext { sc => sc.parallelize(Seq(1, 2, 3)).sum should containSingleValue (6) }
Test pipeline components with in-memory data.
Test pipeline components with in-memory data.
Input data is passed to fn
as SCollections and the
result SCollection from fn
is extracted and to be
verified.
input data
input data
input data
input data
transform to be tested
output data
Test pipeline components with in-memory data.
Test pipeline components with in-memory data.
Input data is passed to fn
as SCollections and the
result SCollection from fn
is extracted and to be
verified.
input data
input data
input data
transform to be tested
output data
Test pipeline components with in-memory data.
Test pipeline components with in-memory data.
Input data is passed to fn
as SCollections and the
result SCollection from fn
is extracted and to be
verified.
input data
input data
transform to be tested
output data
Test pipeline components with in-memory data.
Test pipeline components with in-memory data.
Input data is passed to fn
as an SCollection and the
result SCollection from fn
is extracted and to be
verified.
input data
transform to be tested
output data
runWithData(Seq(1, 2, 3)) { p => p.sum } shouldBe Seq(6)
Test pipeline components with a ScioContext and materialized resulting collection.
Test pipeline components with a ScioContext and materialized resulting collection.
The result SCollection from fn
is extracted and to be
verified.
transform to be tested
a tuple containing the ScioResult and the materialized result of fn as a Seq
Trait with utility methods for unit testing pipelines.