PipelineSpec
Related Doc:
package testing
Assert that the SCollection in question is empty.
Assert that the SCollection in question is empty.
Assert that the SCollection in question contains the provided elements.
Assert that the SCollection in question contains the provided elements.
Assert that the SCollection in question contains a single provided element.
Assert that the SCollection in question contains a single provided element.
Assert that the SCollection in question contains the provided element without making assumptions about other elements in the collection.
Assert that the SCollection in question contains the provided element without making assumptions about other elements in the collection.
Assert that the SCollection in question is equivalent to the provided map.
Assert that the SCollection in question is equivalent to the provided map.
Assert that some elements of the SCollection in question satisfy the provided function.
Assert that some elements of the SCollection in question satisfy the provided function.
Assert that all elements of the SCollection in question satisfy the provided function.
Assert that all elements of the SCollection in question satisfy the provided function.
Assert that the SCollection in question has provided size.
Assert that the SCollection in question has provided size.
SCollection assertion only applied to the specified window across all panes that were not produced by the arrival of late data.
SCollection assertion only applied to the specified window across all panes that were not produced by the arrival of late data.
SCollection assertion only applied to early timing global window.
SCollection assertion only applied to early timing global window.
SCollection assertion only applied to the specified window, running the checker only on the final pane for each key.
SCollection assertion only applied to the specified window, running the checker only on the final pane for each key.
SCollection assertion only applied to the specified window, running the checker only on the on-time pane for each key.
SCollection assertion only applied to the specified window, running the checker only on the on-time pane for each key.
SCollection assertion only applied to the specified window.
SCollection assertion only applied to the specified window. The assertion expect outputs to be produced to the provided window exactly once.
SCollection assertion only applied to the specified window.
SCollection assertion only applied to the specified window.
Test pipeline components with a ScioContext.
Test pipeline components with a ScioContext.
code that tests the components and verifies the result
runWithContext { sc =>
sc.parallelize(Seq(1, 2, 3)).sum should containSingleValue (6)
}
Test pipeline components with in-memory data.
Test pipeline components with in-memory data.
Input data is passed to fn as SCollections and the
result SCollection from fn is extracted and to be
verified.
input data
input data
input data
input data
transform to be tested
output data
Test pipeline components with in-memory data.
Test pipeline components with in-memory data.
Input data is passed to fn as SCollections and the
result SCollection from fn is extracted and to be
verified.
input data
input data
input data
transform to be tested
output data
Test pipeline components with in-memory data.
Test pipeline components with in-memory data.
Input data is passed to fn as SCollections and the
result SCollection from fn is extracted and to be
verified.
input data
input data
transform to be tested
output data
Test pipeline components with in-memory data.
Test pipeline components with in-memory data.
Input data is passed to fn as an SCollection and the
result SCollection from fn is extracted and to be
verified.
input data
transform to be tested
output data
runWithData(Seq(1, 2, 3)) { p => p.sum } shouldBe Seq(6)
Test pipeline components with a ScioContext and materialized resulting collection.
Test pipeline components with a ScioContext and materialized resulting collection.
The result SCollection from fn is extracted and to be
verified.
transform to be tested
a tuple containing the ScioResult and the materialized result of fn as a Seq
Assert that the SCollection in question satisfies the provided function.
Assert that the SCollection in question satisfies the provided function.
The parameterless execute method has been deprecated and will be removed in a future version of ScalaTest. Please invoke execute with empty parens instead: execute().
The trap method is no longer needed for demos in the REPL, which now abreviates stack traces, and will be removed in a future version of ScalaTest
Trait for unit testing pipelines.
A simple test might look like this: