ParallelDo, Combine, GroupByKey have a Bridge = sink for previous computations + source for other computations
ParallelDo, Combine, GroupByKey have a Bridge = sink for previous computations + source for other computations
unique identifier for the bridgeStore storing data for this node
unique identifier for the bridgeStore storing data for this node
display the bridge id
display the bridge id
cleanup
the environment object stored within the env node
unique identifier for this computation node
unique identifier for this computation node
Use this ParallelDo as a Mapper
list of additional sinks for this node
list of additional sinks for this node
display the sinks if any
display the sinks if any
push a computed result to the distributed cache for the parallelDo environment
reduce key and values
setup this parallel do computation
all the additional sinks + the bridgeStore
object defining how to serialise / deserialise data for that node
object defining how to serialise / deserialise data for that node
The ParallelDo node type specifies the building of a CompNode as a result of applying a function to all elements of an existing CompNode and concatenating the results