public class SplittableParDoExpander
extends java.lang.Object
Constructor and Description |
---|
SplittableParDoExpander() |
Modifier and Type | Method and Description |
---|---|
static ProtoOverrides.TransformReplacement |
createSizedReplacement()
Returns a transform replacement which expands a splittable ParDo from:
|
static ProtoOverrides.TransformReplacement |
createTruncateReplacement()
Returns a transform replacement in drain mode which expands a splittable ParDo from:
|
public static ProtoOverrides.TransformReplacement createSizedReplacement()
sideInputA ---------\
sideInputB ---------V
mainInput ---> SplittableParDo --> outputA
\-> outputB
into:
sideInputA ---------\---------------------\--------------------------\
sideInputB ---------V---------------------V--------------------------V
mainInput ---> PairWithRestricton --> SplitAndSize --> ProcessSizedElementsAndRestriction --> outputA
\-> outputB
Specifically this transform ensures that initial splitting is performed and that the sizing information is available to the runner if it chooses to inspect it.
public static ProtoOverrides.TransformReplacement createTruncateReplacement()
sideInputA ---------\
sideInputB ---------V
mainInput ---> SplittableParDo --> outputA
\-> outputB
into:
sideInputA ---------\---------------------\----------------------\--------------------------\
sideInputB ---------V---------------------V----------------------V--------------------------V
mainInput ---> PairWithRestriction --> SplitAndSize --> TruncateAndSize --> ProcessSizedElementsAndRestriction --> outputA
\-> outputB
.