Class Reshuffle<K,V>
- java.lang.Object
-
- org.apache.beam.sdk.transforms.PTransform<PCollection<KV<K,V>>,PCollection<KV<K,V>>>
-
- org.apache.beam.sdk.transforms.Reshuffle<K,V>
-
- Type Parameters:
K
- The type of key being reshuffled on.V
- The type of value being reshuffled.
- All Implemented Interfaces:
java.io.Serializable
,HasDisplayData
@Internal @Deprecated public class Reshuffle<K,V> extends PTransform<PCollection<KV<K,V>>,PCollection<KV<K,V>>>
Deprecated.this transform's intended side effects are not portable; it will likely be removedFor internal use only; no backwards compatibility guarantees.A
PTransform
that returns aPCollection
equivalent to its input but operationally provides some of the side effects of aGroupByKey
, in particular checkpointing, and preventing fusion of the surrounding transforms.Performs a
GroupByKey
so that the data is key-partitioned. Configures theWindowingStrategy
so that no data is dropped, but doesn't affect the need for the user to specify allowed lateness and accumulation mode before a user-inserted GroupByKey.- See Also:
- Serialized Form
-
-
Nested Class Summary
Nested Classes Modifier and Type Class Description static class
Reshuffle.AssignShardFn<T>
Deprecated.static class
Reshuffle.ViaRandomKey<T>
Deprecated.Implementation ofviaRandomKey()
.
-
Field Summary
-
Fields inherited from class org.apache.beam.sdk.transforms.PTransform
name, resourceHints
-
-
Method Summary
All Methods Static Methods Instance Methods Concrete Methods Deprecated Methods Modifier and Type Method Description PCollection<KV<K,V>>
expand(PCollection<KV<K,V>> input)
Deprecated.Override this method to specify how thisPTransform
should be expanded on the givenInputT
.static <K,V>
Reshuffle<K,V>of()
Deprecated.static <T> Reshuffle.ViaRandomKey<T>
viaRandomKey()
Deprecated.Encapsulates the sequence "pair input with unique key, applyof()
, drop the key" commonly used to break fusion.-
Methods inherited from class org.apache.beam.sdk.transforms.PTransform
compose, compose, getAdditionalInputs, getDefaultOutputCoder, getDefaultOutputCoder, getDefaultOutputCoder, getKindString, getName, getResourceHints, populateDisplayData, setResourceHints, toString, validate, validate
-
-
-
-
Method Detail
-
of
public static <K,V> Reshuffle<K,V> of()
Deprecated.
-
viaRandomKey
@Experimental public static <T> Reshuffle.ViaRandomKey<T> viaRandomKey()
Deprecated.Encapsulates the sequence "pair input with unique key, applyof()
, drop the key" commonly used to break fusion.
-
expand
public PCollection<KV<K,V>> expand(PCollection<KV<K,V>> input)
Deprecated.Description copied from class:PTransform
Override this method to specify how thisPTransform
should be expanded on the givenInputT
.NOTE: This method should not be called directly. Instead apply the
PTransform
should be applied to theInputT
using theapply
method.Composite transforms, which are defined in terms of other transforms, should return the output of one of the composed transforms. Non-composite transforms, which do not apply any transforms internally, should return a new unbound output and register evaluators (via backend-specific registration methods).
- Specified by:
expand
in classPTransform<PCollection<KV<K,V>>,PCollection<KV<K,V>>>
-
-