Package org.apache.beam.sdk.transforms
Class Distinct.WithRepresentativeValues<T,IdT>
- java.lang.Object
-
- org.apache.beam.sdk.transforms.PTransform<PCollection<T>,PCollection<T>>
-
- org.apache.beam.sdk.transforms.Distinct.WithRepresentativeValues<T,IdT>
-
- Type Parameters:
T
- the type of input and output elementIdT
- the type of representative values used to dedup
- All Implemented Interfaces:
java.io.Serializable
,HasDisplayData
public static class Distinct.WithRepresentativeValues<T,IdT> extends PTransform<PCollection<T>,PCollection<T>>
ADistinct
PTransform
that uses aSerializableFunction
to obtain a representative value for each input element.Construct via
Distinct.withRepresentativeValueFn(SerializableFunction)
.- See Also:
- Serialized Form
-
-
Field Summary
-
Fields inherited from class org.apache.beam.sdk.transforms.PTransform
name, resourceHints
-
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description PCollection<T>
expand(PCollection<T> in)
Override this method to specify how thisPTransform
should be expanded on the givenInputT
.Distinct.WithRepresentativeValues<T,IdT>
withRepresentativeType(TypeDescriptor<IdT> type)
Return aWithRepresentativeValues
PTransform
that is like this one, but with the specified output type descriptor.-
Methods inherited from class org.apache.beam.sdk.transforms.PTransform
compose, compose, getAdditionalInputs, getDefaultOutputCoder, getDefaultOutputCoder, getDefaultOutputCoder, getKindString, getName, getResourceHints, populateDisplayData, setResourceHints, toString, validate, validate
-
-
-
-
Method Detail
-
expand
public PCollection<T> expand(PCollection<T> in)
Description copied from class:PTransform
Override this method to specify how thisPTransform
should be expanded on the givenInputT
.NOTE: This method should not be called directly. Instead apply the
PTransform
should be applied to theInputT
using theapply
method.Composite transforms, which are defined in terms of other transforms, should return the output of one of the composed transforms. Non-composite transforms, which do not apply any transforms internally, should return a new unbound output and register evaluators (via backend-specific registration methods).
- Specified by:
expand
in classPTransform<PCollection<T>,PCollection<T>>
-
withRepresentativeType
public Distinct.WithRepresentativeValues<T,IdT> withRepresentativeType(TypeDescriptor<IdT> type)
Return aWithRepresentativeValues
PTransform
that is like this one, but with the specified output type descriptor.Required for use of
Distinct.withRepresentativeValueFn(SerializableFunction)
in Java 8 with a lambda as the fn.- Parameters:
type
- aTypeDescriptor
describing the representative type of thisWithRepresentativeValues
- Returns:
- A
WithRepresentativeValues
PTransform
that is like this one, but with the specified output type descriptor.
-
-