Class MapValues<K,V1,V2>
- java.lang.Object
-
- org.apache.beam.sdk.transforms.PTransform<PCollection<KV<K,V1>>,PCollection<KV<K,V2>>>
-
- org.apache.beam.sdk.transforms.MapValues<K,V1,V2>
-
- Type Parameters:
V1
- the type of the values in the inputPCollection
V2
- the type of the elements in the outputPCollection
- All Implemented Interfaces:
java.io.Serializable
,HasDisplayData
public class MapValues<K,V1,V2> extends PTransform<PCollection<KV<K,V1>>,PCollection<KV<K,V2>>>
MapValues
maps aSerializableFunction<V1,V2>
over values of aPCollection<KV<K,V1>>
and returns aPCollection<KV<K, V2>>
.Example of use:
PCollection<KV<String, Integer>> input = ...; PCollection<KV<String, Double> output = input.apply(MapValues.into(TypeDescriptors.doubles()).via(Integer::doubleValue));
See also
MapKeys
.- See Also:
- Serialized Form
-
-
Field Summary
-
Fields inherited from class org.apache.beam.sdk.transforms.PTransform
name, resourceHints
-
-
Method Summary
All Methods Static Methods Instance Methods Concrete Methods Modifier and Type Method Description <FailureT> org.apache.beam.sdk.transforms.SimpleMapWithFailures<KV<K,V1>,KV<K,V2>,FailureT>
exceptionsInto(TypeDescriptor<FailureT> failureTypeDescriptor)
Returns a newSimpleMapWithFailures
transform that catches exceptions raised while mapping elements, with the given type descriptor used for the failure collection but the exception handler yet to be specified usingSimpleMapWithFailures.exceptionsVia(ProcessFunction)
.<FailureT> org.apache.beam.sdk.transforms.SimpleMapWithFailures<KV<K,V1>,KV<K,V2>,FailureT>
exceptionsVia(InferableFunction<WithFailures.ExceptionElement<KV<K,V1>>,FailureT> exceptionHandler)
Returns a newSimpleMapWithFailures
transform that catches exceptions raised while mapping elements, passing the raised exception instance and the input element being processed through the givenexceptionHandler
and emitting the result to a failure collection.PCollection<KV<K,V2>>
expand(PCollection<KV<K,V1>> input)
Override this method to specify how thisPTransform
should be expanded on the givenInputT
.static <V2> MapValues<?,?,V2>
into(TypeDescriptor<V2> outputType)
Returns a newMapValues
transform with the given type descriptor for the output type, but the mapping function yet to be specified usingvia(SerializableFunction)
.<NewKeyT,NewValueT>
MapValues<NewKeyT,NewValueT,V2>via(SerializableFunction<NewValueT,V2> fn)
-
Methods inherited from class org.apache.beam.sdk.transforms.PTransform
compose, compose, getAdditionalInputs, getDefaultOutputCoder, getDefaultOutputCoder, getDefaultOutputCoder, getKindString, getName, getResourceHints, populateDisplayData, setResourceHints, toString, validate, validate
-
-
-
-
Method Detail
-
via
public <NewKeyT,NewValueT> MapValues<NewKeyT,NewValueT,V2> via(SerializableFunction<NewValueT,V2> fn)
- Type Parameters:
NewKeyT
- the type of the keys in the input and outputPCollection
sNewValueT
- the type of the values in the inputPCollection
-
into
public static <V2> MapValues<?,?,V2> into(TypeDescriptor<V2> outputType)
Returns a newMapValues
transform with the given type descriptor for the output type, but the mapping function yet to be specified usingvia(SerializableFunction)
.
-
exceptionsInto
@RequiresNonNull("fn") public <FailureT> org.apache.beam.sdk.transforms.SimpleMapWithFailures<KV<K,V1>,KV<K,V2>,FailureT> exceptionsInto(TypeDescriptor<FailureT> failureTypeDescriptor)
Returns a newSimpleMapWithFailures
transform that catches exceptions raised while mapping elements, with the given type descriptor used for the failure collection but the exception handler yet to be specified usingSimpleMapWithFailures.exceptionsVia(ProcessFunction)
.See
WithFailures
documentation for usage patterns of the returnedWithFailures.Result
.Example usage:
Result<PCollection<KV<String, Integer>>, String> result = input.apply( MapValues.into(TypeDescriptors.integers()) .<String, String>via(word -> 1 / word.length) // Could throw ArithmeticException .exceptionsInto(TypeDescriptors.strings()) .exceptionsVia(ee -> ee.exception().getMessage())); PCollection<KV<String, Integer>> output = result.output(); PCollection<String> failures = result.failures();
-
exceptionsVia
@RequiresNonNull("fn") public <FailureT> org.apache.beam.sdk.transforms.SimpleMapWithFailures<KV<K,V1>,KV<K,V2>,FailureT> exceptionsVia(InferableFunction<WithFailures.ExceptionElement<KV<K,V1>>,FailureT> exceptionHandler)
Returns a newSimpleMapWithFailures
transform that catches exceptions raised while mapping elements, passing the raised exception instance and the input element being processed through the givenexceptionHandler
and emitting the result to a failure collection.This method takes advantage of the type information provided by
InferableFunction
, meaning that a call toexceptionsInto(TypeDescriptor)
may not be necessary.See
WithFailures
documentation for usage patterns of the returnedWithFailures.Result
.Example usage:
Result<PCollection<KV<String, Integer>>, String> result = input.apply( MapValues.into(TypeDescriptors.integers()) .<String, String>via(word -> 1 / word.length) // Could throw ArithmeticException .exceptionsVia( new InferableFunction<ExceptionElement<KV<String, String>>, String>() { @Override public String apply(ExceptionElement<KV<String, String>> input) { return input.exception().getMessage(); } })); PCollection<KV<String, Integer>> output = result.output(); PCollection<String> failures = result.failures();
-
expand
public PCollection<KV<K,V2>> expand(PCollection<KV<K,V1>> input)
Description copied from class:PTransform
Override this method to specify how thisPTransform
should be expanded on the givenInputT
.NOTE: This method should not be called directly. Instead apply the
PTransform
should be applied to theInputT
using theapply
method.Composite transforms, which are defined in terms of other transforms, should return the output of one of the composed transforms. Non-composite transforms, which do not apply any transforms internally, should return a new unbound output and register evaluators (via backend-specific registration methods).
- Specified by:
expand
in classPTransform<PCollection<KV<K,V1>>,PCollection<KV<K,V2>>>
-
-