Class StorageApiConvertMessages<DestinationT,ElementT>
- java.lang.Object
-
- org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<DestinationT,ElementT>>,org.apache.beam.sdk.values.PCollectionTuple>
-
- org.apache.beam.sdk.io.gcp.bigquery.StorageApiConvertMessages<DestinationT,ElementT>
-
- All Implemented Interfaces:
java.io.Serializable
,org.apache.beam.sdk.transforms.display.HasDisplayData
public class StorageApiConvertMessages<DestinationT,ElementT> extends org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<DestinationT,ElementT>>,org.apache.beam.sdk.values.PCollectionTuple>
A transform that converts messages to protocol buffers in preparation for writing to BigQuery.- See Also:
- Serialized Form
-
-
Nested Class Summary
Nested Classes Modifier and Type Class Description static class
StorageApiConvertMessages.ConvertMessagesDoFn<DestinationT extends @NonNull java.lang.Object,ElementT>
-
Constructor Summary
Constructors Constructor Description StorageApiConvertMessages(org.apache.beam.sdk.io.gcp.bigquery.StorageApiDynamicDestinations<ElementT,DestinationT> dynamicDestinations, BigQueryServices bqServices, org.apache.beam.sdk.values.TupleTag<BigQueryStorageApiInsertError> failedWritesTag, org.apache.beam.sdk.values.TupleTag<org.apache.beam.sdk.values.KV<DestinationT,StorageApiWritePayload>> successfulWritesTag, org.apache.beam.sdk.coders.Coder<BigQueryStorageApiInsertError> errorCoder, org.apache.beam.sdk.coders.Coder<org.apache.beam.sdk.values.KV<DestinationT,StorageApiWritePayload>> successCoder)
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description org.apache.beam.sdk.values.PCollectionTuple
expand(org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<DestinationT,ElementT>> input)
-
-
-
Constructor Detail
-
StorageApiConvertMessages
public StorageApiConvertMessages(org.apache.beam.sdk.io.gcp.bigquery.StorageApiDynamicDestinations<ElementT,DestinationT> dynamicDestinations, BigQueryServices bqServices, org.apache.beam.sdk.values.TupleTag<BigQueryStorageApiInsertError> failedWritesTag, org.apache.beam.sdk.values.TupleTag<org.apache.beam.sdk.values.KV<DestinationT,StorageApiWritePayload>> successfulWritesTag, org.apache.beam.sdk.coders.Coder<BigQueryStorageApiInsertError> errorCoder, org.apache.beam.sdk.coders.Coder<org.apache.beam.sdk.values.KV<DestinationT,StorageApiWritePayload>> successCoder)
-
-
Method Detail
-
expand
public org.apache.beam.sdk.values.PCollectionTuple expand(org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<DestinationT,ElementT>> input)
- Specified by:
expand
in classorg.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<DestinationT,ElementT>>,org.apache.beam.sdk.values.PCollectionTuple>
-
-