public abstract static class BigtableIO.ReadChangeStream
extends org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PBegin,org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<com.google.protobuf.ByteString,com.google.cloud.bigtable.data.v2.models.ChangeStreamMutation>>>
Constructor and Description |
---|
ReadChangeStream() |
Modifier and Type | Method and Description |
---|---|
org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<com.google.protobuf.ByteString,com.google.cloud.bigtable.data.v2.models.ChangeStreamMutation>> |
expand(org.apache.beam.sdk.values.PBegin input) |
BigtableIO.ReadChangeStream |
withAppProfileId(java.lang.String appProfileId)
Returns a new
BigtableIO.ReadChangeStream that will stream from the cluster specified
by app profile id. |
BigtableIO.ReadChangeStream |
withChangeStreamName(java.lang.String changeStreamName)
Returns a new
BigtableIO.ReadChangeStream that uses changeStreamName as prefix for
the metadata table. |
BigtableIO.ReadChangeStream |
withCreateOrUpdateMetadataTable(boolean shouldCreate)
Returns a new
BigtableIO.ReadChangeStream that, if set to true, will create or update
metadata table before launching pipeline. |
BigtableIO.ReadChangeStream |
withExistingPipelineOptions(BigtableIO.ExistingPipelineOptions existingPipelineOptions)
Returns a new
BigtableIO.ReadChangeStream that decides what to do if an existing
pipeline exists with the same change stream name. |
BigtableIO.ReadChangeStream |
withInstanceId(java.lang.String instanceId)
Returns a new
BigtableIO.ReadChangeStream that will stream from the Cloud Bigtable
instance indicated by given parameter, requires withProjectId(java.lang.String) to be called to
determine the project. |
BigtableIO.ReadChangeStream |
withMetadataTableAppProfileId(java.lang.String appProfileId)
Returns a new
BigtableIO.ReadChangeStream that will use the cluster specified by app
profile id to store the metadata of the stream. |
BigtableIO.ReadChangeStream |
withMetadataTableInstanceId(java.lang.String instanceId)
Returns a new
BigtableIO.ReadChangeStream that will use the Cloud Bigtable instance
indicated by given parameter to manage the metadata of the stream. |
BigtableIO.ReadChangeStream |
withMetadataTableProjectId(java.lang.String projectId)
Returns a new
BigtableIO.ReadChangeStream that will use the Cloud Bigtable project
indicated by given parameter to manage the metadata of the stream. |
BigtableIO.ReadChangeStream |
withMetadataTableTableId(java.lang.String tableId)
Returns a new
BigtableIO.ReadChangeStream that will use specified table to store the
metadata of the stream. |
BigtableIO.ReadChangeStream |
withProjectId(java.lang.String projectId)
Returns a new
BigtableIO.ReadChangeStream that will stream from the Cloud Bigtable
project indicated by given parameter, requires withInstanceId(java.lang.String) to be called to
determine the instance. |
BigtableIO.ReadChangeStream |
withStartTime(org.joda.time.Instant startTime)
Returns a new
BigtableIO.ReadChangeStream that will start streaming at the specified
start time. |
BigtableIO.ReadChangeStream |
withTableId(java.lang.String tableId)
Returns a new
BigtableIO.ReadChangeStream that will stream from the specified table. |
addAnnotation, compose, compose, getAdditionalInputs, getAnnotations, getDefaultOutputCoder, getDefaultOutputCoder, getDefaultOutputCoder, getKindString, getName, getResourceHints, populateDisplayData, setResourceHints, toString, validate, validate
public BigtableIO.ReadChangeStream withProjectId(java.lang.String projectId)
BigtableIO.ReadChangeStream
that will stream from the Cloud Bigtable
project indicated by given parameter, requires withInstanceId(java.lang.String)
to be called to
determine the instance.
Does not modify this object.
public BigtableIO.ReadChangeStream withInstanceId(java.lang.String instanceId)
BigtableIO.ReadChangeStream
that will stream from the Cloud Bigtable
instance indicated by given parameter, requires withProjectId(java.lang.String)
to be called to
determine the project.
Does not modify this object.
public BigtableIO.ReadChangeStream withTableId(java.lang.String tableId)
BigtableIO.ReadChangeStream
that will stream from the specified table.
Does not modify this object.
public BigtableIO.ReadChangeStream withAppProfileId(java.lang.String appProfileId)
BigtableIO.ReadChangeStream
that will stream from the cluster specified
by app profile id.
This must use single-cluster routing policy. If not setting a separate app profile for the
metadata table with withMetadataTableAppProfileId(java.lang.String)
, this
app profile also needs to enable allow single-row transactions.
Does not modify this object.
public BigtableIO.ReadChangeStream withStartTime(org.joda.time.Instant startTime)
BigtableIO.ReadChangeStream
that will start streaming at the specified
start time.
Does not modify this object.
public BigtableIO.ReadChangeStream withChangeStreamName(java.lang.String changeStreamName)
BigtableIO.ReadChangeStream
that uses changeStreamName as prefix for
the metadata table.
Does not modify this object.
public BigtableIO.ReadChangeStream withExistingPipelineOptions(BigtableIO.ExistingPipelineOptions existingPipelineOptions)
BigtableIO.ReadChangeStream
that decides what to do if an existing
pipeline exists with the same change stream name.
Does not modify this object.
public BigtableIO.ReadChangeStream withMetadataTableProjectId(java.lang.String projectId)
BigtableIO.ReadChangeStream
that will use the Cloud Bigtable project
indicated by given parameter to manage the metadata of the stream.
Optional: defaults to value from withProjectId
Does not modify this object.
public BigtableIO.ReadChangeStream withMetadataTableInstanceId(java.lang.String instanceId)
BigtableIO.ReadChangeStream
that will use the Cloud Bigtable instance
indicated by given parameter to manage the metadata of the stream.
Optional: defaults to value from withInstanceId
Does not modify this object.
public BigtableIO.ReadChangeStream withMetadataTableTableId(java.lang.String tableId)
BigtableIO.ReadChangeStream
that will use specified table to store the
metadata of the stream.
Optional: defaults to value from withTableId
Does not modify this object.
public BigtableIO.ReadChangeStream withMetadataTableAppProfileId(java.lang.String appProfileId)
BigtableIO.ReadChangeStream
that will use the cluster specified by app
profile id to store the metadata of the stream.
Optional: defaults to value from withAppProfileId
This must use single-cluster routing policy with allow single-row transactions enabled.
Does not modify this object.
public BigtableIO.ReadChangeStream withCreateOrUpdateMetadataTable(boolean shouldCreate)
BigtableIO.ReadChangeStream
that, if set to true, will create or update
metadata table before launching pipeline. Otherwise, it is expected that a metadata table
with correct schema exists.
Optional: defaults to true
Does not modify this object.
public org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<com.google.protobuf.ByteString,com.google.cloud.bigtable.data.v2.models.ChangeStreamMutation>> expand(org.apache.beam.sdk.values.PBegin input)
expand
in class org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PBegin,org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<com.google.protobuf.ByteString,com.google.cloud.bigtable.data.v2.models.ChangeStreamMutation>>>