A B C D E F G H I L M N O P Q R S T U V W

A

ackDeadlineSeconds(PubsubClient.SubscriptionPath) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient

Return the ack deadline, in seconds, for subscription.

ackDeadlineSeconds(PubsubClient.SubscriptionPath) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubGrpcClient

ackDeadlineSeconds(PubsubClient.SubscriptionPath) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubJsonClient

acknowledge(PubsubClient.SubscriptionPath, List<String>) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient

Acknowldege messages from subscription with ackIds.

acknowledge(PubsubClient.SubscriptionPath, List<String>) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubGrpcClient

acknowledge(PubsubClient.SubscriptionPath, List<String>) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubJsonClient

add(List<ValueInSingleWindow<T>>, TableDataInsertAllResponse.InsertErrors, TableReference, ValueInSingleWindow<TableRow>) - Method in interface org.apache.beam.sdk.io.gcp.bigquery.ErrorContainer

advanceImpl() - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryStorageStreamSource.BigQueryStorageStreamReader

allowsDynamicSplitting() - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryStorageStreamSource.BigQueryStorageStreamReader

alwaysRetry() - Static method in class org.apache.beam.sdk.io.gcp.bigquery.InsertRetryPolicy

Always retry all failures.

apply(Statement, Description) - Method in class org.apache.beam.sdk.io.gcp.bigquery.TestBigQuery

apply(Statement, Description) - Method in class org.apache.beam.sdk.io.gcp.pubsub.TestPubsub

apply(Statement, Description) - Method in class org.apache.beam.sdk.io.gcp.pubsub.TestPubsubSignal

asPath() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO.PubsubSubscription

Returns the string representation of this subscription as a path used in the Cloud Pub/Sub API.

asPath() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO.PubsubTopic

Returns the string representation of this topic as a path used in the Cloud Pub/Sub API.

assertThatAllRows(Schema) - Method in class org.apache.beam.sdk.io.gcp.bigquery.TestBigQuery

asV1Beta1Path() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO.PubsubSubscription

Deprecated.

the v1beta1 API for Cloud Pub/Sub is deprecated.

asV1Beta1Path() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO.PubsubTopic

Deprecated.

the v1beta1 API for Cloud Pub/Sub is deprecated.

asV1Beta2Path() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO.PubsubSubscription

Deprecated.

the v1beta2 API for Cloud Pub/Sub is deprecated.

asV1Beta2Path() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO.PubsubTopic

Deprecated.

the v1beta2 API for Cloud Pub/Sub is deprecated.

attached() - Method in class org.apache.beam.sdk.io.gcp.spanner.MutationGroup

attributes - Variable in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient.OutgoingMessage

AvroUtils - Class in org.apache.beam.sdk.io.gcp.bigquery

Utils to help convert Apache Avro types to Beam types.

AvroUtils() - Constructor for class org.apache.beam.sdk.io.gcp.bigquery.AvroUtils

B

BIG_QUERY_INSERT_ERROR_ERROR_CONTAINER - Static variable in interface org.apache.beam.sdk.io.gcp.bigquery.ErrorContainer

BigqueryClient - Class in org.apache.beam.sdk.io.gcp.testing

A wrapper class to call Bigquery API calls.

BigqueryClient(String) - Constructor for class org.apache.beam.sdk.io.gcp.testing.BigqueryClient

BigQueryCoderProviderRegistrar - Class in org.apache.beam.sdk.io.gcp.bigquery

A CoderProviderRegistrar for standard types used with BigQueryIO.

BigQueryCoderProviderRegistrar() - Constructor for class org.apache.beam.sdk.io.gcp.bigquery.BigQueryCoderProviderRegistrar

BigQueryHelpers - Class in org.apache.beam.sdk.io.gcp.bigquery

A set of helper functions and classes used by BigQueryIO.

BigQueryHelpers() - Constructor for class org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers

BigQueryInsertError - Class in org.apache.beam.sdk.io.gcp.bigquery

Model definition for BigQueryInsertError.

BigQueryInsertError(TableRow, TableDataInsertAllResponse.InsertErrors, TableReference) - Constructor for class org.apache.beam.sdk.io.gcp.bigquery.BigQueryInsertError

BigQueryInsertErrorCoder - Class in org.apache.beam.sdk.io.gcp.bigquery

A Coder that encodes BigQuery BigQueryInsertError objects.

BigQueryInsertErrorCoder() - Constructor for class org.apache.beam.sdk.io.gcp.bigquery.BigQueryInsertErrorCoder

BigQueryIO - Class in org.apache.beam.sdk.io.gcp.bigquery

PTransforms for reading and writing BigQuery tables.

BigQueryIO.Read - Class in org.apache.beam.sdk.io.gcp.bigquery

Implementation of BigQueryIO.read().

BigQueryIO.TypedRead<T> - Class in org.apache.beam.sdk.io.gcp.bigquery

Implementation of BigQueryIO.read(SerializableFunction).

BigQueryIO.TypedRead.Method - Enum in org.apache.beam.sdk.io.gcp.bigquery

Determines the method used to read data from BigQuery.

BigQueryIO.TypedRead.QueryPriority - Enum in org.apache.beam.sdk.io.gcp.bigquery

An enumeration type for the priority of a query.

BigQueryIO.Write<T> - Class in org.apache.beam.sdk.io.gcp.bigquery

Implementation of BigQueryIO.write().

BigQueryIO.Write.CreateDisposition - Enum in org.apache.beam.sdk.io.gcp.bigquery

An enumeration type for the BigQuery create disposition strings.

BigQueryIO.Write.Method - Enum in org.apache.beam.sdk.io.gcp.bigquery

Determines the method used to insert data in BigQuery.

BigQueryIO.Write.WriteDisposition - Enum in org.apache.beam.sdk.io.gcp.bigquery

An enumeration type for the BigQuery write disposition strings.

BigqueryMatcher - Class in org.apache.beam.sdk.io.gcp.testing

A matcher to verify data in BigQuery by processing given query and comparing with content's checksum.

BigqueryMatcher(String, String, String, String) - Constructor for class org.apache.beam.sdk.io.gcp.testing.BigqueryMatcher

BigQueryOptions - Interface in org.apache.beam.sdk.io.gcp.bigquery

Properties needed when using Google BigQuery with the Apache Beam SDK.

BigQueryServices - Interface in org.apache.beam.sdk.io.gcp.bigquery

An interface for real, mock, or fake implementations of Cloud BigQuery services.

BigQueryServices.DatasetService - Interface in org.apache.beam.sdk.io.gcp.bigquery

An interface to get, create and delete Cloud BigQuery datasets and tables.

BigQueryServices.JobService - Interface in org.apache.beam.sdk.io.gcp.bigquery

An interface for the Cloud BigQuery load service.

BigQueryServices.StorageClient - Interface in org.apache.beam.sdk.io.gcp.bigquery

An interface representing a client object for making calls to the BigQuery Storage API.

BigQueryStorageStreamSource<T> - Class in org.apache.beam.sdk.io.gcp.bigquery

A Source representing a single stream in a read session.

BigQueryStorageStreamSource.BigQueryStorageStreamReader<T> - Class in org.apache.beam.sdk.io.gcp.bigquery

A Source.Reader which reads records from a stream.

BigQueryStorageTableSource<T> - Class in org.apache.beam.sdk.io.gcp.bigquery

A Source representing reading from a table.

BigQueryUtils - Class in org.apache.beam.sdk.io.gcp.bigquery

Utility methods for BigQuery related operations.

BigQueryUtils() - Constructor for class org.apache.beam.sdk.io.gcp.bigquery.BigQueryUtils

BigtableIO - Class in org.apache.beam.sdk.io.gcp.bigtable

Transforms for reading from and writing to Google Cloud Bigtable.

BigtableIO.Read - Class in org.apache.beam.sdk.io.gcp.bigtable

A PTransform that reads from Google Cloud Bigtable.

BigtableIO.Write - Class in org.apache.beam.sdk.io.gcp.bigtable

A PTransform that writes to Google Cloud Bigtable.

build() - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerConfig.Builder

build() - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.CreateTransaction.Builder

Builder() - Constructor for class org.apache.beam.sdk.io.gcp.spanner.SpannerConfig.Builder

Builder() - Constructor for class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.CreateTransaction.Builder

C

checkIfAnySubscriptionExists(String, Duration) - Method in class org.apache.beam.sdk.io.gcp.pubsub.TestPubsub

Check if topics exist.

close() - Method in interface org.apache.beam.sdk.io.gcp.bigquery.BigQueryServices.StorageClient

Close the client object.

close() - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryStorageStreamSource.BigQueryStorageStreamReader

close() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubGrpcClient

Gracefully close the underlying netty channel.

close() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubJsonClient

close() - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerAccessor

connectToSpanner() - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerConfig

Context(TableDataInsertAllResponse.InsertErrors) - Constructor for class org.apache.beam.sdk.io.gcp.bigquery.InsertRetryPolicy.Context

convertAvroFormat(Schema.Field, Object) - Static method in class org.apache.beam.sdk.io.gcp.bigquery.AvroUtils

Tries to convert an Avro field to Beam field based on the target type of the Beam field.

create(Storage.ReadSession, Storage.Stream, TableSchema, SerializableFunction<SchemaAndRecord, T>, Coder<T>, BigQueryServices) - Static method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryStorageStreamSource

create(ValueProvider<TableReference>, ReadOptions.TableReadOptions, SerializableFunction<SchemaAndRecord, T>, Coder<T>, BigQueryServices) - Static method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryStorageTableSource

create(Schema) - Static method in class org.apache.beam.sdk.io.gcp.bigquery.TestBigQuery

Creates an instance of this rule.

create() - Static method in class org.apache.beam.sdk.io.gcp.pubsub.TestPubsub

Creates an instance of this rule.

create() - Static method in class org.apache.beam.sdk.io.gcp.pubsub.TestPubsubSignal

Creates an instance of this rule.

create(Mutation, Mutation...) - Static method in class org.apache.beam.sdk.io.gcp.spanner.MutationGroup

Creates a new group.

create(Mutation, Iterable<Mutation>) - Static method in class org.apache.beam.sdk.io.gcp.spanner.MutationGroup

create() - Static method in class org.apache.beam.sdk.io.gcp.spanner.ReadOperation

create() - Static method in class org.apache.beam.sdk.io.gcp.spanner.SpannerConfig

create(BatchTransactionId) - Static method in class org.apache.beam.sdk.io.gcp.spanner.Transaction

createDataset(String, String, String, String, Long) - Method in interface org.apache.beam.sdk.io.gcp.bigquery.BigQueryServices.DatasetService

Create a Dataset with the given location, description and default expiration time for tables in the dataset (if null, tables don't expire).

createNewDataset(String, String) - Method in class org.apache.beam.sdk.io.gcp.testing.BigqueryClient

createNewTable(String, String, Table) - Method in class org.apache.beam.sdk.io.gcp.testing.BigqueryClient

createRandomSubscription(PubsubClient.ProjectPath, PubsubClient.TopicPath, int) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient

Create a random subscription for topic.

createReader(PipelineOptions) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryStorageStreamSource

createReader(PipelineOptions) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryStorageTableSource

createReadSession(Storage.CreateReadSessionRequest) - Method in interface org.apache.beam.sdk.io.gcp.bigquery.BigQueryServices.StorageClient

Create a new read session against an existing table.

createSourceForSubrange(long, long) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryStorageStreamSource

createSubscription(PubsubClient.TopicPath, PubsubClient.SubscriptionPath, int) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient

Create subscription to topic.

createSubscription(PubsubClient.TopicPath, PubsubClient.SubscriptionPath, int) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubGrpcClient

createSubscription(PubsubClient.TopicPath, PubsubClient.SubscriptionPath, int) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubJsonClient

createTable(Table) - Method in interface org.apache.beam.sdk.io.gcp.bigquery.BigQueryServices.DatasetService

Creates the specified table if it does not exist.

CreateTables<DestinationT,ElementT> - Class in org.apache.beam.sdk.io.gcp.bigquery

Creates any tables needed before performing streaming writes to the tables.

CreateTables(BigQueryIO.Write.CreateDisposition, DynamicDestinations<?, DestinationT>) - Constructor for class org.apache.beam.sdk.io.gcp.bigquery.CreateTables

createTopic(PubsubClient.TopicPath) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient

Create topic.

createTopic(PubsubClient.TopicPath) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubGrpcClient

createTopic(PubsubClient.TopicPath) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubJsonClient

createTransaction() - Static method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO

Returns a transform that creates a batch transaction.

CreateTransaction() - Constructor for class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.CreateTransaction

D

DatastoreIO - Class in org.apache.beam.sdk.io.gcp.datastore

DatastoreIO provides an API for reading from and writing to Google Cloud Datastore over different versions of the Cloud Datastore Client libraries.

DatastoreV1 - Class in org.apache.beam.sdk.io.gcp.datastore

DatastoreV1 provides an API to Read, Write and Delete PCollections of Google Cloud Datastore version v1 Entity objects.

DatastoreV1.DeleteEntity - Class in org.apache.beam.sdk.io.gcp.datastore

A PTransform that deletes Entities from Cloud Datastore.

DatastoreV1.DeleteKey - Class in org.apache.beam.sdk.io.gcp.datastore

A PTransform that deletes Entities associated with the given Keys from Cloud Datastore.

DatastoreV1.Read - Class in org.apache.beam.sdk.io.gcp.datastore

A PTransform that reads the result rows of a Cloud Datastore query as Entity objects.

DatastoreV1.Write - Class in org.apache.beam.sdk.io.gcp.datastore

A PTransform that writes Entity objects to Cloud Datastore.

decode(InputStream) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryInsertErrorCoder

decode(InputStream) - Method in class org.apache.beam.sdk.io.gcp.bigquery.TableDestinationCoder

decode(InputStream) - Method in class org.apache.beam.sdk.io.gcp.bigquery.TableDestinationCoderV2

decode(InputStream) - Method in class org.apache.beam.sdk.io.gcp.bigquery.TableRowJsonCoder

decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.io.gcp.bigquery.TableRowJsonCoder

decode(InputStream) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubMessagePayloadOnlyCoder

decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubMessagePayloadOnlyCoder

decode(InputStream) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubMessageWithAttributesCoder

decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubMessageWithAttributesCoder

deleteDataset(String, String) - Method in interface org.apache.beam.sdk.io.gcp.bigquery.BigQueryServices.DatasetService

Deletes the dataset specified by the datasetId value.

deleteDataset(String, String) - Method in class org.apache.beam.sdk.io.gcp.testing.BigqueryClient

deleteEntity() - Method in class org.apache.beam.sdk.io.gcp.datastore.DatastoreV1

Returns an empty DatastoreV1.DeleteEntity builder.

deleteKey() - Method in class org.apache.beam.sdk.io.gcp.datastore.DatastoreV1

Returns an empty DatastoreV1.DeleteKey builder.

deleteSubscription(PubsubClient.SubscriptionPath) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient

Delete subscription.

deleteSubscription(PubsubClient.SubscriptionPath) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubGrpcClient

deleteSubscription(PubsubClient.SubscriptionPath) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubJsonClient

deleteTable(TableReference) - Method in interface org.apache.beam.sdk.io.gcp.bigquery.BigQueryServices.DatasetService

Deletes the table specified by tableId from the dataset.

deleteTable(String, String, String) - Method in class org.apache.beam.sdk.io.gcp.testing.BigqueryClient

deleteTopic(PubsubClient.TopicPath) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient

deleteTopic(PubsubClient.TopicPath) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubGrpcClient

deleteTopic(PubsubClient.TopicPath) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubJsonClient

describeMismatchSafely(PipelineResult, Description) - Method in class org.apache.beam.sdk.io.gcp.testing.BigqueryMatcher

describeTo(Description) - Method in class org.apache.beam.sdk.io.gcp.testing.BigqueryMatcher

dryRunQuery(String, JobConfigurationQuery, String) - Method in interface org.apache.beam.sdk.io.gcp.bigquery.BigQueryServices.JobService

Dry runs the query in the given project.

DynamicDestinations<T,DestinationT> - Class in org.apache.beam.sdk.io.gcp.bigquery

This class provides the most general way of specifying dynamic BigQuery table destinations.

DynamicDestinations() - Constructor for class org.apache.beam.sdk.io.gcp.bigquery.DynamicDestinations

E

elementBytes - Variable in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient.OutgoingMessage

Underlying (encoded) element.

encode(BigQueryInsertError, OutputStream) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryInsertErrorCoder

encode(TableDestination, OutputStream) - Method in class org.apache.beam.sdk.io.gcp.bigquery.TableDestinationCoder

encode(TableDestination, OutputStream) - Method in class org.apache.beam.sdk.io.gcp.bigquery.TableDestinationCoderV2

encode(TableRow, OutputStream) - Method in class org.apache.beam.sdk.io.gcp.bigquery.TableRowJsonCoder

encode(TableRow, OutputStream, Coder.Context) - Method in class org.apache.beam.sdk.io.gcp.bigquery.TableRowJsonCoder

encode(PubsubMessage, OutputStream) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubMessagePayloadOnlyCoder

encode(PubsubMessage, OutputStream, Coder.Context) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubMessagePayloadOnlyCoder

encode(PubsubMessage, OutputStream) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubMessageWithAttributesCoder

encode(PubsubMessage, OutputStream, Coder.Context) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubMessageWithAttributesCoder

equals(Object) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryInsertError

equals(Object) - Method in class org.apache.beam.sdk.io.gcp.bigquery.TableDestination

equals(Object) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient.OutgoingMessage

equals(Object) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient.ProjectPath

equals(Object) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient.SubscriptionPath

equals(Object) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient.TopicPath

equals(Object) - Method in class org.apache.beam.sdk.io.gcp.spanner.MutationGroup

ErrorContainer<T> - Interface in org.apache.beam.sdk.io.gcp.bigquery

ErrorContainer interface.

eventually(Matcher<Iterable<? extends Row>>) - Method in interface org.apache.beam.sdk.io.gcp.bigquery.TestBigQuery.RowsAssertion

expand(PBegin) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Read

expand(PBegin) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.TypedRead

expand(PCollection<T>) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Write

expand(PCollection<KV<DestinationT, ElementT>>) - Method in class org.apache.beam.sdk.io.gcp.bigquery.CreateTables

expand(PCollection<InputT>) - Method in class org.apache.beam.sdk.io.gcp.bigquery.PrepareWrite

expand(PCollection<T>) - Method in class org.apache.beam.sdk.io.gcp.bigquery.ReifyAsIterable

expand(PCollection<KV<DestinationT, ElementT>>) - Method in class org.apache.beam.sdk.io.gcp.bigquery.StreamingInserts

expand(PCollection<KV<TableDestination, ElementT>>) - Method in class org.apache.beam.sdk.io.gcp.bigquery.StreamingWriteTables

expand() - Method in class org.apache.beam.sdk.io.gcp.bigquery.WriteResult

expand(PBegin) - Method in class org.apache.beam.sdk.io.gcp.bigtable.BigtableIO.Read

expand(PCollection<KV<ByteString, Iterable<Mutation>>>) - Method in class org.apache.beam.sdk.io.gcp.bigtable.BigtableIO.Write

expand(PBegin) - Method in class org.apache.beam.sdk.io.gcp.datastore.DatastoreV1.Read

expand(PBegin) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO.Read

expand(PCollection<T>) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO.Write

expand(PCollection<PubsubMessage>) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubUnboundedSink

expand(PBegin) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubUnboundedSource

expand(PBegin) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.CreateTransaction

expand(PBegin) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.Read

expand(PCollection<ReadOperation>) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.ReadAll

expand(PCollection<Mutation>) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.Write

expand(PCollection<MutationGroup>) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.WriteGrouped

expand() - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerWriteResult

extractTimestamp(String, String, Map<String, String>) - Static method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient

Return the timestamp (in ms since unix epoch) to use for a Pubsub message with attributes and pubsubTimestamp.

F

FACTORY - Static variable in class org.apache.beam.sdk.io.gcp.pubsub.PubsubGrpcClient

Factory for creating Pubsub clients using gRCP transport.

FACTORY - Static variable in class org.apache.beam.sdk.io.gcp.pubsub.PubsubJsonClient

Factory for creating Pubsub clients using Json transport.

finishBundle() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO.Write.PubsubBoundedWriter

finishSpecifyingOutput(String, PInput, PTransform<?, ?>) - Method in class org.apache.beam.sdk.io.gcp.bigquery.WriteResult

finishSpecifyingOutput(String, PInput, PTransform<?, ?>) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerWriteResult

from(String) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Read

Reads a BigQuery table specified as "[project_id]:[dataset_id].[table_id]" or "[dataset_id].[table_id]" for tables within the current project.

from(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Read

Same as from(String), but with a ValueProvider.

from(TableReference) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Read

Read from table specified by a TableReference.

from(String) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.TypedRead

See BigQueryIO.Read.from(String).

from(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.TypedRead

See BigQueryIO.Read.from(ValueProvider).

from(TableReference) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.TypedRead

See BigQueryIO.Read.from(TableReference).

fromPath(String) - Static method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO.PubsubSubscription

Creates a class representing a Pub/Sub subscription from the specified subscription path.

fromPath(String) - Static method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO.PubsubTopic

Creates a class representing a Cloud Pub/Sub topic from the specified topic path.

fromQuery(String) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Read

Reads results received after executing the given query.

fromQuery(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Read

Same as fromQuery(String), but with a ValueProvider.

fromQuery(String) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.TypedRead

See BigQueryIO.Read.fromQuery(String).

fromQuery(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.TypedRead

See BigQueryIO.Read.fromQuery(ValueProvider).

fromSubscription(String) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO.Read

Reads from the given subscription.

fromSubscription(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO.Read

Like subscription() but with a ValueProvider.

fromTopic(String) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO.Read

Creates and returns a transform for reading from a Cloud Pub/Sub topic.

fromTopic(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO.Read

Like topic() but with a ValueProvider.

G

GcpIoPipelineOptionsRegistrar - Class in org.apache.beam.sdk.io.gcp.common

A registrar containing the default GCP options.

GcpIoPipelineOptionsRegistrar() - Constructor for class org.apache.beam.sdk.io.gcp.common.GcpIoPipelineOptionsRegistrar

getAttribute(String) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubMessage

Returns the given attribute value.

getAttributeMap() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubMessage

Returns the full map of attributes.

getBatchClient() - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerAccessor

getBigtableOptions() - Method in class org.apache.beam.sdk.io.gcp.bigtable.BigtableIO.Read

Deprecated.

will be replaced by bigtable options configurator.

getBigtableOptions() - Method in class org.apache.beam.sdk.io.gcp.bigtable.BigtableIO.Write

Deprecated.

will be replaced by bigtable options configurator.

getClient(String) - Static method in class org.apache.beam.sdk.io.gcp.testing.BigqueryClient

getCoderProviders() - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryCoderProviderRegistrar

getCoderProviders() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubCoderProviderRegistrar

getColumns() - Method in class org.apache.beam.sdk.io.gcp.spanner.ReadOperation

getCurrent() - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryStorageStreamSource.BigQueryStorageStreamReader

getCurrentOffset() - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryStorageStreamSource.BigQueryStorageStreamReader

getCurrentSource() - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryStorageStreamSource.BigQueryStorageStreamReader

getDatabaseAdminClient() - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerAccessor

getDatabaseClient() - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerAccessor

getDatabaseId() - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerConfig

getDataset(String, String) - Method in interface org.apache.beam.sdk.io.gcp.bigquery.BigQueryServices.DatasetService

Gets the specified Dataset resource by dataset ID.

getDatasetService(BigQueryOptions) - Method in interface org.apache.beam.sdk.io.gcp.bigquery.BigQueryServices

Returns a real, mock, or fake BigQueryServices.DatasetService.

getDestination(ValueInSingleWindow<T>) - Method in class org.apache.beam.sdk.io.gcp.bigquery.DynamicDestinations

Returns an object that represents at a high level which table is being written to.

getDestinationCoder() - Method in class org.apache.beam.sdk.io.gcp.bigquery.DynamicDestinations

Returns the coder for DestinationT.

getEncodedElementByteSize(BigQueryInsertError) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryInsertErrorCoder

getEncodedElementByteSize(TableRow) - Method in class org.apache.beam.sdk.io.gcp.bigquery.TableRowJsonCoder

getEncodedTypeDescriptor() - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryInsertErrorCoder

getEncodedTypeDescriptor() - Method in class org.apache.beam.sdk.io.gcp.bigquery.TableRowJsonCoder

getError() - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryInsertError

getEstimatedSizeBytes(PipelineOptions) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryStorageStreamSource

getEstimatedSizeBytes(PipelineOptions) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryStorageTableSource

getFailedInserts() - Method in class org.apache.beam.sdk.io.gcp.bigquery.WriteResult

Returns a PCollection containing the TableRows that didn't made it to BQ.

getFailedInsertsWithErr() - Method in class org.apache.beam.sdk.io.gcp.bigquery.WriteResult

Returns a PCollection containing the BigQueryInsertErrors with detailed error information.

getFailedMutations() - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerWriteResult

getFlatJsonRows(Schema) - Method in class org.apache.beam.sdk.io.gcp.bigquery.TestBigQuery

Loads rows from BigQuery into Rows with given Schema.

getHost() - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerConfig

getHTTPWriteTimeout() - Method in interface org.apache.beam.sdk.io.gcp.bigquery.BigQueryOptions

getId() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient.ProjectPath

getIdAttribute() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubUnboundedSink

Get the id attribute.

getIdAttribute() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubUnboundedSource

Get the id attribute.

getIndex() - Method in class org.apache.beam.sdk.io.gcp.spanner.ReadOperation

getInsertBundleParallelism() - Method in interface org.apache.beam.sdk.io.gcp.bigquery.BigQueryOptions

getInstanceId() - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerConfig

getJob(JobReference) - Method in interface org.apache.beam.sdk.io.gcp.bigquery.BigQueryServices.JobService

Gets the specified Job by the given JobReference.

getJobService(BigQueryOptions) - Method in interface org.apache.beam.sdk.io.gcp.bigquery.BigQueryServices

Returns a real, mock, or fake BigQueryServices.JobService.

getJsonTimePartitioning() - Method in class org.apache.beam.sdk.io.gcp.bigquery.TableDestination

getKeyRanges() - Method in class org.apache.beam.sdk.io.gcp.bigtable.BigtableIO.Read

Returns the range of keys that will be read from the table.

getKeySet() - Method in class org.apache.beam.sdk.io.gcp.spanner.ReadOperation

getKind() - Method in interface org.apache.beam.sdk.io.gcp.pubsub.PubsubClient.PubsubClientFactory

Return the display name for this factory.

getLiteralGqlQuery() - Method in class org.apache.beam.sdk.io.gcp.datastore.DatastoreV1.Read

getLocalhost() - Method in class org.apache.beam.sdk.io.gcp.datastore.DatastoreV1.Read

getMaxEndOffset(PipelineOptions) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryStorageStreamSource

getName() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient.SubscriptionPath

getName() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient.TopicPath

getNamespace() - Method in class org.apache.beam.sdk.io.gcp.datastore.DatastoreV1.Read

getNeedsAttributes() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubUnboundedSource

getNewBigquerryClient(String) - Static method in class org.apache.beam.sdk.io.gcp.testing.BigqueryClient

getNumQuerySplits() - Method in class org.apache.beam.sdk.io.gcp.datastore.DatastoreV1.Read

getOutput() - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerWriteResult

getOutputCoder() - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryStorageStreamSource

getOutputCoder() - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryStorageTableSource

getPath() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient.ProjectPath

getPath() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient.SubscriptionPath

getPath() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient.TopicPath

getPayload() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubMessage

Returns the main PubSub message.

getPipeline() - Method in class org.apache.beam.sdk.io.gcp.bigquery.WriteResult

getPipeline() - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerWriteResult

getPipelineOptions() - Method in class org.apache.beam.sdk.io.gcp.common.GcpIoPipelineOptionsRegistrar

getProject() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubUnboundedSource

Get the project path.

getProjectId() - Method in class org.apache.beam.sdk.io.gcp.datastore.DatastoreV1.Read

getProjectId() - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerConfig

getPubsubRootUrl() - Method in interface org.apache.beam.sdk.io.gcp.pubsub.PubsubOptions

Root URL for use with the Google Cloud Pub/Sub API.

getQuery() - Method in class org.apache.beam.sdk.io.gcp.datastore.DatastoreV1.Read

getQuery() - Method in class org.apache.beam.sdk.io.gcp.spanner.ReadOperation

getRecord() - Method in class org.apache.beam.sdk.io.gcp.bigquery.SchemaAndRecord

getRow() - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryInsertError

getSchema(DestinationT) - Method in class org.apache.beam.sdk.io.gcp.bigquery.DynamicDestinations

Returns the table schema for the destination.

getSideInputs() - Method in class org.apache.beam.sdk.io.gcp.bigquery.DynamicDestinations

Specifies that this object needs access to one or more side inputs.

getStorageClient(BigQueryOptions) - Method in interface org.apache.beam.sdk.io.gcp.bigquery.BigQueryServices

Returns a real, mock, or fake BigQueryServices.StorageClient.

getSubscription() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubUnboundedSource

Get the subscription being read from.

getSubscriptionProvider() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubUnboundedSource

Get the ValueProvider for the subscription being read from.

getTable() - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryInsertError

getTable() - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Read

Returns the table to read, or null if reading from a query instead.

getTable() - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.TypedRead

See BigQueryIO.Read.getTable().

getTable() - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Write

Returns the table reference, or null.

getTable(TableReference) - Method in interface org.apache.beam.sdk.io.gcp.bigquery.BigQueryServices.DatasetService

Gets the specified Table resource by table ID.

getTable(TableReference, List<String>) - Method in interface org.apache.beam.sdk.io.gcp.bigquery.BigQueryServices.DatasetService

getTable(DestinationT) - Method in class org.apache.beam.sdk.io.gcp.bigquery.DynamicDestinations

Returns a TableDestination object for the destination.

getTable() - Method in class org.apache.beam.sdk.io.gcp.spanner.ReadOperation

getTableDescription() - Method in class org.apache.beam.sdk.io.gcp.bigquery.TableDestination

getTableId() - Method in class org.apache.beam.sdk.io.gcp.bigtable.BigtableIO.Read

Returns the table being read from.

getTableProvider() - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Read

Returns the table to read, or null if reading from a query instead.

getTableProvider() - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.TypedRead

See BigQueryIO.Read.getTableProvider().

getTableReference() - Method in class org.apache.beam.sdk.io.gcp.bigquery.TableDestination

getTableResource(String, String, String) - Method in class org.apache.beam.sdk.io.gcp.testing.BigqueryClient

getTableSchema() - Method in class org.apache.beam.sdk.io.gcp.bigquery.SchemaAndRecord

getTableSpec() - Method in class org.apache.beam.sdk.io.gcp.bigquery.TableDestination

getTargetDataset() - Method in interface org.apache.beam.sdk.io.gcp.bigquery.TestBigQueryOptions

getTempDatasetId() - Method in interface org.apache.beam.sdk.io.gcp.bigquery.BigQueryOptions

getTimePartitioning() - Method in class org.apache.beam.sdk.io.gcp.bigquery.TableDestination

getTimestampAttribute() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubUnboundedSink

Get the timestamp attribute.

getTimestampAttribute() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubUnboundedSource

Get the timestamp attribute.

getTopic() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubUnboundedSink

Get the topic being written to.

getTopic() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubUnboundedSource

Get the topic being read from.

getTopicProvider() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubUnboundedSink

Get the ValueProvider for the topic being written to.

getTopicProvider() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubUnboundedSource

Get the ValueProvider for the topic being read from.

getV1Beta1Path() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient.SubscriptionPath

getV1Beta1Path() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient.TopicPath

grouped() - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.Write

Same transform but can be applied to PCollection of MutationGroup.

H

hashCode() - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryInsertError

hashCode() - Method in class org.apache.beam.sdk.io.gcp.bigquery.TableDestination

hashCode() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient.OutgoingMessage

hashCode() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient.ProjectPath

hashCode() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient.SubscriptionPath

hashCode() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient.TopicPath

hashCode() - Method in class org.apache.beam.sdk.io.gcp.spanner.MutationGroup

I

ignoreUnknownValues() - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Write

Accept rows that contain values that do not match the schema.

insertAll(TableReference, List<ValueInSingleWindow<TableRow>>, List<String>, InsertRetryPolicy, List<ValueInSingleWindow<T>>, ErrorContainer<T>, boolean, boolean) - Method in interface org.apache.beam.sdk.io.gcp.bigquery.BigQueryServices.DatasetService

Inserts TableRows with the specified insertIds if not null.

insertDataToTable(String, String, String, List<Map<String, Object>>) - Method in class org.apache.beam.sdk.io.gcp.testing.BigqueryClient

InsertRetryPolicy - Class in org.apache.beam.sdk.io.gcp.bigquery

A retry policy for streaming BigQuery inserts.

InsertRetryPolicy() - Constructor for class org.apache.beam.sdk.io.gcp.bigquery.InsertRetryPolicy

InsertRetryPolicy.Context - Class in org.apache.beam.sdk.io.gcp.bigquery

Contains information about a failed insert.

isEOF() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient

Return true if PubsubClient.pull(long, org.apache.beam.sdk.io.gcp.pubsub.PubsubClient.SubscriptionPath, int, boolean) will always return empty list.

isEOF() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubGrpcClient

isEOF() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubJsonClient

isTableEmpty(TableReference) - Method in interface org.apache.beam.sdk.io.gcp.bigquery.BigQueryServices.DatasetService

Returns true if the table is empty.

iterator() - Method in class org.apache.beam.sdk.io.gcp.spanner.MutationGroup

L

listSubscriptions(PubsubClient.ProjectPath, PubsubClient.TopicPath) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient

Return a list of subscriptions for topic in project.

listSubscriptions(PubsubClient.ProjectPath, PubsubClient.TopicPath) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubGrpcClient

listSubscriptions(PubsubClient.ProjectPath, PubsubClient.TopicPath) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubJsonClient

listTopics(PubsubClient.ProjectPath) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient

Return a list of topics for project.

listTopics(PubsubClient.ProjectPath) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubGrpcClient

listTopics(PubsubClient.ProjectPath) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubJsonClient

M

matchesSafely(PipelineResult) - Method in class org.apache.beam.sdk.io.gcp.testing.BigqueryMatcher

modifyAckDeadline(PubsubClient.SubscriptionPath, List<String>, int) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient

Modify the ack deadline for messages from subscription with ackIds to be deadlineSeconds from now.

modifyAckDeadline(PubsubClient.SubscriptionPath, List<String>, int) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubGrpcClient

modifyAckDeadline(PubsubClient.SubscriptionPath, List<String>, int) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubJsonClient

MutationGroup - Class in org.apache.beam.sdk.io.gcp.spanner

A bundle of mutations that must be submitted atomically.

N

neverRetry() - Static method in class org.apache.beam.sdk.io.gcp.bigquery.InsertRetryPolicy

Never retry any failures.

newClient(String, String, PubsubOptions) - Method in interface org.apache.beam.sdk.io.gcp.pubsub.PubsubClient.PubsubClientFactory

Construct a new Pubsub client.

NUM_QUERY_SPLITS_MAX - Static variable in class org.apache.beam.sdk.io.gcp.datastore.DatastoreV1.Read

An upper bound on the number of splits for a query.

O

of() - Static method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryInsertErrorCoder

of() - Static method in class org.apache.beam.sdk.io.gcp.bigquery.TableDestinationCoder

of() - Static method in class org.apache.beam.sdk.io.gcp.bigquery.TableDestinationCoderV2

of() - Static method in class org.apache.beam.sdk.io.gcp.bigquery.TableRowJsonCoder

of() - Static method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubMessagePayloadOnlyCoder

of(TypeDescriptor<PubsubMessage>) - Static method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubMessageWithAttributesCoder

of() - Static method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubMessageWithAttributesCoder

org.apache.beam.sdk.io.gcp.bigquery - package org.apache.beam.sdk.io.gcp.bigquery

Defines transforms for reading and writing from Google BigQuery.

org.apache.beam.sdk.io.gcp.bigtable - package org.apache.beam.sdk.io.gcp.bigtable

Defines transforms for reading and writing from Google Cloud Bigtable.

org.apache.beam.sdk.io.gcp.common - package org.apache.beam.sdk.io.gcp.common

Defines common Google Cloud Platform IO support classes.

org.apache.beam.sdk.io.gcp.datastore - package org.apache.beam.sdk.io.gcp.datastore

Provides an API for reading from and writing to Google Cloud Datastore over different versions of the Cloud Datastore Client libraries.

org.apache.beam.sdk.io.gcp.pubsub - package org.apache.beam.sdk.io.gcp.pubsub

Defines transforms for reading and writing from Google Cloud Pub/Sub.

org.apache.beam.sdk.io.gcp.spanner - package org.apache.beam.sdk.io.gcp.spanner

Provides an API for reading from and writing to Google Cloud Spanner.

org.apache.beam.sdk.io.gcp.testing - package org.apache.beam.sdk.io.gcp.testing

Defines utilities for unit testing Google Cloud Platform components of Apache Beam pipelines.

OutgoingMessage(byte[], Map<String, String>, long, String) - Constructor for class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient.OutgoingMessage

P

parseTableSpec(String) - Static method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers

Parse a table specification in the form "[project_id]:[dataset_id].[table_id]" or "[dataset_id].[table_id]".

patchTableDescription(TableReference, String) - Method in interface org.apache.beam.sdk.io.gcp.bigquery.BigQueryServices.DatasetService

Patch BigQuery Table description.

pollFor(Duration) - Method in interface org.apache.beam.sdk.io.gcp.bigquery.TestBigQuery.PollingAssertion

pollJob(JobReference, int) - Method in interface org.apache.beam.sdk.io.gcp.bigquery.BigQueryServices.JobService

Waits for the job is Done, and returns the job.

populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Read

populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.TypedRead

populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Write

populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryStorageStreamSource

populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryStorageTableSource

populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.io.gcp.bigtable.BigtableIO.Read

populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.io.gcp.bigtable.BigtableIO.Write

populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.io.gcp.datastore.DatastoreV1.Read

populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO.Read

populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO.Write

populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO.Write.PubsubBoundedWriter

populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerConfig

populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.Write

PrepareWrite<InputT,DestinationT,OutputT> - Class in org.apache.beam.sdk.io.gcp.bigquery

Prepare an input PCollection for writing to BigQuery.

PrepareWrite(DynamicDestinations<InputT, DestinationT>, SerializableFunction<InputT, OutputT>) - Constructor for class org.apache.beam.sdk.io.gcp.bigquery.PrepareWrite

primary() - Method in class org.apache.beam.sdk.io.gcp.spanner.MutationGroup

processElement(DoFn<T, Void>.ProcessContext) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO.Write.PubsubBoundedWriter

projectPathFromId(String) - Static method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient

projectPathFromPath(String) - Static method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient

publish(PubsubClient.TopicPath, List<PubsubClient.OutgoingMessage>) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient

Publish outgoingMessages to Pubsub topic.

publish(PubsubClient.TopicPath, List<PubsubClient.OutgoingMessage>) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubGrpcClient

publish(PubsubClient.TopicPath, List<PubsubClient.OutgoingMessage>) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubJsonClient

publish(List<PubsubMessage>) - Method in class org.apache.beam.sdk.io.gcp.pubsub.TestPubsub

Publish messages to TestPubsub.topicPath().

PubsubClient - Class in org.apache.beam.sdk.io.gcp.pubsub

An (abstract) helper class for talking to Pubsub via an underlying transport.

PubsubClient() - Constructor for class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient

PubsubClient.OutgoingMessage - Class in org.apache.beam.sdk.io.gcp.pubsub

A message to be sent to Pubsub.

PubsubClient.ProjectPath - Class in org.apache.beam.sdk.io.gcp.pubsub

Path representing a cloud project id.

PubsubClient.PubsubClientFactory - Interface in org.apache.beam.sdk.io.gcp.pubsub

Factory for creating clients.

PubsubClient.SubscriptionPath - Class in org.apache.beam.sdk.io.gcp.pubsub

Path representing a Pubsub subscription.

PubsubClient.TopicPath - Class in org.apache.beam.sdk.io.gcp.pubsub

Path representing a Pubsub topic.

PubsubCoderProviderRegistrar - Class in org.apache.beam.sdk.io.gcp.pubsub

A CoderProviderRegistrar for standard types used with PubsubIO.

PubsubCoderProviderRegistrar() - Constructor for class org.apache.beam.sdk.io.gcp.pubsub.PubsubCoderProviderRegistrar

PubsubGrpcClient - Class in org.apache.beam.sdk.io.gcp.pubsub

A helper class for talking to Pubsub via grpc.

PubsubIO - Class in org.apache.beam.sdk.io.gcp.pubsub

Read and Write PTransforms for Cloud Pub/Sub streams.

PubsubIO.PubsubSubscription - Class in org.apache.beam.sdk.io.gcp.pubsub

Class representing a Cloud Pub/Sub Subscription.

PubsubIO.PubsubTopic - Class in org.apache.beam.sdk.io.gcp.pubsub

Class representing a Cloud Pub/Sub Topic.

PubsubIO.Read<T> - Class in org.apache.beam.sdk.io.gcp.pubsub

Implementation of PubsubIO.read().

PubsubIO.Write<T> - Class in org.apache.beam.sdk.io.gcp.pubsub

Implementation of PubsubIO.write().

PubsubIO.Write.PubsubBoundedWriter - Class in org.apache.beam.sdk.io.gcp.pubsub

Writer to Pubsub which batches messages from bounded collections.

PubsubJsonClient - Class in org.apache.beam.sdk.io.gcp.pubsub

A Pubsub client using JSON transport.

PubsubMessage - Class in org.apache.beam.sdk.io.gcp.pubsub

Class representing a Pub/Sub message.

PubsubMessage(byte[], Map<String, String>) - Constructor for class org.apache.beam.sdk.io.gcp.pubsub.PubsubMessage

PubsubMessagePayloadOnlyCoder - Class in org.apache.beam.sdk.io.gcp.pubsub

A coder for PubsubMessage treating the raw bytes being decoded as the message's payload.

PubsubMessagePayloadOnlyCoder() - Constructor for class org.apache.beam.sdk.io.gcp.pubsub.PubsubMessagePayloadOnlyCoder

PubsubMessageWithAttributesCoder - Class in org.apache.beam.sdk.io.gcp.pubsub

A coder for PubsubMessage including attributes.

PubsubMessageWithAttributesCoder() - Constructor for class org.apache.beam.sdk.io.gcp.pubsub.PubsubMessageWithAttributesCoder

PubsubOptions - Interface in org.apache.beam.sdk.io.gcp.pubsub

Properties that can be set when using Google Cloud Pub/Sub with the Apache Beam SDK.

PubsubUnboundedSink - Class in org.apache.beam.sdk.io.gcp.pubsub

A PTransform which streams messages to Pubsub.

PubsubUnboundedSink(PubsubClient.PubsubClientFactory, ValueProvider<PubsubClient.TopicPath>, String, String, int) - Constructor for class org.apache.beam.sdk.io.gcp.pubsub.PubsubUnboundedSink

PubsubUnboundedSink(PubsubClient.PubsubClientFactory, ValueProvider<PubsubClient.TopicPath>, String, String, int, int, int) - Constructor for class org.apache.beam.sdk.io.gcp.pubsub.PubsubUnboundedSink

PubsubUnboundedSource - Class in org.apache.beam.sdk.io.gcp.pubsub

Users should use PubsubIO.read() instead.

PubsubUnboundedSource(PubsubClient.PubsubClientFactory, ValueProvider<PubsubClient.ProjectPath>, ValueProvider<PubsubClient.TopicPath>, ValueProvider<PubsubClient.SubscriptionPath>, String, String, boolean) - Constructor for class org.apache.beam.sdk.io.gcp.pubsub.PubsubUnboundedSource

Construct an unbounded source to consume from the Pubsub subscription.

pull(long, PubsubClient.SubscriptionPath, int, boolean) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient

Request the next batch of up to batchSize messages from subscription.

pull(long, PubsubClient.SubscriptionPath, int, boolean) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubGrpcClient

pull(long, PubsubClient.SubscriptionPath, int, boolean) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubJsonClient

Q

queryUnflattened(String, String, boolean) - Method in class org.apache.beam.sdk.io.gcp.testing.BigqueryClient

queryWithRetries(String, String) - Method in class org.apache.beam.sdk.io.gcp.testing.BigqueryClient

queryWithRetries(String, String, boolean) - Method in class org.apache.beam.sdk.io.gcp.testing.BigqueryClient

R

read() - Static method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO

Deprecated.

Use BigQueryIO.read(SerializableFunction) or BigQueryIO.readTableRows() instead. BigQueryIO.readTableRows() does exactly the same as BigQueryIO.read(), however BigQueryIO.read(SerializableFunction) performs better.

read(SerializableFunction<SchemaAndRecord, T>) - Static method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO

Reads from a BigQuery table or query and returns a PCollection with one element per each row of the table or query result, parsed from the BigQuery AVRO format using the specified function.

read() - Static method in class org.apache.beam.sdk.io.gcp.bigtable.BigtableIO

Creates an uninitialized BigtableIO.Read.

Read() - Constructor for class org.apache.beam.sdk.io.gcp.bigtable.BigtableIO.Read

read() - Method in class org.apache.beam.sdk.io.gcp.datastore.DatastoreV1

Returns an empty DatastoreV1.Read builder.

Read() - Constructor for class org.apache.beam.sdk.io.gcp.datastore.DatastoreV1.Read

Read() - Constructor for class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO.Read

read() - Static method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO

Creates an uninitialized instance of SpannerIO.Read.

Read() - Constructor for class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.Read

readAll() - Static method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO

A PTransform that works like SpannerIO.read(), but executes read operations coming from a PCollection.

ReadAll() - Constructor for class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.ReadAll

readAvroGenericRecords(Schema) - Static method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO

Returns a PTransform that continuously reads binary encoded Avro messages into the Avro GenericRecord type.

readAvros(Class<T>) - Static method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO

Returns A PTransform that continuously reads binary encoded Avro messages of the given type from a Google Cloud Pub/Sub stream.

readAvrosWithBeamSchema(Class<T>) - Static method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO

Returns a PTransform that continuously reads binary encoded Avro messages of the specific type.

readMessages() - Static method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO

Returns A PTransform that continuously reads from a Google Cloud Pub/Sub stream.

readMessagesWithAttributes() - Static method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO

Returns A PTransform that continuously reads from a Google Cloud Pub/Sub stream.

ReadOperation - Class in org.apache.beam.sdk.io.gcp.spanner

Encapsulates a spanner read operation.

ReadOperation() - Constructor for class org.apache.beam.sdk.io.gcp.spanner.ReadOperation

readProtos(Class<T>) - Static method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO

Returns A PTransform that continuously reads binary encoded protobuf messages of the given type from a Google Cloud Pub/Sub stream.

readRows(Storage.ReadRowsRequest) - Method in interface org.apache.beam.sdk.io.gcp.bigquery.BigQueryServices.StorageClient

Read rows in the context of a specific read stream.

readStrings() - Static method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO

Returns A PTransform that continuously reads UTF-8 encoded strings from a Google Cloud Pub/Sub stream.

readTableRows() - Static method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO

Like BigQueryIO.read(SerializableFunction) but represents each row as a TableRow.

recordId - Variable in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient.OutgoingMessage

If using an id attribute, the record id to associate with this record's metadata so the receiver can reject duplicates.

ReifyAsIterable<T> - Class in org.apache.beam.sdk.io.gcp.bigquery

This transforms turns a side input into a singleton PCollection that can be used as the main input for another transform.

ReifyAsIterable() - Constructor for class org.apache.beam.sdk.io.gcp.bigquery.ReifyAsIterable

retryTransientErrors() - Static method in class org.apache.beam.sdk.io.gcp.bigquery.InsertRetryPolicy

Retry all failures except for known persistent errors.

S

SchemaAndRecord - Class in org.apache.beam.sdk.io.gcp.bigquery

A wrapper for a GenericRecord and the TableSchema representing the schema of the table (or query) it was generated from.

SchemaAndRecord(GenericRecord, TableSchema) - Constructor for class org.apache.beam.sdk.io.gcp.bigquery.SchemaAndRecord

setHTTPWriteTimeout(Integer) - Method in interface org.apache.beam.sdk.io.gcp.bigquery.BigQueryOptions

setInsertBundleParallelism(Integer) - Method in interface org.apache.beam.sdk.io.gcp.bigquery.BigQueryOptions

setPubsubRootUrl(String) - Method in interface org.apache.beam.sdk.io.gcp.pubsub.PubsubOptions

setSpannerConfig(SpannerConfig) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.CreateTransaction.Builder

setTargetDataset(String) - Method in interface org.apache.beam.sdk.io.gcp.bigquery.TestBigQueryOptions

setTempDatasetId(String) - Method in interface org.apache.beam.sdk.io.gcp.bigquery.BigQueryOptions

setTimestampBound(TimestampBound) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.CreateTransaction.Builder

shouldRetry(InsertRetryPolicy.Context) - Method in class org.apache.beam.sdk.io.gcp.bigquery.InsertRetryPolicy

Return true if this failure should be retried.

sideInput(PCollectionView<SideInputT>) - Method in class org.apache.beam.sdk.io.gcp.bigquery.DynamicDestinations

Returns the value of a given side input.

signalStart() - Method in class org.apache.beam.sdk.io.gcp.pubsub.TestPubsubSignal

Outputs a message that the pipeline has started.

signalSuccessWhen(Coder<T>, SerializableFunction<T, String>, SerializableFunction<Set<T>, Boolean>) - Method in class org.apache.beam.sdk.io.gcp.pubsub.TestPubsubSignal

Outputs a success message when successPredicate is evaluated to true.

signalSuccessWhen(Coder<T>, SerializableFunction<Set<T>, Boolean>) - Method in class org.apache.beam.sdk.io.gcp.pubsub.TestPubsubSignal

Invocation of TestPubsubSignal.signalSuccessWhen(Coder, SerializableFunction, SerializableFunction) with Object.toString() as the formatter.

skipInvalidRows() - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Write

Insert all valid rows of a request, even if invalid rows exist.

SpannerAccessor - Class in org.apache.beam.sdk.io.gcp.spanner

Manages lifecycle of DatabaseClient and Spanner instances.

SpannerConfig - Class in org.apache.beam.sdk.io.gcp.spanner

Configuration for a Cloud Spanner client.

SpannerConfig() - Constructor for class org.apache.beam.sdk.io.gcp.spanner.SpannerConfig

SpannerConfig.Builder - Class in org.apache.beam.sdk.io.gcp.spanner

Builder for SpannerConfig.

SpannerIO - Class in org.apache.beam.sdk.io.gcp.spanner

Experimental Transforms for reading from and writing to Google Cloud Spanner.

SpannerIO.CreateTransaction - Class in org.apache.beam.sdk.io.gcp.spanner

A PTransform that create a transaction.

SpannerIO.CreateTransaction.Builder - Class in org.apache.beam.sdk.io.gcp.spanner

A builder for SpannerIO.CreateTransaction.

SpannerIO.FailureMode - Enum in org.apache.beam.sdk.io.gcp.spanner

A failure handling strategy.

SpannerIO.Read - Class in org.apache.beam.sdk.io.gcp.spanner

Implementation of SpannerIO.read().

SpannerIO.ReadAll - Class in org.apache.beam.sdk.io.gcp.spanner

Implementation of SpannerIO.readAll().

SpannerIO.Write - Class in org.apache.beam.sdk.io.gcp.spanner

A PTransform that writes Mutation objects to Google Cloud Spanner.

SpannerIO.WriteGrouped - Class in org.apache.beam.sdk.io.gcp.spanner

Same as SpannerIO.Write but supports grouped mutations.

SpannerWriteResult - Class in org.apache.beam.sdk.io.gcp.spanner

The results of a SpannerIO.write() transform.

SpannerWriteResult(Pipeline, PCollection<Void>, PCollection<MutationGroup>, TupleTag<MutationGroup>) - Constructor for class org.apache.beam.sdk.io.gcp.spanner.SpannerWriteResult

split(long, PipelineOptions) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryStorageStreamSource

split(long, PipelineOptions) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryStorageTableSource

startBundle(DoFn<T, Void>.StartBundleContext) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO.Write.PubsubBoundedWriter

startCopyJob(JobReference, JobConfigurationTableCopy) - Method in interface org.apache.beam.sdk.io.gcp.bigquery.BigQueryServices.JobService

Start a BigQuery copy job.

startExtractJob(JobReference, JobConfigurationExtract) - Method in interface org.apache.beam.sdk.io.gcp.bigquery.BigQueryServices.JobService

Start a BigQuery extract job.

startImpl() - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryStorageStreamSource.BigQueryStorageStreamReader

startLoadJob(JobReference, JobConfigurationLoad) - Method in interface org.apache.beam.sdk.io.gcp.bigquery.BigQueryServices.JobService

Start a BigQuery load job.

startQueryJob(JobReference, JobConfigurationQuery) - Method in interface org.apache.beam.sdk.io.gcp.bigquery.BigQueryServices.JobService

Start a BigQuery query job.

StreamingInserts<DestinationT,ElementT> - Class in org.apache.beam.sdk.io.gcp.bigquery

PTransform that performs streaming BigQuery write.

StreamingInserts(BigQueryIO.Write.CreateDisposition, DynamicDestinations<?, DestinationT>, Coder<ElementT>, SerializableFunction<ElementT, TableRow>) - Constructor for class org.apache.beam.sdk.io.gcp.bigquery.StreamingInserts

Constructor.

StreamingWriteTables<ElementT> - Class in org.apache.beam.sdk.io.gcp.bigquery

This transform takes in key-value pairs of TableRow entries and the TableDestination it should be written to.

StreamingWriteTables() - Constructor for class org.apache.beam.sdk.io.gcp.bigquery.StreamingWriteTables

stripPartitionDecorator(String) - Static method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers

Strip off any partition decorator information from a tablespec.

subscriptionPathFromName(String, String) - Static method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient

subscriptionPathFromPath(String) - Static method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient

T

TABLE_ROW_ERROR_CONTAINER - Static variable in interface org.apache.beam.sdk.io.gcp.bigquery.ErrorContainer

TableDestination - Class in org.apache.beam.sdk.io.gcp.bigquery

Encapsulates a BigQuery table destination.

TableDestination(String, String) - Constructor for class org.apache.beam.sdk.io.gcp.bigquery.TableDestination

TableDestination(TableReference, String) - Constructor for class org.apache.beam.sdk.io.gcp.bigquery.TableDestination

TableDestination(TableReference, String, TimePartitioning) - Constructor for class org.apache.beam.sdk.io.gcp.bigquery.TableDestination

TableDestination(String, String, TimePartitioning) - Constructor for class org.apache.beam.sdk.io.gcp.bigquery.TableDestination

TableDestination(TableReference, String, String) - Constructor for class org.apache.beam.sdk.io.gcp.bigquery.TableDestination

TableDestination(String, String, String) - Constructor for class org.apache.beam.sdk.io.gcp.bigquery.TableDestination

TableDestinationCoder - Class in org.apache.beam.sdk.io.gcp.bigquery

A coder for TableDestination objects.

TableDestinationCoderV2 - Class in org.apache.beam.sdk.io.gcp.bigquery

A Coder for TableDestination that includes time partitioning information.

TableDestinationCoderV2() - Constructor for class org.apache.beam.sdk.io.gcp.bigquery.TableDestinationCoderV2

TableRowJsonCoder - Class in org.apache.beam.sdk.io.gcp.bigquery

A Coder that encodes BigQuery TableRow objects in their native JSON format.

tableSpec() - Method in class org.apache.beam.sdk.io.gcp.bigquery.TestBigQuery

TestBigQuery - Class in org.apache.beam.sdk.io.gcp.bigquery

Test rule which creates a new table with specified schema, with randomized name and exposes few APIs to work with it.

TestBigQuery.PollingAssertion - Interface in org.apache.beam.sdk.io.gcp.bigquery

Interface to implement a polling assertion.

TestBigQuery.RowsAssertion - Interface in org.apache.beam.sdk.io.gcp.bigquery

Interface for creating a polling eventual assertion.

TestBigQueryOptions - Interface in org.apache.beam.sdk.io.gcp.bigquery

TestPipelineOptions for TestBigQuery.

TestPubsub - Class in org.apache.beam.sdk.io.gcp.pubsub

Test rule which creates a new topic with randomized name and exposes the APIs to work with it.

TestPubsubOptions - Interface in org.apache.beam.sdk.io.gcp.pubsub

PipelineOptions for TestPubsub.

TestPubsubSignal - Class in org.apache.beam.sdk.io.gcp.pubsub

Test rule which observes elements of the PCollection and checks whether they match the success criteria.

timestampMsSinceEpoch - Variable in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient.OutgoingMessage

Timestamp for element (ms since epoch).

to(String) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Write

Writes to the given table, specified in the format described in BigQueryHelpers.parseTableSpec(java.lang.String).

to(TableReference) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Write

Writes to the given table, specified as a TableReference.

to(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Write

Same as BigQueryIO.Write.to(String), but with a ValueProvider.

to(SerializableFunction<ValueInSingleWindow<T>, TableDestination>) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Write

Writes to table specified by the specified table function.

to(DynamicDestinations<T, ?>) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Write

Writes to the table and schema specified by the DynamicDestinations object.

to(String) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO.Write

Publishes to the specified topic.

to(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO.Write

Like topic() but with a ValueProvider.

toBeamRow(Schema) - Static method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryUtils

Convert SchemaAndRecord to a Beam Row.

toBeamRow(GenericRecord, Schema) - Static method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryUtils

toBeamRow(Schema, TableSchema, TableRow) - Static method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryUtils

Tries to parse the JSON TableRow from BigQuery.

topicPath() - Method in class org.apache.beam.sdk.io.gcp.pubsub.TestPubsub

Topic path where events will be published to.

topicPathFromName(String, String) - Static method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient

topicPathFromPath(String) - Static method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient

toString() - Method in class org.apache.beam.sdk.io.gcp.bigquery.TableDestination

toString() - Method in class org.apache.beam.sdk.io.gcp.bigtable.BigtableIO.Read

toString() - Method in class org.apache.beam.sdk.io.gcp.bigtable.BigtableIO.Write

toString() - Method in class org.apache.beam.sdk.io.gcp.datastore.DatastoreV1.Read

toString() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient.OutgoingMessage

toString() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient.ProjectPath

toString() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient.SubscriptionPath

toString() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient.TopicPath

toString() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO.PubsubSubscription

toString() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO.PubsubTopic

toString() - Method in class org.apache.beam.sdk.io.gcp.spanner.MutationGroup

toTableRow() - Static method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryUtils

Convert a Beam Row to a BigQuery TableRow.

toTableRow(Row) - Static method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryUtils

Convert a BigQuery TableRow to a Beam Row.

toTableSchema(Schema) - Static method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryUtils

Convert a Beam Schema to a BigQuery TableSchema.

toTableSchema(PCollection<Row>) - Static method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryUtils

Convert a Beam PCollection to a BigQuery TableSchema.

toTableSpec(TableReference) - Static method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers

Returns a canonical string representation of the TableReference.

toTableSpec(TableReferenceProto.TableReference) - Static method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers

Returns a canonical string representation of a TableReferenceProto.TableReference.

Transaction - Class in org.apache.beam.sdk.io.gcp.spanner

A transaction object.

Transaction() - Constructor for class org.apache.beam.sdk.io.gcp.spanner.Transaction

transactionId() - Method in class org.apache.beam.sdk.io.gcp.spanner.Transaction

TypedRead() - Constructor for class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.TypedRead

U

usingStandardSql() - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Read

Enables BigQuery's Standard SQL dialect when reading from a query.

usingStandardSql() - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.TypedRead

See BigQueryIO.Read.usingStandardSql().

V

v1() - Static method in class org.apache.beam.sdk.io.gcp.datastore.DatastoreIO

Returns a DatastoreV1 that provides an API for accessing Cloud Datastore through v1 version of Datastore Client library.

validate(PipelineOptions) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.TypedRead

validate(PipelineOptions) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Write

validate(PipelineOptions) - Method in class org.apache.beam.sdk.io.gcp.bigtable.BigtableIO.Read

validate(PipelineOptions) - Method in class org.apache.beam.sdk.io.gcp.bigtable.BigtableIO.Write

validate() - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerConfig

valueOf(String) - Static method in enum org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.TypedRead.Method

Returns the enum constant of this type with the specified name.

valueOf(String) - Static method in enum org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.TypedRead.QueryPriority

Returns the enum constant of this type with the specified name.

valueOf(String) - Static method in enum org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Write.CreateDisposition

Returns the enum constant of this type with the specified name.

valueOf(String) - Static method in enum org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Write.Method

Returns the enum constant of this type with the specified name.

valueOf(String) - Static method in enum org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Write.WriteDisposition

Returns the enum constant of this type with the specified name.

valueOf(String) - Static method in enum org.apache.beam.sdk.io.gcp.spanner.SpannerIO.FailureMode

Returns the enum constant of this type with the specified name.

values() - Static method in enum org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.TypedRead.Method

Returns an array containing the constants of this enum type, in the order they are declared.

values() - Static method in enum org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.TypedRead.QueryPriority

Returns an array containing the constants of this enum type, in the order they are declared.

values() - Static method in enum org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Write.CreateDisposition

Returns an array containing the constants of this enum type, in the order they are declared.

values() - Static method in enum org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Write.Method

Returns an array containing the constants of this enum type, in the order they are declared.

values() - Static method in enum org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Write.WriteDisposition

Returns an array containing the constants of this enum type, in the order they are declared.

values() - Static method in enum org.apache.beam.sdk.io.gcp.spanner.SpannerIO.FailureMode

Returns an array containing the constants of this enum type, in the order they are declared.

verifyDeterministic() - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryInsertErrorCoder

verifyDeterministic() - Method in class org.apache.beam.sdk.io.gcp.bigquery.TableDestinationCoder

verifyDeterministic() - Method in class org.apache.beam.sdk.io.gcp.bigquery.TableDestinationCoderV2

verifyDeterministic() - Method in class org.apache.beam.sdk.io.gcp.bigquery.TableRowJsonCoder

W

waitForStart(Duration) - Method in class org.apache.beam.sdk.io.gcp.pubsub.TestPubsubSignal

Future that waits for a start signal for duration.

waitForSuccess(Duration) - Method in class org.apache.beam.sdk.io.gcp.pubsub.TestPubsubSignal

Wait for a success signal for duration.

withBatching(boolean) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.Read

If true the uses Cloud Spanner batch API.

withBatching(boolean) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.ReadAll

By default Batch API is used to read data from Cloud Spanner.

withBatchSizeBytes(long) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.Write

Specifies the batch size limit (max number of bytes mutated per batch).

withBigtableOptions(BigtableOptions) - Method in class org.apache.beam.sdk.io.gcp.bigtable.BigtableIO.Read

Deprecated.

will be replaced by bigtable options configurator.

withBigtableOptions(BigtableOptions.Builder) - Method in class org.apache.beam.sdk.io.gcp.bigtable.BigtableIO.Read

Deprecated.

will be replaced by bigtable options configurator.

withBigtableOptions(BigtableOptions) - Method in class org.apache.beam.sdk.io.gcp.bigtable.BigtableIO.Write

Deprecated.

will be replaced by bigtable options configurator.

withBigtableOptions(BigtableOptions.Builder) - Method in class org.apache.beam.sdk.io.gcp.bigtable.BigtableIO.Write

Deprecated.

will be replaced by bigtable options configurator.

withBigtableOptionsConfigurator(SerializableFunction<BigtableOptions.Builder, BigtableOptions.Builder>) - Method in class org.apache.beam.sdk.io.gcp.bigtable.BigtableIO.Read

Returns a new BigtableIO.Read that will read from the Cloud Bigtable instance with customized options provided by given configurator.

withBigtableOptionsConfigurator(SerializableFunction<BigtableOptions.Builder, BigtableOptions.Builder>) - Method in class org.apache.beam.sdk.io.gcp.bigtable.BigtableIO.Write

Returns a new BigtableIO.Write that will read from the Cloud Bigtable instance with customized options provided by given configurator.

withCoder(Coder<T>) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.TypedRead

Sets a Coder for the result of the parse function.

withColumns(String...) - Method in class org.apache.beam.sdk.io.gcp.spanner.ReadOperation

withColumns(List<String>) - Method in class org.apache.beam.sdk.io.gcp.spanner.ReadOperation

withColumns(String...) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.Read

withColumns(List<String>) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.Read

withCreateDisposition(BigQueryIO.Write.CreateDisposition) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Write

Specifies whether the table should be created if it does not exist.

withCustomGcsTempLocation(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Write

Provides a custom location on GCS for storing temporary files to be loaded via BigQuery batch load jobs.

withDatabaseId(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerConfig

withDatabaseId(String) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerConfig

withDatabaseId(String) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.CreateTransaction

Specifies the Cloud Spanner database.

withDatabaseId(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.CreateTransaction

Specifies the Cloud Spanner database.

withDatabaseId(String) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.Read

Specifies the Cloud Spanner database.

withDatabaseId(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.Read

Specifies the Cloud Spanner database.

withDatabaseId(String) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.ReadAll

Specifies the Cloud Spanner database.

withDatabaseId(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.ReadAll

Specifies the Cloud Spanner database.

withDatabaseId(String) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.Write

Specifies the Cloud Spanner database.

withDatabaseId(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.Write

Specifies the Cloud Spanner database.

withExtendedErrorInfo() - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Write

Enables extended error information by enabling WriteResult.getFailedInsertsWithErr()

withExtendedErrorInfo(boolean) - Method in class org.apache.beam.sdk.io.gcp.bigquery.StreamingInserts

Specify whether to use extended error info or not.

withFailedInsertRetryPolicy(InsertRetryPolicy) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Write

Specfies a policy for handling failed inserts.

withFailureMode(SpannerIO.FailureMode) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.Write

Specifies failure mode.

withFormatFunction(SerializableFunction<T, TableRow>) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Write

Formats the user's type into a TableRow to be written to BigQuery.

withGroupingFactor(int) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.Write

Specifies the multiple of max mutation (in terms of both bytes per batch and cells per batch) that is used to select a set of mutations to sort by key for batching.

withHost(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerConfig

withHost(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.CreateTransaction

Specifies the Cloud Spanner host.

withHost(String) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.CreateTransaction

withHost(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.Read

Specifies the Cloud Spanner host.

withHost(String) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.Read

withHost(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.ReadAll

Specifies the Cloud Spanner host.

withHost(String) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.ReadAll

withHost(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.Write

Specifies the Cloud Spanner host.

withHost(String) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.Write

Specifies the Cloud Spanner host.

withIdAttribute(String) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO.Read

When reading from Cloud Pub/Sub where unique record identifiers are provided as Pub/Sub message attributes, specifies the name of the attribute containing the unique identifier.

withIdAttribute(String) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO.Write

Writes to Pub/Sub, adding each record's unique identifier to the published messages in an attribute with the specified name.

withIndex(String) - Method in class org.apache.beam.sdk.io.gcp.spanner.ReadOperation

withIndex(String) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.Read

withInsertRetryPolicy(InsertRetryPolicy) - Method in class org.apache.beam.sdk.io.gcp.bigquery.StreamingInserts

Specify a retry policy for failed inserts.

withInstanceId(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.bigtable.BigtableIO.Read

Returns a new BigtableIO.Read that will read from the Cloud Bigtable instance indicated by given parameter, requires BigtableIO.Read.withProjectId(org.apache.beam.sdk.options.ValueProvider<java.lang.String>) to be called to determine the project.

withInstanceId(String) - Method in class org.apache.beam.sdk.io.gcp.bigtable.BigtableIO.Read

Returns a new BigtableIO.Read that will read from the Cloud Bigtable instance indicated by given parameter, requires BigtableIO.Read.withProjectId(org.apache.beam.sdk.options.ValueProvider<java.lang.String>) to be called to determine the project.

withInstanceId(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.bigtable.BigtableIO.Write

Returns a new BigtableIO.Write that will write into the Cloud Bigtable instance indicated by given parameter, requires BigtableIO.Write.withProjectId(org.apache.beam.sdk.options.ValueProvider<java.lang.String>) to be called to determine the project.

withInstanceId(String) - Method in class org.apache.beam.sdk.io.gcp.bigtable.BigtableIO.Write

Returns a new BigtableIO.Write that will write into the Cloud Bigtable instance indicated by given parameter, requires BigtableIO.Write.withProjectId(org.apache.beam.sdk.options.ValueProvider<java.lang.String>) to be called to determine the project.

withInstanceId(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerConfig

withInstanceId(String) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerConfig

withInstanceId(String) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.CreateTransaction

Specifies the Cloud Spanner instance.

withInstanceId(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.CreateTransaction

Specifies the Cloud Spanner instance.

withInstanceId(String) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.Read

Specifies the Cloud Spanner instance.

withInstanceId(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.Read

Specifies the Cloud Spanner instance.

withInstanceId(String) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.ReadAll

Specifies the Cloud Spanner instance.

withInstanceId(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.ReadAll

Specifies the Cloud Spanner instance.

withInstanceId(String) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.Write

Specifies the Cloud Spanner instance.

withInstanceId(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.Write

Specifies the Cloud Spanner instance.

withJsonSchema(String) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Write

Similar to BigQueryIO.Write.withSchema(TableSchema) but takes in a JSON-serialized TableSchema.

withJsonSchema(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Write

Same as BigQueryIO.Write.withJsonSchema(String) but using a deferred ValueProvider.

withJsonTimePartitioning(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Write

The same as BigQueryIO.Write.withTimePartitioning(com.google.api.services.bigquery.model.TimePartitioning), but takes a JSON-serialized object.

withKeyRange(ByteKeyRange) - Method in class org.apache.beam.sdk.io.gcp.bigtable.BigtableIO.Read

Returns a new BigtableIO.Read that will read only rows in the specified range.

withKeyRanges(List<ByteKeyRange>) - Method in class org.apache.beam.sdk.io.gcp.bigtable.BigtableIO.Read

Returns a new BigtableIO.Read that will read only rows in the specified ranges.

withKeySet(KeySet) - Method in class org.apache.beam.sdk.io.gcp.spanner.ReadOperation

withKeySet(KeySet) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.Read

withKmsKey(String) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.TypedRead

For query sources, use this Cloud KMS key to encrypt any temporary tables created.

withKmsKey(String) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Write

withLiteralGqlQuery(String) - Method in class org.apache.beam.sdk.io.gcp.datastore.DatastoreV1.Read

Returns a new DatastoreV1.Read that reads the results of the specified GQL query.

withLiteralGqlQuery(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.datastore.DatastoreV1.Read

Same as DatastoreV1.Read.withLiteralGqlQuery(String) but with a ValueProvider.

withLoadJobProjectId(String) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Write

Set the project the BigQuery load job will be initiated from.

withLoadJobProjectId(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Write

withLocalhost(String) - Method in class org.apache.beam.sdk.io.gcp.datastore.DatastoreV1.DeleteEntity

Returns a new DatastoreV1.DeleteEntity that deletes entities from the Cloud Datastore Emulator running locally on the specified host port.

withLocalhost(String) - Method in class org.apache.beam.sdk.io.gcp.datastore.DatastoreV1.DeleteKey

Returns a new DatastoreV1.DeleteKey that deletes entities from the Cloud Datastore Emulator running locally on the specified host port.

withLocalhost(String) - Method in class org.apache.beam.sdk.io.gcp.datastore.DatastoreV1.Read

Returns a new DatastoreV1.Read that reads from a Datastore Emulator running at the given localhost address.

withLocalhost(String) - Method in class org.apache.beam.sdk.io.gcp.datastore.DatastoreV1.Write

Returns a new DatastoreV1.Write that writes to the Cloud Datastore Emulator running locally on the specified host port.

withMaxBatchBytesSize(int) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO.Write

Writes to Pub/Sub are limited by 10mb in general.

withMaxBatchSize(int) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO.Write

Writes to Pub/Sub are batched to efficiently send data.

withMaxNumMutations(long) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.Write

Specifies the cell mutation limit (maximum number of mutated cells per batch).

withMethod(BigQueryIO.TypedRead.Method) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.TypedRead

See BigQueryIO.TypedRead.Method.

withMethod(BigQueryIO.Write.Method) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Write

Choose the method used to write data to BigQuery.

withNamespace(String) - Method in class org.apache.beam.sdk.io.gcp.datastore.DatastoreV1.Read

Returns a new DatastoreV1.Read that reads from the given namespace.

withNamespace(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.datastore.DatastoreV1.Read

Same as DatastoreV1.Read.withNamespace(String) but with a ValueProvider.

withNumFileShards(int) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Write

Control how many file shards are written when using BigQuery load jobs.

withNumQuerySplits(int) - Method in class org.apache.beam.sdk.io.gcp.datastore.DatastoreV1.Read

Returns a new DatastoreV1.Read that reads by splitting the given query into numQuerySplits.

withOptimizedWrites() - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Write

If true, enables new codepaths that are expected to use less resources while writing to BigQuery.

withoutResultFlattening() - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Read

Disable flattening of query results.

withoutResultFlattening() - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.TypedRead

See BigQueryIO.Read.withoutResultFlattening().

withoutValidation() - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Read

Disable validation that the table exists or the query succeeds prior to pipeline submission.

withoutValidation() - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.TypedRead

See BigQueryIO.Read.withoutValidation().

withoutValidation() - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Write

Disables BigQuery table validation.

withoutValidation() - Method in class org.apache.beam.sdk.io.gcp.bigtable.BigtableIO.Read

Disables validation that the table being read from exists.

withoutValidation() - Method in class org.apache.beam.sdk.io.gcp.bigtable.BigtableIO.Write

Disables validation that the table being written to exists.

withPartitionOptions(PartitionOptions) - Method in class org.apache.beam.sdk.io.gcp.spanner.ReadOperation

withPartitionOptions(PartitionOptions) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.Read

withProjectId(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.bigtable.BigtableIO.Read

Returns a new BigtableIO.Read that will read from the Cloud Bigtable project indicated by given parameter, requires BigtableIO.Read.withInstanceId(org.apache.beam.sdk.options.ValueProvider<java.lang.String>) to be called to determine the instance.

withProjectId(String) - Method in class org.apache.beam.sdk.io.gcp.bigtable.BigtableIO.Read

Returns a new BigtableIO.Read that will read from the Cloud Bigtable project indicated by given parameter, requires BigtableIO.Read.withInstanceId(org.apache.beam.sdk.options.ValueProvider<java.lang.String>) to be called to determine the instance.

withProjectId(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.bigtable.BigtableIO.Write

Returns a new BigtableIO.Write that will write into the Cloud Bigtable project indicated by given parameter, requires BigtableIO.Write.withInstanceId(org.apache.beam.sdk.options.ValueProvider<java.lang.String>) to be called to determine the instance.

withProjectId(String) - Method in class org.apache.beam.sdk.io.gcp.bigtable.BigtableIO.Write

Returns a new BigtableIO.Write that will write into the Cloud Bigtable project indicated by given parameter, requires BigtableIO.Write.withInstanceId(org.apache.beam.sdk.options.ValueProvider<java.lang.String>) to be called to determine the instance.

withProjectId(String) - Method in class org.apache.beam.sdk.io.gcp.datastore.DatastoreV1.DeleteEntity

Returns a new DatastoreV1.DeleteEntity that deletes entities from the Cloud Datastore for the specified project.

withProjectId(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.datastore.DatastoreV1.DeleteEntity

Same as DatastoreV1.DeleteEntity.withProjectId(String) but with a ValueProvider.

withProjectId(String) - Method in class org.apache.beam.sdk.io.gcp.datastore.DatastoreV1.DeleteKey

Returns a new DatastoreV1.DeleteKey that deletes entities from the Cloud Datastore for the specified project.

withProjectId(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.datastore.DatastoreV1.DeleteKey

Same as DatastoreV1.DeleteKey.withProjectId(String) but with a ValueProvider.

withProjectId(String) - Method in class org.apache.beam.sdk.io.gcp.datastore.DatastoreV1.Read

Returns a new DatastoreV1.Read that reads from the Cloud Datastore for the specified project.

withProjectId(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.datastore.DatastoreV1.Read

Same as DatastoreV1.Read.withProjectId(String) but with a ValueProvider.

withProjectId(String) - Method in class org.apache.beam.sdk.io.gcp.datastore.DatastoreV1.Write

Returns a new DatastoreV1.Write that writes to the Cloud Datastore for the specified project.

withProjectId(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.datastore.DatastoreV1.Write

Same as DatastoreV1.Write.withProjectId(String) but with a ValueProvider.

withProjectId(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerConfig

withProjectId(String) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerConfig

withProjectId(String) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.CreateTransaction

Specifies the Cloud Spanner project.

withProjectId(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.CreateTransaction

Specifies the Cloud Spanner project.

withProjectId(String) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.Read

Specifies the Cloud Spanner project.

withProjectId(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.Read

Specifies the Cloud Spanner project.

withProjectId(String) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.ReadAll

Specifies the Cloud Spanner project.

withProjectId(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.ReadAll

Specifies the Cloud Spanner project.

withProjectId(String) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.Write

Specifies the Cloud Spanner project.

withProjectId(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.Write

Specifies the Cloud Spanner project.

withQuery(Query) - Method in class org.apache.beam.sdk.io.gcp.datastore.DatastoreV1.Read

Returns a new DatastoreV1.Read that reads the results of the specified query.

withQuery(Statement) - Method in class org.apache.beam.sdk.io.gcp.spanner.ReadOperation

withQuery(String) - Method in class org.apache.beam.sdk.io.gcp.spanner.ReadOperation

withQuery(Statement) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.Read

withQuery(String) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.Read

withQueryLocation(String) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.TypedRead

BigQuery geographic location where the query job will be executed.

withQueryPriority(BigQueryIO.TypedRead.QueryPriority) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.TypedRead

See BigQueryIO.TypedRead.QueryPriority.

withReadOperation(ReadOperation) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.Read

withReadOptions(ReadOptions.TableReadOptions) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.TypedRead

Read options, including a list of selected columns and push-down SQL filter text.

withRowFilter(RowFilter) - Method in class org.apache.beam.sdk.io.gcp.bigtable.BigtableIO.Read

Returns a new BigtableIO.Read that will filter the rows read from Cloud Bigtable using the given row filter.

withSchema(TableSchema) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Write

Uses the specified schema for rows to be written.

withSchema(ValueProvider<TableSchema>) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Write

Same as BigQueryIO.Write.withSchema(TableSchema) but using a deferred ValueProvider.

withSchemaFromView(PCollectionView<Map<String, String>>) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Write

Allows the schemas for each table to be computed within the pipeline itself.

withSchemaReadySignal(PCollection) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.Write

Specifies an optional input PCollection that can be used as the signal for Wait.OnSignal to indicate when the database schema is ready to be read.

withSpannerConfig(SpannerConfig) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.CreateTransaction

Specifies the Cloud Spanner configuration.

withSpannerConfig(SpannerConfig) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.Read

Specifies the Cloud Spanner configuration.

withSpannerConfig(SpannerConfig) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.ReadAll

Specifies the Cloud Spanner configuration.

withSpannerConfig(SpannerConfig) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.Write

Specifies the Cloud Spanner configuration.

withTable(String) - Method in class org.apache.beam.sdk.io.gcp.spanner.ReadOperation

withTable(String) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.Read

withTableDescription(String) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Write

Specifies the table description.

withTableId(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.bigtable.BigtableIO.Read

Returns a new BigtableIO.Read that will read from the specified table.

withTableId(String) - Method in class org.apache.beam.sdk.io.gcp.bigtable.BigtableIO.Read

Returns a new BigtableIO.Read that will read from the specified table.

withTableId(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.gcp.bigtable.BigtableIO.Write

Returns a new BigtableIO.Write that will write to the specified table.

withTableId(String) - Method in class org.apache.beam.sdk.io.gcp.bigtable.BigtableIO.Write

Returns a new BigtableIO.Write that will write to the specified table.

withTableReference(TableReference) - Method in class org.apache.beam.sdk.io.gcp.bigquery.TableDestination

withTemplateCompatibility() - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Read

Use new template-compatible source implementation.

withTemplateCompatibility() - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.TypedRead

withTestServices(BigQueryServices) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Write

withTimePartitioning(TimePartitioning) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Write

Allows newly created tables to include a TimePartitioning class.

withTimePartitioning(ValueProvider<TimePartitioning>) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Write

Like BigQueryIO.Write.withTimePartitioning(TimePartitioning) but using a deferred ValueProvider.

withTimestamp(Timestamp) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.Read

withTimestamp(Timestamp) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.ReadAll

withTimestampAttribute(String) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO.Read

When reading from Cloud Pub/Sub where record timestamps are provided as Pub/Sub message attributes, specifies the name of the attribute that contains the timestamp.

withTimestampAttribute(String) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO.Write

Writes to Pub/Sub and adds each record's timestamp to the published messages in an attribute with the specified name.

withTimestampBound(TimestampBound) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.CreateTransaction

withTimestampBound(TimestampBound) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.Read

withTimestampBound(TimestampBound) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.ReadAll

withTransaction(PCollectionView<Transaction>) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.Read

withTransaction(PCollectionView<Transaction>) - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.ReadAll

withTriggeringFrequency(Duration) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Write

Choose the frequency at which file writes are triggered.

withWriteDisposition(BigQueryIO.Write.WriteDisposition) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Write

Specifies what to do with existing data in the table, in case the table already exists.

write() - Static method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO

A PTransform that writes a PCollection to a BigQuery table.

Write() - Constructor for class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Write

write() - Static method in class org.apache.beam.sdk.io.gcp.bigtable.BigtableIO

Creates an uninitialized BigtableIO.Write.

Write() - Constructor for class org.apache.beam.sdk.io.gcp.bigtable.BigtableIO.Write

write() - Method in class org.apache.beam.sdk.io.gcp.datastore.DatastoreV1

Returns an empty DatastoreV1.Write builder.

Write() - Constructor for class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO.Write

write() - Static method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO

Creates an uninitialized instance of SpannerIO.Write.

Write() - Constructor for class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.Write

writeAvros(Class<T>) - Static method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO

Returns A PTransform that writes binary encoded Avro messages of a given type to a Google Cloud Pub/Sub stream.

WriteGrouped(SpannerIO.Write) - Constructor for class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.WriteGrouped

writeMessages() - Static method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO

Returns A PTransform that writes to a Google Cloud Pub/Sub stream.

writeProtos(Class<T>) - Static method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO

Returns A PTransform that writes binary encoded protobuf messages of a given type to a Google Cloud Pub/Sub stream.

WriteResult - Class in org.apache.beam.sdk.io.gcp.bigquery

The result of a BigQueryIO.Write transform.

writeStrings() - Static method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO

Returns A PTransform that writes UTF-8 encoded strings to a Google Cloud Pub/Sub stream.

writeTableRows() - Static method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO

A PTransform that writes a PCollection containing TableRows to a BigQuery table.

A B C D E F G H I L M N O P Q R S T U V W