com.google.cloud.dataflow.sdk.options

Interface DataflowPipelineDebugOptions

All Superinterfaces:

PipelineOptions

All Known Subinterfaces:

BlockingDataflowPipelineOptions, DataflowPipelineOptions, DataflowWorkerHarnessOptions, TestDataflowPipelineOptions

public interface DataflowPipelineDebugOptions
extends PipelineOptions

Options used for testing and debugging the Dataflow SDK.

Nested Class Summary

Nested Classes

Modifier and Type	Interface and Description
static class	DataflowPipelineDebugOptions.PathValidatorFactory Creates a PathValidator object using the class specified in getPathValidatorClass().
static class	DataflowPipelineDebugOptions.StagerFactory Creates a Stager object using the class specified in getStagerClass().

Method Summary

Methods

Modifier and Type	Method and Description
java.lang.String	getApiRootUrl() The API endpoint to use when communicating with the Dataflow service.
java.lang.String	getDataflowEndpoint() Dataflow endpoint to use.
java.lang.String	getDataflowJobFile() The path to write the translated Dataflow specification out to at job submission time.
java.util.List<java.lang.String>	getExperiments() The list of backend experiments to enable.
com.google.cloud.dataflow.sdk.util.PathValidator	getPathValidator() The validator class used to validate path names.
java.lang.Class<? extends com.google.cloud.dataflow.sdk.util.PathValidator>	getPathValidatorClass() The name of the validator class used to validate path names.
com.google.cloud.dataflow.sdk.util.Stager	getStager() The stager instance used to stage files.
java.lang.Class<? extends com.google.cloud.dataflow.sdk.util.Stager>	getStagerClass() The class used to stage files.
void	setApiRootUrl(java.lang.String value)
void	setDataflowEndpoint(java.lang.String value)
void	setDataflowJobFile(java.lang.String value)
void	setExperiments(java.util.List<java.lang.String> value)
void	setPathValidator(com.google.cloud.dataflow.sdk.util.PathValidator validator)
void	setPathValidatorClass(java.lang.Class<? extends com.google.cloud.dataflow.sdk.util.PathValidator> validatorClass)
void	setStager(com.google.cloud.dataflow.sdk.util.Stager stager)
void	setStagerClass(java.lang.Class<? extends com.google.cloud.dataflow.sdk.util.Stager> stagerClass)

Methods inherited from interface com.google.cloud.dataflow.sdk.options.PipelineOptions

as, getRunner, setRunner

Method Detail

getDataflowEndpoint

java.lang.String getDataflowEndpoint()

Dataflow endpoint to use.

Defaults to the current version of the Google Cloud Dataflow API, at the time the current SDK version was released.

If the string contains "://", then this is treated as a url, otherwise getApiRootUrl() is used as the root url.

setDataflowEndpoint

void setDataflowEndpoint(java.lang.String value)

getExperiments

java.util.List<java.lang.String> getExperiments()

The list of backend experiments to enable.

Dataflow provides a number of experimental features that can be enabled with this flag.

Please sync with the Dataflow team when enabling any experiments.

setExperiments

void setExperiments(java.util.List<java.lang.String> value)

getApiRootUrl

java.lang.String getApiRootUrl()

The API endpoint to use when communicating with the Dataflow service.

setApiRootUrl

void setApiRootUrl(java.lang.String value)

getDataflowJobFile

java.lang.String getDataflowJobFile()

The path to write the translated Dataflow specification out to at job submission time.

setDataflowJobFile

void setDataflowJobFile(java.lang.String value)

getPathValidatorClass

java.lang.Class<? extends com.google.cloud.dataflow.sdk.util.PathValidator> getPathValidatorClass()

The name of the validator class used to validate path names.

setPathValidatorClass

void setPathValidatorClass(java.lang.Class<? extends com.google.cloud.dataflow.sdk.util.PathValidator> validatorClass)

getPathValidator

com.google.cloud.dataflow.sdk.util.PathValidator getPathValidator()

The validator class used to validate path names.

setPathValidator

void setPathValidator(com.google.cloud.dataflow.sdk.util.PathValidator validator)

getStagerClass

java.lang.Class<? extends com.google.cloud.dataflow.sdk.util.Stager> getStagerClass()

The class used to stage files.

setStagerClass

void setStagerClass(java.lang.Class<? extends com.google.cloud.dataflow.sdk.util.Stager> stagerClass)

getStager

com.google.cloud.dataflow.sdk.util.Stager getStager()

The stager instance used to stage files.

setStager

void setStager(com.google.cloud.dataflow.sdk.util.Stager stager)