com.google.cloud.dataflow.sdk.util

Class CloudSourceUtils

java.lang.Object

com.google.cloud.dataflow.sdk.util.CloudSourceUtils

public class CloudSourceUtils
extends Object

Utilities for working with Source Dataflow API definitions and Reader objects.

Constructor Summary

Constructors

Constructor and Description
CloudSourceUtils()

Method Summary

Modifier and Type	Method and Description
static com.google.api.services.dataflow.model.Source	flattenBaseSpecs(com.google.api.services.dataflow.model.Source source) Returns a copy of the source with baseSpecs flattened into spec.
static <T> List<T>	readElemsFromSource(PipelineOptions options, com.google.api.services.dataflow.model.Source source) Creates a Reader from the given Dataflow Source API definition and reads all elements from it.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CloudSourceUtils

public CloudSourceUtils()

Method Detail

flattenBaseSpecs

public static com.google.api.services.dataflow.model.Source flattenBaseSpecs(com.google.api.services.dataflow.model.Source source)

Returns a copy of the source with baseSpecs flattened into spec. On conflict for a parameter name, values in spec override values in baseSpecs, and later values in baseSpecs override earlier ones.

readElemsFromSource

public static <T> List<T> readElemsFromSource(PipelineOptions options,
                                              com.google.api.services.dataflow.model.Source source)

Creates a Reader from the given Dataflow Source API definition and reads all elements from it.