io.cdap.cdap.etl.api

Interface MultiOutputPipelineConfigurer

All Superinterfaces:

DatasetConfigurer, PluginConfigurer

@Beta
public interface MultiOutputPipelineConfigurer
extends PluginConfigurer, DatasetConfigurer

Configures a Pipeline. Allows adding datasets and streams, which will be created when a pipeline is created. Using this as a layer between plugins and CDAP's PluginConfigurer in case pipelines need etl specific methods. Similar to PipelineConfigurer except it exposes MultiOutputStageConfigurer

Method Summary

Modifier and Type	Method and Description
Engine	getEngine()
MultiOutputStageConfigurer	getMultiOutputStageConfigurer() Get multi output stage configurer for the pipeline stage
void	setPipelineProperties(Map<String,String> properties) Set pipeline properties that will be applied to each run of the pipeline.

Methods inherited from interface io.cdap.cdap.api.plugin.PluginConfigurer

usePlugin, usePlugin, usePluginClass, usePluginClass

Methods inherited from interface io.cdap.cdap.api.DatasetConfigurer

addDatasetModule, addDatasetType, createDataset, createDataset, createDataset, createDataset

Method Detail

getMultiOutputStageConfigurer

MultiOutputStageConfigurer getMultiOutputStageConfigurer()

Get multi output stage configurer for the pipeline stage

Returns:

multi output stage configurer

getEngine

Engine getEngine()

Returns:

the engine for this pipeline

setPipelineProperties

void setPipelineProperties(Map<String,String> properties)

Set pipeline properties that will be applied to each run of the pipeline. Depending on the engine used, the properties will be added to the SparkConf for each run or the mapreduce Configuration for each run.

Parameters:

properties - the properties to set