public interface WorkflowConfigurer extends ProgramConfigurer, PluginConfigurer, DatasetConfigurer
Workflow
.Modifier and Type | Method and Description |
---|---|
void |
addAction(CustomAction action)
Adds a custom action as a next sequential step in the
Workflow |
void |
addMapReduce(String mapReduce)
Adds a MapReduce program as a next sequential step in the
Workflow . |
void |
addSpark(String spark)
Adds a Spark program as a next sequential step in the
Workflow . |
WorkflowConditionConfigurer<? extends WorkflowConfigurer> |
condition(Condition condition)
Adds a condition to the
Workflow . |
WorkflowConditionConfigurer<? extends WorkflowConfigurer> |
condition(Predicate<WorkflowContext> condition)
Adds a condition to the
Workflow . |
void |
createLocalDataset(String datasetName,
Class<? extends Dataset> datasetClass,
DatasetProperties props)
Adds a local dataset instance to the
Workflow . |
void |
createLocalDataset(String datasetName,
String typeName,
DatasetProperties properties)
Adds a local dataset instance to the
Workflow . |
WorkflowForkConfigurer<? extends WorkflowConfigurer> |
fork()
Forks the execution of the
Workflow into multiple branches |
setDescription, setName, setProperties
isFeatureEnabled
evaluateMacros, evaluateMacros, usePlugin, usePlugin, usePluginClass, usePluginClass
addDatasetModule, addDatasetType, createDataset, createDataset, createDataset, createDataset
void addMapReduce(String mapReduce)
Workflow
. MapReduce program
must be configured when the Application is defined. Application deployment will fail if the
MapReduce program does not exist.mapReduce
- name of the MapReduce program to be added to the Workflow
void addSpark(String spark)
Workflow
. Spark program must be
configured when the Application is defined. Application deployment will fail if the Spark
program does not exist.spark
- name of the Spark program to be added to the Workflow
void addAction(CustomAction action)
Workflow
action
- to be added to the Workflow
WorkflowForkConfigurer<? extends WorkflowConfigurer> fork()
Workflow
into multiple branchesWorkflow
WorkflowConditionConfigurer<? extends WorkflowConfigurer> condition(Predicate<WorkflowContext> condition)
Workflow
.condition
- the Predicate
to be evaluated for the conditionWorkflowConditionConfigurer<? extends WorkflowConfigurer> condition(Condition condition)
Workflow
.condition
- the Condition
to be evaluated@Beta void createLocalDataset(String datasetName, String typeName, DatasetProperties properties)
Workflow
.
Local datasets are created at the start of every Workflow
run and deleted once the run
is complete. User can decide to keep the local datasets even after the run is complete by
specifying the runtime arguments - dataset.dataset_name.keep.local=true
.
datasetName
- name of the dataset instancetypeName
- name of the dataset typeproperties
- dataset instance properties@Beta void createLocalDataset(String datasetName, Class<? extends Dataset> datasetClass, DatasetProperties props)
Workflow
. Also deploys the dataset type
represented by the datasetClass parameter in the current namespace.
Local datasets are created at the start of every Workflow
run and deleted once the run
is complete. User can decide to keep the local datasets even after the run is complete by
specifying the runtime arguments - dataset.dataset_name.keep.local=true
.
datasetName
- dataset instance namedatasetClass
- dataset class to create the Dataset type fromprops
- dataset instance propertiesCopyright © 2024 Cask Data, Inc. Licensed under the Apache License, Version 2.0.