Interface | Description |
---|---|
WorkflowProgramAdder |
Adds workflow programs.
|
Class | Description |
---|---|
ConditionToConditionAdder<T extends WorkflowConditionConfigurer> |
Implementation of
WorkflowProgramAdder which adds node to the branch of the Condition whose parent is
another Condition. |
ConditionToForkAdder<T extends WorkflowConditionConfigurer> |
Implementation of
WorkflowProgramAdder which adds node to the branch of the Condition whose parent is Fork
in the Workflow. |
ConditionToTrunkAdder<T extends WorkflowConditionConfigurer> |
Implementation of the
WorkflowProgramAdder which adds nodes to the Condition whose parent is Workflow trunk. |
DataPipelineApp |
ETL Data Pipeline Application.
|
ExternalSparkProgram |
A Spark program that instantiates a sparkprogram plugin and executes it.
|
ForkToConditionAdder<T extends WorkflowForkConfigurer> |
Implementation of the
WorkflowProgramAdder which adds nodes on the Fork whose parent is Condition. |
ForkToForkAdder<T extends WorkflowForkConfigurer> |
Implementation of the
WorkflowProgramAdder which adds nodes on the Fork whose parent is another Fork in the
Workflow. |
ForkToTrunkAdder<T extends WorkflowForkConfigurer> |
Implementation of the
WorkflowProgramAdder which adds nodes on the Fork whose parent Workflow trunk. |
InvalidFieldOperations |
For a single stage, this class stores the invalid fields along with the
name of operations which are either using these fields as input or creating
these fields as output.
|
JavaSparkMainWrapper |
This class is a wrapper for the vanilla spark programs.
|
LineageOperationsProcessor |
Class responsible for processing the field lineage operations recorded by plugins and
converting it into the form the platform expects.
|
SmartWorkflow |
Data Pipeline Smart Workflow.
|
StageOperationsValidator |
Validate the input and output fields of operations.
|
StageOperationsValidator.Builder |
Builder for
StageOperationsValidator . |
TrunkProgramAdder |
Implementation of
WorkflowProgramAdder which adds node to the Workflow trunk. |
Exception | Description |
---|---|
InvalidLineageException |
Runtime exception thrown when the field operations to be recorded by the pipeline
contains invalid fields.
|
Copyright © 2018 Cask Data, Inc. Licensed under the Apache License, Version 2.0.