public interface ActionContext extends StageContext, Transactional, SecureStore, SecureStoreManager, LineageRecorder
Modifier and Type | Method and Description |
---|---|
SettableArguments |
getArguments()
Returns settable pipeline arguments.
|
default void |
record(List<FieldOperation> fieldOperations)
Deprecated.
use
LineageRecorder.record(Collection) to emit field operations for actions, that method requires the input
field to contain the previous originated operation name. Using that DAG can be computed so the field
linage can be computed. |
default void |
registerLineage(String referenceName,
AccessType accessType)
Register lineage for this Spark program using the given reference name
|
getFailureCollector, getInputSchema, getInputSchemas, getInputStages, getLogicalStartTime, getMetrics, getNamespace, getOutputPortSchemas, getOutputSchema, getPipelineName, getPluginProperties, getPluginProperties, getStageName, loadPluginClass, newPluginInstance
getServiceURL, getServiceURL, getServiceURL, openConnection
getMetadata, getMetadata
addProperties, addTags, addTags, removeMetadata, removeProperties, removeProperties, removeTags, removeTags
execute, execute
get, list
delete, put
flushLineage, record
SettableArguments getArguments()
getArguments
in interface StageContext
@Deprecated default void record(List<FieldOperation> fieldOperations)
LineageRecorder.record(Collection)
to emit field operations for actions, that method requires the input
field to contain the previous originated operation name. Using that DAG can be computed so the field
linage can be computed.fieldOperations
- the operations to be recordeddefault void registerLineage(String referenceName, AccessType accessType) throws DatasetManagementException, org.apache.tephra.TransactionFailureException
referenceName
- reference name used for sourceaccessType
- the access type of the lineageDatasetManagementException
- thrown if there was an error in creating reference datasetorg.apache.tephra.TransactionFailureException
- thrown if there was an error while fetching the dataset to register usageCopyright © 2021 Cask Data, Inc. Licensed under the Apache License, Version 2.0.