SparkDataFlowAction

Abstract Value Members

abstract val inputLabels: List[String]

The unique identifiers for the inputs to this action
The unique identifiers for the inputs to this action

Definition Classes
DataFlowAction
abstract val outputLabels: List[String]

The unique identifiers for the outputs to this action
The unique identifiers for the outputs to this action

Definition Classes
DataFlowAction
abstract def performAction(inputs: DataFlowEntities, flowContext: SparkFlowContext): Try[ActionResult]

Perform the action
Perform the action
inputs
the DataFlowEntities corresponding to the inputLabels
flowContext
context of the flow in which this action runs
returns
the action outputs (these must be declared in the same order as their labels in outputLabels)

Definition Classes
DataFlowAction

Concrete Value Members

final def !=(arg0: Any): Boolean

Definition Classes
AnyRef → Any
final def ##(): Int

Definition Classes
AnyRef → Any
final def ==(arg0: Any): Boolean

Definition Classes
AnyRef → Any
def actionName: String

For representing the action
For representing the action

Definition Classes
DataFlowAction
final def asInstanceOf[T0]: T0

Definition Classes
Any
def clone(): AnyRef

Attributes
protected[java.lang]
Definition Classes
AnyRef
Annotations
@throws( ... )
def description: String

Definition Classes
DataFlowAction
final def eq(arg0: AnyRef): Boolean

Definition Classes
AnyRef
def equals(arg0: Any): Boolean

Definition Classes
AnyRef → Any
def finalize(): Unit

Attributes
protected[java.lang]
Definition Classes
AnyRef
Annotations
@throws( classOf[java.lang.Throwable] )
def flowState(inputs: DataFlowEntities): DataFlowActionState

Action has the responsibility of assessing itself and produce DataFlowActionState, that will be used by the executors to determine if they can call performAction or not.
Action has the responsibility of assessing itself and produce DataFlowActionState, that will be used by the executors to determine if they can call performAction or not. Also can be used for progress monitoring. This will allow for more custom actions without modifying the executors
inputs
- action will study the state of the inputs in order to generate self assessment
returns
- an instance of the DataFlowActionState

Definition Classes
DataFlowAction
final def getClass(): Class[_]

Definition Classes
AnyRef → Any
val guid: String

Definition Classes
DataFlowAction
def hashCode(): Int

Definition Classes
AnyRef → Any
final def isInstanceOf[T0]: Boolean

Definition Classes
Any
def logLabel: String

Definition Classes
DataFlowAction
final def ne(arg0: AnyRef): Boolean

Definition Classes
AnyRef
final def notify(): Unit

Definition Classes
AnyRef
final def notifyAll(): Unit

Definition Classes
AnyRef
def requiresAllInputs: Boolean

This action can only be executed if all of the inputs are not empty.
This action can only be executed if all of the inputs are not empty. An input can be explicitly marked as empty. If false, than one or more inputs can be empty to start execution.

Definition Classes
DataFlowAction
final def synchronized[T0](arg0: ⇒ T0): T0

Definition Classes
AnyRef
def toString(): String

Definition Classes
AnyRef → Any
final def wait(): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )
final def wait(arg0: Long, arg1: Int): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )
final def wait(arg0: Long): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )

Related Doc: package spark

trait SparkDataFlowAction extends DataFlowAction[SparkFlowContext]

Abstract Value Members

abstract val inputLabels: List[String]

abstract val outputLabels: List[String]

abstract def performAction(inputs: DataFlowEntities, flowContext: SparkFlowContext): Try[ActionResult]

Concrete Value Members

final def !=(arg0: Any): Boolean

final def ##(): Int

final def ==(arg0: Any): Boolean

def actionName: String

final def asInstanceOf[T0]: T0

def clone(): AnyRef

def description: String

final def eq(arg0: AnyRef): Boolean

def equals(arg0: Any): Boolean

def finalize(): Unit

def flowState(inputs: DataFlowEntities): DataFlowActionState

final def getClass(): Class[_]

val guid: String

def hashCode(): Int

final def isInstanceOf[T0]: Boolean

def logLabel: String

final def ne(arg0: AnyRef): Boolean

final def notify(): Unit

final def notifyAll(): Unit

def requiresAllInputs: Boolean

final def synchronized[T0](arg0: ⇒ T0): T0

def toString(): String

final def wait(): Unit

final def wait(arg0: Long, arg1: Int): Unit

final def wait(arg0: Long): Unit

Inherited from DataFlowAction[SparkFlowContext]

Inherited from AnyRef

Inherited from Any

Ungrouped