TaskTracker

Abstract Value Members

abstract def logPathFor(task: Task, id: TaskId, attemptIndex: Int): Path

Generates a path to file to store the log output of the task
Generates a path to file to store the log output of the task

Attributes
protected
abstract def runToCompletion(failFast: Boolean): BiMap[Task, TaskExecutionInfo]

Run all tasks managed to either completion, failure, or inability to schedule.
Run all tasks managed to either completion, failure, or inability to schedule.
This will terminate tasks that were still running before returning in the case of failure or inability to schedule.
returns
a bi-directional map from the set of tasks to their execution information.

Definition Classes
TaskManagerLike
abstract def scriptPathFor(task: Task, id: TaskId, attemptIndex: Int): Path

Generates a path to a file to hold the task command
Generates a path to a file to hold the task command

Attributes
protected
abstract def stepExecution(): (Traversable[Task], Traversable[Task], Traversable[Task], Traversable[Task])

Run a a single iteration of managing tasks.
Run a a single iteration of managing tasks.
1. Get tasks that have completed and update their state. 2. Update any resolved dependencies in the execution graph. 3. Get tasks for any task that has no predecessors until no more can be found. 4. Schedule tasks and start running them.
returns
a tuple of: (1) tasks that can be scheduled. (2) tasks that were scheduled. (3) tasks that are running prior to scheduling. (4) the tasks that have completed prior to scheduling.

Definition Classes
TaskManagerLike

Concrete Value Members

final def !=(arg0: Any): Boolean

Definition Classes
AnyRef → Any
final def ##(): Int

Definition Classes
AnyRef → Any
def +(other: String): String

Implicit information
This member is added by an implicit conversion from TaskTracker to any2stringadd[TaskTracker] performed by method any2stringadd in scala.Predef.
Definition Classes
any2stringadd
def ->[B](y: B): (TaskTracker, B)

Implicit information
This member is added by an implicit conversion from TaskTracker to ArrowAssoc[TaskTracker] performed by method ArrowAssoc in scala.Predef.
Definition Classes
ArrowAssoc
Annotations
@inline()
final def ==(arg0: Any): Boolean

Definition Classes
AnyRef → Any
def addTask(task: Task, enclosingNode: Option[GraphNode], ignoreExists: Boolean = false): TaskId

Adds a task to be managed
Adds a task to be managed
Throws an IllegalArgumentException if a cycle was found after logging each strongly connected component with a cycle in the graph.
task
the given task.
ignoreExists
true if we just return the task id for already added tasks, false if we are to throw an IllegalArgumentException
returns
the task identifier.

Attributes
protected[dagr.core.execsystem]
def addTask(task: Task): TaskId

Adds a task to be managed
Adds a task to be managed
task
the given task.
returns
the task identifier.

Definition Classes
TaskTracker → TaskManagerLike
def addTasks(tasks: Task*): Seq[TaskId]

Adds tasks to be managed
Adds tasks to be managed
tasks
the given tasks.
returns
the task identifiers.

Definition Classes
TaskTracker → TaskManagerLike
def addTasks(tasks: Traversable[Task], enclosingNode: Option[GraphNode] = None, ignoreExists: Boolean = false): List[TaskId]

Adds tasks to be managed
Adds tasks to be managed
tasks
the given tasks.
ignoreExists
true if we just return the task id for already added tasks, false if we are to throw an IllegalArgumentException
returns
the task identifiers.

Attributes
protected[dagr.core.execsystem]
def allPredecessorsAdded(task: Task): Boolean

Returns true if all the predecessors of this task are known (have been added), false otherwise.
Returns true if all the predecessors of this task are known (have been added), false otherwise.

Attributes
protected
def apply(id: TaskId): GraphNode

Gets the graph execution node for the given id.
Gets the graph execution node for the given id. If there is no task being tracked with that id, throws a NoSuchElementException.
id
the id to lookup.
returns
the associated task.

Definition Classes
TaskTracker → TaskManagerLike
final def asInstanceOf[T0]: T0

Definition Classes
Any
def checkForCycles(task: Task): Unit

Checks for cycles in the graph to which the task belongs.
Checks for cycles in the graph to which the task belongs.
Throws an IllegalArgumentException if a cycle was found after logging each strongly connected component with a cycle in the graph.
task
a task in the graph to check.

Attributes
protected
def clone(): AnyRef

Attributes
protected[java.lang]
Definition Classes
AnyRef
Annotations
@throws( ... )
def ensuring(cond: (TaskTracker) ⇒ Boolean, msg: ⇒ Any): TaskTracker

Implicit information
This member is added by an implicit conversion from TaskTracker to Ensuring[TaskTracker] performed by method Ensuring in scala.Predef.
Definition Classes
Ensuring
def ensuring(cond: (TaskTracker) ⇒ Boolean): TaskTracker

Implicit information
This member is added by an implicit conversion from TaskTracker to Ensuring[TaskTracker] performed by method Ensuring in scala.Predef.
Definition Classes
Ensuring
def ensuring(cond: Boolean, msg: ⇒ Any): TaskTracker

Implicit information
This member is added by an implicit conversion from TaskTracker to Ensuring[TaskTracker] performed by method Ensuring in scala.Predef.
Definition Classes
Ensuring
def ensuring(cond: Boolean): TaskTracker

Implicit information
This member is added by an implicit conversion from TaskTracker to Ensuring[TaskTracker] performed by method Ensuring in scala.Predef.
Definition Classes
Ensuring
final def eq(arg0: AnyRef): Boolean

Definition Classes
AnyRef
def equals(arg0: Any): Boolean

Definition Classes
AnyRef → Any
def finalize(): Unit

Attributes
protected[java.lang]
Definition Classes
AnyRef
Annotations
@throws( classOf[java.lang.Throwable] )
def formatted(fmtstr: String): String

Implicit information
This member is added by an implicit conversion from TaskTracker to StringFormat[TaskTracker] performed by method StringFormat in scala.Predef.
Definition Classes
StringFormat
Annotations
@inline()
final def getClass(): Class[_]

Definition Classes
AnyRef → Any
def graphNodeFor(task: Task): Option[GraphNode]

Get the graph node associated with the task
Get the graph node associated with the task
task
a task in the graph
returns
the graph node associated with the task if found, None otherwise
def graphNodeFor(id: TaskId): Option[GraphNode]

Get the graph node associated with the task identifier
Get the graph node associated with the task identifier
id
the task identifier
returns
the graph node associated with the task identifier if found, None otherwise
def graphNodeStateFor(task: Task): Option[GraphNodeState.Value]

Get the execution state of the task.
Get the execution state of the task.
task
the task.
returns
the execution state of the task.
def graphNodeStateFor(id: TaskId): Option[GraphNodeState.Value]

Get the execution state of the task.
Get the execution state of the task.
id
the task identifier.
returns
the execution state of the task.
def graphNodes: Iterable[GraphNode]

Get the graph nodes in the execution graph.
Get the graph nodes in the execution graph.
returns
the graph nodes, in no particular order.
def graphNodesInStateFor(state: GraphNodeState.Value): Iterable[GraphNode]

Gets the graph nodes in a given state.
Gets the graph nodes in a given state.
state
the state of the returned graph nodes.
returns
the graph nodes with the given state.

Attributes
protected
def graphNodesInStatesFor(states: Traversable[GraphNodeState.Value]): Iterable[GraphNode]

Gets the graph nodes in the given states.
Gets the graph nodes in the given states.
states
the states of the returned graph nodes.
returns
the graph nodes with the given states.

Attributes
protected
def graphNodesWithPredecessors: Iterable[GraphNode]

Gets the graph nodes that imply they have predecessors.
Gets the graph nodes that imply they have predecessors.
returns
the graph nodes that have predecessors (unmet dependencies).

Attributes
protected
def hasFailedTasks: Boolean

Checks if we have failed tasks.
Checks if we have failed tasks.
returns
true if we have failed tasks, false otherwise.

Definition Classes
TaskTracker → TaskManagerLike
def hashCode(): Int

Definition Classes
AnyRef → Any
final def isInstanceOf[T0]: Boolean

Definition Classes
Any
lazy val logger: Logger

Attributes
protected
Definition Classes
LazyLogging
final def ne(arg0: AnyRef): Boolean

Definition Classes
AnyRef
final def notify(): Unit

Definition Classes
AnyRef
final def notifyAll(): Unit

Definition Classes
AnyRef
def predecessorsOf(task: Task): Option[Traversable[GraphNode]]

Gets the predecessor graph nodes of the given task in the execution graph.
Gets the predecessor graph nodes of the given task in the execution graph.
This assumes that all predecessors of this task have been added with addTasks and not removed.
task
the task to lookup.
returns
the list of precedessors, or Nil if this task has no predecessors. If there were predecessors that are not currently being tracked, None will be returned instead.

Attributes
protected
def replaceTask(original: Task, replacement: Task): Boolean

Replace the original task with the replacement task and update any internal references.
Replace the original task with the replacement task and update any internal references.
If the replacement task depends on any task, any tasks depends on the replacement task, or if the original task is not being tracked this method will return false. Any tasks dependent on the original task, or any task on which the original task depends, will have their dependency relationship updated.
original
the original task to replace.
replacement
the replacement task.
returns
true if we are successful, false otherwise.

Definition Classes
TaskTracker → TaskManagerLike
final def synchronized[T0](arg0: ⇒ T0): T0

Definition Classes
AnyRef
def taskExecutionInfoFor(node: GraphNode): Option[TaskExecutionInfo]

Get the task's execution information if it exists.
Get the task's execution information if it exists.
node
the node associated with a task.
returns
the task execution information if the task is managed, None otherwise
def taskExecutionInfoFor(task: Task): Option[TaskExecutionInfo]

Get the task's execution information if it exists.
Get the task's execution information if it exists.
task
the task.
returns
the task execution information if the task is managed, None otherwise

Definition Classes
TaskTracker → TaskManagerLike
def taskExecutionInfoFor(id: TaskId): Option[TaskExecutionInfo]

Get the task's execution information if it exists.
Get the task's execution information if it exists.
id
the task identifier.
returns
the task execution information if the task is managed, None otherwise

Definition Classes
TaskTracker → TaskManagerLike
def taskFor(task: Task): Option[TaskId]

Get the task identifier for the given task.
Get the task identifier for the given task.
task
the task.
returns
the task identifier, None if the task is not being managed.

Definition Classes
TaskTracker → TaskManagerLike
def taskFor(id: TaskId): Option[Task]

Gets the task associated with the identifier, if any
Gets the task associated with the identifier, if any
id
the task id
returns
the task associate with the id if found, None otherwise

Definition Classes
TaskTracker → TaskManagerLike
def taskIds(): Iterable[TaskId]

Get the task identifiers for all tracked tasks.
Get the task identifiers for all tracked tasks.
returns
the task ids

Definition Classes
TaskTracker → TaskManagerLike
def taskStatusFor(id: TaskId): Option[TaskStatus.Value]

Get the task's associated TaskStatus.
Get the task's associated TaskStatus.
id
the task identifier.
returns
the task status if the task is managed, None otherwise.

Definition Classes
TaskTracker → TaskManagerLike
def taskStatusFor(task: Task): Option[TaskStatus.Value]

Get the task's associated TaskStatus.
Get the task's associated TaskStatus.
task
the task.
returns
the task status if the task is managed, None otherwise.

Definition Classes
TaskTracker → TaskManagerLike
def taskToInfoBiMapFor: BiMap[Task, TaskExecutionInfo]

Get the bi-directional map between managed tasks and their associated task execution information.
Get the bi-directional map between managed tasks and their associated task execution information.
returns
the task and task execution information bi-directional map.

Definition Classes
TaskTracker → TaskManagerLike
def toString(): String

Definition Classes
AnyRef → Any
final def wait(): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )
final def wait(arg0: Long, arg1: Int): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )
final def wait(arg0: Long): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )
def →[B](y: B): (TaskTracker, B)

Implicit information
This member is added by an implicit conversion from TaskTracker to ArrowAssoc[TaskTracker] performed by method ArrowAssoc in scala.Predef.
Definition Classes
ArrowAssoc

Inherited from LazyLogging

Inherited from TaskManagerLike

Inherited from AnyRef

Inherited from Any

Inherited by implicit conversion any2stringadd from TaskTracker to any2stringadd[TaskTracker]

Inherited by implicit conversion StringFormat from TaskTracker to StringFormat[TaskTracker]

Inherited by implicit conversion Ensuring from TaskTracker to Ensuring[TaskTracker]

Inherited by implicit conversion ArrowAssoc from TaskTracker to ArrowAssoc[TaskTracker]

Ungrouped

Related Doc: package execsystem

trait TaskTracker extends TaskManagerLike with LazyLogging

Abstract Value Members

abstract def logPathFor(task: Task, id: TaskId, attemptIndex: Int): Path

abstract def runToCompletion(failFast: Boolean): BiMap[Task, TaskExecutionInfo]

abstract def scriptPathFor(task: Task, id: TaskId, attemptIndex: Int): Path

abstract def stepExecution(): (Traversable[Task], Traversable[Task], Traversable[Task], Traversable[Task])

Concrete Value Members

final def !=(arg0: Any): Boolean

final def ##(): Int

def +(other: String): String

def ->[B](y: B): (TaskTracker, B)

final def ==(arg0: Any): Boolean

def addTask(task: Task, enclosingNode: Option[GraphNode], ignoreExists: Boolean = false): TaskId

def addTask(task: Task): TaskId

def addTasks(tasks: Task*): Seq[TaskId]

def addTasks(tasks: Traversable[Task], enclosingNode: Option[GraphNode] = None, ignoreExists: Boolean = false): List[TaskId]

def allPredecessorsAdded(task: Task): Boolean

def apply(id: TaskId): GraphNode

final def asInstanceOf[T0]: T0

def checkForCycles(task: Task): Unit

def clone(): AnyRef

def ensuring(cond: (TaskTracker) ⇒ Boolean, msg: ⇒ Any): TaskTracker

def ensuring(cond: (TaskTracker) ⇒ Boolean): TaskTracker

def ensuring(cond: Boolean, msg: ⇒ Any): TaskTracker

def ensuring(cond: Boolean): TaskTracker

final def eq(arg0: AnyRef): Boolean

def equals(arg0: Any): Boolean

def finalize(): Unit

def formatted(fmtstr: String): String

final def getClass(): Class[_]

def graphNodeFor(task: Task): Option[GraphNode]

def graphNodeFor(id: TaskId): Option[GraphNode]

def graphNodeStateFor(task: Task): Option[GraphNodeState.Value]

def graphNodeStateFor(id: TaskId): Option[GraphNodeState.Value]

def graphNodes: Iterable[GraphNode]

def graphNodesInStateFor(state: GraphNodeState.Value): Iterable[GraphNode]

def graphNodesInStatesFor(states: Traversable[GraphNodeState.Value]): Iterable[GraphNode]

def graphNodesWithPredecessors: Iterable[GraphNode]

def hasFailedTasks: Boolean

def hashCode(): Int

final def isInstanceOf[T0]: Boolean

lazy val logger: Logger

final def ne(arg0: AnyRef): Boolean

final def notify(): Unit

final def notifyAll(): Unit

def predecessorsOf(task: Task): Option[Traversable[GraphNode]]

def replaceTask(original: Task, replacement: Task): Boolean

final def synchronized[T0](arg0: ⇒ T0): T0

def taskExecutionInfoFor(node: GraphNode): Option[TaskExecutionInfo]

def taskExecutionInfoFor(task: Task): Option[TaskExecutionInfo]

def taskExecutionInfoFor(id: TaskId): Option[TaskExecutionInfo]

def taskFor(task: Task): Option[TaskId]

def taskFor(id: TaskId): Option[Task]

def taskIds(): Iterable[TaskId]

def taskStatusFor(id: TaskId): Option[TaskStatus.Value]

def taskStatusFor(task: Task): Option[TaskStatus.Value]

def taskToInfoBiMapFor: BiMap[Task, TaskExecutionInfo]

def toString(): String

final def wait(): Unit

final def wait(arg0: Long, arg1: Int): Unit

final def wait(arg0: Long): Unit

def →[B](y: B): (TaskTracker, B)

Inherited from LazyLogging

Inherited from TaskManagerLike

Inherited from AnyRef

Inherited from Any

Inherited by implicit conversion any2stringadd from TaskTracker to any2stringadd[TaskTracker]

Inherited by implicit conversion StringFormat from TaskTracker to StringFormat[TaskTracker]

Inherited by implicit conversion Ensuring from TaskTracker to Ensuring[TaskTracker]

Inherited by implicit conversion ArrowAssoc from TaskTracker to ArrowAssoc[TaskTracker]

Ungrouped