TaskManager

Instance Constructors

new TaskManager(taskManagerResources: SystemResources = ..., scriptsDirectory: Option[Path] = None, logDirectory: Option[Path] = None, scheduler: Scheduler = ..., simulate: Boolean = false, sleepMilliseconds: Int = 1000)

taskManagerResources
the set of task manager resources, otherwise we use the default
scriptsDirectory
the scripts directory, otherwise a temporary directory will be used
logDirectory
the log directory, otherwise a temporary directory will be used
scheduler
the scheduler, otherwise we use the default
simulate
true if we are to simulate running tasks, false otherwise
sleepMilliseconds
the time to wait in milliseconds to wait between trying to schedule tasks.

Value Members

final def !=(arg0: Any): Boolean

Definition Classes
AnyRef → Any
final def ##(): Int

Definition Classes
AnyRef → Any
def +(other: String): String

Implicit information
This member is added by an implicit conversion from TaskManager to any2stringadd[TaskManager] performed by method any2stringadd in scala.Predef.
Definition Classes
any2stringadd
def ->[B](y: B): (TaskManager, B)

Implicit information
This member is added by an implicit conversion from TaskManager to ArrowAssoc[TaskManager] performed by method ArrowAssoc in scala.Predef.
Definition Classes
ArrowAssoc
Annotations
@inline()
final def ==(arg0: Any): Boolean

Definition Classes
AnyRef → Any
val actualLogsDirectory: Path

Attributes
protected
def addTask(task: Task, enclosingNode: Option[GraphNode], ignoreExists: Boolean = false): TaskId

Adds a task to be managed
Adds a task to be managed
Throws an IllegalArgumentException if a cycle was found after logging each strongly connected component with a cycle in the graph.
task
the given task.
ignoreExists
true if we just return the task id for already added tasks, false if we are to throw an IllegalArgumentException
returns
the task identifier.

Attributes
protected[dagr.core.execsystem]
Definition Classes
TaskTracker
def addTask(task: Task): TaskId

Adds a task to be managed
Adds a task to be managed
task
the given task.
returns
the task identifier.

Definition Classes
TaskTracker → TaskManagerLike
def addTasks(tasks: Task*): Seq[TaskId]

Adds tasks to be managed
Adds tasks to be managed
tasks
the given tasks.
returns
the task identifiers.

Definition Classes
TaskTracker → TaskManagerLike
def addTasks(tasks: Traversable[Task], enclosingNode: Option[GraphNode] = None, ignoreExists: Boolean = false): List[TaskId]

Adds tasks to be managed
Adds tasks to be managed
tasks
the given tasks.
ignoreExists
true if we just return the task id for already added tasks, false if we are to throw an IllegalArgumentException
returns
the task identifiers.

Attributes
protected[dagr.core.execsystem]
Definition Classes
TaskTracker
def allPredecessorsAdded(task: Task): Boolean

Returns true if all the predecessors of this task are known (have been added), false otherwise.
Returns true if all the predecessors of this task are known (have been added), false otherwise.

Attributes
protected
Definition Classes
TaskTracker
def apply(id: TaskId): GraphNode

Gets the graph execution node for the given id.
Gets the graph execution node for the given id. If there is no task being tracked with that id, throws a NoSuchElementException.
id
the id to lookup.
returns
the associated task.

Definition Classes
TaskTracker → TaskManagerLike
final def asInstanceOf[T0]: T0

Definition Classes
Any
def checkForCycles(task: Task): Unit

Checks for cycles in the graph to which the task belongs.
Checks for cycles in the graph to which the task belongs.
Throws an IllegalArgumentException if a cycle was found after logging each strongly connected component with a cycle in the graph.
task
a task in the graph to check.

Attributes
protected
Definition Classes
TaskTracker
def clone(): AnyRef

Attributes
protected[java.lang]
Definition Classes
AnyRef
Annotations
@throws( ... )
def ensuring(cond: (TaskManager) ⇒ Boolean, msg: ⇒ Any): TaskManager

Implicit information
This member is added by an implicit conversion from TaskManager to Ensuring[TaskManager] performed by method Ensuring in scala.Predef.
Definition Classes
Ensuring
def ensuring(cond: (TaskManager) ⇒ Boolean): TaskManager

Implicit information
This member is added by an implicit conversion from TaskManager to Ensuring[TaskManager] performed by method Ensuring in scala.Predef.
Definition Classes
Ensuring
def ensuring(cond: Boolean, msg: ⇒ Any): TaskManager

Implicit information
This member is added by an implicit conversion from TaskManager to Ensuring[TaskManager] performed by method Ensuring in scala.Predef.
Definition Classes
Ensuring
def ensuring(cond: Boolean): TaskManager

Implicit information
This member is added by an implicit conversion from TaskManager to Ensuring[TaskManager] performed by method Ensuring in scala.Predef.
Definition Classes
Ensuring
final def eq(arg0: AnyRef): Boolean

Definition Classes
AnyRef
def equals(arg0: Any): Boolean

Definition Classes
AnyRef → Any
def finalize(): Unit

Attributes
protected[java.lang]
Definition Classes
AnyRef
Annotations
@throws( classOf[java.lang.Throwable] )
def formatted(fmtstr: String): String

Implicit information
This member is added by an implicit conversion from TaskManager to StringFormat[TaskManager] performed by method StringFormat in scala.Predef.
Definition Classes
StringFormat
Annotations
@inline()
final def getClass(): Class[_]

Definition Classes
AnyRef → Any
def graphNodeFor(task: Task): Option[GraphNode]

Get the graph node associated with the task
Get the graph node associated with the task
task
a task in the graph
returns
the graph node associated with the task if found, None otherwise

Definition Classes
TaskTracker
def graphNodeFor(id: TaskId): Option[GraphNode]

Get the graph node associated with the task identifier
Get the graph node associated with the task identifier
id
the task identifier
returns
the graph node associated with the task identifier if found, None otherwise

Definition Classes
TaskTracker
def graphNodeStateFor(task: Task): Option[GraphNodeState.Value]

Get the execution state of the task.
Get the execution state of the task.
task
the task.
returns
the execution state of the task.

Definition Classes
TaskTracker
def graphNodeStateFor(id: TaskId): Option[GraphNodeState.Value]

Get the execution state of the task.
Get the execution state of the task.
id
the task identifier.
returns
the execution state of the task.

Definition Classes
TaskTracker
def graphNodes: Iterable[GraphNode]

Get the graph nodes in the execution graph.
Get the graph nodes in the execution graph.
returns
the graph nodes, in no particular order.

Definition Classes
TaskTracker
def graphNodesInStateFor(state: GraphNodeState.Value): Iterable[GraphNode]

Gets the graph nodes in a given state.
Gets the graph nodes in a given state.
state
the state of the returned graph nodes.
returns
the graph nodes with the given state.

Attributes
protected
Definition Classes
TaskTracker
def graphNodesInStatesFor(states: Traversable[GraphNodeState.Value]): Iterable[GraphNode]

Gets the graph nodes in the given states.
Gets the graph nodes in the given states.
states
the states of the returned graph nodes.
returns
the graph nodes with the given states.

Attributes
protected
Definition Classes
TaskTracker
def graphNodesWithPredecessors: Iterable[GraphNode]

Gets the graph nodes that imply they have predecessors.
Gets the graph nodes that imply they have predecessors.
returns
the graph nodes that have predecessors (unmet dependencies).

Attributes
protected
Definition Classes
TaskTracker
def hasFailedTasks: Boolean

Checks if we have failed tasks.
Checks if we have failed tasks.
returns
true if we have failed tasks, false otherwise.

Definition Classes
TaskTracker → TaskManagerLike
def hashCode(): Int

Definition Classes
AnyRef → Any
final def isInstanceOf[T0]: Boolean

Definition Classes
Any
def joinOnRunningTasks(millis: Long): Unit

For testing purposes only.
For testing purposes only.

Attributes
protected
def logPathFor(task: Task, taskId: TaskId, attemptIndex: Int): Path

Generates a path to file to store the log output of the task
Generates a path to file to store the log output of the task

Attributes
protected
Definition Classes
TaskManager → TaskTracker
def logReport(loggerMethod: (String) ⇒ Unit, delimiter: String = " "): Unit

Writes a delimited string of the status of all tasks managed
Writes a delimited string of the status of all tasks managed
loggerMethod
the method to use to write task status information, one line at a time
delimiter
the delimiter between entries in a row

Definition Classes
FinalStatusReporter
lazy val logger: Logger

Attributes
protected
Definition Classes
LazyLogging
final def ne(arg0: AnyRef): Boolean

Definition Classes
AnyRef
final def notify(): Unit

Definition Classes
AnyRef
final def notifyAll(): Unit

Definition Classes
AnyRef
def predecessorsOf(task: Task): Option[Traversable[GraphNode]]

Gets the predecessor graph nodes of the given task in the execution graph.
Gets the predecessor graph nodes of the given task in the execution graph.
This assumes that all predecessors of this task have been added with addTasks and not removed.
task
the task to lookup.
returns
the list of precedessors, or Nil if this task has no predecessors. If there were predecessors that are not currently being tracked, None will be returned instead.

Attributes
protected
Definition Classes
TaskTracker
def readyTasksList: List[UnitTask]

Attributes
protected[dagr.core]
def replaceTask(original: Task, replacement: Task): Boolean

Replace the original task with the replacement task and update any internal references.
Replace the original task with the replacement task and update any internal references. This will terminate the task if it is running.
original
the original task to replace.
replacement
the replacement task.
returns
true if we are successful, false if the original is not being tracked.

Definition Classes
TaskManager → TaskTracker → TaskManagerLike
def runToCompletion(failFast: Boolean): BiMap[Task, TaskExecutionInfo]

Run all tasks managed to either completion, failure, or inability to schedule.
Run all tasks managed to either completion, failure, or inability to schedule.
This will terminate tasks that were still running before returning in the case of failure or inability to schedule.
returns
a bi-directional map from the set of tasks to their execution information.

Definition Classes
TaskManager → TaskManagerLike
def runningTasksMap: Map[UnitTask, ResourceSet]

Returns a map of running tasks and the resource set they were scheduled with.
def scriptPathFor(task: Task, taskId: TaskId, attemptIndex: Int): Path

Generates a path to a file to hold the task command
Generates a path to a file to hold the task command

Attributes
protected
Definition Classes
TaskManager → TaskTracker
def stepExecution(): (Traversable[Task], Traversable[Task], Traversable[Task], Traversable[Task])

Run a a single iteration of managing tasks.
Run a a single iteration of managing tasks.
1. Get tasks that have completed and update their state. 2. Update any resolved dependencies in the execution graph. 3. Get tasks for any task that has no predecessors until no more can be found. 4. Schedule tasks and start running them.
returns
a tuple of: (1) tasks that can be scheduled. (2) tasks that were scheduled. (3) tasks that are running prior to scheduling. (4) the tasks that have completed prior to scheduling.

Definition Classes
TaskManager → TaskManagerLike
final def synchronized[T0](arg0: ⇒ T0): T0

Definition Classes
AnyRef
def taskExecutionInfoFor(node: GraphNode): Option[TaskExecutionInfo]

Get the task's execution information if it exists.
Get the task's execution information if it exists.
node
the node associated with a task.
returns
the task execution information if the task is managed, None otherwise

Definition Classes
TaskTracker
def taskExecutionInfoFor(task: Task): Option[TaskExecutionInfo]

Get the task's execution information if it exists.
Get the task's execution information if it exists.
task
the task.
returns
the task execution information if the task is managed, None otherwise

Definition Classes
TaskTracker → TaskManagerLike
def taskExecutionInfoFor(id: TaskId): Option[TaskExecutionInfo]

Get the task's execution information if it exists.
Get the task's execution information if it exists.
id
the task identifier.
returns
the task execution information if the task is managed, None otherwise

Definition Classes
TaskTracker → TaskManagerLike
def taskFor(task: Task): Option[TaskId]

Get the task identifier for the given task.
Get the task identifier for the given task.
task
the task.
returns
the task identifier, None if the task is not being managed.

Definition Classes
TaskTracker → TaskManagerLike
def taskFor(id: TaskId): Option[Task]

Gets the task associated with the identifier, if any
Gets the task associated with the identifier, if any
id
the task id
returns
the task associate with the id if found, None otherwise

Definition Classes
TaskTracker → TaskManagerLike
def taskIds(): Iterable[TaskId]

Get the task identifiers for all tracked tasks.
Get the task identifiers for all tracked tasks.
returns
the task ids

Definition Classes
TaskTracker → TaskManagerLike
def taskStatusFor(id: TaskId): Option[TaskStatus.Value]

Get the task's associated TaskStatus.
Get the task's associated TaskStatus.
id
the task identifier.
returns
the task status if the task is managed, None otherwise.

Definition Classes
TaskTracker → TaskManagerLike
def taskStatusFor(task: Task): Option[TaskStatus.Value]

Get the task's associated TaskStatus.
Get the task's associated TaskStatus.
task
the task.
returns
the task status if the task is managed, None otherwise.

Definition Classes
TaskTracker → TaskManagerLike
def taskToInfoBiMapFor: BiMap[Task, TaskExecutionInfo]

Get the bi-directional map between managed tasks and their associated task execution information.
Get the bi-directional map between managed tasks and their associated task execution information.
returns
the task and task execution information bi-directional map.

Definition Classes
TaskTracker → TaskManagerLike
def terminateTask(taskId: TaskId): Boolean

Attempts to terminate a task's underlying process.
Attempts to terminate a task's underlying process.
taskId
the identifier of the task to terminate
returns
true if successful, false otherwise

Attributes
protected
def toString(): String

Definition Classes
AnyRef → Any
final def wait(): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )
final def wait(arg0: Long, arg1: Int): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )
final def wait(arg0: Long): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )
def →[B](y: B): (TaskManager, B)

Implicit information
This member is added by an implicit conversion from TaskManager to ArrowAssoc[TaskManager] performed by method ArrowAssoc in scala.Predef.
Definition Classes
ArrowAssoc

Inherited from FinalStatusReporter

Inherited from TaskTracker

Inherited from LazyLogging

Inherited from TaskManagerLike

Inherited from AnyRef

Inherited from Any

Inherited by implicit conversion any2stringadd from TaskManager to any2stringadd[TaskManager]

Inherited by implicit conversion StringFormat from TaskManager to StringFormat[TaskManager]

Inherited by implicit conversion Ensuring from TaskManager to Ensuring[TaskManager]

Inherited by implicit conversion ArrowAssoc from TaskManager to ArrowAssoc[TaskManager]

Ungrouped

Related Docs: object TaskManager | package execsystem

class TaskManager extends TaskManagerLike with TaskTracker with FinalStatusReporter with LazyLogging

Instance Constructors

new TaskManager(taskManagerResources: SystemResources = ..., scriptsDirectory: Option[Path] = None, logDirectory: Option[Path] = None, scheduler: Scheduler = ..., simulate: Boolean = false, sleepMilliseconds: Int = 1000)

Value Members

final def !=(arg0: Any): Boolean

final def ##(): Int

def +(other: String): String

def ->[B](y: B): (TaskManager, B)

final def ==(arg0: Any): Boolean

val actualLogsDirectory: Path

def addTask(task: Task, enclosingNode: Option[GraphNode], ignoreExists: Boolean = false): TaskId

def addTask(task: Task): TaskId

def addTasks(tasks: Task*): Seq[TaskId]

def addTasks(tasks: Traversable[Task], enclosingNode: Option[GraphNode] = None, ignoreExists: Boolean = false): List[TaskId]

def allPredecessorsAdded(task: Task): Boolean

def apply(id: TaskId): GraphNode

final def asInstanceOf[T0]: T0

def checkForCycles(task: Task): Unit

def clone(): AnyRef

def ensuring(cond: (TaskManager) ⇒ Boolean, msg: ⇒ Any): TaskManager

def ensuring(cond: (TaskManager) ⇒ Boolean): TaskManager

def ensuring(cond: Boolean, msg: ⇒ Any): TaskManager

def ensuring(cond: Boolean): TaskManager

final def eq(arg0: AnyRef): Boolean

def equals(arg0: Any): Boolean

def finalize(): Unit

def formatted(fmtstr: String): String

final def getClass(): Class[_]

def graphNodeFor(task: Task): Option[GraphNode]

def graphNodeFor(id: TaskId): Option[GraphNode]

def graphNodeStateFor(task: Task): Option[GraphNodeState.Value]

def graphNodeStateFor(id: TaskId): Option[GraphNodeState.Value]

def graphNodes: Iterable[GraphNode]

def graphNodesInStateFor(state: GraphNodeState.Value): Iterable[GraphNode]

def graphNodesInStatesFor(states: Traversable[GraphNodeState.Value]): Iterable[GraphNode]

def graphNodesWithPredecessors: Iterable[GraphNode]

def hasFailedTasks: Boolean

def hashCode(): Int

final def isInstanceOf[T0]: Boolean

def joinOnRunningTasks(millis: Long): Unit

def logPathFor(task: Task, taskId: TaskId, attemptIndex: Int): Path

def logReport(loggerMethod: (String) ⇒ Unit, delimiter: String = " "): Unit

lazy val logger: Logger

final def ne(arg0: AnyRef): Boolean

final def notify(): Unit

final def notifyAll(): Unit

def predecessorsOf(task: Task): Option[Traversable[GraphNode]]

def readyTasksList: List[UnitTask]

def replaceTask(original: Task, replacement: Task): Boolean

def runToCompletion(failFast: Boolean): BiMap[Task, TaskExecutionInfo]

def runningTasksMap: Map[UnitTask, ResourceSet]

def scriptPathFor(task: Task, taskId: TaskId, attemptIndex: Int): Path

def stepExecution(): (Traversable[Task], Traversable[Task], Traversable[Task], Traversable[Task])

final def synchronized[T0](arg0: ⇒ T0): T0

def taskExecutionInfoFor(node: GraphNode): Option[TaskExecutionInfo]

def taskExecutionInfoFor(task: Task): Option[TaskExecutionInfo]

def taskExecutionInfoFor(id: TaskId): Option[TaskExecutionInfo]

def taskFor(task: Task): Option[TaskId]

def taskFor(id: TaskId): Option[Task]

def taskIds(): Iterable[TaskId]

def taskStatusFor(id: TaskId): Option[TaskStatus.Value]

def taskStatusFor(task: Task): Option[TaskStatus.Value]

def taskToInfoBiMapFor: BiMap[Task, TaskExecutionInfo]

def terminateTask(taskId: TaskId): Boolean

def toString(): String

final def wait(): Unit

final def wait(arg0: Long, arg1: Int): Unit

final def wait(arg0: Long): Unit

def →[B](y: B): (TaskManager, B)

Inherited from FinalStatusReporter

Inherited from TaskTracker

Inherited from LazyLogging

Inherited from TaskManagerLike

Inherited from AnyRef

Inherited from Any

Inherited by implicit conversion any2stringadd from TaskManager to any2stringadd[TaskManager]

Inherited by implicit conversion StringFormat from TaskManager to StringFormat[TaskManager]

Inherited by implicit conversion Ensuring from TaskManager to Ensuring[TaskManager]