UnitTask
Related Doc:
package tasksystem
Given a non-null ResourceSet representing the available resources at this moment in time return either a ResourceSet that is a subset of the available resources in which the task can run, or None if the task cannot run in the available resources.
Given a non-null ResourceSet representing the available resources at this moment in time return either a ResourceSet that is a subset of the available resources in which the task can run, or None if the task cannot run in the available resources.
The system resources available to the task
Either a ResourceSet of the desired subset of resources to run with, or None
Removes this as a dependency for other
Removes this as a dependency for other
Removes this as a dependency for other
Removes this as a dependency for other
Combines this task with another task into a MultiTask.
Combines this task with another task into a MultiTask.
Creates a dependency on this dependable for all the Tasks in the provided MultiTask.
Creates a dependency on this dependable for all the Tasks in the provided MultiTask.
Sets up a dependency between two tasks.
Sets up a dependency between two tasks. The task on the left side of the arrow (i.e. this) is set to be a predecessor/dependency of that task on the right hand side of the arrow (i.e. other).
the "other" task so that chains of calls like a ==> b ==> c work correctly
Called by the Scheduler immediately prior to scheduling to allow tasks to perform any necessary last-minute configuration with the knowledge of the exact set of resources they are to be run with.
Called by the Scheduler immediately prior to scheduling to allow tasks to perform any necessary last-minute configuration with the knowledge of the exact set of resources they are to be run with.
the set of resources that the task will be run with
Get the list of tasks to execute.
Get the list of tasks to execute.
For UnitTask and any class that extends it, if the task wishes to be directly executed, the list should be of size one, and equal to itself. If no resources have been specified, both memory and cores default to the given resources.
the list of tasks of to run.
The name of the task.
The name of the task.
Finalize anything after the task has been run.
Finalize anything after the task has been run.
This method should be called after a task has been run. The intended use of this method is to allow for any modification of this task prior to any dependent tasks being run. This would allow any parameters that were passed to dependent tasks as call-by-name to be finalized here. For example, we could have passed an Option[String] that is None until make it Some(String) in this method. Then when the dependent task's getTasks method is called, it can call 'get' on the option and get something.
the exit code of the task, which could also be 1 due to the system terminating this process
true if we c
Removes a dependency by removing the supplied task from the list of dependencies for this task and removing this from the list of tasks depending on "task".
Removes a dependency by removing the supplied task from the list of dependencies for this task and removing this from the list of tasks depending on "task".
a task on which this task depends
true if a dependency existed and was removed, false otherwise
Retry the given task.
Retry the given task.
the task execution information for the task to be retried.
true the task failed while running its onComplete method, otherwise failed while running its command
the task to be retried, None if it is not to be retried.
Sets the name of this task.
Sets the name of this task.
A task that should be directly executed or scheduled.
A few things about unit tasks: - a task can depend on data from tasks on which it is dependent. See Callbacks. - a task extending this class should return only one task in its getTasks method. See Task.getTasks. - a task can perform any final logic dependent on the resources with which it is scheduled. See Scheduler!.schedule*.
When a unit task gets scheduled, the dagr.core.execsystem.Scheduler.schedule method will be called to allow any final logic based on the resources this task was scheduled with. This is in addition to the steps listed in Task.