com.facebook.presto.execution

Class SqlTaskManager

java.lang.Object

com.facebook.presto.execution.SqlTaskManager

All Implemented Interfaces:

TaskManager, Closeable, AutoCloseable

public class SqlTaskManager
extends Object
implements TaskManager, Closeable

Constructor Summary

Constructors

Constructor and Description

SqlTaskManager(LocalExecutionPlanner planner, LocationFactory locationFactory, TaskExecutor taskExecutor, SplitMonitor splitMonitor, com.facebook.airlift.node.NodeInfo nodeInfo, LocalMemoryManager localMemoryManager, com.facebook.airlift.json.JsonCodec<List<TaskMemoryReservationSummary>> memoryReservationSummaryJsonCodec, TaskManagementExecutor taskManagementExecutor, TaskManagerConfig config, NodeMemoryConfig nodeMemoryConfig, LocalSpillManager localSpillManager, ExchangeClientSupplier exchangeClientSupplier, NodeSpillConfig nodeSpillConfig, com.facebook.airlift.stats.GcMonitor gcMonitor, BlockEncodingSerde blockEncodingSerde, OrderingCompiler orderingCompiler, FragmentResultCacheManager fragmentResultCacheManager, com.fasterxml.jackson.databind.ObjectMapper objectMapper, SpoolingOutputBufferFactory spoolingOutputBufferFactory)

Method Summary

Modifier and Type	Method and Description
TaskInfo	abortTask(TaskId taskId) Aborts a task.
TaskInfo	abortTaskResults(TaskId taskId, OutputBuffers.OutputBufferId bufferId) Aborts a result buffer for a task.
void	acknowledgeTaskResults(TaskId taskId, OutputBuffers.OutputBufferId bufferId, long sequenceId) Acknowledges previously received results.
void	addStateChangeListener(TaskId taskId, StateMachine.StateChangeListener<TaskState> stateChangeListener) Adds a state change listener to the specified task.
TaskInfo	cancelTask(TaskId taskId) Cancels a task.
void	close()
void	failAbandonedTasks()
List<TaskInfo>	getAllTaskInfo() Gets all of the currently tracked tasks.
List<SqlTask>	getAllTasks()
com.facebook.airlift.stats.CounterStat	getFailedTasks()
SqlTaskIoStats	getIoStats()
QueryContext	getQueryContext(QueryId queryId)
SqlTask	getTask(TaskId taskId)
TaskInfo	getTaskInfo(TaskId taskId) Gets the info for the specified task.
com.google.common.util.concurrent.ListenableFuture<TaskInfo>	getTaskInfo(TaskId taskId, TaskState currentState) Gets future info for the task after the state changes from current state.
String	getTaskInstanceId(TaskId taskId) Gets the unique instance id of a task.
com.facebook.airlift.concurrent.ThreadPoolExecutorMBean	getTaskNotificationExecutor()
com.google.common.util.concurrent.ListenableFuture<BufferResult>	getTaskResults(TaskId taskId, OutputBuffers.OutputBufferId bufferId, long startingSequenceId, io.airlift.units.DataSize maxSize) Gets results from a task either immediately or in the future.
TaskStatus	getTaskStatus(TaskId taskId) Gets the status for the specified task.
com.google.common.util.concurrent.ListenableFuture<TaskStatus>	getTaskStatus(TaskId taskId, TaskState currentState) Gets future status for the task after the state changes from current state.
void	removeOldTasks()
void	removeRemoteSource(TaskId taskId, TaskId remoteSourceTaskId) Removes the remote source from exchange clients of taskId receiving data from remoteSourceTaskId.
void	start()
void	updateMemoryPoolAssignments(MemoryPoolAssignmentsRequest assignments)
void	updateMetadataResults(TaskId taskId, MetadataUpdates metadataUpdates) Update the results of metadata requests sent
TaskInfo	updateTask(Session session, TaskId taskId, Optional<PlanFragment> fragment, List<TaskSource> sources, OutputBuffers outputBuffers, Optional<TableWriteInfo> tableWriteInfo) Updates the task plan, sources and output buffers.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SqlTaskManager

@Inject
public SqlTaskManager(LocalExecutionPlanner planner,
                              LocationFactory locationFactory,
                              TaskExecutor taskExecutor,
                              SplitMonitor splitMonitor,
                              com.facebook.airlift.node.NodeInfo nodeInfo,
                              LocalMemoryManager localMemoryManager,
                              com.facebook.airlift.json.JsonCodec<List<TaskMemoryReservationSummary>> memoryReservationSummaryJsonCodec,
                              TaskManagementExecutor taskManagementExecutor,
                              TaskManagerConfig config,
                              NodeMemoryConfig nodeMemoryConfig,
                              LocalSpillManager localSpillManager,
                              ExchangeClientSupplier exchangeClientSupplier,
                              NodeSpillConfig nodeSpillConfig,
                              com.facebook.airlift.stats.GcMonitor gcMonitor,
                              BlockEncodingSerde blockEncodingSerde,
                              OrderingCompiler orderingCompiler,
                              FragmentResultCacheManager fragmentResultCacheManager,
                              com.fasterxml.jackson.databind.ObjectMapper objectMapper,
                              SpoolingOutputBufferFactory spoolingOutputBufferFactory)

Method Detail

updateMemoryPoolAssignments

public void updateMemoryPoolAssignments(MemoryPoolAssignmentsRequest assignments)

Specified by:

updateMemoryPoolAssignments in interface TaskManager

start

@PostConstruct
public void start()

close

@PreDestroy
public void close()

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

getIoStats

public SqlTaskIoStats getIoStats()

getTaskNotificationExecutor

public com.facebook.airlift.concurrent.ThreadPoolExecutorMBean getTaskNotificationExecutor()

getFailedTasks

public com.facebook.airlift.stats.CounterStat getFailedTasks()

getAllTasks

public List<SqlTask> getAllTasks()

getTask

public SqlTask getTask(TaskId taskId)

getAllTaskInfo

public List<TaskInfo> getAllTaskInfo()

Description copied from interface: TaskManager

Gets all of the currently tracked tasks. This will included uninitialized, running, and completed tasks.

Specified by:

getAllTaskInfo in interface TaskManager

getTaskInfo

public TaskInfo getTaskInfo(TaskId taskId)

Description copied from interface: TaskManager

Gets the info for the specified task. If the task has not been created yet, an uninitialized task is created and the info is returned.

NOTE: this design assumes that only tasks that will eventually exist are queried.

Specified by:

getTaskInfo in interface TaskManager

getTaskStatus

public TaskStatus getTaskStatus(TaskId taskId)

Description copied from interface: TaskManager

Gets the status for the specified task.

Specified by:

getTaskStatus in interface TaskManager

getTaskInfo

public com.google.common.util.concurrent.ListenableFuture<TaskInfo> getTaskInfo(TaskId taskId,
                                                                                TaskState currentState)

Description copied from interface: TaskManager

Gets future info for the task after the state changes from current state. If the task has not been created yet, an uninitialized task is created and the future is returned. If the task is already in a final state, the info is returned immediately.

NOTE: this design assumes that only tasks that will eventually exist are queried.

Specified by:

getTaskInfo in interface TaskManager

getTaskInstanceId

public String getTaskInstanceId(TaskId taskId)

Description copied from interface: TaskManager

Gets the unique instance id of a task. This can be used to detect a task that was destroyed and recreated.

Specified by:

getTaskInstanceId in interface TaskManager

getTaskStatus

public com.google.common.util.concurrent.ListenableFuture<TaskStatus> getTaskStatus(TaskId taskId,
                                                                                    TaskState currentState)

Description copied from interface: TaskManager

Gets future status for the task after the state changes from current state. If the task has not been created yet, an uninitialized task is created and the future is returned. If the task is already in a final state, the status is returned immediately.

NOTE: this design assumes that only tasks that will eventually exist are queried.

Specified by:

getTaskStatus in interface TaskManager

updateTask

public TaskInfo updateTask(Session session,
                           TaskId taskId,
                           Optional<PlanFragment> fragment,
                           List<TaskSource> sources,
                           OutputBuffers outputBuffers,
                           Optional<TableWriteInfo> tableWriteInfo)

Description copied from interface: TaskManager

Updates the task plan, sources and output buffers. If the task does not already exist, is is created and then updated.

Specified by:

updateTask in interface TaskManager

updateMetadataResults

public void updateMetadataResults(TaskId taskId,
                                  MetadataUpdates metadataUpdates)

Description copied from interface: TaskManager

Update the results of metadata requests sent

Specified by:

updateMetadataResults in interface TaskManager

getTaskResults

public com.google.common.util.concurrent.ListenableFuture<BufferResult> getTaskResults(TaskId taskId,
                                                                                       OutputBuffers.OutputBufferId bufferId,
                                                                                       long startingSequenceId,
                                                                                       io.airlift.units.DataSize maxSize)

Description copied from interface: TaskManager

Gets results from a task either immediately or in the future. If the task or buffer has not been created yet, an uninitialized task is created and a future is returned.

NOTE: this design assumes that only tasks and buffers that will eventually exist are queried.

Specified by:

getTaskResults in interface TaskManager

acknowledgeTaskResults

public void acknowledgeTaskResults(TaskId taskId,
                                   OutputBuffers.OutputBufferId bufferId,
                                   long sequenceId)

Description copied from interface: TaskManager

Acknowledges previously received results.

Specified by:

acknowledgeTaskResults in interface TaskManager

abortTaskResults

public TaskInfo abortTaskResults(TaskId taskId,
                                 OutputBuffers.OutputBufferId bufferId)

Description copied from interface: TaskManager

Aborts a result buffer for a task. If the task or buffer has not been created yet, an uninitialized task is created and a the buffer is aborted.

NOTE: this design assumes that only tasks and buffers that will eventually exist are queried.

Specified by:

abortTaskResults in interface TaskManager

removeRemoteSource

public void removeRemoteSource(TaskId taskId,
                               TaskId remoteSourceTaskId)

Description copied from interface: TaskManager

Removes the remote source from exchange clients of taskId receiving data from remoteSourceTaskId. Any further output or transport timeout exception from remoteSourceTaskId will be ignored.

Specified by:

removeRemoteSource in interface TaskManager

cancelTask

public TaskInfo cancelTask(TaskId taskId)

Description copied from interface: TaskManager

Cancels a task. If the task does not already exist, is is created and then canceled.

Specified by:

cancelTask in interface TaskManager

abortTask

public TaskInfo abortTask(TaskId taskId)

Description copied from interface: TaskManager

Aborts a task. If the task does not already exist, is is created and then aborted.

Specified by:

abortTask in interface TaskManager

removeOldTasks

public void removeOldTasks()

failAbandonedTasks

public void failAbandonedTasks()

addStateChangeListener

public void addStateChangeListener(TaskId taskId,
                                   StateMachine.StateChangeListener<TaskState> stateChangeListener)

Description copied from interface: TaskManager

Adds a state change listener to the specified task. Listener is always notified asynchronously using a dedicated notification thread pool so, care should be taken to avoid leaking this when adding a listener in a constructor. Additionally, it is possible notifications are observed out of order due to the asynchronous execution.

Specified by:

addStateChangeListener in interface TaskManager

getQueryContext

public QueryContext getQueryContext(QueryId queryId)