org.apache.flink.runtime.scheduler

Interface SchedulerNG

All Superinterfaces:

AutoCloseable, org.apache.flink.util.AutoCloseableAsync

All Known Implementing Classes:

AdaptiveScheduler, DefaultScheduler, SchedulerBase

public interface SchedulerNG
extends org.apache.flink.util.AutoCloseableAsync

Interface for scheduling Flink jobs.

Instances are created via SchedulerNGFactory, and receive a JobGraph when instantiated.

Implementations can expect that methods will not be invoked concurrently. In fact, all invocations will originate from a thread in the ComponentMainThreadExecutor.

Method Summary

Modifier and Type	Method and Description
void	acknowledgeCheckpoint(org.apache.flink.api.common.JobID jobID, ExecutionAttemptID executionAttemptID, long checkpointId, CheckpointMetrics checkpointMetrics, TaskStateSnapshot checkpointState)
void	cancel()
void	declineCheckpoint(DeclineCheckpoint decline)
CompletableFuture<CoordinationResponse>	deliverCoordinationRequestToCoordinator(OperatorID operator, CoordinationRequest request) Delivers a coordination request to the OperatorCoordinator with the given OperatorID and returns the coordinator's response.
void	deliverOperatorEventToCoordinator(ExecutionAttemptID taskExecution, OperatorID operator, OperatorEvent evt) Delivers the given OperatorEvent to the OperatorCoordinator with the given OperatorID.
CompletableFuture<org.apache.flink.api.common.JobStatus>	getJobTerminationFuture()
void	handleGlobalFailure(Throwable cause)
void	notifyKvStateRegistered(org.apache.flink.api.common.JobID jobId, JobVertexID jobVertexId, KeyGroupRange keyGroupRange, String registrationName, org.apache.flink.queryablestate.KvStateID kvStateId, InetSocketAddress kvStateServerAddress)
void	notifyKvStateUnregistered(org.apache.flink.api.common.JobID jobId, JobVertexID jobVertexId, KeyGroupRange keyGroupRange, String registrationName)
void	notifyPartitionDataAvailable(ResultPartitionID partitionID)
void	reportCheckpointMetrics(org.apache.flink.api.common.JobID jobID, ExecutionAttemptID executionAttemptID, long checkpointId, CheckpointMetrics checkpointMetrics)
ExecutionGraphInfo	requestJob()
JobDetails	requestJobDetails()
org.apache.flink.api.common.JobStatus	requestJobStatus()
KvStateLocation	requestKvStateLocation(org.apache.flink.api.common.JobID jobId, String registrationName)
SerializedInputSplit	requestNextInputSplit(JobVertexID vertexID, ExecutionAttemptID executionAttempt)
ExecutionState	requestPartitionState(IntermediateDataSetID intermediateResultId, ResultPartitionID resultPartitionId)
void	startScheduling()
CompletableFuture<String>	stopWithSavepoint(String targetDirectory, boolean terminate)
CompletableFuture<String>	triggerSavepoint(String targetDirectory, boolean cancelJob)
void	updateAccumulators(AccumulatorSnapshot accumulatorSnapshot)
default boolean	updateTaskExecutionState(TaskExecutionState taskExecutionState)
boolean	updateTaskExecutionState(TaskExecutionStateTransition taskExecutionState)

Methods inherited from interface org.apache.flink.util.AutoCloseableAsync

close, closeAsync

Method Detail

startScheduling

void startScheduling()

cancel

void cancel()

getJobTerminationFuture

CompletableFuture<org.apache.flink.api.common.JobStatus> getJobTerminationFuture()

handleGlobalFailure

void handleGlobalFailure(Throwable cause)

updateTaskExecutionState

default boolean updateTaskExecutionState(TaskExecutionState taskExecutionState)

updateTaskExecutionState

boolean updateTaskExecutionState(TaskExecutionStateTransition taskExecutionState)

requestNextInputSplit

SerializedInputSplit requestNextInputSplit(JobVertexID vertexID,
                                           ExecutionAttemptID executionAttempt)
                                    throws IOException

Throws:

IOException

requestPartitionState

ExecutionState requestPartitionState(IntermediateDataSetID intermediateResultId,
                                     ResultPartitionID resultPartitionId)
                              throws PartitionProducerDisposedException

Throws:

PartitionProducerDisposedException

notifyPartitionDataAvailable

void notifyPartitionDataAvailable(ResultPartitionID partitionID)

requestJob

ExecutionGraphInfo requestJob()

requestJobStatus

org.apache.flink.api.common.JobStatus requestJobStatus()

requestJobDetails

JobDetails requestJobDetails()

requestKvStateLocation

KvStateLocation requestKvStateLocation(org.apache.flink.api.common.JobID jobId,
                                       String registrationName)
                                throws UnknownKvStateLocation,
                                       FlinkJobNotFoundException

Throws:

UnknownKvStateLocation

FlinkJobNotFoundException

notifyKvStateRegistered

void notifyKvStateRegistered(org.apache.flink.api.common.JobID jobId,
                             JobVertexID jobVertexId,
                             KeyGroupRange keyGroupRange,
                             String registrationName,
                             org.apache.flink.queryablestate.KvStateID kvStateId,
                             InetSocketAddress kvStateServerAddress)
                      throws FlinkJobNotFoundException

Throws:

FlinkJobNotFoundException

notifyKvStateUnregistered

void notifyKvStateUnregistered(org.apache.flink.api.common.JobID jobId,
                               JobVertexID jobVertexId,
                               KeyGroupRange keyGroupRange,
                               String registrationName)
                        throws FlinkJobNotFoundException

Throws:

FlinkJobNotFoundException

updateAccumulators

void updateAccumulators(AccumulatorSnapshot accumulatorSnapshot)

triggerSavepoint

CompletableFuture<String> triggerSavepoint(@Nullable
                                           String targetDirectory,
                                           boolean cancelJob)

acknowledgeCheckpoint

void acknowledgeCheckpoint(org.apache.flink.api.common.JobID jobID,
                           ExecutionAttemptID executionAttemptID,
                           long checkpointId,
                           CheckpointMetrics checkpointMetrics,
                           TaskStateSnapshot checkpointState)

reportCheckpointMetrics

void reportCheckpointMetrics(org.apache.flink.api.common.JobID jobID,
                             ExecutionAttemptID executionAttemptID,
                             long checkpointId,
                             CheckpointMetrics checkpointMetrics)

declineCheckpoint

void declineCheckpoint(DeclineCheckpoint decline)

stopWithSavepoint

CompletableFuture<String> stopWithSavepoint(String targetDirectory,
                                            boolean terminate)

deliverOperatorEventToCoordinator

void deliverOperatorEventToCoordinator(ExecutionAttemptID taskExecution,
                                       OperatorID operator,
                                       OperatorEvent evt)
                                throws org.apache.flink.util.FlinkException

Delivers the given OperatorEvent to the OperatorCoordinator with the given OperatorID.

Failure semantics: If the task manager sends an event for a non-running task or a non-existing operator coordinator, then respond with an exception to the call. If task and coordinator exist, then we assume that the call from the TaskManager was valid, and any bubbling exception needs to cause a job failure

Throws:

org.apache.flink.util.FlinkException - Thrown, if the task is not running or no operator/coordinator exists for the given ID.

deliverCoordinationRequestToCoordinator

CompletableFuture<CoordinationResponse> deliverCoordinationRequestToCoordinator(OperatorID operator,
                                                                                CoordinationRequest request)
                                                                         throws org.apache.flink.util.FlinkException

Delivers a coordination request to the OperatorCoordinator with the given OperatorID and returns the coordinator's response.

Returns:

A future containing the response.

Throws:

org.apache.flink.util.FlinkException - Thrown, if the task is not running, or no operator/coordinator exists for the given ID, or the coordinator cannot handle client events.