Package org.apache.flink.runtime.scheduler.adaptivebatch

Class DefaultAdaptiveExecutionHandler

java.lang.Object

org.apache.flink.runtime.scheduler.adaptivebatch.DefaultAdaptiveExecutionHandler

All Implemented Interfaces:

AdaptiveExecutionHandler

public class DefaultAdaptiveExecutionHandler
extends Object
implements AdaptiveExecutionHandler

The DefaultAdaptiveExecutionHandler implements the AdaptiveExecutionHandler interface to provide an incrementally generated job graph.

This handler can modify the execution plan before downstream job vertices are created, allowing for flexibility and adaptability during runtime.

Constructor Summary

Constructors

Constructor	Description
DefaultAdaptiveExecutionHandler(ClassLoader userClassloader, StreamGraph streamGraph, Executor serializationExecutor)

Method Summary

Modifier and Type	Method	Description
ExecutionPlanSchedulingContext	createExecutionPlanSchedulingContext(int defaultMaxParallelism)	Creates an instance of ExecutionPlanSchedulingContext.
int	getInitialParallelism(JobVertexID jobVertexId)	Retrieves the initial parallelism for a given JobVertex ID.
JobGraph	getJobGraph()	Returns the JobGraph representing the batch job.
void	handleJobEvent(JobEvent jobEvent)	Handles the provided JobEvent, attempting dynamic modifications to the StreamGraph based on the specifics of the job event.
void	notifyJobVertexParallelismDecided(JobVertexID jobVertexId, int parallelism)	Notifies the handler that the parallelism of a JobVertex has been decided.
void	registerJobGraphUpdateListener(JobGraphUpdateListener listener)	Registers a listener to receive updates when the JobGraph is modified.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DefaultAdaptiveExecutionHandler

public DefaultAdaptiveExecutionHandler(ClassLoader userClassloader,
                                       StreamGraph streamGraph,
                                       Executor serializationExecutor)
                                throws org.apache.flink.util.DynamicCodeLoadingException

Throws:

org.apache.flink.util.DynamicCodeLoadingException

Method Detail

getJobGraph

public JobGraph getJobGraph()

Description copied from interface: AdaptiveExecutionHandler

Returns the JobGraph representing the batch job.

Specified by:

getJobGraph in interface AdaptiveExecutionHandler

Returns:

the JobGraph.

handleJobEvent

public void handleJobEvent(JobEvent jobEvent)

Description copied from interface: AdaptiveExecutionHandler

Handles the provided JobEvent, attempting dynamic modifications to the StreamGraph based on the specifics of the job event.

Specified by:

handleJobEvent in interface AdaptiveExecutionHandler

Parameters:

jobEvent - The job event to handle. This event contains the necessary information that might trigger adjustments to the StreamGraph.

registerJobGraphUpdateListener

public void registerJobGraphUpdateListener(JobGraphUpdateListener listener)

Description copied from interface: AdaptiveExecutionHandler

Registers a listener to receive updates when the JobGraph is modified.

Specified by:

registerJobGraphUpdateListener in interface AdaptiveExecutionHandler

Parameters:

listener - the listener to register for JobGraph updates.

getInitialParallelism

public int getInitialParallelism(JobVertexID jobVertexId)

Description copied from interface: AdaptiveExecutionHandler

Retrieves the initial parallelism for a given JobVertex ID.

Specified by:

getInitialParallelism in interface AdaptiveExecutionHandler

Parameters:

jobVertexId - the JobVertex ID.

Returns:

the corresponding initial parallelism.

notifyJobVertexParallelismDecided

public void notifyJobVertexParallelismDecided(JobVertexID jobVertexId,
                                              int parallelism)

Description copied from interface: AdaptiveExecutionHandler

Notifies the handler that the parallelism of a JobVertex has been decided.

Specified by:

notifyJobVertexParallelismDecided in interface AdaptiveExecutionHandler

Parameters:

jobVertexId - the identifier of the JobVertex whose parallelism was decided.

parallelism - the decided parallelism of the JobVertex.

createExecutionPlanSchedulingContext

public ExecutionPlanSchedulingContext createExecutionPlanSchedulingContext(int defaultMaxParallelism)

Description copied from interface: AdaptiveExecutionHandler

Creates an instance of ExecutionPlanSchedulingContext.

Specified by:

createExecutionPlanSchedulingContext in interface AdaptiveExecutionHandler

Parameters:

defaultMaxParallelism - the default value for maximum parallelism.

Returns:

an instance of ExecutionPlanSchedulingContext.