Package org.apache.pulsar.functions.worker

Class SchedulerManager

java.lang.Object

org.apache.pulsar.functions.worker.SchedulerManager

All Implemented Interfaces:

AutoCloseable

public class SchedulerManager
extends Object
implements AutoCloseable

The scheduler manager is used to compute scheduling of function instances Only the leader computes new schedulings and writes assignments to the assignment topic The lifecyle of this class is the following: 1. When worker becomes leader, this class with be initialized 2. When worker loses leadership, this class will be closed which also closes the worker's producer to the assignments topic

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	SchedulerManager.DrainInProgressException
static class	SchedulerManager.RebalanceInProgressException
static class	SchedulerManager.TooFewWorkersException
static class	SchedulerManager.UnknownWorkerException
static class	SchedulerManager.WorkerNotRemovedAfterPriorDrainException

Field Summary

Fields

Modifier and Type	Field	Description
static final String	HEARTBEAT_NAMESPACE
static final String	HEARTBEAT_TENANT

Constructor Summary

Constructors

Constructor	Description
SchedulerManager(WorkerConfig workerConfig, org.apache.pulsar.client.api.PulsarClient pulsarClient, PulsarAdmin admin, WorkerStatsManager workerStatsManager, ErrorNotifier errorNotifier)

Method Summary

Modifier and Type	Method	Description
org.apache.pulsar.client.api.Producer<byte[]>	acquireExclusiveWrite(Supplier<Boolean> isLeader)	Acquires a exclusive producer.
void	close()
Future<?>	drainIfNotInProgress(String workerId)
LongRunningProcessStatus	getDrainStatus(String workerId)
void	initialize(org.apache.pulsar.client.api.Producer<byte[]> exclusiveProducer)
Future<?>	rebalanceIfNotInprogress()
Future<?>	schedule()
protected int	updateWorkerDrainMap()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

HEARTBEAT_TENANT

public static final String HEARTBEAT_TENANT

See Also:

• Constant Field Values

HEARTBEAT_NAMESPACE

public static final String HEARTBEAT_NAMESPACE

See Also:

• Constant Field Values

Constructor Details

SchedulerManager

public SchedulerManager(WorkerConfig workerConfig,
 org.apache.pulsar.client.api.PulsarClient pulsarClient,
 PulsarAdmin admin,
 WorkerStatsManager workerStatsManager,
 ErrorNotifier errorNotifier)

Method Details

acquireExclusiveWrite

public org.apache.pulsar.client.api.Producer<byte[]> acquireExclusiveWrite(Supplier<Boolean> isLeader)
                                                                    throws WorkerUtils.NotLeaderAnymore

Acquires a exclusive producer. This method cannot return null. It can only return a valid exclusive producer or throw NotLeaderAnymore exception.

Parameters:

isLeader - if the worker is still the leader

Returns:

A valid exclusive producer

Throws:

WorkerUtils.NotLeaderAnymore - if the worker is no longer the leader.

initialize

public void initialize(org.apache.pulsar.client.api.Producer<byte[]> exclusiveProducer)

schedule

public Future<?> schedule()

rebalanceIfNotInprogress

public Future<?> rebalanceIfNotInprogress()

drainIfNotInProgress

public Future<?> drainIfNotInProgress(String workerId)

getDrainStatus

public LongRunningProcessStatus getDrainStatus(String workerId)

updateWorkerDrainMap

protected int updateWorkerDrainMap()

close

public void close()

Specified by:

close in interface AutoCloseable