Package ai.djl.serving.wlm.util

package ai.djl.serving.wlm.util

Contains utilities to support the WorkLoadManager.

Related Packages

Package	Description
ai.djl.serving.wlm	Contains the model server backend which manages worker threads and executes jobs on models.

Class	Description
AutoIncIdGenerator	Class to generate an unique worker id.
EventManager	A class manages model server events.
ModelServerListener	An interface that represent a model server event listener.
ModelServerListenerAdapter	Base implementation of the ModelServerListener that does nothing.
WlmCapacityException	Thrown to throttle when a job is run but the job queue capacity is exceeded.
WlmConfigManager	This manages some configurations used by the WorkLoadManager.
WlmException	Thrown when an exception occurs inside the WorkLoadManager.
WlmOutOfMemoryException	Thrown when no enough memory to load the model.
WlmShutdownException	Thrown when a job is run but all workers are shutdown.
WorkerJob<I,O>	A Job containing metadata from the WorkLoadManager.