Package ai.djl.serving.wlm.util
package ai.djl.serving.wlm.util
Contains utilities to support the
WorkLoadManager
.-
ClassDescriptionClass to generate an unique worker id.A class manages model server events.An interface that represent a model server event listener.Base implementation of the
ModelServerListener
that does nothing.Thrown to throttle when a job is run but the job queue capacity is exceeded.This manages some configurations used by theWorkLoadManager
.Thrown when an exception occurs inside theWorkLoadManager
.Thrown when no enough memory to load the model.Thrown when a job is run but all workers are shutdown.WorkerJob<I,O> AJob
containing metadata from theWorkLoadManager
.