All Classes
-
All Classes Class Summary Enum Summary Exception Summary Class Description Job<I,O> A class represents an inference job.ModelInfo<I,O> A class represent a loaded model and it's metadata.ModelInfo.Status An enum represents state of a model.PermanentBatchAggregator<I,O> a batch aggregator that never terminates by itself.TemporaryBatchAggregator<I,O> a batch aggregator that terminates after a maximum idle time.WlmCapacityException Thrown to throttle when a job is run but the job queue capacity is exceeded.WlmConfigManager This manages some configurations used by theWorkLoadManager
.WlmException Thrown when an exception occurs inside theWorkLoadManager
.WlmShutdownException Thrown when a job is run but all workers are shutdown.WorkerIdGenerator class to generate an unique worker id.WorkerJob<I,O> AJob
containing metadata from theWorkLoadManager
.WorkerState An enum represents state of a worker.WorkerThread<I,O> TheWorkerThread
is the worker managed by theWorkLoadManager
.WorkerThread.Builder<I,O> A Builder to construct aWorkerThread
.WorkLoadManager WorkLoadManager is responsible to manage the work load of worker thread.