Package ai.djl.serving.wlm
Class WorkLoadManager.WorkerPool.WorkerPoolDevice
- java.lang.Object
-
- ai.djl.serving.wlm.WorkLoadManager.WorkerPool.WorkerPoolDevice
-
- Enclosing class:
- WorkLoadManager.WorkerPool<I,O>
public final class WorkLoadManager.WorkerPool.WorkerPoolDevice extends java.lang.Object
TheWorkLoadManager.WorkerPool.WorkerPoolDevice
manages theWorkLoadManager.WorkerPool
for a particularDevice
.
-
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description int
getMaxWorkers()
Returns the max number of workers for the model and device.int
getMinWorkers()
Returns the min number of workers for the model and device.
-
-
-
Method Detail
-
getMinWorkers
public int getMinWorkers()
Returns the min number of workers for the model and device.- Returns:
- the min number of workers for the model and device
-
getMaxWorkers
public int getMaxWorkers()
Returns the max number of workers for the model and device.- Returns:
- the max number of workers for the model and device
-
-