DJL Serving 0.22.1 - serving
This document is the API specification for the Deep Java Library (DJL) Serving.
The DJL serving module is a standalone web service that can serve models with REST API. See here for more details.
| Package | Description |
|---|---|
| ai.djl.serving |
Contains a model server implementation.
|
| ai.djl.serving.cache |
Contains classes that handles response caching.
|
| ai.djl.serving.http |
Contains classes that handles REST API calls.
|
| ai.djl.serving.models |
Contains classes that manage model lifecycle.
|
| ai.djl.serving.plugins |
Contains plugin manager implementation of the model server.
|
| ai.djl.serving.util |
Contains utilities used by model server.
|
| ai.djl.serving.workflow |
Contains the
Workflow for managing a model execution flow. |
| ai.djl.serving.workflow.function |
Contains the
WorkflowFunction and various built-in
functions. |