A C D G H I L M N P R S W
All Classes All Packages

A

addEnv(String, String) - Method in class ai.djl.python.engine.PyEnv

Adds an environment variable.

addParameter(String, String) - Method in class ai.djl.python.engine.PyEnv

Adds a model initialization parameter.

ai.djl.python.engine - package ai.djl.python.engine

Contains classes to interface with the underlying Python worker.

C

close() - Method in class ai.djl.python.engine.PyModel

CodecUtils - Class in ai.djl.python.engine

This is a utility class for reading and writing to netty ByteBuf.

createVirtualEnv(String) - Method in class ai.djl.python.engine.PyEnv

Creates python virtual environment if needed.

D

deleteVirtualEnv(String) - Method in class ai.djl.python.engine.PyEnv

Deletes python virtual environment.

DsEngineProvider() - Constructor for class ai.djl.python.engine.MpiEngineProvider.DsEngineProvider

G

getAlternativeEngine() - Method in class ai.djl.python.engine.PyEngine

getEngine() - Method in class ai.djl.python.engine.PyEngineProvider

getEngineName() - Method in class ai.djl.python.engine.MpiEngineProvider.DsEngineProvider

getEngineName() - Method in class ai.djl.python.engine.MpiEngineProvider

getEngineName() - Method in class ai.djl.python.engine.PyEngine

getEngineName() - Method in class ai.djl.python.engine.PyEngineProvider

getEngineRank() - Method in class ai.djl.python.engine.MpiEngineProvider

getEngineRank() - Method in class ai.djl.python.engine.PyEngineProvider

getEntryPoint() - Method in class ai.djl.python.engine.PyEnv

Returns the model's entrypoint file path.

getHandler() - Method in class ai.djl.python.engine.PyEnv

Returns the python model's handler function.

getInitParameters() - Method in class ai.djl.python.engine.PyEnv

Returns the python model initialization parameters.

getModelLoadingTimeout() - Method in class ai.djl.python.engine.PyEnv

Returns the model loading timeout in seconds.

getPredictTimeout() - Method in class ai.djl.python.engine.PyEnv

Returns the prediction timeout in seconds.

getPythonExecutable() - Method in class ai.djl.python.engine.PyEnv

Returns the python executable path.

getRank() - Method in class ai.djl.python.engine.PyEngine

getTensorParallelDegree() - Method in class ai.djl.python.engine.PyEnv

Returns the tensor parallel degree.

getVersion() - Method in class ai.djl.python.engine.PyEngine

H

hasCapability(String) - Method in class ai.djl.python.engine.PyEngine

I

installDependency(Path) - Method in class ai.djl.python.engine.PyEnv

Installs model dependencies if needed.

isEnableVenv() - Method in class ai.djl.python.engine.PyEnv

Returns whether the python virtual environment is enabled.

isFailOnInitialize() - Method in class ai.djl.python.engine.PyEnv

Returns true to forcibly fail if initialize process in python failed.

L

load(Path, String, Map<String, ?>) - Method in class ai.djl.python.engine.PyModel

M

MAX_BUFFER_SIZE - Static variable in class ai.djl.python.engine.CodecUtils

MpiEngineProvider - Class in ai.djl.python.engine

DsEngineProvider is the DeepSpeed implementation of EngineProvider.

MpiEngineProvider() - Constructor for class ai.djl.python.engine.MpiEngineProvider

Constructs a new MpiEngineProvider instance.

MpiEngineProvider.DsEngineProvider - Class in ai.djl.python.engine

DsEngineProvider is the alias of MpiEngineProvider.

mpiMode - Variable in class ai.djl.python.engine.PyEngineProvider

N

newBaseManager() - Method in class ai.djl.python.engine.PyEngine

newBaseManager(Device) - Method in class ai.djl.python.engine.PyEngine

newModel(String, Device) - Method in class ai.djl.python.engine.PyEngine

newPredictor(Translator<I, O>, Device) - Method in class ai.djl.python.engine.PyModel

P

PyEngine - Class in ai.djl.python.engine

The PyEngine is an implementation of the Engine that runs Python worker.

PyEngineProvider - Class in ai.djl.python.engine

PyEngineProvider is the Python implementation of EngineProvider.

PyEngineProvider() - Constructor for class ai.djl.python.engine.PyEngineProvider

PyEnv - Class in ai.djl.python.engine

Python engine environment.

PyEnv(boolean) - Constructor for class ai.djl.python.engine.PyEnv

Constructs a new PyEnv instance.

PyModel - Class in ai.djl.python.engine

PyModel is the Python engine implementation of Model.

R

readBytes(ByteBuf, int) - Static method in class ai.djl.python.engine.CodecUtils

Reads the specified length of data.

readUtf8(ByteBuf) - Static method in class ai.djl.python.engine.CodecUtils

Read a String from the ByteBuf.

S

setEnableVenv(boolean) - Method in class ai.djl.python.engine.PyEnv

Sets whether to enable the python virtual environment.

setEntryPoint(String) - Method in class ai.djl.python.engine.PyEnv

Sets the model's entrypoint file path.

setFailOnInitialize(boolean) - Method in class ai.djl.python.engine.PyEnv

Enables to forcibly fail if initialize process in python failed.

setHandler(String) - Method in class ai.djl.python.engine.PyEnv

Sets the python model's handler function.

setModelLoadingTimeout(int) - Method in class ai.djl.python.engine.PyEnv

Sets the model loading timeout in seconds.

setPredictTimeout(int) - Method in class ai.djl.python.engine.PyEnv

Sets the prediction timeout in seconds.

setPythonExecutable(String) - Method in class ai.djl.python.engine.PyEnv

Sets the python executable path.

setTensorParallelDegree(int) - Method in class ai.djl.python.engine.PyEnv

Sets the tensor parallel degree.

W

writeUtf8(ByteBuf, String) - Static method in class ai.djl.python.engine.CodecUtils

Encode a String in UTF-8 and write it to the ByteBuf.

A C D G H I L M N P R S W
All Classes All Packages