Index

A B C D E F G H I J L N O R S T Z
All Classes and Interfaces|All Packages|Constant Field Values

A

ai.djl.tensorrt.engine - package ai.djl.tensorrt.engine

Contains classes to interface with the underlying TensorRT Engine.

ai.djl.tensorrt.jni - package ai.djl.tensorrt.jni

Contains classes to interface with the underlying TensorRT Engine.

allocateDirect(int) - Method in class ai.djl.tensorrt.engine.TrtNDManager

B

bind(long, String, ByteBuffer) - Static method in class ai.djl.tensorrt.jni.JniUtils

C

close() - Method in class ai.djl.tensorrt.engine.TrtModel

close() - Method in class ai.djl.tensorrt.engine.TrtSession

close() - Method in class ai.djl.tensorrt.engine.TrtSymbolBlock

create(Buffer, Shape, DataType) - Method in class ai.djl.tensorrt.engine.TrtNDManager

createSession(long) - Static method in class ai.djl.tensorrt.jni.JniUtils

D

deleteSession(long) - Static method in class ai.djl.tensorrt.jni.JniUtils

deleteTrtModel(long) - Static method in class ai.djl.tensorrt.jni.JniUtils

detach() - Method in class ai.djl.tensorrt.engine.TrtNDArray

E

ENGINE_NAME - Static variable in class ai.djl.tensorrt.engine.TrtEngine

F

forwardInternal(ParameterStore, NDList, boolean, PairList<String, Object>) - Method in class ai.djl.tensorrt.engine.TrtSession

forwardInternal(ParameterStore, NDList, boolean, PairList<String, Object>) - Method in class ai.djl.tensorrt.engine.TrtSymbolBlock

from(NDArray) - Method in class ai.djl.tensorrt.engine.TrtNDManager

fromTrt(int) - Static method in class ai.djl.tensorrt.jni.JniUtils

G

getAlternativeEngine() - Method in class ai.djl.tensorrt.engine.TrtEngine

getDirectParameters() - Method in class ai.djl.tensorrt.engine.TrtSymbolBlock

getEngine() - Method in class ai.djl.tensorrt.engine.TrtEngineProvider

getEngine() - Method in class ai.djl.tensorrt.engine.TrtNDManager

getEngineName() - Method in class ai.djl.tensorrt.engine.TrtEngine

getEngineName() - Method in class ai.djl.tensorrt.engine.TrtEngineProvider

getEngineRank() - Method in class ai.djl.tensorrt.engine.TrtEngineProvider

getInputBindings() - Method in class ai.djl.tensorrt.engine.TrtSession

Returns the input NDList that bound to TensorRT engine.

getInputDataTypes(long) - Static method in class ai.djl.tensorrt.jni.JniUtils

getInputNames(long) - Static method in class ai.djl.tensorrt.jni.JniUtils

getOutputBindings() - Method in class ai.djl.tensorrt.engine.TrtSession

Returns the output NDList that bound to TensorRT engine.

getOutputDataTypes(long) - Static method in class ai.djl.tensorrt.jni.JniUtils

getOutputNames(long) - Static method in class ai.djl.tensorrt.jni.JniUtils

getOutputShapes(Shape[]) - Method in class ai.djl.tensorrt.engine.TrtSession

getRank() - Method in class ai.djl.tensorrt.engine.TrtEngine

getShape(long, String) - Static method in class ai.djl.tensorrt.jni.JniUtils

getTrtVersion() - Static method in class ai.djl.tensorrt.jni.JniUtils

getVersion() - Method in class ai.djl.tensorrt.engine.TrtEngine

H

hasCapability(String) - Method in class ai.djl.tensorrt.engine.TrtEngine

I

initPlugins(String) - Static method in class ai.djl.tensorrt.jni.JniUtils

intern(NDArray) - Method in class ai.djl.tensorrt.engine.TrtNDArray

J

JniUtils - Class in ai.djl.tensorrt.jni

A class containing utilities to interact with the PyTorch Engine's Java Native Interface (JNI) layer.

L

LibUtils - Class in ai.djl.tensorrt.jni

Utilities for finding the TensorRT Engine binary on the System.

load(Path, String, Map<String, ?>) - Method in class ai.djl.tensorrt.engine.TrtModel

loadLibrary() - Static method in class ai.djl.tensorrt.jni.LibUtils

loadModel(int, String, Device, Map<String, ?>) - Static method in class ai.djl.tensorrt.jni.JniUtils

N

newBaseManager() - Method in class ai.djl.tensorrt.engine.TrtEngine

newBaseManager(Device) - Method in class ai.djl.tensorrt.engine.TrtEngine

newModel(String, Device) - Method in class ai.djl.tensorrt.engine.TrtEngine

newPredictor(Translator<I, O>, Device) - Method in class ai.djl.tensorrt.engine.TrtModel

newSubManager(Device) - Method in class ai.djl.tensorrt.engine.TrtNDManager

O

ones(Shape, DataType) - Method in class ai.djl.tensorrt.engine.TrtNDManager

R

runTrtModel(long) - Static method in class ai.djl.tensorrt.jni.JniUtils

S

set(Buffer) - Method in class ai.djl.tensorrt.engine.TrtNDArray

T

toByteBuffer() - Method in class ai.djl.tensorrt.engine.TrtNDArray

toString() - Method in class ai.djl.tensorrt.engine.TrtEngine

TrtEngine - Class in ai.djl.tensorrt.engine

The TrtEngine is an implementation of the Engine based on the TensorRT.

TrtEngineProvider - Class in ai.djl.tensorrt.engine

TrtEngineProvider is the TensorRT implementation of EngineProvider.

TrtEngineProvider() - Constructor for class ai.djl.tensorrt.engine.TrtEngineProvider

TrtModel - Class in ai.djl.tensorrt.engine

TrtModel is the TensorRT implementation of Model.

TrtNDArray - Class in ai.djl.tensorrt.engine

TrtNDArray is the TensorRT implementation of NDArray.

TrtNDManager - Class in ai.djl.tensorrt.engine

TrtNDManager is the TensorRT implementation of NDManager.

TrtSession - Class in ai.djl.tensorrt.engine

TrtSession represents the TensorRT's execution context.

TrtSymbolBlock - Class in ai.djl.tensorrt.engine

TrtSymbolBlock is the TensorRT implementation of SymbolBlock.

TrtSymbolBlock(long) - Constructor for class ai.djl.tensorrt.engine.TrtSymbolBlock

Constructs a TrtSymbolBlock.

Z

zeros(Shape, DataType) - Method in class ai.djl.tensorrt.engine.TrtNDManager

A B C D E F G H I J L N O R S T Z
All Classes and Interfaces|All Packages|Constant Field Values