Package ai.djl.inference

Class Predictor.PredictorContext

java.lang.Object

ai.djl.inference.Predictor.PredictorContext

All Implemented Interfaces:

TranslatorContext, AutoCloseable

Enclosing class:

Predictor<I,O>

public static final class Predictor.PredictorContext
extends Object
implements TranslatorContext

An implementation of TranslatorContext.

Constructor Summary

Constructors

Constructor	Description
PredictorContext(Model model, NDManager predictorManager, Metrics metrics)	Constructs a new PredictorContext instance.

Method Summary

Modifier and Type	Method	Description
void	close()
Object	getAttachment(String key)	Returns value of attached key-value pair to context.
Block	getBlock()	Returns the block from the TranslatorContext.
Metrics	getMetrics()	Returns the Metric tool to do benchmark.
Model	getModel()	Returns the Model object to understand the input/output.
NDManager	getNDManager()	Returns the NDManager to create NDArray.
NDManager	getPredictorManager()	Returns the Predictor's NDManager.
void	setAttachment(String key, Object value)	Set a key-value pair of attachments.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

PredictorContext

public PredictorContext(Model model,
 NDManager predictorManager,
 Metrics metrics)

Constructs a new PredictorContext instance.

Method Details

getModel

public Model getModel()

Returns the Model object to understand the input/output.

Specified by:

getModel in interface TranslatorContext

Returns:

the Model

getNDManager

public NDManager getNDManager()

Returns the NDManager to create NDArray.

Specified by:

getNDManager in interface TranslatorContext

Returns:

the NDManager

getPredictorManager

public NDManager getPredictorManager()

Returns the Predictor's NDManager.

Specified by:

getPredictorManager in interface TranslatorContext

Returns:

the Predictor's NDManager

getBlock

public Block getBlock()

Returns the block from the TranslatorContext.

Specified by:

getBlock in interface TranslatorContext

Returns:

the block from the TranslatorContext

getMetrics

public Metrics getMetrics()

Returns the Metric tool to do benchmark.

Specified by:

getMetrics in interface TranslatorContext

Returns:

the Metrics

close

public void close()

Specified by:

close in interface AutoCloseable

Specified by:

close in interface TranslatorContext

getAttachment

public Object getAttachment(String key)

Returns value of attached key-value pair to context.

Specified by:

getAttachment in interface TranslatorContext

Parameters:

key - key of attached value

Returns:

the object stored in relevant map

setAttachment

public void setAttachment(String key,
 Object value)

Set a key-value pair of attachments.

Specified by:

setAttachment in interface TranslatorContext

Parameters:

key - key of attached value

value - value assosicated with key