ai.djl.modality.nlp.translator

Class QaServingTranslator

java.lang.Object

ai.djl.modality.nlp.translator.QaServingTranslator

All Implemented Interfaces:

PostProcessor<Output>, PreProcessor<Input>, Translator<Input,Output>

public class QaServingTranslator
extends java.lang.Object
implements Translator<Input,Output>

A Translator that can handle generic question answering Input and Output.

Constructor Summary

Constructors

Constructor and Description
QaServingTranslator(Translator<QAInput,java.lang.String> translator) Constructs a QaServingTranslator instance.

Method Summary

Modifier and Type	Method and Description
Batchifier	getBatchifier() Gets the Batchifier.
void	prepare(TranslatorContext ctx) Prepares the translator with the manager and model to use.
NDList	processInput(TranslatorContext ctx, Input input) Processes the input and converts it to NDList.
Output	processOutput(TranslatorContext ctx, NDList list) Processes the output NDList to the corresponding output object.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

QaServingTranslator

public QaServingTranslator(Translator<QAInput,java.lang.String> translator)

Constructs a QaServingTranslator instance.

Parameters:

translator - a Translator processes question answering input

Method Detail

getBatchifier

public Batchifier getBatchifier()

Gets the Batchifier.

Specified by:

getBatchifier in interface Translator<Input,Output>

Returns:

the Batchifier

prepare

public void prepare(TranslatorContext ctx)
             throws java.lang.Exception

Prepares the translator with the manager and model to use.

Specified by:

prepare in interface Translator<Input,Output>

Parameters:

ctx - the context for the Predictor.

Throws:

java.lang.Exception - if there is an error for preparing the translator

processInput

public NDList processInput(TranslatorContext ctx,
                           Input input)
                    throws java.lang.Exception

Processes the input and converts it to NDList.

Specified by:

processInput in interface PreProcessor<Input>

Parameters:

ctx - the toolkit for creating the input NDArray

input - the input object

Returns:

the NDList after pre-processing

Throws:

java.lang.Exception - if an error occurs during processing input

processOutput

public Output processOutput(TranslatorContext ctx,
                            NDList list)
                     throws java.lang.Exception

Processes the output NDList to the corresponding output object.

Specified by:

processOutput in interface PostProcessor<Output>

Parameters:

ctx - the toolkit used for post-processing

list - the output NDList after inference

Returns:

the output object of expected type

Throws:

java.lang.Exception - if an error occurs during processing output