Package ai.djl.modality.nlp.translator
Class TextEmbeddingServingTranslator
- java.lang.Object
-
- ai.djl.modality.nlp.translator.TextEmbeddingServingTranslator
-
- All Implemented Interfaces:
PostProcessor<Output>
,PreProcessor<Input>
,Translator<Input,Output>
public class TextEmbeddingServingTranslator extends java.lang.Object implements Translator<Input,Output>
-
-
Constructor Summary
Constructors Constructor Description TextEmbeddingServingTranslator(Translator<java.lang.String,float[]> translator)
Constructs aTextEmbeddingServingTranslator
instance.
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description Batchifier
getBatchifier()
Gets theBatchifier
.void
prepare(TranslatorContext ctx)
Prepares the translator with the manager and model to use.NDList
processInput(TranslatorContext ctx, Input input)
Processes the input and converts it to NDList.Output
processOutput(TranslatorContext ctx, NDList list)
Processes the output NDList to the corresponding output object.
-
-
-
Constructor Detail
-
TextEmbeddingServingTranslator
public TextEmbeddingServingTranslator(Translator<java.lang.String,float[]> translator)
Constructs aTextEmbeddingServingTranslator
instance.- Parameters:
translator
- aTranslator
processes text embedding input
-
-
Method Detail
-
getBatchifier
public Batchifier getBatchifier()
Gets theBatchifier
.- Specified by:
getBatchifier
in interfaceTranslator<Input,Output>
- Returns:
- the
Batchifier
-
prepare
public void prepare(TranslatorContext ctx) throws java.lang.Exception
Prepares the translator with the manager and model to use.- Specified by:
prepare
in interfaceTranslator<Input,Output>
- Parameters:
ctx
- the context for thePredictor
.- Throws:
java.lang.Exception
- if there is an error for preparing the translator
-
processInput
public NDList processInput(TranslatorContext ctx, Input input) throws java.lang.Exception
Processes the input and converts it to NDList.- Specified by:
processInput
in interfacePreProcessor<Input>
- Parameters:
ctx
- the toolkit for creating the input NDArrayinput
- the input object- Returns:
- the
NDList
after pre-processing - Throws:
java.lang.Exception
- if an error occurs during processing input
-
processOutput
public Output processOutput(TranslatorContext ctx, NDList list) throws java.lang.Exception
Processes the output NDList to the corresponding output object.- Specified by:
processOutput
in interfacePostProcessor<Output>
- Parameters:
ctx
- the toolkit used for post-processinglist
- the output NDList after inference, usually immutable in engines like PyTorch. @see Issue 1774- Returns:
- the output object of expected type
- Throws:
java.lang.Exception
- if an error occurs during processing output
-
-