Package ai.djl.modality.nlp.preprocess
Class LambdaProcessor
- java.lang.Object
-
- ai.djl.modality.nlp.preprocess.LambdaProcessor
-
- All Implemented Interfaces:
TextProcessor
public class LambdaProcessor extends java.lang.Object implements TextProcessor
TextProcessor
will apply user defined lambda function on input tokens.The function can only support single input and output.
-
-
Constructor Summary
Constructors Constructor Description LambdaProcessor(java.util.function.Function<java.lang.String,java.lang.String> processor)
Creates aLambdaProcessor
and specify the function to apply.
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description java.util.List<java.lang.String>
preprocess(java.util.List<java.lang.String> tokens)
Applies the preprocessing defined to the given input tokens.
-
-
-
Method Detail
-
preprocess
public java.util.List<java.lang.String> preprocess(java.util.List<java.lang.String> tokens)
Applies the preprocessing defined to the given input tokens.- Specified by:
preprocess
in interfaceTextProcessor
- Parameters:
tokens
- the tokens created after the input text is tokenized- Returns:
- the preprocessed tokens
-
-