Package ai.djl.modality.nlp.generate
Contains utility classes for image manipulation.
-
Class Summary Class Description BatchTensorList BatchTensorList represents a search state, and the NDArrays inside are updated in each iteration of the autoregressive loop.CausalLMOutput CausalLMOuput is used to contain multiple output of a language model.ContrastiveSeqBatchScheduler ContrastiveSeqBatchScheduler
is a class which implements the contrastive search algorithm used in SeqBatchScheduler.SearchConfig SearchConfig
is a class whose fields are parameters used for autoregressive search / text generation.SeqBatcher SeqBatcher
stores the search state (BatchTensorList), the control variables (e.g.SeqBatchScheduler This is a scheduler, serving as an API to the consumer of the system, allowing for three major actions: initForward, addBatch, fastForward, collectResults.StepGeneration StepGeneration
is a utility class containing the step generation utility functions used in autoregressive search.TextGenerator TextGenerator
is an LMSearch (language model search) which contains multiple autoregressive search methods.