Package ai.djl.modality.nlp.bert

package ai.djl.modality.nlp.bert

Contains classes that deal with BERT for natural language pre-processing tasks.

Related Packages

Package	Description
ai.djl.modality.nlp	Contains utility classes for natural language processing tasks.
ai.djl.modality.nlp.embedding	Contains classes that deal with word embeddings for natural language pre-processing tasks.
ai.djl.modality.nlp.generate	Contains utility classes for image manipulation.
ai.djl.modality.nlp.preprocess	Contains utility classes for natural language pre-processing tasks.
ai.djl.modality.nlp.qa	Contains utility classes for question and answer processing.
ai.djl.modality.nlp.translator	Contains utility classes for each of the predefined translator.

Classes

Class	Description
BertFullTokenizer	BertFullTokenizer runs end to end tokenization of input text
BertToken	BertToken contains all the information for Bert model after encoding question and paragraph.
BertTokenizer	BertTokenizer is a class to help you encode question and paragraph sentence.
WordpieceTokenizer	WordpieceTokenizer tokenizes a piece of text into its word pieces.