Package ai.djl.modality.nlp.bert

Contains classes that deal with BERT for natural language pre-processing tasks.

Class Summary

Class	Description
BertFullTokenizer	BertFullTokenizer runs end to end tokenization of input text
BertToken	BertToken contains all the information for Bert model after encoding question and paragraph.
BertTokenizer	BertTokenizer is a class to help you encode question and paragraph sentence.
WordpieceTokenizer	WordpieceTokenizer tokenizes a piece of text into its word pieces.