See: Description
Class | Description |
---|---|
BertFullTokenizer |
BertFullTokenizer runs end to end tokenization of input text
|
BertToken |
BertToken contains all the information for Bert model after encoding question and paragraph.
|
BertTokenizer |
BertTokenizer is a class to help you encode question and paragraph sentence.
|
WordpieceTokenizer |
WordpieceTokenizer tokenizes a piece of text into its word pieces.
|