Package ai.djl.nn.transformer

package ai.djl.nn.transformer

Contains blocks for transformer models.

Related Packages

Package	Description
ai.djl.nn	Contains classes to construct neural networks.
ai.djl.nn.convolutional	Contains classes that define convolutional operations extending Convolution and Deconvolution.
ai.djl.nn.core	Contains classes that define simple neural network operations.
ai.djl.nn.norm	Contains classes that define normalizing neural network operations.
ai.djl.nn.pooling	Contains pooling neural network operations in Pool and helpers for it.
ai.djl.nn.recurrent	Contains classes for recurrent neural network operations.

Classes

Class	Description
BertBlock	Implements the core bert model (without next sentence and masked language task) of bert.
BertBlock.Builder	The Builder to construct a BertBlock type of Block.
BertMaskedLanguageModelBlock	Block for the bert masked language task.
BertMaskedLanguageModelLoss	The loss for the bert masked language model task.
BertNextSentenceBlock	Block to perform the Bert next-sentence-prediction task.
BertNextSentenceLoss	Calculates the loss for the next sentence prediction task.
BertPretrainingBlock	Creates a block that performs all bert pretraining tasks (next sentence and masked language).
BertPretrainingLoss	Loss that combines the next sentence and masked language losses of bert pretraining.
IdEmbedding	An Embedding from integer ids to float vectors.
IdEmbedding.Builder	The Builder to construct an IdEmbedding type of Block.
PointwiseFeedForwardBlock	Fully connected Feed-Forward network, only applied to the last dimension of the input.
ScaledDotProductAttentionBlock	A Block implementing scaled product attention according to Vaswani et.
ScaledDotProductAttentionBlock.Builder	A builder for ScaledDotProductAttentionBlocks.
TransformerEncoderBlock	Self-Attention based transformer encoder block.