Class LearnedSelfAttentionLayer.Builder
- java.lang.Object
-
- org.deeplearning4j.nn.conf.layers.Layer.Builder<T>
-
- org.deeplearning4j.nn.conf.layers.samediff.AbstractSameDiffLayer.Builder<T>
-
- org.deeplearning4j.nn.conf.layers.samediff.SameDiffLayer.Builder<LearnedSelfAttentionLayer.Builder>
-
- org.deeplearning4j.nn.conf.layers.LearnedSelfAttentionLayer.Builder
-
- Enclosing class:
- LearnedSelfAttentionLayer
public static class LearnedSelfAttentionLayer.Builder extends SameDiffLayer.Builder<LearnedSelfAttentionLayer.Builder>
-
-
Field Summary
-
Fields inherited from class org.deeplearning4j.nn.conf.layers.samediff.SameDiffLayer.Builder
paramWeightInit, weightInit
-
Fields inherited from class org.deeplearning4j.nn.conf.layers.samediff.AbstractSameDiffLayer.Builder
biasUpdater, regularization, regularizationBias, updater
-
Fields inherited from class org.deeplearning4j.nn.conf.layers.Layer.Builder
allParamConstraints, biasConstraints, iDropout, layerName, weightConstraints
-
-
Constructor Summary
Constructors Constructor Description Builder()
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description LearnedSelfAttentionLayer
build()
LearnedSelfAttentionLayer.Builder
headSize(int headSize)
Size of attention headsLearnedSelfAttentionLayer.Builder
nHeads(int nHeads)
Number of Attention HeadsLearnedSelfAttentionLayer.Builder
nIn(int nIn)
LearnedSelfAttentionLayer.Builder
nOut(int nOut)
LearnedSelfAttentionLayer.Builder
nQueries(int nQueries)
Number of queries to learnLearnedSelfAttentionLayer.Builder
projectInput(boolean projectInput)
Project input before applying attention or not.-
Methods inherited from class org.deeplearning4j.nn.conf.layers.samediff.SameDiffLayer.Builder
weightInit, weightInit
-
Methods inherited from class org.deeplearning4j.nn.conf.layers.samediff.AbstractSameDiffLayer.Builder
biasUpdater, l1, l1Bias, l2, l2Bias, regularization, regularizationBias, updater, weightDecay, weightDecay, weightDecayBias, weightDecayBias
-
Methods inherited from class org.deeplearning4j.nn.conf.layers.Layer.Builder
constrainAllParameters, constrainBias, constrainWeights, dropOut, dropOut, name
-
-
-
-
Method Detail
-
nIn
public LearnedSelfAttentionLayer.Builder nIn(int nIn)
- Parameters:
nIn
- Number of inputs to the layer (input size)
-
nOut
public LearnedSelfAttentionLayer.Builder nOut(int nOut)
- Parameters:
nOut
- Number of outputs (output size)
-
nHeads
public LearnedSelfAttentionLayer.Builder nHeads(int nHeads)
Number of Attention Heads
-
headSize
public LearnedSelfAttentionLayer.Builder headSize(int headSize)
Size of attention heads
-
projectInput
public LearnedSelfAttentionLayer.Builder projectInput(boolean projectInput)
Project input before applying attention or not.
-
nQueries
public LearnedSelfAttentionLayer.Builder nQueries(int nQueries)
Number of queries to learn
-
build
public LearnedSelfAttentionLayer build()
- Specified by:
build
in classLayer.Builder<LearnedSelfAttentionLayer.Builder>
-
-