| Interface | Description |
|---|---|
| IWeightInit |
| Class | Description |
|---|---|
| WeightInitConstant | |
| WeightInitDistribution | |
| WeightInitIdentity | |
| WeightInitLecunUniform |
Uniform U[-a,a] with a=3/sqrt(fanIn).
|
| WeightInitNormal |
Normal/Gaussian distribution, with mean 0 and standard deviation 1/sqrt(fanIn).
|
| WeightInitRelu | |
| WeightInitReluUniform | |
| WeightInitSigmoidUniform | |
| WeightInitUniform | |
| WeightInitUtil |
Weight initialization utility
|
| WeightInitVarScalingNormalFanAvg | |
| WeightInitVarScalingNormalFanIn | |
| WeightInitVarScalingNormalFanOut | |
| WeightInitVarScalingUniformFanAvg |
Uniform U[-a,a] with a=3.0/((fanIn + fanOut)/2)
|
| WeightInitVarScalingUniformFanIn | |
| WeightInitVarScalingUniformFanOut | |
| WeightInitXavier | |
| WeightInitXavierLegacy |
Xavier weight init in DL4J up to 0.6.0.
|
| WeightInitXavierUniform |
As per Glorot and Bengio 2010: Uniform distribution U(-s,s) with s = sqrt(6/(fanIn + fanOut))
|
| Enum | Description |
|---|---|
| WeightInit |
Copyright © 2022. All rights reserved.