Interface | Description |
---|---|
NDArraySupplierInitScheme.NDArraySupplier |
A simple
facade |
Class | Description |
---|---|
ConstantInitScheme |
Initialize the weight to zero.
|
DistributionInitScheme |
Initialize the weights based on a given
Distribution |
IdentityInitScheme |
Initialize the weight to one.
|
LecunUniformInitScheme |
Initialize the weight to:
randn(shape) //N(0, 2/nIn);
|
NDArraySupplierInitScheme | |
OneInitScheme |
Initialize the weight to one.
|
ReluInitScheme |
Initialize the weight to:
randn(shape) //N(0, 2/nIn);
|
ReluUniformInitScheme |
Initialize the weight to:
U(-sqrt(6/fanIn), sqrt(6/fanIn)
|
SigmoidUniformInitScheme |
Initialize the weight to:
range = 4.0 * Math.sqrt(6.0 / (fanIn + fanOut))
U(-range,range)
|
UniformInitScheme |
Initialize the weight to:
range = 1.0 / Math.sqrt(fanIn)
U(-range,range)
|
VarScalingNormalFanAvgInitScheme |
Initialize the weight to:
U / sqrt((fanin _ fanout) / 2)
|
VarScalingNormalFanInInitScheme |
Initialize the weight to:
U / fanIn
|
VarScalingNormalFanOutInitScheme |
Initialize the weight to:
U / sqrt(fanout)
|
VarScalingNormalUniformFanInInitScheme |
Initialize the weight to:
range = = 3.0 / Math.sqrt(fanIn)
U(-range,range)
|
VarScalingNormalUniformFanOutInitScheme |
Initialize the weight to:
randn(shape) //N(0, 2/nIn);
|
VarScalingUniformFanAvgInitScheme |
Initialize the weight to:
range = = 3.0 / Math.sqrt((fanIn + fanOut) / 2)
U(-range,range)
|
XavierFanInInitScheme |
Initialize the weight to:
randn(shape) //N(0, 2/nIn);
|
XavierInitScheme |
Initialize the weight to:
range = = U * sqrt(2.0 / (fanIn + fanOut)
|
XavierUniformInitScheme |
Initialize the weight to:
//As per Glorot and Bengio 2010: Uniform distribution U(-s,s) with s = sqrt(6/(fanIn + fanOut))
Eq 16: http://jmlr.org/proceedings/papers/v9/glorot10a/glorot10a.pdf
|
ZeroInitScheme |
Initialize the weight to zero.
|
Copyright © 2019. All rights reserved.