Package | Description |
---|---|
org.nd4j.autodiff.samediff | |
org.nd4j.linalg.api.ops.impl.layers | |
org.nd4j.weightinit | |
org.nd4j.weightinit.impl |
Modifier and Type | Field and Description |
---|---|
protected WeightInitScheme |
SDVariable.weightInitScheme |
Modifier and Type | Method and Description |
---|---|
SDVariable |
SameDiff.var(String name,
int[] shape,
WeightInitScheme weightInitScheme)
Variable initialization
with a specified
WeightInitScheme |
Constructor and Description |
---|
Linear(int nIn,
int nOut,
WeightInitScheme weightInitScheme,
WeightInitScheme biasWeightInitScheme) |
Linear(SameDiff sameDiff,
int nIn,
int nOut,
WeightInitScheme weightInitScheme,
WeightInitScheme biasWeightInitScheme) |
Modifier and Type | Class and Description |
---|---|
class |
BaseWeightInitScheme
Abstract class for
WeightInitScheme
This handles boilerplate like delegating to the parameters view. |
Modifier and Type | Class and Description |
---|---|
class |
ConstantInitScheme
Initialize the weight to zero.
|
class |
DistributionInitScheme
Initialize the weights based on a given
Distribution |
class |
IdentityInitScheme
Initialize the weight to one.
|
class |
LecunUniformInitScheme
Initialize the weight to:
randn(shape) //N(0, 2/nIn);
|
class |
NDArraySupplierInitScheme |
class |
OneInitScheme
Initialize the weight to one.
|
class |
ReluInitScheme
Initialize the weight to:
randn(shape) //N(0, 2/nIn);
|
class |
ReluUniformInitScheme
Initialize the weight to:
U(-sqrt(6/fanIn), sqrt(6/fanIn)
|
class |
SigmoidUniformInitScheme
Initialize the weight to:
range = 4.0 * Math.sqrt(6.0 / (fanIn + fanOut))
U(-range,range)
|
class |
UniformInitScheme
Initialize the weight to:
range = 1.0 / Math.sqrt(fanIn)
U(-range,range)
|
class |
VarScalingNormalFanAvgInitScheme
Initialize the weight to:
U / sqrt((fanin _ fanout) / 2)
|
class |
VarScalingNormalFanInInitScheme
Initialize the weight to:
U / fanIn
|
class |
VarScalingNormalFanOutInitScheme
Initialize the weight to:
U / sqrt(fanout)
|
class |
VarScalingNormalUniformFanInInitScheme
Initialize the weight to:
range = = 3.0 / Math.sqrt(fanIn)
U(-range,range)
|
class |
VarScalingNormalUniformFanOutInitScheme
Initialize the weight to:
randn(shape) //N(0, 2/nIn);
|
class |
VarScalingUniformFanAvgInitScheme
Initialize the weight to:
range = = 3.0 / Math.sqrt((fanIn + fanOut) / 2)
U(-range,range)
|
class |
XavierFanInInitScheme
Initialize the weight to:
randn(shape) //N(0, 2/nIn);
|
class |
XavierInitScheme
Initialize the weight to:
range = = U * sqrt(2.0 / (fanIn + fanOut)
|
class |
XavierUniformInitScheme
Initialize the weight to:
//As per Glorot and Bengio 2010: Uniform distribution U(-s,s) with s = sqrt(6/(fanIn + fanOut))
Eq 16: http://jmlr.org/proceedings/papers/v9/glorot10a/glorot10a.pdf
|
class |
ZeroInitScheme
Initialize the weight to zero.
|
Copyright © 2018. All rights reserved.