Compute mapping for x
Compute mapping for x
the input matrix. Before application, input should be summed already.
value of f(x)
Differentiate function at output value fx.
Differentiate function at output value fx.
Differentiation point vector, by output value.
Differentiation value of this function, generally squared matrix with same dimension.
Differentiate function at output value y.
Differentiate function at output value y.
Differentiation point vector, by output value.
Differentiation value of this function, generally squared matrix with same dimension.
Initialization range of weight
Initialization range of weight
the number of fan-in i.e. the number of neurons in previous layer
the number of fan-out i.e. the number of neurons in next layer
the initialized range of weight
Activation Function: Rectifier
rectifier(x) = x if x > 0, otherwise 0
We assumed the input of activation is a row vector.