Compute mapping for x
Compute mapping for x
the input matrix. Before application, input should be summed already.
value of f(x)
Differentiate function at output value fx.
Differentiate function at output value fx.
Differentiation point vector, by output value.
Differentiation value of this function, generally squared matrix with same dimension.
Differentiate function at output value y.
Differentiate function at output value y.
Differentiation point vector, by output value.
Differentiation value of this function, generally squared matrix with same dimension.
Initialize the weight matrix
Initialize the weight matrix
the number of fan-in i.e. the number of neurons in previous layer
the number of fan-out i.e. the number of neurons in next layer
the initialized weight matrix
Activation Function: Sigmoid function
We assumed the input of activation is a row vector.