Package org.nd4j.linalg.learning.config

Interface Summary

Interface	Description
IUpdater	IUpdater interface: used for configuration and instantiation of updaters - both built-in and custom. Note that the actual implementations for updaters are in GradientUpdater

Class Summary

Class	Description
AdaDelta	https://www.matthewzeiler.com/mattzeiler/adadelta.pdf https://arxiv.org/pdf/1212.5701v1.pdf
AdaDelta.Builder
AdaGrad	Vectorized Learning Rate used per Connection Weight Adapted from: http://xcorr.net/2014/01/23/adagrad-eliminating-learning-rates-in-stochastic-gradient-descent/ See also http://cs231n.github.io/neural-networks-3/#ada
AdaGrad.Builder
Adam	The Adam updater.
Adam.Builder
AdaMax	The AdaMax updater, a variant of Adam.
AdaMax.Builder
AMSGrad	The AMSGrad updater Reference: On the Convergence of Adam and Beyond - https://openreview.net/forum?id=ryQu7f-RZ
AMSGrad.Builder
Nadam	Setup and DynamicCustomOpsBuilder for Nadam updater.
Nadam.Builder
Nesterovs	Nesterov's momentum.
Nesterovs.Builder
NoOp	NoOp updater: gradient updater that makes no changes to the gradient
RmsProp	RMS Prop updates:
RmsProp.Builder
Sgd	SGD updater applies a learning rate only
Sgd.Builder