Interface | Description |
---|---|
GradientUpdater |
Gradient modifications:
Calculates an update and tracks related
information for gradient changes over time
for handling updates.
|
Class | Description |
---|---|
AdaDelta |
http://www.matthewzeiler.com/pubs/googleTR2012/googleTR2012.pdf
Ada delta updater.
|
AdaGrad |
Vectorized Learning Rate used per Connection Weight
Adapted from: http://xcorr.net/2014/01/23/adagrad-eliminating-learning-rates-in-stochastic-gradient-descent/
|
Adam |
The Adam updater.
|
Nesterovs |
Nesterov's momentum.
|
RmsPropUpdater |
RMS Prop updates:
http://www.cs.toronto.edu/~tijmen/csc321/slides/lecture_slides_lec6.pdf
http://cs231n.github.io/neural-networks-3/#ada
|
SgdUpdater |
Copyright © 2015. All Rights Reserved.