learning rate
first moment coefficient
second moment coefficient
for numerical stability
learning rate decay
learning rate schedule
first moment coefficient
second moment coefficient
learning rate decay
for numerical stability
learning rate
An implementation of Adam http://arxiv.org/pdf/1412.6980.pdf
An implementation of Adam http://arxiv.org/pdf/1412.6980.pdf
a function that takes a single input (X), the point of a evaluation, and returns f(X) and df/dX
the initial point
the new x vector and the function list {fx}, evaluated before the update
learning rate schedule
(Since version 0.2.0) Please use clearHistory() instead
(Since version 0.2.0) Please initialize OptimMethod with parameters when creating it instead of importing table
An implementation of Adam http://arxiv.org/pdf/1412.6980.pdf with learning rate schedule.