Clear the history information in the state
Clear the history information in the state
return an string of current hyperParameter.
return an string of current hyperParameter.
a table contains the hyper parameter.
a function that takes a single input (X), the point of a evaluation, and returns f(X) and df/dX
the initial point
a table with configuration parameters for the optimizer learningRate: learning rate learningRateDecay: learning rate decay weightDecay: weight decay weightDecays: 1D tensor of individual weight decays momentum: momentum dampening: dampening for momentum nesterov: enables Nesterov momentum learningRates: 1D tensor of individual learning rates
a table describing the state of the optimizer; after each call the state is modified
the new x 1D tensor and the function list, evaluated before the update
Update hyper parameter.
Update hyper parameter. We have updated hyper parameter in method optimize(). But in DistriOptimizer, the method optimize() is only called on the executor side, the driver's hyper parameter is unchanged. So this method is using to update hyper parameter on the driver side.
config table.
state Table.
A string.
A plain implementation of SGD
data type