Represent an accuracy result.
An implementation of Adagrad.
An implementation of Adagrad. See the original paper: http://jmlr.org/papers/volume12/duchi11a/duchi11a.pdf
numeric type
The optimizer run on a distributed cluster.
Validate model on a distributed cluster.
This implementation of L-BFGS relies on a user-provided line search function (state.lineSearch).
This implementation of L-BFGS relies on a user-provided line search function (state.lineSearch). If this function is not provided, then a simple learningRate is used to produce fixed size steps. Fixed size steps are much less costly than line searches, and can be useful for stochastic problems.
The learning rate is used even when a line search is provided. This is also useful for large-scale stochastic problems, where opfunc is a noisy approximation of f(x). In that case, the learning rate allows a reduction of confidence in the step size.
Line Search strategy
Optimize a model on a single machine
Validate a model on a single machine
Use given dataset with certain validation methods such as Top1Accuracy
as an argument of its test
method
This evaluation method is calculate loss of output with respect to target
Use loss as a validation result
Performance metrics for the training process.
Performance metrics for the training process. Beyond collect local metrics(e.g. throughput) in driver node, it can also be used to collect distributed metrics (e.g. time of some steps among the workers). The is useful for performance analysis.
Similar to torch Optim method, which is used to update the parameter
Optimizer is an abstract class which is used to train a model automatically with some certain optimization algorithms.
Optimizer is an abstract class which is used to train a model automatically with some certain optimization algorithms.
numeric type, which can be Float or Double
the type of elements in DataSet, such as MiniBatch
A plain implementation of SGD
A plain implementation of SGD
data type
Caculate the percentage that output's max probability index equals target
Caculate the percentage that target in output's top5 probability indexes
A trigger specifies a timespot or several timespots during training, and a corresponding action will be taken when the timespot(s) is reached.
A method defined to evaluate the model.
A method defined to evaluate the model. This trait can be extended by user-defined method. Such as Top1Accuracy
A result that calculate the numeric value of a validation method.
A result that calculate the numeric value of a validation method. User-defined valuation results must override the + operation and result() method. It is executed over the samples in each batch.
Validator is an abstract class which is used to test a model automatically
with some certain validation methods such as Top1Accuracy, as an argument of
its test
method.
Validator is an abstract class which is used to test a model automatically
with some certain validation methods such as Top1Accuracy, as an argument of
its test
method.
numeric type, which can be Float or Double
the type of elements in DataSet, such as MiniBatch
Represent an accuracy result. Accuracy means a ratio of correct number and total number.