Package ai.djl.training.tracker
Contains classes for having a gradually changing hyper-parameter.
It contains a main interface Tracker
and various options that
extend it.
-
Interface Summary Interface Description CyclicalTracker.ScaleFunction ScaleFunction
is an interface to implement a custom scale function.ParameterTracker ATracker
represents a collection of hyperparameters orTracker
s that changes gradually through the training process.Tracker ATracker
represents a hyperparameter that changes gradually through the training process. -
Class Summary Class Description CosineTracker CosineTracker
is an implementation ofTracker
which is updated by taking sections of a cosine curve to smoothly reduce learning rate until a specified step and base learning rate.CosineTracker.Builder The Builder to construct anCosineTracker
object.CyclicalTracker CyclicalTracker
is an implementation ofTracker
which is a policy of learning rate adjustment that increases the learning rate off a base value in a cyclical nature, as detailed in the paper Cyclical Learning Rates for Training Neural Networks.CyclicalTracker.Builder The Builder to construct anCyclicalTracker
object.FactorTracker FactorTracker
is an implementation ofTracker
which is updated by a multiplicative factor.FactorTracker.Builder The Builder to construct anFactorTracker
object.FixedPerVarTracker FixedPerVarTracker
is an implementation ofTracker
which returns a fixed value.FixedPerVarTracker.Builder The Builder to construct anFixedPerVarTracker
object.LinearTracker FactorTracker
is an implementation ofTracker
which is updated by a constant factor.LinearTracker.Builder The Builder to construct anLinearTracker
object.MultiFactorTracker MultiFactorTracker
is an implementation ofTracker
which returns piecewise constant values for fixed numbers of steps.MultiFactorTracker.Builder The Builder to construct anMultiFactorTracker
object.PolynomialDecayTracker Polynomial decayTracker
.PolynomialDecayTracker.Builder Builder for PolynomialDecayTracker.WarmUpTracker AWarmUpTracker
applies a simple warm-up before executing a mainTracker
.WarmUpTracker.Builder The Builder to construct aWarmUpTracker
. -
Enum Summary Enum Description CyclicalTracker.CyclicalMode CyclicalTracker
provides three predefined cyclical modes and can be selected by this enum.WarmUpTracker.Mode An enum that enumerates the types of warm-up modes for aWarmUpTracker
.