org.nd4j.linalg.learning.config

Class Nadam

java.lang.Object

org.nd4j.linalg.learning.config.Nadam

All Implemented Interfaces:

Serializable, Cloneable, IUpdater

public class Nadam
extends Object
implements IUpdater

Setup and Builder for Nadam updater. https://arxiv.org/pdf/1609.04747.pdf

Author:

Andrey Spiridonov

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	Nadam.Builder

Field Summary

Fields

Modifier and Type	Field and Description
static double	DEFAULT_NADAM_BETA1_MEAN_DECAY
static double	DEFAULT_NADAM_BETA2_VAR_DECAY
static double	DEFAULT_NADAM_EPSILON
static double	DEFAULT_NADAM_LEARNING_RATE

Constructor Summary

Constructors

Constructor and Description
Nadam()
Nadam(double learningRate, double beta1, double beta2, double epsilon)

Method Summary

Modifier and Type	Method and Description
void	applySchedules(int iteration, double newLearningRate) Apply the new learning rate and any other schedules
Nadam	clone() Clone the updater
GradientUpdater	instantiate(INDArray viewArray, boolean initializeViewArray) Create a new gradient updater
long	stateSize(long numParams) Determine the updater state size for the given number of parameters.

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.nd4j.linalg.learning.config.IUpdater

equals

Field Detail

DEFAULT_NADAM_LEARNING_RATE

public static final double DEFAULT_NADAM_LEARNING_RATE

See Also:

Constant Field Values

DEFAULT_NADAM_EPSILON

public static final double DEFAULT_NADAM_EPSILON

See Also:

Constant Field Values

DEFAULT_NADAM_BETA1_MEAN_DECAY

public static final double DEFAULT_NADAM_BETA1_MEAN_DECAY

See Also:

Constant Field Values

DEFAULT_NADAM_BETA2_VAR_DECAY

public static final double DEFAULT_NADAM_BETA2_VAR_DECAY

See Also:

Constant Field Values

Constructor Detail

Nadam

public Nadam()

Nadam

public Nadam(double learningRate,
             double beta1,
             double beta2,
             double epsilon)

Method Detail

stateSize

public long stateSize(long numParams)

Description copied from interface: IUpdater

Determine the updater state size for the given number of parameters. Usually a integer multiple (0,1 or 2) times the number of parameters in a layer.

Specified by:

stateSize in interface IUpdater

Parameters:

numParams - Number of parameters

Returns:

Updater state size for the given number of parameters

applySchedules

public void applySchedules(int iteration,
                           double newLearningRate)

Description copied from interface: IUpdater

Apply the new learning rate and any other schedules

Specified by:

applySchedules in interface IUpdater

Parameters:

iteration - Current iteration count

newLearningRate - new learning rate to set for the updater

instantiate

public GradientUpdater instantiate(INDArray viewArray,
                                   boolean initializeViewArray)

Description copied from interface: IUpdater

Create a new gradient updater

Specified by:

instantiate in interface IUpdater

Parameters:

viewArray - The updater state size view away

initializeViewArray - If true: initialise the updater state

Returns:

clone

public Nadam clone()

Description copied from interface: IUpdater

Clone the updater

Specified by:

clone in interface IUpdater

Overrides:

clone in class Object