Class

com.intel.analytics.zoo.pipeline.api.keras.optimizers

Adam

Related Doc: package optimizers

Permalink

class Adam[T] extends SGD[T]

An implementation of Adam http://arxiv.org/pdf/1412.6980.pdf with learning rate schedule.

Linear Supertypes
SGD[T], OptimMethod[T], Serializable, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. Adam
  2. SGD
  3. OptimMethod
  4. Serializable
  5. Serializable
  6. AnyRef
  7. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new Adam(lr: Double = 1e-3, beta_1: Double = 0.9, beta_2: Double = 0.999, epsilon: Double = 1e-8, decay: Double = 0.0, schedule: LearningRateSchedule = Default())(implicit arg0: ClassTag[T], ev: TensorNumeric[T])

    Permalink

    lr

    learning rate

    beta_1

    first moment coefficient

    beta_2

    second moment coefficient

    epsilon

    for numerical stability

    decay

    learning rate decay

    schedule

    learning rate schedule

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  5. var beta_1: Double

    Permalink

    first moment coefficient

  6. var beta_2: Double

    Permalink

    second moment coefficient

  7. def clearHistory(): Unit

    Permalink
    Definition Classes
    Adam → SGD → OptimMethod
  8. def clone(): OptimMethod[T]

    Permalink
    Definition Classes
    OptimMethod → AnyRef
  9. var dampening: Double

    Permalink
    Definition Classes
    SGD
  10. var decay: Double

    Permalink

    learning rate decay

  11. var epsilon: Double

    Permalink

    for numerical stability

  12. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  13. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  14. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  15. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  16. def getHyperParameter(config: Table): String

    Permalink
    Definition Classes
    SGD → OptimMethod
  17. def getHyperParameter(): String

    Permalink
    Definition Classes
    SGD → OptimMethod
  18. def getLearningRate(): Double

    Permalink
    Definition Classes
    SGD → OptimMethod
  19. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  20. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  21. var learningRate: Double

    Permalink
    Definition Classes
    SGD
  22. var learningRateDecay: Double

    Permalink
    Definition Classes
    SGD
  23. var learningRateSchedule: LearningRateSchedule

    Permalink
    Definition Classes
    SGD
  24. var learningRates: Tensor[T]

    Permalink
    Definition Classes
    SGD
  25. def loadFromTable(config: Table): Adam.this.type

    Permalink
    Definition Classes
    Adam → SGD → OptimMethod
  26. var lr: Double

    Permalink

    learning rate

  27. var momentum: Double

    Permalink
    Definition Classes
    SGD
  28. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  29. var nesterov: Boolean

    Permalink
    Definition Classes
    SGD
  30. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  31. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  32. def optimize(feval: (Tensor[T]) ⇒ (T, Tensor[T]), parameter: Tensor[T]): (Tensor[T], Array[T])

    Permalink

    An implementation of Adam http://arxiv.org/pdf/1412.6980.pdf

    An implementation of Adam http://arxiv.org/pdf/1412.6980.pdf

    feval

    a function that takes a single input (X), the point of a evaluation, and returns f(X) and df/dX

    parameter

    the initial point

    returns

    the new x vector and the function list {fx}, evaluated before the update

    Definition Classes
    Adam → SGD → OptimMethod
  33. def save(path: String, overWrite: Boolean): Adam.this.type

    Permalink
    Definition Classes
    OptimMethod
  34. val schedule: LearningRateSchedule

    Permalink

    learning rate schedule

  35. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  36. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  37. def updateHyperParameter(config: Table, state: Table): Unit

    Permalink
    Definition Classes
    SGD → OptimMethod
  38. def updateHyperParameter(): Unit

    Permalink
    Definition Classes
    SGD → OptimMethod
  39. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  40. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  41. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  42. var weightDecay: Double

    Permalink
    Definition Classes
    SGD
  43. var weightDecays: Tensor[T]

    Permalink
    Definition Classes
    SGD

Deprecated Value Members

  1. def clearHistory(state: Table): Table

    Permalink
    Definition Classes
    OptimMethod
    Annotations
    @deprecated
    Deprecated

    (Since version 0.2.0) Please use clearHistory() instead

  2. def optimize(feval: (Tensor[T]) ⇒ (T, Tensor[T]), parameter: Tensor[T], config: Table, state: Table): (Tensor[T], Array[T])

    Permalink
    Definition Classes
    OptimMethod
    Annotations
    @deprecated
    Deprecated

    (Since version 0.2.0) Please initialize OptimMethod with parameters when creating it instead of importing table

Inherited from SGD[T]

Inherited from OptimMethod[T]

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped