Class/Object

org.platanios.tensorflow.api.ops.training.distribute.ops

SingleDeviceReduceCrossTowerOps

Related Docs: object SingleDeviceReduceCrossTowerOps | package ops

Permalink

class SingleDeviceReduceCrossTowerOps extends CrossTowerOps

Cross-tower ops that always perform a reduction to one device first and then do broadcasting.

Batch reduction is done by reduction on each element one by one.

Linear Supertypes
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. SingleDeviceReduceCrossTowerOps
  2. CrossTowerOps
  3. AnyRef
  4. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new SingleDeviceReduceCrossTowerOps(device: Option[DeviceSpecification])

    Permalink

    device

    Intermediate device to reduce to. If None, reduce to the first device in the provided destination of the reduce() method.

    Attributes
    protected

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  5. def batchReduce[D](reduction: Reduction, valueDestinationPairs: Seq[(PerDeviceValue[OutputLike], Option[D])])(implicit arg0: Destination[D]): Seq[MirroredValue[OutputLike]]

    Permalink

    Reduces a batch per-device values to the corresponding provided destinations.

    Reduces a batch per-device values to the corresponding provided destinations.

    For each tuple in valueDestinationPairs, this method reduces each first element to each second element which indicates the corresponding destination.

    reduction

    Reduction method.

    valueDestinationPairs

    Sequence of per-device values and destinations pairs. If a destination is None, then the destination is set to match the devices of the corresponding per-device value.

    returns

    Sequence of reduced mirrored values.

    Definition Classes
    SingleDeviceReduceCrossTowerOpsCrossTowerOps
  6. def broadcast[O <: OutputLike, D](value: O, destination: D)(implicit arg0: Destination[D]): MirroredValue[O]

    Permalink

    Broadcasts value to destination.

    Broadcasts value to destination.

    value

    Value to broadcast.

    destination

    Broadcast destination.

    returns

    Broadcasted mirrored value.

    Definition Classes
    CrossTowerOps
  7. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  8. val device: Option[DeviceSpecification]

    Permalink

    Intermediate device to reduce to.

    Intermediate device to reduce to. If None, reduce to the first device in the provided destination of the reduce() method.

  9. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  10. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  11. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  12. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  13. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  14. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  15. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  16. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  17. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  18. def reduce[D](reduction: Reduction, value: PerDeviceValue[OutputLike], destination: Option[D])(implicit arg0: Destination[D]): MirroredValue[OutputLike]

    Permalink

    Reduces value to destination.

    Reduces value to destination.

    It runs the reduction operation defined by reduction and puts the result on destination.

    reduction

    Reduction method.

    value

    Per-device value to be reduced.

    destination

    Reduction destination.

    returns

    Reduced mirrored value.

    Definition Classes
    SingleDeviceReduceCrossTowerOpsCrossTowerOps
  19. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  20. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  21. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  22. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  23. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from CrossTowerOps

Inherited from AnyRef

Inherited from Any

Ungrouped