AllReduceCrossTowerOps

Value Members

1. final def !=(arg0: Any): Boolean

   

   Definition Classes

   AnyRef → Any

2. final def ##(): Int

   

   Definition Classes

   AnyRef → Any

3. final def ==(arg0: Any): Boolean

   

   Definition Classes

   AnyRef → Any

4. val algorithm: Algorithm

   

   All-reduce algorithm to use.

5. final def asInstanceOf[T0]: T0

   

   Definition Classes

   Any

6. def batchAllReduce(reduction: Reduction, values: Seq[PerDeviceValue[OutputLike]]): Seq[MirroredValue[OutputLike]]

   

   Performs a batched all-reduce operation.

   Performs a batched all-reduce operation.

   reduction

   Reduction method.

   values

   Per-device values to be reduced.

   returns

   Sequence of reduced mirrored values.

   Attributes

   protected

7. def batchReduce[D](reduction: Reduction, valueDestinationPairs: Seq[(PerDeviceValue[OutputLike], Option[D])])(implicit arg0: Destination[D]): Seq[MirroredValue[OutputLike]]

   

   Reduces a batch per-device values to the corresponding provided destinations.

   Reduces a batch per-device values to the corresponding provided destinations.

   For each tuple in valueDestinationPairs, this method reduces each first element to each second element which indicates the corresponding destination.

   reduction

   Reduction method.

   valueDestinationPairs

   Sequence of per-device values and destinations pairs. If a destination is None, then the destination is set to match the devices of the corresponding per-device value.

   returns

   Sequence of reduced mirrored values.

   Definition Classes

   AllReduceCrossTowerOps → CrossTowerOps

8. def broadcast[O <: OutputLike, D](value: O, destination: D)(implicit arg0: Destination[D]): MirroredValue[O]

   

   Broadcasts value to destination.

   Broadcasts value to destination.

   value

   Value to broadcast.

   destination

   Broadcast destination.

   returns

   Broadcasted mirrored value.

   Definition Classes

   CrossTowerOps

9. def clone(): AnyRef

   

   Attributes

   protected[java.lang]

   Definition Classes

   AnyRef

   Annotations

   @throws( ... )

10. final def eq(arg0: AnyRef): Boolean

    

    Definition Classes

    AnyRef

11. def equals(arg0: Any): Boolean

    

    Definition Classes

    AnyRef → Any

12. def finalize(): Unit

    

    Attributes

    protected[java.lang]

    Definition Classes

    AnyRef

    Annotations

    @throws( classOf[java.lang.Throwable] )

13. final def getClass(): Class[_]

    

    Definition Classes

    AnyRef → Any

14. def hashCode(): Int

    

    Definition Classes

    AnyRef → Any

15. final def isInstanceOf[T0]: Boolean

    

    Definition Classes

    Any

16. final def ne(arg0: AnyRef): Boolean

    

    Definition Classes

    AnyRef

17. final def notify(): Unit

    

    Definition Classes

    AnyRef

18. final def notifyAll(): Unit

    

    Definition Classes

    AnyRef

19. val packer: Packer[P]

    

    Packer that can be used to repack/aggregate values before applying the all-reduce, in order to allow for more efficient cross-device transportation.

20. def reduce[D](reduction: Reduction, value: PerDeviceValue[OutputLike], destination: Option[D])(implicit arg0: Destination[D]): MirroredValue[OutputLike]

    

    Reduces value to destination.

    Reduces value to destination.

    It runs the reduction operation defined by reduction and puts the result on destination.

    reduction

    Reduction method.

    value

    Per-device value to be reduced.

    destination

    Reduction destination.

    returns

    Reduced mirrored value.

    Definition Classes

    AllReduceCrossTowerOps → CrossTowerOps

21. final def synchronized[T0](arg0: ⇒ T0): T0

    

    Definition Classes

    AnyRef

22. def toString(): String

    

    Definition Classes

    AnyRef → Any

23. final def wait(): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

24. final def wait(arg0: Long, arg1: Int): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

25. final def wait(arg0: Long): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )