ops

Type Members

1. class AllReduceCrossTowerOps[P] extends CrossTowerOps

   

   Cross-tower ops that perform an all-reduce operation.

2. abstract class CrossTowerOps extends AnyRef

   

   Base class for cross-tower reduction and broadcasting algorithms.

3. class SingleDeviceReduceCrossTowerOps extends CrossTowerOps

   

   Cross-tower ops that always perform a reduction to one device first and then do broadcasting.

   Cross-tower ops that always perform a reduction to one device first and then do broadcasting.

   Batch reduction is done by reduction on each element one by one.