packers

Type Members

1. class AggregateSmallTensorsPacker extends Packer[PackInformation]

   

   Packer that concatenates small tensors together for reduction.

   Packer that concatenates small tensors together for reduction.

   This packer aggregates values that occupy less than maxBytes memory space into groups with at most maxGroups values each.

   Annotations

   @throws( ... )

   Exceptions thrown

   InvalidArgumentException If maxBytes or maxGroups is less than 1.

2. class ConcatenateAndSplitPacker extends Packer[PackInformation]

   

   Packer that concatenates all tensors together and then splits them into packs for reduction.

   Packer that concatenates all tensors together and then splits them into packs for reduction.

   This packer aggregates values into a total of numPacks splits.

   Annotations

   @throws( ... )

   Exceptions thrown

   InvalidArgumentException If numPacks is less than 1.

3. trait Packer[P] extends AnyRef

   

   Represents a tensor packer that helps facilitate faster communication between devices.

   Represents a tensor packer that helps facilitate faster communication between devices.

   TODO: [DISTRIBUTE] This can only be used with dense tensors at this point.

   P

   Pack information type. Represents information collected during packing that is necessary for unpacking.