The parameters of a distributed optimizer
Local Optimizer Performance Parameters
Local Optimizer Performance Parameters
batch size
core number
how many iterations to run
data type (double / float)
module name
input data type (constant / random)
ModelBroadcast is used to broadcast model when doing model inference.
ModelBroadcast is used to broadcast model when doing model inference. Note: do not use it in model training since the broadcast models share weights and biases It shortens the broadcast time, which is especially useful when the model size is large
data type
The parameters of a distributed optimizer
batch size
how many epochs to run
data type (double / float)
module name
inputData input data type (constant / random)