Page History

...

                                            (a) where it fits in KVStore                                                                        (b) InitMergeBuffersAndComm                          

                                   (c) Reduce                                                                                                                         (d) Broadcast
Figure 5. Block diagram of proposed addition. Changes to old initialization (InitMergeBuffersAndComm), Reduce and Broadcast are illustrated.

...

Figure 7. VGG-16 performance as function of MXNET_KVSTORE_BIGARRAYGPUARRAY_BOUND using batch size 4 per GPU.

...