THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
...
Setup
EC2 Instance: p3.8xlarge
CUDNN: 7.4.2
CUDA: 10.0
Commit Hash: b3b952f9d5490ee2707209ab866e6c3f094e2046 (PoC changes made on top of this built from source)
...
Model (Samples/sec) | Batch Size | Original Model (Samples/sec) | Mixed Precision Model (Samples/sec) | Original Model with Implicit Type Conversion (MXNET_CUDA_TENSOR_OP_MATH_ALLOW_CONVERSION=1) (Samples/sec) |
---|---|---|---|---|
imagenet1k-resnet-152 | 1 | 85 | 72 | 72 |
2 | 140 | 140 | 142 | |
4 | 240 | 270 | 228 | |
8 | 320 | 470 | 261 | |
16 | 405 | 680 | 315 | |
resnet50_v1 | 1 | 215 | 165 | 205 |
2 | 370 | 330 | 365 | |
4 | 560 | 600 | 545 | |
8 | 760 | 980 | 635 | |
16 | 935 | 1400 | 790 |
FAQ
Will the arg_params and aux_params be casted to fp16 ?
...