Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.


Performance Boost with Intel MKL-DNN backend from various models


Category

Model

Latency batchsize=1 (ms, small is better)Throughput batchsize=128 (fps, big is better)
w/o MKL-DNNw/ MKL-DNNspeedupw/o MKL-DNNw/ MKL-DNNspeedup

CNN/classification

ResNet-50 v1





ResNet-50 v2





Inception v3





Inception v4





DenseNet





MobileNet





VGG16





AlexNet





inception-resnet v2





CNN/object detection

Faster R-CNN





SSD-VGG16





SSD-MobileNet





RNN

GNMT





GANDCGAN

...