Introduction:
This page tracks the current status and development to support ONNX on Mxnet. We currently support:
- import of ONNX models into Mxnet.
- export MXNet models to ONNX format.
ONNX-MXNET Import Module
We have two repositories for the import module:
- onnx-mxnet repository inside onnx https://github.com/onnx/onnx-mxnet (deprecated)
- A newly created and refactored module inside Mxnet -> contrib. https://github.com/apache/incubator-mxnet/tree/master/python/mxnet/contrib/onnx/onnx2mx
MXNET-ONNX Export module
A new module has been added to MXNet repository to export MXNet models to ONNX model format. https://github.com/apache/incubator-mxnet/tree/master/python/mxnet/contrib/onnx/mx2onnx
Operator Coverage:
This table keeps track of the status of all ONNX operators supported by Mxnet.
ONNX backend test script reports the coverage on the operators and attributes.
Operator | Test Coverage | Mxnet (Import) | Mxnet (Export) |
---|---|---|---|
Abs | Yes | OK | OK |
Add | Yes | OK | OK |
And | OK | ||
ArgMax | Yes | OK | OK |
ArgMin | Yes | OK | OK |
AveragePool | Yes | OK | OK |
BatchNormalization | Yes | OK | OK |
Cast | Yes | OK | OK |
Ceil | Yes | OK | OK |
Clip | Yes | OK | |
Concat | Yes | OK | OK |
Constant | Yes | OK | |
Conv | Yes | OK | OK |
ConvTranspose | Yes | OK | OK |
DepthToSpace | NOT OK, under development | ||
Div | Yes | OK | OK |
Dropout | OK | OK | |
Elu | Yes | OK | OK |
Equal | Yes | OK | |
Exp | Yes | OK | OK |
Flatten | Yes | PARTIAL, only supports default axis=1 | OK |
Floor | Yes | OK | OK |
GRU | NOT OK , under development | ||
Gather | Yes | OK | |
Gemm | Yes | OK | OK |
GlobalAveragePool | Yes | OK | OK |
GlobalLpPool | OK | ||
GlobalMaxPool | Yes | OK | OK |
Greater | OK | ||
HardSigmoid | OK | ||
Hardmax | OK | ||
InstanceNormalization | OK | ||
LRN | OK | OK | |
LSTM | NOT OK, under development | ||
LeakyRelu | Yes | OK | OK |
Less | OK | ||
Log | Yes | OK | OK |
LogSoftMax | OK | ||
LpNormalization | OK | OK | |
LpPool | Yes | OK | |
Max | Yes | OK | OK |
MaxPool | Yes | OK | OK |
MaxRoiPool | OK | ||
Mean | OK | OK | |
Min | Yes | OK | OK |
Mul | Yes | OK | OK |
Neg | Yes | OK | OK |
Not | OK | ||
Or | OK | ||
PRelu | Yes | OK | OK |
Pad | Yes | OK | OK |
Pow | Yes | Partial, only supports default axis=1 | OK |
RNN | NOT OK, under development | ||
RandomNormal | OK | ||
RandomNormalLike | OK | ||
RandomUniform | OK | ||
RandomUniformLike | OK | ||
Reciprocal | OK | OK | |
ReduceL1 | OK | ||
ReduceL2 | OK | ||
ReduceLogSum | OK | ||
ReduceLogSumExp | OK | ||
ReduceMax | Yes | OK | OK |
ReduceMean | Yes | OK | OK |
ReduceMin | Yes | OK | OK |
ReduceProd | Yes | OK | OK |
ReduceSum | Yes | OK | |
ReduceSumSquare | OK | ||
Relu | Yes | OK | OK |
Reshape | Yes | OK | OK |
Selu | Yes | NOT OK, under development | OK |
Sigmoid | Yes | OK | OK |
Slice | Yes | Partial, supports axis=1 | OK |
Softmax | Yes | OK | OK |
Softplus | Yes | O | OK |
Softsign | NOT OK, under development | OK | |
SpaceToDepth | NOT OK, under development | ||
Split | Yes | NOT OK, under development | OK |
Sqrt | OK | OK | |
Squeeze | Yes | OK | OK |
Sub | Yes | OK | OK |
Sum | Yes | OK | OK |
Tanh | Yes | OK | OK |
Tile | NOT OK, under development | ||
Transpose | Yes | OK | OK |
Xor | NOT OK, under development | ||
experimental ATen | NOT OK, under development | ||
experimental Affine | NOT OK, under development | ||
experimental ConstantFill | NOT OK, under development | ||
experimental Crop | NOT OK, under development | ||
experimental FC | NOT OK, under development | ||
experimental GRUUnit | NOT OK, under development | ||
experimental GivenTensorFill | NOT OK, under development | ||
experimental Identity | NOT OK, under development | ||
experimental ImageScaler | NOT OK, under development | ||
experimental MeanVarianceNormalization | NOT OK, under development | ||
experimental ParametricSoftplus | NOT OK, under development | ||
experimental Scale | NOT OK, under development | ||
experimental ScaledTanh | NOT OK, under development | ||
experimental ThresholdedRelu | NOT OK, under development | ||
experimental Upsample | NOT OK, under development |
ONNX models coverage:
ONNX backend tests include below models. The table lists current status on Mxnet:
ONNX Models | Mxnet Support |
---|---|
bvlc_alexnet | OK |
densenet121 | OK |
inception_v1 | NOT OK, precision difference due to issue |
inception_v2 | NOT OK, precision difference due to issue |
resnet50 | OK |
shufflenet | NOT OK, precision difference due to issue |
squeezenet | OK |
vgg16 | OK |
vgg19 | OK |
bvlc_googlenet | OK |
bvlc_caffenet | OK |
bvlc-rcnn-ilsvrc13 | OK |