Page History

...

We'll need to version the MXNet operators with accelerator libraries so that as operator implementations change we catch the mismatch against older accelerator libraries. 

Milestones

TBD

References

...

Subgraph Project description within MXNet

https://cwiki.apache.org/confluence/display/MXNET/Unified+integration+with+external+backend+libraries

Related project using subgraph API for MKLDNN

https://cwiki.apache.org/confluence/display/MXNET/MXNet+Graph+Optimization+and+Quantization+based+on+subgraph+and+MKL-DNN

TensorRT runtime integration proposal

https://cwiki.apache.org/confluence/display/MXNET/Runtime+Integration+with+TensorRT

TensorRT Graph pass to produce TRT-specific subgraphs

https://github.com/apache/incubator-mxnet/blob/5a9c3af4b101b85047b306575575ea9022a8474e/src/executor/tensorrt_pass.cc

TensorRT Operator registration inside MXNet

https://github.com/apache/incubator-mxnet/blob/5a9c3af4b101b85047b306575575ea9022a8474e/src/operator/contrib/tensorrt.cc

(Also see other tensorrt.* files in the contrib directory)

ONNX to TensorRT conversion

https://github.com/apache/incubator-mxnet/blob/e04565aa9534bdc35bdca57e67ef2307cb473792/src/executor/onnx_to_tensorrt.cc

TensorRT execution at runtime

https://github.com/apache/incubator-mxnet/blob/2becd7641fbe264b72425fe6b1ded00cea19d3a8/src/c_api/c_api_executor.cc#L446

https://github.com/apache/incubator-mxnet/blob/5a9c3af4b101b85047b306575575ea9022a8474e/src/executor/trt_graph_executor.cc

TensorRT Unit Tests

https://github.com/apache/incubator-mxnet/tree/5a9c3af4b101b85047b306575575ea9022a8474e/tests/python/tensorrt

TensorRT Tutorial 

https://github.com/apache/incubator-mxnet/blob/cb6815c3963e1a97af1aa51fe5d45390d9fddfbc/docs/tutorials/tensorrt/inference_with_trt.md