...
As the diversity of deep learning hardware accelerators increase, it is import important to have an efficient abstraction layer so developers can avoid having to enable each accelerator/compute separately. Intel nGraph enables that vision as shown below.
...
Proposed Approach
As described in subgraph acceleration API design design document, we extend and customize SubgraphProperty and SubgraphSelector classes to enable nGraph integration.
...
SgNgraphSelector inherits SubgraphSelector to provide an interface to the subgraph selection mechanism, and SgNgraphProperty inherits Subgraph Property to provide a way to create nGraph subgraphs.
When compiling with nGraph, NDArray now contains a method get_tensor to enable memory sharing between nGraph and MXNet. This enables us to avoid copying or reallocating memory.
...