Versions Compared

Old Version 21

changes.mady.by.user Meghna Baijal

Saved on

compared with

New Version 22

changes.mady.by.user Seb Kiureghian

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • Added enhancements to the Gluon package, a high-level interface designed to be easy to use while keeping most of the flexibility of low level API. Gluon supports both imperative and symbolic programming, making it easy to train complex models imperatively with minimal impact on performance. Neural networks (and other machine learning models) can be defined and trained with gluon.nn and gluon.rnn packages. 

  • Added new loss functions - SigmoidBinaryCrossEntropyLoss, CTCLoss, HuberLoss, HingeLoss, SquaredHingeLoss, LogisticLoss, TripletLoss.

  • gluon.Trainer now allows reading and setting learning rate with trainer.learning_rate property.

  • Added API HybridBlock.export for exporting gluon models to MXNet format.

  • Added ConvLSTM to Convolutional recurrent networks for RNN, LSTM, and GRU.

  • Added VariationalDropoutgluon.contrib.


New Features - Autograd

  • Added enhancements to autograd package, which enables automatic differentiation of NDArray operations.

  • autograd.Function allows defining both forward and backward computation for custom operators. See documentation for examples.

  • Added mx.autograd.grad and experimental second order gradient support (most operators don't support second order gradient yet).

  • Autograd now supports cross-device graphs. Use x.copyto(mx.gpu(i)) and x.copyto(mx.cpu()) to do computation on multiple devices.

...