Page History

...

We used 50 passes over the data in total, comprising different combinations of epochs and number_of_iterations.  You can see that logical sequential SGD with epochs=1 and number_of_iterations=50 has the highest accuracy but takes the longest to train.  Conversely, the fastest training is with epochs=50 and number_of_iterations=1 but the validation accuracy is lower.

Image RemovedImage Added

You should do some experimentation on your own project to determine what tradeoff works for your models architectures and dataset.

...