Versions Compared

Old Version 24

changes.mady.by.user Lijie Wang

Saved on

compared with

New Version 25

changes.mady.by.user Lijie Wang

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

In order to obtain the state of shuffle master, we will add the following methods to shuffle master. Before the job starts running, we will check whether the shuffle master supports taking snapshots(through method supportsBatchSnapshot). If it is not supported, we have to will disable Job Recovery for jobs.

...