Versions Compared

Old Version 33

changes.mady.by.user Dong Lin

Saved on

compared with

New Version 34

changes.mady.by.user Dong Lin

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • The process of operator chain can still be done. After that, the results of its operator chain as well as and its upstream operators will be set blocking (by default) or hybrid shuffle partition type which can be controlled by configuring ExecutionOptions.BATCH_SHUFFLE_MODE.
  • This operator as well as its upstream operators will be executed in batch mode.

    More specifically, the checkpoint is disabled when these operators are running so , such that these operators can do things like operations not compatible with checkpoints (e.g. sorting inputs). And operators should re-read the data from the upstream blocking edge or sources after failover. 

...