Page History

...

That is to replace the coordinator with instance generator and commit sink just like the original pipeline.

Note that this pipeline can not work in mini-batch mode because there is no component to coordinate the mini-batches, and we can not control the sequence of the checkpoint success notifications of the operators. So it is impossible to write eagerly  and start instant immediately when a checkpoint finish.

Image AddedImage Removed

Implementation Plan

...