Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • Change the handling of checkpoint barriers,  
  • Propose an API for persistently storing in-flight data,
  • Sketch a first implementation that co-locates in-flight data with operator state,
  • to allow them to overtake other records
  • Enhance the checkpoint format, 
  • Recover from the new checkpoint while also allowing new checkpoints to be taken during recovering to guarantee progress, and
  • Refine scaling of operators to match the changed checkpoint format.

...

  • Propose a solution of how the operators can be rescaled in the future

Handling of checkpoint barriers

...