Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.


...

Page properties

...


Discussion thread

...

...

...

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-14551

...

Release1.11


Please keep the discussion on the mailing list rather than commenting on the wiki (wiki discussions get unwieldy fast).

...

  • Re-scaling on unaligned checkpoints (need to use savepoint in MVP)
  • Incremental checkpointing to not writing write the same buffer multiple times (when the job is backpressured)
  • Advanced triggers for unaligned checkpoints such as timeouts on alignment or meeting the maximum threshold of checkpoint sizes
  • Support for concurrent checkpoints
  • Incremental loading and processing of state
  • No additional memory to load channel state: ideally, existing network buffers should be reused
  • Reduced number of files: single file could be reused for several checkpoints

...