THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
...
Page properties |
---|
...
|
...
...
|
...
|
...
|
Please keep the discussion on the mailing list rather than commenting on the wiki (wiki discussions get unwieldy fast).
...
- Re-scaling on unaligned checkpoints (need to use savepoint in MVP)
- Incremental checkpointing to not writing write the same buffer multiple times (when the job is backpressured)
- Advanced triggers for unaligned checkpoints such as timeouts on alignment or meeting the maximum threshold of checkpoint sizes
- Support for concurrent checkpoints
- Incremental loading and processing of state
- No additional memory to load channel state: ideally, existing network buffers should be reused
- Reduced number of files: single file could be reused for several checkpoints
...