Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  1. not writing the same buffer multiple times (when the job is backpressured); can be addressed by implementing incremental checkpointing for FS backend
  2. incremental loading and processing of state
  3. no additional memory to load channel state: ideally, existing network buffers should be reused
  4. reduced number of files: single file could be reused for several checkpoints 

Compatibility, Deprecation, and Migration Plan

...