Versions Compared

Old Version 18

changes.mady.by.user Roman Khachatryan

Saved on

compared with

New Version 19

changes.mady.by.user Roman Khachatryan

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Ad-hoc vs continuous spilling

Avoiding double processing in downstream (if continuous spilling)

  1. downstream reads upstream buffers and filters out what it has already processed; files are indexed
  2. downstream communicates its offset to upstream during snapshotting
  3. downstream communicates its offset to upstream during recovery

Existing persistence mechanisms vs custom

...