Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

draw.io Diagram
bordertrue
viewerToolbartrue
fitWindowfalse
diagramDisplayNameCheckpoint barriers overtake in-flight records
lboxtrue
revision2
diagramNameBuffer format.drawio
simpleViewerfalse
width
linksauto
tbstyletop
diagramWidth821
revision2

Figure 2: The format of the state-based storage. The state header contains the version number and is written once per
logical input / output.
Each buffer is prefixed with the channel id for restoring the original assignment to channels.

...

draw.io Diagram
bordertrue
viewerToolbartrue
fitWindowfalse
diagramDisplayNameViolating ordering guarantees while rescaling of non-keyed data
lboxtrue
revision3
diagramNamerescale.drawio
simpleViewerfalse
width
linksauto
tbstyletop
diagramWidth521revision3

Figure 3: Violating ordering guarantees while rescaling of non-keyed data. Split S1 is moved from source instance I to instance II.
If the original operators are
back-pressured, data from the new source instance can overtake the original data.

...