...
Furthermore, the state containing the persisted data of an input/output should also contain a small header. The header consists of a version number identifying the used checkpoint format. For the first version (described above), the number is ‘1’ and gives us the option for backward compatible changes. See Figure 4 for an overview over all involved headers. Note that the current buffer format including record header remains untouched and is just shown for completeness.
draw.io Diagram | ||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
Figure 2: The format of the state-based storage. The state header contains the version number and is written once per logical input / output.
Each buffer is prefixed with the channel id for restoring the original assignment to channels.
Enhancing the checkpoints of operators
...