Page properties | |||||
---|---|---|---|---|---|
|
Status
Current state: Under Discussion
Discussion thread: -
...
|
...
|
...
|
Please keep the discussion on the mailing list rather than commenting on the wiki (wiki discussions get unwieldy fast).
Table of Contents |
---|
This is a follow up on https://cwiki.apache.org/confluence/display/FLINK/FLIP-193%3A+Snapshots+ownership which this is heavily relying on and as such please check FLIP-193 before for the require context
...
Yes | Yes (unofficially)/Maybe (untested) | No (but could be done) | Very difficult/impossible |
Canonical Savepoint | Aligned Checkpoint | Unaligned Checkpoint | |
Statebackend change | |||
Self-contained and relocatable | |||
State Processor API(reading) | (|||
State Processor API(writing) | |||
Schema evolution | untested? | untested? | |
Flink minor (1.x → 1.y) version upgrade | (???) | ||
Flink bug/patch (1.14.x → 1.14.y) version upgrade | (???) | (???) | |
Arbitrary job upgrade (changed graph shape/record types) | |||
Job upgrade w/o changing graph shape and record types | |||
Rescaling |
...
Canonical Savepoint | Native Savepoint | Aligned Checkpoint | Unaligned Checkpoint | ||
Statebackend change | |||||
Self-contained and relocatable | |||||
State Processor API(reading) | (???) | (???) | |||
State Processor API(writing) | |||||
Schema evolution | (???)(???) | (???) | |||
Flink minor (1.x → 1.y) version upgrade | (change) | ||||
Flink bug/patch (1.14.x → 1.14.y) version upgrade | (change) | (change) | |||
Arbitrary job upgrade (changed graph shape/record types) | (change) | ||||
Job upgrade w/o changing graph shape and record types | (change) | (change) | |||
Rescaling |
...
Rejected proposal for checkpoint guarantees
Canonical Savepoint | Native Savepoint | Aligned Checkpoint | Unaligned Checkpoint | |
Statebackend change | ||||
Self-contained and relocatable | ||||
State Processor API | (???) | (???) | ||
Schema evolution | (???) | (???) | (???) | |
Flink minor (1.x → 1.y) version upgrade | ||||
Flink bug/patch (1.14.x → 1.14.y) version upgrade | (change) | (change) | ||
Arbitrary job upgrade (changed graph shape/record types) | ||||
Job upgrade w/o changing graph shape and record types | ||||
Rescaling |
Main aim of the first proposal was to unify guarantees between two types of savepoints and two types of checkpoints. The only difference between native and canonical savepoint should be the ability to change statebackend, and officially there would be no difference between aligned and unaligned checkpoints. Hence we would simplify the documentation, as we could avoid documenting the distinction between unaligned and aligned checkpoints.
...