Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  1. execution.checkpointing: all configurations associated with checkpointing and savepoint.
  2. execution.state-recovery: all configurations pertinent to state recovery.
  3. state.*: all configurations related to the state accessing.

...

Original (Current) option

Proposed New option

Note

state.checkpoints.num-retained

execution.checkpointing.num-retained


state.checkpoint.cleaner.parallel-mode

execution.checkpointing.cleaner.parallel-mode


state.backend.incremental

execution.checkpoint.type

execution.checkpointing.incremental

(In discussion)

an enumeration option which can be 'full' (default) or 'incremental'

state.backend.local-recovery

execution.checkpointing.local-copybackup.enabled

Whether to do checkpoint on local disk, another option execution.state-recovery.from-local is added to control the behavior of recovery from local

taskmanager.state.local.root-dirs


execution.checkpointing.local-copybackup.dir


state.savepoints.dir

execution.checkpointing.savepoint.dir


state.checkpoints.dir

state.checkpoint-storage

execution.checkpointing.dir

One URI is enough for specifying the checkpoint directory and storage. 'jobmanager' and 'jm://' are special URI for job manager based storage.

state.storage.fs.memory-threshold


execution.checkpointing.data-inline-threshold


state.storage.fs.write-buffer-size

execution.checkpointing.write-buffer-size


...

Original (Current) option

Proposed New option

Note

execution.savepoint.path

execution.state-recovery.path


execution.savepoint.ignore-unclaimed-state

execution.state-recovery.ignore-unclaimed-state


execution.savepoint-restore-mode

execution.state-recovery.claim-mode


state.backend.local-recovery

execution.state-recovery.from-local

Specifies whether to recover from local, the local files are created while the execution.checkpointing.local-copybackup is set as true

execution.checkpointing.approximate-local-recovery

execution.state-recovery.approximate-local-recovery


execution.checkpointing.recover-without-channel-state.checkpoint-id

execution.state-recovery.without-channel-state.checkpoint-id


...

As the most special one, the state.backend.local-recovery defines whether the Flink do checkpoint in local disk, as well as whether the Flink would recover from the local. This FLIP proposes to spilt this option into two, named execution.checkpointing.local-copybackup and execution.state-recovery.from-local, representing checkpointing and recovery behavior respectively.

...