Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Please note that this FLIP does not change any state accessing, checkpointing and recovery logic. To be more specific, the detailed migration plan for the individual options is as follows:

Checkpointing

Original (Current) option

Proposed New option

Type

Note

state.checkpoints.num-retained

execution.checkpointing.num-retained

Integer

state.checkpoint.cleaner.parallel-mode

execution.checkpointing.cleaner.parallel-mode

Boolean

state.backend.incremental

execution.checkpointing.incremental

Boolean

state.backend.local-recovery

execution.checkpointing.local-backup.enabled

Boolean

Whether to do checkpoint on local disk, another option execution.state-recovery.from-local is added to control the behavior of recovery from local

taskmanager.state.local.root-dirs


execution.checkpointing.local-backup.dir

String

state.savepoints.dir

execution.checkpointing.savepoint-dir

String

state.checkpoints.dir

state.checkpoint-storage

execution.checkpointing.dir

StringOne URI is enough for specifying the checkpoint directory and storage. 'jobmanager' and 'jm://' are special URI for job manager based storage.

state.storage.fs.memory-threshold


execution.checkpointing.data-inline-threshold

MemorySize

state.storage.fs.write-buffer-size

execution.checkpointing.write-buffer-size

MemorySize

execution.checkpointing.checkpoints-after-tasks-finish.enabled

execution.checkpointing.checkpoints-after-tasks-finish

BooleanRemove the 'enabled' if the naming rule for boolean type option 3 is chosen

All those options will be moved into `CheckpointingOptions` if they are not currently in.

Recovery

Original (Current) option

Proposed New option

Type

Note

execution.savepoint.path

execution.state-recovery.path

String


execution.savepoint.ignore-unclaimed-state

execution.state-recovery.ignore-unclaimed-state

Boolean

execution.savepoint-restore-mode

execution.state-recovery.claim-mode

EnumEnum of 
org.apache.flink.runtime.jobgraph.RestoreMode

state.backend.local-recovery

execution.state-recovery.from-local

Boolean

Specifies whether to recover from local, the local files are created while the execution.checkpointing.local-backup.enabled is set as true

execution.checkpointing.approximate-local-recovery

execution.state-recovery.approximate-local-recovery

Boolean

execution.checkpointing.recover-without-channel-state.checkpoint-id

execution.state-recovery.without-channel-state.checkpoint-id

Long

All those options will be moved into a newly introduced class `RecoveryOptions` in flink-core.

...