THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
...
- state.backend.*: specific options for individual state backends, such as RocksDB.
- state.changelog: configurations for the changelog, as outlined in FLIP-158, including the options for the "Durable Short-term Log" (DSTL).
- state.latency-track: configurations related to the latency tracking of state access.
Additional key naming rule for boolean type options (In discussion): ONLY add 'enabled' when there are more detailed configurations under the same prefix, to prevent one name from serving as a prefix to another. Otherwise, do not add 'enabled' as suffix.
Please note that this FLIP does not change any state accessing, checkpointing and recovery logic. To be more specific, the detailed migration plan for the individual options is as follows:
...
Original (Current) option | Proposed New option | Note |
state.checkpoints.num-retained | execution.checkpointing.num-retained | |
state.checkpoint.cleaner.parallel-mode | execution.checkpointing.cleaner.parallel-mode | |
state.backend.incremental |
execution.checkpointcheckpointing.typeincremental (In discussion) | |
state.backend.local-recovery | execution.checkpointing.local-copy.enabled | Whether to do checkpoint on local disk, another option |
taskmanager.state.local.root-dirs | execution.checkpointing.local-copy.dir | |
state.savepoints.dir | execution.checkpointing.savepoint.dir | |
state.checkpoints.dir state.checkpoint-storage | execution.checkpointing.dir | One URI is enough for specifying the checkpoint directory and storage. 'jobmanager' and 'jm://' are special URI for job manager based storage. |
state.storage.fs.memory-threshold | execution.checkpointing.data-inline-threshold | |
state.storage.fs.write-buffer-size | execution.checkpointing.write-buffer-size |
...