Page History

...

1. Unit tests for the new code
2. Add incremental mode: FileStateBackendTest, EventTimeWindowCheckpointingITCase, KeyedStateCheckpointingITCase
3. Add increment-specific integration tests to FileStateBackendTest
4. Parameterize the whole CI build (each build randomly or as a separate periodic build) using existing state.backend.incremental=true/false. This affects the following tests:
1. About 10 IT cases in stream.sql (e.g. RankITCase, JoinITCase)
2. Planner IT cases (e.g. GroupWindowITCase)
3. E2E: test_streaming_sql (planner) (especially blink), test_resume_savepoint, test_ha_datastream (HA*)
4. Others: CEPOperatorTest, WindowOperatorMigrationTest, StreamOperatorSnapshotRestoreTest, FileStateBackendTest, MemoryStateBackendTest, HeapAsyncSnapshotTtlStateTest, LocalRecoveryITCase, RegionFailoverITCase, UnalignedCheckpointITCase, 
5. Important for checking removal correctness: WindowAggregateITCase, WindowCheckpointingITCase
6. Load testing - similar to the evaluation below but more detailed:
   1. job runtime
   2. recovery time
   3. checkpointing times
   4. memory overhead

(in the future, side-by-side comparisons with permuted configurations can be added)

...