Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

You can enable tiered storage by setting “remote.log.storage.enable” to true on the desired topics. Before enabling tiered storage, you should make sure the producer snapshots are built for all the segments for that topic in all followers. You should wait till the log retention occurs for all the segments so that all the segments have producer snapshots. Because follower replicas for topics with tier storage enabled, need the respective producer snapshot for each segment for reconciliating the state as mentioned in earlier follower fetch protocol section.  

Integration and System tests

For integration tests, we can have file based RSM(LocalTieredStorage) that we have. For system tests, we plan to have a single node HDFS cluster in one of the containers and use HDFS RSM implementation.

Feature Test

Feature test cases and test results are documented in this google spreadsheet.

...