Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

PR: https://github.com/apache/kafka/pull/20913

Motivation


This KIP proposes an optional, topic-level feature that provides an opportunity for cost savings on remote storage when the scenario is suitable to use.

Currently, Kafka's tiered storage implementation uploads all non-active local log segments to remote storage immediately, even when they are still within the local retention period. 
This results in redundant storage of the same data in both local and remote tiers.

...