Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

It does not support compact topics .   with tiered storage. Topic created with the effective value for remote.log.enabled as true, can not change its retention policy from delete to compact.

It does not support JBOD feature with tiered storage.

Proposed Changes

High-level design

...

LogStartOffset of a topic can point to either of local segment or remote segment but it is initialised and maintained in the Log class like now. This is already maintained in `Log` class while loading the logs and it can also be fetched from RemoteLogMetadataManager.  

JBOD related changes

Currently, JBOD is supported by altering log dirs in two ways.

...

Altering to a different dir on the local broker

  • This is not supported in this KIP but we may plan this in future releases.

Altering to a dir on a remote broker

...

 

There are no changes with other protocol APIs because of tiered storage. 

...