Page History

...

1. With in-memory snapshot the broker needs to read 1MB/s from the head of the log.
2. With log compaction the broker needs to
   1. read 1MB/s from the head of the log to update the in-memory state
   2. read 1MB/s to update the map of keys to offsets
   3. read 3MB/s (100MB from the already compacted log, 50MB from the new key-value records) from the older segments. The log will accumulate 50MB in 50 seconds worth of changes before compacting because the default configuration has a minimum clean ration ratio of 50%.

We mentioned __consumer_offsets in this section because in the future we are interested in using this mechanism for high-throughput topic partitions like the Group Coordinator and Transaction Coordinator.

...