Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Because all the index files are memory mapped files the main consideration here is to avoid significantly increasing the memory consumption. 

Use a time index for each log segment to save the (timestamp -> log offset) at a configurable granularity

Create another index file for each log segment with name SegmentBaseOffset.time.index. The density of the index is defined by time.index.interval.ms and index.interval.bytes configuration.

...