Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Depending on the structure of the shared log segment, a single Fetch request could be satisfied by one GET request, or may need multiple requests. In order to improve the locality of requests, Diskless shared log segments will be periodically compacted in order to increase sequential spans of batches. The compaction is discussed in detail in KIP-C1165: Object Compaction for Diskless.

Object storage implementations are expected to implement caching to reduce the quantity of overall requests to the underlying storage. These caches should be partitioned per-rack, to maintain good locality for requests. Caching is discussed in detail in a follow-up KIP.

...