...

For more detail discussion please refer to the mail thread as well as the Rejected Alternatives section.

This KIP is closely related to KIP-33. Some of the contents listed in this KIP are actually part of KIP-33. They are put here because they are important for the design decision. More specifically, KIP-33 will implement the following changes:

1. Build a time index for each log segment using the timestamps in messages.
2. Enforce log retention and log rolling use time based index.

Add a Timestamp field to the message format with maximum allowed time difference configuration on broker.

...

We bump up ProduceRequest/FetchRequest (and responses) versions to indicate the broker that this client supports new message format.

Build Time Index for messages based on message timestamp (will be implemented in KIP-33)

This section will be implemented in KIP-33. It is listed here because it is closely related to the design of this KIP. Please see the details in KIP-33.

Change time based log retention and log rolling to base on the time index (will be implemented in KIP-33)

This section will be implemented in KIP-33. It is listed here because it is closely related to the design of this KIP. Please see the details in KIP-33.

Compatibility, Deprecation, and Migration Plan

...