Status

Current state: Under DiscussionAccepted

Discussion thread: https://lists.apache.org/thread/ww67h9d4xvgw1f7jn4zxwydmt8x1mq72

...

The property metadata.log.max.snapshot.interval.ms will be added to the Kafka server configuration. This is the maximum amount of time that Kafka will wait to generate a snapshot if there are records in the log that are not included in the latest snapshot. The default value for this property will be an hour. A value of zero, disables time based snapshot generation.

The default value for the metadata.max.retention.bytes  will be changed from -1 (disabled)  to 100 * 1024 * 1024  (100MB).

Proposed Changes

Both the KRaft brokers and controllers will generate a snapshot if there is a record in the log that is newer than the latest snapshot and has an append time older than metadata.log.max.snapshot.interval.ms milliseconds ago.

...

There are no compatibility, deprecation or migration implications. This feature only affects the local replica and doesn't have any effect on remote replicas.

If the user wants to keep the behavior before this KIP was implemented, they would need to disable time based snapshots by setting metadata.log.max.snapshot.interval.ms to zero (0).

Test Plan

We will add both unit and integration tests for this feature.

...