Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Table of Contents

Status

Current state:  [Voting]Adopted in 2.3.

Discussion thread: TBD

JIRA:  

Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-7190

...

When trouble shooting KAFKA-7190, one observation is that Streams' overridden topic configs of `segment`segment.ms` ms` and `segment.index.bytes` are too aggressive, and hence is causing various issues with applications that do not have high traffic via these repartition topics. Although the root cause of it should be tackled at KIP-360, I think it is still worth removing these two aggressive overrides and only keep the `segment.bytes` override to 50MB, which should be sufficient for bounding the repartition topic's footprint.

Proposed Changes

Remove the override of `segment`segment.ms` ms` and `segment.index.bytes` and instead fall back to broker-side TopicConfig's default, which is 7 days and 10MB respectively as of version 2.2.

Also replace the overridden value of `retention.ms` from MAX_VALUE to -1 indicating no limit, which is the documented value as well.

We want to remove the override and instead fall back to the ConsumerConfig-defined default of five minutes.

...