Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Table of Contents

Status

Current state: Voting Accepted (voting thread)

Discussion thread: here

...

The ProducerIdCount metric reflects the total count of producer ids in all partitions maintained at each broker, and .  The metric can be used to set up alerts so that the abovementioned pattern can proactively detected and action could be taken before too many producer ids run the broker out of memory.

...

NameDescription
kafka.server:type=ReplicaManager,name=ProducerIdCount The total number of active transactional / idempotent producers producer ids in all partitions maintained in the broker.

Proposed Changes

...

Rejected Alternatives

Have a partition level metric as well - this doesn't seem to be needed as we can use KIP-664: Provide tooling to detect and abort hanging transactions for detailed debugging, once alerted on total producer id count on the broker.

Name the metric ProducerCount - may be misleading as the producers without producer ids are not counted.

...