Current state: Accepted
Discussion thread: here
JIRA:
Please keep the discussion on the mailing list rather than commenting on the wiki (wiki discussions get unwieldy fast).
Currently Kafka only reports metrics on the in-sync state of a partition, but does not give finer level detail on the number of in- / out-of- sync replicas per partition.
This proposal would add the number of in-sync replicas, as well as the number of replicas per topic-partition, as reported by the partition leader.
Public Interfaces
Monitoring
This proposal would add the following two yammer metrics (and resulting JMX metrics):
kafka.cluster:type=Partition,name=InSyncReplicasCount,topic={topic},partition={partition}
" – one gauge per topic partition leaderkafka.cluster:type=Partition,name=ReplicasCount,topic={topic},partition={partition}
" – one gauge per topic partition leaderThis proposal would add the yammer gauges described above to the kafka.cluster.Partitions class, similar to the existing "UnderReplicated" metric in that class.
Performance impact should be minimal, since the new metrics rely on the same information already used to define the "UnderReplicated" metric.
None