Here's a more-or-less exhaustive list of metrics Kafka reports in 0.8.2.0.

I may have misattributed some of the parent classes (I generated the list from code and there are some class hierarchy things involved), so feel free to fix the misnames.

Gauge

  • ProducerRequestPurgatory.NumDelayedRequests
  • ProducerRequestPurgatory.PurgatorySize
  • FetchRequestPurgatory.NumDelayedRequests
  • FetchRequestPurgatory.PurgatorySize
  • ReplicaManager.PartitionCount
  • ReplicaManager.UnderReplicatedPartitions
  • ReplicaManager.LeaderCount
  • KafkaController.PreferredReplicaImbalanceCount
  • KafkaController.ActiveControllerCount
  • KafkaController.OfflinePartitionsCount
  • Log.LogEndOffset
  • Log.LogStartOffset
  • Log.size
  • Log.NumLogSegments
  • AppInfo.Version
  • Consumer.OwnedPartitionsCount
  • Producer.ProducerQueueSize
  • Log.max-buffer-utilization-percent
  • Log.cleaner-recopy-percent
  • Log.max-clean-time-secs
  • Log.max-dirty-percen
  • Network.RequestQueueSize
  • Network.ResponseQueueSize
  • Network.ResponsesBeingSent
  • KafkaServer.MaxLag
  • KafkaServer.ConsumerLag
  • KafkaServer.MinFetchRate
  • KafkaServer.BrokerState
  • OffsetManager.NumOffsets
  • OffsetManager.NumGroups
  • MirrorMaker.NumUnackedMessages
  • MirrorMaker.UnackedOffsetListsSize
  • MirrorMaker.NumSkippedOffsets

Histograms

(The Network ones are collected by API request type)
  • Consumer.FetchResponseSize
  • Producer.ProducerRequestSize
  • Network.RequestQueueTimeMs
  • Network.LocalTimeMs
  • Network.RemoteTimeMs
  • Network.ResponseQueueTimeMs
  • Network.ResponseSendTimeMs
  • Network.TotalTimeMs
  • MirrorMaker.MirrorMaker-DataChannel-queue-%d-NumMessages
  • MirrorMaker-DataChannel-queue-%d-NumMessages
  • MirrorMaker-DataChannel-Record-Siz

Metered

  • Consumer.MessagesPerSec
  • Consumer.BytesPerSec
  • Consumer.KafkaCommitsPerSec
  • Consumer.ZookeeperCommitsPerSec
  • Producer.SerializationErrorsPerSec
  • Producer.ResendsPerSec
  • Producer.FailedSendsPerSec
  • Producer.MessagesPerSec
  • Producer.BytesPerSec
  • Producer.DroppedMessagesPerSec
  • KafkaController.UncleanLeaderElectionsPerSec
  • Network.RequestsPerSec
  • Network.NetworkProcessorAvgIdlePercent
  • Network.IdlePercent (per processing)
  • KafkaServer.RequestsPerSec
  • KafkaServer.BytesPerSec
  • KafkaServer.ExpiresPerSecond (for follower or consumer)
  • KafkaServer.RequestHandlerAvgIdlePercent
  • KafkaServer.MessagesInPerSec
  • KafkaServer.BytesInPerSec
  • KafkaServer.BytesOutPerSec
  • KafkaServer.BytesRejectedPerSec
  • KafkaServer.FailedProducerRequestsPerSec
  • KafkaServer.FailedFetchRequestsPerSec
  • ProduceRequestPurgatory.ExpiresPerSecond
  • ReplicaManager.IsrExpandsPerSec
  • ReplicaManager.IsrShrinksPerSec
  • MirrorMaker.MirrorMaker-DataChannel-WaitOnPut 
  • MirrorMaker.MirrorMaker-DataChannel-WaitOnTake

Timer

  • Consumer.FetchRequestRateAndTimeMs
  • Consumer.RebalanceRateAndTime
  • KafkaController.LeaderElectionRateAndTimeMs
  • Log.LogFlushRateAndTimeMs
  • Producer.ProducerRequestRateAndTimeMs
  • No labels