Here's a more-or-less exhaustive list of metrics Kafka reports in 0.8.2.0.
I may have misattributed some of the parent classes (I generated the list from code and there are some class hierarchy things involved), so feel free to fix the misnames.
Gauge
- ProducerRequestPurgatory.NumDelayedRequests
- ProducerRequestPurgatory.PurgatorySize
- FetchRequestPurgatory.NumDelayedRequests
- FetchRequestPurgatory.PurgatorySize
- ReplicaManager.PartitionCount
- ReplicaManager.UnderReplicatedPartitions
- ReplicaManager.LeaderCount
- KafkaController.PreferredReplicaImbalanceCount
- KafkaController.ActiveControllerCount
- KafkaController.OfflinePartitionsCount
- Log.LogEndOffset
- Log.LogStartOffset
- Log.size
- Log.NumLogSegments
- AppInfo.Version
- Consumer.OwnedPartitionsCount
- Producer.ProducerQueueSize
- Log.max-buffer-utilization-percent
- Log.cleaner-recopy-percent
- Log.max-clean-time-secs
- Log.max-dirty-percen
- Network.RequestQueueSize
- Network.ResponseQueueSize
- Network.ResponsesBeingSent
- KafkaServer.MaxLag
- KafkaServer.ConsumerLag
- KafkaServer.MinFetchRate
- KafkaServer.BrokerState
- OffsetManager.NumOffsets
- OffsetManager.NumGroups
- MirrorMaker.NumUnackedMessages
- MirrorMaker.UnackedOffsetListsSize
- MirrorMaker.NumSkippedOffsets
Histograms
(The Network ones are collected by API request type)
- Consumer.FetchResponseSize
- Producer.ProducerRequestSize
- Network.RequestQueueTimeMs
- Network.LocalTimeMs
- Network.RemoteTimeMs
- Network.ResponseQueueTimeMs
- Network.ResponseSendTimeMs
- Network.TotalTimeMs
- MirrorMaker.MirrorMaker-DataChannel-queue-%d-NumMessages
- MirrorMaker-DataChannel-queue-%d-NumMessages
- MirrorMaker-DataChannel-Record-Siz
Metered
- Consumer.MessagesPerSec
- Consumer.BytesPerSec
- Consumer.KafkaCommitsPerSec
- Consumer.ZookeeperCommitsPerSec
- Producer.SerializationErrorsPerSec
- Producer.ResendsPerSec
- Producer.FailedSendsPerSec
- Producer.MessagesPerSec
- Producer.BytesPerSec
- Producer.DroppedMessagesPerSec
- KafkaController.UncleanLeaderElectionsPerSec
- Network.RequestsPerSec
- Network.NetworkProcessorAvgIdlePercent
- Network.IdlePercent (per processing)
- KafkaServer.RequestsPerSec
- KafkaServer.BytesPerSec
- KafkaServer.ExpiresPerSecond (for follower or consumer)
- KafkaServer.RequestHandlerAvgIdlePercent
- KafkaServer.MessagesInPerSec
- KafkaServer.BytesInPerSec
- KafkaServer.BytesOutPerSec
- KafkaServer.BytesRejectedPerSec
- KafkaServer.FailedProducerRequestsPerSec
- KafkaServer.FailedFetchRequestsPerSec
- ProduceRequestPurgatory.ExpiresPerSecond
- ReplicaManager.IsrExpandsPerSec
- ReplicaManager.IsrShrinksPerSec
- MirrorMaker.MirrorMaker-DataChannel-WaitOnPut
- MirrorMaker.MirrorMaker-DataChannel-WaitOnTake
Timer
- Consumer.FetchRequestRateAndTimeMs
- Consumer.RebalanceRateAndTime
- KafkaController.LeaderElectionRateAndTimeMs
- Log.LogFlushRateAndTimeMs
- Producer.ProducerRequestRateAndTimeMs