DUE TO SPAM, SIGN-UP IS DISABLED. Goto Selfserve wiki signup and request an account.
| Table of Contents |
|---|
Status
Current state: Under Discussion Voting in progress
Discussion thread: https://lists.apache.org/thread/z4o5093zqxmc18nzb74vyhvb1hb399v4
Vote thread: https://lists.apache.org/thread/jxf789v0kdpvsb9wsosghh57odkksxt7
JIRA:
| Jira | ||||||
|---|---|---|---|---|---|---|
|
...
| Metric Name | Type | Description |
| paused-partitions | Gauge (Integer) | The current number of partitions that have been paused by the user via Consumer.pause() . |
| paused-partitions-rate | Rate | The per-second rate of Consumer.pause() calls. |
| paused-partitions-total | CumulativeCount | The total cumulative number of Consumer.pause() calls. |
| paused-partitions-duration-seconds-max | Gauge (Long) | The maximum duration in seconds that any partition has been paused. Returns -1 if no partition is currently paused. |
consumer-fetch-manager-metrics
...
| Metric Name | Type | Description |
| paused-partitionspartition | Gauge (Integer) | Whether this partition is currently paused. Returns 1 if paused, 0 if not paused. |
| paused-partitionspartition-duration-seconds | Gauge (Long) | The time in seconds since this partition was paused. Returns -1 if the partition is not currently paused. |
| paused-partitionspartition-rate | Rate | The per-second rate of Consumer.pause() calls for this partition. |
| paused-partitionspartition-total | CumulativeCount | The total cumulative number of Consumer.pause() calls for this partition. |
...
Currently, each partition's internal state tracks whether it is paused with a simple boolean flag. To support the paused-partitions-duration-seconds metric, this KIP adds a timestamp that records when the partition was paused. The timestamp is set when pause() is called, cleared (reset to -1) when resume() is called, and also reset to -1 cleared on partition reassignment regardless of prior pause status. This ensures that a partition re-assigned to the same consumer after a rebalance starts with a clean pause state.
consumer-coordinator-metrics
A paused-partitions / paused-partitions gauge and -duration-seconds-max gauges and paused-partitions-rate / paused-partitions-total sensors are registered at coordinator level. When queried, this gauge computes these gauges compute the current count of paused partitions and max paused duration by reading from the consumer's subscription state. Sensor metrics are updated on each each pause() call, incrementing the cumulative count and contributing to the rate calculation.
consumer-fetch-manager-metrics
The paused-partitionspartition / paused-partitionspartition-duration-seconds gauges and paused-partitionspartition-rate / paused-partitionspartition-total sensors are registered per partition in the fetch manager metrics, alongside the existing per-partition lag and lead metrics. They follow the same lifecycle:
...