DUE TO SPAM, SIGN-UP IS DISABLED. Goto Selfserve wiki signup and request an account.
Status
Current state: DraftUnder Discussion
Discussion thread: Mailing list discussion - to be updated]
JIRA: [To Be Created]
| Jira | ||||||
|---|---|---|---|---|---|---|
|
Released: XXX
Please keep the discussion on the mailing list rather than commenting on the wiki (wiki discussions get unwieldy fast).
...
| Configuration | Type | Default | Description |
|---|---|---|---|
| remote.log.metrics.cost.attribution.enabled | Boolean | false | Master switch to enable client-level metrics |
| Int | 1000 | Maximum unique client-ids tracked (LRU eviction) |
| remote.log.metrics.include.partition | Boolean | false | Include partition tag (increases cardinality) |
...
Where:
• VEgress = Total bytes from RemoteFetchBytesPerConsumerGroup RemoteFetchBytesPerSec (aggregated count)
• REgress = Cloud provider's egress rate (e.g., $0.09/GB for Internet, $0.01/GB for Inter-AZ)
• NRequests = Total count from RemoteFetchRequestsPerConsumerGroup RemoteFetchRequestsPerSec + RemoteFetchErrorsPerSec
• RAPI = Cloud provider's API rate (e.g., $0.0004 per 1,000 GET requests)
...
- Verify exact byte count attribution for mock remote fetches
- Test LRU eviction with max.consumerclient.groups limitsensors limit
- Validate context propagation from FetchRequest to RemoteStorageFetchInfo
- Verify MBean unregistration upon sensor eviction
...
| Code Block |
|---|
sum(rate(kafka_server_remote_fetch_bytes_total[1h])) by (client_id) / sum(rate(kafka_server_remote_fetch_requests_total[1h])) by (client_id) |
Error rate by client:Promql
| Code Block |
|---|
sum(rate(kafka_server_remote_fetch_errors_total[1h])) by (client_id) |
...