Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Kafka Improvement Proposal: Quality of Service (QoS) Framework

Status

Draft

Motivation

Apache Kafka has become the de facto standard for event streaming, with a growing ecosystem of Kafka-compliant services and implementations. While these services conform to the wire protocol, they differ drastically in their Quality of Service (QoS) characteristics—including latency, throughput, elasticity, storage architecture, and observability.

...

Future Work

  • Define a formal grammar (e.g., JSON Schema or protobuf) for QoS metadata
  • Add QoS negotiation APIs to Kafka clients
  • Integrate QoS metrics into JMX and logging outputs
  • Establish community-led working groups for specific QoS dimensions (latency, elasticity, retention, etc.)
  • Explore alignment with schema evolution and data contracts

...