...

• Eliminate inter-zone data transfer costs from replication
• Eliminate inter-zone ingress and egress costs for data from producers and to consumers
• Permit multi-region active-active topics with automatic failover

Diskless topics will allow all Apache Kafka operators to:

...

• Broker Roles: Specializing brokers between produce/consume/coordination/compaction operations and permitting heterogeneous Kafka clusters
• Parallel Produce Handling: Processing multiple Produce requests concurrently, increasing potential throughput in high latency environments.
• Transactions on Diskless Topics: Including Diskless Topics in Exactly-Once Semantics Workloads
• Iceberg Format: Allowing massively parallel processing of at-rest topic data. This work enables a pluggable storage interface where one can innovate in the log format layer independently
• Dynamically Enabled Diskless: Allowing extremely easy migrations to try out & revert Diskless
• Unification/Relationship with Tiered Storage: Identifying a long-term vision for Diskless and Tiered Storage plugins
• Multi-region active-active topics with automatic failover

These components are less defined, and currently don’t have KIPs attached. Contributions are welcome to either suggest other extensions, or design one of the above extensions. Design, discussion, and voting on these is expected to begin after the integral KIPs are complete.

...

This KIP does not propose any new public interfaces; but its sub-KIPs will.

Compatibility, Deprecation, and Migration Plan

...