Page History

...

In addition to the minimum viable implementation described in the integral KIPs above, below are some optional follow-ups. These are features which are not critical to the core functionality, but are natural extensions, further optimizations, and new innovations which are unlocked once the core functionality is in place.

• Topic Type Changing: Allow classic topics to be changed into Diskless and vice versa.
• Broker Roles: Specializing brokers between produce/consume/coordination/compaction operations and permitting heterogeneous Kafka clusters
• Parallel Produce Handling: Processing multiple Produce requests concurrently, increasing potential throughput in high latency environments.
• Iceberg Format: Allowing massively parallel processing of at-rest topic data. This work enables a pluggable storage interface where one can innovate in the log format layer independently
• Dynamically Enabled Diskless: Allowing extremely easy migrations to try out & revert Diskless
• Multi-region active-active topics with automatic failover

...