Versions Compared

Old Version 10

changes.mady.by.user Ivan Yurchenko

Saved on

compared with

New Version 11

changes.mady.by.user Ivan Yurchenko

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  1. Define the Batch Coordinator plugin interface.
  2. Describe the reference topic-based implementation of this interface that will be shipped with Kafka.

The KIP proposes that Kafka provide a production-grade implementation, but also that the mechanism is pluggable so that users and operators could have a Batch Coordinator implementation suitable for their use cases. Among the possible implementations are:

  • backed by a Kafka topic;

  • backed by a stand-alone database;
  • backed by the KRaft quorum;
  • backed by object storage itself.

Batch Coordinator

The Batch Coordinator is the source of truth about objects, partitions, and batches in diskless topics. It does the following:

...