Status

Current state: [Accepted]Under Discussion

Discussion thread: here

JIRA: KAFKA-7358 3333 Alternative Partitioner to Support "Always Round-Robin" Selection

Motivation

In my organisation, we have been using kafka as the basic publish-subscribe messaging system provider. Our goal is to send event-based (secure, encrypted) SQL messages reliably, and process them accordingly. For us, the message keys represent some metadata which we use to either ignore messages (if a loop-back to the sender), or log some information. We have the following use case for messaging:

...

To address this issue, we are proposing an alternative, and more concrete partitioner - "KeylessPartitionerRoundRobinPartitioner". We use "KeylessRound-Robin" as the new partitioner does not focus on the key or paritions. The partitioner code will almost be identical to DefaultPartitioner.partition() method, except that it will simply execute the "Null Key and No Partition" logic from DefaultPartitioner. The following is the content of partition() method for our new partitioner.

...