Status

Current state: Under DiscussionComplete

Discussion thread:   https://lists.apache.org/thread/14zykd5t0zjosb286pqtz1lkyvyzfo45

JIRA:

Released:  Kafka Connector v3.1.0

Motivation

KIP-70836 was implemented some time ago in Kafka. This allows brokers and consumers to communicate about the rack (or AWS Availability Zone) they're located in. Reading from a local broker can save money in bandwidth and improve latency for your consumers.

...

KafkaSourceBuilder will get a new method setRackId() that will take a callback as an argument. Setting this value will result in the value of the `clientclient.rack` rack property for the Kafka client on each Task Manager. Note that to see any behavior change or benefit from this setting, the Kafka brokers the client is connecting to must be configured to assign replicas with the RackAwareReplicaSelector and have their own broker rack IDs set correspondingly to the client rack IDs. 

...