DUE TO SPAM, SIGN-UP IS DISABLED. Goto Selfserve wiki signup and request an account.
...
A new metadata image is computed by controller. An epoch can represent the version of TopicImage. If there is number of partitions or partition racks change, the controller bumps the epoch. When coordinator receives a new metadata image and there is a new topic epoch, it triggers a rebalance for a group. The group also can store topic epoch map in records, so it can know the difference if the coordinator restarts. This approach save cpu and storage resources and avoid the downside of "Check Topic Delta to Trigger a Rebalance". However, this approach mixes the group coordinator logic within the controller.
Bump Group Version
Increase the group.version feature level to 2 to enable rack-aware rebalancing. However, there are two drawbacks to implementing this:
- It requires maintaining lot of if-else block to determine whether to use subscription metadata or group hash.
- When changing the
group.versionto 2, it triggers an epoch bump for all groups.