THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
...
A prototype implementation targeting Kafka 0.10.2.0 is available here.
Example
- TODO: Lag-aware assignment worked example (Grant Neale)
...
Suppose a consumer group contains two consumers C0 and C1, both subscribed to a topic t0 with 3 partitions: t0p0 (lag 100,000), t0p1 (lag 60,000) and t0p2 (lag 50,000).
The assignment generated by both RangeAssignor and RoundRobinAssignor will be:
| Consumer | Assigned Topic Partitions | Total Assigned Lag |
|---|---|---|
C0 | t0p0, t0p1 | 160,000 |
C1 | t0p2 | 50,000 |
The assignment generated by the proposed lag-aware assignor will be:
| Consumer | Assigned Topic Partitions | Total Assigned Lag |
|---|---|---|
C0 | t0p0 | 100,000 |
C1 | t0p1,t0p2 | 110,000 |
Compatibility, Deprecation, and Migration Plan
...