THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
...
Delivery goal: Scale down supportSpecifically
We will focus on the delivery of scaling down support upon the success of version 1.0
- Tag for leaving members.
- Create new tooling for marking instances as ready to scale down
- Scale down timeout implementation
...
scale.down.timeout.ms Default: infinity | Timeout in milliseconds to force terminate the stream worker when informed to be scaled down. | stream.worker.balancing.factor Default: 2 | The tolerance of task imbalance factor between hosts to trigger rebalance. |
| stream.rebalancing.mode Default: incremental | The setting to help ensure no downtime upgrade of online application. Options : upgrading, incremental |
...
| stream.worker.balancing.factor Default: 2 | The tolerance of task imbalance factor between hosts to trigger rebalance. |
Implementation Plan
We want to callout this portion because the algorithm we are gonna design is fairly complicated so far. To make sure the delivery is smooth with fundamental changes of KStream internals, I build a separate Google Doc here that could be sharable to outline the step of changes. Feel free to give your feedback on this plan while reviewing the algorithm, because some of the changes are highly coupled with internal changes. Without these details, the algorithm is not making sense.
...