THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
...
Note that to make sure the above resource shuffling could happen as expected, we need to have the following task status indicators to be provided:
Tag Name | Task Type | Explanation | prerequisites |
---|---|---|---|
isStateful | both | Indicate whether given task has a state to restore. | N/A |
isLearner | standby | Indicate whether standby task is a learner task. | isStateful = True |
beingLearned | active | Indicate whether active task is being learned by some other stream worker. | isStateful = True |
isReady | standby | Indicate whether standby task is ready to serve as active task. | isLearner = True and isStateful = True |
isLeaving |
active | Indicate whether |
active task will be leaving the group soon. | isStateful = True |
Algorithm Walkthrough
The above examples are focusing more on demonstrating expected behaviors with KStream incremental rebalancing. We also want to define the new learner algorithm for a holistic view.
...