Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Note that to make sure the above resource shuffling could happen as expected, we need to have the following task status indicators to be provided:

Tag NameTask TypeExplanationprerequisites
isStatefulbothIndicate whether given task has a state to restore.N/A
isLearnerstandbyIndicate whether standby task is a learner task.isStateful = True
beingLearnedactiveIndicate whether active task is being learned by some other stream worker.isStateful = True
isReadystandbyIndicate whether standby task is ready to serve as active task.isLearner = True and isStateful = True
isStateful
isLeaving
both
activeIndicate whether
given task has a state to restore.N/A
active task will be leaving the group soon.isStateful = True


Algorithm Walkthrough

The above examples are focusing more on demonstrating expected behaviors with KStream incremental rebalancing.  We also want to define the new learner algorithm for a holistic view.

...