Versions Compared

Old Version 3

changes.mady.by.user Kirk True

Saved on

compared with

New Version 4

changes.mady.by.user Kirk True

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Partition reconciliation is the act of updating the consumer's internal state to reflect its assigned partitions. This reconciliation occurs in multiple steps, shown here:

Step 1

PlantUML Render Macro
border1
formatPNG
exportNamepartition-reconciliation-1.txt
titlePartition Reconciliation Step 1

@startuml
participant "Heartbeat\nRequest\nManager" as HRM
participant "Member\nState" as MS
participant "Assignment\nReconciler" as AR
participant "Revoke\nPartitions\nEvent" as RPE
queue "Backend\nEvent\nQueue" as BEQ

skinparam maxMessageSize 70

HRM -> MS: heartbeat received
activate MS

MS -> AR: delegate assignment reconciliation (if needed)    
activate AR

AR -> AR: determine partions to revoke
create RPE
AR -> RPE : new
AR -> BEQ : Enqueue event for application thread
AR -> MS : 
deactivate AR
MS -> HRM :
deactivate MS
@enduml


In the above...

Step 2

PlantUML Render Macro
border1
formatPNG
exportNamepartition-reconciliation-step-2.png
titlePartition Reconciliation Step 2

@startuml
actor User as U
participant ProtoAsyncConsumer as PAC
participant "Revoke\nPartitions\nEvent" as RPE

participant "Partitions\nRevoked\nEvent" as PRE

Participant "Consumer\nRebalance\nListener" as CRL
queue "Application\nEvent\nQueue" as AEQ

queue "Backend\nEvent\nQueue" as BEQ

skinparam maxMessageSize 70

U -> PAC: poll()
activate PAC

PAC -> BEQ: poll()
activate BEQ

return

PAC -> PAC: process background events
...

PAC -> RPE: partitions()

activate RPE

return


PAC -> CRL: partitionsRevoked()
activate CRL
return

create PRE
PAC -> PRE : new
PAC -> AEQ : add()

activate AEQ

return

return
@enduml


In the above...