Page History

...

In the context of a bidirectional replication, a reverse checkpoint can be created by using the offset-syncs of the opposite flow. The upstream:downstream offset pairs of the opposite flow can be used to implement the reverse mappings.

Image Added

Changes to implement:

1. Update OffsetSyncStore to be able to track reverse offsets. (subclass/flag)
2. Update MirrorCheckpointTask to instantiate an OffsetSyncStore for the reverse checkpointing, consuming from the offset-syncs topic of the opposite flow. (i.e. if the offset syncs of the current flow are located in the source, the offset sync of the opposite flow will be in the target)
3. Update MirrorCheckpointTask to generate reverse checkpoints - i.e. in the B -> A flow, identify topics in B which were replicated from A (with DefaultReplicationPolicy, all topics starting with "A."), use reverse offset syncs, and transform the topic name back to the upstream name (with DefaultReplicationPolicy, strip the starting "A.").

...