...
As SinkTask can only be created by SinkConnector, MirrorSinkConnector will be implemented and follow the most same logics as current MirrorSourceConnector. To minimize the duplicate code, a new class, e.g. "MirrorCommonConnector", may be proposed to host the common code as a separate code change merged before this KIP.
WorkerSinkTask
Due to the fact that group offsets from target cluster is single-source-of-truth, each time when MirrorSInkTask restarts, it loads group offsets from target cluster and supply them to the consumer in WorkerSinkTask so that the consumer will rewind to the last committed offsets without duplicating or missing data. However in our test, we ran into
Jira | ||||||
---|---|---|---|---|---|---|
|
Migration from MirrorSourceConnector to MirrorSinkConnector /w EOS
...