Versions Compared

Old Version 54

changes.mady.by.user Mason Chen

Saved on

compared with

New Version 55

changes.mady.by.user Mason Chen

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Other required functionality leverages and composes the existing KafkaSource implementation for discovering Kafka topic partition offsets and round robin split assignment per Kafka cluster. The diagrams below depicts how the source will reuse the code of the KafkaSource in order to achieve the requirements.

Image Modified

To the source more user friendly, a MultiClusterKafkaSourceBuilder will be provided (e.g. batch mode should not turn on KafkaMetadataService discovery, should only be done at startup).

...