Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

This KIP proposes to migrate to incrementalAlterConfigs API for syncing topic configurations in MirrorMaker. The incrementalAlterConfigs API has been around for several years since it was introduced in Kafka 2.3.0 and addresses the shortcoming of the deprecated alterConfigs  API. In order not to break the compatibility, we will introduce a new setting to MirrorMaker to give the option to enable incrementalAlterConfigs API for syncing topic configurations. This new setting is expected to serve as a temporary measure until the next major release when the API is always used. 

It also proposes includes a proposal to add an option the ability to use the target cluster's default for the target topic configurations instead of , rather than using the source cluster's default. For example, if the user wants to use the target cluster default, the  ConfigPropertyFilter would be used instance, users would be able to configure ConfigPropertyFilter to check if the configuration on the source topic has been dynamically set and decide which cluster default should be usedis the default and decide whether or not to replicate it to the target topic

Proposed Changes

1) Add a new method updateTopicConfigsUsingIncrementalAlterConfigs() to MirrorSourceConnector.java which takes a list topic configurations as a parameter and calls incrementalAlterConfigs() to the target cluster. 

...