DUE TO SPAM, SIGN-UP IS DISABLED. Goto Selfserve wiki signup and request an account.
...
We have the RemoteClusterUtils API to enable users to perform some operations of their MirrorMaker environmentenvironments. One method from this API, translateOffsets(), allows to manually translate consumer group offsets. This is useful when MirrorCheckpointConnector is not configured to automatically sync offsets or when dealing with a disaster and unplanned failover. This method works by fully reading the checkpoints topic which is populated by MirrorCheckpointConnector, so this can be an expensive call and it can take a long time depending on the size of the topic. This method takes a single consumer group id as input, so it makes it unsuitable in cases when the offsets of several consumer groups have to be translated as each call re-reads the full topic.
...
A new translateOffsets() method in RemoteClusterUtils , that takes a regex pattern to specify the consumer groups:
...
- This is adding new methods. There are no behavior changes to existing methods or logic.
Test Plan
The new methods will be tested using unit tests. This will require some refactoring in MirrorClient to make the remoteConsumerOffsets() method testable (we currently don't have tests for that method).
...