...

Current state:"Under Discussion"

Discussion thread: here [TODO]

JIRA: here

Please keep the discussion on the mailing list rather than commenting on the wiki (wiki discussions get unwieldy fast).

Motivation

This KIP is aimed to extend current Consumer Group Reset Offset tooling (implemented by KIP-122[1]) for Kafka Streams applications.

There is an existing tooling that is specific for Streams Applications "kafka-streams-application-reset" but it only supports Streams, overlapping with Reset Offset tooling, and also only support reset to earliest offset in input topics.

Public Interfaces

"kafka-streams-application-reset" supports the current features[2]:

1. for any specified input topic, it resets all offsets to zero
2. for any specified intermediate topic, seeks to the end for all partitions
3. for all internal topic
   3.1. resets all offsets to zero
   3.2. deletes the topic

This new functionality will add the same features to Consumer Group's reset-offset command:

1. Input topics will be part of regular `--topics` option.
2. There will be a new `--intermediate-topics` option to specify intermediate topics.
3. Internal topics will be reset to zero.

Application ID input will be specified as `--group` option.

Proposed Changes

1. New Intermediate Topics option

A new `--intermediate-topics` will be available to specify Streams intermediate topics, where Consumer Group offsets will be moved to the latest offset.

2. Internal Changes

• Group ID `--group` will be also considered as Application ID to search internal topics.

• Internal Topics will be search and removed Consumer Group offsets will be moved to earliest offset.

...