...

Please keep the discussion on the mailing list rather than commenting on the wiki (wiki discussions get unwieldy fast).

Motivation

The Kafka Connect framework stores the most recent offsets for source and sink connectors in Kafka topics. While offsets for sink connectors are managed by the Kafka consumers, the offsets for source connectors are managed entirely by the Connect runtime. When operating a source connector, it is sometimes desirable to manually change or override the persisted offsets. For example, if a connector fails to produce a message at a particular offset, an operator may choose to skip over that source-specific offset and have the connector restart at the next message. The Connect API allows source connectors to specify a source offset for each source partition, where the partitions and offsets are defined by the source connectors as sets of key-value pairs (e.g., maps). The proposed tool will allow users to read the existing partition-offset pairs for the connectors, update/modify them, and then store the partition-offset pairs back to the Kafka topic.

...