Status
Current state: Under Discussion
Discussion thread: here [Change the link from the KIP proposal email archive to your own email thread]
JIRA: here [Change the link from KAFKA-1 to your own ticket]
Please keep the discussion on the mailing list rather than commenting on the wiki (wiki discussions get unwieldy fast).
Motivation
We support a new type of OffsetSpce
in KIP-734 which is max-timestamp, and it's preferable to extend it to GetOffsetShell. In the future, maybe more OffsetSpce
types will be added to it.
Currently, we use KafkaConsumer to get offsets in GetOffsetShell, whereas the new OffsetSpec is only supported in AdminClient, so we need to change the client from KafkaConsumer to AdminClient.
Public Interfaces
Change --command-config parameter in GetOffsetShell from property file of KafkaConsumer Client to property file of AdminClient.
Proposed Changes
- Support max timestamp in GetOffsetShell
- Support All AdminClient config in the file specified by --command-config, the only new config is
retries
, which means we will resend any request that fails when getting offsets. - Some old KafkaConsumer config will be ignored, for example, key.deserializer and value.deserializer
Compatibility, Deprecation, and Migration Plan
Those consumer configs which can't work with admin config will be ignored, and the only mandatory config in AdminClient is bootstrap.servers, which is also mandatory in KafkaConsumer, so this is a compatible change
Rejected Alternatives
No