Table of Contents |
---|
Status
Current state: Under DiscussionAccepted
Discussion thread: here
JIRA: here
Released: TBD0.11.0.0
Please keep the discussion on the mailing list rather than commenting on the wiki (wiki discussions get unwieldy fast).
...
- Mirroring data: an exact copy is desired, so deserializing/converting the data to Connect format is wasteful
- Output systems/formats that will just copy the raw data: for example, copying each record as a single line into a JSON file if it is already JSON encoded. Or copying what is truly a binary BLOB from a database into Kafka and from there to HDFS.
To address these use cases where avoiding the cost (CPU, memory, garbage collection overhead), this KIP proposes providing a ByteArrayConverter
supporting only a single type to be converted to/from the Kafka Connect data API, much like the ByteArraySerializer
/Deserializer
already provided for Java clients.
...