Versions Compared

Old Version 3

changes.mady.by.user Ewen Cheslack-Postava

Saved on

compared with

New Version 4

changes.mady.by.user Gwen Shapira

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • Mirroring data: an exact copy is desired, so deserializing/converting the data to Connect format is wasteful
  • Output systems/formats that will just copy the raw data: for example, copying each record as a single line into a JSON file if it is already JSON encoded. Or copying what is truly a binary BLOB from a database into Kafka and from there to HDFS.

To address these use cases where avoiding the cost (CPU, memory, garbage collection overhead), this KIP proposes providing a ByteArrayConverter supporting only a single type to be converted to/from the Kafka Connect data API, much like the ByteArraySerializer/Deserializer already provided for Java clients.

...