...
This KIP introduces the following additions to the public interfaces. No broker changes are needed.
Client API changes
In the interface Producer<K,V>, we are going to add a new method as below
...
No change is needed for Consumer<K, V> because KIP-712 already introduced 'fetch.raw.bytes' so that the ingestion consumer can fetch the byte buffer directly.
No broker changes are needed.
Proposed Changes
We propose adding Parquet as the encoder and optionally compressor in Kafka producer client. When this feature is enabled, Parquet is used to encode the batch records segment and optionally compress. Parquet has the encoding and compression in a columnar-oriented way.
...