Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Parquet has a built-in column encryption feature that would enable Kafka to have field encryption for free,  offering several advantages: 1) It applies AES to the block of fields (i.e., Parquet page), minimizing overhead (5.7% for write and 3.7% for read). 2) It supports all data types of fields, including Boolean. 3) It is almost becoming industry standard now for big data column encryption mature and deployed at scale e.g. Uber, Apple, and AWS. 4) It operates at the data format layer, requiring Kafka only to enable it.

...