Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • EncryptionManager : Module for encrypting and decrypting table data files[2]
  • KeyManagementClient : A minimum client interface to connect to a key management service (KMS) [3]

Hudi and iceberg also have some shortcomings. Hudi relies on Spark , Iceberg only provides basic interfaces without corresponding implementation classes.

As a data lake framework, it is very important for paimon in supporting data encryption to meet enterprise security standards. This document describes how to extend the current paimon architecture to provide users with out-of-the-box encryption capabilities.

...