...
Discussion thread | https://lists.apache.org/thread/ttmxvs135pqxtydp31xdgvp6w9n9g8tr |
---|---|
Vote thread | |
ISSUE | https://github.com/apache/incubator-paimon/issues/2113 |
Release | 0.6TBD |
Motivation
With the growing amount of information stored, the importance of stored data to individuals, companies and governments is ever increasing. In addition to traditional storage criteria such as performance, capacity and reliability, security is also becoming an important feature of storage systems.and there are some industries that have mandatory legal requirements for it, such as bank, transportation, etc.
...
As a data lake framework, it is very important for paimon in supporting data encryption to meet enterprise security standards. This document describes how to extend the current paimon architecture to provide users with out-of-the-box encryption capabilities.
Goals
Not related to engine
It is not related to the engine, when enable encryption, users can read and write paimon by any engines (Flink, Spark, Java API)
Pluggable KMS
The key management service (KMS) is pluggable in the system,
...