Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

After completion of the key change preparation process, a new distributed process is initiated to complete the key change.

The discovery event from the distributed process pushes a new exchange task to the exchange worker to start PME free switch (it is required to prevent reordering of WAL records when key will be changed and to simplify initial design, this could be changed in the future)

While updates are blocked each node:

distributed process configured action initiates partition swapping on each node (this action may require suspension of local or global operations if WAL records can be reordered during key change).

  1. Acquire checkpoint lock.Forces the checkpoint (required for WAL consistency?)
  2. Swap all partition files:
    1. Backup original file.
    2. Move re-encrypted file to the place of the original one.
  3. Change encryption key(s) in metastore (update encryption keys history - add new key and set current WAL pointer to previous key).
  4. Cancel checkpoint updates for copied partitions.
  5. Release checkpoint lock.
  6. Force checkpoint
  7. Remove partition backups (2a).

...