Versions Compared

Old Version 2

changes.mady.by.user Rakesh Radhakrishnan

Saved on

compared with

New Version 3

changes.mady.by.user Rakesh Radhakrishnan

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Introduction:

Presently, a rename/delete operation can become prohibitively expensive for such directories which have large sub-trees/sub-paths. Ozone does rename/delete each and every sub-file & sub-dir under the given directory via multiple RPC calls to OM thus makes it very expensive. Also, rename and delete doesn't guarantee the atomicity.

The prefix based FileSystem optimization idea allows to perform rename, delete of any directory in a deterministic/constant time atomically. Now, ozone performs rename/delete operations in a single RPC call by sending only the given directory to OM. It will finish rename, delete operations with O(1) complexity. Also, makes it possible to support atomic rename/delete of any directory at any level in the namespace.

Git Branch:

Implementing this in a separate feature HDDS-2939 branch. Thanks to all contributors/reviewers.