Versions Compared

Old Version 6

changes.mady.by.user Sammi Chen

Saved on

compared with

New Version Current

changes.mady.by.user Attila Doroszlai

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: fix feature branch link

Git branch: https://github.com/apache/ozone/tree/HDDS-3630


Currently there will be one RocksDB for each Container on datanode, which leads to hundreds of thousands of RocksDB instances on one datanode. It's very challenge challenging to manage this amount of RocksDB instances in one JVM. Please refer to the "problem statement" section of the design document for detail challenges. Different than [1] for challenge details. Unlike the current approach, Datanode RocksDB merge feature will use only one RocksDB for each data volume. With far less fewer RocksDB instance instances to manage, the write path performance and DN stability is improvementare improved, Refer to the Micro Benchmark Data section of the design document. 


To enable the feature, the following configs need to be added to Ozone Manager's ozone-site.xml.

...