Versions Compared

Old Version 5

changes.mady.by.user Sammi Chen

Saved on

compared with

New Version 6

changes.mady.by.user Sammi Chen

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Currently there will be one RocksDB for each Container on datanode, which leads to hundreds of thousands of RocksDB instances on one datanode. It's very challenge to manage this amount of RocksDB instances in one JVM. Please refer to the "problem statement" section of the design document [1] for detail challenges. Different than current approach, Datanode RocksDB merge feature will use only one RocksDB for each data volume. With far less RocksDB instance to manage, the write path performance and DN stability is improvement, Refer to the Micro Benchmark Data section of design document[1]. 

For more, please check out the full documentation. The doc has feature overview, setup guide, CLI guide and access control guide (best viewed locally rendered using hugo serve command under ./hadoop-hdds/docs/ , as it is not published to the website yet).


To enable the feature, the following configs need to be added to Ozone Manager's ozone-site.xml.

...

2. Documentation

Documentation has been is being added since by 

Jira
serverASF JIRA
columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,customfield_12311032,customfield_12311037,customfield_12311022,customfield_12311027,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,Priority,Priority,Priority,Priority,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyHDDS-62756790
and is under constant revision.The doc (S3-Multi-Tenancy.md, S3-Tenant-Commands.md and so on) can be found under https://github.com/apache/ozone/tree/HDDS-4944/hadoop-hdds/docs/content/feature . 

3. Design, attached the docs

...

5. Docker-compose / acceptance tests

New acceptance test is being added by Jira:

Jira
serverASF JIRA
columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyHDDS-6791
No addition.

6. Support of containers / Kubernetes:

...