Hadoop Distributed Data Store and Applications

Hadoop Distributed Data Store (HDDS) is a distributed, replicated block layer that allows separation of block layer and namespace for HDFS.

HDDS allows different kind of storage systems to be built on an HDFS cluster. Ozone is a distributed key-value store built using HDDS.

It is a redundant, distributed object store built by leveraging primitives present in HDDS. Ozone supports REST API for accessing the store.

Ozone is a work in progress and currently in alpha state. To test, you need to build if from the source code or use Hadoop version higher than 3.1.

Getting started

To run an Ozone cluster you have multiple options:

1. Use prebaked docker images from the docker hub (no build is required, but these images are not from the Apache Hadoop project)

2. Build a new Ozone cluster from the source code and start a cluster with docker (also useful for development)
3. Build new Ozone cluster from the source code and start it with the startup scripts without docker.

Additional information

• To follow the progress of Ozone development you can check the JIRA dashboard

• A detailed discussion of Ozone file system and design docs can be found here. 
• A detailed and work items for the security of  Hadoop Distributed Storage Layer is tracked in this JIRA

• The documentation is part of the source code, but you can check out directly from github: https://github.com/apache/hadoop/tree/trunk/hadoop-ozone/docs/content See the markdown files with Ozone prefix (Or you can generate a new site from the feature branch)