Ozone is a work in progress and there is no official release. To use it, you have to build a package and deploy a cluster.
Build Ozone
hdds
Maven profile enabled.git clone git://git.apache.org/hadoop.git cd hadoop && git checkout trunk mvn clean package install -Phdds -DskipTests=true -Dmaven.javadoc.skip=true -Pdist -Dtar -DskipShade
Initial compilation may take over 30 minutes as Maven downloads dependencies. skipShade
makes compilation a little faster for development and it is not required.
This will give you a tarball in your distribution directory. Here is an example of the tarball that will be generated.
hadoop-dist/target/hadoop-project-dist-3.2.0-SNAPSHOT.tar.gz
Start Cluster Using Docker
After building the package, run the following command in the git root directory.
cd $(git rev-parse --show-toplevel)/hadoop-dist/target/ozone-?.?.?-SNAPSHOT/compose docker-compose up -d
For more docker-compose commands, please check the end of the Getting started with docker guide
To Shutdown the cluster, please run the command docker-compose down
Run Commands Against Ozone
To run commands on your Ozone cluster please ssh into any DataNode.
docker-compose exec datanode bash
The Ozone command shell is documented here.
Alternatively, you can try running freon, the load generator for ozone. The following command creates a volume, ten buckets and writes one hundred keys to each bucket using corona.
ozone freon -mode offline -validateWrites -numOfVolumes 1 -numOfBuckets 10 -numOfKeys 100
You can check the OzoneManager UI to see the activity generated by corona. The docker-compose
configuration forwards port 9874 of the docker host to the OzoneManager web UI.
While you are there, please check out the ozone documentation.