Ozone is a work in progress and there is no official release. To use it, you have to build a package and deploy a cluster.
Table of Contents | ||||
---|---|---|---|---|
|
Build Ozone
hdds
Maven profile enabled.Code Block | ||||
---|---|---|---|---|
| ||||
git clone git://git.apache.org/hadoop.git
cd hadoop && git checkout trunk
mvn clean package install -Phdds -DskipTests=true -Dmaven.javadoc.skip=true -Pdist -Dtar -DskipShade |
Initial compilation may take over 30 minutes as Maven downloads dependencies. skipShade
makes compilation a little faster for development and it is not required.
This will give you a tarball in your distribution directory. Here is an example of the tarball that will be generated.
hadoop-dist/target/hadoop-project-dist-3.2.0-SNAPSHOT.tar.gz
Start Cluster Using Docker
After building the package, run the following command in the git root directory.
Code Block | ||||
---|---|---|---|---|
| ||||
cd $(git rev-parse --show-toplevel)/hadoop-dist/target/ozone-?.?.?-SNAPSHOT/compose/ozone
docker-compose up -d |
For more docker-compose commands, please check the end of the Getting started with docker guide
To Shutdown the cluster, please run the command docker-compose down
Run Commands Against Ozone
To run commands on your Ozone cluster please ssh into any DataNode.
Code Block | ||||
---|---|---|---|---|
| ||||
docker-compose exec datanode bash |
The Ozone command shell is documented here.
Alternatively, you can try running freon, the load generator for ozone. The following command creates a volume, ten buckets and writes one hundred keys to each bucket using corona.
Code Block | ||||
---|---|---|---|---|
| ||||
ozone freon -mode offline -validateWrites -numOfVolumes 1 -numOfBuckets 10 -numOfKeys 100 |
You can check the OzoneManager UI to see the activity generated by corona. The docker-compose
configuration forwards port 9874 of the docker host to the OzoneManager web UI.
http://localhost:9874/#!/metrics/ozoneManager
While you are there, please check out the ozone documentation.