Ozone is a work in progress and there is no official release. To use it, you have to build a package and deploy a cluster.
Table of Contents | ||||
---|---|---|---|---|
|
Build Ozone
hdds
Maven profile enabled.Code Block | ||||
---|---|---|---|---|
| ||||
git clone git://git.apache.org/hadoop.git
cd hadoop && git checkout trunk
mvn clean package install -Phdds -DskipTests=true -Dmaven.javadoc.skip=true -Pdist -Dtar -DskipShade |
Initial compilation may take over 30 minutes as Maven downloads dependencies. skipShade
makes compilation a little faster for development and it is not required.
This will give you a tarball in your distribution directory. Here is an example of the tarball that will be generated.
hadoop-ozone/dist/target/ozone-0.3.0-SNAPSHOT.tar.gz
Start Cluster Using Docker
After building the package, run the following command in the git root directory.
Code Block | ||||
---|---|---|---|---|
| ||||
cd $(git rev-parse --show-toplevel)/hadoop-ozone/dist/target/ozone-*-SNAPSHOT/compose/ozone
docker-compose up -d |
For more docker-compose commands, please check the end of the Getting started with docker guide
To Shutdown the cluster, please run the command docker-compose down
Run Commands Against Ozone
To run commands on your Ozone cluster please ssh into any DataNode.
Code Block | ||||
---|---|---|---|---|
| ||||
docker-compose exec datanode bash |
The Ozone command shell is documented here.
Alternatively, you can try running freon, the load generator for ozone. The following command creates a volume, ten buckets and writes one hundred keys to each bucket using corona.
Code Block | ||||
---|---|---|---|---|
| ||||
ozone freon randomkeys --numOfVolumes=10 --numOfBuckets 10 --numOfKeys 10 --replicationType=RATIS --factor=THREE |
You can check the OzoneManager UI to see the activity generated by freon. The docker-compose
configuration forwards port 9874 of the docker host to the OzoneManager web UI.
http://localhost:9874/#!/metrics/ozoneManager
While you are there, please check out the ozone documentation.