Ozone is a work in progress and currently lives in a branchthere is no official release. To use it, you have to build a package and deploy a cluster.
...
Build Ozone
hdds
Maven profile enabled.Code Block |
---|
git clone git://git.apache.org/hadoop.git cd hadoop && git checkout trunk mvn clean package install -Phdds -DskipTests=true -Dmaven.javadoc.skip=true -Pdist -Dtar -DskipShade |
...
This will give you a tarball in your distribution directory. Here is an example of the tarball that will be generated.
* `~~/apache/hadoop/hadoop-dist/target/hadoop-project-dist-3.2.0-SNAPSHOT.tar.
gz`
At this point, we have an option to set up a physical cluster or run ozone via docker.
Start an Ozone cluster using docker
gz
Start Cluster Using Docker
After building the package, run the following command in the git root directory.
Code Block |
---|
cd $(git rev-parse --show-toplevel)/dev-support/compose/ozone
docker-compose up -d |
...
To Shutdown the cluster, please run the command docker-compose down
Running commands against ozone
...
Run Commands Against Ozone
To run commands on your dozone Ozone cluster please ssh into the data nodeany DataNode.
Code Block |
---|
docker-compose exec datanode bash |
Now we
The Ozone command shell is documented here.
Alternatively, you can try running freon can run oz command shell or freon. Here is an example of running freon, the load generator for ozone. The following command creates a volume, ten buckets and writes one hundred keys to each bucket using corona.
Code Block |
---|
cd hadoop/bin ./hdfs freon -mode offline -validateWrites -numOfVolumes 1 -numOfBuckets 10 -numOfKeys 100 |
You can check the KSM OzoneManager UI to see the activity generated by corona. The docker-compose
configuration forwards port 9874 of the docker host to the OzoneManager web UI.
While you are there, please check out the ozone documentation.
...