You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 4 Next »

Ozone is a work in progress and currently lives in a branch. To use it, you have to build a package and deploy a cluster.

Building Ozone

To build Ozone, please check out the Hadoop sources from Github, Then check out the ozone branch HDFS-7240 and build it.
 git checkout HDFS-7240
 mvn clean package -DskipTests=true -Dmaven.javadoc.skip=true -Pdist -Dtar -DskipShade

*skipShade* is just to make compilation faster and not required.

This will give you a tarball in your distribution directory. Here is an example of the tarball that will be generated.

* `~/apache/hadoop/hadoop-dist/target/hadoop-project-dist-3.1.0-SNAPSHOT.tar.gz`

At this point, we have an option to set up a physical cluster or run ozone via docker.

Start an ozone cluster using docker

cd dev-support/compose/ozone
docker-compose up -d

For more docker-compose commands, please check the end of the Getting started with docker guide

To Shutdown the cluster, please run the command docker-compose down


Running commands against ozone

 

To run commands on your dozone cluster please ssh into the data node.

docker-compose exec datanode bash

 

Now we can run oz command shell or corona. Here is an example of running corona the load generator for ozone. 

The following command creates a volume, ten buckets and writes one hundred keys to each bucket using corona.

 

cd hadoop/bin
./hdfs corona -mode offline -validateWrites -numOfVolumes 1 -numOfBuckets 10 -numOfKeys 100

You can check the KSM UI to see the activity generated by corona.

http://localhost:9874/

While you are there, please check out the Ozone documentation.

 

  • No labels