You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 8 Next »

Ozone is a work in progress and currently lives in a branch. To use it, you have to build a package and deploy a cluster.

Building Ozone

To build Ozone, please check out the Hadoop sources from the Apache Git Rep. Then check out trunk and build it with the hdds Maven profile enabled.
 git clone git://git.apache.org/hadoop.git
 git checkout trunk
 mvn clean package install -Phdds -DskipTests=true -Dmaven.javadoc.skip=true -Pdist -Dtar -DskipShade

skipShade makes compilation faster for development and is not required.

This will give you a tarball in your distribution directory. Here is an example of the tarball that will be generated.

* `~/apache/hadoop/hadoop-dist/target/hadoop-project-dist-3.2.0-SNAPSHOT.tar.gz`

At this point, we have an option to set up a physical cluster or run ozone via docker.

Start an Ozone cluster using docker

cd dev-support/compose/ozone
docker-compose up -d

For more docker-compose commands, please check the end of the Getting started with docker guide

To Shutdown the cluster, please run the command docker-compose down


Running commands against ozone

 

To run commands on your dozone cluster please ssh into the data node.

docker-compose exec datanode bash

 

Now we can run oz command shell or freon. Here is an example of running freon, the load generator for ozone. 

The following command creates a volume, ten buckets and writes one hundred keys to each bucket using corona.

 

cd hadoop/bin
./hdfs freon -mode offline -validateWrites -numOfVolumes 1 -numOfBuckets 10 -numOfKeys 100

You can check the KSM UI to see the activity generated by corona.

http://localhost:9874/

While you are there, please check out the ozone documentation.

 

  • No labels