Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Ozone is a work in progress and there is no official release. To use it, you have to build a package and deploy a cluster.

Build Ozone

To build Ozone, please check out the Hadoop sources from the Apache Git Rep. Then check out trunk and build it with the hdds Maven profile enabled.
Code Block
  git clone git://git.apache.org/hadoop.git
  cd hadoop && git checkout trunk
  mvn clean package install -Phdds -DskipTests=true -Dmaven.javadoc.skip=true -Pdist -Dtar -DskipShade

Initial compilation may take over 30 minutes as Maven downloads dependencies. skipShade makes compilation a little faster for development and it is not required.

This will give you a tarball in your distribution directory. Here is an example of the tarball that will be generated.

hadoop-dist/target/hadoop-project-dist-3.2.0-SNAPSHOT.tar.gz

Start Cluster Using Docker

After building the package, run the following command in the git root directory.

Code Block
  cd $(git rev-parse --show-toplevel)/hadoop-dist/target/ozone-?.?.?-SNAPSHOT/compose/ozone
  docker-compose up -d

For more docker-compose commands, please check the end of the Getting started with docker guide

To Shutdown the cluster, please run the command docker-compose down

Run Commands Against Ozone

To run commands on your Ozone cluster please ssh into any DataNode.

Code Block
  docker-compose exec datanode bash

 

The Ozone command shell is documented here.

Alternatively, you can try running freon, the load generator for ozone. The following command creates a volume, ten buckets and writes one hundred keys to each bucket using corona.

Code Block
  ozone freon -mode offline -validateWrites -numOfVolumes 1 -numOfBuckets 10 -numOfKeys 100

You can check the OzoneManager UI to see the activity generated by corona. The docker-compose configuration forwards port 9874 of the docker host to the OzoneManager web UI.

http://localhost:9874/#!/metrics/ozoneManager

While you are there, please check out the ozone documentation.

 Content moved to Try out Ozone#StartClusterUsingDocker