THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
Ozone is a work in progress and currently lives in a branch. To use it, you have to build a package and deploy a cluster.
Building Ozone
To build Ozone, please check out the Hadoop sources from the Apache Git Rep. Then check out trunk and build it with the
hdds Maven profile enabled.| Code Block |
|---|
git clone git://git.apache.org/hadoop.git
git checkout trunk
mvn clean package install -Phdds -DskipTests=true -Dmaven.javadoc.skip=true -Pdist -Dtar -DskipShade |
skipShade makes compilation faster for development and is not required.
This will give you a tarball in your distribution directory. Here is an example of the tarball that will be generated.
* `~/apache/hadoop/hadoop-dist/target/hadoop-project-dist-3.2.0-SNAPSHOT.tar.gz`
At this point, we have an option to set up a physical cluster or run ozone via docker.
Start an Ozone cluster using docker
| Code Block |
|---|
cd dev-support/compose/ozone
docker-compose up -d |
For more docker-compose commands, please check the end of the Getting started with docker guide
To Shutdown the cluster, please run the command docker-compose down
Running commands against ozone
To run commands on your dozone cluster please ssh into the data node.
| Code Block |
|---|
docker-compose exec datanode bash |
Now we can run oz command shell or freon. Here is an example of running freon, the load generator for ozone.
The following command creates a volume, ten buckets and writes one hundred keys to each bucket using corona.
| Code Block |
|---|
cd hadoop/bin
./hdfs freon -mode offline -validateWrites -numOfVolumes 1 -numOfBuckets 10 -numOfKeys 100 |
You can check the KSM UI to see the activity generated by corona.
While you are there, please check out the ozone documentation.