THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
Ozone is a work in progress and currently lives in a branch. To use it, you have to build a package and deploy a cluster.
Building Ozone
To build Ozone, please check out the Hadoop sources from Github, Then check out the ozone branch HDFS-7240 and build it.
| Code Block |
|---|
git checkout HDFS-7240
mvn clean package -DskipTests=true -Dmaven.javadoc.skip=true -Pdist -Dtar -DskipShade |
*skipShade* is just to make compilation faster and not required.
This will give you a tarball in your distribution directory. Here is an example of the tarball that will be generated.
* `~/apache/hadoop/hadoop-dist/target/hadoop-project-dist-3.1.0-SNAPSHOT.tar.gz`
At this point, we have an option to set up a physical cluster or run ozone via docker.
Start an ozone cluster using docker
| Code Block |
|---|
cd dev-support/compose/ozone
docker-compose up -d |
For more docker-compose commands, please check the end of the Getting started with docker guide
To Shutdown the cluster run the command docker-compose down
Running commands against ozone
To run commands on your dozone cluster please ssh into the datanode.
| Code Block |
|---|
docker-compose exec datanode bash |
Now we can run oz command shell or corona. Here is an example of running corona the load generator for ozone.
The following command creates a volume, ten buckets and writes one hundred keys to each bucket using corona.
| Code Block |
|---|
cd hadoop/bin
./hdfs corona -mode offline -validateWrites -numOfVolumes 1 -numOfBuckets 10 -numOfKeys 100 |
You can check the KSM UI to see the activity generated by corona.
While you are there, please check out the Ozone documentation.