Getting started from the source

This is the traditional method. You need a build the projects as defined in Development cluster with docker page. Please follow the build instruction from there.

You can start it by going to the hadoop-dist/target/hadoop-3.1.0-alpha directory and start the cluster.

Configuration

There is a detailed documentation about the configuration of Ozone cluster. But If you would like to getting started, just save the following snippet to the etc/hadoop/ozone-site.xml (inside your hadoop distribution)

<properties>
<property><name>ozone.ksm.address</name><value>localhost</value></property>
<property><name>ozone.scm.datanode.id</name><value>/tmp/datanode.id</value></property>
<property><name>ozone.scm.names</name><value>localhost</value></property>
<property><name>ozone.handler.type</name><value>distributed</value></property>
<property><name>ozone.container.metadata.dirs</name><value>/tmp/metadata</value></property>
<property><name>ozone.scm.block.client.address</name><value>localhost</value></property>
<property><name>ozone.scm.client.address</name><value>localhost</value></property>
<property><name>ozone.enabled</name><value>True</value></property>
</properties>

Run

Ozone is designed to run concurrently with HDFS. The simplest way to start is to run start-dfs.sh from the $HADOOP/sbin/start-dfs.sh. Once HDFS is running, please verify it is fully functional by running some commands like.

hdfs dfs -mkdir /usr
hdfs dfs -ls /

Once you are sure that HDFS is running, start Ozone. To start ozone, you need to start SCM and KSM. Currently we assume that both KSM and SCM is running on the same node, this will change in future.

./hdfs --daemon start scm
./hdfs --daemon start ksm

if you would like to start HDFS and Ozone together, you can do that by running a single command.

$HADOOP/sbin/start-ozone.sh

This command will start HDFS and then start the ozone components.

Once you have ozone running you can use these ozone shell commands to create a volume, bucket and keys.