Running a pseudo-cluster without Docker

This is the traditional method. Please follow the build instructions from the Development cluster with docker page to build the Ozone tarball.

You can start it by going to the hadoop-dist/target/hadoop-3.2.0-SNAPSHOT directory and start the cluster.

Configuration

There is a detailed documentation about the configuration of Ozone cluster. But If you would like to get started, just save the following snippet to the etc/hadoop/ozone-site.xml file (inside your hadoop distribution)

<properties>
<property><name>ozone.om.address</name><value>localhost</value></property>
<property><name>ozone.scm.datanode.id</name><value>/tmp/datanode.id</value></property>
<property><name>ozone.scm.names</name><value>localhost</value></property>
<property><name>ozone.handler.type</name><value>distributed</value></property>
<property><name>ozone.container.metadata.dirs</name><value>/tmp/metadata</value></property>
<property><name>ozone.scm.block.client.address</name><value>localhost</value></property>
<property><name>ozone.scm.client.address</name><value>localhost</value></property>
<property><name>ozone.enabled</name><value>True</value></property>
</properties>

Run

Ozone is designed to run concurrently with HDFS. The simplest way to start is to run start-dfs.sh from the $HADOOP/sbin/start-dfs.sh. Once HDFS is running, please verify it is fully functional by running some commands like.

hdfs dfs -mkdir /usr
hdfs dfs -ls /

Once you are sure that HDFS is running, start Ozone. To start ozone, you need to start SCM and KSM. Currently we assume that both KSM and SCM is running on the same node, this will change in future.

./hdfs --daemon start scm
./hdfs --daemon start ksm

if you would like to start HDFS and Ozone together, you can do that by running a single command.

$HADOOP/sbin/start-ozone.sh

This command will start HDFS and then start the ozone components.

Once you have ozone running you can use these ozone shell commands to create a volume, bucket and keys.