Page History

Table of Contents

What is Streaming OODT?

Streaming OODT (S-OODT) is an attempt to bring technologies that support big-cluster processing and stream processing into the OODT processing system. This will enable OODT to tackle bigger data sets and new data paradigms moving into the future. The core technologies handle: stream management, cluster management, processing, file system efficiency and backward-compatibility (running standard OODT within a managed cluster).   These technologies include:

...

Note: Root user access should not be required.

Setup Bootstrap Script

#Make a temp directory
mkdir tmp
cd tmp
#Get install script (minimal bootstrap script)
svn export https://svn.apache.org/repos/asf/oodt/trunk/cluster-tools/setup/
#Setup environment variables
cd setup
mv env-vars.sh.tmpl env-vars.sh

...

Now edit "hosts". This is a list of nodes used by your cluster.  This first host is the head-node, and the rest represent slaves.  Add all hosts in your cluster to this file. 

Run Cluster Install

# Add execute permission to scripts
chmod +x install.sh env-vars.sh deploy.sh
# Run installation (will take some time)
./install.sh
#NOTE: Bootstrap finished, use installed software at ${INSTALL_DIR}.
# Navigate to installed setup scripts
. env-vars.sh
cd ${INSTALL_DIR}/cluster-tools/setup

...