Streaming OODT (S-OODT) is an attempt to bring technologies that support big-cluster processing and stream processing into the OODT processing system. This will enable OODT to tackle bigger data sets and new data paradigms moving into the future. The core technologies handle: stream management, cluster management, processing, file system efficiency and backward-compatibility (running standard OODT within a managed cluster). These technologies include:
For detailed design documentation please refer to: Streaming OODT
Streaming OODT is designed for use on clusters of machines. It requires at least one head node and at least one slave node. The head node runs the main servers, and the slaves run the client services including processing slaves and HDFS slaves. In general the cluster should have moderate local disk storage and above normal RAM on each slave node. Currently S-OODT has only been tested on linux hosts.
In order to install and run S-OODT the following items are reuired to be configured on your cluster before you install.
Required software:
Required environment variables:
The following sections describe how to install, setup and use S-OODT.
In order to install S-OODT, first make sure you have the required software. Then login to your head-node and perform the following steps. Note: Root user access should not be required.
```
mkdir tmp
cd tmp
svn export https://svn.apache.org/repos/asf/oodt/trunk/cluster-tools/setup/
cd setup/
vi hosts
mv env-vars.sh.tmpl env-vars.sh
chmod +x install.sh
mkdir /data/cluster-local/software (and all)
./install.sh
```