Page History

This document describes the steps required to build ApacheTrafodion software.

Table of Contents

Supported Platforms

• Red Hat or Centos 6.x (6.4 or later) versions are supported as development and production platforms.

Prerequisites

Install the following packages:

...

1. Java version is compatible, it must be 1.7.x. To check your version, do "java -version". Ensure JAVA_HOME environment variable exists and set to your JDK installation.

2. Verify that Trafodion source is downloaded and un-tarred,  or cloned from github.  In these instructions, this location is referred to as <trafodion source directory>.
3. Download, build and install additional development tools via  Additional Build Tools.
4. Maven version 3.0.5 or greater is installed and part of your path. To check your version, do "mvn --version".

...

•  core file size                    (blocks, -c) 1000000
• data seg size                    (kbytes, -d) unlimited
• scheduling priority            (-e) 0
• file size                             (blocks, -f) unlimited
• pending signals                (-i) 515196
• max locked memory         (kbytes, -l) 49595556
• max memory size             (kbytes, -m) unlimited
• open files                          (-n) 32000
• pipe size                           (512 bytes, -p) 8
• POSIX message queues  (bytes, -q) 819200
• real-time priority               (-r) 0
• stack size                         (kbytes, -s) 10240
• cpu time                           (seconds, -t) unlimited
• max user processes         (-u) 267263
• virtual memory                 (kbytes, -v) unlimited
• file locks                           (-x) unlimited

Build Steps

...

Set up Trafodion

...

configuration file

Additional development tools are required before building Trafodion  as described Additional Build Tools.  A convenience script script exists that downloads, installs, and builds all these tools in a common directory.  It is recommended that you use this convenience script.  Once completed, export your TOOLSDIR:

...

 Trafodion is up and running, you can now start up a SQL command line  interface and initialize Trafodion.

If this convenience script is not used , then you need to export the location of each tool as follows:

or if any of these additional build tools are not found in the expected location, then the Trafodion configuration file needs to be updated. The Trafodion configuration file template is located in <download directory>/apache-trafodion-1.3.0-incubating/core/sqf/LocalSettingsTemplate.sh.  To change values, copy this file to your home directory and change its name to .trafodion.  Edit the .trafodion file and update according to the instructions.  Be sure to change the location of your TOOLSDIR to your <tools installation directory>.

   cp <download directory>/apache-trafodion-1.3.0-incubating/core/sqf/LocalSettingsTemplate.sh ~/.trafodion   export BISON="<bison-location>/bison_3_linux/bin/bison"
   export LLVM=<llvm-location>/dest-llvm-3.2"
   export UDIS86="<udis-location>/udis86-1.7.2"
   export ICU="<icu-location>/icu4.4"
   export MPICH_ROOT="<mpich-location>/dest-mpich-3.0.4"
   export ZOOKEEPER_DIR="<zookeeper-location>/zookeeper-3.4.5"
   export THRIFT_LIB_DIR="<thrift-location>/thrift-0.9.0/lib"
   export THRIFT_INC_DIR="<thrift-location>/thrift-0.9.0/include"

Build Trafodion

Start a new ssh session

    cd <trafodion<download source directory>directory>/apache-trafodion-1.3.0-incubating
    export $TOOLSDIR=<tools installation directory>
    source ./env.sh

Note:  if you don't export  TOOLSDIR before sourcing in env.sh, Trafodion sets this variable to /opt/home/tools.  If the additional tools are not found in this location, the build will fail.

Build using one of the following options:

...

Verify build by executing the sqvers request with the -u option.  It reports that seven jar files exist.

    sqvers -u

Prepare the test environment

It is recommended that you test Trafodion by setting up a local version of Hadoop and installing Trafodion on top.  This is enabled by running the 'install_local_hadoop' script.

...

Run install_local_hadoop

This section describes the steps to use the Trafodion installation script called 'install_local_hadoop' that downloads compatible versions of Hadoop, HBase, Hive, and MySql and starts Trafodion.

Start a new ssh session and set environment

       make make sure you have set up password less authentication. You should be able to "ssh localhost" without having to enter a password

     cd <trafodion source directory>
     source If you started a new ssh session, be sure to

   cd <download directory>/apache-trafodion-1.3.0-incubating
   source ./env.sh

Install Hadoop, HBase, Hive, MySql, and Trafodionhadoop 

...

  cd $MY_SQROOT/sql/scripts
 

...

  install_local_hadoop
   ./install_traf_components 

Verify that the install completed by running the following command - should report: 6 java servers and 2 mysqld processes are running

...

‘install_local_hadoop' — will use default port numbers for all services OR
'install_local_hadoop -p fromDisplay' - will start Hadoop with a port number range determined from the DISPLAY environment variable OR
‘install_local_hadoop -p rand' —  will start with any random port number range between 9000 and 49000 OR
‘install_local_hadoop -p < specify a port # >' — will start with port number specified OR

When this script completes, Hadoop, HBase, Hive, and MySql (used as Hive's metadata repository) have been installed and are started. 

To start/stop/check Hadoop environment using Trafodion supplied scripts, you can execute  ‘swstartall’ ,  ‘swstopall’ and ‘swstatus’, and if you need to remove the installation, execute the 'swuninstall_local_hadoop'. 

Use pre-installed Hadoop

If you want to use an already installed version of Hadoop, you should build binary tar files and then install Trafodion following instructions described in Installation .

To build binary files

   cd <download directory>/apache-trafodion-1.3.0-incubating
   make package

Your binary tar files will be created in <download directory>/apache-trafodion-1.3.0-incubating/distribution directory. <TBD - section to be added>

Run Trafodion

This section describes how to start Trafodion and run operations. 

...

Setup required each time source is downloaded

Start a new ssh session and set up environment:

    cd <trafodion source<download directory>/apache-trafodion-1.3.0-incubating
    source ./env.sh
    cd $MY_SQROOT/etc
    # delete ms.env, if it exists
    rm ms.env
    cd $MY_SQROOT/sql/scripts
    sqgen 

Start up Trafodion

...

    cd $MY_SQROOT/sql/scripts
    sqstart
    sqcheck 

...

sqcheck   (For all of Trafodion)
dcscheck  (For Database Connectivity Service)
rmscheck  (For RMS Server)

Create Trafodion metadata

 If you started a new ssh session, be sure to

   cd <download directory>/apache-trafodion-1.3.0-incubating
   source ./env.sh

Trafodion is up and running, you can now start up a SQL command line  interface and initialize Trafodion

    cd <trafodion source directory>
    source ./env.sh
    sqlci 

Perform the following statements:

    initialize trafodion;
    exit

Validate 

Test your setup by using "sqlci" or "trafci" (uses DCS to connect to the SQL engine):

...