Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Note
You should export JAVA_HOME in your .bashrc or .profile file.

Verify Trafodion Download

Verify that the Trafodion source has been either:

  • Downloaded and unpackaged.
  • Cloned from github.

If not, please do so now. Refer to Contributor Workflow - Code/Docs.

Install Required Build Tools

Refer to  Required Build Tools for instructions.

Verify System Limits

Setup Passwordless SSH 

The method used to set up passwordless SSH keys depends on whether you're downloading the Trafodion source directly using hub clone.

If You're Using Hub Clone

You've set up your ssh keys using the method described in https://github.com/settings/ssh, which means that you already have an existing set of ssh keys. Simply copy both the id_rsa.pub and id_rsa.ppk to the ~/.ssh directory.

Then, do the following:Please check that the system limits in your environment are appropriate for Apache Trafodion. If they are not, then you will need to increase the limits or Trafodion cannot start.

Code Block
languagetext
titleRecommended System LimitsModify the ssh Environment
cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys
chmod 600 ~/.ssh/id_rsa.ppk
echo "NoHostAuthenticationForLocalhost=yes" >>~/.ssh/config
chmod go-w ~/.ssh/config

If You Downloaded and Unpacked the Source

Ensure that you've set up passwordless authentication.

Code Block
languagetext
titlepasswordless ssh Not Correctly Setup
ssh localhost
The authenticity of host 'localhost (::1)' can't be established.
RSA key fingerprint is 88:f7:90:fe:35:76:10:92:cf:6d:c4:60:ca:b9:43:9f.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added 'localhost' (RSA) to the list of known hosts.
gtapper@localhost's password:
Last login: Fri Nov  6 22:44:00 2015 from 192.168.1.9

If you see the above, then setup passwordless ssh doing the following:

Code Block
languagetext
titleSetup passwordless ssh
ssh-keygen -t rsa -N "" -f ~/.ssh/id_rsa
cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys
chmod 600 ~/.ssh/id_rsa.pub
echo "NoHostAuthenticationForLocalhost=yes" >>~/.ssh/config
chmod go-w ~/.ssh/config

Verify Trafodion Download

Verify that the Trafodion source has been either:

  • Downloaded and unpackaged.
  • Cloned from github.

If not, please do so now. Refer to Contributor Workflow - Code/Docs.

Install Required Build Tools

Refer to  Required Build Tools for instructions.

Verify System Limits

Please check that the system limits in your environment are appropriate for Apache Trafodion. If they are not, then you will need to increase the limits or Trafodion cannot start.

Code Block
languagetext
titleRecommended System Limits
ulimit –a
core file size             (blocks, -c) 1000000
data seg size              (kbytes, -d) unlimited
scheduling priority        (-e) 0
file size                  (blocks, -f) unlimited
pending signals            (-i) 515196
max locked memory          (kbytes, -l) 49595556
max memory size            (kbytes, -m) unlimited
open files                 (-n) 32000
pipe sizeulimit –a
core file size             (blocks, -c) 1000000
data seg size              (kbytes, -d) unlimited
scheduling priority        (-e) 0
file size                  (blocks, -f) unlimited
pending signals            (-i) 515196
max locked memory          (kbytes, -l) 49595556
max memory size            (kbytes, -m) unlimited
open files                 (-n) 32000
pipe size                  (512 bytes, -p) 8
POSIX message queues       (bytes, -q) 819200
real-time priority         (-r) 0
stack size                 (kbytes, -s) 10240
cpu time                   (seconds, -t) unlimited
max user processes         (-u) 267263
virtual memory             (kbytes, -v) unlimited
file locks                 (-x) unlimited

Please refer to this article for information on how you change system limits.

Build Trafodion

Start a new ssh session. Use the following commands to set up the Trafodion environmental variables.
 
Code Block
languagetext
cd <download directory>/incubator-trafodion
export TOOLSDIR=<tools installation directory>
source ./env.sh
 
Note

 If you do not set up TOOLSDIR before sourcing in env.sh, then tools location defaults to /opt/home/tools. You may want to edit your .bashrc or .profile file to always export TOOLSDIR.

Build using one of the following options:

CommandWhat It Builds
make all
Trafodion, DCS, and REST.
make package
Trafodion, DCS, REST, and Client Drivers.
make package-all
Trafodion, DCS, REST, Client Drivers, and tests for all components.

...

   (kbytes, -v) unlimited
file locks                 (-x) unlimited

Please refer to this article for information on how you change system limits.

Build Trafodion

Start a new ssh session. Use the following commands to set up the Trafodion environmental variables.
 
Code Block
languagetext
titleVerify Build
$ sqvers -u
MY_SQROOT=/home/gtapper/cd <download directory>/incubator-trafodion
export TOOLSDIR=<tools installation directory>
source ./env.sh
 
Note

 If you do not set up TOOLSDIR before sourcing in env.sh, then tools location defaults to /opt/home/tools. You may want to edit your .bashrc or .profile file to always export TOOLSDIR.

Build using one of the following options:

CommandWhat It Builds
make all
Trafodion, DCS, and REST.
make package
Trafodion, DCS, REST, and Client Drivers.
make package-all
Trafodion, DCS, REST, Client Drivers, and tests for all components.

Verify the build:

Code Block
languagetext
titleVerify Build
$ sqvers -u
MY_SQROOT=/home/gtapper/incubator-trafodion/core/sqf
who@host=gtapper@box01
JAVA_HOME=/usr/lib/jvm/java-1.7.0-openjdk.x86_64
SQ_MBTYPE=64d (64-debug)
linux=2.6.32-504.el6.x86_64
redhat=6.6
NO patches
Most common Apache_Trafodion Release 2.0.0 (Build debug [gtapper], branch 392b99b-trafweb, date 06Nov15)
UTT count is 1
[8]     Release 2.0.0 (Build debug [gtapper], branch 392b99b-trafweb, date 06Nov15)/core/sqf
who@host=gtapper@box01
JAVA_HOME=/usr/lib/jvm/java-1.7.0-openjdk.x86_64
SQ_MBTYPE=64d (64-debug)
linux=2.6.32-504.el6.x86_64
redhat=6.6
NO patches
Most common Apache_Trafodion Release 2.0.0 (Build debug [gtapper], branch 392b99b-trafweb, date 06Nov15)
UTT count is 1
[8]     Release 2.0.0 (Build debug [gtapper], branch 392b99b-trafweb, date 06Nov15)
          export/lib/hbase-trx-cdh5_3-2.0.0.jar
          export/lib/hbase-trx-hbase_98_4-2.0.0.jar
          export/lib/hbase-trx-hdp2_2-2.0.0.jar
          export/lib/hbase-trx-mapr4_0-2.0.0.jar
          export/lib/sqmanvers.jar
          export/lib/trafodion-dtm-2.0.0.jar
          export/lib/trafodion-sqlhbase-trx-cdh5_3-2.0.0.jar
          export/lib/trafodionhbase-utility-2.0.0.jar
$

The output should show that eight jar files exist.

Setup Test Environment

You should test your installation using:

  • A local Hadoop environment
  • Trafodion installation

You're installation approach depends on whether you already have installed Hadoop.

If Hadoop is Already Installed

Build binary tar files and then install Trafodion following instructions described in Installation.

Code Block
languagetext
titleBuild Binary Files
cd <download directory>/incubator-trafodion
make package

The binary tar files will be created in <download directory>/incubator-trafodion/distribution directory. 

Install a Local Hadoop Environment

The install_local_hadoop script downloads compatible versions of Hadoop, HBase, Hive, and MySQL. Then, it starts Trafodion.

Tip
titleTime Saver

install_local_hadoop downloads Hadoop, HBase, Hive, and MySql jar files from the internet. To avoid this overhead, you can download the required files into a separate directory and set the environment variable MY_LOCAL_SW_DIST to point to this directory.

Prerequisite

You need to ensure that you've set up passwordless authentication.

Code Block
languagetext
titlepasswordless ssh Not Correctly Setup
ssh localhost
The authenticity of host 'localhost (::1)' can't be established.
RSA key fingerprint is 88:f7:90:fe:35:76:10:92:cf:6d:c4:60:ca:b9:43:9f.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added 'localhost' (RSA) to the list of known hosts.
gtapper@localhost's password:
Last login: Fri Nov  6 22:44:00 2015 from 192.168.1.9
trx-hbase_98_4-2.0.0.jar
          export/lib/hbase-trx-hdp2_2-2.0.0.jar
          export/lib/hbase-trx-mapr4_0-2.0.0.jar
          export/lib/sqmanvers.jar
          export/lib/trafodion-dtm-2.0.0.jar
          export/lib/trafodion-sql-2.0.0.jar
          export/lib/trafodion-utility-2.0.0.jar
$

The output should show that eight jar files exist.

 

Setup Test Environment

You should test your installation using:

  • A local Hadoop environment
  • Trafodion installation

You're installation approach depends on whether you already have installed Hadoop.

If Hadoop is Already Installed

Build binary tar files and then install Trafodion following instructions described in Installation.

Code Block
languagetext
titleBuild Binary Files
cd <download directory>/incubator-trafodion
make package

The binary tar files will be created in <download directory>/incubator-trafodion/distribution directory. 

Install a Local Hadoop Environment

The install_local_hadoop script downloads compatible versions of Hadoop, HBase, Hive, and MySQL. Then, it starts Trafodion.

Tip
titleTime Saver

install_local_hadoop downloads Hadoop, HBase, Hive, and MySql jar files from the internet. To avoid this overhead, you can download the required files into a separate directory and set the environment variable MY_LOCAL_SW_DIST to point to this directory.

Code Block
languagetext
titleSetup passwordless ssh
ssh-keygen -t rsa -N "" -f ~/.ssh/id_rsa cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys

Usage

CommandWhat It Does
install_local_hadoop
Uses default ports for all services.
install_local_hadoop -p fromDisplay
Start Hadoop with a port number range determined from the DISPLAY environment variable.
install_local_hadoop -p rand
Start with any random port number range between 9000 and 49000.
install_local_hadoop -p <port >
Start with the specified port number.

...