...
Note |
---|
You should export JAVA_HOME in your .bashrc or .profile file. |
Verify Trafodion Download
Verify that the Trafodion source has been either:
- Downloaded and unpackaged.
- Cloned from github.
If not, please do so now. Refer to Contributor Workflow - Code/Docs.
Install Required Build Tools
Refer to Required Build Tools for instructions.
Verify System Limits
Setup Passwordless SSH
The method used to set up passwordless SSH keys depends on whether you're downloading the Trafodion source directly using hub clone.
If You're Using Hub Clone
You've set up your ssh keys using the method described in https://github.com/settings/ssh, which means that you already have an existing set of ssh keys. Simply copy both the id_rsa.pub and id_rsa.ppk to the ~/.ssh directory.
Then, do the following:Please check that the system limits in your environment are appropriate for Apache Trafodion. If they are not, then you will need to increase the limits or Trafodion cannot start.
Code Block | |||||
---|---|---|---|---|---|
| |||||
cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys
chmod 600 ~/.ssh/id_rsa.ppk
echo "NoHostAuthenticationForLocalhost=yes" >>~/.ssh/config
chmod go-w ~/.ssh/config |
If You Downloaded and Unpacked the Source
Ensure that you've set up passwordless authentication.
Code Block | ||||
---|---|---|---|---|
| ||||
ssh localhost
The authenticity of host 'localhost (::1)' can't be established.
RSA key fingerprint is 88:f7:90:fe:35:76:10:92:cf:6d:c4:60:ca:b9:43:9f.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added 'localhost' (RSA) to the list of known hosts.
gtapper@localhost's password:
Last login: Fri Nov 6 22:44:00 2015 from 192.168.1.9 |
If you see the above, then setup passwordless ssh doing the following:
Code Block | ||||
---|---|---|---|---|
| ||||
ssh-keygen -t rsa -N "" -f ~/.ssh/id_rsa
cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys
chmod 600 ~/.ssh/id_rsa.pub
echo "NoHostAuthenticationForLocalhost=yes" >>~/.ssh/config
chmod go-w ~/.ssh/config |
Verify Trafodion Download
Verify that the Trafodion source has been either:
- Downloaded and unpackaged.
- Cloned from github.
If not, please do so now. Refer to Contributor Workflow - Code/Docs.
Install Required Build Tools
Refer to Required Build Tools for instructions.
Verify System Limits
Please check that the system limits in your environment are appropriate for Apache Trafodion. If they are not, then you will need to increase the limits or Trafodion cannot start.
Code Block | ||||
---|---|---|---|---|
| ||||
ulimit –a core file size (blocks, -c) 1000000 data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 515196 max locked memory (kbytes, -l) 49595556 max memory size (kbytes, -m) unlimited open files (-n) 32000 pipe sizeulimit –a core file size (blocks, -c) 1000000 data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 515196 max locked memory (kbytes, -l) 49595556 max memory size (kbytes, -m) unlimited open files (-n) 32000 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 10240 cpu time (seconds, -t) unlimited max user processes (-u) 267263 virtual memory (kbytes, -v) unlimited file locks (-x) unlimited |
Please refer to this article for information on how you change system limits.
Build Trafodion
Start a new ssh session. Use the following commands to set up the Trafodion environmental variables.
Code Block | ||
---|---|---|
| ||
cd <download directory>/incubator-trafodion
export TOOLSDIR=<tools installation directory>
source ./env.sh
|
Note |
---|
If you do not set up TOOLSDIR before sourcing in env.sh, then tools location defaults to /opt/home/tools. You may want to edit your .bashrc or .profile file to always export TOOLSDIR. |
Build using one of the following options:
Command | What It Builds |
---|---|
make all | Trafodion, DCS, and REST. |
make package | Trafodion, DCS, REST, and Client Drivers. |
make package-all | Trafodion, DCS, REST, Client Drivers, and tests for all components. |
...
(kbytes, -v) unlimited
file locks (-x) unlimited
|
Please refer to this article for information on how you change system limits.
Build Trafodion
Start a new ssh session. Use the following commands to set up the Trafodion environmental variables.
Code Block | ||||
---|---|---|---|---|
| ||||
$ sqvers -u MY_SQROOT=/home/gtapper/cd <download directory>/incubator-trafodion export TOOLSDIR=<tools installation directory> source ./env.sh |
Note |
---|
If you do not set up TOOLSDIR before sourcing in env.sh, then tools location defaults to /opt/home/tools. You may want to edit your .bashrc or .profile file to always export TOOLSDIR. |
Build using one of the following options:
Command | What It Builds |
---|---|
make all | Trafodion, DCS, and REST. |
make package | Trafodion, DCS, REST, and Client Drivers. |
make package-all | Trafodion, DCS, REST, Client Drivers, and tests for all components. |
Verify the build:
Code Block | ||||
---|---|---|---|---|
| ||||
$ sqvers -u MY_SQROOT=/home/gtapper/incubator-trafodion/core/sqf who@host=gtapper@box01 JAVA_HOME=/usr/lib/jvm/java-1.7.0-openjdk.x86_64 SQ_MBTYPE=64d (64-debug) linux=2.6.32-504.el6.x86_64 redhat=6.6 NO patches Most common Apache_Trafodion Release 2.0.0 (Build debug [gtapper], branch 392b99b-trafweb, date 06Nov15) UTT count is 1 [8] Release 2.0.0 (Build debug [gtapper], branch 392b99b-trafweb, date 06Nov15)/core/sqf who@host=gtapper@box01 JAVA_HOME=/usr/lib/jvm/java-1.7.0-openjdk.x86_64 SQ_MBTYPE=64d (64-debug) linux=2.6.32-504.el6.x86_64 redhat=6.6 NO patches Most common Apache_Trafodion Release 2.0.0 (Build debug [gtapper], branch 392b99b-trafweb, date 06Nov15) UTT count is 1 [8] Release 2.0.0 (Build debug [gtapper], branch 392b99b-trafweb, date 06Nov15) export/lib/hbase-trx-cdh5_3-2.0.0.jar export/lib/hbase-trx-hbase_98_4-2.0.0.jar export/lib/hbase-trx-hdp2_2-2.0.0.jar export/lib/hbase-trx-mapr4_0-2.0.0.jar export/lib/sqmanvers.jar export/lib/trafodion-dtm-2.0.0.jar export/lib/trafodion-sqlhbase-trx-cdh5_3-2.0.0.jar export/lib/trafodionhbase-utility-2.0.0.jar $ |
The output should show that eight jar files exist.
Setup Test Environment
You should test your installation using:
- A local Hadoop environment
- Trafodion installation
You're installation approach depends on whether you already have installed Hadoop.
If Hadoop is Already Installed
Build binary tar files and then install Trafodion following instructions described in Installation.
Code Block | ||||
---|---|---|---|---|
| ||||
cd <download directory>/incubator-trafodion
make package |
The binary tar files will be created in <download directory>/incubator-trafodion/distribution directory.
Install a Local Hadoop Environment
The install_local_hadoop script downloads compatible versions of Hadoop, HBase, Hive, and MySQL. Then, it starts Trafodion.
Tip | ||
---|---|---|
| ||
install_local_hadoop downloads Hadoop, HBase, Hive, and MySql jar files from the internet. To avoid this overhead, you can download the required files into a separate directory and set the environment variable MY_LOCAL_SW_DIST to point to this directory. |
Prerequisite
You need to ensure that you've set up passwordless authentication.
Code Block | ||||
---|---|---|---|---|
| ||||
ssh localhost
The authenticity of host 'localhost (::1)' can't be established.
RSA key fingerprint is 88:f7:90:fe:35:76:10:92:cf:6d:c4:60:ca:b9:43:9f.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added 'localhost' (RSA) to the list of known hosts.
gtapper@localhost's password:
Last login: Fri Nov 6 22:44:00 2015 from 192.168.1.9 |
trx-hbase_98_4-2.0.0.jar
export/lib/hbase-trx-hdp2_2-2.0.0.jar
export/lib/hbase-trx-mapr4_0-2.0.0.jar
export/lib/sqmanvers.jar
export/lib/trafodion-dtm-2.0.0.jar
export/lib/trafodion-sql-2.0.0.jar
export/lib/trafodion-utility-2.0.0.jar
$ |
The output should show that eight jar files exist.
Setup Test Environment
You should test your installation using:
- A local Hadoop environment
- Trafodion installation
You're installation approach depends on whether you already have installed Hadoop.
If Hadoop is Already Installed
Build binary tar files and then install Trafodion following instructions described in Installation.
Code Block | ||||
---|---|---|---|---|
| ||||
cd <download directory>/incubator-trafodion
make package |
The binary tar files will be created in <download directory>/incubator-trafodion/distribution directory.
Install a Local Hadoop Environment
The install_local_hadoop script downloads compatible versions of Hadoop, HBase, Hive, and MySQL. Then, it starts Trafodion.
Tip | ||||
---|---|---|---|---|
| ||||
install_local_hadoop downloads Hadoop, HBase, Hive, and MySql jar files from the internet. To avoid this overhead, you can download the required files into a separate directory and set the environment variable MY_LOCAL_SW_DIST to point to this directory. | ||||
Code Block | ||||
| ||||
ssh-keygen -t rsa -N "" -f ~/.ssh/id_rsa cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys |
Usage
Command | What It Does |
---|---|
install_local_hadoop | Uses default ports for all services. |
install_local_hadoop -p fromDisplay | Start Hadoop with a port number range determined from the DISPLAY environment variable. |
install_local_hadoop -p rand | Start with any random port number range between 9000 and 49000. |
install_local_hadoop -p <port > | Start with the specified port number. |
...