...
Note | ||
---|---|---|
| ||
You MUST complete the steps in Create Build Environment and and build the Trafodion components using the instructions in Build Source before you create the test environment. |
Prerequisites
The following prerequisites need to be met in order to create a functional Trafodion Test Environment.
...
You can create a Trafodion test environment using a:
- Pre-Installed Hadoop: Trafodion installation on a system that already has a compatible version of Hadoop installed.
- Local Hadoop: You install a Hadoop environment using the
install_local_hadoop
script
Your installation approach depends on whether you already have installed Hadoop.
Anchor | ||||
---|---|---|---|---|
|
Pre-Installed Hadoop
Info | ||
---|---|---|
| ||
Currently, Trafodion requires:
|
Build Binary tar Files
Build the Trafodion binary tar files.
Code Block | ||||
---|---|---|---|---|
| ||||
cd <Trafodion source directory> make package |
For more information, refer to Build Trafodion Components in the Build Source chapter. Build Source Chapter.
Install Trafodion
To be written.
Anchor | ||||
---|---|---|---|---|
|
Local Hadoop
Use the following instructions to install a local Hadoop environment.
Run install_local_hadoop
The install_local_hadoop
script downloads compatible versions of Hadoop, HBase, Hive, and MySQL based on the Cloudera archives. Then, it starts Trafodion.
Info | ||
---|---|---|
| ||
|
Command | Usage |
---|---|
install_local_hadoop | Uses default ports for all services. |
install_local_hadoop -p fromDisplay | Start Hadoop with a port number range determined from the DISPLAY environment variable. |
install_local_hadoop -p rand | Start with any random port number range between 9000 and 49000. |
install_local_hadoop -p <port> | Start with the specified port number. |
Sample Procedure
Start a new
ssh
session and ensure that the Trafodion environmental variables are loaded.Code Block language bash cd <Trafodion source directory> source ./env.sh
Code Block language bash title Example: Load Environment Variables cd mysource/incubator-trafodion source ./env.sh
Install the Hadoop software.
Code Block language bash cd $MY_SQROOT/sql/scripts install_local_hadoop ./install_traf_components
Code Block language bash title Example: Install Hadoop Software $ cd $MY_SQROOT/sql/scripts $ install_local_hadoop Checking for existing Hadoop processes... The testware tpcds_kit.zip does not exist and will not be installed This testware is needed to run developer HIVE regression tests . . . Installed directory size and name = 2.7G /home/trafdeveloper/mysource/incubator-trafodion/core/sqf/sql/local_hadoop Setup is complete. You can use the convenience scripts starting with sw... located in /home/trafdeveloper/mysource/incubator-trafodion/core/sqf/sql/scripts. $ ./install_traf_components Installing and configuring DCS, REST, TRAFCI & Phoenix tests for Trafodion... Environment used for core, DCS, REST and Phonenix ... . . . Configuration scripts for DCS, REST, TRAFCI and Phoenix test are set up Open a new session and start Trafodion by executing sqgen and sqstart scripts $
Verify installation.
Code Block language bash $ swstatus 6 java servers and 2 mysqld processes are running 713 NameNode 19513 HMaster 1003 SecondaryNameNode 838 DataNode 1173 ResourceManager 1298 NodeManager
The following Java servers should be running:
NodeManager (Yarn)
ResourceManager (Yarn)
NameNode (HDFS)
SecondaryNameNode (HDFS)
DataNode (HDFS)
HMaster (HBase)
In addition, 2 mysqld processes should be running.
Info The Hadoop enviroment is install in:
$MY_SQROOT/sql/local_hadoop
. The log files are located in$MY_SQROOT/sql/local_hadoop/log
and in the Hadoop components' log directories. If a service is not started, then look in the associated log files for the issue and search for the error string for possible solutions to the issue; these are Hadoop issues and are therefore outside the scope of this guide.
- Run sqgen —
sqgen
creates the Trafodion configuration files. Do the following:Start a new terminal window for this step.
Do the following:
Code Block language bash cd <Trafodion source directory> source ./env.sh cd $MY_SQROOT/etc # delete ms.env, if it exists rm ms.env cd $MY_SQROOT/sql/scripts sqgen
Code Block language bash title Example: Run sqgen $ cd mysource/incubator-trafidion $ source ./env.sh $ cd $MY_SQROOT/etc # delete ms.env, if it exists $ rm ms.env $ cd $MY_SQROOT/sql/scripts $ sqgen Workstation environment - Not a clustered environment Generating SQ environment variable file: /home/trafdeveloper/mysource/incubator-trafodion/core/sqf/etc/ms.env Note: Using cluster.conf format type 2. . . . *********************************************************** Updating Authentication Configuration *********************************************************** Creating folders for storing certificates $
Start Trafodion.
Code Block language bash title Example: sqstart $ sqstart Checking orphan processes. Removing old mpijob* files from /home/trafdeveloper/mysource/incubator-trafodion/core/sqf/tmp Removing old monitor.port* files from /home/trafdeveloper/mysource/incubator-trafodion/core/sqf/tmp Executing sqipcrm (output to sqipcrm.out) Starting the SQ Environment (Executing /home/trafdeveloper/mysource/incubator-trafodion/core/sqf/sql/scripts/gomon.cold) Background SQ Startup job (pid: 15755) . . . You can monitor the SQ shell log file : /home/trafdeveloper/mysource/incubator-trafodion/core/sqf/logs/sqmon.log Startup time 0 hour(s) 0 minute(s) 59 second(s) $
- Initialize Trafodion
The final step is to initialize the Trafodion database.
Code Block | ||||
---|---|---|---|---|
| ||||
$ sqlci Apache Trafodion Conversational Interface 1.3.0 Copyright (c) 2015 Apache Software Foundation >>initialize trafodion; --- SQL operation complete. >> exit; End of MXCI Session $ |
Next Steps
...