Versions Compared

Old Version 1

changes.mady.by.user Atanu Mishra

Saved on

compared with

New Version Current

changes.mady.by.user Atanu Mishra

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

This page explains how to install Trafodion on a cluster. The instructions apply to the single-script installer and the latest Trafodion release, which is Release 1.1.

 

Preparing Your PC

 

If you are using a Windows PC, additional PC software may be needed throughout the installation process. It is recommended that you preinstall the PC software that you may need before continuing with the Trafodion installation.

 

Install this PC software: 

  • putty and puttygen (download from the PuTTY website)
  • VNC client (download from http://www.realvnc.com)
  • Firefox or Chrome browser
  • SFTP client to transfer files from your PC to the server: WinSCP or FileZilla

...

Preparing Your Cluster Environment

 

Before installing Trafodion, see these sections to understand the requirements and to prepare for installation:

 

 

Cluster Requirements

 

These configuration settings have been tested and are known to work with the Trafodion installation: 

Hardware platformx86-64
Operating system
  • RedHat Enterprise Linux, 6.x kernel (64 bit)
  • CentOS, 6.x kernel (64 bit)
User IDsA user ID with passwordless sudo access. See Obtaining Sudo Access and Passwordless SSH.
Cluster sizeA cluster consisting of 1 to N nodes. There is currently no upper limit. Two nodes is the recommended minimum, but a single node cluster should work.
Disk spaceMinimum of 20 GB. See Checking the Disk Space (Cloudera Only).
MemoryMinimal 1 GB * number of connectivity servers (MXOSRVR processes) configured per cluster.

 

Checking the Disk Space (Cloudera Only)

...

 

Before installing Cloudera, a minimum of 20 GB is needed to support the database. The default installation location is "/var/lib/cloudera-scm-server-db". To check the size available to /var, start a putty session, or start a VNC terminal window on the node in your cluster where Cloudera will be installed. To execute the following commands, you will need either root or sudo access.

 

Confirm there is a minimum of 20 GB available to /var.

 

cd "/var"
df -hP

...

If there is insufficient space available in /var, a possible solution is to provide a soft link to another drive for your Cloudera database. Locate a drive that does have sufficient space.
 
cd <new drive>  (e.g. cd /DATA)
mkdir cloudera-scm-server-db
chmod 777 cloudera-scm-server-db
cd /var/lib
ln -s <new drive>/cloudera-scm-server-db .

...
If Cloudera has already been installed and it is showing red for log directories, it means that Cloudera was installed using /var/lib and may not have a large enough /var file system. In this case, there is an unsupported script that can be used to move the directories. Please see the clouderaMoveDB.sh script in the installer/tools directory, which is created when the installer tar.gz file is untarred. Execute clouderaMoveDB.sh without syntax to display help information. 
Obtaining Sudo Access and Passwordless SSH
...
The Trafodion installation requires a user ID with these attributes: 
  • sudo access
  • passwordless ssh to all nodes on the cluster
...
The following example shows how to set up your user ID to have "passwordless ssh" abilities.
 
echo -e 'y\n' | ssh-keygen -t rsa -N "" -f $HOME/.ssh/id_rsa
cat $HOME/.ssh/id_rsa.pub >> $HOME/.ssh/authorized_keys
echo localhost $(cat /etc/ssh/ssh_host_rsa_key.pub) >> $HOME/.ssh/known_hosts
echo "NoHostAuthenticationForLocalhost=yes" >> $HOME/.ssh/config
chmod 600 $HOME/.ssh/config

 
After running these commands, you will need to copy the contents of the public key file, $HOME/.ssh/id_rsa.pub, and append those contents to each additional node's $HOME/.ssh/authorized_keys file. You will also need to copy your private $HOME/.ssh/id_rsa file from the head node to the other nodes' $HOME/.ssh directory, and secure it as private to yourself (chmod 700), as you do not want someone else pretending to be you.
 
Disabling requiretty
 
You will need to disable requiretty so that sudo commands can be run from inside the installation scripts. 
To make sure that the requiretty option is NOT being used, in the /etc/sudoers file, comment out the "Defaults requiretty" setting.
 
Configuring an LDAP Identity Store
 
If you plan to enable authentication in Trafodion, you will need to have an LDAP identity store available to perform authentication. The Trafodion installer will prompt you to set up an authentication configuration file that points to an LDAP server (or servers), which will enable security (that is, authentication and authorization) in the Trafodion system. If you wish to manually set up the authentication configuration file and enable security, see Enabling Security Features in Trafodion. 
Installing a Supported Hadoop Distribution
...
Trafodion Release 1.1 is compatible with the following distributions:
...
DistributionVersionHBase VersionInstallationAdditional Information
Cloudera Distribution Including Apache Hadoop (CDH)CDH 5.3 (or 5.2)0.98.6To install CDH 5.3, see the CDH 5.3.x Installation and Upgrade Guide. Before installing CDH, please see the note below and review theMandatory Hadoop Services and Settings.
NOTE:
  • Select Cloudera Standard edition.
  • Install using packages. Do not install using tarballs and parcels. Trafodion does not currently support tarball/parcel installation.
  • CDH 5.2 is supported but has not been officially tested with Trafodion Release 1.1.
  • If you are installing Trafodion Release 1.0, it supports CDH 5.1.n and HBase 0.98.1.
Mandatory Hadoop Services and Settings
Hortonworks Data Platform (HDP)HDP 2.20.98.4To install HDP 2.2, see the Ambari 1.7.0 Install Guide for a first-time installation or the Ambari 1.7.0 Upgrade Guide to upgrade to HDP 2.2. Before installing HDP, please review the Mandatory Hadoop Services and Settings.
NOTE: If you are installing Trafodion Release 1.0, it supports HDP 2.1 and HBase 0.98.0.
Mandatory Hadoop Services and Settings
 
Mandatory Hadoop Services and Settings
...
IMPORTANT: Before installing a Hadoop distribution, please review this list of mandatory services and settings: 
  • HDFS
  • MapReduce
  • ZooKeeper
  • HBase
  • Hive
  • Nagios (Hortonworks)
  • Ganglia (Hortonworks)
  • Embedded Databases (Cloudera)
 
Please make sure that those services and settings are selected during installation.
 
IMPORTANT: Trafodion does not support a Hadoop server (for example, Cloudera or Hortonworks) running on a node that is not part of the Trafodion cluster. You must specify the Hadoop nodes to be part of the Trafodion list of nodes during the installation of Trafodion (using the --nodes parameter). The Trafodion installer needs to run from the same node where you installed the Hadoop distribution (Cloudera or Hortonworks).
 
User IDs and Passwords
...
For your reference, this table lists the user IDs and passwords that you will use during installation.
 
NOTE: On a physical cluster, you will use two user IDs: your user ID and trafodion. 
LogonUser IDPasswordDescription
Cloudera Manager Web GUI logonadmin(default)admin(default)After installing Cloudera, you will be instructed to log on to the Cloudera Manager Web GUI. Use the default user ID and password (admin, admin). If you already had Cloudera installed, please use your previously defined user ID and password.
Ambari Web GUI logonadmin(default)admin(default)After downloading and setting up the Ambari repository, you will be instructed to log on to the Ambari Web GUI. Use the default user ID and password (admin, admin). If you already had Ambari installed, please use your previously defined user ID and password.
User ID with sudo access<sudo-username><password>In the installation steps, you may be instructed to use "sudo" or "sudo userid" access. You will be using your user ID, which has been enabled with "sudo" access and passwordless ssh to all nodes of the cluster.
Trafodion logontrafodiontraf123(default)This user ID is automatically created for you by the Trafodion installer when Trafodion is installed. Do not create this user ID manually.
VNC server logontrafodiontraf123(default)After installing Trafodion, you will be instructed to log on to the VNC server at port 1. Use the trafodion user ID and password.
 
Installing Trafodion
...
NOTE: If you are upgrading to a newer version of Trafodion, please see Upgrading Trafodion before proceeding. 
At a high level, the following instructions consist of a single step:
...
  • To troubleshoot issues during or after installation, see Troubleshooting the Installation.
  • After installing Trafodion, see Configuration for guidelines on how to configure your Trafodion environment for optimal performance.
  • If you did not enable security during installation but want to restrict users or restrict access only to registered users, see Enabling Security Features in Trafodion.
  • After successful installation, Trafodion should already be started and ready to use. If you need to stop and restart Trafodion, such as to install a new build, see Starting and Stopping Trafodion.
  • If you want to move data from another relational database management system (RDBMS) to Trafodion, see the guidelines in Data Loading.
 
Upgrading Trafodion
 
Follow these steps if you have an older version of Trafodion that you want to upgrade:
...