Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

alsa-lib-devel
ant
ant-nodeps
boost-devel
device-mapper-multipath
dhcp
gcc-c++
gd
glibc-devel.i686
graphviz-perl
gzip
java-1.7.0-openjdk-devel
java-1.6.0-openjdk-devel
libaio-devel
libibcm.i686
libibumad-devel
libibumad-devel.i686
libiodbc
libiodbc-devellibrdmacm-devellibrdmacm-devel.i686
log4cxxlog4cxx-devellua-devel
lzo-minilzonet-snmp-develnet-snmp-perl
openldap-clientsopenldap-devel.i686
openmotif
openssl-devel.i686
openssl-static
perl-Config-IniFiles
perl-DBD-SQLite
perl-Config-Tiny
perl-Expect
perl-IO-Tty
perl-Math-Calc-Units
perl-Params-Validate
perl-Parse-RecDescent
perl-TermReadKey
perl-Time-HiRes
protobuf-compiler
protobuf-devel
python-qpid
python-qpid-qmf
qpid-cpp-client
qpid-cpp-client-devel
qpid-cpp-client-ssl
qpid-cpp-server
qpid-cpp-server-ssl
qpid-qmf
qpid-tools
readline-devel
saslwrapper
sqlite-devel
tog-Pegasuspegasus
unixODBCunixODBC-devel
uuid-perl
xinetdxerces-c-devel

...

                     wget http://download.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm

...

  1. Download latest source from Apache Incubator https://github.com/apache/incubator-trafodion
  2. Using ssh, set Trafodion environment
          cd incubator-trafodion/core/sqf
          . ./sqenv.sh
          cd $MY_SQROOT/..
          make all
  3. Build database connectivity service(DCS)
          cd $MY_SQROOT/../../dcs
          mvn clean site package
          cd $HOME
          tar -xvf $MY_SQROOT/../../dcs/target/dcs.gz

          export DCS_INSTALL_DIR=$HOME/<dcs install folder name> (It is preferable to set DCS_INSTALL_DIR in your profile)

  4.       
Configuring DCS and starting Trafodion

...

          cd hadoop-2.4.0-src
          export JAVA_HOME=...           # path to 1.7.x JDK
          export HADOOP_PROTOC_PATH=...  # path to protobufs 2.5.0 protoc command
          mvn clean install package -Pdist -Pnative -Dtar -DskipTests \
             -Dtomcat.download.url=http://archive.apache.org/dist/tomcat/tomcat-6/v6.0.36/bin/apache-tomcat-6.0.36.tar.gz

                c. For Pre-installed Hadoop/HBase version, Update the HBase configuration and restart HBase.

  1.  hbase-site.xml:
      <property>
        <name>hbase.client.scanner.caching</name>
        <value>100</value>
      </property>
      <property>
        <name>hbase.client.scanner.timeout.period</name>
        <value>60000</value>
      </property>
      <property>
        <name>hbase.coprocessor.region.classes</name>
          <value>
               org.apache.hadoop.hbase.coprocessor.transactional.TrxRegionObserver,
               org.apache.hadoop.hbase.coprocessor.transactional.TrxRegionEndpoint,
               org.apache.hadoop.hbase.coprocessor.AggregateImplementation
          </value>
      </property>
      <property>
        <name>hbase.hregion.impl</name>
        <value>org.apache.hadoop.hbase.regionserver.transactional.TransactionalRegion</value>
      </property>
    
    2. hbase-env.xml:
       export HBASE_CLASSPATH=${HBASE_TRXDIR}/${HBASE_TRX_JAR}
    

...

 NOTE: The hadoop release contains 32-bit libraries. You must build hadoop from source for 64-bit architecture, and not just download the release tar file.                                                            See: http://wiki.apache.org/hadoop/HowToContribute  

Notes

  • The $MY_SQROOT/sqenv.sh file sources in the file sqenvcom.sh, where most of the Trafodion environment is set up: PATH, CLASSPATH, LD_LIBRARY_PATH, and so on.
  • The sqgen command takes CLASSPATH and other environment variables and makes sure that they are used when starting Trafodion processes across the cluster. Therefore, it's very important that the correct CLASSPATH is set up before calling sqgen. Trafodion processes actually use the CLASSPATH that's defined in $MY_SQROOT/etc/ms.env, which should match what you get after sourcing sqenv.sh.
  • The install_local_hadoop script copies jar files and executables for a single-node Hadoop install into your source tree: $MY_SQROOT/sql/local_hadoop. If you already have Hadoop running on the system and also want a sandbox version, install the sand-boxed Hadoop on non-standard ports:
    install_local_hadoop -p <start-port>
    <start-port> ... <start-port>+199 should be a range of unused ports.
    
  • To run the software you built on a cluster, use the "package" make target instead of the "all" target above and use the built tar files to install on the cluster. Generally, most developers run on a single-node cluster, since a multi-node cluster requires more complex steps to deploy the built software. Here is how to modify software and run the modified objects on the local node (note there is no "make install"):
     sqstop
     # edit source files
     cd $MY_SQROOT/..
     make all
     sqstart
    
  • Shutting Trafodion down. To do this, you would shut down Trafodion, then shut down the sand-boxed Hadoop that's used. The sw commands only apply if you are using the sandbox hadoop (install_local_hadoop).
     sqstop
     swstopall
    

    To start it up later, use the following commands:

     swstartall
     sqstart
    

    To check on the status, use these commands:

     sqcheck
     swstatus
    
  • If you get rid of the entire source tree, all of the local Hadoop install will also be lost. Before removing these files, make sure to stop Hadoop. The easiest way to do that is with the swstopall or swuninstall_local_hadoop script (these are generated script in your path).