Versions Compared

Old Version 44

changes.mady.by.user Lei Chang

Saved on

compared with

New Version 45

changes.mady.by.user Lei Chang

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Panel
Tabs Container
idbuild-tabs
directionhorizontal
Tabs Page
idmacos
titleMacOS (10.10+)

Install dependencies on MAC

Code Block
brew install protobuf protobuf-c Gsasl openssl boost
 
 thrift json-c ccache snappy libyaml libevent python

brew tap brona/iproute2mac

brew install iproute2mac

brew install postgresql
sudo  pip 

sudo  pip --retries=50 --timeout=300 install pygresql (please verify if python command ‘import _pg’ works after installation)
 sudo  pip 

 sudo  pip --retries=50 --timeout=300 install unittest2 pycrypto lockfile paramiko psi (use system default gcc)

sudo pip --retries=50 --timeout=300 install http://sourceforge.net/projects/pychecker/files/pychecker/0.8.19/pychecker-0.8.19.tar.gz/download (use system default gcc)

brew uninstall postgresql

 

Install libhdfs3

Code Block
git clone https://github.com/Pivotal-DataFabric/libhdfs3

cd libhdfs3

mkdir build

cd build

../bootstrap --prefix=/usr/local/

make -j8

make install

 

 

Tabs Page
idtab-yum
titleRedhat/Centos 7.X

Install dependencies on CentOS7.x

OS requirement

Linux ( tested on centos 7.x).

Dependencies

(CentOS7 user can follow easy steps provided by Zhanwei Wang)

 

Code Block
languagebash
curl -L "https://bintray.com/wangzw/rpm/rpm" -o /etc/yum.repos.d/bintray-wangzw-rpm.repo
yum install -y epel-release
yum makecache
yum install -y man passwd sudo tar which git mlocate links make bzip2 net-tools \
  autoconf automake libtool m4 gcc gcc-c++ gdb bison flex cmake gperf maven indent \
  libuuid-devel krb5-devel libgsasl-devel expat-devel libxml2-devel \
  perl-ExtUtils-Embed pam-devel python-devel libcurl-devel snappy-devel \
  thrift-devel libyaml-devel libevent-devel bzip2-devel openssl-devel \
  openldap-devel protobuf-devel readline-devel net-snmp-devel apr-devel \
  libesmtp-devel xerces-c-devel python-pip json-c-devel libhdfs3-devel \
  apache-ivy java-1.7.0-openjdk-devel \
  openssh-clients openssh-server
yum install -y postgresql-devel
pip --retries=50 --timeout=300 install pg8000 simplejson unittest2 pycrypto pygresql pyyaml lockfile paramiko psi
pip --retries=50 --timeout=300 install http://darcs.idyll.org/~t/projects/figleaf-0.6.1.tar.gz
pip --retries=50 --timeout=300 install http://sourceforge.net/projects/pychecker/files/pychecker/0.8.19/pychecker-0.8.19.tar.gz/download
yum erase -y postgresql postgresql-libs postgresql-devel
Tabs Page
titleRedhat/Centos 6.x
classtabs-compile-dependencies

Build dependencies yourself

OS requirement

Linux ( tested on redhat 6.x).

Dependencies

There are several dependencies (see the following table) you must install before building HAWQ. To build Apache HAWQ, gcc and some dependencies are needed. The libraries are tested on the given versions. Most of the dependencies can be installed through yum. Other dependencies should be installed through the source tarball. Typically you can use "./configure && make && make install" to install from source tarball.

Libraries that must be installed using source tarball.


NameVersionDownload URL
json-c
0.9

http://oss.metaparadigm.com/json-c/json-c-0.9.tar.gz

boost
1.56
http://sourceforge.net/projects/boost/files/boost/1.56.0/boost_1_56_0.tar.bz2
thrift
0.9.1-1
http://archive.apache.org/dist/thrift/0.9.1/thrift-0.9.1.tar.gz
protobuf
2.5.0
https://github.com/google/protobuf/tree/v2.5.0
curl
7.44.0
http://www.curl.haxx.se/download/curl-7.44.0.tar.gz
libhdfs3
latest version
https://github.com/PivotalRD/libhdfs3.git
libyarn
 
Code shipped with Apache HAWQ (under incubator-hawq/depends/)
  • cd depends/libyarn/
  • mkdir build
  • cd build
  • ../bootstrap --prefix=/usr/local/
  • make
    • sudo make install

     

     

    Libraries that can be installed through yum.

    NameVersoin
    epel-release6-8
    make
    3.81
    gcc
    4.4.7
    gcc-c++
    4.4.7
    gperf
    3.0.4
    snappy-devel
    1.1.3
    bzip2-devel 
    1.0.6
    python-devel 
    2.6.2
    libevent-devel
    1.4.6
    krb5-devel
    1.11.3
    libuuid-devel
    2.26.2
    libgsasl-devel
    1.8.0
    libxml2-devel 
    2.7.8
    zlib-devel
    1.2.3
    readline-devel
    6
    openssl-devel
    0.9.8
    bison-devel
    2.5
    apr-devel
    1.2.12
    libyaml-devel
    0.1.1
    flex-devel
    2.5.35
    Tabs Page
    iddocker-tab
    titleDocker (Redhat/Centos 7.X)

    Build with Prebuilt Docker Image

     

    Probably the simplest way to get started with the build is starting with the community developed docker image with all the project dependencies pre-installed.

     

    To use the docker image follow the steps on: https://hub.docker.com/r/mayjojo/hawq-devel/

     

     

     

    ...