You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 22 Next »

1. Build HAWQ/PXF Ranger RPM package

  • Step 1: Prepare a HAWQ source code tarball for rpm building.
    • a) Make sure the source code tarball name format is: apache-hawq-src-%{hawq_version}-incubating.tar.gz
    • b) Make sure the extracted directory name format is: apache-hawq-src-%{hawq_version}-incubating
    • c) Put the HAWQ source tarball to %{top_dir}/contrib/hawq-package folder. Or use "HAWQ_SOURCE_TARBALL_PATH" to specify the find path of HAWQ source tarball.
  • Step 2: Install build dependencies of HAWQ, following instruction at:
  • Step 3: Run 'make distclean' and './configure'.
  • Step 4: Run 'make rpm' in the top directory of source code
    • You can set environment variable "HAWQ_RELEASE_VERSION" to specify HAWQ version
  • Step 5: You can find HAWQ/PFX/Ranger plugin rpms tarball at:
    • %{top_dir}/contrib/hawq-package/apache-hawq-rpm-%{hawq_version}-incubating.tar.gz
  • Please refer to: https://github.com/apache/incubator-hawq/blob/master/contrib/hawq-package/README for details.

2. Install HAWQ/PXF/Ranger with RPM

  • Step 1: Install Apache Hadoop rpm packages using bigtop

    • Download bigtop repo as /etc/yum.repos.d/bigtop.repo from https://www-us.apache.org/dist/bigtop/bigtop-1.2.0/repos/centos7/

      sudo wget -O /etc/yum.repos.d/bigtop.repo https://www-us.apache.org/dist/bigtop/bigtop-1.2.0/repos/centos7/bigtop.repo

    • Install Hadoop component including Hadoop, Hive, Hbase and Tomcat. Note that bigtop-tomcat version need to be >= 6.0.

      sudo yum install bigtop-tomcat hadoop\* hive\* hbase\*

    • Install Ranger.

      sudo yum install ranger

  • Step 2: Get HAWQ/PXF/Ranger RPM package

    • Download rpm binary release tarball from Apache HAWQ binary repository

      wget -O apache-hawq-src-%{hawq_version}-incubating.tar.gz https://dist.apache.org/repos/dist/release/incubator/hawq/%{hawq_version}-incubating/apache-hawq-src-%{hawq_version}-incubating.tar.gz

    • Or copy it if you compile it by yourself

      cp $HAWQ_SOURCE_DIR/contrib/hawq-package/apache-hawq-rpm-%{hawq_version}-incubating.tar.gz .

  • Step 3: Install HAWQ/PXF/Ranger runtime dependencies

  • Step 4: Install HAWQ/PXF Ranger with RPM package

    • Extract apache-hawq-rpm-2.2.0.0-incubating.tar.gz and go to the directory ‘hawq_rpm_packages’

      tar -xzvf apache-hawq-rpm-2.2.0.0-incubating.tar.gz; cd hawq_rpm_packages

    • Install the rpm packages with below sequence

      rpm -ivh apache-hawq-2.2.0.0-el7.x86_64.rpm
rpm -ivh hawq-ranger-plugin-2.2.0.0-1.el7.centos.noarch.rpm
rpm -ivh apache-tomcat-7.0.62-el6.noarch.rpm
rpm -ivh pxf-service-3.2.1.0-1.el6.noarch.rpm
rpm -ivh pxf-hdfs-3.2.1.0-1.el6.noarch.rpm
rpm -ivh pxf-hive-3.2.1.0-1.el6.noarch.rpm
rpm -ivh pxf-hbase-3.2.1.0-1.el6.noarch.rpm
rpm -ivh pxf-jdbc-3.2.1.0-1.el6.noarch.rpm
rpm -ivh pxf-json-3.2.1.0-1.el6.noarch.rpm
rpm -ivh pxf-3.2.1.0-1.el6.noarch.rpm
  • No labels