Versions Compared

Old Version 3

changes.mady.by.user Tim Armstrong

Saved on

compared with

New Version Current

changes.mady.by.user Tim Armstrong

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.


Info

See Bootstrapping an Impala Development Environment From Scratch for up-to-date, regularly tested, steps to set up your development environment.

The information on this page is stale, but maybe be useful for adventurous people who want to set up a dev environment manually from scratch.

Java

Download and install a Java 7 or Java 8 JDK. Either the Oracle JDK or OpenJDK should work for development.

This page is out of date, but retained in case people want/need to try setting up Impala from scratch without the automated Chef script.

These instructions are installing the prerequisite packages and configuration for Impala. Currently we have guides for building on Ubuntu 14.04 and CentOs 6.5.

Java

Download the Oracle Java 7 JDK.

On Ubuntu 14.04 this can be done with the following commands:   

Code Block
sudo add-apt-repository ppa:webupd8team/java -y
sudo apt-get update -y

# Will have to agree to License
get install openjdk-7-jdk


On Ubuntu 16.04 :

Code Block
sudo apt-get install oracleopenjdk-jdk7-installer -y8-jdk

The OpenJDK website has tips for other distributions too: http://openjdk.java.net/install/On CentOS 6.5, [this page has a good guide.](https://www.digitalocean.com/community/tutorials/how-to-install-java-on-centos-and-fedora)

Required packages

On Ubuntu 14.04

...

You need to make a configurations change to allow Hbase and the Hive metastore to functions correctly. Edit the following file as root.
On Ubuntu 14.04 and 16.04

    /etc/postgresql/*/main/pg_hba.conf

On CentOs 6.5

    /var/lib/pgsql/data/pg_hba.conf

...


To make Postgres aware of these changes, either restart the service or run: pg_ctl reload


If the script fails to start postgresql due to a missing snakeoil SSL cert, do:

sudo make-ssl-cert generate-default-snakeoil



Creating the Hive metastore user

...

Code Block
CREATE ROLE hiveuser LOGIN PASSWORD 'password';
ALTER ROLE hiveuser WITH CREATEDB;

Maven 3

On some older systems you may need to install Maven 3 from https://maven.apache.org/ and install it:

...

Put these in your `.bashrc` or elsewhere:On Ubuntu 14.04/CentOS6.5

Code Block
export JAVA_HOME=/usr/lib/jvm/java-7-oracle<your java version>
export LD_LIBRARY_PATH=/usr/lib/x86_64-linux-gnu
export LC_ALL="en_US.UTF-8"

# If you installed maven manually:
export M2_HOME=/usr/local/apache-maven-3.0.5
export M2=$M2_HOME/bin  
export PATH=$M2:$PATH

...

Code Block
sudo apt-get install ntp ntpdate
sudo service ntp start

...


On CentOS 7
 Code Block
yum install ntp
systemctl start ntpd
...