Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Migrated to Confluence 5.3

...

WARNING 1: We are only supporting Oracle JDK/JRE 6. Bigtop distribution may or may not run with OpenJDK. Please got to the Oracle's web site and download the JDK6 package for the Linux distro that you're using: http://www.oracle.com/technetwork/java/javasebusiness/downloads/java-archive-downloads-javase6-419409.htmlImage Removed before installing Bigtop

...

  1. Make sure to grab the repo file:
    No Format
    wget -O  
    http://bigtop01.cloudera.org:8080/view/Releases/job/Bigtop-0.4.0/label=sles11/lastSuccessfulBuild/artifact/output/bigtop.repo
    sudo mv bigtop.repo  /etc/zypp/repos.d/bigtop.repo
    
  2. Refresh zypper to start looking at the newly added repo
    No Format
    
    sudo zypper refresh
    
  3. Browse through the artifacts
    No Format
    zypper search mahout
    
  4. Install the full Hadoop stack (or parts of it)
    No Format
    sudo zypper install hadoop\* flume\* mahout\* oozie\* whirr\*
    

...

  1. Install the Apache Bigtop GPG key
    No Format
    wget -O- http://www.apache.org/dist/bigtop/bigtop-0.4.0-incubating/repos/GPG-KEY-bigtop | sudo apt-key add -
    
  2. Make sure to grab the repo file:
    for Ubuntu Lucid:
    No Format
    sudo wget -O /etc/apt/sources.list.d/bigtop.list http://bigtop01.cloudera.org:8080/view/Releases/job/Bigtop-0.4.0/label=lucid/lastSuccessfulBuild/artifact/output/bigtop.list
    
    for Ubuntu Precise:
    No Format
    sudo wget -O /etc/apt/sources.list.d/bigtop.list http://bigtop01.cloudera.org:8080/view/Releases/job/Bigtop-0.4.0/label=precise/lastSuccessfulBuild/artifact/output/bigtop.list
    
  3. Update the apt cache
    No Format
    sudo apt-get update
    
  4. Browse through the artifacts
    No Format
    apt-cache search mahout
    
  5. Install bigtop-utils
    No Format
    
    sudo apt-get install bigtop-utils
    
  6. Make sure that you have the latest JDK installed on your system as well. You can either get it from the official Oracle website (http://www.oracle.com/technetwork/java/javase/downloads/jdk-6u29-download-513648.html) or follow the advice given by your Linux distribution. If your JDK is installed in a non-standard location, make sure to add the line below to the /etc/default/bigtop-utils file
    No Format
    export JAVA_HOME=XXXX
    
  7. Install the full Hadoop stack (or parts of it)
    No Format
    sudo apt-get install hadoop\* flume-* mahout\* oozie\* whirr-*
    

...

One of the advantages of Bigtop is the ease of installation of the different Hadoop Components without having to hunt for a specific Hadoop Component distribution and matching it with a specific Hadoop version.
Please visit the link above to run some easy examples from the Bigtop distribution !
Provided at the link above are examples to run Hadoop 1.0.1 and nine other components from the Hadoop ecosystem (hive/hbase/zookeeper/pig/sqoop/oozie/mahout/whirr and flume).
See the

HTML
<a href="https://svn.apache.org/repos/asf/incubator/bigtop/trunk/bigtop.mk" target="_blank">Bigtop Make File</a>

...