Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  1. To log on to a virtual machine, use the vagrant ssh command; for example:

    Code Block
    vagrant ssh c7001
    
    LMBP:centos7.0 lkg$ vagrant ssh c7001
    Last login: Tue Jan 12 11:20:28 2016
    [vagrant@c7001 ~]$  

    From this point onward, this terminal window is connected to the virtual machine until you exit the virtual machine. All commands go to the VM, not to your Mac.

    Recommendation: Open a second terminal window for your Mac. This is useful when accessing the Ambari Web UI. To distinguish between the two, terminal windows typically list the computer name or VM hostname on each command-line prompt and at the top of the terminal window.

  2. When you first access the VM you will be logged in as user vagrant. Switch to the root user:

    Code Block
    [vagrant@c7001 ~]$ sudo su -
    
    Last login: Sun Sep 25 01:34:28 AEST 2016 on pts/0
    root@c7001:~#  

The following two subsections describe how to install Ambari and HDP components. If at any time you wish to return a the terminal window to your host machine:

...

  1. From the terminal window on the VM where you want to run the main Ambari service, download the Ambari repository. The following commands download Ambari version 2.4.1.0 and install ambari-server. To install a different version of Ambari, specify the appropriate repo URL. Choose the appropriate commands for the operating system on your VMs:

    OSCommands
    CentOS 6
    wget -nv http://public-repo-1.hortonworks.com/ambari/centos6/2.x/updates/2.4.1.0/ambari.repo -O /etc/yum.repos.d/ambari.repo 

    yum install ambari-server -y
    CentOS 7wget -nv http://public-repo-1.hortonworks.com/ambari/centos7/2.x/updates/2.4.1.0/ambari.repo -O /etc/yum.repos.d/ambari.repo

    yum install ambari-server -y
    Ubuntu 12
    wget -nv http://public-repo-1.hortonworks.com/ambari/ubuntu12/2.x/updates/2.4.1.0/ambari.list -O /etc/apt/sources.list.d/ambari.list

    apt-key adv --recv-keys --keyserver keyserver.ubuntu.com B9733A7A07513CAD
    apt-get update
    apt-get install ambari-server -y
     Ubuntu 14wget -nv http://public-repo-1.hortonworks.com/ambari/ubuntu14/2.x/updates/2.4.1.0/ambari.list -O /etc/apt/sources.list.d/ambari.list

    apt-key adv --recv-keys --keyserver keyserver.ubuntu.com B9733A7A07513CAD

    apt-get update

    apt-get install ambari-server -y
  2. To install Ambari with default settings, set up and start ambari-server:

    Code Block
    ambari-server setup -s
    ambari-server start

    For more information about installation options and settings, see Apache Ambari Installation.

  3. To check Ambari Server status, issue the following command:
    ambari-server status

  4. After Ambari Server has started, launch a browser on your host machine (Mac). Access the Ambari Web UI at http://<hostname>.ambari.apache.org:8080. The <hostname> part of the URL specifies the VM where you installed Ambari; for example:

    Code Block
    http://c7001.ambari.apache.org:8080

     Note: The Ambari Server can take some time to launch and be ready to accept connections. Keep trying the URL until you see the login page.

  5. Login using default username admin, password admin.

  6. On the welcome page, choose "Launch Install Wizard."

  7. Specify a name for your cluster, and then click Next.

Install the HDP Stack

The following instructions describe how to use Ambari to install HDP components. For additional information, see the Apache Ambari Installation Guide. (The link is for Apache Ambari version 2.4.1.0, HDP distribution.)

  1. On the Ambari screen, login using default username admin, password admin.

  2. On the welcome page, choose "Launch Install Wizard."

  3. Specify a name for your cluster, and then click Next.

  4. On the Select Version page, choose which version of HDP to install, and then click Next.

  5. On the Install Options page, complete the following steps:

    1. List

    On the Select Version page, choose which version of HDP to install, and then click Next.
    On the Install Options page, list
    1. the FQDNs of the virtual machines. For example:

      Code Block
      c7001.ambari.apache.org
      c7002.ambari.apache.org
      c7003.ambari.apache.org
      

      Alternatively, you can use a range expression:

      Code Block
      c70[01-03].ambari.apache.org
      
    2. Upload the insecure_private_key file that you created earlier: browse to the ambari-vagrant directory, navigate to the operating system folder for your VM's, and choose the key file.

    3. Change the SSH User Account to vagrant.

    4. Click "Register and Confirm."

  6. On the Confirm Hosts page,

    select all hosts.

    Ambari displays installation status.

    Continue stepping through Installation Wizard, completing onscreen instructions. If you see the following If you see the following message, click on the link to review warnings:
         Some warnings were encountered while performing checks against the 3 registered hosts above Click here to see the warnings.
    See the Troubleshooting section (later on this page) for more information.

  7. Click When all host checks pass, click Next to continue.

  8. On the Choose Services page, unselect uncheck any components that you do not expect to use. If any are required for selected components, Ambari will request to add them back in.
  9. On the Assign Masters screen, choose hosts or simply click Next to use default values.
  10. On the Assign Slaves and Clients screen, choose hosts or simply click Next to use default values.
  11. On the Customize Services screen, review services with warning notes, such as Hive and Ambari Metrics in the following image:
    Specify property values as directed by the installation wizard, and then . When all configurations have been addressed, click Next.
  12. On the Review screen, review the service definitions, and then click Next.
  13. The Install, Start and Test page shows deployment status. This step takes several minutes.

Install the HDP Stack

Next, install HDP on your cluster.

http://docs.hortonworks.com/HDPDocuments/Ambari-2.2.1.0/bk_Installing_HDP_AMB/content/ch_Deploy_and_Configure_a_HDP_Cluster.html

Choose which HDP version,  Choose services, Assign master and slave processes, Customize services (here I assigned admin/admin to Hive and Oozie)

Timeline for installing HDP, and mac hardware

Troubleshooting

  • Ambari message about THPs? fix transparent huge page setting in /etc/rc.loca (CentOS7)
  • ntp not running / ntpd not installed?

+ Timeline for installing HDP, and mac hardware

Troubleshooting

  • Ambari message about THPs? fix transparent huge page setting in /etc/rc.loca (CentOS7)
  • ntp not running / ntpd not installed?

If you see an error similar to the following on the Confirm Hosts page of the Ambari installation wizard, click the link to see the warnings:
     Some warnings were encountered while performing checks against the 3 registered hosts above. Click here to see the warnings.

...

You should see messages confirming that ntpd is running. Navigate back to the Host Checks window of the Ambari installation wizard and click Rerun Checks. When all checks complete successfully, click Close to continue the installation process.

If the Install, Start and Test step fails with the following error during DataNode deployment: 

Error: Package: snappy-devel-1.0.5-1.el6.x86_64 (HDP-UTILS-1.1.0.20) 
Requires
: snappy(x86-64) = 1.0.5-1.el6 
Installed
: snappy-1.1.0-3.el7.x86_64 (@anaconda/7.2)

Run the following commands under the root account on each VM:

yum remove -y snappy-1.1.0-3.el7.x86_64
yum install snappy
-devel -y

Basic Vagrant Commands

The following table lists several common Vagrant commands. For more information, see Vagrant Command-Line Interface documentation.

...