You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 24 Next »

Quick Intro slide

Here's a slide to quickly go through the idea of the BigTop VM and Docker provisioner.

Getting Started

Clone the BigTop source code

$ git clone https://github.com/apache/bigtop.git

To create a VM based BigTop Hadoop cluster:

$ cd bigtop/bigtop-deploy/vm/vagrant-puppet-vm

$ vim vagrantconfig.yaml  

# Update the repo to be:

CentOS 6: http://bigtop-repos.s3.amazonaws.com/releases/1.0.0/centos/6/x86_64

Debian 8: http://bigtop-repos.s3.amazonaws.com/releases/1.0.0/debian/8/x86_64

And update the component you'd like to deploy, for example: 

components: [hadoop, yarn, ignite-hadoop] (effective values)

$ vagrant up

DONE!

To create a Docker based  BigTop Hadoop cluster:

$ cd bigtop/bigtop-deploy/vm/vagrant-puppet-docker

$ vim vagrantconfig.yaml  

# Update the repo to be:

CentOS 6: http://bigtop-repos.s3.amazonaws.com/releases/1.0.0/centos/6/x86_64

Debian 8: http://bigtop-repos.s3.amazonaws.com/releases/1.0.0/debian/8/x86_64

And update the component you'd like to deploy, for example: 

components: [hadoop, yarn, ignite-hadoop] (effective values)

./docker-hadoop.sh --create 3

DONE!

Destroy clusters:

destroy VM cluster:

$ vagrant destroy -f

destroy Docker cluster:

$ ./docker-hadoop.sh --destroy

Demo video

  • No labels