Quick Intro slide
Here's a slide to quickly go through the idea of the BigTop VM and Docker provisioner.
Getting Started
Clone the BigTop source code
$ git clone https://github.com/apache/bigtop.git
To create a VM based BigTop Hadoop cluster:
$ cd bigtop/bigtop-deploy/vm/vagrant-puppet-vm
$ vim vagrantconfig.yaml
# Update the repo to be:
CentOS 6: http://bigtop-repos.s3.amazonaws.com/releases/1.0.0/centos/6/x86_64
Debian 8: http://bigtop-repos.s3.amazonaws.com/releases/1.0.0/debian/8/x86_64
And update the component you'd like to deploy, for example:
components: [hadoop, yarn, ignite-hadoop] (effective values)
$ vagrant up
DONE!
To create a Docker based BigTop Hadoop cluster:
$ cd bigtop/bigtop-deploy/vm/vagrant-puppet-docker
$ vim vagrantconfig.yaml
# Update the repo to be:
CentOS 6: http://bigtop-repos.s3.amazonaws.com/releases/1.0.0/centos/6/x86_64
Debian 8: http://bigtop-repos.s3.amazonaws.com/releases/1.0.0/debian/8/x86_64
And update the component you'd like to deploy, for example:
components: [hadoop, yarn, ignite-hadoop] (effective values)
$ ./docker-hadoop.sh --create 3
DONE!
Destroy clusters:
destroy VM cluster:
$ vagrant destroy -f
destroy Docker cluster:
$ ./docker-hadoop.sh --destroy
Demo video