Quick Intro slide
Here's a slide to quickly go through the idea of the BigTop VM and Docker provisioner.
Getting Started
Clone the BigTop source code
$ git clone https://github.com/apache/bigtop.git
To create a VM based BigTop Hadoop cluster:
$ cd bigtop/bigtop-deploy/vm/vagrant-puppet-vm
$ vim vagrantconfig.yaml
# Update the repo to be:
Note: Bigtop S3 repos is currently out of available, we're working on the fix. Please use the packages on our CI server instead.
And update the component you'd like to deploy, for example:
components: [hadoop, yarn, ignite-hadoop] (effective values)
$ vagrant up
DONE!
To create a Docker based BigTop Hadoop cluster:
$ cd bigtop/bigtop-deploy/vm/vagrant-puppet-docker
$ vim vagrantconfig.yaml
# Update the repo to be:
Note: Bigtop S3 repos is currently out of available, we're working on the fix. Please use the packages on our CI server instead.
And update the component you'd like to deploy, for example:
components: [hadoop, yarn, ignite-hadoop] (effective values)
$ ./docker-hadoop.sh --build-image --create 3
DONE!
Destroy clusters:
destroy VM cluster:
$ vagrant destroy -f
destroy Docker cluster:
$ ./docker-hadoop.sh --destroy
Demo video