Welcome to the home of the Apache Bigtop space!
The primary goal of Bigtop is to build a community around the packaging, deployment and interoperability testing of Hadoop-related projects. This includes testing at various levels (packaging, platform, runtime, upgrade, etc...) developed by a community with a focus on the system as a whole, rather than individual projects.
Build, packaging and integration test code that depends upon official releases of the Apache Hadoop-related projects (HDFS, MapReduce, HBase, Hive, Pig, ZooKeeper, etc...) is developed and released by this project. As bugs and other issues are found we expect these to be fixed upstream.
Apache Bigtop has several purposes.
- How-To (for bigtop users) of real clusters
Getting Started
- How to build and run Bigtop Sandbox (Experimental)
- How to install Hadoop distribution from Bigtop 1.2.0
- How to install Bigtop 1.0.0(and above) with Bigtop Provisioner
- How to install Bigtop 0.8.0 Hadoop on CentOS 6 with Puppet
- How to install Hadoop distribution from Bigtop 0.7.0
- How to install Hadoop distribution from Bigtop 0.6.0
- How to install Hadoop distribution from Bigtop 0.5.0
- How to install Hadoop distribution from Bigtop 0.4.0
- How to install Hadoop distribution from Bigtop 0.3.0
Releases
- Bigtop 1.3.0 Release Nov. 2018
- Bigtop 1.2.1 Release Nov., 2017
- Bigtop 1.2.0 Release Apr., 2017
- Bigtop 1.1.0 Release Feb., 2016
- Bigtop 1.0.0 Release Aug., 2015
Known Issues
Building
- How to build Bigtop-trunk: (development with toolchain, Docker images, etc.)
- How to build Bigtop-1.1
- How to build Bigtop-1.0
- Bigtop CI Setup Guide
Deployment and Integration Testing
For simple and easy testing of bigtop deployment and smoke tests, you can run Vagrant Provisioner or Docker Provisioner, which demonstrate round trip setup, testing of a bigtop distribution on different platforms.
Details are in the links below.
- Bigtop Provisioner User Guide
- Deploying Bigtop with Puppet
- Running integration, system, and package tests
- Writing integration and system tests
- Setting up Bigtop to run HBase system tests
- Next gen puppet deployment (discussions)
Contributing
General
- Frequently Asked Questions (FAQ)
- Slides from Bigtop presentations
- The Community goals of BigTop
- Social Media Guidelines
- How to release