THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
...
docker run -d -p 50070:50070 -p 60010:60010 bigtop/sandbox:1.2.1-ubuntu-16.04_-hdfs_hbase
Run Hadoop HDFS + Spark Standalone
docker run -d -p 50070:50070 -p 80888080:80888080 bigtop/sandbox:1.2.1-ubuntu-16.04_-hdfs_spark-standalone
Run Hadoop HDFS + YARN + Hive + Pig
docker run -d -p 50070:50070 -p 80808088:80808088 bigtop/sandbox:1.2.1-ubuntu-16.04_-hdfs_yarn_hive_pig
How to build
Download Bigtop
Go to http://bigtop.apache.org/download.html#releases and download the latest bigtop release. After downloaded:
Code Block | ||
---|---|---|
| ||
tar zxvf bigtop-1.2.1-project.tar.gz
cd bigtop/docker/sandbox |
Build a Hadoop HDFS sandbox image
./build.sh -a bigtop -o centosubuntu-616.04 -c hdfs
Build a Hadoop HDFS, Hadoop YARN, and Spark on YARN sandbox image
...
./build.sh -a bigtop -o centos-6 -f site.yaml.template.centos-6_hadoop_ignite -t my_ignite_stack
Known issues
Fail to start daemons using systemd
Since systemd requires CAP_SYS_ADMIN, currently any OS using systemd can not successfully started up daemons during image build time.
...