Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

ComponentRuntime DependenciesPackage CI

Puppet Deployment

Smoke Test

Smoke Test CI

Smoke Test RequirementsOther notes on installation, migration and operation
AlluxioHDFS(tick)(tick)(tick)(tick)

Ambari-(tick)(tick)(tick)(tick)

Elasticsearch-(tick)(tick)(tick)(tick)

FlinkHDFS, YARN(tick)(tick)(tick)(tick)

Flume-(tick)(tick)(tick)(tick)

GiraphHDFS, YARN(tick)(tick)(tick)(tick)

GPDB-(tick)(tick)(tick)

(tick)

  • At least 2 nodes (master and primary)

HBaseHDFS, Zookeeper(tick)(tick)(tick)(warning)

HDFS/HCFS(Zookeeper if HA enabled)(tick)(tick)(tick)(tick)
  • At least 3 nodes of testing cluster is required for node failing test to be passed
  • Allow sshkeys and have ssh support on the hosts

HiveHDFS, YARN(tick)(tick)(tick)(tick)

Ignite HadoopHDFS, YARN(tick)(tick)(tick)(tick)

KafkaZookeeper(tick)(tick)(tick)(tick)

KibanaElasticsearch(tick)(tick)(tick)(warning)

LivyHDFS, YARN, Spark(tick)(tick)(tick)(warning)

Logstash-(tick)(tick)(tick)(tick)

Mahout

HDFS, YARN(tick)(tick)(tick)(tick)
  • MEM >=8G for ML models to be ran successfully

MapreduceHDFS, YARN(tick)(tick)(tick)(tick)

Oozie-(tick)(tick)(tick)(warning)
  • If you upgrade from Bigtop 1.4.0, you may have to "downgrade" Oozie since its version is 4.3.0-1 in the 1.5.0 release while 4.3.0-3 in 1.4.0.


PhoenixHDFS, HBase, Zookeeper(tick)(error)(error)(error)

QFSHDFS, YARN(tick)(tick)(tick)(warning)

Solr CloudHDFS, Zookeeper(tick)(tick)(tick)(tick)

SparkHDFS, YARN(tick)(tick)(tick)(tick)

Sqoop-(tick)(tick)(tick)(tick)

TezHDFS, YARN, Hive(tick)(tick)(tick)(tick)

YARNHDFS(tick)(tick)(tick)(tick)
  • In HA mode, you may have to specify the "yarn.resourcemanager.webapp.address.$rm-id" property in yarn-site.xml explicitly.Otherwise you may come across NPE when running YARN application, reported as YARN-8056.
YCSB-(tick)(tick)(tick)(tick)

ZeppelinHDFS, YARN, Spark, Hive(tick)(tick)(tick)(tick)

Zookeeper-(tick)(tick)(tick)(tick)

...