ComponentRuntime DependenciesPackage CI

Puppet Deployment

Smoke Test CI

Notes on packaging and smoke-testsOther notes on packaging, installation, migration and operation
AlluxioHDFS(warning)(tick)(tick)
  • not supported on openEuler 22.03 aarch64. (see BIGTOP-4114)
  • (not supported on Debian 11 ppc64el)

bigtop-select
(tick)--
  • DEB is not supported.

FlinkHDFS, YARN(tick)(tick)(tick)

HBaseHDFS, Zookeeper(tick)(tick)(tick)

HDFS/HCFS(Zookeeper if HA enabled)(tick)(tick)(tick)
  • At least 3 nodes of testing cluster is required for node failing test to be passed.
  • Allow sshkeys and have ssh support on the hosts.

HiveHDFS, YARN(tick)(tick)(tick)

KafkaZookeeper(tick)(tick)(tick)

LivyHDFS, YARN, Spark(tick)(tick)(tick)

MapReduceHDFS, YARN(tick)(tick)(tick)

PhoenixHDFS, HBase, Zookeeper(tick)(tick)(tick)

Ranger
(tick)(tick)(warning)
  • (not supported on ppc64le)
  • TestRangerSmoke fails on aarch64 instances. (BIGTOP-4147)

SparkHDFS, YARN(tick)(tick)(warning)
  • testSparkR fails on openEuler 22.03 due to lack of Python in the test deployment. (BIGTOP-4112)

TezHDFS, YARN, Hive(tick)(tick)(tick)

YARNHDFS(tick)(tick)(tick)

In HA mode, you may have to specify the "yarn.resourcemanager.webapp.address.$rm-id" property in yarn-site.xml explicitly. Otherwise you may come across NPE when running YARN application, reported as YARN-8056.

ZeppelinHDFS, YARN, Spark, Hive(tick)(tick)(tick)
  • (not supported on CentOS 7 ppc64le)

Zookeeper-(tick)(tick)(tick)

Platform X Arch CI Coverage Report


x86_64AARCH64PPC64LE

Package CISmoke Test CIPackage CISmoke Test CIPackage CISmoke Test CI
CentOS 7(tick)(tick)(tick)(tick)(tick)

(tick)

Rocky Linux 8

(tick)(tick)(tick)(tick)--

Fedora 38

(tick)(tick)(tick)(tick)--

openEuler 22.03

(tick)(tick)(tick)(tick)--
Debian 11(tick)(tick)(tick)(tick)(tick)(tick)
Ubuntu 22.04(tick)(tick)(tick)(tick)(tick)(tick)

Package CI Status

Smoke Test CI Status