Component | Runtime Dependencies | Package CI | Puppet Deployment | Smoke Test | Smoke Test CI | Smoke Test Requirements | Other notes on installation, migration and operation |
---|---|---|---|---|---|---|---|
Alluxio | HDFS | ||||||
Ambari | - | If the deployment gets stuck on `ambari-server setup` and PostgreSQL seems to be suspended during deactivating on Rocky Linux 8, running `sudo systemctl daemon-reload` from other terminal may resume the process. See BIGTOP-3553 and https://bugs.centos.org/view.php?id=17461#c38582. | |||||
Flink | HDFS, YARN | ||||||
GPDB | - |
| |||||
HBase | HDFS, Zookeeper | ||||||
HDFS/HCFS | (Zookeeper if HA enabled) |
| |||||
Hive | HDFS, YARN | ||||||
Kafka | Zookeeper | ||||||
Kibana | Elasticsearch | ||||||
Livy | HDFS, YARN, Spark | ||||||
MapReduce | HDFS, YARN | ||||||
Oozie | - | ||||||
Phoenix | HDFS, HBase, Zookeeper | ||||||
Solr Cloud | Zookeeper | ||||||
Spark | HDFS, YARN | ||||||
Tez | HDFS, YARN, Hive | ||||||
YARN | HDFS | In HA mode, you may have to specify the "yarn.resourcemanager.webapp.address.$rm-id" property in yarn-site.xml explicitly. Otherwise you may come across NPE when running YARN application, reported as YARN-8056. | |||||
YCSB | - | ||||||
Zeppelin | HDFS, YARN, Spark, Hive | ||||||
Zookeeper | - |
Platform X Arch CI Coverage Report
x86_64 | AARCH64 | PPC64LE | ||||
---|---|---|---|---|---|---|
Package CI | Smoke Test CI | Package CI | Smoke Test CI | Package CI | Smoke Test CI | |
CentOS 7 | - | - | ||||
Rocky Linux 8 | - | - | ||||
Fedora 36 | ||||||
Debian 10 | - | - | ||||
Debian 11 | ||||||
Ubuntu 10.04 | ||||||
Ubuntu 22.04 |
Smoke Tests issues:
- There're still some deployment issues for Alluxio and GPDB on Arm64 and PPC64le Fedora 36. (BIGTOP-3896)
Package CI Status
- https://ci.bigtop.apache.org/job/Bigtop-3.2.1-x86_64/
- https://ci.bigtop.apache.org/job/Bigtop-3.2.1-aarch64/
- https://ci.bigtop.apache.org/job/Bigtop-3.2.1-ppc64le/