...
Component | Runtime Dependencies | Package CI | Puppet Deployment | Smoke Test | Smoke Test CI | Smoke Test Requirements | Other notes on installation, migration and operation |
---|---|---|---|---|---|---|---|
Alluxio | HDFS | ||||||
Ambari | - | If the deployment gets stuck on `ambari-server setup` and PostgreSQL seems to be suspended during deactivating on Rocky Linux 8, running `sudo systemctl daemon-reload` from other terminal may resume the process. See BIGTOP-3553 and https://bugs.centos.org/view.php?id=17461#c38582. Deployment issues on Ubuntu-22.04: BIGTOP-3898. | |||||
Flink | HDFS, YARN | ||||||
GPDB | - |
| |||||
HBase | HDFS, Zookeeper | ||||||
HDFS/HCFS | (Zookeeper if HA enabled) |
| |||||
Hive | HDFS, YARN | ||||||
Kafka | Zookeeper | ||||||
Kibana | Elasticsearch | ||||||
Livy | HDFS, YARN, Spark | ||||||
MapReduce | HDFS, YARN | ||||||
Oozie | - | ||||||
Phoenix | HDFS, HBase, Zookeeper | ||||||
Solr Cloud | Zookeeper | ||||||
Spark | HDFS, YARN | ||||||
Tez | HDFS, YARN, Hive | ||||||
YARN | HDFS | In HA mode, you may have to specify the "yarn.resourcemanager.webapp.address.$rm-id" property in yarn-site.xml explicitly. Otherwise you may come across NPE when running YARN application, reported as YARN-8056. | |||||
YCSB | - | ||||||
Zeppelin | HDFS, YARN, Spark, Hive | ||||||
Zookeeper | - |
...
x86_64 | AARCH64 | PPC64LE | ||||
---|---|---|---|---|---|---|
Package CI | Smoke Test CI | Package CI | Smoke Test CI | Package CI | Smoke Test CI | |
CentOS 7 | ||||||
Rocky Linux 8 (for x86_64 and aarch64 only) | - | - | ||||
Fedora 36 | ||||||
Debian 10 | ||||||
Debian 11 | ||||||
Ubuntu 1020.04 | ||||||
Ubuntu 22.04 |
Smoke Tests issues:
- There're still some deployment issues for Alluxio and GPDB on Arm64 and PPC64le Fedora 36.
- The python dependency issues on Ubuntu-22.04, which caused the smoke tests of Ambari, gpdb, Hive, Ycsb and Zeppelin to fail on Ubuntu-22.04.
It's going to be addressed in the 3.2.1 release and the corresponding Jiras(BIGTOP-3896; BIGTOP-3897; BIGTOP-3898) were created to track them.
...