| Component | Runtime Dependencies | Package CI | Puppet Deployment | Smoke Test CI | Notes on packaging and smoke-tests | Other notes on packaging, installation, migration and operation |
|---|
| Alluxio | HDFS |  |  |  |
| - "devel" repository must be enabled on Rocky Linux 9 for dependency on redhat-lsb-core.
|
| bigtop-select |
|  | - | - | |
|
| Flink | HDFS, YARN |  |  |  |
| - "devel" repository must be enabled on Rocky Linux 9 for dependency on redhat-lsb-core.
|
| HBase | HDFS, Zookeeper |  |  |  |
| - "devel" repository must be enabled on Rocky Linux 9 for dependency on redhat-lsb-core.
|
| HDFS/HCFS | (Zookeeper if HA enabled) |  |  |  | - Allow sshkeys and have ssh support on the hosts.
- At least 3 worker nodes are required for tests to be passed.
| - "devel" repository must be enabled on Rocky Linux 9 for dependency on redhat-lsb-core.
|
| Hive | HDFS, YARN |  |  |  | - smoke-test is flaky due to premature access (BIGTOP-4432).
| - "devel" repository must be enabled on Rocky Linux 9 for dependency on redhat-lsb-core.
|
| Kafka | Zookeeper |  |  |  |
|
|
| Livy | HDFS, YARN, Spark |  |  |  |
|
|
| MapReduce | HDFS, YARN |  |  |  |
|
|
| Phoenix | HDFS, HBase, Zookeeper |  |  |  | - Packaging fails on ubuntu-24.04-aarch64 due to issue related to mvn install:install-file (BIGTOP-4422). Since the issue is not reproducible on local machine, packages built on local are uploaded.
|
|
| Ranger |
|  |  |  |
|
|
| Solr |
|  |  |  |
| - "devel" repository must be enabled on Rocky Linux 9 for dependency on redhat-lsb-core.
|
| Spark | HDFS, YARN |  |  |  |
| - "devel" repository must be enabled on Rocky Linux 9 for dependency on redhat-lsb-core.
|
| Tez | HDFS, YARN, Hive |  |  |  |
|
|
| YARN | HDFS |  |  |  |
| - In HA mode, you may have to specify the "yarn.resourcemanager.webapp.address.$rm-id" property in yarn-site.xml explicitly. Otherwise you may come across NPE when running YARN application, reported as YARN-8056.
|
| Zeppelin | HDFS, YARN, Spark, Hive |  |  |  |
| - "devel" repository must be enabled on Rocky Linux 9 for dependency on redhat-lsb-core.
|
| Zookeeper | - |  |  |  |
| - "devel" repository must be enabled on Rocky Linux 9 for dependency on redhat-lsb-core.
|