...
Application Type | Upgrade Type | Issues Found | Status | Overall Status | ||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
MR | EXPRESS/ROLLING UPGRADE |
| Fixed | |||||||||
HIVE on TEZ | Hive with older versions of Tez (0.7, 0.8.x) with Hadoop 2 client ran into UT failures | Tez 0.10.0 will support Hadoop 3
| ||||||||||
Spark 2.2/2.3 | Spark 2.2/2.3 has a fork of older version of Hive (1.2) which does not work with Hadoop 3
SPARK-23710 Upgrade to Hive 2.x ( which builds with Hadoop 3) | IN-PROGRESS | ||||||||||
PIG | Support for Hadoop 3 In-Progress in the community - targeted for PIG 0.18.0 PIG-5253 Pig Hadoop 3 support | IN-PROGRESS | ||||||||||
OOZIE | Dependent on PIG support for Hadoop 3 | Support for Hadoop 3 In-Progress in the community - Targeted for OOZIE-5.1.0 OOZIE-2973 Make sure Oozie works with Hadoop 3 | IN-PROGRESS | |||||||||
MR with Native Task Optimization | Validation Pending | |||||||||||
MR with Shared Cache Manager | Validation Pending |