...
This document tracks on-going efforts to upgrade from Hadoop 2.x to Hadoop 3.x - Refer Refer Umbrella Jira HADOOP-15501 for current status on this.
Upgrade Tests
The following scenarios were tested while upgrading from Hadoop 2.8.4 to Hadoop 3.1.0
| Type | Component | Scenario | Issues Found | Workaround | Overall Status |
|---|
| EXPRESS UPGRADE | HDFS | Starting NameNode/DataNode with custom MetricsPlugin configured in hadoop2-metrics.properties | | Jira |
|---|
| server | ASF JIRA |
|---|
| serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
|---|
| key | HADOOP-15502 |
|---|
|
| Replace MetricsPlugin implementation jars( eg: HadoopTimelineMetricsSink) with recompilked jars which use package "org.apache.commons.configuration2" |  |
| EXPRESS UPGRADE | YARN | Starting YARN daemons |
|
| |
| ROLLING UPGRADE | HDFS | NN is started with rollingUpgrade with default policy configured for Erasure coding | | Jira |
|---|
| server | ASF JIRA |
|---|
| serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
|---|
| key | HDFS-13596 |
|---|
|
| Not known | |
| ROLLING UPGRADE | YARN |
| | Jira |
|---|
| server | ASF JIRA |
|---|
| serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
|---|
| key | YARN-8068 |
|---|
|
| Jira |
|---|
| server | ASF JIRA |
|---|
| serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
|---|
| key | YARN-8346 |
|---|
|
|
| |
|
|
|
|
| |
|
|
|
|
| |