Page History

Table of Contents

Information about the upcoming mainline releases based on the information from the hadoop mailing lists.

Feature freeze date: all features should be merged
Code freeze date - blockers/critical only, no more improvements and non blocker/critical bug-fixes

...

Please also see, EOL (End-of-life) release branches.

Upcoming releases

3.4.0
3.3.2
3.2.3

Feature freeze date	6th October 2017NA
Code freeze date	20th October 2017NA
Planned release date3rd November 2017
Actual release date
Release Manager:	Subru Krishnan, Arun Suresh
Tracking Page	Hadoop 2.9 Release
Branch	branch-2

Planned features:


Branch	branch-3.2
Release Status	Hadoop 3.2 Release

2.10.2

For more details, please check Hadoop Active Release Lines

Old releases (Released)

Information about old releases only for the records here. For the final features included in a given release please check the official release notes.

3.2.2

Feature freeze date	Sep 30, 2020
Code freeze date	Oct 15, 2020
Planned release date	Dec 20, 2020
Actual release date	Jan 15, 2021
Release Manager:	He Xiaoqiao
Branch	branch-3.2

3.1.4

Feature freeze date	Wednesday, 11 March 2020
Code freeze date	Wednesday, 22 April 2020
Planned release date	Wednesday, 29 April 2020
Actual release date
Release Manager:	Gabor Bota
Branch	branch-3.1

Planned features: Hadoop 3.1 Release

3.3.0

Feature freeze date	Feb 28, 2020
Code freeze date	March 10, 2020
Planned release date	March 15, 2020
Actual release date	July 14,2020
Release Manager:	Brahma Reddy Battula
Branch	trunk

Planned features:

YARN features

...

JIRA
Summary
Component
Feature Owner
Production Deployment Sponsor(*)
Comments
Status
1. YARN-
2928 / YARN-5355ATS v2
9414 Application Catalog for YARN applications YARN
Vrushali / Varun
Eric Yang
Merged
2.
YARN-
2877 / YARN-5220Opportunistic Containers
5542
Scheduling of opportunistic containers YARN
Konstantinos Karanasos/
ArunRoni (Microsoft)
Abhishek Modi

Merged
3. YARN-
5085 Container Update
9473 Support Vector Engine ( a new accelerator hardware) based on pluggable device framework YARN
Arun / WangdaRoni / Sarvesh (
Peter Bacsko
Merged
Microsoft)
4. YARN-
2915Yarn Federation
9264 [Umbrella] Follow-up on IntelOpenCL FPGA plugin YARN
Subru / Carlo
Peter Bacsko
Merged
Sarvesh (Microsoft)
5. YARN-
5139Global Scheduling (Capacity Scheduler)
9145 [Umbrella] Dynamically add or remove auxiliary services YARN
Wangda
Billie Rinaldi

Merged
6. YARN-
3368YARN Web UI v2
9050 [Umbrella] Usability improvements for scheduler activities YARN
Sunil / Wangda
Tao Yang
Merged

7. YARN-
5734API based (Capacity) Scheduler configurationYARNJonathan / XuanJonathan (LinkedIn)
8851 [Umbrella] A pluggable device plugin framework to ease vendor plugin development YARN Zhankun Tang
Merged
8. YARN-
4726
9014
Allocation reuse for
runC container
upgrades
runtime YARN
Arun / JianSarvesh (Microsoft)
Eric Badger
Merged Partially

HDFS Features:

	JIRA	Summary	Component	Feature Owner	Comments	Status
1

9

.

HDFS-

10467

13891

HDFS

Router based federation

RBF stabilization phase

HDFS

Inigo / ChrisInigo (Microsoft)

(*) Production Deployment Sponsor: "We will favor inclusion of a feature in the 2.9.0 release if it is associated with an immediate production deployment requirement. Other cases: We would recommend moving it to the next major release."

	Brahma Reddy Battula		Merged
2.	HDFS-12345	Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)	HDFS	Erik Krogen	Merged
3.	HDFS-13762	Support non-volatile storage class memory(SCM) in HDFS cache directives	HDFS	Feilong He	Merged

Common Features:

	JIRA	Summary	Component	Feature Owner	Status
1.	HADOOP-16095	Support impersonation for AuthenticationFilter	Common	Eric Yang	Merged
2.	HADOOP-15620	Über-jira: S3A phase VI: Hadoop 3.3 features	Common	Steve Loughran	Merged Partially
3.	HADOOP-15763	Über-JIRA: abfs phase II: Hadoop 3.3 features & fixes	Common	Steve Loughran	Merged Partially
4.	HADOOP-15338	Java 11 runtime support	Common	Akira Ajisaka	Merged
5.	HADOOP-15619	Über-JIRA: S3Guard Phase IV: Hadoop 3.3 features	Common	Steve Loughran	Merged Partially
6.	HADOOP-13363	Upgrade protobuf from 2.5.0 to something newer	Common	Vinay	Merged

2.10.

...

0

Feature freeze date

Sep 15, 2017

Code freeze date


Planned release date	2019
Actual

Planned

release date

2017-11-01

Oct 31, 2019

Release Manager:

Andrew WangTracking pageHadoop 3.0.0 release

Jonathan Hung
Branch	branch-

3.0

2

Planned features:

...

YARN features

	JIRA	Summary	Component	Feature Owner	Comments	Status
1.	YARN-8200	Backport resource types/GPU features to branch-2	YARN	Jonathan		Merged to branch-2.10

HDFS Features:

	JIRA	Summary	Component	Feature Owner	Comments	Status
1.

HADOOP

HDFS-

11656

Classpath isolationHADOOP

12943

Consistent Reads from Standby Node

HDFS

Konstantin

Merged

2.

HADOOP S3GuardHADOOP

HDFS-

13345

13541

NameNode Port based selective encryption

HDFS

Chen

Merged

3.

HADOOP

HDFS-

9902 Shell script rewriteHADOOP 4. Reworked daemon and task heap managementHADOOP, MAPREDUCE 5. MapReduce task-level native optimizationMAPREDUCE 6.HADOOP-11804 Shaded client jarsHADOOP 7.YARN-2915 Yarn FederationYARN 8. Support for Opportunistic Containers and Distributed Scheduling.YARN 9. TimelineService v2 alpha 2YARN 10. Support for Microsoft Azure Data Lake and Aliyun Object Storage System filesystem connectorsHADOOP 11.HDFS-7285 Support for Erasure Codes in HDFSHDFS 12.HDFS-5570 Removal of hftp in favor of webhdfsHDFS 13.HDFS-6440 Support for more than two standby NamenodesHDFS 14.HDFS-1312 Intra-datanode balancerHDFS 15.HDFS-9427 Move default ports out of ephemeral rangeHDFS 16.HDFS-10467 HDFS Router based federationHDFS

14403

Cost-Based RPC Fair Call Queue

HDFS

Erik

Merged

3.1.3

Feature freeze date	Aug 25, 2019
Code freeze date	Aug 30, 2019
Planned release date	Sep 07, 2019
Actual release date
Release Manager:	Zhankun Tang
Branch	branch-3.1

Planned features:

3.2.1

Feature freeze date	Aug 30, 2019
Code freeze date	Aug 30, 2019
Planned release date	Sept 7, 2019
Actual release date	Sept 22, 2019
Release Manager:	Rohith Sharma K S
Branch	branch-3.2

3.2.0

Feature freeze date	Sep 7, 2018
Code freeze date	Sep 14, 2018
Planned release date	Sept 30, 2018
Actual release date	Jan 8, 2019
Release Manager:	Sunil Govindan
Branch	trunk

Planned features:

YARN features

	JIRA	Summary	Component	Feature Owner	Status
1.	YARN-3409	Node Attributes Support in YARN	YARN	Naganarasimha/ Sunil	Merged
2.	~~YARN-1011~~	~~Resource Overcommitment~~	~~YARN~~	~~Haibo / Miklos~~	~~Moved Out~~
3.	YARN-8135	Hadoop Submarine project for DeepLearning workloads	YARN	Wangda	Merged
4.	~~YARN-7129~~	~~Application Catalog for YARN applications~~	~~YARN~~	~~Eric Yang~~	~~Moved Out~~
5.	YARN-7512	Support service upgrade via YARN Service API and CLI	YARN	Chandni	Merged
6.	YARN-5742	Serve aggregated logs of historical apps from ATSv2	YARN	Rohith Sharma	Merged

HDFS Features:

	JIRA	Summary	Component	Feature Owner	Comments	Status
1.	HDFS-10285	HDFS Storage Policy Satisfier	HDFS	Uma		Merged
2.	HDFS-12615	Router-based HDFS federation	HDFS	Inigo	Improvement Works	Merged

Common Features:

Inigo / Chris

JIRA

Summary

Component

Comments

1.

HADOOP-15226

S3Guard Phase III

Common

Steve Loughran

Merged

2.

HADOOP-15220

S3a phase V

Common

Steve Loughran

Merged

3.

HADOOP-15407

Support Windows Azure Storage - Blob file system in Hadoop

Common

Da Zhou/Steve Loughran

Merged

Version 3.1

Feature freeze date

Dec 15

Jan 30,

2017

2018

Code freeze date

Jan 1

Feb 08, 2018

Planned release

dae

date

Jan 15

Feb 28, 2018
Release Manager:	Wangda Tan
Branch	trunk

...

YARN features

JIRA

Summary

Component

Feature Owner

Comments

Status

1.

YARN-5079,

YARN-4793,

YARN-4757,

YARN-6419

YARN native services

YARN

Jian He

Maybe 3.0

	Merged
2.	YARN-5734	Dynamic scheduler queue configuration	YARN	Jonathan / Xuan	Also 2.9	Merged
3.	YARN-5881	Add absolute resource configuration

to CapacityScheduler

YARN

Sunil G

Merged

4.

~~YARN-5673~~

~~Container-executor rewrite for better security,~~

~~extensibility and portability~~

~~YARN~~

~~Varun V~~

	~~Move out~~
5.	YARN-6223	GPU Isolation	YARN	Wangda

	Merged
6.	~~YARN-5972~~	~~Support Pausing/Freezing of opportunistic containers~~	~~YARN~~	~~Arun Suresh~~

	~~Move out~~
7.	YARN-3926	Resource Profile and multiple resource types	YARN	Varun V / Sunil	Maybe 3.0	Merged
8.	~~YARN-1011~~	~~Resource~~ overcommittment	~~YARN~~	~~Haibo / Karthik K~~	~~Under discussion~~	~~Move out~~
9.	YARN-6592	Support rich placement constraints in YARN	YARN	Arun Suresh / Kostas / Wangda	Tentative	Merged
10.	YARN-7117	Capacity Scheduler: Support Auto Creation of Leaf Queues While Doing Queue Mapping	YARN	Suma		Merged
11.	YARN-5983	FPGA support				Merged

HDFS Features:

JIRA	Summary	Component	Feature Owner	Comments
1.	~~HDFS-10285~~	~~HDFS Storage Policy Satisfier~~	~~HDFS~~	~~Uma~~

~~Move out~~

2.

<TODO>

HDFS-9806

HDFS tiered storage

HDFS

Chris Douglas

Merged
3.	~~HDFS-7240~~	~~Ozone: Object store for HDFS~~	~~HDFS~~	~~Anu~~

~~Move out~~

Common Features:

...

JIRA

Summary

Component

Comments

1.

HADOOP-13786

Add S3Guard committer for zero-rename commits to

S3 endpoints

HDFS

Steve Loughran

Merged

Version 2.9

Feature freeze date	~~6th October 2017~~ 20th October 2017
Code freeze date	~~20th October 2017~~ 27th October 2017
Planned release date	~~3rd November 2017~~ 17th November 2017
Release Manager:	Subru Krishnan, Arun Suresh
Tracking Page	Hadoop 2.9 Release
Branch	branch-2

Planned features:

	JIRA	Summary	Component	Feature Owner	Production Deployment Sponsor(*)	Status
1.	YARN-2928 / YARN-5355	ATS v2	YARN	Vrushali / Varun	Joep (Twitter)	Merged in branch-2
2.	YARN-2877 / YARN-5220	Opportunistic Containers	YARN	Konstantinos / Arun	Roni (Microsoft)	Merged in branch-2
3.	YARN-5085	Container Update	YARN	Arun / Wangda	Roni / Sarvesh (Microsoft)	Merged in branch-2
4.	YARN-2915	Yarn Federation	YARN	Subru / Carlo	Sarvesh (Microsoft)	Merged in branch-2
5.	YARN-5139	Global Scheduling (Capacity Scheduler)	YARN	Wangda		Merged in branch-2
6.	YARN-3368	YARN Web UI v2	YARN	Sunil / Wangda	Joep (Twitter)	Merged in branch-2
7.	YARN-5734	API based (Capacity) Scheduler configuration	YARN	Jonathan / Xuan	Jonathan (LinkedIn)	Merged in branch-2
8.	YARN-4726	Allocation reuse for container upgrades	YARN	Arun / Jian	Sarvesh (Microsoft)	Merged in branch-2
9.	HDFS-10467	HDFS Router based federation	HDFS	Inigo / Chris	Inigo (Microsoft)	Merged in branch-2

(*) Production Deployment Sponsor: "We will favor inclusion of a feature in the 2.9.0 release if it is associated with an immediate production deployment requirement. Other cases: We would recommend moving it to the next major release."

Version 3.0

Feature freeze date	Sep 15, 2017
Code freeze date
Planned release date	2017-11-01
Release Manager:	Andrew Wang
Tracking page	Hadoop 3.0.0 release
Branch	branch-3.0

Planned features:

		Summary	Component	Feature Owner	Status
1.	HADOOP-11656	Classpath isolation	HADOOP		Merged
2.	HADOOP-13345	S3Guard	HADOOP		Merged
3.	HADOOP-9902	Shell script rewrite	HADOOP		Merged
4.	HADOOP-13578	Add Codec for ZStandard Compression	HADOOP		Merged
5.	HADOOP-10950,MAPREDUCE-5785	Reworked daemon and task heap management	HADOOP, MAPREDUCE		Merged
6.	MAPREDUCE-2841	MapReduce task-level native optimization	MAPREDUCE		Merged
7.	HADOOP-11804	Shaded client jars	HADOOP		Merged
8.	YARN-2915	Yarn Federation	YARN		Merged
9.	YARN-5520	Support for Opportunistic Containers and Distributed Scheduling.	YARN		Merged
10.	YARN-5355	TimelineService v2 alpha 2	YARN		Merged
12.	YARN-5734	API based scheduler configuration	YARN		Merged
12.	YARN-5079,YARN-4793,YARN-4757,YARN-6419	Yarn native services	YARN		PENDING
13.	HADOOP-12756	Support for Microsoft Azure Data Lake and Aliyun Object Storage System filesystem connectors	HADOOP		Merged
14.	HDFS-7285	Support for Erasure Codes in HDFS	HDFS		Merged
15.	HDFS-5570	Removal of hftp in favor of webhdfs	HDFS		Merged
16.	HDFS-6440	Support for more than two standby Namenodes	HDFS		Merged
17.	HDFS-1312	Intra-datanode balancer	HDFS		Merged
18.	HDFS-9427	Move default ports out of ephemeral range	HDFS		Merged
19.	HDFS-10467	HDFS Router based federation	HDFS	Inigo / Chris	Merged

Space shortcuts

Page tree

Versions Compared

Old Version 22

New Version Current

Key

Upcoming releases

Planned features:

Old releases (Released)

3.2.2

3.1.4

3.3.0

YARN features

HDFS Features:

Common Features:

2.10.

0

YARN features

HDFS Features:

3.1.3

3.2.1

3.2.0

Planned features:

YARN features

HDFS Features:

Common Features:

Version 3.1

YARN features

HDFS Features:

Common Features:

Version 2.9

Planned features:

Version 3.0

Planned features:

8851	[Umbrella] A pluggable device plugin framework to ease vendor plugin development	YARN	Zhankun Tang		Merged
8.	YARN-