Page History

Table of Contents

Information about the upcoming mainline releases based on the information from the hadoop mailing lists.

Feature freeze date: all features should be merged
Code freeze date - blockers/critical only, no more improvements and non blocker/critical bug-fixes

Please also see, EOL (End-of-life) release branches.

Upcoming releases

3.4.0
3.3.2
3.2.3

Feature freeze date	NA
Code freeze date	NA
Planned release date
Actual release date
Release Manager:
Branch	branch-3.2
Release Status	Hadoop 3.2 Release

2.10.2

For more details, please check Hadoop Active Release Lines

Old releases (Released)

Information about old releases only for the records here. For the final features included in a given release please check the official release notes.

3.2.2

Feature freeze date	Sep 30, 2020
Code freeze date	Oct 15, 2020
Planned release date	Dec 20, 2020
Actual release date	Jan 15, 2021
Release Manager:	He Xiaoqiao
Branch	branch-3.2

3.1.4

Feature freeze date	Wednesday, 11 March 2020
Code freeze date	Wednesday, 22 April 2020
Planned release date	Wednesday, 29 April 2020
Actual release date
Release Manager:	Gabor Bota
Branch	branch-3.1

Planned features: Hadoop 3.1 Release

3.3.0

Feature freeze date	Feb 28, 2020
Code freeze date	March 10, 2020
Planned release date	March 15, 2020
Actual release date	July 14,2020
Release Manager:	Brahma Reddy Battula
Branch	trunk

Planned features:

YARN features

	JIRA	Summary	Component	Feature Owner	Status
1.	YARN-9414	Application Catalog for YARN applications	YARN	Eric Yang	Merged
2.	YARN-5542	Scheduling of opportunistic containers	YARN	Konstantinos Karanasos/Abhishek Modi	Merged
3.	YARN-9473	Support Vector Engine ( a new accelerator hardware) based on pluggable device framework	YARN	Peter Bacsko	Merged
4.	YARN-9264	[Umbrella] Follow-up on IntelOpenCL FPGA plugin	YARN	Peter Bacsko	Merged
5.	YARN-9145	[Umbrella] Dynamically add or remove auxiliary services	YARN	Billie Rinaldi	Merged
6.	YARN-9050	[Umbrella] Usability improvements for scheduler activities	YARN	Tao Yang	Merged
7.	YARN-8851	[Umbrella] A pluggable device plugin framework to ease vendor plugin development	YARN	Zhankun Tang	Merged
8.	YARN-9014	runC container runtime	YARN	Eric Badger	Merged Partially

HDFS Features:

	JIRA	Summary	Component	Feature Owner	Status
1.	HDFS-13891	HDFS RBF stabilization phase	HDFS	Brahma Reddy Battula	Merged
2.	HDFS-12345	Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)	HDFS	Erik Krogen	Merged
3.	HDFS-13762	Support non-volatile storage class memory(SCM) in HDFS cache directives	HDFS	Feilong He	Merged

Common Features:

	JIRA	Summary	Component	Feature Owner	Status
1.	HADOOP-16095	Support impersonation for AuthenticationFilter	Common	Eric Yang	Merged
2.	HADOOP-15620	Über-jira: S3A phase VI: Hadoop 3.3 features	Common	Steve Loughran	Merged Partially
3.	HADOOP-15763	Über-JIRA: abfs phase II: Hadoop 3.3 features & fixes	Common	Steve Loughran	Merged Partially
4.	HADOOP-15338	Java 11 runtime support	Common	Akira Ajisaka	Merged
5.	HADOOP-15619	Über-JIRA: S3Guard Phase IV: Hadoop 3.3 features	Common	Steve Loughran	Merged Partially
6.	HADOOP-13363	Upgrade protobuf from 2.5.0 to something newer	Common	Vinay	Merged

2.10.0

Feature freeze date
Code freeze date
Planned release date	2019
Actual release date	Oct 31, 2019
Release Manager:	Jonathan Hung
Branch	branch-2

Planned features:

YARN features

	JIRA	Summary	Component	Feature Owner	Comments	Status
1.	YARN-8200	Backport resource types/GPU features to branch-2	YARN	Jonathan		Merged to branch-2.10

HDFS Features:

	JIRA	Summary	Component	Feature Owner	Status
1.	HDFS-12943	Consistent Reads from Standby Node	HDFS	Konstantin	Merged
2.	HDFS-13541	NameNode Port based selective encryption	HDFS	Chen	Merged
3.	HDFS-14403	Cost-Based RPC Fair Call Queue	HDFS	Erik	Merged

3.1.3

Feature freeze date	Aug 25, 2019
Code freeze date	Aug 30, 2019
Planned release date	Sep 07, 2019
Actual release date
Release Manager:	Zhankun Tang
Branch	branch-3.1

Planned features:

3.2.1

Feature freeze date	Aug 30, 2019
Code freeze date	Aug 30, 2019
Planned release date	Sept 7, 2019
Actual release date	Sept 22, 2019
Release Manager:	Rohith Sharma K S
Branch	branch-3.2

3.2.0

Feature freeze date	Sep 7, 2018
Code freeze date	Sep 14, 2018
Planned release date	Sept 30, 2018
Actual release date	Jan 8, 2019
Release Manager:	Sunil Govindan
Branch	trunk

Planned features:

YARN features

	JIRA	Summary	Component	Feature Owner	Status
1.	YARN-3409	Node Attributes Support in YARN	YARN	Naganarasimha/ Sunil	Merged
2.	~~YARN-1011~~	~~Resource Overcommitment~~	~~YARN~~	~~Haibo / Miklos~~	~~Moved Out~~
3.	YARN-8135	Hadoop Submarine project for DeepLearning workloads	YARN	Wangda	Merged
4.	~~YARN-7129~~	~~Application Catalog for YARN applications~~	~~YARN~~	~~Eric Yang~~	~~Moved Out~~
5.	YARN-7512	Support service upgrade via YARN Service API and CLI	YARN	Chandni	Merged
6.	YARN-5742	Serve aggregated logs of historical apps from ATSv2	YARN	Rohith Sharma	Merged

HDFS Features:

	JIRA	Summary	Component	Feature Owner	Comments	Status
1.	HDFS-10285	HDFS Storage Policy Satisfier	HDFS	Uma		Merged
2.	HDFS-12615	Router-based HDFS federation	HDFS	Inigo	Improvement Works	Merged

Common Features:

JIRA

Summary

Component

Comments

1.

HADOOP-15226

S3Guard Phase III

Common

Steve Loughran

Merged

2.

HADOOP-15220

S3a phase V

Common

Steve Loughran

Merged

3.

HADOOP-15407

Support Windows Azure Storage - Blob file system in Hadoop

Common

Da Zhou/Steve Loughran

Merged

Version 3.1

Feature freeze date	Jan 30, 2018
Code freeze date	Feb 08, 2018
Planned release date	Feb 28, 2018
Release Manager:	Wangda Tan
Branch	trunk

YARN features

	JIRA	Summary	Component	Feature Owner	Comments	Status
1.	YARN-5079, YARN-4793, YARN-4757, YARN-6419	YARN native services	YARN	Jian He		Merged
2.	YARN-5734	Dynamic scheduler queue configuration	YARN	Jonathan / Xuan	Also 2.9	Merged
3.	YARN-5881	Add absolute resource configuration to CapacityScheduler	YARN	Sunil G		Merged
4.	~~YARN-5673~~	~~Container-executor rewrite for better security,~~ ~~extensibility and portability~~	~~YARN~~	~~Varun V~~		~~Move out~~
5.	YARN-6223	GPU Isolation	YARN	Wangda		Merged
6.	~~YARN-5972~~	~~Support Pausing/Freezing of opportunistic containers~~	~~YARN~~	~~Arun Suresh~~		~~Move out~~
7.	YARN-3926	Resource Profile and multiple resource types	YARN	Varun V / Sunil	Maybe 3.0	Merged
8.	~~YARN-1011~~	~~Resource~~ overcommittment	~~YARN~~	~~Haibo / Karthik K~~	~~Under discussion~~	~~Move out~~
9.	YARN-6592	Support rich placement constraints in YARN	YARN	Arun Suresh / Kostas / Wangda	Tentative	Merged
10.	YARN-7117	Capacity Scheduler: Support Auto Creation of Leaf Queues While Doing Queue Mapping	YARN	Suma		Merged
11.	YARN-5983	FPGA support				Merged

HDFS Features:

	JIRA	Summary	Component	Feature Owner	Comments
1.	~~HDFS-10285~~	~~HDFS Storage Policy Satisfier~~	~~HDFS~~	~~Uma~~	~~Move out~~
2.	HDFS-9806	HDFS tiered storage	HDFS	Chris Douglas	Merged
3.	~~HDFS-7240~~	~~Ozone: Object store for HDFS~~	~~HDFS~~	~~Anu~~	~~Move out~~

Common Features:

JIRA

Summary

Component

Comments

1.

HADOOP-13786

Add S3Guard committer for zero-rename commits to

S3 endpoints

HDFS

Steve Loughran

Merged

Version 2.9

Feature freeze date	~~6th October 2017~~ 20th October 2017
Code freeze date	~~20th October 2017~~ 27th October 2017
Planned release date	~~3rd November~~

2017 10th

~~2017~~ 17th November 2017
Release Manager:	Subru Krishnan, Arun Suresh
Tracking Page	Hadoop 2.9 Release
Branch	branch-2

Planned features:

JIRA	Summary	Component	Feature Owner	Production Deployment Sponsor(*)	Status
1.	YARN-2928 / YARN-5355	ATS v2	YARN	Vrushali / Varun	Joep (Twitter)	Merged in

trunk, awaiting

branch-2

merge


2.	YARN-2877 / YARN-5220	Opportunistic Containers	YARN	Konstantinos / Arun	Roni (Microsoft)	Merged in branch-2
3.	YARN-5085	Container Update	YARN	Arun / Wangda	Roni / Sarvesh (Microsoft)	Merged in branch-2
4.	YARN-2915	Yarn Federation	YARN	Subru / Carlo	Sarvesh (Microsoft)	Merged in branch-2
5.	YARN-5139	Global Scheduling (Capacity Scheduler)	YARN	Wangda

	Merged in branch-2
6.	YARN-3368	YARN Web UI v2	YARN	Sunil / Wangda	Joep (Twitter)	Merged in

trunk, awaiting

branch-2

merge


7.	YARN-5734	API based (Capacity) Scheduler configuration	YARN	Jonathan / Xuan	Jonathan (LinkedIn)	Merged in branch-2
8.	YARN-4726	Allocation reuse for container upgrades	YARN	Arun / Jian	Sarvesh (Microsoft)	Merged in branch-2
9.	HDFS-10467	HDFS Router based federation	HDFS	Inigo / Chris	Inigo (Microsoft)

Merge Vote active

Merged in branch-2

(*) Production Deployment Sponsor: "We will favor inclusion of a feature in the 2.9.0 release if it is associated with an immediate production deployment requirement. Other cases: We would recommend moving it to the next major release."

Version 3.0

Feature freeze date	Sep 15, 2017
Code freeze date


Planned release date	2017-11-01
Release Manager:	Andrew Wang
Tracking page	Hadoop 3.0.0 release
Branch	branch-3.0

Planned features:

...

JIRA Summary Component Feature Owner Status
1.
HADOOP-11656

Classpath isolation HADOOP

Merged
2. HADOOP-13345

S3Guard HADOOP

Merged
3. HADOOP-9902

Shell script rewrite HADOOP

Merged
4. HADOOP-13578

Add Codec for ZStandard Compression HADOOP

Merged
5. HADOOP-10950,MAPREDUCE-5785

Reworked daemon and task heap management HADOOP, MAPREDUCE

Merged
6. MAPREDUCE-2841

MapReduce task-level native optimization MAPREDUCE

Merged
7. HADOOP-11804

Shaded client jars HADOOP

Merged
8. YARN-2915

Yarn Federation YARN

Merged
9. YARN-5520

Support for Opportunistic Containers and Distributed Scheduling. YARN

Merged
10. YARN-5355

TimelineService v2 alpha 2 YARN

Merged
12. YARN-5734

API based scheduler configuration YARN

Merged
12.
YARN-5079,YARN-4793,YARN-4757,YARN-6419

Yarn native services YARN

PENDING
13. HADOOP-12756

Support for Microsoft Azure Data Lake and Aliyun Object Storage System filesystem connectors HADOOP

Merged
14. HDFS-7285

Support for Erasure Codes in HDFS HDFS

Merged
15. HDFS-5570

Removal of hftp in favor of webhdfs HDFS

Merged
16. HDFS-6440

Support for more than two standby Namenodes HDFS

Merged
17. HDFS-1312

Intra-datanode balancer HDFS

Merged
18. HDFS-9427

Move default ports out of ephemeral range HDFS

Merged
19. HDFS-10467

HDFS Router based federation HDFS Inigo / Chris Merged

Version 3.1

Feature freeze date	Dec 15, 2017
Code freeze date	Jan 1, 2018
Planned release dae	Jan 15, 2018
Release Manager:	Wangda Tan
Branch	trunk

Planned features:

YARN features

	JIRA	Summary	Component	Feature Owner	Comments
1.	YARN-5079, YARN-4793, YARN-4757, YARN-6419	YARN native services	YARN	Jian He	Maybe 3.0
2.	YARN-5734	Dynamic scheduler queue configuration	YARN	Jonathan / Xuan	Also 2.9
3.	YARN-5881	Add absolute resource configuration to CapacityScheduler	YARN	Sunil G
4.	YARN-5673	Container-executor rewrite for better security, extensibility and portability	YARN	Varun V
5.	YARN-6223	GPU Isolation	YARN	Wangda
6.	YARN-5972	Support Pausing/Freezing of opportunistic containers	YARN	Arun Suresh
7.	YARN-3926	Resource Profile and multiple resource types	YARN	Varun V / Sunil	Maybe 3.0
8.	YARN-1011	Resource overcommittment	YARN	Haibo / Karthik K	Under discussion

HDFS Features:

	JIRA	Summary	Component	Feature Owner
1.	HDFS-10285	HDFS Storage Policy Satisfier	HDFS	Uma
2.	<TODO>	HDFS tiered storage	HDFS	Chris Douglas
3.	HDFS-7240	Ozone: Object store for HDFS	HDFS	Anu

Common Features:

JIRASummaryComponentCommentsComments1.

HADOOP-13786

Add S3Guard committer for zero-rename commits to

S3 endpoints

HDFSSteve Loughran

Space shortcuts

Page tree

Versions Compared

Old Version 29

New Version Current

Key

Upcoming releases

Old releases (Released)

3.2.2

3.1.4

3.3.0

YARN features

HDFS Features:

Common Features:

2.10.0

YARN features

HDFS Features:

3.1.3

3.2.1

3.2.0

Planned features:

YARN features

HDFS Features:

Common Features:

Version 3.1

YARN features

HDFS Features:

Common Features:

Version 2.9

Planned features:

Version 3.0

Planned features:

Version 3.1

Planned features: