Page History

Table of Contents

Information about the upcoming mainline releases based on the information from the hadoop mailing lists.

Feature freeze date: all features should be merged
Code freeze date - blockers/critical only, no more improvements and non blocker/critical bug-fixes

Version 3.0

Please also see, EOL (End-of-life) release branches.

Upcoming releases

3.4.0
3.3.2
3.2.3

Feature freeze date	NA
Code freeze date	NA
Planned release date
Actual release date
Release Manager:
Branch	branch-3.2
Release Status	Hadoop 3.2 Release

2.10.2

For more details, please check Hadoop Active Release Lines

Old releases (Released)

Information about old releases only for the records here. For the final features included in a given release please check the official release notes.

3.2.2

Feature freeze date

Sep 30, 2020

Feature freeze dateSep 15, 2017

Code freeze date

Oct 15, 2020

Planned release date

2017-11-01

Dec 20, 2020
Actual release date	Jan 15, 2021
Release Manager:	He Xiaoqiao

Andrew WangTracking pageHadoop 3.0.0 releaseBranchbranch-3.0

Planned features:

Erasure coding
HADOOP-11656 Classpath isolation
TimelineService v2 alpha 2
HDFS router-based federation
YARN-2915: YARN federation
HADOOP-13345: S3Guard
HADOOP-9902 Shell script rewrite
HDFS-5570 Removal of hftp in favor of webhdfs
HDFS-6440 Support for more than two standby NameNodes
HDFS-7285 Support for Erasure Codes in HDFS
HDFS-1312 Intra-datanode balancer
HDFS-9427 Move default ports out of ephemeral range

Version 3.1

Branch

branch-3.2

3.1.4

Feature freeze date	Wednesday, 11 March 2020
Code freeze date	Wednesday, 22 April 2020
Planned release date	Wednesday, 29 April 2020
Actual release date
Release Manager:	Gabor Bota
Branch	branch-3.1

Planned features: Hadoop 3.1 Release

3.3.0

Feature freeze date	Feb 28, 2020
Code freeze date	March 10, 2020
Planned release date	March 15, 2020
Actual release date	July 14,2020
Release Manager:	Brahma Reddy Battula
Branch	trunk

Planned features:

YARN features

	JIRA	Summary	Component	Feature Owner	Status
1.	YARN-9414	Application Catalog for YARN applications	YARN	Eric Yang	Merged
2.	YARN-5542	Scheduling of opportunistic containers	YARN	Konstantinos Karanasos/Abhishek Modi	Merged
3.	YARN-9473	Support Vector Engine ( a new accelerator hardware) based on pluggable device framework	YARN	Peter Bacsko	Merged
4.	YARN-9264	[Umbrella] Follow-up on IntelOpenCL FPGA plugin	YARN	Peter Bacsko	Merged
5.	YARN-9145	[Umbrella] Dynamically add or remove auxiliary services	YARN	Billie Rinaldi	Merged
6.	YARN-9050	[Umbrella] Usability improvements for scheduler activities	YARN	Tao Yang	Merged
7.	YARN-8851	[Umbrella] A pluggable device plugin framework to ease vendor plugin development	YARN	Zhankun Tang	Merged
8.	YARN-9014	runC container runtime	YARN	Eric Badger	Merged Partially

HDFS Features:

	JIRA	Summary	Component	Feature Owner	Status
1.	HDFS-13891	HDFS RBF stabilization phase	HDFS	Brahma Reddy Battula	Merged
2.	HDFS-12345	Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)	HDFS	Erik Krogen	Merged
3.	HDFS-13762	Support non-volatile storage class memory(SCM) in HDFS cache directives	HDFS	Feilong He	Merged

Common Features:

	JIRA	Summary	Component	Feature Owner	Status
1.	HADOOP-16095	Support impersonation for AuthenticationFilter	Common	Eric Yang	Merged
2.	HADOOP-15620	Über-jira: S3A phase VI: Hadoop 3.3 features	Common	Steve Loughran	Merged Partially
3.	HADOOP-15763	Über-JIRA: abfs phase II: Hadoop 3.3 features & fixes	Common	Steve Loughran	Merged Partially
4.	HADOOP-15338	Java 11 runtime support	Common	Akira Ajisaka	Merged
5.	HADOOP-15619	Über-JIRA: S3Guard Phase IV: Hadoop 3.3 features	Common	Steve Loughran	Merged Partially
6.	HADOOP-13363	Upgrade protobuf from 2.5.0 to something newer	Common	Vinay	Merged

2.10.0

Feature freeze date
Code freeze date
Planned release date	2019
Actual release date	Oct 31, 2019
Release Manager:	Jonathan Hung
Branch	branch-2

Planned features:

YARN features

	JIRA	Summary	Component	Feature Owner	Comments	Status
1.	YARN-8200	Backport resource types/GPU features to branch-2	YARN	Jonathan		Merged to branch-2.10

HDFS Features:

	JIRA	Summary	Component	Feature Owner	Status
1.	HDFS-12943	Consistent Reads from Standby Node	HDFS	Konstantin	Merged
2.	HDFS-13541	NameNode Port based selective encryption	HDFS	Chen	Merged
3.	HDFS-14403	Cost-Based RPC Fair Call Queue	HDFS	Erik	Merged

3.1.3

Feature freeze date	Aug 25, 2019
Code freeze date	Aug 30, 2019
Planned release date	Sep 07, 2019
Actual release date
Release Manager:	Zhankun Tang
Branch	branch-3.1

Planned features:

3.2.1

Feature freeze date	Aug 30, 2019
Code freeze date	Aug 30, 2019
Planned release date	Sept 7, 2019
Actual release date	Sept 22, 2019
Release Manager:	Rohith Sharma K S
Branch	branch-3.2

3.2.0

Feature freeze date	Sep 7, 2018
Code freeze date	Sep 14, 2018
Planned release date	Sept 30, 2018
Actual release date	Jan 8, 2019
Release Manager:	Sunil Govindan

Feature freeze dateDec 15, 2017Code freeze date Jan 1, 2018Planned release daeJan 15, 2018Release Manager:Wangda Tan


Branch	trunk

Planned features:

YARN features

	JIRA	Summary	Component	Feature Owner	Status
1.	YARN-3409	Node Attributes Support in YARN	YARN	Naganarasimha/ Sunil	Merged
2.	~~YARN-1011~~	~~Resource Overcommitment~~	~~YARN~~	~~Haibo / Miklos~~	~~Moved Out~~
3.	YARN-8135	Hadoop Submarine project for DeepLearning workloads	YARN	Wangda	Merged
4.	~~YARN-7129~~	~~Application Catalog for YARN applications~~	~~YARN~~	~~Eric Yang~~	~~Moved Out~~
5.	YARN-7512	Support service upgrade via YARN Service API and CLI	YARN	Chandni	Merged
6.	YARN-5742	Serve aggregated logs of historical apps from ATSv2	YARN	Rohith Sharma	Merged

HDFS Features:

	JIRA	Summary	Component	Feature Owner	Comments	Status
1.	HDFS-10285	HDFS Storage Policy Satisfier	HDFS	Uma		Merged
2.	HDFS-12615	Router-based HDFS federation	HDFS	Inigo	Improvement Works	Merged

Common Features:

JIRA

Summary

Component

Comments

1.

HADOOP-15226

S3Guard Phase III

Common

Steve Loughran

Merged

2.

HADOOP-15220

S3a phase V

Common

Steve Loughran

Merged

3.

HADOOP-15407

Support Windows Azure Storage - Blob file system in Hadoop

Common

Da Zhou/Steve Loughran

Merged

Version 3.1

Feature freeze date	Jan 30, 2018
Code freeze date	Feb 08, 2018
Planned release date	Feb 28, 2018
Release Manager:	Wangda Tan
Branch	trunk

YARN features

JIRA

Summary

Component

Feature Owner

Comments

Status

1.

YARN-5079,

YARN-4793,

YARN-4757,

YARN-6419

YARN native services

YARN

Jian He

Maybe 3.0

	Merged
2.	YARN-5734	Dynamic scheduler queue configuration	YARN	Jonathan / Xuan	Also 2.9

Merged
3.	YARN-5881	Add absolute resource configuration

to CapacityScheduler

YARN

Sunil G

Merged

4.

~~YARN-5673~~

~~Container-executor rewrite for better security,~~

~~extensibility and portability~~

~~YARN~~

~~Varun~~

Vasudev

V

	~~Move out~~
5.	YARN-6223	GPU Isolation	YARN	Wangda

	Merged
6.	~~YARN-5972~~	~~Support Pausing/Freezing of opportunistic containers~~	~~YARN~~	~~Arun Suresh~~

	~~Move out~~
7.	YARN-3926	Resource Profile and multiple resource types	YARN	Varun

Vasudev

V / Sunil	Maybe 3.0	Merged
8.	~~YARN-1011~~	~~Resource~~ overcommittment	~~YARN~~	~~Haibo / Karthik K~~	~~Under discussion~~	~~Move out~~
9.	YARN-6592	Support rich placement constraints in YARN	YARN	Arun Suresh / Kostas / Wangda	Tentative	Merged
10.	YARN-7117	Capacity Scheduler: Support Auto Creation of Leaf Queues While Doing Queue Mapping	YARN	Suma		Merged
11.	YARN-5983	FPGA support				Merged

HDFS Features:

...

	JIRA	Summary	Component	Feature Owner	Comments
1.	~~HDFS-10285~~	~~HDFS Storage Policy Satisfier~~	~~HDFS~~	~~Uma~~

~~Move out~~

2.

<TODO>

HDFS-9806

HDFS tiered storage

HDFS

Chris Douglas

Merged
3.	~~HDFS-7240~~

OZone

~~Ozone: Object store~~

in

~~for HDFS~~

~~HDFS~~

~~Anu~~

~~Move out~~

Common Features:

...

JIRA

Summary

Component

Comments

1.

HADOOP-13786

Add S3Guard committer for zero-rename commits to

S3 endpoints

HDFS

Steve Loughran

Merged

Version 2.9

Feature freeze date	~~6th October 2017~~ 20th October 2017
Code freeze date	~~20th October 2017~~ 27th October 2017
Planned release date	~~3rd November 2017~~ 17th November 2017
Release Manager:	Subru Krishnan, Arun Suresh
Tracking Page	Hadoop 2.9 Release
Branch	branch-2

Planned features:

JIRA	Summary	Component	Feature Owner	Production Deployment Sponsor(*)	Status
1.	YARN-2928 / YARN-5355	ATS v2	YARN	Vrushali / Varun

	Joep (Twitter)	Merged in branch-2
2.	YARN-2877 / YARN-5220	Opportunistic Containers	YARN	Konstantinos / Arun

	Roni (Microsoft)	Merged in branch-2
3.	YARN-5085	Container Update	YARN	Arun / Wangda	Roni / Sarvesh (Microsoft)	Merged in branch-2
4.	YARN-2915	Yarn Federation	YARN	Subru / Carlo	Sarvesh (Microsoft)	Merged in branch-2
5.	YARN-5139	Global Scheduling (Capacity Scheduler)	YARN	Wangda

	Merged in branch-2
6.	YARN-3368	YARN Web UI v2	YARN	Sunil / Wangda

	Joep (Twitter)	Merged in branch-2
7.	YARN-5734	API based (Capacity) Scheduler configuration	YARN	Jonathan / Xuan

Jonathan (LinkedIn)	Merged in branch-2
8.	YARN-4726	Allocation reuse for container upgrades	YARN	Arun / Jian	Sarvesh (Microsoft)	Merged in branch-2
9.	HDFS-10467	HDFS Router based federation	HDFS	Inigo / Chris	Inigo (Microsoft)	Merged in branch-2

(*) Production Deployment Sponsor: "We will favor inclusion of a feature in the 2.9.0 release if it is associated with an immediate production deployment requirement. Other cases: We would recommend moving it to the next major release."

Version 3.0

Feature freeze date	Sep 15, 2017
Code freeze date
Planned release date	2017-11-01
Release Manager:	Andrew Wang
Tracking page	Hadoop 3.0.0 release
Branch	branch-3.0

Planned features:

		Summary	Component	Status
1.	HADOOP-11656	Classpath isolation	HADOOP	Merged
2.	HADOOP-13345	S3Guard	HADOOP	Merged
3.	HADOOP-9902	Shell script rewrite	HADOOP	Merged
4.	HADOOP-13578	Add Codec for ZStandard Compression	HADOOP	Merged
5.	HADOOP-10950,MAPREDUCE-5785	Reworked daemon and task heap management	HADOOP, MAPREDUCE	Merged
6.	MAPREDUCE-2841	MapReduce task-level native optimization	MAPREDUCE	Merged
7.	HADOOP-11804	Shaded client jars	HADOOP	Merged
8.	YARN-2915	Yarn Federation	YARN	Merged
9.	YARN-5520	Support for Opportunistic Containers and Distributed Scheduling.	YARN	Merged
10.	YARN-5355	TimelineService v2 alpha 2	YARN	Merged
12.	YARN-5734	API based scheduler configuration	YARN	Merged
12.	YARN-5079,YARN-4793,YARN-4757,YARN-6419	Yarn native services	YARN	PENDING
13.	HADOOP-12756	Support for Microsoft Azure Data Lake and Aliyun Object Storage System filesystem connectors	HADOOP	Merged
14.	HDFS-7285	Support for Erasure Codes in HDFS	HDFS	Merged
15.	HDFS-5570

...

Removal of hftp in favor of webhdfs	HDFS	Merged
16.	HDFS-6440	Support for more than two standby Namenodes	HDFS		Merged
17.	HDFS-1312	Intra-datanode balancer	HDFS		Merged
18.	HDFS-9427	Move default ports out of ephemeral range	HDFS		Merged
19.	HDFS-10467	HDFS Router based federation	HDFS	Inigo / Chris	Merged

...

Space shortcuts

Page tree

Versions Compared

Old Version 12

New Version Current

Key

Version 3.0

Upcoming releases

Old releases (Released)

3.2.2

Planned features:

Version 3.1

3.1.4

3.3.0

YARN features

HDFS Features:

Common Features:

2.10.0

YARN features

HDFS Features:

3.1.3

3.2.1

3.2.0

Planned features:

YARN features

HDFS Features:

Common Features:

Version 3.1

YARN features

HDFS Features:

Common Features:

Version 2.9

Planned features:

Version 3.0

Planned features: