Versions Compared

Old Version 49

changes.mady.by.user Sunil G

Saved on

compared with

New Version 50

changes.mady.by.user Wangda Tan

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • Feature freeze date:  all features should be merged
  • Code freeze date - blockers/critical only, no more improvements and non blocker/critical bug-fixe

Next Releases

...

Upcoming releases

2.10.0

Feature freeze date
Code freeze date
Planned release date2019
Actual release date
Release Manager:Jonathan Hung
Branchbranch-2

Planned features: TODO

2.8.6

Feature freeze date
Code freeze date
Planned release date2019
Actual release date
Release Manager:Junping Du
Branchbranch-2.8

Planned features: TODO

3.1.3

Feature freeze date
Code freeze date
Planned release date2019
Actual release date
Release Manager:
Branchbranch-2

Planned features: TODO

3.2.1

Feature freeze date
Code freeze date
Planned release date2019
Actual release date
Release Manager:Rohith Sharma KS
Branchbranch-3.2

Planned features: TODO

3.3.0

Feature freeze date
Code freeze date
Planned release date2019
Actual release date
Release Manager:
Branchtrunk

Planned features: TODO

Old releases (Released)

Information about old releases only for the records here. For the final features included in a given release please check the official release notes.

3.2.0

Feature freeze dateSep 7, 2018
Code freeze dateSep 14, 2018
Planned release dateSept 30, 2018
Actual release dateJan 8, 2019
Release Manager:Sunil Govindan
Branchtrunk

Planned features:

YARN features
 

 JIRASummaryComponentFeature OwnerCommentsStatus
1.

YARN-3409

Node Attributes Support in YARNYARNNaganarasimha/ Sunil
Merged
2.YARN-1011Resource OvercommitmentYARNHaibo / Miklos
Moved Out
3.YARN-8135

Hadoop Submarine project for DeepLearning workloads 

YARNWangda 
Merged
4.YARN-7129Application Catalog for YARN applicationsYARNEric Yang
Moved Out
5.YARN-7512Support service upgrade via YARN Service API and CLIYARNChandni
Merged
6.YARN-5742Serve aggregated logs of historical apps from ATSv2YARNRohith Sharma
Merged
HDFS Features: 

 JIRASummaryComponentFeature OwnerCommentsStatus
1.

HDFS-10285

HDFS Storage Policy SatisfierHDFSUma
Merged
2.HDFS-12615Router-based HDFS federationHDFSInigoImprovement WorksMerged
Common Features:  

JIRASummaryComponentCommentsComments
1.

HADOOP-15226

S3Guard Phase III


CommonSteve LoughranMerged
2.HADOOP-15220S3a phase V CommonSteve LoughranMerged
3.HADOOP-15407Support Windows Azure Storage - Blob file system in HadoopCommonDa Zhou/Steve LoughranMerged

Old releases

...


Version 3.1

Feature freeze dateJan 30, 2018
Code freeze dateFeb 08, 2018
Planned release dateFeb 28, 2018
Release Manager:Wangda Tan
Branchtrunk
YARN features
  

 JIRASummaryComponentFeature OwnerCommentsStatus
1.

YARN-5079,

YARN-4793,

YARN-4757,

YARN-6419

YARN native servicesYARNJian He
Merged
2.YARN-5734Dynamic scheduler queue configurationYARNJonathan / XuanAlso 2.9Merged
3.YARN-5881

Add absolute resource configuration to CapacityScheduler

YARNSunil G 
Merged
4.YARN-5673

Container-executor rewrite for better security,

extensibility and portability

YARNVarun V
Move out
5.YARN-6223GPU IsolationYARNWangda 
Merged
6.YARN-5972Support Pausing/Freezing of opportunistic containersYARNArun Suresh 
Move out
7.YARN-3926Resource Profile and multiple resource typesYARNVarun V / SunilMaybe 3.0Merged
8.YARN-1011Resource overcommittmentYARNHaibo / Karthik KUnder discussionMove out
9.YARN-6592Support rich placement constraints in YARNYARNArun Suresh / Kostas / WangdaTentativeMerged
10.
YARN-7117
Capacity Scheduler: Support Auto Creation of Leaf Queues While Doing Queue MappingYARNSuma 
Merged
11.YARN-5983FPGA support   


Merged
HDFS Features:  

JIRASummaryComponentFeature OwnerComments
1.

HDFS-10285

HDFS Storage Policy SatisfierHDFSUmaMove out
2.HDFS-9806HDFS tiered storageHDFSChris DouglasMerged
3.HDFS-7240Ozone: Object store for HDFSHDFSAnuMove out
Common Features: 

 JIRASummaryComponentCommentsComments
1.

HADOOP-13786

Add S3Guard committer for zero-rename commits to

S3 endpoints

HDFSSteve LoughranMerged

...

Feature freeze date6th October 2017 20th October 2017
Code freeze date20th October 2017 27th October 2017
Planned release date3rd November 2017 17th November 2017
Release Manager:Subru Krishnan, Arun Suresh
Tracking PageHadoop 2.9 Release
Branchbranch-2
Planned features:

 

...



JIRASummaryComponentFeature OwnerProduction Deployment Sponsor(*)Status
1.YARN-2928 / YARN-5355ATS v2YARNVrushali / VarunJoep (Twitter)Merged in branch-2
2.YARN-2877 / YARN-5220Opportunistic ContainersYARNKonstantinos / ArunRoni (Microsoft)Merged in branch-2
3.YARN-5085 Container UpdateYARNArun / WangdaRoni / Sarvesh (Microsoft)Merged in branch-2
4.YARN-2915Yarn FederationYARNSubru / CarloSarvesh (Microsoft)Merged in branch-2
5.YARN-5139Global Scheduling (Capacity Scheduler)YARNWangda 
Merged in branch-2
6.YARN-3368YARN Web UI v2YARNSunil / WangdaJoep (Twitter)Merged in branch-2
7.YARN-5734API based (Capacity) Scheduler configurationYARNJonathan / XuanJonathan (LinkedIn)Merged in branch-2
8.YARN-4726Allocation reuse for container upgradesYARNArun / JianSarvesh (Microsoft)Merged in branch-2
9.HDFS-10467HDFS Router based federationHDFSInigo / ChrisInigo (Microsoft)Merged in branch-2

...

Feature freeze dateSep 15, 2017
Code freeze date 
Planned release date2017-11-01
Release Manager:Andrew Wang
Tracking pageHadoop 3.0.0 release
Branchbranch-3.0

Planned features:

     


  JIRASummaryComponentFeature OwnerStatus
1.

HADOOP-11656

 


Classpath isolationHADOOP 
Merged
2.HADOOP-13345 
S3GuardHADOOP
Merged
3.HADOOP-9902 
Shell script rewriteHADOOP 
Merged
4.HADOOP-13578 
Add Codec for ZStandard CompressionHADOOP 
Merged
5.HADOOP-10950,MAPREDUCE-5785 
Reworked daemon and task heap managementHADOOP, MAPREDUCE 
Merged
6.MAPREDUCE-2841 
MapReduce task-level native optimizationMAPREDUCE 
Merged
7.HADOOP-11804 
Shaded client jarsHADOOP 
Merged
8.YARN-2915 
Yarn FederationYARN 
Merged
9.YARN-5520 
Support for Opportunistic Containers and Distributed Scheduling.YARN 
Merged
10.YARN-5355 
TimelineService v2 alpha 2YARN
Merged
12.YARN-5734 
API based scheduler configurationYARN 
Merged
12.

YARN-5079,YARN-4793,YARN-4757,YARN-6419

 


Yarn native servicesYARN 
PENDING
13.HADOOP-12756 
Support for Microsoft Azure Data Lake and Aliyun Object Storage System filesystem connectorsHADOOP 
Merged
14.HDFS-7285 
Support for Erasure Codes in HDFSHDFS 
Merged
15.HDFS-5570
  Removal of hftp in favor of webhdfsHDFS
Merged
16.HDFS-6440 
Support for more than two standby NamenodesHDFS
Merged
17.HDFS-1312 
Intra-datanode balancerHDFS 
Merged
18.HDFS-9427 
Move default ports out of ephemeral rangeHDFS
Merged
19.HDFS-10467 
HDFS Router based federationHDFSInigo / ChrisMerged