You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 31 Next »

 

Information about the upcoming mainline releases based on the information from the hadoop mailing lists.

  • Feature freeze date:  all features should be merged
  • Code freeze date - blockers/critical only, no more improvements and non blocker/critical bug-fixes

Version 2.9

Feature freeze date6th October 2017 20th October 2017
Code freeze date20th October 2017 27th October 2017
Planned release date3rd November 2017 10th November 2017
Release Manager:Subru Krishnan, Arun Suresh
Tracking PageHadoop 2.9 Release
Branchbranch-2

Planned features:

 

 JIRASummaryComponentFeature OwnerProduction Deployment Sponsor(*)Status
1.YARN-2928 / YARN-5355ATS v2YARNVrushali / VarunJoep (Twitter)Merged in branch-2
2.YARN-2877 / YARN-5220Opportunistic ContainersYARNKonstantinos / ArunRoni (Microsoft)Merged in branch-2
3.YARN-5085 Container UpdateYARNArun / WangdaRoni / Sarvesh (Microsoft)Merged in branch-2
4.YARN-2915Yarn FederationYARNSubru / CarloSarvesh (Microsoft)Merged in branch-2
5.YARN-5139Global Scheduling (Capacity Scheduler)YARNWangda Merged in branch-2
6.YARN-3368YARN Web UI v2YARNSunil / WangdaJoep (Twitter)Merged in branch-2
7.YARN-5734API based (Capacity) Scheduler configurationYARNJonathan / XuanJonathan (LinkedIn)Merged in branch-2
8.YARN-4726Allocation reuse for container upgradesYARNArun / JianSarvesh (Microsoft)Merged in branch-2
9.HDFS-10467HDFS Router based federationHDFSInigo / ChrisInigo (Microsoft)Merged in trunk, awaiting branch-2 merge

(*) Production Deployment Sponsor: "We will favor inclusion of a feature in the 2.9.0 release if it is associated with an immediate production deployment requirement. Other cases: We would recommend moving it to the next major release."

Version 3.0

Feature freeze dateSep 15, 2017
Code freeze date 
Planned release date2017-11-01
Release Manager:Andrew Wang
Tracking pageHadoop 3.0.0 release
Branchbranch-3.0

Planned features:

  JIRASummaryComponentFeature OwnerStatus
1.

HADOOP-11656

 

Classpath isolationHADOOP Merged
2.HADOOP-13345 S3GuardHADOOP Merged
3.HADOOP-9902 Shell script rewriteHADOOP Merged
4.HADOOP-13578 Add Codec for ZStandard CompressionHADOOP Merged
5.HADOOP-10950,MAPREDUCE-5785 Reworked daemon and task heap managementHADOOP, MAPREDUCE Merged
6.MAPREDUCE-2841 MapReduce task-level native optimizationMAPREDUCE Merged
7.HADOOP-11804 Shaded client jarsHADOOP Merged
8.YARN-2915 Yarn FederationYARN Merged
9.YARN-5520 Support for Opportunistic Containers and Distributed Scheduling.YARN Merged
10.YARN-5355 TimelineService v2 alpha 2YARN Merged
12.YARN-5734 API based scheduler configurationYARN Merged
12.

YARN-5079,YARN-4793,YARN-4757,YARN-6419

 Yarn native servicesYARN PENDING
13.HADOOP-12756 Support for Microsoft Azure Data Lake and Aliyun Object Storage System filesystem connectorsHADOOP Merged
14.HDFS-7285 Support for Erasure Codes in HDFSHDFS Merged
15.HDFS-5570  Removal of hftp in favor of webhdfsHDFS Merged
16.HDFS-6440 Support for more than two standby NamenodesHDFS Merged
17.HDFS-1312 Intra-datanode balancerHDFS Merged
18.HDFS-9427 Move default ports out of ephemeral rangeHDFS Merged
19.HDFS-10467 HDFS Router based federationHDFSInigo / ChrisMerged
       

Version 3.1

Feature freeze dateDec 15, 2017
Code freeze date Jan 1, 2018
Planned release daeJan 15, 2018
Release Manager:Wangda Tan
Branchtrunk

Planned features:

YARN features

 JIRASummaryComponentFeature OwnerComments
1.

YARN-5079,

YARN-4793,

YARN-4757,

YARN-6419

YARN native servicesYARNJian HeMaybe 3.0
2.YARN-5734Dynamic scheduler queue configurationYARNJonathan / XuanAlso 2.9
3.YARN-5881

Add absolute resource configuration

to CapacityScheduler

YARNSunil G 
4.YARN-5673

Container-executor rewrite for better security,

extensibility and portability

YARNVarun V 
5.YARN-6223GPU IsolationYARNWangda 
6.YARN-5972Support Pausing/Freezing of opportunistic containersYARNArun Suresh 
7.YARN-3926Resource Profile and multiple resource typesYARNVarun V / SunilMaybe 3.0
8.YARN-1011Resource overcommittmentYARNHaibo / Karthik KUnder discussion

HDFS Features: 

 JIRASummaryComponentFeature OwnerComments
1.

HDFS-10285

HDFS Storage Policy SatisfierHDFSUma 
2.<TODO>HDFS tiered storageHDFSChris Douglas 
3.HDFS-7240Ozone: Object store for HDFSHDFSAnu 

Common Features: 

 JIRASummaryComponentCommentsComments
1.

HADOOP-13786

Add S3Guard committer for zero-rename commits to

S3 endpoints

HDFSSteve Loughran 
  • No labels