You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 16 Next »

 

Information about the upcoming mainline releases based on the information from the hadoop mailing lists.

  • Feature freeze date:  all features should be merged
  • Code freeze date - blockers/critical only, no more improvements and non blocker/critical bug-fixes

Version 2.9

Feature freeze date6th October 2017
Code freeze date20th October 2017
Planned release date3rd November 2017
Release Manager:Subru Krishnan, Arun Suresh
Branchbranch-2

Planned features:

 

 JIRASummaryComponentFeature OwnerProduction Deployment Sponsor(*)
1.YARN-2928 / YARN-5355ATS v2YARNVrushali / Varun 
2.YARN-2877 / YARN-5220Opportunistic ContainersYARNKonstantinos / Arun 
3.YARN-5085 Container UpdateYARNArun / WangdaSarvesh
4.YARN-2915Yarn FederationYARNSubru / CarloSarvesh
5.YARN-5139Global Scheduling (Capacity Scheduler)YARNWangda 
6.YARN-3368YARN Web UI v2YARNSunil / Wangda 
7.YARN-5734API based (Capacity) Scheduler configurationYARNJonathan / Xuan 
8.YARN-4726Allocation reuse for container upgradesYARNArun / JianSarvesh
9.HDFS-10467HDFS Router based federationHDFSInigo / ChrisInigo

(*) Production Deployment Sponsor: "We will favor inclusion of a feature in the 2.9.0 release if it is associated with an immediate production deployment requirement. Other cases: We would recommend moving it to the next major release."

Version 3.0

Feature freeze dateSep 15, 2017
Code freeze date 
Planned release date2017-11-01
Release Manager:Andrew Wang
Tracking pageHadoop 3.0.0 release
Branchbranch-3.0

Planned features:

  JIRASummaryComponentFeature Owner
1.

HADOOP-11656

 

Classpath isolationHADOOP 
2.HADOOP-13345 S3GuardHADOOP 
3.HADOOP-9902 Shell script rewriteHADOOP 
   Reworked daemon and task heap managementHADOOP, MAPREDUCE 
   MapReduce task-level native optimizationMAPREDUCE 
 HADOOP-11804 Shaded client jarsHADOOP 
4.YARN-2915 Yarn FederationYARN 
   Support for Opportunistic Containers and Distributed Scheduling.YARN 
5.  TimelineService v2 alpha 2YARN 
   Support for Microsoft Azure Data Lake and Aliyun Object Storage System filesystem connectorsHADOOP 
6.HDFS-7285 Support for Erasure Codes in HDFSHDFS 
7.HDFS-5570  Removal of hftp in favor of webhdfsHDFS 
8.HDFS-6440 Support for more than two standby NamenodesHDFS 
9.HDFS-1312 Intra-datanode balancerHDFS 
10.HDFS-9427 Move default ports out of ephemeral rangeHDFS 

Version 3.1

Feature freeze dateDec 15, 2017
Code freeze date Jan 1, 2018
Planned release daeJan 15, 2018
Release Manager:Wangda Tan
Branchtrunk

Planned features:

YARN features

 JIRASummaryComponentFeature OwnerComments
1.

YARN-5079,

YARN-4793,

YARN-4757,

YARN-6419

YARN native servicesYARNJian HeMaybe 3.0
2.YARN-5734Dynamic scheduler queue configurationYARNJonathan / Xuan 
3.YARN-5881

Add absolute resource configuration

to CapacityScheduler

YARNSunil G 
4.YARN-5673

Container-executor rewrite for better security,

extensibility and portability

YARNVarun V 
5.YARN-6223GPU IsolationYARNWangda 
6.YARN-5972Support Pausing/Freezing of opportunistic containersYARNArun Suresh 
7.YARN-3926Resource Profile and multiple resource typesYARNVarun V / SunilMaybe 3.0
8.YARN-1011Resource overcommittmentYARNHaibo / Karthik KUnder discussion

HDFS Features: 

 JIRASummaryComponentFeature OwnerComments
1.

HDFS-10285

HDFS Storage Policy SatisfierHDFSUma 
2.<TODO>HDFS tiered storageHDFSChris Douglas 
3.HDFS-7240OZone: Object store in HDFSHDFSAnu 

Common Features: 

 JIRASummaryComponentCommentsComments
1.

HADOOP-13786

Add S3Guard committer for zero-rename commits to

S3 endpoints

HDFSSteve Loughran 

 

 

 

 

 

 

Reworked daemon and task heap management

  • No labels