You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 24 Next »

 

Information about the upcoming mainline releases based on the information from the hadoop mailing lists.

  • Feature freeze date:  all features should be merged
  • Code freeze date - blockers/critical only, no more improvements and non blocker/critical bug-fixes

Version 2.9

Feature freeze date6th October 2017
Code freeze date20th October 2017
Planned release date3rd November 2017
Release Manager:Subru Krishnan, Arun Suresh
Tracking PageHadoop 2.9 Release
Branchbranch-2

Planned features:

 

 JIRASummaryComponentFeature OwnerProduction Deployment Sponsor(*)
1.YARN-2928 / YARN-5355ATS v2YARNVrushali / VarunJoep (Twitter)
2.YARN-2877 / YARN-5220Opportunistic ContainersYARNKonstantinos / ArunRoni (Microsoft)
3.YARN-5085 Container UpdateYARNArun / WangdaRoni / Sarvesh (Microsoft)
4.YARN-2915Yarn FederationYARNSubru / CarloSarvesh (Microsoft)
5.YARN-5139Global Scheduling (Capacity Scheduler)YARNWangda 
6.YARN-3368YARN Web UI v2YARNSunil / WangdaJoep (Twitter)
7.YARN-5734API based (Capacity) Scheduler configurationYARNJonathan / XuanJonathan (LinkedIn)
8.YARN-4726Allocation reuse for container upgradesYARNArun / JianSarvesh (Microsoft)
9.HDFS-10467HDFS Router based federationHDFSInigo / ChrisInigo (Microsoft)

(*) Production Deployment Sponsor: "We will favor inclusion of a feature in the 2.9.0 release if it is associated with an immediate production deployment requirement. Other cases: We would recommend moving it to the next major release."

Version 3.0

Feature freeze dateSep 15, 2017
Code freeze date 
Planned release date2017-11-01
Release Manager:Andrew Wang
Tracking pageHadoop 3.0.0 release
Branchbranch-3.0

Planned features:

  JIRASummaryComponentFeature Owner
1.

HADOOP-11656

 

Classpath isolationHADOOP 
2.HADOOP-13345 S3GuardHADOOP 
3.HADOOP-9902 Shell script rewriteHADOOP 
4.HADOOP-13578 Add Codec for ZStandard CompressionHADOOP 
5.  Reworked daemon and task heap managementHADOOP, MAPREDUCE 
6.  MapReduce task-level native optimizationMAPREDUCE 
7.HADOOP-11804 Shaded client jarsHADOOP 
8.YARN-2915 Yarn FederationYARN 
9.  Support for Opportunistic Containers and Distributed Scheduling.YARN 
10.  TimelineService v2 alpha 2YARN 
11.  Support for Microsoft Azure Data Lake and Aliyun Object Storage System filesystem connectorsHADOOP 
12.HDFS-7285 Support for Erasure Codes in HDFSHDFS 
13.HDFS-5570  Removal of hftp in favor of webhdfsHDFS 
14.HDFS-6440 Support for more than two standby NamenodesHDFS 
15.HDFS-1312 Intra-datanode balancerHDFS 
16.HDFS-9427 Move default ports out of ephemeral rangeHDFS 
17.HDFS-10467 HDFS Router based federationHDFSInigo / Chris

Version 3.1

Feature freeze dateDec 15, 2017
Code freeze date Jan 1, 2018
Planned release daeJan 15, 2018
Release Manager:Wangda Tan
Branchtrunk

Planned features:

YARN features

 JIRASummaryComponentFeature OwnerComments
1.

YARN-5079,

YARN-4793,

YARN-4757,

YARN-6419

YARN native servicesYARNJian HeMaybe 3.0
2.YARN-5734Dynamic scheduler queue configurationYARNJonathan / XuanAlso 2.9
3.YARN-5881

Add absolute resource configuration

to CapacityScheduler

YARNSunil G 
4.YARN-5673

Container-executor rewrite for better security,

extensibility and portability

YARNVarun V 
5.YARN-6223GPU IsolationYARNWangda 
6.YARN-5972Support Pausing/Freezing of opportunistic containersYARNArun Suresh 
7.YARN-3926Resource Profile and multiple resource typesYARNVarun V / SunilMaybe 3.0
8.YARN-1011Resource overcommittmentYARNHaibo / Karthik KUnder discussion

HDFS Features: 

 JIRASummaryComponentFeature OwnerComments
1.

HDFS-10285

HDFS Storage Policy SatisfierHDFSUma 
2.<TODO>HDFS tiered storageHDFSChris Douglas 
3.HDFS-7240Ozone: Object store for HDFSHDFSAnu 

Common Features: 

 JIRASummaryComponentCommentsComments
1.

HADOOP-13786

Add S3Guard committer for zero-rename commits to

S3 endpoints

HDFSSteve Loughran 

 

Add Codec for ZStandard Compression 

  • No labels