THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
Information about the upcoming mainline releases based on the information from the hadoop mailing lists.
- Feature freeze date: all features should be merged
- Code freeze date - blockers/critical only, no more improvements and non blocker/critical bug-fixes
Version 2.9
| Feature freeze date | |
| Code freeze date | |
| Planned release date | |
| Release Manager: | Subru Krishnan, Arun Suresh |
| Tracking Page | Hadoop 2.9 Release |
| Branch | branch-2 |
Planned features:
| JIRA | Summary | Component | Feature Owner | Production Deployment Sponsor(*) | Status | |
|---|---|---|---|---|---|---|
| 1. | YARN-2928 / YARN-5355 | ATS v2 | YARN | Vrushali / Varun | Joep (Twitter) | Merged in branch-2 |
| 2. | YARN-2877 / YARN-5220 | Opportunistic Containers | YARN | Konstantinos / Arun | Roni (Microsoft) | Merged in branch-2 |
| 3. | YARN-5085 | Container Update | YARN | Arun / Wangda | Roni / Sarvesh (Microsoft) | Merged in branch-2 |
| 4. | YARN-2915 | Yarn Federation | YARN | Subru / Carlo | Sarvesh (Microsoft) | Merged in branch-2 |
| 5. | YARN-5139 | Global Scheduling (Capacity Scheduler) | YARN | Wangda | Merged in branch-2 | |
| 6. | YARN-3368 | YARN Web UI v2 | YARN | Sunil / Wangda | Joep (Twitter) | Merged in branch-2 |
| 7. | YARN-5734 | API based (Capacity) Scheduler configuration | YARN | Jonathan / Xuan | Jonathan (LinkedIn) | Merged in branch-2 |
| 8. | YARN-4726 | Allocation reuse for container upgrades | YARN | Arun / Jian | Sarvesh (Microsoft) | Merged in branch-2 |
| 9. | HDFS-10467 | HDFS Router based federation | HDFS | Inigo / Chris | Inigo (Microsoft) | Merged in trunk, awaiting branch-2 merge |
(*) Production Deployment Sponsor: "We will favor inclusion of a feature in the 2.9.0 release if it is associated with an immediate production deployment requirement. Other cases: We would recommend moving it to the next major release."
Version 3.0
| Feature freeze date | Sep 15, 2017 |
| Code freeze date | |
| Planned release date | 2017-11-01 |
| Release Manager: | Andrew Wang |
| Tracking page | Hadoop 3.0.0 release |
| Branch | branch-3.0 |
Planned features:
| JIRA | Summary | Component | Feature Owner | Status | ||
|---|---|---|---|---|---|---|
| 1. |
| Classpath isolation | HADOOP | Merged | ||
| 2. | HADOOP-13345 | S3Guard | HADOOP | Merged | ||
| 3. | HADOOP-9902 | Shell script rewrite | HADOOP | Merged | ||
| 4. | HADOOP-13578 | Add Codec for ZStandard Compression | HADOOP | Merged | ||
| 5. | HADOOP-10950,MAPREDUCE-5785 | Reworked daemon and task heap management | HADOOP, MAPREDUCE | Merged | ||
| 6. | MAPREDUCE-2841 | MapReduce task-level native optimization | MAPREDUCE | Merged | ||
| 7. | HADOOP-11804 | Shaded client jars | HADOOP | Merged | ||
| 8. | YARN-2915 | Yarn Federation | YARN | Merged | ||
| 9. | YARN-5520 | Support for Opportunistic Containers and Distributed Scheduling. | YARN | Merged | ||
| 10. | YARN-5355 | TimelineService v2 alpha 2 | YARN | Merged | ||
| 12. | YARN-5734 | API based scheduler configuration | YARN | Merged | ||
| 12. | Yarn native services | YARN | PENDING | |||
| 13. | HADOOP-12756 | Support for Microsoft Azure Data Lake and Aliyun Object Storage System filesystem connectors | HADOOP | Merged | ||
| 14. | HDFS-7285 | Support for Erasure Codes in HDFS | HDFS | Merged | ||
| 15. | HDFS-5570 | Removal of hftp in favor of webhdfs | HDFS | Merged | ||
| 16. | HDFS-6440 | Support for more than two standby Namenodes | HDFS | Merged | ||
| 17. | HDFS-1312 | Intra-datanode balancer | HDFS | Merged | ||
| 18. | HDFS-9427 | Move default ports out of ephemeral range | HDFS | Merged | ||
| 19. | HDFS-10467 | HDFS Router based federation | HDFS | Inigo / Chris | Merged | |
Version 3.1
| Feature freeze date | Dec 15, 2017 |
| Code freeze date | Jan 1, 2018 |
| Planned release dae | Jan 15, 2018 |
| Release Manager: | Wangda Tan |
| Branch | trunk |
Planned features:
YARN features
| JIRA | Summary | Component | Feature Owner | Comments | |
|---|---|---|---|---|---|
| 1. | YARN-5079, YARN-4793, YARN-4757, YARN-6419 | YARN native services | YARN | Jian He | Maybe 3.0 |
| 2. | YARN-5734 | Dynamic scheduler queue configuration | YARN | Jonathan / Xuan | Also 2.9 |
| 3. | YARN-5881 | Add absolute resource configuration to CapacityScheduler | YARN | Sunil G | |
| 4. | YARN-5673 | Container-executor rewrite for better security, extensibility and portability | YARN | Varun V | |
| 5. | YARN-6223 | GPU Isolation | YARN | Wangda | |
| 6. | YARN-5972 | Support Pausing/Freezing of opportunistic containers | YARN | Arun Suresh | |
| 7. | YARN-3926 | Resource Profile and multiple resource types | YARN | Varun V / Sunil | Maybe 3.0 |
| 8. | YARN-1011 | Resource overcommittment | YARN | Haibo / Karthik K | Under discussion |
HDFS Features:
| JIRA | Summary | Component | Feature Owner | Comments | |
|---|---|---|---|---|---|
| 1. | HDFS-10285 | HDFS Storage Policy Satisfier | HDFS | Uma | |
| 2. | <TODO> | HDFS tiered storage | HDFS | Chris Douglas | |
| 3. | HDFS-7240 | Ozone: Object store for HDFS | HDFS | Anu |
Common Features:
| JIRA | Summary | Component | Comments | Comments | |
|---|---|---|---|---|---|
| 1. | HADOOP-13786 | Add S3Guard committer for zero-rename commits to S3 endpoints | HDFS | Steve Loughran |