Status: RELEASED


Release History

Blocker/Critical (2.8.0):

 

JIRA NumberPriorityAssigneeStatusDescription
HDFS-10684BlockerJohn ZhugeDONEWebHDFS DataNode calls fail without parameter createparent
HDFS-11180BlockerAkira AjisakaDONEIntermittent deadlock in NameNode when failover happens
YARN-5184BlockerSangjin LeeDONEFix up incompatible changes introduced on ContainerStatus and NodeReport
YARN-5559BlockerAkira AjisakaDONE

 Analyse 2.8.0/3.0.0 jdiff reports and fix any issues

YARN-3866BlockerWangda TanDONEAM-RM protocol changes to support container resizing (break API compatibility)
YARN-6029CriticalTao YangDONE

CapacityScheduler deadlock when ParentQueue#getQueueUserAclInfo is called by Thread_A at the moment that

Thread_B calls LeafQueue#assignContainers to release a reserved container

YARN-6068BlockerJunping DuDONELog aggregation get failed when NM restart even with recovery
YARN-6072BlockerAjith S RM unable to start in secure mode
MAPREDUCE-6816BlockerShen YinjieDONEProgress bars in Web UI always at 100%
YARN-5709CriticalKarthik KambatlaDONECleanup leader election configs and pluggability
HADOOP-13250Critical Vinod Kumar VavilapalliMOVE TO LATERjdiff and dependency reports aren't linked in site web pages
HDFS-8674CriticalDaryn SharpDONEImprove performance of postponed block scans
HADOOP-13826CriticalSean MackroryDONES3A Deadlock in multipart copy due to thread pool limits.
HDFS-11209CriticalXiaoyu YaoMOVE TO LATERSNN can't checkpoint when rolling upgrade is not finalized

 

For details, please refer: https://s.apache.org/6kwx

 

TODOs before RC

TODO itemStatus - 1/4/2017Current Status
All blockers target for 2.8.0 are landed.DONEDONE
All JIRAs with fixVersion 2.8 get landed in branch-2.874 JIRAs identified that no patch landedDONE
All JIRAs with fixVersion 2.7.1, 2.7.2, 2.7.3 have fix version of 2.8.0352 JIRAs identified that not marked with 2.8.0.DONE
All JIRAs with fixVersion of 2.7.1, 2.7.2 and 2.7.3 get landed in branch-2.8

17 JIRAs from 2.7.1 have no patch landed in 2.8.0

8 JIRAs from 2.7.2 have no patch landed in 2.8.0

16 JIRAs from 2.7.3 have no patch landed in 2.8.0

DONE

 

Release Scope

Important Features & Improvements:

JIRA IDFeature DescriptionJIRA IDFeature Description
HADOOP-12909

Support async call retry and failover which can be used in async DFS
implementation with retry effort.

HDFS-9239

DataNode Lifeline Protocol: an alternative protocol for reporting DataNode
liveness. This can prevent the NameNode from incorrectly marking DataNodes
as stale or dead in highly overloaded clusters where heartbeat processing
is suffering delays.

HADOOP-12691

HADOOP-13008

XFS Filter support in UIs. Cross Frame Scripting (XFS) prevention for UIs can be provided through
a common servlet filter.

HDFS-9184Logging HDFS operation's caller context into audit logs

HADOOP-12723

HADOOP-12548

HADOOP-12537

S3A improvements: add ability to plug in any AWSCredentialsProvider,
support read s3a credentials from hadoop credential provider API in
addition to XML configuraiton files, support Amazon STS temporary
credentials

HDFS-9945

A new Datanode command for evicting writers which is useful when data node
decommissioning is blocked by slow writers.

HADOOP-12635WASB improvements: adding append API supportYARN-3458NodeManager CPU resource monitoring in Windows.

HADOOP-11731

HADOOP-12651

Build enhancements: replace dev-support with wrappers to Yetus,
provide a docker based solution to setup a build environment,
remove CHANGES.txt and rework the change log and release notes.

YARN-41

NM shutdown more graceful: NM will unregister to RM immediately rather than
waiting for timeout to be LOST (if NM work preserving is not enabled).

HADOOP-9477Add posixGroups support for LDAP groups mapping service.YARN-261Add ability to fail a specific AM attempt in scenario of AM attempt get stuck.
HADOOP-13037

Support integration with Azure Data Lake (ADL) as an alternative
Hadoop-compatible file system.

YARN-4349CallerContext support in YARN audit log.

HDFS-9711

HDFS-8155

HDFS-9057

WebHDFS enhancements: integrate CSRF prevention filter in WebHDFS,
support OAuth2 in WebHDFS, disallow/allow snapshots via WebHDFS

YARN-3623ATS versioning support: a new configuration to indicate timeline service version.
HDFS-9804Allow long-running Balancer to login with keytabMAPREDUCE-6304Allow node labels get specificed in submitting MR jobs
HDFS-9835

Add ReverseXML processor which reconstructs an fsimage from an XML file.
This will make it easy to create fsimages for testing, and manually edit
fsimages when there is corruption

MAPREDUCE-6415Add a new tool to combine aggregated logs into HAR files
HDFS-9244Support nested encryption zones  

 

Number of Patches

ProjectNumber of Patches Not Released Before (not include 3.0.0-alphaX)Number of Patches Since 2.7.0
COMMON655774
HDFS9601137
MAPREDUCE170232
YARN585774
TOTAL23702917
  • No labels