2017-09-29

After about a month of slip, RC0 has been sent out for a VOTE. Focus now turns to GA, where we will attempt to keep the original beta1 target date (early November).

Highlights:

• RC0 vote was sent out on Thursday, two binding +1's so far.

Red flags:

• Resource profiles still has a number of pending subtasks, which is concerning from a schedule perspective. I emailed Wangda about this, and we need to discuss with other key contributors.
• Native services has one pending subtask but we haven't gotten follow-on reviews from Allen (who -1'd the earlier merge vote). Need to confirm that we've satisfied his feedback.

Previously tracked beta1 blockers that have been resolved or dropped:

• YARN-6623 was pushed out of beta1 to GA, has been committed so we can drop it from tracking.
• HADOOP-14897 (Loosen compatibility guidelines for native dependencies): Patch committed!

beta1 blockers:

• None, RC0 is out

GA blockers:

• Jira
  server ASF JIRA serverId 5aa69414-a9e9-3523-82ec-879b028fb15b key YARN-7134

   : this one popped out of nowhere, I don't have an update yet.

• Jira
  server ASF JIRA serverId 5aa69414-a9e9-3523-82ec-879b028fb15b key YARN-7178

  : this also popped out of nowhere, no update yet.

• Jira
  server ASF JIRA serverId 5aa69414-a9e9-3523-82ec-879b028fb15b key YARN-7275

  : Ditto

• Jira
  server ASF JIRA serverId 5aa69414-a9e9-3523-82ec-879b028fb15b key YARN-4859

  : Ditto

• Jira
  server ASF JIRA serverId 5aa69414-a9e9-3523-82ec-879b028fb15b key YARN-4827

  : Ditto

Features merged for GA:

• Erasure coding
  • People are looking more at the flaky tests and nice-to-haves
  • Some bugs reported and being fixed based on testing at Cloudera
  • Need to finish the 3.0 must-do's.
• Addressing incompatible changes (YARN-6142 and HDFS-11096)
  
  • Sean has posted a new rev of the rolling upgrade script
  • Some YARN PB backward compat issues that we decided weren't blockers and are scheduled for GA
• Classpath isolation (HADOOP-11656)
  • HADOOP-13917 (Ensure nightly builds run the integration tests for the shaded client): Resolved, Sean retriggered and determined that this works.
  • HADOOP-14771 is still floating, along with adding documentation.
• Compat guide (HADOOP-13714)
  • A few subtasks are targeted at GA
• TSv2 alpha 2
  • This was merged, no problems thus far 

Unmerged features:

• Resource profiles (YARN-3926 and YARN-7069) (Wangda Tan)
  • This has been merged for 3.1.0, YARN-7069 tracks follow on work
  • ~7 patch available subtasks, I asked Wangda to set up a JIRA query for tracking this
• HDFS router-based federation (HDFS-10467) (Inigo Goiri and Chris Douglas)
  • Inigo sent out the merge vote
• API-based scheduler configuration (Jonathan Hung)
  • Jonathan sent out a discuss thread for merge, thinking is early next week. Larry did a security-oriented review.
• YARN native services (YARN-5079) (Jian He)
  • Subtasks were filed to address Allen's review comments from the previous merge vote, only one pending 
  • We need to confirm with Allen that this is ready to go, he hasn't been reviewing

2017-09-22

We've had some late breaking blockers related to Docker support that are delaying the release. We're on a day-by-day slip at this point.

...