2017-10-06

The beta1 RC0 vote passed, and beta1 is out! Now tracking GA features.

Highlights:

• 3.0.0-beta1 has been released!

Red flags:

• Still need to nail down whether we're going to try and merge resource profiles. I've been emailing with Wangda and Daniel about this, we need to reach a decision ASAP (might already be too late).
• No change in status in native services feature, haven't gotten follow-on reviews from Allen (who -1'd the earlier merge vote).

Previously tracked GA blockers that have been resolved or dropped:

• Jira
  server ASF JIRA serverId 5aa69414-a9e9-3523-82ec-879b028fb15b key YARN-7134

  :  Wangda downgraded this to "Major", dropping from list.

GA blockers:

• Jira
  server ASF JIRA serverId 5aa69414-a9e9-3523-82ec-879b028fb15b key YARN-6623

  : Actively being reviewed
• Change of ExecutionType

  • Jira
    server ASF JIRA serverId 5aa69414-a9e9-3523-82ec-879b028fb15b key YARN-7275

    : Kartheek has posted a patch, waiting for review

  • Jira
    server ASF JIRA serverId 5aa69414-a9e9-3523-82ec-879b028fb15b key YARN-7178

    : No update from Arun, though it's just a docs patch
• ReservationSystem

  • Jira
    server ASF JIRA serverId 5aa69414-a9e9-3523-82ec-879b028fb15b key YARN-4859

    : Yufei has picked this up

  • Jira
    server ASF JIRA serverId 5aa69414-a9e9-3523-82ec-879b028fb15b key YARN-4827

    : Yufei has picked this up, just a docs patch

Features merged for GA:

• Erasure coding
  • People are looking more at the flaky tests and nice-to-haves
  • Some bugs reported and being fixed based on testing at Cloudera
  • Need to finish the 3.0 must-do's.
• Addressing incompatible changes (YARN-6142 and HDFS-11096)
  
  • Sean has posted a new rev of the rolling upgrade script
  • Some YARN PB backward compat issues that we decided weren't blockers and are scheduled for GA
• Classpath isolation (HADOOP-11656)
  • HADOOP-13917 (Ensure nightly builds run the integration tests for the shaded client): Resolved, Sean retriggered and determined that this works.
  • HADOOP-14771 is still floating, along with adding documentation.
• Compat guide (HADOOP-13714)
  • A few subtasks are targeted at GA
• TSv2 alpha 2
  • This was merged, no problems thus far 

Unmerged features:

• Resource profiles (YARN-3926 and YARN-7069) (Wangda Tan)
  • This has been merged for 3.1.0, YARN-7069 tracks follow on work
  • ~7 patch available subtasks, I asked Wangda to set up a JIRA query for tracking this
• HDFS router-based federation (HDFS-10467) (Inigo Goiri and Chris Douglas)
  • Inigo sent out the merge vote
• API-based scheduler configuration (Jonathan Hung)
  • Jonathan sent out a discuss thread for merge, thinking is early next week. Larry did a security-oriented review.
• YARN native services (YARN-5079) (Jian He)
  • Subtasks were filed to address Allen's review comments from the previous merge vote, only one pending 
  • We need to confirm with Allen that this is ready to go, he hasn't been reviewing

2017-09-29

After about a month of slip, RC0 has been sent out for a VOTE. Focus now turns to GA, where we will attempt to keep the original beta1 target date (early November).

...