Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • 3.0.0-beta1 has been released!
  • Router-based federation merge vote should be about to pass
  • API-based scheduler configuration merge vote is out, has the votes so far

Red flags:

  • Still need to nail down whether we're going to try and merge resource profiles. I've been emailing with Wangda and Daniel about this, we need to reach a decision ASAP (might already be too late).
  • No change in status in native services feature, haven't gotten follow-on reviews from Allen (who -1'd the earlier merge vote)Still waiting on Allen to review YARN native services feature.

Previously tracked GA blockers that have been resolved or dropped:

...

  • Jira
    serverASF JIRA
    serverId5aa69414-a9e9-3523-82ec-879b028fb15b
    keyYARN-6623
    : Actively being reviewed
  • Change of ExecutionType
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyYARN-7275
      : Kartheek has posted a patch, waiting for review
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyYARN-7178
      : No update from Arun, though it's just a docs patch
  • ReservationSystem
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyYARN-4859
      : Yufei has picked this up
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyYARN-4827
      : Yufei has picked this up, just a docs patch

Features merged for GA:

  • Rolling upgrade
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyYARN-6142
      : Ray is still going through JACC and proto output
    • Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyHDFS-11096
      : Sean has revved the patch and is waiting on reviews from Ray, Allen

Features merged for GA:

  • Erasure coding
    • Continued bug reporting and fixing
    Erasure coding
    • People are looking more at the flaky tests and nice-to-haves
    • Some bugs reported and being fixed based on testing at Cloudera.
    • Need Still need to finish the 3.0 must-do's.
    Addressing incompatible changes (YARN-6142 and HDFS-11096)
    • Sean has posted a new rev of the rolling upgrade script
    • Some YARN PB backward compat issues that we decided weren't blockers and are scheduled for GA
  • Classpath isolation (HADOOP-11656)HADOOP-13917 (Ensure nightly builds run the integration tests for the shaded client): Resolved, Sean retriggered and determined that this works.HADOOP-11656)
    • HADOOP-14771 is still floating, along with adding documentation.
  • Compat guide (HADOOP-13714)
    • A few subtasks are targeted at GASynced with Daniel, he plans to wrap up the remaining  stuff next week
  • TSv2 alpha 2
    • This was merged, no problems thus far (smile)

Unmerged features:

  • Resource types / profiles (YARN-3926 and YARN-7069) (Wangda Tan)(Wangda Tan)
    • This has been merged for 3.1.0, YARN-7069 tracks follow on work
    • Wangda said that he's okay waiting for 3.1.0 for this, we're waiting on Daniel. I synced with Daniel earlier this week, and he wants to try and get some of it into 3.0.0. Waiting on an update.
    • I still need
    • This has been merged for 3.1.0, YARN-7069 tracks follow on work
    • ~7 patch available subtasks, I asked Wangda to set up a JIRA query for tracking the state of this.
  • HDFS router-based federation (HDFS-10467) (Inigo Goiri and Chris Douglas)
    • Inigo sent out the merge voteMerge vote should close any minute now
  • API-based scheduler configuration (Jonathan Hung)
    • Jonathan sent out a discuss thread for merge, thinking is early next week. Larry did a security-oriented review.Merge vote is out, will close next week
  • YARN native services (YARN-5079) (Jian He)
    • Subtasks were filed to address Allen's review comments from the previous merge vote, only one pending 
    • We need to confirm with Allen that this is ready to go, he hasn't been reviewing

...