2017-10-31

Lots of progress towards GA, we look on track for cutting RC0 this week.

Highlights:

• Resource types vote has passed and will be merged with branch-3.0 shortly.
• Down to three blockers on the dashboard, all being actively revved.

Red flags:

• Still need to validate that resource types is ready to go once it's merged.

Previous tracked GA blockers that have been resolved or dropped:

• Change of ExecutionType

  • Jira
    server ASF JIRA serverId 5aa69414-a9e9-3523-82ec-879b028fb15b key YARN-7178

    : Arun got the patch in with reviews from Wangda and Haibo.
• ReservationSystem

  • Jira
    server ASF JIRA serverId 5aa69414-a9e9-3523-82ec-879b028fb15b key YARN-4827

    : Yufei and Subru got this in.
• Rolling upgrade

  • Jira
    server ASF JIRA serverId 5aa69414-a9e9-3523-82ec-879b028fb15b key YARN-6142

    : Ray resolved this since we think it's sufficiently complete.
• Erasure coding

  • Jira
    server ASF JIRA serverId 5aa69414-a9e9-3523-82ec-879b028fb15b key HDFS-12686

    : Resolved this one to incorporate it in HDFS-12682

GA blockers:

• Rolling upgrade

  • Jira
    server ASF JIRA serverId 5aa69414-a9e9-3523-82ec-879b028fb15b key HDFS-11096

    : I asked Sean if we can downgrade this from blocker
• Erasure coding

  • Jira
    server ASF JIRA serverId 5aa69414-a9e9-3523-82ec-879b028fb15b key HDFS-12682

    : Actively being worked on and reviewed, should be in soon

  • Jira
    server ASF JIRA serverId 5aa69414-a9e9-3523-82ec-879b028fb15b key HDFS-11467

    : Waiting on HDFS-12682, I asked if we can work concurrently

Features merged for GA:

• Erasure coding
  • Testing is still ongoing at Cloudera, no new bugs found recently
  • Closing on remaining blockers for GA
• Classpath isolation (HADOOP-11656)
  

  • Jira
    server ASF JIRA serverId 5aa69414-a9e9-3523-82ec-879b028fb15b key HADOOP-13916

    : Seems unlikely to make it
• Compat guide (HADOOP-13714)

  • Jira
    server ASF JIRA serverId 5aa69414-a9e9-3523-82ec-879b028fb15b key HADOOP-14876

    : Patch is being actively revved and reviewed, Robert +1'd, Anu posted a big review

  • Jira
    server ASF JIRA serverId 5aa69414-a9e9-3523-82ec-879b028fb15b key HADOOP-14875

    : No patch yet
• TSv2 alpha 2
  • This was merged, no problems thus far 
• API-based scheduler configuration 

  Jira
  server ASF JIRA serverId 5aa69414-a9e9-3523-82ec-879b028fb15b key YARN-5734

  • Merged, no problems thus far 
• HDFS router-based configuration 

  Jira
  server ASF JIRA serverId 5aa69414-a9e9-3523-82ec-879b028fb15b key HDFS-10467

  • Merged, no problems thus far 
• Resource types 

  Jira
  server ASF JIRA serverId 5aa69414-a9e9-3523-82ec-879b028fb15b key YARN-3926

  • Vote has passed, Daniel is currently doing the mechanics of merging
  • Need to also perform final validation post-merge

Dropping the "unmerged features" section since we're not letting in anything else at this point.

2017-10-20

Apologies for skipping the update last week. Here's how we're tracking for GA.

...