Page History

...

• Process
  • Decide on a date to create a 2.0.0-test branch
  • When should we defer the in-scope items to post-2.0
    • Completion by a date?
    • Progress by a date?
  • Creating a Changelog for 2.0
  • Beta Testing
    
    • Need help from Airflow Vendors and power customers like Astronomer, Google, AirBnb
• Smart Sensors – in 2.0 or 2.1
• TBD

#2: 24 Aug 2020

Attendees

Key Decisions

• Smart Sensors – in 2.0 or 2.1
  • AIP-17 | PR: https://github.com/apache/airflow/pull/5499
  • We have not come to a conclusion yet on whether this should be included in 2.0 or not. The majority is towards adding it in 2.0 (as it supports Airflow 2.0's Scalability story) and marking it as experimental.
  • There were some questions raised around supporting this new feature. So we decided that everyone would take a look at the PR itself and we will spend a few minutes in the next meeting to decide whether it is 2.0 or not
• Simplification of KubernetesExecutor / KubernetesPodOperator
  • PR: https://github.com/apache/airflow/pull/10393
  • This will be part of Airflow 2.0
• Airflow Upgrade Check (airflow upgrade-check) command 
  • WIP PR: PR: https://github.com/apache/airflow/pull/9467 | Design Doc: 

    Widget Connector
    url https://docs.google.com/document/d/17tB9KZrH871q3AEafqR_i2I7Nrn-OT7le_P49G65VzM/edit#heading=h.vv80w6y621gv

  • Scope:
    • Users bash script won’t be included but anything in the core Airflow would be covered

    • DAG Definitions:

      • Changes in Path for contrib to Providers packages
      • DAG Interfaces: changes in arguments of a DAG / BaseOperator
    • Configurations:
      • Option to auto-replace deprecated configs with new options
    • Run-time Core items:
      • Changes like "Connection type can't be null". The upgrade-check should at least shown warning if it can't provide option to detect the type.
    • CLI refactor is out-of-scope
      • Automatic refactor is out-of-scope as it is too difficult to cover all the cases in the Users bash scripts.
      • This will be covered by docs or by showing warnings via the upgrade-check command
    • Experimental API to New API refactor is out-of-scope (will be covered by Migration docs)
• We agreed that the airflow upgrade-check command needs to be available in the last release before Airflow 2.0 (1.10.x or 1.11.x)