DUE TO SPAM, SIGN-UP IS DISABLED. Goto Selfserve wiki signup and request an account.
...
Date | Milestone |
|---|---|
| Week of 7 Sep 2020 | Create the 2.0.0-test branch |
While the scope is fluid, we would be rebasing this test branch from master. After we completely freeze the scope, we would only cherrypick commits from Airflow Master to v2-0-test branch if they are “in-scope”. Normal development would continue on Master branch i.e. PRs would be created against Airflow Master. | |
| Week of 28 Sep 2020 | Cut Functionally complete 2.0 alpha release |
| Week of 12 Oct 2020 | Cut first 2.0 beta release |
Beta snapshots would be published to the Airflow Community to test and create issues to make sure Airflow is functioning and backwards compatible. | |
| Week of 19 Oct 2020 | Cut bridge release based on 1.10.x - jump-off point to 2.0. Probably 1.10.13 or 1.10.14 containing upgrade check scripts for 2.0 |
| Week of 26 Oct 2020 | Cut second 2.0 beta release |
| Week of 9 Nov 2020 | Cut third 2.0 beta release |
| Week of 23 Nov 2020 | Cut first 2.0 release candidate (2.0.0rc1) |
Things to Discuss Next
#4: 7 Sep 2020
Attendees
| Name | Company |
|---|---|
| Kaxil Naik | Astronomer |
| Ash-Berlin Taylor | Astronomer |
| Vikram Koka | Astronomer |
| Tomek Urbaszek | Polidea |
| Jarek Potiuk | Polidea |
| Daniel Imberman | Astronomer |
| James Timmins | Astronomer |
Xiaodong DENG | - |
| Kamil Breguła | Polidea |
| Ry Walker | Astronomer |
| Rafal Biegacz | |
| Anita Fronczak | |
| QP Hou | Scribd |
Key Decisions
- Updates
- Airflow v2-0-test branch has already been cut and currently manually rebased on top of the Master. Currently, we don't run CI as the branch is in-sync with Master. As soon as we have a PR / commit that we don't want to have it in 2.0 we will diverge v2-0-test branch from Master and start running tests against it.
- The upgrade-check PR was merged, we now need to define more rules to add more checks.
- API
- Progress:
- Project Board:
- API
- Progress, Current Work & Discussions
- Any open questions?
- Improvements to SubDags / Concept of TaskGroup
- AIP-34: https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-34+TaskGroup%3A+A+UI+task+grouping+concept+as+an+alternative+to+SubDagOperator
- PR: https://github.com/apache/airflow/pull/10153
- Any concerns on including this PR to 2.0 ??
- Do we want to support both TaskGroup & SubDags?
- Scheduler HA
- Docs Improvements Helm ChartDiscuss the issue with sources
- projects/1
- The issues labelled with "Enhancement" are not a requirement for 2.0
- Endpoints:
- Task Instance Endpoint is WIP, all the other endpoints have been implemented.
- Permissions Model:
- On-going discussion on the PR but close to completion.
- The next piece of work to be done is migrating existing Views to use resource-based permissions. (Github issue). This is mainly for standardizing the permissions model across API and UI.
- Progress:
- Will be included in 2.0 as an early-access feature with a clear note that this feature might potentially change in future Airflow version with breaking changes.
- Airbnb team would be happy to help on the support side answering questions related to Smart Sensor.
- Add docs around different execution modes for Sensor: Poke mode, Reschedule mode vs Smart Sensor
- Only critical fixes (fixes to bugs that takedown Production system) will be backported to 1.10.x core for six months after Airflow 2.0 is released.
Things to Discuss Next
- 21 September (TBD)
- UI Changes for 2.0
- Minimum effort changes: CSS/colours/spacing to make the UI look a bit modern
- TBD
- Process Process:
- When should we defer the in-scope items to post-2.0
- Completion by a date?
- Progress by a date?
- When should we defer the in-scope items to post-2.0
- UI Changes for 2.0