DUE TO SPAM, SIGN-UP IS DISABLED. Goto Selfserve wiki signup and request an account.
...
-
--load-example-dagsmust load examples from standard provider at least in Airflow 3.1 (same like in breeze hack today) - Testing DAGs must be loadable (at least in breeze) to be able to remove them from example tree
Likely we should have a dedicated "test_dags" folder/bundle that should contain dags used for testing only. We can automatically add such dags to be used in unit test via auto-fixture in the sharedconftest.pyor similar - this way it will work in both breeze and local venv. I think we should aim to have breeze == local env - DAG Budles must be extended depending on installed/available providers to extend examples - allowing to move examples from core to providers (e.g.
example_kubernetes_executor.py→ cncf.kubernetes)
Likely we can add "examples" section inprovider.yamland move the example dags from "tests" to separate "examples" folder that will be also embedded in the.whlfile (so that you can also conditionally enable examples from a given provider). This means that "system" tests will not be a separate "system" folder, but something separate. -
We should figure out a way how to show examples from a provider - possibly "load_core_examples=true/false" and "load_provider_examples=[list of providers]" would be a nice way how to do it
The example have to be reviewed with "security" point of view. We often have security reports that are pointing to RCE , lack of sanitizations etc. in our examples - which is very important as those examples can be used by others and bad practices propagated to production code.
Proposed Technical Excellence in Example DAGs
...