DUE TO SPAM, SIGN-UP IS DISABLED. Goto Selfserve wiki signup and request an account.
...
| Code Block | ||||
|---|---|---|---|---|
| ||||
DAG(dag_id="blah", partition="new") # change this name |
Aside: I think making dag partitioning an explicit thing in airflow would be an overall good thing, beyond the whole uniqueness issue. It clarifies what exactly is going on, i.e. why execution X does not run until the next partition – cus it would not be complete otherwise. It also makes it possible for the user to say, every day rerun the last N partitions. This is essentially a partition-driven workflow with a configurable lookback.
4. Leave it sorta fuzzy and ambiguous
...