(renamed from Airflow FS)
Status
StateDraft | In Progress |
Discussion Thread | |
Vote Thread | https://lists.apache.org/thread/wokt58k15g81cjnsytq9k1ofvspb4d5c |
Created | 2023-10-07 |
Progress Tracking |
Updated 2023-11-16: The AIP has been accepted as experiemental in 2.8.
Summary
With Airflow Store (AS) we want to address the challenges of fragmented code, improve XCom, and DAG processing complexity by providing a unified abstraction for accessing object storage systems. By doing so, we aim to enhance the overall user experience, promote code reusability, and simplify the development of Airflow workflows that interact with different storage backends.
...