Versions Compared

Old Version 11

changes.mady.by.user Bolke de Bruin

Saved on

compared with

New Version 12

changes.mady.by.user Bolke de Bruin

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

One of the primary considerations for the adoption of AS is its integration into the core Airflow package, hosted on airflow.io. This ensures availability across DAG Processing, XCOM, Authoring and Providers. To achieve this, AS will be implemented based on the well-established fsspec library, a BSD licensed file system specification library. AFS aims to provide a standard and unified approach to working with various object storage systems through the concept of mounts and mountpoints. This unified approach will eliminate the need for users to grapple with cross-filesystem issues, such as copying data between different cloud storage providers and removing the need for specialised Operators that deal with this.

...