Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  •  Airflow configuration support (implementation):
    •  Copy the airflow config into each worker pod as environmental variables 
      •  (not safe from a security perspective, secrets in plaintext)
    •  Force people to put `airflow.cfg` in a kubernetes secret (or persistent volume), mount that secret or persistent volume into each worker pod 
      •  (nice but not very flexiblethe most flexible as it requires a very specific deployment setup)
    •  On startup of the scheduler, snapshot the airflow configuration and create/update the airflow secret, then mount that secret into each worker pod 
      •  (scheduler must have kubernetes RBAC rules to create/update 

...