This repository help operate Airflow
We use Airflow's official helm chart to generate the yaml files, then we use kustomize to overwrite environment specific variables.
- update resource helm hook to argocd hook.
- specify the base values.yaml
- production: overwrite connection string to its corresponding Cloud SQL's connection string.
- develop: overwrite connection string to its corresponding Cloud SQL's connection string, and update dags sync branch to develop.
- office: overwrite connection string to its corresponding managed SQL connection string, and update dags sync branch to develop. IaC for deploying sql can be found here.
this folder is generating argocd deployed application spec
- cd/base: create repo spec connecting to airflow-cd and dags.
- cd/overlays: create application's declarative spec for corresponding environment, and setup proper cluster credential if needed.
- connect kubectl to the cluster you want to deploy argocd application (i.e., the argocd cluster).
just argo-deploy gke