/airflow-k8s-executor

Run Airflow kubernetes executor on local machine

Primary LanguagePython

Airflow-k8s-executor-playground

Run Airflow kubernetes executor on local machine and use airflow code from main with minimum setup.

Prerequisite

  • Docker desktop - Enable kubernetes
  • Helm

Clone Airflow code

Update templates

  • ./templates
  • values.yaml

Create persistent volume and persistent volume claim

kubectl apply -f ./templates

Install

helm upgrade --install -f values.yaml airflow ../airflow/chart

Access console

docker run --rm -ti apache/airflow:2.6.0 bash

port forwarding

kubectl port-forward svc/airflow-webserver 8080:8080