Link: https://airflow.apache.org/docs/apache-airflow/stable/start/docker.html
Commands
docker-compose up airflow-init
docker-compose up docker ps
Big setup
cd airflow-materials/airflow-section-3/
./start.sh
-
Testing : airflow tasks test forex_data_pipeline forex_processing 2021-01-01
-
Airflow webserver (admin/admin): http://kube-sarye-worker.francecentral.cloudapp.azure.com:8080
-
Hue (admin/admin): http://kube-sarye-worker.francecentral.cloudapp.azure.com:32762
https://hooks.slack.com/services/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