spark-airflow Running (Py)Spark on Airflow Locally https://krewari.medium.com/running-py-spark-on-airflow-locally-processing-good-bad-data-separately-batch-mode-5f970c6c3b52?source=your_stories_page