Airflow Based Spark Jobs On K8S

Introduction

  • The inention behind this repository is to provide a clear way to setup a development evnironment to launch Spark Jobs on K8S using Airflow as an orchasterator

Notes

  • I will be grooming this setup adding Docs, a Makefile to streamline the setup process, and better organization.