This portfolio is intended to exemplify a data orchestration structure with Airflow via Astronomer and EMR (without the use of terraform) with local development.
- Install astronomer a follow steps at https://docs.astronomer.io/astro/cli/install-cli
- run astro dev init
- astro dev start (or stop)
- Airflow password and user "admin"
- Add variables (aws key_id) in Airflow in order to connect with EMR/AWS