/pydata2019cba-mvdp-airflow-jupyter

PyData 2019 CBA - MVP for Data Products using Airflow and Jupyter

Primary LanguageJupyter Notebook

[PyData 2019 CBA] - Minimum Valuable Data Products with Airflow and Jupyter

Slide Deck

PDF. Download to see all the slides.

Daniel Imberman - Platform Engineer
t: @danimberman
i: @d_imberz
www.astronomer.io

Gonzalo Diaz - Senior Data Engineer
t: @gdcor
i: @gondcor
www.rappi.com.ar
Join us! gonzalo.diaz@rappi.com

Build

docker-compose build

Launch

docker-compose up

Go to http://localhost:8888 to Open Jupyter Labs

Go to http://localhost:8080 to Open Airflow

Test it

In Airflow, turn on the DAG and press "Trigger DAG". This will run an execution.

Once the DAG complete, check the output csv files in the folder jupyter/templates/datasets/output.