/govtech2020

dataeng_test

Primary LanguagePython

DSAID Data Engineering Technical Test

Submission from Friedemann Ang

Submission Contents

Find within 3 folders for each of the test's sections:

  1. Data Pipelines
    • an Airflow DAG file to process data/dataset.csv
    • output/result.csv, the output of the DAG
  2. Databases
    • ER diagram
    • Dockerfile
  3. System Design
    • Architecture diagram
    • Short explanation document