/etl-assignment

Primary LanguagePython

ETL Assignment

Requirements

  1. Python 3.7+ - link

  2. Docker/docker-compose link

Run Postgres DB

docker-compose up -d postgres

Run ETL job

  1. Create virtual enviroment - link.

  2. Run below command:

pip install -r requirements.txt
  1. Run job:
python run_etl.py --destination db --transformation test_utilization

Available options:

  • destination - db (postgres database) or dir (local directory, default)

  • transformation - test_utilization / test_average_scores

Run tests

pytest -v