/financial_data

A Prefect implementation for building data pipelines and performing ETL for financial data.

Primary LanguagePython

Financial data pipelines

A prefect implementation for building data pipelines and performing ETL on financial data.

Migrations

Running migrations

poetry run python manage.py migrate <APP_NAME>

Creating migrations

poetry run python manage.py makemigrations <APP_NAME> -m <MESSAGE>

If initial migration

  1. append version path to version_path list in alembic.ini
version_locations = ...  %(here)s/financial_data/<YOUR_APP>/migrations
  1. run init the migrations using init-migrations in manage.py
poetry run python init-migrations <APP_NAME>
  1. add script path to alembic.ini
[<APP_NAME>]
script_location = financial_data/<APP_NAME>/migrations
  1. run initial migrations
python manage.py makemigrations <APP_NAME> -m <MESSAGE> -v <MIGRATIONS_DIR> -i

Prefect notes

Registering flows discussion on Prefect repo