/re-data-ufo

uses airbyte to load from a google sheet into postgress then does data reliability engineering with re data

re data with airbyte

source

ufo data kaggle

setup

# load seed files into the database
dbt seed
# Compute models for toy_shop project, only pending_orders_per_customer table in this case.
dbt run --select stg_ufo

run re data for the a time window (minics running this several times)

re_data run --start-date 2022-06-20 --end-date 2022-06-26

running site

re_data overview generate
re_data overview serve

send a notification TBC

re_data notify slack \                                              ✘ INT  re-data-dbt-aMOho44y
--start-date 2022-06-20 \
--end-date 2022-06-27 \
--webhook-url https://hooks.slack.com/services/T00000000/B00000000/XXXXXXXXXXXXXXXXXXXXXXXX \
--subtitle="[Optional] Daves Markdown text to be added as a subtitle in the slack message generated"