Pinned Repositories
airbyte-dbt-toolkit
Deploy an airbyte instance with dbt models in Google Cloud in 5 minutes
airflow-dbt-cloud
dbt Cloud pipelines in airflow examples
airflow-toolkit
Any Airflow project day 1, you can spin up a local desktop Kubernetes Airflow environment AND one in Google Cloud Composer with tested data pipelines(DAGs) :desktop_computer: >> [ :rocket:, :ship: ]
aws-lambda-based-etl
:file_folder: Process individual files and perform data normalization: s3->secrets manager->RDS & s3
dbt_bigquery_example
How to Automate SQL: dbt(data build tool) tutorial on bigquery with extensive NOTES :notebook:
fst
fst: flow state tool | smooth where you want it, friction where you need it when data engineering
iot-python-webapp
Live, real-time dashboard in a serverless docker web app, and deployed via terraform with a built-in CICD trigger
prefect-dbt-cloud
dbt Cloud pipelines in prefect 2.0 examples
schedule-python-script-using-Google-Cloud
:clock4: Schedules a Python script to append data into Bigquery using Google Cloud's App Engine with a cron job
serverless-data-pipeline-gcp
:factory: Schedule a data pipeline in Google Cloud using cloud function, BigQuery, cloud storage, cloud scheduler, stack trace, cloud build, and pub/sub
sungchun12's Repositories
sungchun12/airflow-toolkit
Any Airflow project day 1, you can spin up a local desktop Kubernetes Airflow environment AND one in Google Cloud Composer with tested data pipelines(DAGs) :desktop_computer: >> [ :rocket:, :ship: ]
sungchun12/iot-python-webapp
Live, real-time dashboard in a serverless docker web app, and deployed via terraform with a built-in CICD trigger
sungchun12/airflow-dbt-cloud
dbt Cloud pipelines in airflow examples
sungchun12/dbt_bigquery_example
How to Automate SQL: dbt(data build tool) tutorial on bigquery with extensive NOTES :notebook:
sungchun12/fst
fst: flow state tool | smooth where you want it, friction where you need it when data engineering
sungchun12/schedule-python-script-using-Google-Cloud
:clock4: Schedules a Python script to append data into Bigquery using Google Cloud's App Engine with a cron job
sungchun12/jaffle_shop_duckdb
Fun times!
sungchun12/datafold_demo
sungchun12/data-diff
Compare tables within or across databases
sungchun12/jaffle_shop_neon
I see the glimmers of dbt uniting software and data engineers
sungchun12/sqlmesh-demos
SQLMesh project for live demos - provides instructions so you can run this on your own!
sungchun12/bpt
blueprint: write and update schemas for your dbt models, less time doing toil == more time feeling royal
sungchun12/CMS_OMOP
sungchun12/dagster_demos
sungchun12/data-diff-chat
Chat with the `data-diff` codebase
sungchun12/dbt-core
dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
sungchun12/dbt-typer
Automate the boring toil of typing out dbt Model Contracts
sungchun12/demo-project-a
sungchun12/fal_serverless_demo
sungchun12/fast-elt
A data toolkit so gosh darn fast that you wonder why you ever accepted slow ELT as normal
sungchun12/filediff
sungchun12/langchain-demo
sungchun12/modal_demo
sungchun12/motherduck-blog
sungchun12/rust-demos
sungchun12/rustlings
:crab: Small exercises to get you used to reading and writing Rust code!
sungchun12/sqlmesh
Efficient data transformation and modeling framework that is backwards compatible with dbt.
sungchun12/sung_getting_started
sungchun12/weather_api_pipeline
sungchun12/xdb_diff_demo