Pinned Repositories
airbyte-dbt-toolkit
Deploy an airbyte instance with dbt models in Google Cloud in 5 minutes
airflow-dbt-cloud
dbt Cloud pipelines in airflow examples
airflow-toolkit
Any Airflow project day 1, you can spin up a local desktop Kubernetes Airflow environment AND one in Google Cloud Composer with tested data pipelines(DAGs) :desktop_computer: >> [ :rocket:, :ship: ]
aws-lambda-based-etl
:file_folder: Process individual files and perform data normalization: s3->secrets manager->RDS & s3
dbt_bigquery_example
How to Automate SQL: dbt(data build tool) tutorial on bigquery with extensive NOTES :notebook:
demotron
CLI to delight real people with live demos
fst
fst: flow state tool | smooth where you want it, friction where you need it when data engineering
iot-python-webapp
Live, real-time dashboard in a serverless docker web app, and deployed via terraform with a built-in CICD trigger
schedule-python-script-using-Google-Cloud
:clock4: Schedules a Python script to append data into Bigquery using Google Cloud's App Engine with a cron job
serverless-data-pipeline-gcp
:factory: Schedule a data pipeline in Google Cloud using cloud function, BigQuery, cloud storage, cloud scheduler, stack trace, cloud build, and pub/sub
sungchun12's Repositories
sungchun12/fst
fst: flow state tool | smooth where you want it, friction where you need it when data engineering
sungchun12/airbyte-dbt-toolkit
Deploy an airbyte instance with dbt models in Google Cloud in 5 minutes
sungchun12/dbt-bigquery-example
sungchun12/prefect-dbt-cloud
dbt Cloud pipelines in prefect 2.0 examples
sungchun12/prefect-examples
personal examples for prefect
sungchun12/terratest
Terratest is a Go library that makes it easier to write automated tests for your infrastructure code.
sungchun12/airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
sungchun12/airflow-dbt-cloud-guide
sungchun12/charts
Curated applications for Kubernetes
sungchun12/code_snippets-1
sungchun12/COVID_prison_data
Compiling data on the prevalence of coronavirus infection in prisons across the country
sungchun12/dbt-cloud-datafold
Test repository
sungchun12/dbt-cloud-test
sungchun12/dbt-tutorial
sungchun12/dbt-works
Library of dbt challenges overcome
sungchun12/dbt_cloud_api_examples
Hub for my dbt Cloud API code snippets
sungchun12/docker-airflow
Docker Apache Airflow
sungchun12/duckdb-demo
sungchun12/fal_serverless_demo
sungchun12/fast-elt
A data toolkit so gosh darn fast that you wonder why you ever accepted slow ELT as normal
sungchun12/gitignore
A collection of useful .gitignore templates
sungchun12/learn-terraform-cost-estimation
sungchun12/learn-terraform-enforce-policies
sungchun12/materialize
Materialize simplifies application development with streaming data. Incrementally-updated materialized views - in PostgreSQL and in real time. Materialize is powered by Timely Dataflow.
sungchun12/modal_demo
sungchun12/personal-website
Code that'll help you kickstart a personal website that showcases your work as a software developer.
sungchun12/README
:scroll: My personal reference for when I meet new teammates. Not something I share willy nilly. Kudos to you if you're reading this on your own!
sungchun12/starburst-trino-demo
sungchun12/terraform-getting-started
sungchun12/terragrunt-reference-architecture
Terragrunt Reference Architecture (upd: May 2020)