/overgrown-to-thriving

A presentation about how to scale an overgrown dbt project into a thriving ecosystem

Primary LanguageCSS

From Overgrown to Thriving: Scaling Your dbt Project Like a Gardener

This repository houses the presentation slides from the session titled "From Overgrown to Thriving: Scaling Your dbt Project Like a Gardener", which I presented at MDS Fest on August 24, 2023.

In this session, we explore the parallels between revitalizing an overgrown garden and maintaining well-organized dbt (data build tool) projects. Just as a neglected garden can become a tangled mess, even the most cherished dbt projects can accumulate complexity and inefficiencies over time without proper care. This presentation provides actionable steps to rejuvenate your dbt projects and foster a culture of long-term sustainability. Presentation Description

Session Recording and Slides

A recording of the MDS Fest 2023 session can be founding here: https://www.youtube.com/watch?v=bV7aLRocQdw

A live version of the slides can be found at https://nicholasyager.github.io/overgrown-to-thriving/#1

Referenced Tools

Here are links to all of the tools referenced in this presentation:

  • dbt_project_evaluator: dbt package for testing project architectural practices.
  • Whetstone: An open-source web app for analyzing project architecture.
  • dbt-meshify: A CLI for apply dbt model governance features
  • dbt-loom: An open source dbt Core plugin that enables multi-project deployments.
  • SQLFluff: An open source, dialect-flexible and configurable SQL linter.
  • sqlfmt: An opinionated formatter for dbt SQL.

I hope you find the presentation enlightening and valuable for maintaining and enhancing your dbt projects. Happy gardening!