This repo helps set up the DBT SQL Serverless + DBT enviornment to run the TPC-DI benchmark.
The main findings from this experiment were posted in our blog here:
https://synccomputing.com/5-lessons-learned-from-testing-databricks-sql-serverless-dbt/
For more questions to learn more about how to optimize your Databricks jobs, find us here at:
- Clone this repo into your local environment
- Set up your Databricks credentials
- Run the DBT project