dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
The Databricks Lakehouse provides one simple platform to unify all your data, analytics and AI workloads.
The dbt-databricks
adapter contains all of the code enabling dbt to work with Databricks.
This adapter is based off the amazing work done in dbt-spark
Install using pip:
pip install dbt-databricks
Upgrade to the latest version
pip install --upgrade dbt-databricks
your_profile_name:
target: dev
outputs:
dev:
type: databricks
schema: [database/schema name]
host: [your.databrickshost.com]
http_path: [/sql/your/http/path]
token: [dapiXXXXXXXXXXXXXXXXXXXXXXX]
The dbt-databricks
adapter has been tested against Databricks SQL
and Databricks runtime releases 7.3 LTS
and later.