Dataform is a tool for managing SQL based data operations in your warehouse.

Intro

Dataform is an open source framework for managing SQL based data operations in your warehouse. It helps you pilot the T in ELT, with SQL code, and brings engineering best practices to analytics pipeline management.

How it works

You develop datasets and assertions in SQL with Dataform’s built-in templating syntax and APIs
Dataform compiles your project into a DAG (Directed Acyclic Graph) of every action in SQL
Dataform connects to your warehouse and runs the DAG or just the actions that you specify
You receive detailed execution logs

Get started

With the CLI

You can install the Dataform SDK using the following command line. Follow the docs to get started.

npm i -g @dataform/cli

With Dataform web

Dataform web is a development environment and production ready deployment tool for the Dataform SDK. You can learn more on dataform.co

Want to report a bug or request a feature?

Open an issue or email us at opensource@dataform.co

Want to contribute?

Check out our contributors guide to get started with setting up the repo.