/datafusion-federation

Allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.

Primary LanguageRustApache License 2.0Apache-2.0

DataFusion Federation

crates.io docs.rs

The goal of this repo is to allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.

Check out the examples to get a feel for how it works.

Potential use-cases:

  • Querying across SQLite, MySQL, PostgreSQL, ...
  • Pushing down SQL or Substrait plans.
  • DataFusion -> Flight SQL -> DataFusion
  • ..

Status

The project is in alpha status. Contributions welcome; land a PR = commit access.