/duckdb_azure

Azure extension for DuckDB

Primary LanguageC++MIT LicenseMIT

Experimental warning

This extension is currently in an experimental state. Feel free to try it out, but be aware some things may not work as expected.

DuckDB Azure Extension

This extension adds a filesystem abstraction for Azure blob storage to DuckDB. To use it, install latest (>0.9.1) DuckDB and run:

SET azure_storage_connection_string = '<your_connection_string>';

then you can query files from azure:

SELECT count(*) FROM 'azure://<my_container>/<my_file>.<parquet_or_csv>';

Supported architectures

The extension is tested & distributed for Linux (x64, arm64), MacOS (x64, arm64) and Windows (x64)

Documentation

See the Azure page in the DuckDB documentation.

Check out the tests in test/sql for more examples.

Building

This extension depends on the Azure c++ sdk. To build it, either install that manually, or use vcpkg to do dependency management. To install vcpkg check out the docs here. Then to build this extension run:

VCPKG_TOOLCHAIN_PATH=<path_to_your_vcpkg_toolchain> make