shaeqahmed/parquet-viewer

View parquet files online

Parquet Viewer

Online at: https://parquet-viewer.xiangpeng.systems

OpenVSX or VS Code extension

Parquet viewer is made possible with the funding from InfluxData.

Features

• Query parquet data with SQL ✅
• Query parquet data with natural language through LLM ✅
• View Parquet metadata ✅
• View Parquet files from anywhere -- local file, S3, or any URLs ✅
• Everything runs in the browser, no server, no external dependencies, just a web page ✅
• Read only you query -- won't download the entire parquet file ✅

Demo

Tips

• You can use ?url= to load a file from a url. For example, parquet-viewer.xiangpeng.systems/?url=https://raw.githubusercontent.com/tobilg/public-cloud-provider-ip-ranges/main/data/providers/all.parquet will load the file from github. parquet-viewer is smart enough to only download the data that is relevant to your query, usually a few KBs, even if the file is large.

• You can use parquet-viewer.py in utils to open a local file. Only works on Chrome or Firefox (not Safari).

./parquet-viewer.py /path/to/your/file.parquet

Development

It compiles Parquet, Arrow, Datafusion, OpenDAL to WebAssembly and uses it to explore Parquet files, more details.

Checkout the awesome Leptos framework.

Run locally

cargo install trunk --locked

trunk serve --release  --no-autoreload

Run tests

cargo install wasm-pack --locked
wasm-pack test --headless --chrome

Build VS Code extension

cd vscode-extension
npm install
npm run compile
vsce login xiangpeng-systems
vsce package
vsce publish

License

Licensed under either of

• Apache License, Version 2.0, (LICENSE-APACHE or http://www.apache.org/licenses/LICENSE-2.0)
• MIT license (LICENSE-MIT or http://opensource.org/licenses/MIT)

at your option.

Be aware that most of the code is generated by AI, resistance is futile.