teratide/parquet-io-accelerator

Parquet I/O accelerator

Parquet I/O accelerator

Requirements

• Rust 1.51+
• Thrift

Parquet benchmarks

Compression

cargo bench compression

• Uncompressed
• Snappy
• GZIP
• LZO
• Brotli
• LZ4
• Zstd

Metadata

cargo bench metadata

• FileMetaData
• PageHeader

Encodings

• Plain
• Dictionary Encoding
• Run Length Encoding
• Bit-packed (deprecated)
• Delta encoding
• Delta-length byte array
• Delta Strings
• Byte Stream Split