/aircompressor

A port of Snappy, LZO, LZ4, and Zstandard to Java

Primary LanguageJavaApache License 2.0Apache-2.0

Compression in pure Java

Maven Central Build Status

This library contains implementations of LZ4, Snappy, and LZO written in pure Java. They are typically 10-40% faster than the JNI wrapper for the native libraries.

Hadoop CompressionCodec

In addition to the raw block encoders, there are implementations of the Hadoop CompressionCodec for each algorithm. They are typically 300% faster than the JNI wrappers.

Requirements

This library requires a Java 1.8+ virtual machine containing the sun.misc.Unsafe interface running on a little endian platform.

Users

This library is used in projects such as Presto (https://prestosql.io), a distributed SQL engine.