/4mc

4mc - splittable lz4 and zstd in hadoop/spark/flink

Primary LanguageCOtherNOASSERTION

Fork of 4mc - Four More Compression

About

Used by util-cofig.

Versions

Version 2.0.1 is deployed as a jar to artifacts.placed.com thirdparty repo here.

Version 3.0.0 is deployed as a jar to artifacts.placed.com release repo here.

Version 3.0.1 (supports arm64/aarch64) is deployed as a jar to artifacts.placed.com release repo here.

CI/CD

Currently, CI/CD for this repo is not configured. To deploy a new version of this library, follow this doc for setting up your environment, bump the artifact's version here, then run following commands:

cd java/hadoop-4mc
mvn clean package

Check that jar was generated (for example, at location 4mc/java/hadoop-4mc/target/hadoop-4mc-3.0.1.jar), then deploy to release repo:

mvn deploy