Support compression for log files
danthegoodman1 opened this issue · 0 comments
danthegoodman1 commented
Can just take the compression based on the extension suffix (e.g. .jsonl.gz, .jsonl.zstd, etc.)
Support:
- gzip
- zstd
- uncompressed
Omitting snappy because it doesn't seem to provide very minimal speed over zstd, but worse compression.