pytorch/data

Add zlib support to Decompressor

JohnHBrock opened this issue ยท 1 comments

๐Ÿš€ The feature

Add support to Decompressor for file_type="zlib", and add a corresponding ZlibFileLoader.

Motivation, pitch

zlib is a very popular format, but Decompressor doesn't seem to support it (AFAICT it only supports gzip, lzma, tar, zip, and bzip2). I ran into this while working with a large dataset compressed using zlib and had to roll my own solution.

Alternatives

No response

Additional context

I'm happy to submit a PR implementing this.

ejguan commented

Pls feel free to open a PR to add it.