Proposal to use zstd instead of gzip
Closed this issue · 5 comments
Before I spent time cleaning up our fork and creating a PR for this, I wanted to check if this is something you would actually be interested in taking back at all.
Basically, I just wanted to use zstd compression instead (or in parallel?) with the current gzip compression. The primary reason is a much lower cache size and overall binary size.
.rw-rw-r--@ 1,422,606 jake 29 May 8:56 embedded-cache.bin.gz
.rw-rw-r--@ 967,297 jake 20 Jun 9:22 embedded-cache.bin.zstd
.rwxrwxr-x@ 8,034,936 jake 28 May 11:57 askalono
.rwxrwxr-x@ 7,130,792 jake 20 Jun 9:22 askalono
There is also a slight (~20ms on my machine) improvement on decompression times, but it's probably not going to be noticeable in practice.
Ah! I had almost this exact thought the other day. That would be super cool -- a substantial size reduction and a speedup is a win in my book. Would love to see a PR. :)
Cool, good to hear, will hopefully have something next week. Do you want it to support both, or just do a straight replacement?
Replacement is totally fine; no need for both when the format itself is specific to this tool.
Awesome, that makes it a lot easier.
Closing based on your PR (thanks again!)