facebook/zstd

ZSTD-22 is 30 times slower than it should be

aleksazr opened this issue · 0 comments

I have some binary files which are essentialy identical,
but zstd on level 22 is waaay slower on some of those files:

fast0.bin : 325949144 -> 2216950 (x147.03), 16.6 MB/s, 3339.1 MB/s
fast1.bin : 277326896 -> 2180040 (x127.21), 14.9 MB/s, 3818.3 MB/s
fast2.bin : 307040492 -> 2198873 (x139.64), 16.2 MB/s, 3960.9 MB/s
slow0.bin : 216098880 -> 1765827 (x122.38), 0.54 MB/s, 4015.0 MB/s
slow1.bin : 191787756 -> 1749474 (x109.63), 0.58 MB/s, 3930.7 MB/s
slow2.bin : 162074160 -> 1709061 (x94.83), 0.65 MB/s, 3694.5 MB/s

Also, x64 version of zstd.exe might produce
Assertion failed: cSize < UINT_MAX, file benchzstd.c, line 628

zstd slow.zip