Way better now, yet, LZSSE2 and LzTurbo cast long shadows
Sanmayce opened this issue · 24 comments
Hi inikep,
some textual decompression feedback, again.
@github_staff
Shouldn't it be better to add 'Feedback' section, thus feedbacks won't go to 'Issues', inappropriate it is.
Anyway, seeing how v2.0 is way better than the one I played with before, wanted to see my new toy (nothing special) Nakamichi 'Zato' against LZSSE2, LZ5, and the rest superfast decompressors.
TurboBench from Sep 4 2016 was used.
Dind't have enough machine power and time to test more files, yet, the 19 ones serve well the overview.
The benchmark is downloadable at:
[https://1drv.ms/u/s!AmWWFXGMzDmEgmEpIiqenL43pg4N]
On a LZSSE2, two notes:
- I believe this buggy i5, that is used, mischaracterize the beauty of utilizing the available registers, surely i7 will give all the needed registers. A retest is needed on i7, and 4th+ gen on top of that;
- When decompressing from L1/L2/L3 cache, or fetching fast from main RAM, AVX compile is much much faster than SSE4.1 one, see 'Dictionary_of_Native_American_Mythology.tar' testfile.
The benchmark package contains:
D:\LZ5_v2beta_VS_LZSSE2_VS_Zato>dir/on
10/02/2016 08:55 PM 9,025 _BENCH.BAT
10/02/2016 08:55 PM 10,687,517 Agatha_Christie_85-ebooks_(French)_TXT.tar.L17.LZSSE2
10/02/2016 08:55 PM 9,803,106 Agatha_Christie_85-ebooks_(French)_TXT.tar.Nakamichi
10/02/2016 08:55 PM 11,649,537 Agatha_Christie_89-ebooks_TXT.tar.L17.LZSSE2
10/02/2016 08:55 PM 11,441,644 Agatha_Christie_89-ebooks_TXT.tar.Nakamichi
10/02/2016 08:55 PM 5,524,854 Arabian_Nights_complete.html.L17.LZSSE2
10/02/2016 08:55 PM 5,660,839 Arabian_Nights_complete.html.Nakamichi
10/02/2016 08:55 PM 1,566,277 Blacklegs_Card_Sharps_and_Confidence_Men.pdf.L17.LZSSE2
10/02/2016 08:55 PM 1,552,936 Blacklegs_Card_Sharps_and_Confidence_Men.pdf.Nakamichi
10/02/2016 08:55 PM 4,840,938 Complete_Works_of_Fyodor_Dostoyevsky.txt.L17.LZSSE2
10/02/2016 08:55 PM 4,859,306 Complete_Works_of_Fyodor_Dostoyevsky.txt.Nakamichi
10/02/2016 08:55 PM 10,359,314 Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar.L17.LZSSE2
10/02/2016 08:55 PM 9,730,008 Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar.Nakamichi
10/02/2016 08:55 PM 668,060 Dictionary_of_Native_American_Mythology.tar.L17.LZSSE2
10/02/2016 08:55 PM 717,938 Dictionary_of_Native_American_Mythology.tar.Nakamichi
10/02/2016 08:55 PM 1,830,701 Duden_Synonymworterbuch_(De-De).dsl.L17.LZSSE2
10/02/2016 08:55 PM 1,610,899 Duden_Synonymworterbuch_(De-De).dsl.Nakamichi
10/02/2016 08:55 PM 4,573,102 Encyclopedia_of_Pain_(3_Vol_Set).pdf.txt.L17.LZSSE2
10/02/2016 08:55 PM 4,564,126 Encyclopedia_of_Pain_(3_Vol_Set).pdf.txt.Nakamichi
10/02/2016 08:55 PM 38,063,182 enwik8.L17.LZSSE2
10/02/2016 08:55 PM 38,261,116 enwik8.Nakamichi
10/02/2016 08:55 PM 1,768,505 Large_traffic_log_file_of_a_popular_website_fp.log.L17.LZSSE2
10/02/2016 08:55 PM 1,990,428 Large_traffic_log_file_of_a_popular_website_fp.log.Nakamichi
10/02/2016 08:55 PM 451,490 lz5-2.0_beta.exe
10/02/2016 08:55 PM 433,552 Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.L17.LZSSE2
10/02/2016 08:55 PM 468,913 Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.Nakamichi
10/02/2016 08:55 PM 1,632 MokujIN 224 prompt.lnk
10/02/2016 08:55 PM 17,363,811 Nakamichi_(Zato)_256MB-Sliding-Window_vs_LZSSE2.zip
10/02/2016 08:55 PM 146,944 Nakamichi_Zato_XMM_PREFETCH_4096_Intel_15.0_64bit_AVX.exe
10/02/2016 08:55 PM 154,624 Nakamichi_Zato_XMM_PREFETCH_4096_Intel_15.0_64bit_SSE41.exe
10/02/2016 08:55 PM 3,496,527 Slownik_jezyka_polskiego_(Pol-Pol).dsl.L17.LZSSE2
10/02/2016 08:55 PM 3,101,206 Slownik_jezyka_polskiego_(Pol-Pol).dsl.Nakamichi
10/02/2016 08:55 PM 505,572 Smyslov_(Vasily_Smyslov_2627_games).pgn.L17.LZSSE2
10/02/2016 08:55 PM 541,608 Smyslov_(Vasily_Smyslov_2627_games).pgn.Nakamichi
10/02/2016 08:55 PM 5,160,110 The_complete_Aubrey_Maturin_by_Patrick_O'Brian_(21-TXTs).tar.L17.LZSSE2
10/02/2016 08:55 PM 5,031,882 The_complete_Aubrey_Maturin_by_Patrick_O'Brian_(21-TXTs).tar.Nakamichi
10/02/2016 08:55 PM 2,556,494 The_Project_Gutenberg_12_Fairy_Books_by_Andrew_Lang.tar.L17.LZSSE2
10/02/2016 08:55 PM 2,540,805 The_Project_Gutenberg_12_Fairy_Books_by_Andrew_Lang.tar.Nakamichi
10/02/2016 08:55 PM 348 turbobench_singlefile_noNakamichi_2G.bat
10/02/2016 08:55 PM 9,129,173 turbobenchs.exe
10/02/2016 08:55 PM 1,142,536 University_of_Canterbury_The_Calgary_Corpus.tar.L17.LZSSE2
10/02/2016 08:55 PM 1,311,813 University_of_Canterbury_The_Calgary_Corpus.tar.Nakamichi
10/02/2016 08:55 PM 2,152,105 Word-list_584879_words_Russian_Spell-Check.txt.L17.LZSSE2
10/02/2016 08:55 PM 2,004,811 Word-list_584879_words_Russian_Spell-Check.txt.Nakamichi
10/02/2016 08:55 PM 1,297,189 www.ncbi.nlm.nih.gov_(Ladona_fulva_-_whole_genome_shotgun_sequence)_sequence.fasta.txt.L17.LZSSE2
10/02/2016 08:55 PM 1,456,466 www.ncbi.nlm.nih.gov_(Ladona_fulva_-_whole_genome_shotgun_sequence)_sequence.fasta.txt.Nakamichi
D:\LZ5_v2beta_VS_LZSSE2_VS_Zato>
And the actual console results on i5-2430M @3.00GHz, RAM @666MHz:
D:\LZ5_v2beta_VS_LZSSE2_VS_Zato>turbobenchs.exe Large_traffic_log_file_of_a_popular_website_fp.log -ezlib,9/libdeflate,9/xpack,9/fastlz,2/lzturbo,19,29,39/bzip2/chameleon,2/snappy_c/zstd,12,22/density,3/lz4,16/lz5,15/lzham,4/brieflz/brotli,11/crush,2/lzma,9/zpaq,2,5/lzf/yappy/trle/memcpy/lzsse2,1,17 -g -k0 -J13 -B2G
TurboBench: - Sun Oct 02 19:12:09 2016
C Size ratio% C MB/s D MB/s Name File
411108 2.0 0.36 0.36 zpaq 5 Large_traffic_log_file_of_a_popular_website_fp.log.tbb
709242 3.4 1.00 403.91 lzma 9 Large_traffic_log_file_of_a_popular_website_fp.log.tbb
723419 3.5 5.45 49.40 bzip2 Large_traffic_log_file_of_a_popular_website_fp.log.tbb
742667 3.6 0.24 793.82 brotli 11 Large_traffic_log_file_of_a_popular_website_fp.log.tbb
745809 3.6 0.76 2184.24 lzturbo 39 Large_traffic_log_file_of_a_popular_website_fp.log.tbb
801029 3.9 1.21 1750.18 zstd 22 Large_traffic_log_file_of_a_popular_website_fp.log.tbb
872740 4.2 1.39 735.04 lzham 4 Large_traffic_log_file_of_a_popular_website_fp.log.tbb
970589 4.7 6.37 1603.19 xpack 9 Large_traffic_log_file_of_a_popular_website_fp.log.tbb
1010821 4.9 48.77 1718.66 zstd 12 Large_traffic_log_file_of_a_popular_website_fp.log.tbb
1064459 5.2 0.87 3725.53 lzturbo 29 Large_traffic_log_file_of_a_popular_website_fp.log.tbb
1084431 5.3 1.23 2447.71 lz5 15 Large_traffic_log_file_of_a_popular_website_fp.log.tbb
1085963 5.3 7.57 121.05 zpaq 2 Large_traffic_log_file_of_a_popular_website_fp.log.tbb
1143618 5.5 0.94 1043.22 crush 2 Large_traffic_log_file_of_a_popular_website_fp.log.tbb
1178879 3420.8 lz5-2.0_beta 18 ! Outside TurboBench !
1333117 6.5 41.81 637.39 zlib 9 Large_traffic_log_file_of_a_popular_website_fp.log.tbb
1408548 6.8 18.63 1386.39 libdeflate 9 Large_traffic_log_file_of_a_popular_website_fp.log.tbb
1554934 7.5 1.12 5195.83 lzturbo 19 Large_traffic_log_file_of_a_popular_website_fp.log.tbb
1561495 4302.4 lz5-2.0_beta 9 ! Outside TurboBench !
1567022 7.6 34.31 3805.99 lz4 16 Large_traffic_log_file_of_a_popular_website_fp.log.tbb
1724307 8.4 257.46 603.83 brieflz Large_traffic_log_file_of_a_popular_website_fp.log.tbb
1768505 4416 LZSSE2 17 SSE4.1! Outside TurboBench !
1768505 4672 LZSSE2 17 AVX ! Outside TurboBench !
1768509 8.6 2.96 4414.79 lzsse2 17 Large_traffic_log_file_of_a_popular_website_fp.log.tbb
1939991 9.4 445.99 339.39 density 3 Large_traffic_log_file_of_a_popular_website_fp.log.tbb
1990428 2560 Nakamichi-Zato ! Outside TurboBench !
2041871 9.9 11.78 3969.40 lzsse2 1 Large_traffic_log_file_of_a_popular_website_fp.log.tbb
2458195 11.9 513.22 935.48 fastlz 2 Large_traffic_log_file_of_a_popular_website_fp.log.tbb
2754356 13.4 971.13 1760.19 snappy_c Large_traffic_log_file_of_a_popular_website_fp.log.tbb
2806326 13.6 528.68 944.44 lzf Large_traffic_log_file_of_a_popular_website_fp.log.tbb
3016983 14.6 143.55 3652.92 yappy Large_traffic_log_file_of_a_popular_website_fp.log.tbb
11053474 53.6 1203.35 2929.39 chameleon 2 Large_traffic_log_file_of_a_popular_website_fp.log.tbb
20511136 99.5 143.57 1228.89 trle Large_traffic_log_file_of_a_popular_website_fp.log.tbb
20617075 100.0 6159.87 5509.64 memcpy Large_traffic_log_file_of_a_popular_website_fp.log.tbb
D:\LZ5_v2beta_VS_LZSSE2_VS_Zato>turbobenchs.exe Word-list_584879_words_Russian_Spell-Check.txt -ezlib,9/libdeflate,9/xpack,9/fastlz,2/lzturbo,19,29,39/bzip2/chameleon,2/snappy_c/zstd,12,22/density,3/lz4,16/lz5,15/lzham,4/brieflz/brotli,11/crush,2/lzma,9/zpaq,2,5/lzf/yappy/trle/memcpy/lzsse2,1,17 -g -k0 -J13 -B2G
TurboBench: - Sun Oct 02 19:17:03 2016
C Size ratio% C MB/s D MB/s Name File
395907 5.7 0.27 0.27 zpaq 5 Word-list_584879_words_Russian_Spell-Check.txt.tbb
961241 13.7 1.36 81.69 lzma 9 Word-list_584879_words_Russian_Spell-Check.txt.tbb
972129 13.9 0.30 282.44 brotli 11 Word-list_584879_words_Russian_Spell-Check.txt.tbb
1038938 14.8 2.50 552.26 lzturbo 39 Word-list_584879_words_Russian_Spell-Check.txt.tbb
1053174 15.0 0.93 462.60 zstd 22 Word-list_584879_words_Russian_Spell-Check.txt.tbb
1068797 15.3 1.09 133.01 lzham 4 Word-list_584879_words_Russian_Spell-Check.txt.tbb
1134768 16.2 12.76 498.47 libdeflate 9 Word-list_584879_words_Russian_Spell-Check.txt.tbb
1331729 19.0 15.38 501.86 zstd 12 Word-list_584879_words_Russian_Spell-Check.txt.tbb
1384453 19.8 2.75 492.78 xpack 9 Word-list_584879_words_Russian_Spell-Check.txt.tbb
1410045 20.1 1.64 283.05 zlib 9 Word-list_584879_words_Russian_Spell-Check.txt.tbb
1647224 23.5 13.32 34.23 bzip2 Word-list_584879_words_Russian_Spell-Check.txt.tbb
1818611 26.0 0.12 254.46 crush 2 Word-list_584879_words_Russian_Spell-Check.txt.tbb
1884914 26.9 5.18 64.44 zpaq 2 Word-list_584879_words_Russian_Spell-Check.txt.tbb
1958090 28.0 139.17 211.29 brieflz Word-list_584879_words_Russian_Spell-Check.txt.tbb
1958925 28.0 2.67 951.28 lzturbo 29 Word-list_584879_words_Russian_Spell-Check.txt.tbb
1959563 28.0 0.83 828.85 lz5 15 Word-list_584879_words_Russian_Spell-Check.txt.tbb
2004811 832 Nakamichi-Zato ! Outside TurboBench !
2073997 1399.8 lz5-2.0_beta 18 ! Outside TurboBench !
2109594 30.1 70.40 1957.07 yappy Word-list_584879_words_Russian_Spell-Check.txt.tbb
2152105 1664 LZSSE2 17 SSE4.1! Outside TurboBench !
2152105 1664 LZSSE2 17 AVX ! Outside TurboBench !
2152109 30.7 8.05 1716.22 lzsse2 17 Word-list_584879_words_Russian_Spell-Check.txt.tbb
2236063 31.9 16.07 1530.82 lzsse2 1 Word-list_584879_words_Russian_Spell-Check.txt.tbb
2339944 33.4 3.23 1229.66 lzturbo 19 Word-list_584879_words_Russian_Spell-Check.txt.tbb
2346546 1547.4 lz5-2.0_beta 9 ! Outside TurboBench !
2363922 33.8 6.91 1595.00 lz4 16 Word-list_584879_words_Russian_Spell-Check.txt.tbb
2422149 34.6 281.36 480.54 lzf Word-list_584879_words_Russian_Spell-Check.txt.tbb
2445093 34.9 287.86 387.69 fastlz 2 Word-list_584879_words_Russian_Spell-Check.txt.tbb
2449587 35.0 373.98 915.45 snappy_c Word-list_584879_words_Russian_Spell-Check.txt.tbb
2536517 36.2 277.47 248.53 density 3 Word-list_584879_words_Russian_Spell-Check.txt.tbb
3888621 55.5 1169.47 2460.62 chameleon 2 Word-list_584879_words_Russian_Spell-Check.txt.tbb
7000457 100.0 137.35 5672.98 trle Word-list_584879_words_Russian_Spell-Check.txt.tbb
7000457 100.0 6346.74 5595.89 memcpy Word-list_584879_words_Russian_Spell-Check.txt.tbb
D:\LZ5_v2beta_VS_LZSSE2_VS_Zato>turbobenchs.exe Agatha_Christie_85-ebooks_(French)_TXT.tar -ezlib,9/libdeflate,9/xpack,9/fastlz,2/lzturbo,19,29,39/bzip2/chameleon,2/snappy_c/zstd,12,22/density,3/lz4,16/lz5,15/lzham,4/brieflz/brotli,11/crush,2/lzma,9/zpaq,2,5/lzf/yappy/trle/memcpy/lzsse2,1,17 -g -k0 -J13 -B2G
TurboBench: - Sun Oct 02 14:13:46 2016
C Size ratio% C MB/s D MB/s Name File
5639052 17.6 0.30 0.30 zpaq 5 Agatha_Christie_85-ebooks_(French)_TXT.tar.tbb
6739693 21.1 0.95 81.88 lzma 9 Agatha_Christie_85-ebooks_(French)_TXT.tar.tbb
6758120 21.1 0.79 166.72 lzham 4 Agatha_Christie_85-ebooks_(French)_TXT.tar.tbb
6797247 21.2 0.92 389.67 lzturbo 39 Agatha_Christie_85-ebooks_(French)_TXT.tar.tbb
6802328 21.3 1.10 301.01 zstd 22 Agatha_Christie_85-ebooks_(French)_TXT.tar.tbb
6910154 21.6 0.37 245.03 brotli 11 Agatha_Christie_85-ebooks_(French)_TXT.tar.tbb
7680438 24.0 9.49 20.61 bzip2 Agatha_Christie_85-ebooks_(French)_TXT.tar.tbb
8367282 26.1 0.61 355.33 xpack 9 Agatha_Christie_85-ebooks_(French)_TXT.tar.tbb
8897625 27.8 3.28 58.95 zpaq 2 Agatha_Christie_85-ebooks_(French)_TXT.tar.tbb
8965799 28.0 4.68 499.64 zstd 12 Agatha_Christie_85-ebooks_(French)_TXT.tar.tbb
8990951 28.1 0.93 610.22 lzturbo 29 Agatha_Christie_85-ebooks_(French)_TXT.tar.tbb
9147309 28.6 0.12 263.86 crush 2 Agatha_Christie_85-ebooks_(French)_TXT.tar.tbb
9332360 769.3 lz5-2.0_beta 18 ! Outside TurboBench !
9803106 960 Nakamichi-Zato ! Outside TurboBench !
10107487 31.6 1.30 396.87 lz5 15 Agatha_Christie_85-ebooks_(French)_TXT.tar.tbb
10460666 32.7 6.97 454.65 libdeflate 9 Agatha_Christie_85-ebooks_(French)_TXT.tar.tbb
10687517 2176 LZSSE2 17 SSE4.1! Outside TurboBench !
10687517 2304 LZSSE2 17 AVX ! Outside TurboBench !
10687521 33.4 2.07 2267.44 lzsse2 17 Agatha_Christie_85-ebooks_(French)_TXT.tar.tbb
10973383 34.3 10.73 232.96 zlib 9 Agatha_Christie_85-ebooks_(French)_TXT.tar.tbb
12107435 37.8 1.01 2658.62 lzturbo 19 Agatha_Christie_85-ebooks_(French)_TXT.tar.tbb
12132016 1840.8 lz5-2.0_beta 9 ! Outside TurboBench !
12266943 38.3 16.35 1897.96 lz4 16 Agatha_Christie_85-ebooks_(French)_TXT.tar.tbb
13238993 41.4 83.58 154.50 brieflz Agatha_Christie_85-ebooks_(French)_TXT.tar.tbb
14364428 44.9 283.27 251.05 density 3 Agatha_Christie_85-ebooks_(French)_TXT.tar.tbb
15448533 48.3 12.31 1691.80 lzsse2 1 Agatha_Christie_85-ebooks_(French)_TXT.tar.tbb
17262978 53.9 61.89 1265.41 yappy Agatha_Christie_85-ebooks_(French)_TXT.tar.tbb
17678955 55.2 178.84 361.43 lzf Agatha_Christie_85-ebooks_(French)_TXT.tar.tbb
17868118 55.8 182.69 313.48 fastlz 2 Agatha_Christie_85-ebooks_(French)_TXT.tar.tbb
17915390 56.0 1049.93 2004.08 chameleon 2 Agatha_Christie_85-ebooks_(French)_TXT.tar.tbb
18694206 58.4 222.62 644.77 snappy_c Agatha_Christie_85-ebooks_(French)_TXT.tar.tbb
31952980 99.8 148.95 1323.10 trle Agatha_Christie_85-ebooks_(French)_TXT.tar.tbb
32007172 100.0 6225.86 5379.36 memcpy Agatha_Christie_85-ebooks_(French)_TXT.tar.tbb
D:\LZ5_v2beta_VS_LZSSE2_VS_Zato>turbobenchs.exe Agatha_Christie_89-ebooks_TXT.tar -ezlib,9/libdeflate,9/xpack,9/fastlz,2/lzturbo,19,29,39/bzip2/chameleon,2/snappy_c/zstd,12,22/density,3/lz4,16/lz5,15/lzham,4/brieflz/brotli,11/crush,2/lzma,9/zpaq,2,5/lzf/yappy/trle/memcpy/lzsse2,1,17 -g -k0 -J13 -B2G
TurboBench: - Sun Oct 02 14:31:39 2016
C Size ratio% C MB/s D MB/s Name File
6267713 18.8 0.31 0.31 zpaq 5 Agatha_Christie_89-ebooks_TXT.tar.tbb
7881393 23.7 0.94 72.93 lzma 9 Agatha_Christie_89-ebooks_TXT.tar.tbb
7917303 23.8 0.79 147.72 lzham 4 Agatha_Christie_89-ebooks_TXT.tar.tbb
7963999 23.9 1.04 260.59 zstd 22 Agatha_Christie_89-ebooks_TXT.tar.tbb
7973327 24.0 0.89 348.96 lzturbo 39 Agatha_Christie_89-ebooks_TXT.tar.tbb
8014306 24.1 0.35 218.91 brotli 11 Agatha_Christie_89-ebooks_TXT.tar.tbb
8416486 25.3 10.01 21.03 bzip2 Agatha_Christie_89-ebooks_TXT.tar.tbb
9595005 28.8 0.55 319.11 xpack 9 Agatha_Christie_89-ebooks_TXT.tar.tbb
9851022 29.6 4.71 471.32 zstd 12 Agatha_Christie_89-ebooks_TXT.tar.tbb
9926145 29.8 3.03 56.95 zpaq 2 Agatha_Christie_89-ebooks_TXT.tar.tbb
10076254 30.3 0.14 247.08 crush 2 Agatha_Christie_89-ebooks_TXT.tar.tbb
10334621 31.1 0.89 567.62 lzturbo 29 Agatha_Christie_89-ebooks_TXT.tar.tbb
11133495 774.0 lz5-2.0_beta 18 ! Outside TurboBench !
11145205 33.5 1.33 386.04 lz5 15 Agatha_Christie_89-ebooks_TXT.tar.tbb
11175291 33.6 7.26 437.57 libdeflate 9 Agatha_Christie_89-ebooks_TXT.tar.tbb
11441644 960 Nakamichi-Zato ! Outside TurboBench !
11649537 2112 LZSSE2 17 SSE4.1! Outside TurboBench !
11649537 2240 LZSSE2 17 AVX ! Outside TurboBench !
11649541 35.0 4.65 2172.48 lzsse2 17 Agatha_Christie_89-ebooks_TXT.tar.tbb
11716396 35.2 10.54 226.92 zlib 9 Agatha_Christie_89-ebooks_TXT.tar.tbb
13165738 39.6 1.04 2570.80 lzturbo 19 Agatha_Christie_89-ebooks_TXT.tar.tbb
13194355 1813.8 lz5-2.0_beta 9 ! Outside TurboBench !
13327732 40.1 16.41 1870.35 lz4 16 Agatha_Christie_89-ebooks_TXT.tar.tbb
14305207 43.0 77.90 148.64 brieflz Agatha_Christie_89-ebooks_TXT.tar.tbb
15146404 45.5 277.03 245.52 density 3 Agatha_Christie_89-ebooks_TXT.tar.tbb
15890698 47.8 12.23 1702.86 lzsse2 1 Agatha_Christie_89-ebooks_TXT.tar.tbb
18054497 54.3 61.85 1292.14 yappy Agatha_Christie_89-ebooks_TXT.tar.tbb
18191878 54.7 176.19 357.75 lzf Agatha_Christie_89-ebooks_TXT.tar.tbb
18478571 55.6 180.34 307.93 fastlz 2 Agatha_Christie_89-ebooks_TXT.tar.tbb
18773896 56.4 1103.36 1976.50 chameleon 2 Agatha_Christie_89-ebooks_TXT.tar.tbb
19377968 58.3 245.84 647.92 snappy_c Agatha_Christie_89-ebooks_TXT.tar.tbb
33156061 99.7 149.02 1321.56 trle Agatha_Christie_89-ebooks_TXT.tar.tbb
33258500 100.0 6312.11 5575.61 memcpy Agatha_Christie_89-ebooks_TXT.tar.tbb
D:\LZ5_v2beta_VS_LZSSE2_VS_Zato>turbobenchs.exe Arabian_Nights_complete.html -ezlib,9/libdeflate,9/xpack,9/fastlz,2/lzturbo,19,29,39/bzip2/chameleon,2/snappy_c/zstd,12,22/density,3/lz4,16/lz5,15/lzham,4/brieflz/brotli,11/crush,2/lzma,9/zpaq,2,5/lzf/yappy/trle/memcpy/lzsse2,1,17 -g -k0 -J13 -B2G
TurboBench: - Sun Oct 02 14:40:27 2016
C Size ratio% C MB/s D MB/s Name File
2975964 19.1 0.30 0.30 zpaq 5 Arabian_Nights_complete.html.tbb
3892786 25.0 1.05 68.74 lzma 9 Arabian_Nights_complete.html.tbb
3913051 25.1 0.34 212.05 brotli 11 Arabian_Nights_complete.html.tbb
3961082 25.4 0.89 145.14 lzham 4 Arabian_Nights_complete.html.tbb
3988669 25.6 1.05 299.58 zstd 22 Arabian_Nights_complete.html.tbb
3992884 25.6 1.04 385.67 lzturbo 39 Arabian_Nights_complete.html.tbb
4038902 25.9 10.07 21.41 bzip2 Arabian_Nights_complete.html.tbb
4589061 29.4 0.64 324.11 xpack 9 Arabian_Nights_complete.html.tbb
4620802 29.7 5.18 464.37 zstd 12 Arabian_Nights_complete.html.tbb
4724482 30.3 3.02 56.53 zpaq 2 Arabian_Nights_complete.html.tbb
4757444 30.5 0.16 243.38 crush 2 Arabian_Nights_complete.html.tbb
5035317 32.3 1.05 635.15 lzturbo 29 Arabian_Nights_complete.html.tbb
5223100 33.5 1.03 409.66 lz5 15 Arabian_Nights_complete.html.tbb
5259086 33.7 7.66 416.98 libdeflate 9 Arabian_Nights_complete.html.tbb
5478319 35.2 9.98 223.95 zlib 9 Arabian_Nights_complete.html.tbb
5509438 928.2 lz5-2.0_beta 18 ! Outside TurboBench !
5524854 2048 LZSSE2 17 SSE4.1! Outside TurboBench !
5524854 2240 LZSSE2 17 AVX ! Outside TurboBench !
5524858 35.5 5.26 2108.15 lzsse2 17 Arabian_Nights_complete.html.tbb
5660839 960 Nakamichi-Zato ! Outside TurboBench !
6183326 39.7 1.23 2527.32 lzturbo 19 Arabian_Nights_complete.html.tbb
6185910 1814.8 lz5-2.0_beta 9 ! Outside TurboBench !
6258303 40.2 15.74 1815.83 lz4 16 Arabian_Nights_complete.html.tbb
6740391 43.3 79.89 150.83 brieflz Arabian_Nights_complete.html.tbb
7101428 45.6 250.89 227.77 density 3 Arabian_Nights_complete.html.tbb
7294087 46.8 12.03 1700.32 lzsse2 1 Arabian_Nights_complete.html.tbb
8585442 55.1 168.81 356.18 lzf Arabian_Nights_complete.html.tbb
8613199 55.3 179.31 313.49 fastlz 2 Arabian_Nights_complete.html.tbb
8630338 55.4 62.13 1302.20 yappy Arabian_Nights_complete.html.tbb
9027159 57.9 247.54 632.03 snappy_c Arabian_Nights_complete.html.tbb
9049558 58.1 1093.34 1864.05 chameleon 2 Arabian_Nights_complete.html.tbb
15580578 100.0 144.65 1319.96 trle Arabian_Nights_complete.html.tbb
15583444 100.0 6495.81 5477.48 memcpy Arabian_Nights_complete.html.tbb
D:\LZ5_v2beta_VS_LZSSE2_VS_Zato>turbobenchs.exe Blacklegs_Card_Sharps_and_Confidence_Men.pdf -ezlib,9/libdeflate,9/xpack,9/fastlz,2/lzturbo,19,29,39/bzip2/chameleon,2/snappy_c/zstd,12,22/density,3/lz4,16/lz5,15/lzham,4/brieflz/brotli,11/crush,2/lzma,9/zpaq,2,5/lzf/yappy/trle/memcpy/lzsse2,1,17 -g -k0 -J13 -B2G
TurboBench: - Sun Oct 02 14:42:24 2016
C Size ratio% C MB/s D MB/s Name File
1433545 91.5 0.22 0.22 zpaq 5 Blacklegs_Card_Sharps_and_Confidence_Men.pdf.tbb
1437059 91.7 0.29 107.33 brotli 11 Blacklegs_Card_Sharps_and_Confidence_Men.pdf.tbb
1443674 92.2 3.83 2782.02 lzturbo 39 Blacklegs_Card_Sharps_and_Confidence_Men.pdf.tbb
1445273 92.3 4.97 92.01 lzham 4 Blacklegs_Card_Sharps_and_Confidence_Men.pdf.tbb
1447307 92.4 5.42 3361.11 zstd 22 Blacklegs_Card_Sharps_and_Confidence_Men.pdf.tbb
1448653 92.5 1.91 409.16 xpack 9 Blacklegs_Card_Sharps_and_Confidence_Men.pdf.tbb
1449223 92.5 4.37 6166.44 lzturbo 29 Blacklegs_Card_Sharps_and_Confidence_Men.pdf.tbb
1450837 92.6 34.31 4437.05 zstd 12 Blacklegs_Card_Sharps_and_Confidence_Men.pdf.tbb
1452139 92.7 23.39 286.44 libdeflate 9 Blacklegs_Card_Sharps_and_Confidence_Men.pdf.tbb
1452300 92.7 4.95 37.43 zpaq 2 Blacklegs_Card_Sharps_and_Confidence_Men.pdf.tbb
1454011 92.8 2.84 3975.32 lz5 15 Blacklegs_Card_Sharps_and_Confidence_Men.pdf.tbb
1454076 92.8 3.64 17.07 lzma 9 Blacklegs_Card_Sharps_and_Confidence_Men.pdf.tbb
1454251 7285.0 lz5-2.0_beta 18 ! Outside TurboBench !
1455523 92.9 4.85 7530.18 lzturbo 19 Blacklegs_Card_Sharps_and_Confidence_Men.pdf.tbb
1456105 93.0 25.75 234.33 zlib 9 Blacklegs_Card_Sharps_and_Confidence_Men.pdf.tbb
1458737 7950.6 lz5-2.0_beta 9 ! Outside TurboBench !
1458993 93.2 6.00 11.92 bzip2 Blacklegs_Card_Sharps_and_Confidence_Men.pdf.tbb
1459844 93.2 34.26 6190.82 lz4 16 Blacklegs_Card_Sharps_and_Confidence_Men.pdf.tbb
1474902 94.2 1857.98 4819.31 snappy_c Blacklegs_Card_Sharps_and_Confidence_Men.pdf.tbb
1513157 96.6 333.89 317.19 density 3 Blacklegs_Card_Sharps_and_Confidence_Men.pdf.tbb
1513539 96.6 256.01 1596.61 fastlz 2 Blacklegs_Card_Sharps_and_Confidence_Men.pdf.tbb
1515421 96.8 165.74 1687.80 lzf Blacklegs_Card_Sharps_and_Confidence_Men.pdf.tbb
1528008 97.6 58.24 5844.32 yappy Blacklegs_Card_Sharps_and_Confidence_Men.pdf.tbb
1552936 2944 Nakamichi-Zato ! Outside TurboBench !
1559959 99.6 988.81 1220.79 chameleon 2 Blacklegs_Card_Sharps_and_Confidence_Men.pdf.tbb
1566281 100.0 165.01 7677.83 trle Blacklegs_Card_Sharps_and_Confidence_Men.pdf.tbb
1566277 95552 LZSSE2 17 SSE4.1! Outside TurboBench !
1566277 95552 LZSSE2 17 AVX ! Outside TurboBench !
1566281 100.0 13.58 7677.83 lzsse2 17 Blacklegs_Card_Sharps_and_Confidence_Men.pdf.tbb
1566281 100.0 16.82 7640.38 lzsse2 1 Blacklegs_Card_Sharps_and_Confidence_Men.pdf.tbb
1566281 100.0 7458.46 4789.84 memcpy Blacklegs_Card_Sharps_and_Confidence_Men.pdf.tbb
1617666 103.3 9.15 181.96 crush 2 Blacklegs_Card_Sharps_and_Confidence_Men.pdf.tbb
1634540 104.4 99.78 634.89 brieflz Blacklegs_Card_Sharps_and_Confidence_Men.pdf.tbb
D:\LZ5_v2beta_VS_LZSSE2_VS_Zato>turbobenchs.exe Complete_Works_of_Fyodor_Dostoyevsky.txt -ezlib,9/libdeflate,9/xpack,9/fastlz,2/lzturbo,19,29,39/bzip2/chameleon,2/snappy_c/zstd,12,22/density,3/lz4,16/lz5,15/lzham,4/brieflz/brotli,11/crush,2/lzma,9/zpaq,2,5/lzf/yappy/trle/memcpy/lzsse2,1,17 -g -k0 -J13 -B2G
TurboBench: - Sun Oct 02 14:50:16 2016
C Size ratio% C MB/s D MB/s Name File
2650827 19.3 0.31 0.31 zpaq 5 Complete_Works_of_Fyodor_Dostoyevsky.txt.tbb
3470856 25.3 10.08 20.71 bzip2 Complete_Works_of_Fyodor_Dostoyevsky.txt.tbb
3474265 25.3 1.08 70.01 lzma 9 Complete_Works_of_Fyodor_Dostoyevsky.txt.tbb
3488656 25.4 0.36 227.95 brotli 11 Complete_Works_of_Fyodor_Dostoyevsky.txt.tbb
3490560 25.5 0.92 147.68 lzham 4 Complete_Works_of_Fyodor_Dostoyevsky.txt.tbb
3502860 25.5 1.25 314.05 zstd 22 Complete_Works_of_Fyodor_Dostoyevsky.txt.tbb
3512645 25.6 1.03 396.60 lzturbo 39 Complete_Works_of_Fyodor_Dostoyevsky.txt.tbb
4097920 29.9 4.59 469.52 zstd 12 Complete_Works_of_Fyodor_Dostoyevsky.txt.tbb
4104258 29.9 0.62 342.84 xpack 9 Complete_Works_of_Fyodor_Dostoyevsky.txt.tbb
4203354 30.7 0.13 246.45 crush 2 Complete_Works_of_Fyodor_Dostoyevsky.txt.tbb
4211285 30.7 3.03 56.49 zpaq 2 Complete_Works_of_Fyodor_Dostoyevsky.txt.tbb
4555584 33.2 1.07 615.66 lzturbo 29 Complete_Works_of_Fyodor_Dostoyevsky.txt.tbb
4618517 33.7 7.25 437.03 libdeflate 9 Complete_Works_of_Fyodor_Dostoyevsky.txt.tbb
4697463 34.3 1.38 420.74 lz5 15 Complete_Works_of_Fyodor_Dostoyevsky.txt.tbb
4840938 2112 LZSSE2 17 SSE4.1! Outside TurboBench !
4840938 2176 LZSSE2 17 AVX ! Outside TurboBench !
4840942 35.3 4.71 2161.27 lzsse2 17 Complete_Works_of_Fyodor_Dostoyevsky.txt.tbb
4852707 35.4 10.44 227.07 zlib 9 Complete_Works_of_Fyodor_Dostoyevsky.txt.tbb
4859306 960 Nakamichi-Zato ! Outside TurboBench !
4885062 867.2 lz5-2.0_beta 18 ! Outside TurboBench !
5488915 40.0 1.26 2532.93 lzturbo 19 Complete_Works_of_Fyodor_Dostoyevsky.txt.tbb
5491134 1805 lz5-2.0_beta 9 ! Outside TurboBench !
5554582 40.5 15.92 1845.41 lz4 16 Complete_Works_of_Fyodor_Dostoyevsky.txt.tbb
5944346 43.3 74.60 147.71 brieflz Complete_Works_of_Fyodor_Dostoyevsky.txt.tbb
6378991 46.5 273.52 243.70 density 3 Complete_Works_of_Fyodor_Dostoyevsky.txt.tbb
6664446 48.6 12.22 1679.31 lzsse2 1 Complete_Works_of_Fyodor_Dostoyevsky.txt.tbb
7434625 54.2 62.38 1279.70 yappy Complete_Works_of_Fyodor_Dostoyevsky.txt.tbb
7557433 55.1 168.58 358.05 lzf Complete_Works_of_Fyodor_Dostoyevsky.txt.tbb
7662064 55.9 176.15 307.64 fastlz 2 Complete_Works_of_Fyodor_Dostoyevsky.txt.tbb
7741282 56.5 1025.52 1966.62 chameleon 2 Complete_Works_of_Fyodor_Dostoyevsky.txt.tbb
8028636 58.5 246.64 629.16 snappy_c Complete_Works_of_Fyodor_Dostoyevsky.txt.tbb
13704843 99.9 144.97 1312.28 trle Complete_Works_of_Fyodor_Dostoyevsky.txt.tbb
13713279 100.0 6624.77 6086.67 memcpy Complete_Works_of_Fyodor_Dostoyevsky.txt.tbb
D:\LZ5_v2beta_VS_LZSSE2_VS_Zato>turbobenchs.exe Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar -ezlib,9/libdeflate,9/xpack,9/fastlz,2/lzturbo,19,29,39/bzip2/chameleon,2/snappy_c/zstd,12,22/density,3/lz4,16/lz5,15/lzham,4/brieflz/brotli,11/crush,2/lzma,9/zpaq,2,5/lzf/yappy/trle/memcpy/lzsse2,1,17 -g -k0 -J13 -B2G
TurboBench: - Sun Oct 02 15:16:32 2016
C Size ratio% C MB/s D MB/s Name File
5881208 14.6 0.34 0.34 zpaq 5 Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar.tbb
6942121 17.2 0.92 96.16 lzma 9 Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar.tbb
6996681 17.4 0.77 198.87 lzham 4 Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar.tbb
7028270 17.4 0.80 437.34 lzturbo 39 Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar.tbb
7055102 17.5 1.08 355.74 zstd 22 Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar.tbb
7110795 17.6 0.33 297.52 brotli 11 Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar.tbb
7125187 17.7 9.43 23.06 bzip2 Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar.tbb
8984648 22.3 3.62 67.43 zpaq 2 Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar.tbb
9221434 22.9 1.14 510.86 xpack 9 Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar.tbb
9253662 874.7 lz5-2.0_beta 18 ! Outside TurboBench !
9263242 23.0 0.06 318.59 crush 2 Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar.tbb
9298174 23.1 7.08 588.24 zstd 12 Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar.tbb
9491604 23.6 0.80 710.56 lzturbo 29 Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar.tbb
9730008 896 Nakamichi-Zato ! Outside TurboBench !
10048812 24.9 1.35 555.35 lz5 15 Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar.tbb
10125158 25.1 5.37 605.01 libdeflate 9 Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar.tbb
10359314 2752 LZSSE2 17 SSE4.1! Outside TurboBench !
10359314 2880 LZSSE2 17 AVX ! Outside TurboBench !
10359318 25.7 4.28 2803.69 lzsse2 17 Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar.tbb
10771358 26.7 4.40 275.13 zlib 9 Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar.tbb
11806303 29.3 0.95 2915.87 lzturbo 19 Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar.tbb
11817690 1983.0 lz5-2.0_beta 9 ! Outside TurboBench !
12065538 29.9 8.37 1983.71 lz4 16 Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar.tbb
15196140 37.7 95.09 159.80 brieflz Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar.tbb
15278814 37.9 57.32 1675.18 yappy Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar.tbb
17802562 44.2 341.20 281.89 density 3 Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar.tbb
18298845 45.4 12.66 1793.96 lzsse2 1 Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar.tbb
19974577 49.6 280.56 718.80 snappy_c Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar.tbb
20525594 50.9 201.42 387.03 lzf Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar.tbb
20596670 51.1 209.58 340.90 fastlz 2 Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar.tbb
21693398 53.8 1168.54 2562.83 chameleon 2 Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar.tbb
40278350 99.9 150.33 1323.24 trle Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar.tbb
40303108 100.0 6211.95 5505.14 memcpy Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar.tbb
D:\LZ5_v2beta_VS_LZSSE2_VS_Zato>turbobenchs.exe Dictionary_of_Native_American_Mythology.tar -ezlib,9/libdeflate,9/xpack,9/fastlz,2/lzturbo,19,29,39/bzip2/chameleon,2/snappy_c/zstd,12,22/density,3/lz4,16/lz5,15/lzham,4/brieflz/brotli,11/crush,2/lzma,9/zpaq,2,5/lzf/yappy/trle/memcpy/lzsse2,1,17 -g -k0 -J13 -B2G
TurboBench: - Sun Oct 02 15:19:11 2016
C Size ratio% C MB/s D MB/s Name File
304124 10.4 0.33 0.33 zpaq 5 Dictionary_of_Native_American_Mythology.tar.tbb
419209 14.3 8.96 34.37 bzip2 Dictionary_of_Native_American_Mythology.tar.tbb
422997 14.4 0.46 399.98 brotli 11 Dictionary_of_Native_American_Mythology.tar.tbb
427665 14.6 1.34 111.56 lzma 9 Dictionary_of_Native_American_Mythology.tar.tbb
447293 15.3 1.60 828.00 zstd 22 Dictionary_of_Native_American_Mythology.tar.tbb
448088 15.3 1.60 1176.63 lzturbo 39 Dictionary_of_Native_American_Mythology.tar.tbb
451937 15.4 1.41 243.61 lzham 4 Dictionary_of_Native_American_Mythology.tar.tbb
489933 16.7 14.65 821.73 zstd 12 Dictionary_of_Native_American_Mythology.tar.tbb
492053 16.8 3.63 846.92 xpack 9 Dictionary_of_Native_American_Mythology.tar.tbb
513025 17.5 0.85 404.51 crush 2 Dictionary_of_Native_American_Mythology.tar.tbb
533603 18.2 6.45 82.20 zpaq 2 Dictionary_of_Native_American_Mythology.tar.tbb
563084 19.2 0.62 1046.32 lz5 15 Dictionary_of_Native_American_Mythology.tar.tbb
563974 19.3 1.81 1571.16 lzturbo 29 Dictionary_of_Native_American_Mythology.tar.tbb
617741 21.1 12.25 607.35 libdeflate 9 Dictionary_of_Native_American_Mythology.tar.tbb
617824 2122.2 lz5-2.0_beta 18 ! Outside TurboBench !
629521 21.5 23.63 319.20 zlib 9 Dictionary_of_Native_American_Mythology.tar.tbb
668060 2816 LZSSE2 17 SSE4.1! Outside TurboBench !
668060 3712 LZSSE2 17 AVX ! Outside TurboBench !
668064 22.8 1.82 2557.76 lzsse2 17 Dictionary_of_Native_American_Mythology.tar.tbb
705547 2655.2 lz5-2.0_beta 9 ! Outside TurboBench !
706652 24.1 2.12 3358.53 lzturbo 19 Dictionary_of_Native_American_Mythology.tar.tbb
709584 24.2 22.47 2418.36 lz4 16 Dictionary_of_Native_American_Mythology.tar.tbb
717938 1600 Nakamichi-Zato ! Outside TurboBench !
738627 25.2 111.96 246.60 brieflz Dictionary_of_Native_American_Mythology.tar.tbb
799115 27.3 13.67 2412.39 lzsse2 1 Dictionary_of_Native_American_Mythology.tar.tbb
885362 30.2 224.09 221.16 density 3 Dictionary_of_Native_American_Mythology.tar.tbb
977236 33.4 257.58 476.82 fastlz 2 Dictionary_of_Native_American_Mythology.tar.tbb
1055618 36.0 245.24 498.49 lzf Dictionary_of_Native_American_Mythology.tar.tbb
1064801 36.4 390.07 959.58 snappy_c Dictionary_of_Native_American_Mythology.tar.tbb
1364314 46.6 77.02 1847.72 yappy Dictionary_of_Native_American_Mythology.tar.tbb
1695276 57.9 1098.51 1914.14 chameleon 2 Dictionary_of_Native_American_Mythology.tar.tbb
2563763 87.5 167.14 1430.70 trle Dictionary_of_Native_American_Mythology.tar.tbb
2928644 100.0 7143.02 7666.60 memcpy Dictionary_of_Native_American_Mythology.tar.tbb
D:\LZ5_v2beta_VS_LZSSE2_VS_Zato>turbobenchs.exe Duden_Synonymworterbuch_(De-De).dsl -ezlib,9/libdeflate,9/xpack,9/fastlz,2/lzturbo,19,29,39/bzip2/chameleon,2/snappy_c/zstd,12,22/density,3/lz4,16/lz5,15/lzham,4/brieflz/brotli,11/crush,2/lzma,9/zpaq,2,5/lzf/yappy/trle/memcpy/lzsse2,1,17 -g -k0 -J13 -B2G
TurboBench: - Sun Oct 02 15:25:19 2016
C Size ratio% C MB/s D MB/s Name File
811958 7.2 0.37 0.38 zpaq 5 Duden_Synonymworterbuch_(De-De).dsl.tbb
1004261 8.9 1.18 166.17 lzma 9 Duden_Synonymworterbuch_(De-De).dsl.tbb
1068742 9.4 1.19 919.77 lzturbo 39 Duden_Synonymworterbuch_(De-De).dsl.tbb
1070058 9.4 1.00 353.88 lzham 4 Duden_Synonymworterbuch_(De-De).dsl.tbb
1081825 9.5 0.41 456.20 brotli 11 Duden_Synonymworterbuch_(De-De).dsl.tbb
1088298 9.6 1.25 716.11 zstd 22 Duden_Synonymworterbuch_(De-De).dsl.tbb
1147399 10.1 7.13 33.48 bzip2 Duden_Synonymworterbuch_(De-De).dsl.tbb
1335007 11.8 4.51 93.77 zpaq 2 Duden_Synonymworterbuch_(De-De).dsl.tbb
1420344 12.5 1.25 1430.67 lzturbo 29 Duden_Synonymworterbuch_(De-De).dsl.tbb
1424372 12.6 3.16 733.06 xpack 9 Duden_Synonymworterbuch_(De-De).dsl.tbb
1466311 12.9 15.76 823.66 zstd 12 Duden_Synonymworterbuch_(De-De).dsl.tbb
1485383 13.1 0.13 482.12 crush 2 Duden_Synonymworterbuch_(De-De).dsl.tbb
1489744 13.1 1.00 1011.44 lz5 15 Duden_Synonymworterbuch_(De-De).dsl.tbb
1493790 1467.7 lz5-2.0_beta 18 ! Outside TurboBench !
1610899 1472 Nakamichi-Zato ! Outside TurboBench !
1740676 15.4 8.44 822.53 libdeflate 9 Duden_Synonymworterbuch_(De-De).dsl.tbb
1744697 15.4 4.34 393.79 zlib 9 Duden_Synonymworterbuch_(De-De).dsl.tbb
1830701 3648 LZSSE2 17 SSE4.1! Outside TurboBench !
1830701 3648 LZSSE2 17 AVX ! Outside TurboBench !
1830705 16.2 3.28 3288.43 lzsse2 17 Duden_Synonymworterbuch_(De-De).dsl.tbb
2037204 18.0 1.59 2809.23 lzturbo 19 Duden_Synonymworterbuch_(De-De).dsl.tbb
2042405 2175.3 lz5-2.0_beta 9 ! Outside TurboBench !
2090628 18.4 11.50 1909.57 lz4 16 Duden_Synonymworterbuch_(De-De).dsl.tbb
2479859 21.9 92.42 2067.72 yappy Duden_Synonymworterbuch_(De-De).dsl.tbb
2588673 22.8 10.74 2962.68 lzsse2 1 Duden_Synonymworterbuch_(De-De).dsl.tbb
2605920 23.0 156.21 246.93 brieflz Duden_Synonymworterbuch_(De-De).dsl.tbb
3015462 26.6 317.64 271.72 density 3 Duden_Synonymworterbuch_(De-De).dsl.tbb
3040630 26.8 371.51 620.77 lzf Duden_Synonymworterbuch_(De-De).dsl.tbb
3049421 26.9 355.83 532.30 fastlz 2 Duden_Synonymworterbuch_(De-De).dsl.tbb
3233776 28.5 441.40 993.10 snappy_c Duden_Synonymworterbuch_(De-De).dsl.tbb
6029314 53.2 1216.62 3272.30 chameleon 2 Duden_Synonymworterbuch_(De-De).dsl.tbb
11335236 100.0 139.52 5470.67 trle Duden_Synonymworterbuch_(De-De).dsl.tbb
11335236 100.0 6339.62 5452.25 memcpy Duden_Synonymworterbuch_(De-De).dsl.tbb
D:\LZ5_v2beta_VS_LZSSE2_VS_Zato>turbobenchs.exe Encyclopedia_of_Pain_(3_Vol_Set).pdf.txt -ezlib,9/libdeflate,9/xpack,9/fastlz,2/lzturbo,19,29,39/bzip2/chameleon,2/snappy_c/zstd,12,22/density,3/lz4,16/lz5,15/lzham,4/brieflz/brotli,11/crush,2/lzma,9/zpaq,2,5/lzf/yappy/trle/memcpy/lzsse2,1,17 -g -k0 -J13 -B2G
TurboBench: - Sun Oct 02 15:31:51 2016
C Size ratio% C MB/s D MB/s Name File
2375112 18.4 0.30 0.30 zpaq 5 Encyclopedia_of_Pain_(3_Vol_Set).pdf.txt.tbb
3087799 23.9 0.36 234.26 brotli 11 Encyclopedia_of_Pain_(3_Vol_Set).pdf.txt.tbb
3102796 24.0 1.23 70.16 lzma 9 Encyclopedia_of_Pain_(3_Vol_Set).pdf.txt.tbb
3149792 24.4 1.00 152.52 lzham 4 Encyclopedia_of_Pain_(3_Vol_Set).pdf.txt.tbb
3163361 24.5 1.37 345.08 zstd 22 Encyclopedia_of_Pain_(3_Vol_Set).pdf.txt.tbb
3176170 24.6 1.07 437.88 lzturbo 39 Encyclopedia_of_Pain_(3_Vol_Set).pdf.txt.tbb
3423837 26.5 10.31 21.69 bzip2 Encyclopedia_of_Pain_(3_Vol_Set).pdf.txt.tbb
3610798 27.9 0.74 353.93 xpack 9 Encyclopedia_of_Pain_(3_Vol_Set).pdf.txt.tbb
3702916 28.6 6.20 479.15 zstd 12 Encyclopedia_of_Pain_(3_Vol_Set).pdf.txt.tbb
3726436 28.8 3.32 59.29 zpaq 2 Encyclopedia_of_Pain_(3_Vol_Set).pdf.txt.tbb
3795056 29.3 0.25 244.54 crush 2 Encyclopedia_of_Pain_(3_Vol_Set).pdf.txt.tbb
3999478 30.9 1.12 677.81 lzturbo 29 Encyclopedia_of_Pain_(3_Vol_Set).pdf.txt.tbb
4188499 32.4 1.51 436.06 lz5 15 Encyclopedia_of_Pain_(3_Vol_Set).pdf.txt.tbb
4327921 946.6 lz5-2.0_beta 18 ! Outside TurboBench !
4354767 33.7 8.04 417.97 libdeflate 9 Encyclopedia_of_Pain_(3_Vol_Set).pdf.txt.tbb
4521811 35.0 14.10 222.49 zlib 9 Encyclopedia_of_Pain_(3_Vol_Set).pdf.txt.tbb
4564126 896 Nakamichi-Zato ! Outside TurboBench !
4573102 2048 LZSSE2 17 SSE4.1! Outside TurboBench !
4573102 2240 LZSSE2 17 AVX ! Outside TurboBench !
4573106 35.4 5.89 2139.98 lzsse2 17 Encyclopedia_of_Pain_(3_Vol_Set).pdf.txt.tbb
5095655 39.4 1.32 2609.78 lzturbo 19 Encyclopedia_of_Pain_(3_Vol_Set).pdf.txt.tbb
5097610 1864.2 lz5-2.0_beta 9 ! Outside TurboBench !
5138931 39.7 21.52 1869.08 lz4 16 Encyclopedia_of_Pain_(3_Vol_Set).pdf.txt.tbb
5399037 41.7 80.69 153.48 brieflz Encyclopedia_of_Pain_(3_Vol_Set).pdf.txt.tbb
5762189 44.6 11.93 1790.43 lzsse2 1 Encyclopedia_of_Pain_(3_Vol_Set).pdf.txt.tbb
5929465 45.8 230.92 211.71 density 3 Encyclopedia_of_Pain_(3_Vol_Set).pdf.txt.tbb
6858738 53.0 64.45 1444.34 yappy Encyclopedia_of_Pain_(3_Vol_Set).pdf.txt.tbb
6989183 54.0 168.78 357.56 lzf Encyclopedia_of_Pain_(3_Vol_Set).pdf.txt.tbb
7078866 54.7 172.08 309.69 fastlz 2 Encyclopedia_of_Pain_(3_Vol_Set).pdf.txt.tbb
7285714 56.3 249.62 673.72 snappy_c Encyclopedia_of_Pain_(3_Vol_Set).pdf.txt.tbb
7713222 59.6 1018.75 1764.06 chameleon 2 Encyclopedia_of_Pain_(3_Vol_Set).pdf.txt.tbb
12928445 100.0 148.79 1311.90 trle Encyclopedia_of_Pain_(3_Vol_Set).pdf.txt.tbb
12934059 100.0 6387.19 5613.74 memcpy Encyclopedia_of_Pain_(3_Vol_Set).pdf.txt.tbb
D:\LZ5_v2beta_VS_LZSSE2_VS_Zato>turbobenchs.exe enwik8 -ezlib,9/libdeflate,9/xpack,9/fastlz,2/lzturbo,19,29,39/bzip2/chameleon,2/snappy_c/zstd,12,22/density,3/lz4,16/lz5,15/lzham,4/brieflz/brotli,11/crush,2/lzma,9/zpaq,2,5/lzf/yappy/trle/memcpy/lzsse2,1,17 -g -k0 -J13 -B2G
TurboBench: - Sun Oct 02 16:16:52 2016
C Size ratio% C MB/s D MB/s Name File
20596996 20.6 0.30 0.29 zpaq 5 enwik8.tbb
24763998 24.8 0.85 64.99 lzma 9 enwik8.tbb
25021508 25.0 0.71 127.88 lzham 4 enwik8.tbb
25390181 25.4 0.95 220.17 zstd 22 enwik8.tbb
25403540 25.4 0.79 301.23 lzturbo 39 enwik8.tbb
25743413 25.7 0.31 195.25 brotli 11 enwik8.tbb
29008762 29.0 10.20 21.06 bzip2 enwik8.tbb
30520879 30.5 0.44 245.40 xpack 9 enwik8.tbb
31056443 31.1 5.94 427.89 zstd 12 enwik8.tbb
31373273 31.4 0.81 549.03 lzturbo 29 enwik8.tbb
31699553 31.7 0.26 222.10 crush 2 enwik8.tbb
32073935 32.1 2.89 54.35 zpaq 2 enwik8.tbb
34427078 34.4 1.51 382.56 lz5 15 enwik8.tbb
35197151 35.2 8.78 375.05 libdeflate 9 enwik8.tbb
36475796 36.5 14.57 212.84 zlib 9 enwik8.tbb
36576568 822.0 lz5-2.0_beta 18 ! Outside TurboBench !
38063182 1856 LZSSE2 17 SSE4.1! Outside TurboBench !
38063182 1984 LZSSE2 17 AVX ! Outside TurboBench !
38063186 38.1 6.05 1981.30 lzsse2 17 enwik8.tbb
38261116 768 Nakamichi-Zato ! Outside TurboBench !
41924195 41.9 0.94 2443.32 lzturbo 19 enwik8.tbb
41956938 1809.8 lz5-2.0_beta 9 ! Outside TurboBench !
42196877 42.2 23.96 1802.61 lz4 16 enwik8.tbb
43196169 43.2 76.49 152.52 brieflz enwik8.tbb
45854489 45.9 11.65 1712.27 lzsse2 1 enwik8.tbb
47817696 47.8 218.21 205.05 density 3 enwik8.tbb
53844730 53.8 65.94 1450.22 yappy enwik8.tbb
53915996 53.9 177.09 358.29 lzf enwik8.tbb
54163017 54.2 173.58 311.66 fastlz 2 enwik8.tbb
56539849 56.5 249.67 631.71 snappy_c enwik8.tbb
61528422 61.5 1096.56 1661.82 chameleon 2 enwik8.tbb
99138398 99.1 147.45 1277.33 trle enwik8.tbb
100000004 100.0 6125.95 5728.36 memcpy enwik8.tbb
D:\LZ5_v2beta_VS_LZSSE2_VS_Zato>turbobenchs.exe Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt -ezlib,9/libdeflate,9/xpack,9/fastlz,2/lzturbo,19,29,39/bzip2/chameleon,2/snappy_c/zstd,12,22/density,3/lz4,16/lz5,15/lzham,4/brieflz/brotli,11/crush,2/lzma,9/zpaq,2,5/lzf/yappy/trle/memcpy/lzsse2,1,17 -g -k0 -J13 -B2G
TurboBench: - Sun Oct 02 16:17:59 2016
C Size ratio% C MB/s D MB/s Name File
263042 22.0 0.32 0.31 zpaq 5 Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.tbb
312058 26.1 10.06 20.84 bzip2 Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.tbb
337771 28.3 0.43 272.73 brotli 11 Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.tbb
343393 28.7 1.91 61.27 lzma 9 Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.tbb
346407 29.0 2.33 489.11 zstd 22 Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.tbb
347791 29.1 1.75 704.00 lzturbo 39 Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.tbb
354786 29.7 1.54 136.34 lzham 4 Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.tbb
376650 31.5 6.94 491.73 zstd 12 Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.tbb
380752 31.9 2.43 521.55 xpack 9 Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.tbb
396876 33.2 0.56 229.75 crush 2 Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.tbb
410524 34.3 7.00 425.26 libdeflate 9 Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.tbb
414525 34.7 4.81 59.35 zpaq 2 Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.tbb
432292 36.2 9.60 224.40 zlib 9 Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.tbb
433552 2176 LZSSE2 17 SSE4.1! Outside TurboBench !
433552 2176 LZSSE2 17 AVX ! Outside TurboBench !
433556 36.3 5.36 2127.04 lzsse2 17 Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.tbb
451898 37.8 2.11 643.72 lz5 15 Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.tbb
454747 38.0 1.80 862.48 lzturbo 29 Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.tbb
468913 1152 Nakamichi-Zato ! Outside TurboBench !
475502 1419.7 lz5-2.0_beta 18 ! Outside TurboBench !
489322 40.9 2.17 2565.23 lzturbo 19 Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.tbb
489595 1853.3 lz5-2.0_beta 9 ! Outside TurboBench !
495240 41.4 15.24 1864.89 lz4 16 Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.tbb
529655 44.3 75.61 147.96 brieflz Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.tbb
594040 49.7 12.24 1655.67 lzsse2 1 Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.tbb
616213 51.5 189.90 190.68 density 3 Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.tbb
650156 54.4 61.36 1319.42 yappy Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.tbb
666147 55.7 175.41 357.05 lzf Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.tbb
677269 56.7 174.23 301.94 fastlz 2 Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.tbb
707035 59.1 1084.75 1747.66 chameleon 2 Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.tbb
708040 59.2 241.06 634.16 snappy_c Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.tbb
1195311 100.0 147.47 1262.30 trle Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.tbb
1195401 100.0 7565.80 7762.32 memcpy Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.tbb
D:\LZ5_v2beta_VS_LZSSE2_VS_Zato>turbobenchs.exe Slownik_jezyka_polskiego_(Pol-Pol).dsl -ezlib,9/libdeflate,9/xpack,9/fastlz,2/lzturbo,19,29,39/bzip2/chameleon,2/snappy_c/zstd,12,22/density,3/lz4,16/lz5,15/lzham,4/brieflz/brotli,11/crush,2/lzma,9/zpaq,2,5/lzf/yappy/trle/memcpy/lzsse2,1,17 -g -k0 -J13 -B2G
TurboBench: - Sun Oct 02 16:28:53 2016
C Size ratio% C MB/s D MB/s Name File
1851513 10.8 0.37 0.37 zpaq 5 Slownik_jezyka_polskiego_(Pol-Pol).dsl.tbb
2141578 12.4 1.11 124.47 lzma 9 Slownik_jezyka_polskiego_(Pol-Pol).dsl.tbb
2179075 12.7 0.90 263.14 lzham 4 Slownik_jezyka_polskiego_(Pol-Pol).dsl.tbb
2260440 13.1 0.99 683.08 lzturbo 39 Slownik_jezyka_polskiego_(Pol-Pol).dsl.tbb
2276496 13.2 1.30 503.93 zstd 22 Slownik_jezyka_polskiego_(Pol-Pol).dsl.tbb
2293510 13.3 0.38 374.40 brotli 11 Slownik_jezyka_polskiego_(Pol-Pol).dsl.tbb
2394859 13.9 9.09 27.47 bzip2 Slownik_jezyka_polskiego_(Pol-Pol).dsl.tbb
2840567 16.5 3.64 80.16 zpaq 2 Slownik_jezyka_polskiego_(Pol-Pol).dsl.tbb
2997101 17.4 2.47 589.93 xpack 9 Slownik_jezyka_polskiego_(Pol-Pol).dsl.tbb
3011302 17.5 10.79 676.74 zstd 12 Slownik_jezyka_polskiego_(Pol-Pol).dsl.tbb
3060604 1107.2 lz5-2.0_beta 18 ! Outside TurboBench !
3060960 17.8 0.07 380.21 crush 2 Slownik_jezyka_polskiego_(Pol-Pol).dsl.tbb
3091927 18.0 1.00 1037.46 lzturbo 29 Slownik_jezyka_polskiego_(Pol-Pol).dsl.tbb
3101206 1216 Nakamichi-Zato ! Outside TurboBench !
3231730 18.8 1.44 720.80 lz5 15 Slownik_jezyka_polskiego_(Pol-Pol).dsl.tbb
3353571 19.5 5.80 736.70 libdeflate 9 Slownik_jezyka_polskiego_(Pol-Pol).dsl.tbb
3496527 3200 LZSSE2 17 SSE4.1! Outside TurboBench !
3496527 3328 LZSSE2 17 AVX ! Outside TurboBench !
3496531 20.3 4.07 3243.61 lzsse2 17 Slownik_jezyka_polskiego_(Pol-Pol).dsl.tbb
3572553 20.8 3.10 319.69 zlib 9 Slownik_jezyka_polskiego_(Pol-Pol).dsl.tbb
4006357 23.3 1.22 2934.36 lzturbo 19 Slownik_jezyka_polskiego_(Pol-Pol).dsl.tbb
4012459 1970.0 lz5-2.0_beta 9 ! Outside TurboBench !
4138755 24.1 6.95 1812.87 lz4 16 Slownik_jezyka_polskiego_(Pol-Pol).dsl.tbb
4901067 28.5 70.29 2109.64 yappy Slownik_jezyka_polskiego_(Pol-Pol).dsl.tbb
5500763 32.0 126.29 194.35 brieflz Slownik_jezyka_polskiego_(Pol-Pol).dsl.tbb
5730218 33.3 12.13 2397.12 lzsse2 1 Slownik_jezyka_polskiego_(Pol-Pol).dsl.tbb
6101970 35.5 341.66 289.44 density 3 Slownik_jezyka_polskiego_(Pol-Pol).dsl.tbb
6356114 36.9 309.19 541.25 lzf Slownik_jezyka_polskiego_(Pol-Pol).dsl.tbb
6652854 38.7 294.85 447.56 fastlz 2 Slownik_jezyka_polskiego_(Pol-Pol).dsl.tbb
6936171 40.3 330.45 868.41 snappy_c Slownik_jezyka_polskiego_(Pol-Pol).dsl.tbb
9150049 53.2 1256.05 3298.34 chameleon 2 Slownik_jezyka_polskiego_(Pol-Pol).dsl.tbb
17204132 100.0 6325.05 5638.85 memcpy Slownik_jezyka_polskiego_(Pol-Pol).dsl.tbb
17204132 100.0 144.01 5562.28 trle Slownik_jezyka_polskiego_(Pol-Pol).dsl.tbb
D:\LZ5_v2beta_VS_LZSSE2_VS_Zato>turbobenchs.exe Smyslov_(Vasily_Smyslov_2627_games).pgn -ezlib,9/libdeflate,9/xpack,9/fastlz,2/lzturbo,19,29,39/bzip2/chameleon,2/snappy_c/zstd,12,22/density,3/lz4,16/lz5,15/lzham,4/brieflz/brotli,11/crush,2/lzma,9/zpaq,2,5/lzf/yappy/trle/memcpy/lzsse2,1,17 -g -k0 -J13 -B2G
TurboBench: - Sun Oct 02 16:30:22 2016
C Size ratio% C MB/s D MB/s Name File
257330 15.5 0.34 0.33 zpaq 5 Smyslov_(Vasily_Smyslov_2627_games).pgn.tbb
314975 19.0 8.51 25.07 bzip2 Smyslov_(Vasily_Smyslov_2627_games).pgn.tbb
363995 21.9 1.53 69.25 lzma 9 Smyslov_(Vasily_Smyslov_2627_games).pgn.tbb
364389 22.0 0.40 277.83 brotli 11 Smyslov_(Vasily_Smyslov_2627_games).pgn.tbb
389023 23.4 1.89 525.16 zstd 22 Smyslov_(Vasily_Smyslov_2627_games).pgn.tbb
390007 23.5 1.49 787.49 lzturbo 39 Smyslov_(Vasily_Smyslov_2627_games).pgn.tbb
394133 23.7 1.53 154.98 lzham 4 Smyslov_(Vasily_Smyslov_2627_games).pgn.tbb
418780 25.2 6.92 560.26 zstd 12 Smyslov_(Vasily_Smyslov_2627_games).pgn.tbb
420151 25.3 1.95 599.08 xpack 9 Smyslov_(Vasily_Smyslov_2627_games).pgn.tbb
456748 27.5 0.56 287.75 crush 2 Smyslov_(Vasily_Smyslov_2627_games).pgn.tbb
466362 28.1 5.36 67.65 zpaq 2 Smyslov_(Vasily_Smyslov_2627_games).pgn.tbb
474789 28.6 8.79 490.12 libdeflate 9 Smyslov_(Vasily_Smyslov_2627_games).pgn.tbb
490598 29.6 12.43 269.27 zlib 9 Smyslov_(Vasily_Smyslov_2627_games).pgn.tbb
495673 29.9 1.90 834.19 lz5 15 Smyslov_(Vasily_Smyslov_2627_games).pgn.tbb
500488 30.1 1.64 1158.44 lzturbo 29 Smyslov_(Vasily_Smyslov_2627_games).pgn.tbb
505572 3008 LZSSE2 17 SSE4.1! Outside TurboBench !
505572 3008 LZSSE2 17 AVX ! Outside TurboBench !
505576 30.5 4.45 2299.22 lzsse2 17 Smyslov_(Vasily_Smyslov_2627_games).pgn.tbb
520201 1576.5 lz5-2.0_beta 18 ! Outside TurboBench !
541608 1280 Nakamichi-Zato ! Outside TurboBench !
557400 33.6 2.01 2585.73 lzturbo 19 Smyslov_(Vasily_Smyslov_2627_games).pgn.tbb
557733 1964.5 lz5-2.0_beta 9 ! Outside TurboBench !
566194 34.1 23.06 1928.04 lz4 16 Smyslov_(Vasily_Smyslov_2627_games).pgn.tbb
623758 37.6 96.30 184.37 brieflz Smyslov_(Vasily_Smyslov_2627_games).pgn.tbb
688581 41.5 220.43 233.22 density 3 Smyslov_(Vasily_Smyslov_2627_games).pgn.tbb
710927 42.8 10.47 1790.76 lzsse2 1 Smyslov_(Vasily_Smyslov_2627_games).pgn.tbb
768969 46.3 235.83 442.09 lzf Smyslov_(Vasily_Smyslov_2627_games).pgn.tbb
770887 46.4 242.16 418.78 fastlz 2 Smyslov_(Vasily_Smyslov_2627_games).pgn.tbb
782311 47.1 75.40 1277.94 yappy Smyslov_(Vasily_Smyslov_2627_games).pgn.tbb
850739 51.2 295.33 676.19 snappy_c Smyslov_(Vasily_Smyslov_2627_games).pgn.tbb
937681 56.5 1097.18 2004.88 chameleon 2 Smyslov_(Vasily_Smyslov_2627_games).pgn.tbb
1659995 100.0 148.80 1300.97 trle Smyslov_(Vasily_Smyslov_2627_games).pgn.tbb
1660043 100.0 7410.89 7377.95 memcpy Smyslov_(Vasily_Smyslov_2627_games).pgn.tbb
D:\LZ5_v2beta_VS_LZSSE2_VS_Zato>turbobenchs.exe The_complete_Aubrey_Maturin_by_Patrick_O'Brian_(21-TXTs).tar -ezlib,9/libdeflate,9/xpack,9/fastlz,2/lzturbo,19,29,39/bzip2/chameleon,2/snappy_c/zstd,12,22/density,3/lz4,16/lz5,15/lzham,4/brieflz/brotli,11/crush,2/lzma,9/zpaq,2,5/lzf/yappy/trle/memcpy/lzsse2,1,17 -g -k0 -J13 -B2G
TurboBench: - Sun Oct 02 16:38:19 2016
C Size ratio% C MB/s D MB/s Name File
2767461 20.2 0.31 0.30 zpaq 5 The_complete_Aubrey_Maturin_by_Patrick_O'Brian_(21-TXTs).tar.tbb
3554802 26.0 1.06 69.16 lzma 9 The_complete_Aubrey_Maturin_by_Patrick_O'Brian_(21-TXTs).tar.tbb
3562585 26.0 0.35 206.99 brotli 11 The_complete_Aubrey_Maturin_by_Patrick_O'Brian_(21-TXTs).tar.tbb
3567992 26.1 0.89 142.08 lzham 4 The_complete_Aubrey_Maturin_by_Patrick_O'Brian_(21-TXTs).tar.tbb
3585035 26.2 1.19 284.31 zstd 22 The_complete_Aubrey_Maturin_by_Patrick_O'Brian_(21-TXTs).tar.tbb
3591509 26.2 1.05 366.58 lzturbo 39 The_complete_Aubrey_Maturin_by_Patrick_O'Brian_(21-TXTs).tar.tbb
3703637 27.0 9.99 19.22 bzip2 The_complete_Aubrey_Maturin_by_Patrick_O'Brian_(21-TXTs).tar.tbb
4197653 30.7 0.58 323.83 xpack 9 The_complete_Aubrey_Maturin_by_Patrick_O'Brian_(21-TXTs).tar.tbb
4256970 31.1 4.27 452.97 zstd 12 The_complete_Aubrey_Maturin_by_Patrick_O'Brian_(21-TXTs).tar.tbb
4294809 31.4 2.97 55.37 zpaq 2 The_complete_Aubrey_Maturin_by_Patrick_O'Brian_(21-TXTs).tar.tbb
4371236 31.9 0.13 241.10 crush 2 The_complete_Aubrey_Maturin_by_Patrick_O'Brian_(21-TXTs).tar.tbb
4632254 33.8 1.07 624.71 lzturbo 29 The_complete_Aubrey_Maturin_by_Patrick_O'Brian_(21-TXTs).tar.tbb
4855421 35.5 1.30 372.19 lz5 15 The_complete_Aubrey_Maturin_by_Patrick_O'Brian_(21-TXTs).tar.tbb
4924148 36.0 7.39 408.26 libdeflate 9 The_complete_Aubrey_Maturin_by_Patrick_O'Brian_(21-TXTs).tar.tbb
5031882 960 Nakamichi-Zato ! Outside TurboBench !
5032797 826.5 lz5-2.0_beta 18 ! Outside TurboBench !
5158479 37.7 9.68 217.04 zlib 9 The_complete_Aubrey_Maturin_by_Patrick_O'Brian_(21-TXTs).tar.tbb
5160110 2048 LZSSE2 17 SSE4.1! Outside TurboBench !
5160110 2112 LZSSE2 17 AVX ! Outside TurboBench !
5160114 37.7 5.00 2034.31 lzsse2 17 The_complete_Aubrey_Maturin_by_Patrick_O'Brian_(21-TXTs).tar.tbb
5828546 42.6 1.26 2456.94 lzturbo 19 The_complete_Aubrey_Maturin_by_Patrick_O'Brian_(21-TXTs).tar.tbb
5838641 1758.9 lz5-2.0_beta 9 ! Outside TurboBench !
5892721 43.0 14.96 1811.50 lz4 16 The_complete_Aubrey_Maturin_by_Patrick_O'Brian_(21-TXTs).tar.tbb
6211745 45.4 77.62 145.52 brieflz The_complete_Aubrey_Maturin_by_Patrick_O'Brian_(21-TXTs).tar.tbb
6526796 47.7 266.83 239.25 density 3 The_complete_Aubrey_Maturin_by_Patrick_O'Brian_(21-TXTs).tar.tbb
7029733 51.3 12.33 1592.99 lzsse2 1 The_complete_Aubrey_Maturin_by_Patrick_O'Brian_(21-TXTs).tar.tbb
7814850 57.1 1084.32 1902.87 chameleon 2 The_complete_Aubrey_Maturin_by_Patrick_O'Brian_(21-TXTs).tar.tbb
7913296 57.8 174.46 352.14 lzf The_complete_Aubrey_Maturin_by_Patrick_O'Brian_(21-TXTs).tar.tbb
7978444 58.3 61.33 1223.09 yappy The_complete_Aubrey_Maturin_by_Patrick_O'Brian_(21-TXTs).tar.tbb
8050844 58.8 170.32 306.06 fastlz 2 The_complete_Aubrey_Maturin_by_Patrick_O'Brian_(21-TXTs).tar.tbb
8508270 62.1 235.40 611.22 snappy_c The_complete_Aubrey_Maturin_by_Patrick_O'Brian_(21-TXTs).tar.tbb
13674844 99.9 142.59 1323.70 trle The_complete_Aubrey_Maturin_by_Patrick_O'Brian_(21-TXTs).tar.tbb
13694980 100.0 6396.53 5440.99 memcpy The_complete_Aubrey_Maturin_by_Patrick_O'Brian_(21-TXTs).tar.tbb
D:\LZ5_v2beta_VS_LZSSE2_VS_Zato>turbobenchs.exe The_Project_Gutenberg_12_Fairy_Books_by_Andrew_Lang.tar -ezlib,9/libdeflate,9/xpack,9/fastlz,2/lzturbo,19,29,39/bzip2/chameleon,2/snappy_c/zstd,12,22/density,3/lz4,16/lz5,15/lzham,4/brieflz/brotli,11/crush,2/lzma,9/zpaq,2,5/lzf/yappy/trle/memcpy/lzsse2,1,17 -g -k0 -J13 -B2G
TurboBench: - Sun Oct 02 16:43:20 2016
C Size ratio% C MB/s D MB/s Name File
1399417 19.6 0.31 0.31 zpaq 5 The_Project_Gutenberg_12_Fairy_Books_by_Andrew_Lang.tar.tbb
1835483 25.7 1.23 70.09 lzma 9 The_Project_Gutenberg_12_Fairy_Books_by_Andrew_Lang.tar.tbb
1839607 25.8 0.37 248.10 brotli 11 The_Project_Gutenberg_12_Fairy_Books_by_Andrew_Lang.tar.tbb
1858314 26.0 10.04 20.92 bzip2 The_Project_Gutenberg_12_Fairy_Books_by_Andrew_Lang.tar.tbb
1858842 26.0 1.04 151.87 lzham 4 The_Project_Gutenberg_12_Fairy_Books_by_Andrew_Lang.tar.tbb
1860631 26.1 1.45 380.19 zstd 22 The_Project_Gutenberg_12_Fairy_Books_by_Andrew_Lang.tar.tbb
1865477 26.1 1.22 477.92 lzturbo 39 The_Project_Gutenberg_12_Fairy_Books_by_Andrew_Lang.tar.tbb
2133573 29.9 4.78 482.44 zstd 12 The_Project_Gutenberg_12_Fairy_Books_by_Andrew_Lang.tar.tbb
2135754 29.9 0.74 413.11 xpack 9 The_Project_Gutenberg_12_Fairy_Books_by_Andrew_Lang.tar.tbb
2184827 30.6 0.14 249.13 crush 2 The_Project_Gutenberg_12_Fairy_Books_by_Andrew_Lang.tar.tbb
2223226 31.1 3.47 58.98 zpaq 2 The_Project_Gutenberg_12_Fairy_Books_by_Andrew_Lang.tar.tbb
2407621 33.7 1.24 692.67 lzturbo 29 The_Project_Gutenberg_12_Fairy_Books_by_Andrew_Lang.tar.tbb
2421732 33.9 7.13 432.41 libdeflate 9 The_Project_Gutenberg_12_Fairy_Books_by_Andrew_Lang.tar.tbb
2445769 34.3 1.43 447.98 lz5 15 The_Project_Gutenberg_12_Fairy_Books_by_Andrew_Lang.tar.tbb
2539892 35.6 8.70 228.14 zlib 9 The_Project_Gutenberg_12_Fairy_Books_by_Andrew_Lang.tar.tbb
2540805 1088 Nakamichi-Zato ! Outside TurboBench !
2556494 2112 LZSSE2 17 SSE4.1! Outside TurboBench !
2556494 2304 LZSSE2 17 AVX ! Outside TurboBench !
2556498 35.8 5.22 2141.40 lzsse2 17 The_Project_Gutenberg_12_Fairy_Books_by_Andrew_Lang.tar.tbb
2595499 1056.1 lz5-2.0_beta 18 ! Outside TurboBench !
2891200 40.5 1.44 2364.12 lzturbo 19 The_Project_Gutenberg_12_Fairy_Books_by_Andrew_Lang.tar.tbb
2896240 1809.7 lz5-2.0_beta 9 ! Outside TurboBench !
2929699 41.0 13.19 1850.47 lz4 16 The_Project_Gutenberg_12_Fairy_Books_by_Andrew_Lang.tar.tbb
3047250 42.7 79.41 151.27 brieflz The_Project_Gutenberg_12_Fairy_Books_by_Andrew_Lang.tar.tbb
3405772 47.7 261.79 237.63 density 3 The_Project_Gutenberg_12_Fairy_Books_by_Andrew_Lang.tar.tbb
3505515 49.1 12.34 1662.93 lzsse2 1 The_Project_Gutenberg_12_Fairy_Books_by_Andrew_Lang.tar.tbb
3793663 53.2 61.37 1295.80 yappy The_Project_Gutenberg_12_Fairy_Books_by_Andrew_Lang.tar.tbb
3917217 54.9 171.14 360.47 lzf The_Project_Gutenberg_12_Fairy_Books_by_Andrew_Lang.tar.tbb
3984251 55.8 179.46 307.76 fastlz 2 The_Project_Gutenberg_12_Fairy_Books_by_Andrew_Lang.tar.tbb
4054300 56.8 1026.06 1958.10 chameleon 2 The_Project_Gutenberg_12_Fairy_Books_by_Andrew_Lang.tar.tbb
4167383 58.4 248.95 629.89 snappy_c The_Project_Gutenberg_12_Fairy_Books_by_Andrew_Lang.tar.tbb
7108504 99.6 148.08 1317.81 trle The_Project_Gutenberg_12_Fairy_Books_by_Andrew_Lang.tar.tbb
7137284 100.0 6553.98 5765.17 memcpy The_Project_Gutenberg_12_Fairy_Books_by_Andrew_Lang.tar.tbb
D:\LZ5_v2beta_VS_LZSSE2_VS_Zato>turbobenchs.exe University_of_Canterbury_The_Calgary_Corpus.tar -ezlib,9/libdeflate,9/xpack,9/fastlz,2/lzturbo,19,29,39/bzip2/chameleon,2/snappy_c/zstd,12,22/density,3/lz4,16/lz5,15/lzham,4/brieflz/brotli,11/crush,2/lzma,9/zpaq,2,5/lzf/yappy/trle/memcpy/lzsse2,1,17 -g -k0 -J13 -B2G
TurboBench: - Sun Oct 02 16:46:20 2016
C Size ratio% C MB/s D MB/s Name File
688059 21.1 0.31 0.31 zpaq 5 University_of_Canterbury_The_Calgary_Corpus.tar.tbb
851327 26.1 1.75 60.80 lzma 9 University_of_Canterbury_The_Calgary_Corpus.tar.tbb
863141 26.4 0.38 233.77 brotli 11 University_of_Canterbury_The_Calgary_Corpus.tar.tbb
890859 27.3 11.64 25.20 bzip2 University_of_Canterbury_The_Calgary_Corpus.tar.tbb
899273 27.5 2.23 493.73 zstd 22 University_of_Canterbury_The_Calgary_Corpus.tar.tbb
902432 27.6 1.59 686.90 lzturbo 39 University_of_Canterbury_The_Calgary_Corpus.tar.tbb
913218 28.0 1.61 137.29 lzham 4 University_of_Canterbury_The_Calgary_Corpus.tar.tbb
958042 29.3 1.89 493.21 xpack 9 University_of_Canterbury_The_Calgary_Corpus.tar.tbb
968043 29.6 9.54 532.63 zstd 12 University_of_Canterbury_The_Calgary_Corpus.tar.tbb
1021136 31.3 9.31 422.94 libdeflate 9 University_of_Canterbury_The_Calgary_Corpus.tar.tbb
1022374 31.3 0.70 235.13 crush 2 University_of_Canterbury_The_Calgary_Corpus.tar.tbb
1060310 32.5 9.04 235.18 zlib 9 University_of_Canterbury_The_Calgary_Corpus.tar.tbb
1077695 33.0 4.90 60.46 zpaq 2 University_of_Canterbury_The_Calgary_Corpus.tar.tbb
1114797 34.1 1.77 966.13 lzturbo 29 University_of_Canterbury_The_Calgary_Corpus.tar.tbb
1125796 34.5 1.83 688.06 lz5 15 University_of_Canterbury_The_Calgary_Corpus.tar.tbb
1142536 2112 LZSSE2 17 SSE4.1! Outside TurboBench !
1142536 2496 LZSSE2 17 AVX ! Outside TurboBench !
1142540 35.0 0.44 2042.24 lzsse2 17 University_of_Canterbury_The_Calgary_Corpus.tar.tbb
1192352 1509.7 lz5-2.0_beta 18 ! Outside TurboBench !
1231161 37.7 2.07 2625.03 lzturbo 19 University_of_Canterbury_The_Calgary_Corpus.tar.tbb
1237244 2014.5 lz5-2.0_beta 9 ! Outside TurboBench !
1240210 38.0 4.17 1942.62 lz4 16 University_of_Canterbury_The_Calgary_Corpus.tar.tbb
1298840 39.8 89.11 180.28 brieflz University_of_Canterbury_The_Calgary_Corpus.tar.tbb
1311813 960 Nakamichi-Zato ! Outside TurboBench !
1405647 43.0 12.14 1749.08 lzsse2 1 University_of_Canterbury_The_Calgary_Corpus.tar.tbb
1596322 48.9 199.22 394.06 lzf University_of_Canterbury_The_Calgary_Corpus.tar.tbb
1607581 49.2 194.25 360.83 fastlz 2 University_of_Canterbury_The_Calgary_Corpus.tar.tbb
1610706 49.3 206.42 194.15 density 3 University_of_Canterbury_The_Calgary_Corpus.tar.tbb
1624766 49.8 60.18 1554.28 yappy University_of_Canterbury_The_Calgary_Corpus.tar.tbb
1682025 51.5 289.47 734.82 snappy_c University_of_Canterbury_The_Calgary_Corpus.tar.tbb
2084324 63.8 1077.73 1576.79 chameleon 2 University_of_Canterbury_The_Calgary_Corpus.tar.tbb
2810417 86.1 191.46 5224.86 trle University_of_Canterbury_The_Calgary_Corpus.tar.tbb
3265540 100.0 6903.88 6610.40 memcpy University_of_Canterbury_The_Calgary_Corpus.tar.tbb
D:\LZ5_v2beta_VS_LZSSE2_VS_Zato>turbobenchs.exe www.ncbi.nlm.nih.gov_(Ladona_fulva_-_whole_genome_shotgun_sequence)_sequence.fasta.txt -ezlib,9/libdeflate,9/xpack,9/fastlz,2/lzturbo,19,29,39/bzip2/chameleon,2/snappy_c/zstd,12,22/density,3/lz4,16/lz5,15/lzham,4/brieflz/brotli,11/crush,2/lzma,9/zpaq,2,5/lzf/yappy/trle/memcpy/lzsse2,1,17 -g -k0 -J13 -B2G
TurboBench: - Sun Oct 02 16:52:02 2016
C Size ratio% C MB/s D MB/s Name File
973794 21.7 0.26 0.26 zpaq 5 www.ncbi.nlm.nih.gov_(Ladona_fulva_-_whole_genome_shotgun_sequence)_sequence.fasta.txt.tbb
1098241 24.5 0.28 111.41 brotli 11 www.ncbi.nlm.nih.gov_(Ladona_fulva_-_whole_genome_shotgun_sequence)_sequence.fasta.txt.tbb
1107450 24.7 1.02 78.87 lzma 9 www.ncbi.nlm.nih.gov_(Ladona_fulva_-_whole_genome_shotgun_sequence)_sequence.fasta.txt.tbb
1115796 24.9 1.26 446.60 zstd 22 www.ncbi.nlm.nih.gov_(Ladona_fulva_-_whole_genome_shotgun_sequence)_sequence.fasta.txt.tbb
1124307 25.1 0.89 152.31 lzham 4 www.ncbi.nlm.nih.gov_(Ladona_fulva_-_whole_genome_shotgun_sequence)_sequence.fasta.txt.tbb
1156565 25.8 10.30 19.93 bzip2 www.ncbi.nlm.nih.gov_(Ladona_fulva_-_whole_genome_shotgun_sequence)_sequence.fasta.txt.tbb
1163771 25.9 4.55 542.94 libdeflate 9 www.ncbi.nlm.nih.gov_(Ladona_fulva_-_whole_genome_shotgun_sequence)_sequence.fasta.txt.tbb
1205730 26.9 1.08 294.70 zlib 9 www.ncbi.nlm.nih.gov_(Ladona_fulva_-_whole_genome_shotgun_sequence)_sequence.fasta.txt.tbb
1229904 27.4 2.81 553.32 xpack 9 www.ncbi.nlm.nih.gov_(Ladona_fulva_-_whole_genome_shotgun_sequence)_sequence.fasta.txt.tbb
1231733 27.4 7.63 478.05 zstd 12 www.ncbi.nlm.nih.gov_(Ladona_fulva_-_whole_genome_shotgun_sequence)_sequence.fasta.txt.tbb
1297189 2432 LZSSE2 17 SSE4.1! Outside TurboBench !
1297189 2880 LZSSE2 17 AVX ! Outside TurboBench !
1297193 28.9 1.21 2429.58 lzsse2 17 www.ncbi.nlm.nih.gov_(Ladona_fulva_-_whole_genome_shotgun_sequence)_sequence.fasta.txt.tbb
1366183 30.4 0.04 282.19 crush 2 www.ncbi.nlm.nih.gov_(Ladona_fulva_-_whole_genome_shotgun_sequence)_sequence.fasta.txt.tbb
1396907 31.1 4.25 61.98 zpaq 2 www.ncbi.nlm.nih.gov_(Ladona_fulva_-_whole_genome_shotgun_sequence)_sequence.fasta.txt.tbb
1437041 32.0 1.23 727.18 lz5 15 www.ncbi.nlm.nih.gov_(Ladona_fulva_-_whole_genome_shotgun_sequence)_sequence.fasta.txt.tbb
1441772 32.1 1.47 867.14 lzturbo 29 www.ncbi.nlm.nih.gov_(Ladona_fulva_-_whole_genome_shotgun_sequence)_sequence.fasta.txt.tbb
1456466 1152 Nakamichi-Zato ! Outside TurboBench !
1503145 1516.5 lz5-2.0_beta 18 ! Outside TurboBench !
1509154 33.6 1.76 2556.94 lzturbo 19 www.ncbi.nlm.nih.gov_(Ladona_fulva_-_whole_genome_shotgun_sequence)_sequence.fasta.txt.tbb
1510839 2000.6 lz5-2.0_beta 9 ! Outside TurboBench !
1556225 34.7 50.22 2329.92 yappy www.ncbi.nlm.nih.gov_(Ladona_fulva_-_whole_genome_shotgun_sequence)_sequence.fasta.txt.tbb
1596981 35.6 1.79 2074.63 lz4 16 www.ncbi.nlm.nih.gov_(Ladona_fulva_-_whole_genome_shotgun_sequence)_sequence.fasta.txt.tbb
1598279 35.6 145.80 224.33 brieflz www.ncbi.nlm.nih.gov_(Ladona_fulva_-_whole_genome_shotgun_sequence)_sequence.fasta.txt.tbb
1995712 44.5 362.36 731.09 snappy_c www.ncbi.nlm.nih.gov_(Ladona_fulva_-_whole_genome_shotgun_sequence)_sequence.fasta.txt.tbb
2161251 48.2 437.41 367.88 density 3 www.ncbi.nlm.nih.gov_(Ladona_fulva_-_whole_genome_shotgun_sequence)_sequence.fasta.txt.tbb
2385361 53.2 1224.07 3230.69 chameleon 2 www.ncbi.nlm.nih.gov_(Ladona_fulva_-_whole_genome_shotgun_sequence)_sequence.fasta.txt.tbb
2403235 53.6 240.33 441.11 lzf www.ncbi.nlm.nih.gov_(Ladona_fulva_-_whole_genome_shotgun_sequence)_sequence.fasta.txt.tbb
2408470 53.7 219.97 406.62 fastlz 2 www.ncbi.nlm.nih.gov_(Ladona_fulva_-_whole_genome_shotgun_sequence)_sequence.fasta.txt.tbb
2559866 57.0 15.08 1358.59 lzsse2 1 www.ncbi.nlm.nih.gov_(Ladona_fulva_-_whole_genome_shotgun_sequence)_sequence.fasta.txt.tbb
3677928 82.0 159.99 856.38 trle www.ncbi.nlm.nih.gov_(Ladona_fulva_-_whole_genome_shotgun_sequence)_sequence.fasta.txt.tbb
3849226 85.8 1.38 3717.84 lzturbo 39 www.ncbi.nlm.nih.gov_(Ladona_fulva_-_whole_genome_shotgun_sequence)_sequence.fasta.txt.tbb
4487437 100.0 6758.18 6198.11 memcpy www.ncbi.nlm.nih.gov_(Ladona_fulva_-_whole_genome_shotgun_sequence)_sequence.fasta.txt.tbb
D:\LZ5_v2beta_VS_LZSSE2_VS_Zato>
Hope that someone will give the above picture on some serious machine, not like my crappy i5 ruining the beautiful ... exploitation of registers.
Still haven't given up on making the richest textual roster with 400+ files...
https://1drv.ms/i/s!AmWWFXGMzDmEgmI7l-33IsTzHnMy
Thanks for the results. My notes:
a) LZ5 v2.0beta 9 is very similar to lzturbo 19. When I will disable some bounds checking then LZ5 can be 20% faster so almost identical with lzturbo 19.
b) LZSSE2 has very good ratio on your textual files. In my experiments with mixed files it's not as good and not as fast.
c) the results with Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar.tbb
show that "lz5 15" is very weak on this file. Worse than "lz5-2.0_beta 18" what shouldn't happen. I think the reason can be MINMATCH=3 which doesn't work for this file.
Two things.
First, regarding Dostoyevski, for better tweaking I just uploaded:
ALPHABET RIPPER Package (C source, compile, Complete Spanish/Russian/English Dostoyevski):
https://1drv.ms/u/s!AmWWFXGMzDmEgmOqwg7i2lvwv6bC
A two-page booklet, Okami.pdf:
https://1drv.ms/b/s!AmWWFXGMzDmEgmRLavzRS2u9xEXT
A screenshot from the PDF:
https://1drv.ms/i/s!AmWWFXGMzDmEgmWoMRUV48io4t1i
Entropy of Alphabetical Orders Table, in short, Decomposition Table, or, B.B.s Table, Decomposition_Table_sorted_by_GRANULARITY_(3rd_column).txt:
--------------------------------------------------------------------------------------------------------------------
| #1 Filesize | #2 | #3 Granularity | #4 N.U.B.B.s | #5 U.B.B.s | #6 U.B.B.s_Alphabet | #7 Entropy | #8 Filename
| 000,013,713,275 | 001 | 008bit | 000,013,713,275 | 000,000,000,145 | NewOrder = 008bit | 0.000,010,573 | Complete_Works_of_Fyodor_Dostoyevsky.txt
| 000,014,658,560 | 001 | 008bit | 000,014,658,560 | 000,000,000,149 | NewOrder = 008bit | 0.000,010,164 | Textos_Completos_-_F.M._DOSTOIEVSKI_(Spanish).tar
| 000,040,303,104 | 001 | 008bit | 000,040,303,104 | 000,000,000,170 | NewOrder = 008bit | 0.000,004,218 | Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar
--------------------------------------------------------------------------------------------------------------------
| 000,013,713,275 | 004 | 032bit | 000,013,713,272 | 000,000,093,562 | NewOrder = 017bit | 0.006,822,733 | Complete_Works_of_Fyodor_Dostoyevsky.txt
| 000,014,658,560 | 004 | 032bit | 000,014,658,557 | 000,000,096,477 | NewOrder = 017bit | 0.006,581,616 | Textos_Completos_-_F.M._DOSTOIEVSKI_(Spanish).tar
| 000,040,303,104 | 004 | 032bit | 000,040,303,101 | 000,000,073,613 | NewOrder = 017bit | 0.001,826,484 | Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar
--------------------------------------------------------------------------------------------------------------------
| 000,013,713,275 | 008 | 064bit | 000,013,713,268 | 000,002,415,302 | NewOrder = 022bit | 0.176,128,832 | Complete_Works_of_Fyodor_Dostoyevsky.txt
| 000,014,658,560 | 008 | 064bit | 000,014,658,553 | 000,002,770,961 | NewOrder = 022bit | 0.189,033,728 | Textos_Completos_-_F.M._DOSTOIEVSKI_(Spanish).tar
| 000,040,303,104 | 008 | 064bit | 000,040,303,097 | 000,001,342,706 | NewOrder = 021bit | 0.033,315,208 | Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar
--------------------------------------------------------------------------------------------------------------------
| 000,013,713,275 | 024 | 192bit | 000,013,713,252 | 000,013,414,524 | NewOrder = 024bit | 0.978,216,128 | Complete_Works_of_Fyodor_Dostoyevsky.txt
| 000,014,658,560 | 024 | 192bit | 000,014,658,537 | 000,014,351,284 | NewOrder = 024bit | 0.979,039,296 | Textos_Completos_-_F.M._DOSTOIEVSKI_(Spanish).tar
| 000,040,303,104 | 024 | 192bit | 000,040,303,081 | 000,032,186,471 | NewOrder = 025bit | 0.798,610,752 | Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar
--------------------------------------------------------------------------------------------------------------------
| 000,013,713,275 | 048 | 384bit | 000,013,713,228 | 000,013,671,791 | NewOrder = 024bit | 0.996,978,368 | Complete_Works_of_Fyodor_Dostoyevsky.txt
| 000,014,658,560 | 048 | 384bit | 000,014,658,513 | 000,014,608,828 | NewOrder = 024bit | 0.996,610,496 | Textos_Completos_-_F.M._DOSTOIEVSKI_(Spanish).tar
| 000,040,303,104 | 048 | 384bit | 000,040,303,057 | 000,039,205,521 | NewOrder = 026bit | 0.972,767,936 | Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar
Table Legend:
#1: Filesize (in bytes)
#2: Building-Blocks_Order = B.B.s_Order (in bytes)
#3: Granularity = Alphabet_Order = "Letters"_size = B.B.s_Order x 8bit
#4: N.U.B.B.s = Non-Unique-Building-Blocks = (Filesize - B.B.s_Order + 1)
#5: U.B.B.s = Unique-Building-Blocks
#6: Shrunk_Alphabet (to house U.B.B.s) = NewOrder, for (NewOrder=1; UBBs > ((1LL)<<NewOrder); NewOrder++);
#7: Entropy_Alphabetical = U.B.B.s / N.U.B.B.s; LOWER -> MORE COMPRESSIBLE; The bigger the number the higher the "diffusion" i.e. richness of combinations, when 1 then full coverage of Entropy spectrum is present, lower values suggest "textuality", higher Alphabetical Orders could "warn" for duplicative fragments
#8: Filename
Looking at alphabet order 4, it strikes that the Russian text has 3-4 times lower entropy, it means less different 4bytes "letters" (~20,000) plus 3 times (40MB vs 13MB) more repetitions, which suggests higher compression.
Second, I made a new stronger Nakamichi called 'Okamiko', it replaces all the rest.
Also, I finished updating my 'Deathship' Textual Compression Corpus, gradually new tests will be made, the full listing of all the 604 testdatafiles is in the package.
Thanks, I will look at it.
Let's compare LZ5 v2.0 RC modes 9&18 with 'Okami', text only data, 13 files.
The benchmark (183MB) package is at:
https://1drv.ms/u/s!AmWWFXGMzDmEgmmuOYirB45zn7LY
Again the testmachine is Toshiba laptop i5-2430M @2.4GHz (boost @3000MHZ) 16GB RAM @666MHz.
Didn't have time this evening to wait for _BENCH.BAT, so stats only for 5 files...
D:\LZ5_v2RC_VS_LZSSE2_VS_Okami>turbobenchs.exe Agatha_Christie_89-ebooks_TXT.tar -ezlib,9/libdeflate,9,12/xpack,9/fastlz,2/lzturbo,19,29,39/bzip2/chameleon,2/snappy_c/zstd,12,22/density,3/lz4,16/lz5,15/lzham,4/brieflz/brotli,11/crush,2/lzma,9/zpaq,2,5/lzf/yappy/trle/memcpy/lzsse2,1,17/bsc_st,6/shrinker/rans_static16 -g -k0 -J13 -B2G
TurboBench: - Wed Nov 09 20:51:37 2016
C Size ratio% C MB/s D MB/s Name File
6267713 18.8 0.31 0.31 zpaq 5 Agatha_Christie_89-ebooks_TXT.tar.tbb
6782248 20.4 9.77 5.89 bsc_st 6 Agatha_Christie_89-ebooks_TXT.tar.tbb
7881393 23.7 0.93 72.92 lzma 9 Agatha_Christie_89-ebooks_TXT.tar.tbb
7917303 23.8 0.79 144.68 lzham 4 Agatha_Christie_89-ebooks_TXT.tar.tbb
7963999 23.9 1.04 272.30 zstd 22 Agatha_Christie_89-ebooks_TXT.tar.tbb
7973327 24.0 0.88 349.54 lzturbo 39 Agatha_Christie_89-ebooks_TXT.tar.tbb
8014306 24.1 0.35 219.00 brotli 11 Agatha_Christie_89-ebooks_TXT.tar.tbb
8416486 25.3 10.02 20.96 bzip2 Agatha_Christie_89-ebooks_TXT.tar.tbb
9595005 28.8 0.55 318.67 xpack 9 Agatha_Christie_89-ebooks_TXT.tar.tbb
9851022 29.6 4.72 471.41 zstd 12 Agatha_Christie_89-ebooks_TXT.tar.tbb
9926145 29.8 2.99 57.21 zpaq 2 Agatha_Christie_89-ebooks_TXT.tar.tbb
10076254 30.3 0.14 247.23 crush 2 Agatha_Christie_89-ebooks_TXT.tar.tbb
10216874 582 Nakamichi-Okami ! Outside TurboBench !
10334621 31.1 0.89 565.21 lzturbo 29 Agatha_Christie_89-ebooks_TXT.tar.tbb
11145205 33.5 1.32 385.61 lz5 15 Agatha_Christie_89-ebooks_TXT.tar.tbb
11147919 33.5 4.97 426.82 libdeflate 12 Agatha_Christie_89-ebooks_TXT.tar.tbb
11175291 33.6 7.25 437.41 libdeflate 9 Agatha_Christie_89-ebooks_TXT.tar.tbb
11290274 866.9 lz5-2.0rc 18 ! Outside TurboBench !
11649537 2115 lzsse2 17 ! SSE4.1 Outside TurboBench !
11649541 35.0 4.64 2169.93 lzsse2 17 Agatha_Christie_89-ebooks_TXT.tar.tbb
11716396 35.2 10.53 227.22 zlib 9 Agatha_Christie_89-ebooks_TXT.tar.tbb
13165738 39.6 1.03 2568.42 lzturbo 19 Agatha_Christie_89-ebooks_TXT.tar.tbb
13194355 1875.5 lz5-2.0rc 9 ! Outside TurboBench !
13327732 40.1 16.45 1850.57 lz4 16 Agatha_Christie_89-ebooks_TXT.tar.tbb
14305207 43.0 80.65 148.68 brieflz Agatha_Christie_89-ebooks_TXT.tar.tbb
15146404 45.5 273.61 245.11 density 3 Agatha_Christie_89-ebooks_TXT.tar.tbb
15890698 47.8 11.86 1704.34 lzsse2 1 Agatha_Christie_89-ebooks_TXT.tar.tbb
18054497 54.3 62.24 1288.59 yappy Agatha_Christie_89-ebooks_TXT.tar.tbb
18101060 54.4 217.37 496.36 shrinker Agatha_Christie_89-ebooks_TXT.tar.tbb
18191878 54.7 176.09 357.47 lzf Agatha_Christie_89-ebooks_TXT.tar.tbb
18478571 55.6 180.08 307.88 fastlz 2 Agatha_Christie_89-ebooks_TXT.tar.tbb
18773896 56.4 1100.76 1976.03 chameleon 2 Agatha_Christie_89-ebooks_TXT.tar.tbb
19377968 58.3 244.90 635.69 snappy_c Agatha_Christie_89-ebooks_TXT.tar.tbb
19455809 58.5 219.24 404.17 rans_static16 Agatha_Christie_89-ebooks_TXT.tar.tbb
33156061 99.7 148.19 1322.30 trle Agatha_Christie_89-ebooks_TXT.tar.tbb
33258500 100.0 6360.39 5791.14 memcpy Agatha_Christie_89-ebooks_TXT.tar.tbb
D:\LZ5_v2RC_VS_LZSSE2_VS_Okami>turbobenchs.exe Arabian_Nights_complete.html -ezlib,9/libdeflate,9,12/xpack,9/fastlz,2/lzturbo,19,29,39/bzip2/chameleon,2/snappy_c/zstd,12,22/density,3/lz4,16/lz5,15/lzham,4/brieflz/brotli,11/crush,2/lzma,9/zpaq,2,5/lzf/yappy/trle/memcpy/lzsse2,1,17/bsc_st,6/shrinker/rans_static16 -g -k0 -J13 -B2G
TurboBench: - Wed Nov 09 21:01:08 2016
C Size ratio% C MB/s D MB/s Name File
2975964 19.1 0.31 0.30 zpaq 5 Arabian_Nights_complete.html.tbb
3242800 20.8 9.52 5.97 bsc_st 6 Arabian_Nights_complete.html.tbb
3892786 25.0 1.03 68.62 lzma 9 Arabian_Nights_complete.html.tbb
3913051 25.1 0.35 219.88 brotli 11 Arabian_Nights_complete.html.tbb
3961082 25.4 0.89 145.53 lzham 4 Arabian_Nights_complete.html.tbb
3988669 25.6 1.03 311.48 zstd 22 Arabian_Nights_complete.html.tbb
3992884 25.6 1.01 402.30 lzturbo 39 Arabian_Nights_complete.html.tbb
4038902 25.9 10.01 21.75 bzip2 Arabian_Nights_complete.html.tbb
4589061 29.4 0.62 320.90 xpack 9 Arabian_Nights_complete.html.tbb
4620802 29.7 5.21 463.79 zstd 12 Arabian_Nights_complete.html.tbb
4724482 30.3 2.93 56.74 zpaq 2 Arabian_Nights_complete.html.tbb
4757444 30.5 0.16 243.29 crush 2 Arabian_Nights_complete.html.tbb
5035317 32.3 1.04 660.04 lzturbo 29 Arabian_Nights_complete.html.tbb
5154252 623 Nakamichi-Okami ! Outside TurboBench !
5223100 33.5 1.05 430.68 lz5 15 Arabian_Nights_complete.html.tbb
5242942 33.6 4.91 406.63 libdeflate 12 Arabian_Nights_complete.html.tbb
5259086 33.7 7.66 416.60 libdeflate 9 Arabian_Nights_complete.html.tbb
5478319 35.2 9.96 223.88 zlib 9 Arabian_Nights_complete.html.tbb
5524854 2083 lzsse2 17 ! SSE4.1 Outside TurboBench !
5524858 35.5 5.28 2105.87 lzsse2 17 Arabian_Nights_complete.html.tbb
5539920 998.9 lz5-2.0rc 18 ! Outside TurboBench !
6183326 39.7 1.23 2517.11 lzturbo 19 Arabian_Nights_complete.html.tbb
6185910 1875.5 lz5-2.0rc 9 ! Outside TurboBench !
6258303 40.2 15.87 1806.99 lz4 16 Arabian_Nights_complete.html.tbb
6740391 43.3 79.47 150.72 brieflz Arabian_Nights_complete.html.tbb
7101428 45.6 250.15 227.89 density 3 Arabian_Nights_complete.html.tbb
7294087 46.8 12.06 1700.88 lzsse2 1 Arabian_Nights_complete.html.tbb
8323881 53.4 209.29 520.14 shrinker Arabian_Nights_complete.html.tbb
8585442 55.1 174.85 355.62 lzf Arabian_Nights_complete.html.tbb
8613199 55.3 174.57 313.40 fastlz 2 Arabian_Nights_complete.html.tbb
8630338 55.4 62.51 1301.87 yappy Arabian_Nights_complete.html.tbb
9027159 57.9 233.01 633.24 snappy_c Arabian_Nights_complete.html.tbb
9049558 58.1 1090.21 1865.16 chameleon 2 Arabian_Nights_complete.html.tbb
9365512 60.1 214.82 401.98 rans_static16 Arabian_Nights_complete.html.tbb
15580578 100.0 148.31 1319.74 trle Arabian_Nights_complete.html.tbb
15583444 100.0 6276.05 5627.82 memcpy Arabian_Nights_complete.html.tbb
D:\LZ5_v2RC_VS_LZSSE2_VS_Okami>turbobenchs.exe "Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl" -ezlib,9/libdeflate,9,12/xpack,9/fastlz,2/lzturbo,19,29,39/bzip2/chameleon,2/snappy_c/zstd,12,22/density,3/lz4,16/lz5,15/lzham,4/brieflz/brotli,11/crush,2/lzma,9/zpaq,2,5/lzf/yappy/trle/memcpy/lzsse2,1,17/bsc_st,6/shrinker/rans_static16 -g -k0 -J13 -B2G
TurboBench: - Wed Nov 09 22:08:56 2016
C Size ratio% C MB/s D MB/s Name File
12327751 10.2 1.00 147.77 lzma 9 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
12876783 10.6 0.84 296.26 lzham 4 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
13097015 10.8 1.07 667.50 lzturbo 39 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
13376024 11.0 1.47 522.59 zstd 22 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
14004155 11.6 0.35 0.35 zpaq 5 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
15159296 12.5 14.78 9.48 bsc_st 6 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
16562339 13.7 1.59 508.16 xpack 9 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
16720872 13.8 1.14 1141.22 lzturbo 29 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
18210336 15.0 0.39 313.28 brotli 11 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
18933363 15.6 7.71 28.33 bzip2 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
20482167 959 Nakamichi-Okami ! Outside TurboBench !
22894194 18.9 3.38 74.66 zpaq 2 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
23516258 19.4 11.72 640.48 zstd 12 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
23616399 19.5 0.10 344.90 crush 2 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
24698086 20.4 1.53 669.32 lz5 15 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
25138280 1176.2 lz5-2.0rc 18 ! Outside TurboBench !
25882601 21.3 3.45 621.83 libdeflate 12 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
26890277 22.2 8.15 607.14 libdeflate 9 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
27512823 22.7 4.94 302.53 zlib 9 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
28142742 2798 lzsse2 17 ! SSE4.1 Outside TurboBench !
28142746 23.2 4.08 2825.89 lzsse2 17 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
30238083 24.9 0.90 2830.31 lzturbo 19 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
30265848 2241.9 lz5-2.0rc 9 ! Outside TurboBench !
30766001 25.4 12.30 1883.53 lz4 16 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
36298701 29.9 115.11 201.10 brieflz Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
36544651 30.1 78.77 1896.85 yappy Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
37010892 30.5 11.29 2410.72 lzsse2 1 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
39566228 32.6 285.67 249.16 density 3 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
42256528 34.9 291.05 539.19 lzf Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
42992117 35.5 276.37 464.90 fastlz 2 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
44996014 37.1 359.11 882.79 snappy_c Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
46746725 38.6 308.56 629.28 shrinker Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
65064159 53.7 234.93 394.01 rans_static16 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
66247214 54.6 1197.98 2644.73 chameleon 2 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
121244832 100.0 165.03 5811.48 trle Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
121244832 100.0 6195.44 5591.70 memcpy Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
D:\LZ5_v2RC_VS_LZSSE2_VS_Okami>turbobenchs.exe "Taishukan's_Genius_English-Japanese_Dictionary_(En-Jp).dsl" -ezlib,9/libdeflate,9,12/xpack,9/fastlz,2/lzturbo,19,29,39/bzip2/chameleon,2/snappy_c/zstd,12,22/density,3/lz4,16/lz5,15/lzham,4/brieflz/brotli,11/crush,2/lzma,9/zpaq,2,5/lzf/yappy/trle/memcpy/lzsse2,1,17/bsc_st,6/shrinker/rans_static16 -g -k0 -J13 -B2G
TurboBench: - Wed Nov 09 22:25:04 2016
C Size ratio% C MB/s D MB/s Name File
4140658 12.5 0.33 0.33 zpaq 5 Taishukan's_Genius_English-Japanese_Dictionary_(En-Jp).dsl.tbb
4502438 13.6 12.94 8.58 bsc_st 6 Taishukan's_Genius_English-Japanese_Dictionary_(En-Jp).dsl.tbb
5074677 15.3 1.13 104.46 lzma 9 Taishukan's_Genius_English-Japanese_Dictionary_(En-Jp).dsl.tbb
5249435 15.9 0.94 214.68 lzham 4 Taishukan's_Genius_English-Japanese_Dictionary_(En-Jp).dsl.tbb
5377244 16.2 0.91 528.41 lzturbo 39 Taishukan's_Genius_English-Japanese_Dictionary_(En-Jp).dsl.tbb
5453713 16.5 1.35 408.79 zstd 22 Taishukan's_Genius_English-Japanese_Dictionary_(En-Jp).dsl.tbb
5501046 16.6 0.39 297.70 brotli 11 Taishukan's_Genius_English-Japanese_Dictionary_(En-Jp).dsl.tbb
5949508 18.0 7.34 25.82 bzip2 Taishukan's_Genius_English-Japanese_Dictionary_(En-Jp).dsl.tbb
6223431 18.8 1.14 357.45 xpack 9 Taishukan's_Genius_English-Japanese_Dictionary_(En-Jp).dsl.tbb
6670018 20.1 0.97 900.75 lzturbo 29 Taishukan's_Genius_English-Japanese_Dictionary_(En-Jp).dsl.tbb
6674201 20.2 3.24 72.11 zpaq 2 Taishukan's_Genius_English-Japanese_Dictionary_(En-Jp).dsl.tbb
6937294 21.0 0.19 327.74 crush 2 Taishukan's_Genius_English-Japanese_Dictionary_(En-Jp).dsl.tbb
6977829 21.1 11.52 591.21 zstd 12 Taishukan's_Genius_English-Japanese_Dictionary_(En-Jp).dsl.tbb
7272755 22.0 1.56 593.16 lz5 15 Taishukan's_Genius_English-Japanese_Dictionary_(En-Jp).dsl.tbb
7306841 795 Nakamichi-Okami ! Outside TurboBench !
7706546 1210.1 lz5-2.0rc 18 ! Outside TurboBench !
8230450 24.9 3.68 529.74 libdeflate 12 Taishukan's_Genius_English-Japanese_Dictionary_(En-Jp).dsl.tbb
8503715 25.7 9.83 517.23 libdeflate 9 Taishukan's_Genius_English-Japanese_Dictionary_(En-Jp).dsl.tbb
8537142 25.8 7.44 277.71 zlib 9 Taishukan's_Genius_English-Japanese_Dictionary_(En-Jp).dsl.tbb
8758878 2466 lzsse2 17 ! SSE4.1 Outside TurboBench !
8758882 26.5 4.28 2497.25 lzsse2 17 Taishukan's_Genius_English-Japanese_Dictionary_(En-Jp).dsl.tbb
9232237 27.9 1.11 2706.51 lzturbo 19 Taishukan's_Genius_English-Japanese_Dictionary_(En-Jp).dsl.tbb
9245349 2216.8 lz5-2.0rc 9 ! Outside TurboBench !
9324314 28.2 16.54 1890.16 lz4 16 Taishukan's_Genius_English-Japanese_Dictionary_(En-Jp).dsl.tbb
10477943 31.6 11.19 2279.25 lzsse2 1 Taishukan's_Genius_English-Japanese_Dictionary_(En-Jp).dsl.tbb
10580324 32.0 260.46 234.21 density 3 Taishukan's_Genius_English-Japanese_Dictionary_(En-Jp).dsl.tbb
10778941 32.6 102.39 189.36 brieflz Taishukan's_Genius_English-Japanese_Dictionary_(En-Jp).dsl.tbb
12004306 36.3 81.43 1726.61 yappy Taishukan's_Genius_English-Japanese_Dictionary_(En-Jp).dsl.tbb
13065075 39.5 279.12 646.55 shrinker Taishukan's_Genius_English-Japanese_Dictionary_(En-Jp).dsl.tbb
13124851 39.6 253.98 484.06 lzf Taishukan's_Genius_English-Japanese_Dictionary_(En-Jp).dsl.tbb
13352581 40.3 232.75 424.72 fastlz 2 Taishukan's_Genius_English-Japanese_Dictionary_(En-Jp).dsl.tbb
13476228 40.7 319.30 838.47 snappy_c Taishukan's_Genius_English-Japanese_Dictionary_(En-Jp).dsl.tbb
18457607 55.8 1075.01 2377.97 chameleon 2 Taishukan's_Genius_English-Japanese_Dictionary_(En-Jp).dsl.tbb
20269848 61.2 220.59 390.55 rans_static16 Taishukan's_Genius_English-Japanese_Dictionary_(En-Jp).dsl.tbb
33106086 100.0 6190.37 5502.09 memcpy Taishukan's_Genius_English-Japanese_Dictionary_(En-Jp).dsl.tbb
33106086 100.0 162.56 5501.18 trle Taishukan's_Genius_English-Japanese_Dictionary_(En-Jp).dsl.tbb
D:\LZ5_v2RC_VS_LZSSE2_VS_Okami>turbobenchs.exe _Cambridge.History.of.Japan.6.Volumes.Set.PDF.ebooks.tar -ezlib,9/libdeflate,9,12/xpack,9/fastlz,2/lzturbo,19,29,39/bzip2/chameleon,2/snappy_c/zstd,12,22/density,3/lz4,16/lz5,15/lzham,4/brieflz/brotli,11/crush,2/lzma,9/zpaq,2,5/lzf/yappy/trle/memcpy/lzsse2,1,17/bsc_st,6/shrinker/rans_static16 -g -k0 -J13 -B2G
TurboBench: - Wed Nov 09 22:32:15 2016
C Size ratio% C MB/s D MB/s Name File
2448490 19.7 0.30 0.30 zpaq 5 _Cambridge.History.of.Japan.6.Volumes.Set.PDF.ebooks.tar.tbb
2698592 21.7 9.12 6.20 bsc_st 6 _Cambridge.History.of.Japan.6.Volumes.Set.PDF.ebooks.tar.tbb
3226365 26.0 0.36 229.89 brotli 11 _Cambridge.History.of.Japan.6.Volumes.Set.PDF.ebooks.tar.tbb
3233782 26.0 1.18 66.40 lzma 9 _Cambridge.History.of.Japan.6.Volumes.Set.PDF.ebooks.tar.tbb
3285953 26.4 1.03 145.35 lzham 4 _Cambridge.History.of.Japan.6.Volumes.Set.PDF.ebooks.tar.tbb
3291821 26.5 1.35 350.35 zstd 22 _Cambridge.History.of.Japan.6.Volumes.Set.PDF.ebooks.tar.tbb
3303448 26.6 1.08 448.35 lzturbo 39 _Cambridge.History.of.Japan.6.Volumes.Set.PDF.ebooks.tar.tbb
3319589 26.7 10.09 21.65 bzip2 _Cambridge.History.of.Japan.6.Volumes.Set.PDF.ebooks.tar.tbb
3714226 29.9 5.46 473.42 zstd 12 _Cambridge.History.of.Japan.6.Volumes.Set.PDF.ebooks.tar.tbb
3732445 30.0 0.65 358.59 xpack 9 _Cambridge.History.of.Japan.6.Volumes.Set.PDF.ebooks.tar.tbb
3834775 30.8 0.21 239.99 crush 2 _Cambridge.History.of.Japan.6.Volumes.Set.PDF.ebooks.tar.tbb
3897858 31.4 3.11 56.99 zpaq 2 _Cambridge.History.of.Japan.6.Volumes.Set.PDF.ebooks.tar.tbb
4180254 33.6 1.14 673.95 lzturbo 29 _Cambridge.History.of.Japan.6.Volumes.Set.PDF.ebooks.tar.tbb
4257691 34.2 5.06 425.77 libdeflate 12 _Cambridge.History.of.Japan.6.Volumes.Set.PDF.ebooks.tar.tbb
4267241 34.3 7.86 424.76 libdeflate 9 _Cambridge.History.of.Japan.6.Volumes.Set.PDF.ebooks.tar.tbb
4268007 34.3 1.44 436.70 lz5 15 _Cambridge.History.of.Japan.6.Volumes.Set.PDF.ebooks.tar.tbb
4278558 585 Nakamichi-Okami ! Outside TurboBench !
4449460 35.8 11.93 223.10 zlib 9 _Cambridge.History.of.Japan.6.Volumes.Set.PDF.ebooks.tar.tbb
4455660 2069 lzsse2 17 ! SSE4.1 Outside TurboBench !
4455664 35.8 5.58 2109.33 lzsse2 17 _Cambridge.History.of.Japan.6.Volumes.Set.PDF.ebooks.tar.tbb
4523469 1076.5 lz5-2.0rc 18 ! Outside TurboBench !
4976085 40.0 1.33 2598.74 lzturbo 19 _Cambridge.History.of.Japan.6.Volumes.Set.PDF.ebooks.tar.tbb
4980575 1907.7 lz5-2.0rc 9 ! Outside TurboBench !
5022061 40.4 17.97 1844.57 lz4 16 _Cambridge.History.of.Japan.6.Volumes.Set.PDF.ebooks.tar.tbb
5418291 43.6 77.56 149.95 brieflz _Cambridge.History.of.Japan.6.Volumes.Set.PDF.ebooks.tar.tbb
5756766 46.3 228.60 219.86 density 3 _Cambridge.History.of.Japan.6.Volumes.Set.PDF.ebooks.tar.tbb
5839796 47.0 11.75 1711.51 lzsse2 1 _Cambridge.History.of.Japan.6.Volumes.Set.PDF.ebooks.tar.tbb
6675317 53.7 202.86 526.66 shrinker _Cambridge.History.of.Japan.6.Volumes.Set.PDF.ebooks.tar.tbb
6934718 55.8 168.89 360.21 lzf _Cambridge.History.of.Japan.6.Volumes.Set.PDF.ebooks.tar.tbb
7008760 56.4 61.81 1357.25 yappy _Cambridge.History.of.Japan.6.Volumes.Set.PDF.ebooks.tar.tbb
7024328 56.5 175.80 310.10 fastlz 2 _Cambridge.History.of.Japan.6.Volumes.Set.PDF.ebooks.tar.tbb
7284722 58.6 246.83 660.42 snappy_c _Cambridge.History.of.Japan.6.Volumes.Set.PDF.ebooks.tar.tbb
7313986 58.8 1083.72 1788.83 chameleon 2 _Cambridge.History.of.Japan.6.Volumes.Set.PDF.ebooks.tar.tbb
7360963 59.2 217.17 403.68 rans_static16 _Cambridge.History.of.Japan.6.Volumes.Set.PDF.ebooks.tar.tbb
12425925 99.9 146.91 1320.77 trle _Cambridge.History.of.Japan.6.Volumes.Set.PDF.ebooks.tar.tbb
12432388 100.0 6372.31 5597.65 memcpy _Cambridge.History.of.Japan.6.Volumes.Set.PDF.ebooks.tar.tbb
D:\LZ5_v2RC_VS_LZSSE2_VS_Okami>
Oh, and wanted to include 'enwik8' but the supernastily slow compression progress is currently at 54% 2.92:1, it will reach 3.00:1 no doubt.
According to one Finnish guy 'lddqu' (SSE3) is faster than 'loadu' (SSE2) due to no penalties when crossing page boundaries, 'Okami' is using 'lddqu' already.
Wonder how a CPU with 16+MB cache (5960x has 20MB) will execute the well-optimized for 16MB sliding Window Nakamichi 'Okami'?!
In my tests, LZ5 decompresses much faster than 'Okami', yet, there are exceptions, very much I want to see Haswell E/EP and Skylake in action with some 2666-3200MHz RAM, is it a single fetch with 'lddqu' (within 16MB window) really that better?!
Thanks Sanmayce. Have you tried LZ5HUF?
Hi inikep,
my pleasure to play with all those decompressors, options, and comparing them, textual madness it is.
Haven't tried LZ5HUF until this evening, so a quick showdown with my latest/strongest Nakamichi - 'Okamigan' a.k.a. 'Lonewolfeye' or more poetically 'Eye-of-the-Lonewolf'.
The benchmark package (LZ5HUF_and_LZ5_v2.0_RC_vs_Okamigan.zip 103MB) is at:
https://1drv.ms/u/s!AmWWFXGMzDmEgmoaLF9LpLtI_7SO
And again, it will be quite helpful someone to run it on some fast machine:
1] MokujIN GREEN 224 prompt.lnk
2] _BENCH.BAT
Step one goes to the console prompt enlarged to house 9999 lines, thus right mouse click 'select all' and 'Enter' will copy the whole console log to the clipboard - easy for sharing that is.
D:\LZ5HUF_and_LZ5_v2.0_RC_vs_Okamigan>dir
11/17/2016 12:01 PM 11,649,537 Agatha_Christie_89-ebooks_TXT.tar.L17.LZSSE2
11/17/2016 12:01 PM 10,122,752 Agatha_Christie_89-ebooks_TXT.tar.Nakamichi
11/17/2016 12:01 PM 5,524,854 Arabian_Nights_complete.html.L17.LZSSE2
11/17/2016 12:01 PM 5,121,395 Arabian_Nights_complete.html.Nakamichi
11/17/2016 12:01 PM 6,504,431 Big_Encyclopedia_of_Russian_Orthodox_Church_(Holy_Rus)_3-TXTs.tar.L17.LZSSE2
11/17/2016 12:01 PM 5,780,676 Big_Encyclopedia_of_Russian_Orthodox_Church_(Holy_Rus)_3-TXTs.tar.Nakamichi
11/17/2016 12:01 PM 10,429,480 Complete_Works_of_Emile_Zola.txt.L17.LZSSE2
11/17/2016 12:01 PM 9,184,423 Complete_Works_of_Emile_Zola.txt.Nakamichi
11/17/2016 12:01 PM 10,359,314 Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar.L17.LZSSE2
11/17/2016 12:01 PM 9,114,822 Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar.Nakamichi
11/17/2016 12:01 PM 274,427 lz5.exe
11/17/2016 12:01 PM 363,796 lz5huf.exe
11/17/2016 12:01 PM 1,632 MokujIN BLUE 224 prompt.lnk
11/17/2016 12:01 PM 1,632 MokujIN GREEN 224 prompt.lnk
11/17/2016 12:01 PM 636,775 Nakamichi_Okamigan.zip
11/17/2016 12:01 PM 155,648 Nakamichi_Okamigan_XMM_PREFETCH_4096_Intel_15.0_64bit_SSE41.exe
11/17/2016 12:01 PM 8,758,878 Taishukan's_Genius_English-Japanese_Dictionary_(En-Jp).dsl.L17.LZSSE2
11/17/2016 12:01 PM 7,211,857 Taishukan's_Genius_English-Japanese_Dictionary_(En-Jp).dsl.Nakamichi
11/17/2016 12:01 PM 5,160,110 The_complete_Aubrey_Maturin_by_Patrick_O'Brian_(21-TXTs).tar.L17.LZSSE2
11/17/2016 12:01 PM 4,548,859 The_complete_Aubrey_Maturin_by_Patrick_O'Brian_(21-TXTs).tar.Nakamichi
11/17/2016 12:01 PM 3,227 _BENCH.BAT
D:\LZ5HUF_and_LZ5_v2.0_RC_vs_Okamigan>_BENCH.BAT
...
At the moment I have only 7 files to test with, and the laptop is the same i5-2430M @3ghz RAM @666MHz:
--------------------------------------------------------------------------------------------------------------------------------
| Textualfile | size / decompression | decompressor |
--------------------------------------------------------------------------------------------------------------------------------
| 33,258,496 Agatha_Christie_89-ebooks_TXT.tar | 10,122,752 / 551 MB/s | Nakamichi 'Okamigan' |
| 15,583,440 Arabian_Nights_complete.html | 5,121,395 / 589 MB/s | Nakamichi 'Okamigan' |
| 23,985,664 Big_Encyclopedia_of_Russian_Orthodox_Church_(Holy_Rus)_3-TXTs.tar | 5,780,676 / 709 MB/s | Nakamichi 'Okamigan' |
| 28,959,721 Complete_Works_of_Emile_Zola.txt | 9,184,423 / 536 MB/s | Nakamichi 'Okamigan' |
| 40,303,104 Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar | 9,114,822 / 698 MB/s | Nakamichi 'Okamigan' |
| 33,106,082 Taishukan's_Genius_English-Japanese_Dictionary_(En-Jp).dsl | 7,211,857 / 803 MB/s | Nakamichi 'Okamigan' |
| 13,694,976 The_complete_Aubrey_Maturin_by_Patrick_O'Brian_(21-TXTs).tar | 4,548,859 / 593 MB/s | Nakamichi 'Okamigan' |
--------------------------------------------------------------------------------------------------------------------------------
| 33,258,496 Agatha_Christie_89-ebooks_TXT.tar | 11,709,826 / 1318 MB/s | lz5huf -B256 -b9 |
| 15,583,440 Arabian_Nights_complete.html | 5,554,762 / 1319 MB/s | lz5huf -B256 -b9 |
| 23,985,664 Big_Encyclopedia_of_Russian_Orthodox_Church_(Holy_Rus)_3-TXTs.tar | 6,556,082 / 1454 MB/s | lz5huf -B256 -b9 |
| 28,959,721 Complete_Works_of_Emile_Zola.txt | 10,421,665 / 1304 MB/s | lz5huf -B256 -b9 |
| 40,303,104 Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar | 10,441,100 / 1495 MB/s | lz5huf -B256 -b9 |
| 33,106,082 Taishukan's_Genius_English-Japanese_Dictionary_(En-Jp).dsl | 8,642,612 / 1620 MB/s | lz5huf -B256 -b9 |
| 13,694,976 The_complete_Aubrey_Maturin_by_Patrick_O'Brian_(21-TXTs).tar | 5,156,058 / 1276 MB/s | lz5huf -B256 -b9 |
--------------------------------------------------------------------------------------------------------------------------------
| 33,258,496 Agatha_Christie_89-ebooks_TXT.tar | 13,194,355 / 1877 MB/s | lz5 -B256 -b9 |
| 15,583,440 Arabian_Nights_complete.html | 6,185,910 / 1880 MB/s | lz5 -B256 -b9 |
| 23,985,664 Big_Encyclopedia_of_Russian_Orthodox_Church_(Holy_Rus)_3-TXTs.tar | 7,379,354 / 2031 MB/s | lz5 -B256 -b9 |
| 28,959,721 Complete_Works_of_Emile_Zola.txt | 11,839,846 / 1846 MB/s | lz5 -B256 -b9 |
| 40,303,104 Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar | 11,817,690 / 2071 MB/s | lz5 -B256 -b9 |
| 33,106,082 Taishukan's_Genius_English-Japanese_Dictionary_(En-Jp).dsl | 9,245,349 / 2217 MB/s | lz5 -B256 -b9 |
| 13,694,976 The_complete_Aubrey_Maturin_by_Patrick_O'Brian_(21-TXTs).tar | 5,838,641 / 1807 MB/s | lz5 -B256 -b9 |
--------------------------------------------------------------------------------------------------------------------------------
| 33,258,496 Agatha_Christie_89-ebooks_TXT.tar | 11,649,537 / 2150 MB/s | LZSSE2 level 17 |
| 15,583,440 Arabian_Nights_complete.html | 5,524,854 / 2083 MB/s | LZSSE2 level 17 |
| 23,985,664 Big_Encyclopedia_of_Russian_Orthodox_Church_(Holy_Rus)_3-TXTs.tar | 6,504,431 / 2552 MB/s | LZSSE2 level 17 |
| 28,959,721 Complete_Works_of_Emile_Zola.txt | 10,429,480 / 2107 MB/s | LZSSE2 level 17 |
| 40,303,104 Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar | 10,359,314 / 2766 MB/s | LZSSE2 level 17 |
| 33,106,082 Taishukan's_Genius_English-Japanese_Dictionary_(En-Jp).dsl | 8,758,878 / 2477 MB/s | LZSSE2 level 17 |
| 13,694,976 The_complete_Aubrey_Maturin_by_Patrick_O'Brian_(21-TXTs).tar | 5,160,110 / 2021 MB/s | LZSSE2 level 17 |
--------------------------------------------------------------------------------------------------------------------------------
| 33,258,496 Agatha_Christie_89-ebooks_TXT.tar | 9,413,645 / 568 MB/s | lz5huf -B256 -b18 |
| 15,583,440 Arabian_Nights_complete.html | 4,676,881 / 625 MB/s | lz5huf -B256 -b18 |
| 23,985,664 Big_Encyclopedia_of_Russian_Orthodox_Church_(Holy_Rus)_3-TXTs.tar | 5,174,795 / 707 MB/s | lz5huf -B256 -b18 |
| 28,959,721 Complete_Works_of_Emile_Zola.txt | 8,579,859 / 568 MB/s | lz5huf -B256 -b18 |
| 40,303,104 Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar | 8,061,307 / 733 MB/s | lz5huf -B256 -b18 |
| 33,106,082 Taishukan's_Genius_English-Japanese_Dictionary_(En-Jp).dsl | 7,014,022 / 908 MB/s | lz5huf -B256 -b18 |
| 13,694,976 The_complete_Aubrey_Maturin_by_Patrick_O'Brian_(21-TXTs).tar | 4,206,198 / 570 MB/s | lz5huf -B256 -b18 |
--------------------------------------------------------------------------------------------------------------------------------
| 33,258,496 Agatha_Christie_89-ebooks_TXT.tar | 11,290,274 / 879 MB/s | lz5 -B256 -b18 |
| 15,583,440 Arabian_Nights_complete.html | 5,539,920 / 999 MB/s | lz5 -B256 -b18 |
| 23,985,664 Big_Encyclopedia_of_Russian_Orthodox_Church_(Holy_Rus)_3-TXTs.tar | 5,961,553 / 977 MB/s | lz5 -B256 -b18 |
| 28,959,721 Complete_Works_of_Emile_Zola.txt | 10,385,084 / 850 MB/s | lz5 -B256 -b18 |
| 40,303,104 Complete_works_of_Fyodor_Dostoyevsky_in_15_volumes_(Russian).tar | 9,438,909 / 1002 MB/s | lz5 -B256 -b18 |
| 33,106,082 Taishukan's_Genius_English-Japanese_Dictionary_(En-Jp).dsl | 7,706,546 / 1205 MB/s | lz5 -B256 -b18 |
| 13,694,976 The_complete_Aubrey_Maturin_by_Patrick_O'Brian_(21-TXTs).tar | 5,070,052 / 871 MB/s | lz5 -B256 -b18 |
--------------------------------------------------------------------------------------------------------------------------------
Grrr... this slowish RAM is choking the 'Okamigan', but after seeing how LZ5HUF is thrashing 'Okamigan' in compression ratio department while decompressing faster, I can say only Woof!
This saturday night I will try to give more detailed picture of those 7 files using your Lzbench and TurboBench, including as many as possible decompressors.
I released a new version of LZ5 i.e. v2.0 RC2 with improved ratio at https://github.com/inikep/lz5/releases
LZ5HUF is now LZ5 levels -30 to -49.
I also published a new version of lzbench that includes LZ5 v2.0 RC2.
More toys, thanks a lot!
Surely your last updates in Lzbench and the levels grouped into 4 categories is much clearer and easier to use:
lz5 updated to v2.0 RC2
lz4 updated to v1.7.3
zstd updated to v1.1.1
libdeflate updated to v0.6
Instead of using console tools, now I can run only Lzbench & TurboBench in order to gather rich results into my decompression roster. I need some time to add a few ~100MB files (enwik8 included), thus files from 1MB through 120MB will be present.
Inikep, more feedback, though fragmented and far from rich-roster-ness.
Couldn't wait for 100[+]MB testdatafiles to complete (a week away), so a quick with 8 textual files benchmark. The i5-2430M is unavailable for the moment, so Q9550s @2.83GHz was used.
First thing, it is not fair to run the supermonster LZSSE2 on Core 2, it is crippled speedwise.
At a glance CSC made good to reach Top-spot in compression size with Complete_Tolkien, ring a bell? Lord-of-the-rings author.
As far as I remember the author is the little grumpy Chinese boy, jokishly calling its toy - Country-Side-Compressor, yes?
Caramba, it reached Top-position in King James Bible as well, he is to be given a candy or something, hee-hee!
csc 2016-10-13 -5 2.56 MB/s 42 MB/s 1018530 22.91 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
...
brotli24 0.5.2 -11 0.34 MB/s 241 MB/s 1056498 23.77 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
...
lzma 9.38 -9 1.45 MB/s 63 MB/s 1057446 23.79 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
xz 5.2.2 -9 1.47 MB/s 57 MB/s 1057636 23.79 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
zstd 1.1.1 -22 1.70 MB/s 411 MB/s 1074949 24.18 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
tornado 0.6a -16 1.70 MB/s 136 MB/s 1076310 24.21 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
zstd 1.1.1 -20 1.63 MB/s 409 MB/s 1076531 24.22 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lzham 1.0 -d26 -4 1.01 MB/s 141 MB/s 1077978 24.25 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
...
lz5 2.0 RC2 -49 1.68 MB/s 583 MB/s 1246110 28.03 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
...
xpack 2016-06-02 -9 8.88 MB/s 364 MB/s 1297344 29.18 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
...
lz5 2.0 RC2 -39 4.12 MB/s 695 MB/s 1361566 30.63 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
Nakamichi 'Okamigan' 635 MB/s 1390843 ! Outside lzbench !
lzsse2 2016-05-14 -17 4.40 MB/s 950 MB/s 1390894 31.29 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
This small 4MB file is not burdened by uncached (LLC is 12MB) references, so it is good for seeing mainly how clock speeds and mispredictions (pipelines) are of a factor.
ADDITIONALLY fast RAM kits will show different picture I am sure, 'Okamigan' will perform 2x-3x faster, this was seen a year ago in its old cousin 'Shifune':
- 1st column: Intel Core 2 Q9550s 'Yorkfield' @2833MHz 45nm, Cache 12MB, RAM @666MHz DDR2 CL5 CR2, laptop Asus;
- 2nd column: Intel i7 4960x 'Ivy Bridge E' 22nm, Cache 15MB, core @4600MHz RAM @2133mhz 8-10-10-21 CR1; MOBO Asus Rampage IV Black Edition;
http://cdn.overclock.net/8/8b/8b9d96b9_decompshowdwn.jpeg - 3rd column: Intel i7 5960x 'Haswell E/EP' 22nm, Cache 20MB, core/cache @4700MHz/@4200MHz RAM @2666MHz; MOBO Asus Rampage V Extreme;
http://cdn.overclock.net/8/8b/8b2c8f32_decompshowdown.jpeg - 4th column: Intel Core i5 6600K 'Skylake' 14nm, Cache 6MB, core/cache @4700MHz/4500MHz RAM @3200mhz CL15; MOBO Asus Maximus VIII Extreme;
http://cdn.overclock.net/6/6b/6b1770b9_decompshowdown.jpeg
--------------------------------------------------------------------------------------------------------------------------------------------------------------
| testdatafile | Yorkfield | Ivy Bridge E | Haswell E/EP | Skylake |
--------------------------------------------------------------------------------------------------------------------------------------------------------------
| 4,445,260 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt | | | | |
| 1,076,637 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.256MB.lzturbo12-39.lzt | N.A. | N.A. | N.A. | N.A. |
| 1,089,279 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.4MB.lzturbo12-39.lzt | N.A. | N.A. | N.A. | N.A. |
| 1,087,439 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.brotli | 160.277 MB/s | 304.988 MB/s | 339.146 MB/s | 370.247 MB/s |
| 1,441,679 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.Nakamichi | 704 MB/s | 2048 MB/s | 2432 MB/s | 2368 MB/s |
| 1,320,100 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.zip | N.A. | N.A. | N.A. | N.A. |
| 1,537,047 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.zst | 320.7 MB/s | 622.4 MB/s | 656.1 MB/s | 668.6 MB/s |
| 1,286,796 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.method28.zpaq | N.A. | N.A. | N.A. | N.A. |
| 855,786 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.ST6Block256.bsc | N.A. | N.A. | N.A. | N.A. |
| 1,056,804 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.xz | N.A. | N.A. | N.A. | N.A. |
--------------------------------------------------------------------------------------------------------------------------------------------------------------
Another surprise did come from Yappy, usually Yappy doesn't shine but with the biggest Polish dictionary it does:
brotli24 0.5.2 -11 0.09 MB/s 246 MB/s 6234190 11.52 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
brotli 0.5.2 -11 0.14 MB/s 267 MB/s 6281327 11.61 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
csc 2016-10-13 -5 1.87 MB/s 58 MB/s 6556444 12.12 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
brotli24 0.5.2 -10 0.23 MB/s 247 MB/s 6733920 12.45 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lzlib 1.7 -9 0.85 MB/s 52 MB/s 6950867 12.85 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lzma 9.38 -9 1.47 MB/s 79 MB/s 6979585 12.90 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
xz 5.2.2 -9 1.56 MB/s 68 MB/s 6988492 12.92 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lzham 1.0 -d26 -4 0.78 MB/s 130 MB/s 7511351 13.88 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lzham 1.0 -d26 -1 2.08 MB/s 132 MB/s 7749388 14.32 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
zstd 1.1.1 -22 0.77 MB/s 408 MB/s 7827812 14.47 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
zstd 1.1.1 -20 1.37 MB/s 409 MB/s 7829273 14.47 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
zstd 1.1.1 -18 2.54 MB/s 413 MB/s 7863394 14.53 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
tornado 0.6a -16 1.41 MB/s 136 MB/s 8072569 14.92 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
brotli24 0.5.2 -9 3.86 MB/s 291 MB/s 8304563 15.35 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
libdeflate 16-08-29 -12 3.88 MB/s 487 MB/s 8345954 15.42 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
brotli24 0.5.2 -8 6.29 MB/s 290 MB/s 8389409 15.51 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
brotli24 0.5.2 -7 9.47 MB/s 289 MB/s 8455556 15.63 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
brotli24 0.5.2 -6 13 MB/s 283 MB/s 8766786 16.20 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
brotli24 0.5.2 -5 17 MB/s 279 MB/s 8824349 16.31 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
zling 2016-01-10 -4 32 MB/s 158 MB/s 9218367 17.04 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
brotli24 0.5.2 -2 62 MB/s 265 MB/s 9251327 17.10 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
zstd 1.1.1 -16 6.54 MB/s 462 MB/s 9497523 17.55 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
zstd 1.1.1 -12 16 MB/s 461 MB/s 9522897 17.60 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
brotli24 0.5.2 -3 51 MB/s 270 MB/s 9526635 17.61 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
zstd 1.1.1 -14 8.98 MB/s 464 MB/s 9583490 17.71 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
brotli24 0.5.2 -4 27 MB/s 275 MB/s 9645205 17.83 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
xpack 2016-06-02 -9 8.93 MB/s 417 MB/s 9795144 18.10 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
zlib 1.2.8 -9 3.14 MB/s 282 MB/s 10052370 18.58 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lzfse 2016-08-16 40 MB/s 471 MB/s 10059545 18.59 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lz5 2.0 RC2 -39 4.11 MB/s 608 MB/s 10701923 19.78 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lz5 2.0 RC2 -49 0.68 MB/s 683 MB/s 11566159 21.38 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lz5 2.0 RC2 -35 32 MB/s 616 MB/s 11625384 21.49 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lz5 2.0 RC2 -32 67 MB/s 603 MB/s 11770425 21.75 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lzmat 1.01 6.17 MB/s 247 MB/s 11830613 21.86 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lz5 2.0 RC2 -45 6.54 MB/s 644 MB/s 11990039 22.16 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
brotli24 0.5.2 -1 142 MB/s 243 MB/s 12132185 22.42 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
crush 1.0 -2 0.15 MB/s 242 MB/s 12169879 22.49 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
yappy 2014-03-22 -100 32 MB/s 1125 MB/s 12567098 23.23 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
brotli24 0.5.2 -0 187 MB/s 253 MB/s 12593615 23.28 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lz5 2.0 RC2 -42 27 MB/s 667 MB/s 12717833 23.50 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
Nakamichi 'Okamigan' 699 MB/s 13001650 ! Outside lzbench !
lzo1y 2.09 -999 2.53 MB/s 505 MB/s 13019601 24.06 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
Cannot figure it out, the parsing is quite good and decompression is excellent, wonder what the numbers will be with 10000...
As for the most revered etymological/encyclopedic Chinese-Chinese dictionary - 'Sea-Of-Words', my toy delivers goodness - trumped only by Yann's zstd and Eric's xpack and surely by rest ANS performers.
...
brotli24 0.5.2 -11 0.33 MB/s 174 MB/s 11086971 25.83 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
zstd 1.1.1 -22 1.49 MB/s 255 MB/s 11200788 26.10 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
lzham 1.0 -d26 -1 1.39 MB/s 129 MB/s 11222645 26.15 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
tornado 0.6a -16 1.51 MB/s 111 MB/s 11227828 26.16 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
zstd 1.1.1 -20 1.62 MB/s 260 MB/s 11271098 26.26 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
brotli24 0.5.2 -10 0.65 MB/s 167 MB/s 11471508 26.73 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
brotli 0.5.2 -11 0.35 MB/s 210 MB/s 11585635 26.99 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
zstd 1.1.1 -18 2.41 MB/s 368 MB/s 12620133 29.40 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
brotli24 0.5.2 -9 1.29 MB/s 182 MB/s 12816910 29.86 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
zling 2016-01-10 -4 16 MB/s 89 MB/s 13068285 30.45 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
brotli24 0.5.2 -8 2.03 MB/s 187 MB/s 13069532 30.45 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
zstd 1.1.1 -16 4.27 MB/s 371 MB/s 13332565 31.06 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
brotli24 0.5.2 -7 3.91 MB/s 197 MB/s 13403539 31.23 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
zstd 1.1.1 -14 6.78 MB/s 418 MB/s 13717459 31.96 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
zstd 1.1.1 -12 11 MB/s 416 MB/s 13811568 32.18 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
crush 1.0 -2 0.53 MB/s 199 MB/s 13817818 32.19 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
xpack 2016-06-02 -9 16 MB/s 347 MB/s 13880854 32.34 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
brotli24 0.5.2 -6 11 MB/s 202 MB/s 14011329 32.65 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
brotli24 0.5.2 -5 15 MB/s 199 MB/s 14308064 33.34 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
Nakamichi 'Okamigan' 313 MB/s 14560763 ! Outside lzbench !
lz5 2.0 RC2 -49 1.50 MB/s 611 MB/s 14737678 34.34 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
libdeflate 16-08-29 -12 4.32 MB/s 379 MB/s 14779857 34.44 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
...
What I visualize is one rich roster of textual files made by mixing the output of Lzbench and TurboBench, thus the gaps will be filled and such goodies as Ilya Grebnov's bsc and Hamid's LzTurbo will give a nearly definitive picture of todays decompressors.
Ugh, forgot to give the benchmark itself:
https://1drv.ms/u/s!AmWWFXGMzDmEgmsa1z7eIcSRxJ30
Its console log below:
D:\TEXTUAL_MADNESS_old\Nakamichi_Okamigan\LZ5[HUF]_v2.0_RC2_vs_Okamigan>dir
11/23/2016 04:31 PM 10,446,848 github.com_inikep_lzbench-1.5.tar
11/23/2016 04:31 PM 2,047,711 github.com_inikep_lzbench-1.5.tar.L17.LZSSE2
11/23/2016 04:31 PM 2,126,928 github.com_inikep_lzbench-1.5.tar.Nakamichi
11/23/2016 04:31 PM 42,920,232 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
11/23/2016 04:31 PM 16,550,167 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl.L17.LZSSE2
11/23/2016 04:31 PM 14,560,763 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl.Nakamichi
11/23/2016 04:31 PM 29,603,328 JRR_Tolkien_complete.tar
11/23/2016 04:31 PM 10,300,511 JRR_Tolkien_complete.tar.L17.LZSSE2
11/23/2016 04:31 PM 8,611,959 JRR_Tolkien_complete.tar.Nakamichi
11/23/2016 04:31 PM 9,078,220 lzbench.exe
11/23/2016 04:31 PM 1,632 MokujIN BLUE 224 prompt.lnk
11/23/2016 04:31 PM 1,632 MokujIN GREEN 224 prompt.lnk
11/23/2016 04:31 PM 636,775 Nakamichi_Okamigan.zip
11/23/2016 04:31 PM 155,648 Nakamichi_Okamigan_XMM_PREFETCH_4096_Intel_15.0_64bit_SSE41.exe
11/23/2016 04:31 PM 54,107,648 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
11/23/2016 04:31 PM 13,339,144 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar.L17.LZSSE2
11/23/2016 04:31 PM 13,001,650 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar.Nakamichi
11/23/2016 04:31 PM 17,204,128 Slownik_jezyka_polskiego_(Pol-Pol).dsl
11/23/2016 04:31 PM 3,496,527 Slownik_jezyka_polskiego_(Pol-Pol).dsl.L17.LZSSE2
11/23/2016 04:31 PM 2,973,800 Slownik_jezyka_polskiego_(Pol-Pol).dsl.Nakamichi
11/23/2016 04:31 PM 36,390,400 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
11/23/2016 04:31 PM 10,658,848 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar.L17.LZSSE2
11/23/2016 04:31 PM 9,104,050 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar.Nakamichi
11/23/2016 04:31 PM 4,445,260 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
11/23/2016 04:31 PM 1,390,894 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.L17.LZSSE2
11/23/2016 04:31 PM 1,390,843 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.Nakamichi
11/23/2016 04:31 PM 19,286,528 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
11/23/2016 04:31 PM 6,895,904 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar.L17.LZSSE2
11/23/2016 04:31 PM 6,496,052 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar.Nakamichi
11/23/2016 04:31 PM 5,612 _BENCH.BAT
D:\TEXTUAL_MADNESS_old\Nakamichi_Okamigan\LZ5[HUF]_v2.0_RC2_vs_Okamigan>_BENCH.BAT
D:\TEXTUAL_MADNESS_old\Nakamichi_Okamigan\LZ5[HUF]_v2.0_RC2_vs_Okamigan>lzbench.exe -c4 -ebrotli,11/brotli24/tornado,16/blosclz,9/brieflz/crush,2/csc,5/density,3/fastlz,2/gipfeli/zstd,12,14,16,18,20,22/lzo1b,999/lzo1c,999/lzo1f,999/lzo1x,999/lzo1y,999/lzham,4/libdeflate,12/lz4/lz4fast,17/lz4hc,16/lz5,10,12,15,19,20,22,25,29,30,32,35,39,40,42,45,49/lzf,1/lzfse/lzg,8/lzham,1/lzjb/lzlib,9/lzma,9/lzrw,5/lzsse2,17/lzsse4,17/lzsse8,17/lzvn/pithy,9/quicklz,3/snappy/slz_zlib,3/ucl_nrv2b,9/ucl_nrv2d,9/ucl_nrv2e,9/xpack,9/xz,9/yalz77,12/yappy,100/zlib,9/zling,4/shrinker/wflz/lzmat The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lzbench 1.5 (64-bit Windows) Assembled by P.Skibinski
...
The results sorted by column number 4:
Compressor name Compress. Decompress. Compr. size Ratio Filename
csc 2016-10-13 -5 2.56 MB/s 42 MB/s 1018530 22.91 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lzlib 1.7 -9 1.42 MB/s 42 MB/s 1055781 23.75 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
brotli24 0.5.2 -11 0.34 MB/s 241 MB/s 1056498 23.77 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
brotli 0.5.2 -11 0.34 MB/s 244 MB/s 1056618 23.77 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lzma 9.38 -9 1.44 MB/s 63 MB/s 1057446 23.79 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
xz 5.2.2 -9 1.47 MB/s 57 MB/s 1057636 23.79 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
zstd 1.1.1 -22 1.70 MB/s 411 MB/s 1074949 24.18 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
tornado 0.6a -16 1.70 MB/s 136 MB/s 1076310 24.21 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
zstd 1.1.1 -20 1.63 MB/s 409 MB/s 1076531 24.22 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lzham 1.0 -d26 -4 1.01 MB/s 141 MB/s 1077978 24.25 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
brotli24 0.5.2 -10 0.80 MB/s 220 MB/s 1079720 24.29 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
zstd 1.1.1 -18 2.01 MB/s 414 MB/s 1080090 24.30 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
zstd 1.1.1 -16 3.20 MB/s 425 MB/s 1159458 26.08 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lzham 1.0 -d26 -1 1.53 MB/s 128 MB/s 1164061 26.19 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
zling 2016-01-10 -4 23 MB/s 111 MB/s 1177552 26.49 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
brotli24 0.5.2 -9 4.27 MB/s 247 MB/s 1190023 26.77 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
zstd 1.1.1 -14 3.75 MB/s 414 MB/s 1194509 26.87 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
brotli24 0.5.2 -8 5.86 MB/s 243 MB/s 1208937 27.20 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
zstd 1.1.1 -12 8.30 MB/s 409 MB/s 1211792 27.26 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
brotli24 0.5.2 -7 8.01 MB/s 239 MB/s 1232977 27.74 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
crush 1.0 -2 0.28 MB/s 214 MB/s 1245176 28.01 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lz5 2.0 RC2 -49 1.68 MB/s 583 MB/s 1246110 28.03 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
brotli24 0.5.2 -6 11 MB/s 231 MB/s 1272052 28.62 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
xpack 2016-06-02 -9 8.88 MB/s 364 MB/s 1297344 29.18 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
brotli24 0.5.2 -5 13 MB/s 221 MB/s 1311737 29.51 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
libdeflate 16-08-29 -12 3.92 MB/s 421 MB/s 1318620 29.66 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lz5 2.0 RC2 -39 4.12 MB/s 695 MB/s 1361566 30.63 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
Nakamichi 'Okamigan' 635 MB/s 1390843 ! Outside lzbench !
lzsse2 2016-05-14 -17 4.40 MB/s 950 MB/s 1390894 31.29 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
zlib 1.2.8 -9 6.33 MB/s 209 MB/s 1392038 31.32 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lzsse4 2016-05-14 -17 5.31 MB/s 836 MB/s 1398971 31.47 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lz5 2.0 RC2 -45 4.85 MB/s 559 MB/s 1402901 31.56 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
brotli24 0.5.2 -4 23 MB/s 215 MB/s 1404607 31.60 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lzfse 2016-08-16 29 MB/s 344 MB/s 1422806 32.01 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lzsse8 2016-05-14 -17 4.94 MB/s 775 MB/s 1423249 32.02 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
brotli24 0.5.2 -3 43 MB/s 198 MB/s 1445593 32.52 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
brotli24 0.5.2 -2 50 MB/s 192 MB/s 1461991 32.89 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lz5 2.0 RC2 -29 1.76 MB/s 779 MB/s 1468773 33.04 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
ucl_nrv2e 1.03 -9 0.88 MB/s 161 MB/s 1494978 33.63 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
ucl_nrv2d 1.03 -9 0.88 MB/s 167 MB/s 1512032 34.01 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
brotli24 0.5.2 -1 100 MB/s 176 MB/s 1517064 34.13 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lzo1b 2.09 -999 7.02 MB/s 417 MB/s 1531566 34.45 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lz5 2.0 RC2 -35 29 MB/s 771 MB/s 1532054 34.46 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lz5 2.0 RC2 -42 24 MB/s 574 MB/s 1533608 34.50 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
ucl_nrv2b 1.03 -9 0.88 MB/s 162 MB/s 1542414 34.70 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lz5 2.0 RC2 -19 4.15 MB/s 893 MB/s 1574995 35.43 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lzo1y 2.09 -999 3.49 MB/s 326 MB/s 1590574 35.78 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lzmat 1.01 10 MB/s 198 MB/s 1592582 35.83 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lzo1x 2.09 -999 3.44 MB/s 333 MB/s 1594633 35.87 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lz4hc 1.7.3 -16 9.62 MB/s 983 MB/s 1598095 35.95 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lz5 2.0 RC2 -25 5.04 MB/s 769 MB/s 1632064 36.71 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lz5 2.0 RC2 -40 70 MB/s 527 MB/s 1642782 36.96 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
brotli24 0.5.2 -0 123 MB/s 163 MB/s 1665688 37.47 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lz5 2.0 RC2 -15 30 MB/s 943 MB/s 1675427 37.69 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lzo1c 2.09 -999 13 MB/s 384 MB/s 1675488 37.69 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lz5 2.0 RC2 -32 52 MB/s 725 MB/s 1684714 37.90 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
brieflz 1.1.0 63 MB/s 108 MB/s 1727013 38.85 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lzo1f 2.09 -999 11 MB/s 337 MB/s 1746433 39.29 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lzvn 2016-08-16 24 MB/s 462 MB/s 1786500 40.19 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
quicklz 1.5.0 -3 27 MB/s 446 MB/s 1793134 40.34 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lzg 1.0.8 -8 5.76 MB/s 406 MB/s 1811659 40.75 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lzrw 15-Jul-1991 -5 68 MB/s 252 MB/s 1834261 41.26 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
gipfeli 2016-07-13 154 MB/s 264 MB/s 1840556 41.40 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
yalz77 2015-09-19 -12 23 MB/s 191 MB/s 1845753 41.52 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lz5 2.0 RC2 -22 26 MB/s 802 MB/s 1854663 41.72 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lz5 2.0 RC2 -12 56 MB/s 885 MB/s 1862207 41.89 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lz5 2.0 RC2 -30 130 MB/s 463 MB/s 1904738 42.85 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
pithy 2011-12-24 -9 193 MB/s 693 MB/s 1958473 44.06 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
density 0.12.5 beta -3 183 MB/s 159 MB/s 1969082 44.30 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lz5 2.0 RC2 -20 79 MB/s 716 MB/s 2003683 45.07 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
yappy 2014-03-22 -100 39 MB/s 692 MB/s 2054789 46.22 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
shrinker 0.1 154 MB/s 427 MB/s 2185903 49.17 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lzf 3.6 -1 161 MB/s 326 MB/s 2209914 49.71 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
fastlz 0.1 -2 153 MB/s 275 MB/s 2240029 50.39 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
slz_zlib 1.0.0 -3 117 MB/s 161 MB/s 2251376 50.65 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
blosclz 2015-11-10 -9 127 MB/s 308 MB/s 2278725 51.26 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
snappy 1.1.3 163 MB/s 533 MB/s 2294833 51.62 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lz4 1.7.3 188 MB/s 999 MB/s 2302339 51.79 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lz5 2.0 RC2 -10 166 MB/s 909 MB/s 2303208 51.81 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
wflz 2015-09-16 137 MB/s 402 MB/s 2792378 62.82 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lzjb 2010 127 MB/s 263 MB/s 2891920 65.06 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lz4fast 1.7.3 -17 358 MB/s 1160 MB/s 3454525 77.71 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
D:\TEXTUAL_MADNESS_old\Nakamichi_Okamigan\LZ5[HUF]_v2.0_RC2_vs_Okamigan>lzbench.exe -c4 -ebrotli,11/brotli24/tornado,16/blosclz,9/brieflz/crush,2/csc,5/density,3/fastlz,2/gipfeli/zstd,12,14,16,18,20,22/lzo1b,999/lzo1c,999/lzo1f,999/lzo1x,999/lzo1y,999/lzham,4/libdeflate,12/lz4/lz4fast,17/lz4hc,16/lz5,10,12,15,19,20,22,25,29,30,32,35,39,40,42,45,49/lzf,1/lzfse/lzg,8/lzham,1/lzjb/lzlib,9/lzma,9/lzrw,5/lzsse2,17/lzsse4,17/lzsse8,17/lzvn/pithy,9/quicklz,3/snappy/slz_zlib,3/ucl_nrv2b,9/ucl_nrv2d,9/ucl_nrv2e,9/xpack,9/xz,9/yalz77,12/yappy,100/zlib,9/zling,4/shrinker/wflz/lzmat github.com_inikep_lzbench-1.5.tar
lzbench 1.5 (64-bit Windows) Assembled by P.Skibinski
...
The results sorted by column number 4:
Compressor name Compress. Decompress. Compr. size Ratio Filename
lzlib 1.7 -9 1.37 MB/s 67 MB/s 1272643 12.18 github.com_inikep_lzbench-1.5.tar
brotli24 0.5.2 -11 0.36 MB/s 310 MB/s 1282237 12.27 github.com_inikep_lzbench-1.5.tar
xz 5.2.2 -9 2.25 MB/s 94 MB/s 1286684 12.32 github.com_inikep_lzbench-1.5.tar
lzma 9.38 -9 2.04 MB/s 105 MB/s 1286712 12.32 github.com_inikep_lzbench-1.5.tar
brotli24 0.5.2 -10 0.87 MB/s 291 MB/s 1323455 12.67 github.com_inikep_lzbench-1.5.tar
brotli 0.5.2 -11 0.37 MB/s 340 MB/s 1336079 12.79 github.com_inikep_lzbench-1.5.tar
zstd 1.1.1 -22 1.38 MB/s 614 MB/s 1350628 12.93 github.com_inikep_lzbench-1.5.tar
zstd 1.1.1 -20 2.41 MB/s 612 MB/s 1360430 13.02 github.com_inikep_lzbench-1.5.tar
csc 2016-10-13 -5 2.53 MB/s 80 MB/s 1361821 13.04 github.com_inikep_lzbench-1.5.tar
lzham 1.0 -d26 -4 1.07 MB/s 221 MB/s 1385233 13.26 github.com_inikep_lzbench-1.5.tar
tornado 0.6a -16 1.86 MB/s 205 MB/s 1393016 13.33 github.com_inikep_lzbench-1.5.tar
zstd 1.1.1 -18 3.58 MB/s 631 MB/s 1400226 13.40 github.com_inikep_lzbench-1.5.tar
brotli24 0.5.2 -9 6.02 MB/s 335 MB/s 1473494 14.10 github.com_inikep_lzbench-1.5.tar
lzham 1.0 -d26 -1 2.08 MB/s 211 MB/s 1475783 14.13 github.com_inikep_lzbench-1.5.tar
zstd 1.1.1 -16 5.86 MB/s 643 MB/s 1476927 14.14 github.com_inikep_lzbench-1.5.tar
brotli24 0.5.2 -8 8.36 MB/s 329 MB/s 1494440 14.31 github.com_inikep_lzbench-1.5.tar
brotli24 0.5.2 -7 11 MB/s 326 MB/s 1518170 14.53 github.com_inikep_lzbench-1.5.tar
zling 2016-01-10 -4 43 MB/s 179 MB/s 1556501 14.90 github.com_inikep_lzbench-1.5.tar
zstd 1.1.1 -14 11 MB/s 612 MB/s 1570841 15.04 github.com_inikep_lzbench-1.5.tar
brotli24 0.5.2 -6 16 MB/s 319 MB/s 1570960 15.04 github.com_inikep_lzbench-1.5.tar
zstd 1.1.1 -12 18 MB/s 599 MB/s 1591799 15.24 github.com_inikep_lzbench-1.5.tar
brotli24 0.5.2 -5 20 MB/s 307 MB/s 1631988 15.62 github.com_inikep_lzbench-1.5.tar
lz5 2.0 RC2 -49 0.76 MB/s 894 MB/s 1658971 15.88 github.com_inikep_lzbench-1.5.tar
xpack 2016-06-02 -9 17 MB/s 517 MB/s 1695521 16.23 github.com_inikep_lzbench-1.5.tar
crush 1.0 -2 1.10 MB/s 327 MB/s 1697600 16.25 github.com_inikep_lzbench-1.5.tar
libdeflate 16-08-29 -12 3.19 MB/s 597 MB/s 1751648 16.77 github.com_inikep_lzbench-1.5.tar
brotli24 0.5.2 -4 31 MB/s 294 MB/s 1821248 17.43 github.com_inikep_lzbench-1.5.tar
zlib 1.2.8 -9 5.83 MB/s 311 MB/s 1850703 17.72 github.com_inikep_lzbench-1.5.tar
lzfse 2016-08-16 41 MB/s 531 MB/s 1885468 18.05 github.com_inikep_lzbench-1.5.tar
lz5 2.0 RC2 -45 6.65 MB/s 779 MB/s 1895495 18.14 github.com_inikep_lzbench-1.5.tar
ucl_nrv2e 1.03 -9 1.97 MB/s 266 MB/s 1898928 18.18 github.com_inikep_lzbench-1.5.tar
lz5 2.0 RC2 -29 0.81 MB/s 1167 MB/s 1904972 18.23 github.com_inikep_lzbench-1.5.tar
brotli24 0.5.2 -3 59 MB/s 279 MB/s 1908327 18.27 github.com_inikep_lzbench-1.5.tar
ucl_nrv2d 1.03 -9 1.98 MB/s 275 MB/s 1915600 18.34 github.com_inikep_lzbench-1.5.tar
ucl_nrv2b 1.03 -9 1.94 MB/s 271 MB/s 1934686 18.52 github.com_inikep_lzbench-1.5.tar
lz5 2.0 RC2 -39 1.20 MB/s 984 MB/s 1954268 18.71 github.com_inikep_lzbench-1.5.tar
brotli24 0.5.2 -2 68 MB/s 267 MB/s 1956587 18.73 github.com_inikep_lzbench-1.5.tar
lzmat 1.01 16 MB/s 275 MB/s 2045672 19.58 github.com_inikep_lzbench-1.5.tar
lzsse2 2016-05-14 -17 1.20 MB/s 1253 MB/s 2047711 19.60 github.com_inikep_lzbench-1.5.tar
lzsse4 2016-05-14 -17 1.27 MB/s 1108 MB/s 2070828 19.82 github.com_inikep_lzbench-1.5.tar
brotli24 0.5.2 -1 155 MB/s 247 MB/s 2078594 19.90 github.com_inikep_lzbench-1.5.tar
lz5 2.0 RC2 -42 32 MB/s 791 MB/s 2097482 20.08 github.com_inikep_lzbench-1.5.tar
lzo1y 2.09 -999 4.03 MB/s 564 MB/s 2103813 20.14 github.com_inikep_lzbench-1.5.tar
lzsse8 2016-05-14 -17 1.20 MB/s 1029 MB/s 2114603 20.24 github.com_inikep_lzbench-1.5.tar
lzo1b 2.09 -999 10 MB/s 667 MB/s 2121797 20.31 github.com_inikep_lzbench-1.5.tar
Nakamichi 'Okamigan' 852 MB/s 2126928 ! Outside lzbench !
lzo1x 2.09 -999 3.93 MB/s 578 MB/s 2135379 20.44 github.com_inikep_lzbench-1.5.tar
lz5 2.0 RC2 -35 43 MB/s 1007 MB/s 2167955 20.75 github.com_inikep_lzbench-1.5.tar
lz5 2.0 RC2 -19 1.22 MB/s 1229 MB/s 2183515 20.90 github.com_inikep_lzbench-1.5.tar
lz4hc 1.7.3 -16 4.60 MB/s 1245 MB/s 2198539 21.04 github.com_inikep_lzbench-1.5.tar
lz5 2.0 RC2 -25 7.32 MB/s 1079 MB/s 2221506 21.26 github.com_inikep_lzbench-1.5.tar
lz5 2.0 RC2 -40 124 MB/s 733 MB/s 2275605 21.78 github.com_inikep_lzbench-1.5.tar
quicklz 1.5.0 -3 41 MB/s 660 MB/s 2316558 22.17 github.com_inikep_lzbench-1.5.tar
lz5 2.0 RC2 -32 72 MB/s 851 MB/s 2350796 22.50 github.com_inikep_lzbench-1.5.tar
brotli24 0.5.2 -0 191 MB/s 240 MB/s 2361426 22.60 github.com_inikep_lzbench-1.5.tar
lz5 2.0 RC2 -15 45 MB/s 1280 MB/s 2375756 22.74 github.com_inikep_lzbench-1.5.tar
brieflz 1.1.0 94 MB/s 160 MB/s 2384951 22.83 github.com_inikep_lzbench-1.5.tar
lzo1c 2.09 -999 9.03 MB/s 610 MB/s 2399924 22.97 github.com_inikep_lzbench-1.5.tar
lzo1f 2.09 -999 8.81 MB/s 558 MB/s 2405366 23.02 github.com_inikep_lzbench-1.5.tar
lzg 1.0.8 -8 11 MB/s 547 MB/s 2427630 23.24 github.com_inikep_lzbench-1.5.tar
lzvn 2016-08-16 35 MB/s 628 MB/s 2457470 23.52 github.com_inikep_lzbench-1.5.tar
lz5 2.0 RC2 -22 34 MB/s 1103 MB/s 2490817 23.84 github.com_inikep_lzbench-1.5.tar
yalz77 2015-09-19 -12 34 MB/s 273 MB/s 2531167 24.23 github.com_inikep_lzbench-1.5.tar
lz5 2.0 RC2 -30 207 MB/s 625 MB/s 2676372 25.62 github.com_inikep_lzbench-1.5.tar
lz5 2.0 RC2 -12 77 MB/s 1226 MB/s 2704767 25.89 github.com_inikep_lzbench-1.5.tar
lz5 2.0 RC2 -20 144 MB/s 1029 MB/s 2729031 26.12 github.com_inikep_lzbench-1.5.tar
gipfeli 2016-07-13 236 MB/s 359 MB/s 2731430 26.15 github.com_inikep_lzbench-1.5.tar
pithy 2011-12-24 -9 294 MB/s 846 MB/s 2743715 26.26 github.com_inikep_lzbench-1.5.tar
lzrw 15-Jul-1991 -5 92 MB/s 369 MB/s 2869162 27.46 github.com_inikep_lzbench-1.5.tar
shrinker 0.1 240 MB/s 602 MB/s 2976885 28.50 github.com_inikep_lzbench-1.5.tar
slz_zlib 1.0.0 -3 185 MB/s 225 MB/s 3088178 29.56 github.com_inikep_lzbench-1.5.tar
yappy 2014-03-22 -100 38 MB/s 1024 MB/s 3089504 29.57 github.com_inikep_lzbench-1.5.tar
fastlz 0.1 -2 230 MB/s 396 MB/s 3173632 30.38 github.com_inikep_lzbench-1.5.tar
lz4 1.7.3 316 MB/s 1115 MB/s 3245582 31.07 github.com_inikep_lzbench-1.5.tar
snappy 1.1.3 276 MB/s 744 MB/s 3285509 31.45 github.com_inikep_lzbench-1.5.tar
blosclz 2015-11-10 -9 199 MB/s 477 MB/s 3314086 31.72 github.com_inikep_lzbench-1.5.tar
density 0.12.5 beta -3 192 MB/s 176 MB/s 3386670 32.42 github.com_inikep_lzbench-1.5.tar
lz5 2.0 RC2 -10 267 MB/s 1111 MB/s 3395872 32.51 github.com_inikep_lzbench-1.5.tar
lzf 3.6 -1 239 MB/s 411 MB/s 3461918 33.14 github.com_inikep_lzbench-1.5.tar
wflz 2015-09-16 242 MB/s 612 MB/s 4008371 38.37 github.com_inikep_lzbench-1.5.tar
lzjb 2010 191 MB/s 374 MB/s 4479949 42.88 github.com_inikep_lzbench-1.5.tar
lz4fast 1.7.3 -17 442 MB/s 1195 MB/s 4684571 44.84 github.com_inikep_lzbench-1.5.tar
D:\TEXTUAL_MADNESS_old\Nakamichi_Okamigan\LZ5[HUF]_v2.0_RC2_vs_Okamigan>lzbench.exe -c4 -ebrotli,11/brotli24/tornado,16/blosclz,9/brieflz/crush,2/csc,5/density,3/fastlz,2/gipfeli/zstd,12,14,16,18,20,22/lzo1b,999/lzo1c,999/lzo1f,999/lzo1x,999/lzo1y,999/lzham,4/libdeflate,12/lz4/lz4fast,17/lz4hc,16/lz5,10,12,15,19,20,22,25,29,30,32,35,39,40,42,45,49/lzf,1/lzfse/lzg,8/lzham,1/lzjb/lzlib,9/lzma,9/lzrw,5/lzsse2,17/lzsse4,17/lzsse8,17/lzvn/pithy,9/quicklz,3/snappy/slz_zlib,3/ucl_nrv2b,9/ucl_nrv2d,9/ucl_nrv2e,9/xpack,9/xz,9/yalz77,12/yappy,100/zlib,9/zling,4/shrinker/wflz/lzmat Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
lzbench 1.5 (64-bit Windows) Assembled by P.Skibinski
...
The results sorted by column number 4:
Compressor name Compress. Decompress. Compr. size Ratio Filename
lzlib 1.7 -9 1.21 MB/s 40 MB/s 10286465 23.97 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
xz 5.2.2 -9 1.41 MB/s 51 MB/s 10292128 23.98 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
lzma 9.38 -9 1.33 MB/s 55 MB/s 10292604 23.98 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
lzham 1.0 -d26 -4 0.84 MB/s 130 MB/s 10405355 24.24 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
csc 2016-10-13 -5 1.58 MB/s 39 MB/s 10559301 24.60 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
brotli24 0.5.2 -11 0.33 MB/s 174 MB/s 11086971 25.83 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
zstd 1.1.1 -22 1.49 MB/s 255 MB/s 11200788 26.10 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
lzham 1.0 -d26 -1 1.39 MB/s 129 MB/s 11222645 26.15 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
tornado 0.6a -16 1.51 MB/s 111 MB/s 11227828 26.16 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
zstd 1.1.1 -20 1.62 MB/s 260 MB/s 11271098 26.26 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
brotli24 0.5.2 -10 0.65 MB/s 167 MB/s 11471508 26.73 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
brotli 0.5.2 -11 0.35 MB/s 210 MB/s 11585635 26.99 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
zstd 1.1.1 -18 2.41 MB/s 368 MB/s 12620133 29.40 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
brotli24 0.5.2 -9 1.29 MB/s 182 MB/s 12816910 29.86 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
zling 2016-01-10 -4 16 MB/s 89 MB/s 13068285 30.45 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
brotli24 0.5.2 -8 2.03 MB/s 187 MB/s 13069532 30.45 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
zstd 1.1.1 -16 4.27 MB/s 371 MB/s 13332565 31.06 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
brotli24 0.5.2 -7 3.91 MB/s 197 MB/s 13403539 31.23 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
zstd 1.1.1 -14 6.78 MB/s 418 MB/s 13717459 31.96 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
zstd 1.1.1 -12 11 MB/s 416 MB/s 13811568 32.18 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
crush 1.0 -2 0.53 MB/s 199 MB/s 13817818 32.19 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
xpack 2016-06-02 -9 16 MB/s 347 MB/s 13880854 32.34 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
brotli24 0.5.2 -6 11 MB/s 202 MB/s 14011329 32.65 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
brotli24 0.5.2 -5 15 MB/s 199 MB/s 14308064 33.34 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
Nakamichi 'Okamigan' 313 MB/s 14560763 ! Outside lzbench !
lz5 2.0 RC2 -49 1.50 MB/s 611 MB/s 14737678 34.34 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
libdeflate 16-08-29 -12 4.32 MB/s 379 MB/s 14779857 34.44 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
ucl_nrv2e 1.03 -9 1.44 MB/s 166 MB/s 15095566 35.17 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
ucl_nrv2d 1.03 -9 1.41 MB/s 174 MB/s 15132554 35.26 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
lzfse 2016-08-16 35 MB/s 410 MB/s 15161812 35.33 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
zlib 1.2.8 -9 5.78 MB/s 211 MB/s 15182013 35.37 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
ucl_nrv2b 1.03 -9 1.41 MB/s 168 MB/s 15321754 35.70 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
brotli24 0.5.2 -4 34 MB/s 199 MB/s 15625135 36.41 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
lz5 2.0 RC2 -29 1.59 MB/s 810 MB/s 15897916 37.04 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
lz5 2.0 RC2 -39 4.17 MB/s 857 MB/s 15936167 37.13 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
lz5 2.0 RC2 -45 4.06 MB/s 689 MB/s 15990351 37.26 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
brotli24 0.5.2 -3 48 MB/s 194 MB/s 16004501 37.29 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
brotli24 0.5.2 -2 57 MB/s 191 MB/s 16142332 37.61 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
lzsse8 2016-05-14 -17 5.04 MB/s 821 MB/s 16307734 38.00 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
lzsse4 2016-05-14 -17 5.33 MB/s 792 MB/s 16428934 38.28 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
lzsse2 2016-05-14 -17 5.05 MB/s 748 MB/s 16550167 38.56 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
lzo1x 2.09 -999 3.25 MB/s 409 MB/s 16596002 38.67 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
lzo1y 2.09 -999 3.37 MB/s 406 MB/s 16641927 38.77 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
lzmat 1.01 18 MB/s 205 MB/s 16887890 39.35 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
lzo1b 2.09 -999 5.58 MB/s 504 MB/s 16918643 39.42 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
lz5 2.0 RC2 -19 4.20 MB/s 1080 MB/s 16949359 39.49 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
lz5 2.0 RC2 -25 4.43 MB/s 874 MB/s 17006877 39.62 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
lz4hc 1.7.3 -16 13 MB/s 1100 MB/s 17024299 39.66 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
density 0.12.5 beta -3 163 MB/s 151 MB/s 17148930 39.96 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
brotli24 0.5.2 -1 103 MB/s 176 MB/s 17172844 40.01 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
lzo1c 2.09 -999 12 MB/s 519 MB/s 17273910 40.25 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
quicklz 1.5.0 -3 31 MB/s 462 MB/s 17355088 40.44 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
lzo1f 2.09 -999 12 MB/s 471 MB/s 17414267 40.57 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
brieflz 1.1.0 65 MB/s 118 MB/s 17497550 40.77 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
lzvn 2016-08-16 29 MB/s 533 MB/s 17514312 40.81 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
lz5 2.0 RC2 -35 42 MB/s 1116 MB/s 17722436 41.29 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
lz5 2.0 RC2 -42 20 MB/s 879 MB/s 17872208 41.64 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
lzg 1.0.8 -8 13 MB/s 415 MB/s 17936711 41.79 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
lz5 2.0 RC2 -32 65 MB/s 1090 MB/s 18175710 42.35 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
lz5 2.0 RC2 -15 44 MB/s 1321 MB/s 18252105 42.53 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
lz5 2.0 RC2 -22 22 MB/s 1010 MB/s 18451237 42.99 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
brotli24 0.5.2 -0 128 MB/s 163 MB/s 18513681 43.14 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
yappy 2014-03-22 -100 38 MB/s 966 MB/s 18688558 43.54 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
lz5 2.0 RC2 -12 70 MB/s 1293 MB/s 18746820 43.68 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
gipfeli 2016-07-13 156 MB/s 333 MB/s 18856691 43.93 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
lz5 2.0 RC2 -40 90 MB/s 913 MB/s 18892382 44.02 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
lzrw 15-Jul-1991 -5 69 MB/s 253 MB/s 18950469 44.15 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
yalz77 2015-09-19 -12 10 MB/s 212 MB/s 19097889 44.50 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
slz_zlib 1.0.0 -3 145 MB/s 199 MB/s 19243482 44.84 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
shrinker 0.1 186 MB/s 558 MB/s 19412716 45.23 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
pithy 2011-12-24 -9 186 MB/s 660 MB/s 19413598 45.23 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
lz5 2.0 RC2 -20 113 MB/s 1049 MB/s 19574611 45.61 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
lzf 3.6 -1 193 MB/s 431 MB/s 20071240 46.76 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
lz5 2.0 RC2 -30 164 MB/s 1071 MB/s 20314449 47.33 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
snappy 1.1.3 230 MB/s 680 MB/s 20465003 47.68 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
fastlz 0.1 -2 157 MB/s 365 MB/s 20548714 47.88 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
blosclz 2015-11-10 -9 164 MB/s 489 MB/s 20641504 48.09 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
lz4 1.7.3 233 MB/s 1183 MB/s 20900451 48.70 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
lz5 2.0 RC2 -10 211 MB/s 1269 MB/s 20911111 48.72 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
wflz 2015-09-16 142 MB/s 636 MB/s 22158398 51.63 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
lzjb 2010 177 MB/s 391 MB/s 22356358 52.09 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
lz4fast 1.7.3 -17 394 MB/s 1281 MB/s 25401883 59.18 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
D:\TEXTUAL_MADNESS_old\Nakamichi_Okamigan\LZ5[HUF]_v2.0_RC2_vs_Okamigan>lzbench.exe -c4 -ebrotli,11/brotli24/tornado,16/blosclz,9/brieflz/crush,2/csc,5/density,3/fastlz,2/gipfeli/zstd,12,14,16,18,20,22/lzo1b,999/lzo1c,999/lzo1f,999/lzo1x,999/lzo1y,999/lzham,4/libdeflate,12/lz4/lz4fast,17/lz4hc,16/lz5,10,12,15,19,20,22,25,29,30,32,35,39,40,42,45,49/lzf,1/lzfse/lzg,8/lzham,1/lzjb/lzlib,9/lzma,9/lzrw,5/lzsse2,17/lzsse4,17/lzsse8,17/lzvn/pithy,9/quicklz,3/snappy/slz_zlib,3/ucl_nrv2b,9/ucl_nrv2d,9/ucl_nrv2e,9/xpack,9/xz,9/yalz77,12/yappy,100/zlib,9/zling,4/shrinker/wflz/lzmat JRR_Tolkien_complete.tar
lzbench 1.5 (64-bit Windows) Assembled by P.Skibinski
...
The results sorted by column number 4:
Compressor name Compress. Decompress. Compr. size Ratio Filename
csc 2016-10-13 -5 2.39 MB/s 44 MB/s 6262382 21.15 JRR_Tolkien_complete.tar
brotli24 0.5.2 -11 0.31 MB/s 226 MB/s 6382182 21.56 JRR_Tolkien_complete.tar
lzlib 1.7 -9 0.99 MB/s 46 MB/s 6397127 21.61 JRR_Tolkien_complete.tar
xz 5.2.2 -9 1.24 MB/s 62 MB/s 6427689 21.71 JRR_Tolkien_complete.tar
lzma 9.38 -9 1.17 MB/s 69 MB/s 6427913 21.71 JRR_Tolkien_complete.tar
zstd 1.1.1 -22 1.09 MB/s 350 MB/s 6497891 21.95 JRR_Tolkien_complete.tar
lzham 1.0 -d26 -4 0.74 MB/s 151 MB/s 6520480 22.03 JRR_Tolkien_complete.tar
zstd 1.1.1 -20 1.34 MB/s 351 MB/s 6525499 22.04 JRR_Tolkien_complete.tar
tornado 0.6a -16 1.21 MB/s 143 MB/s 6537709 22.08 JRR_Tolkien_complete.tar
brotli24 0.5.2 -10 0.70 MB/s 208 MB/s 6571791 22.20 JRR_Tolkien_complete.tar
brotli 0.5.2 -11 0.33 MB/s 271 MB/s 6618317 22.36 JRR_Tolkien_complete.tar
zstd 1.1.1 -18 1.85 MB/s 419 MB/s 6747131 22.79 JRR_Tolkien_complete.tar
zstd 1.1.1 -16 2.95 MB/s 426 MB/s 7269512 24.56 JRR_Tolkien_complete.tar
brotli24 0.5.2 -9 2.13 MB/s 241 MB/s 7348198 24.82 JRR_Tolkien_complete.tar
lzham 1.0 -d26 -1 1.49 MB/s 141 MB/s 7392240 24.97 JRR_Tolkien_complete.tar
brotli24 0.5.2 -8 3.83 MB/s 242 MB/s 7538227 25.46 JRR_Tolkien_complete.tar
lz5 2.0 RC2 -49 0.95 MB/s 554 MB/s 7624312 25.75 JRR_Tolkien_complete.tar
zstd 1.1.1 -14 3.35 MB/s 418 MB/s 7687995 25.97 JRR_Tolkien_complete.tar
brotli24 0.5.2 -7 6.16 MB/s 240 MB/s 7760962 26.22 JRR_Tolkien_complete.tar
zling 2016-01-10 -4 24 MB/s 117 MB/s 7823226 26.43 JRR_Tolkien_complete.tar
zstd 1.1.1 -12 7.88 MB/s 408 MB/s 7934438 26.80 JRR_Tolkien_complete.tar
brotli24 0.5.2 -6 9.59 MB/s 232 MB/s 8299273 28.03 JRR_Tolkien_complete.tar
Nakamichi 'Okamigan' 392 MB/s 8611959 ! Outside lzbench !
crush 1.0 -2 0.24 MB/s 211 MB/s 8647237 29.21 JRR_Tolkien_complete.tar
brotli24 0.5.2 -5 11 MB/s 219 MB/s 8787043 29.68 JRR_Tolkien_complete.tar
lz5 2.0 RC2 -45 4.97 MB/s 573 MB/s 9006303 30.42 JRR_Tolkien_complete.tar
lz5 2.0 RC2 -29 1.00 MB/s 754 MB/s 9047724 30.56 JRR_Tolkien_complete.tar
xpack 2016-06-02 -9 8.61 MB/s 333 MB/s 9516962 32.15 JRR_Tolkien_complete.tar
brotli24 0.5.2 -4 16 MB/s 209 MB/s 9609455 32.46 JRR_Tolkien_complete.tar
libdeflate 16-08-29 -12 3.80 MB/s 370 MB/s 9672495 32.67 JRR_Tolkien_complete.tar
lz5 2.0 RC2 -39 3.31 MB/s 646 MB/s 9933739 33.56 JRR_Tolkien_complete.tar
brotli24 0.5.2 -2 49 MB/s 186 MB/s 10018048 33.84 JRR_Tolkien_complete.tar
lz5 2.0 RC2 -42 25 MB/s 564 MB/s 10022367 33.86 JRR_Tolkien_complete.tar
brotli24 0.5.2 -3 41 MB/s 191 MB/s 10023226 33.86 JRR_Tolkien_complete.tar
zlib 1.2.8 -9 5.73 MB/s 198 MB/s 10175708 34.37 JRR_Tolkien_complete.tar
brotli24 0.5.2 -1 99 MB/s 173 MB/s 10178620 34.38 JRR_Tolkien_complete.tar
lzsse2 2016-05-14 -17 3.77 MB/s 835 MB/s 10300511 34.80 JRR_Tolkien_complete.tar
lzfse 2016-08-16 27 MB/s 327 MB/s 10310079 34.83 JRR_Tolkien_complete.tar
lzsse4 2016-05-14 -17 4.25 MB/s 745 MB/s 10351342 34.97 JRR_Tolkien_complete.tar
lzsse8 2016-05-14 -17 4.09 MB/s 710 MB/s 10456808 35.32 JRR_Tolkien_complete.tar
lz5 2.0 RC2 -25 5.29 MB/s 792 MB/s 10491660 35.44 JRR_Tolkien_complete.tar
ucl_nrv2e 1.03 -9 0.84 MB/s 149 MB/s 10931671 36.93 JRR_Tolkien_complete.tar
ucl_nrv2d 1.03 -9 0.84 MB/s 153 MB/s 11067534 37.39 JRR_Tolkien_complete.tar
lz5 2.0 RC2 -35 29 MB/s 726 MB/s 11158110 37.69 JRR_Tolkien_complete.tar
lzo1b 2.09 -999 6.57 MB/s 384 MB/s 11243723 37.98 JRR_Tolkien_complete.tar
yalz77 2015-09-19 -12 17 MB/s 186 MB/s 11283080 38.11 JRR_Tolkien_complete.tar
ucl_nrv2b 1.03 -9 0.83 MB/s 149 MB/s 11303489 38.18 JRR_Tolkien_complete.tar
lz5 2.0 RC2 -19 3.38 MB/s 831 MB/s 11555184 39.03 JRR_Tolkien_complete.tar
lzo1x 2.09 -999 3.35 MB/s 308 MB/s 11562924 39.06 JRR_Tolkien_complete.tar
lz5 2.0 RC2 -40 73 MB/s 498 MB/s 11579861 39.12 JRR_Tolkien_complete.tar
brotli24 0.5.2 -0 118 MB/s 152 MB/s 11612531 39.23 JRR_Tolkien_complete.tar
lz4hc 1.7.3 -16 4.40 MB/s 940 MB/s 11681087 39.46 JRR_Tolkien_complete.tar
lzo1y 2.09 -999 3.36 MB/s 302 MB/s 11698331 39.52 JRR_Tolkien_complete.tar
lzmat 1.01 9.88 MB/s 188 MB/s 11791488 39.83 JRR_Tolkien_complete.tar
brieflz 1.1.0 61 MB/s 105 MB/s 12050164 40.71 JRR_Tolkien_complete.tar
lzo1c 2.09 -999 11 MB/s 362 MB/s 12152105 41.05 JRR_Tolkien_complete.tar
lz5 2.0 RC2 -15 30 MB/s 886 MB/s 12229671 41.31 JRR_Tolkien_complete.tar
lz5 2.0 RC2 -32 51 MB/s 682 MB/s 12256939 41.40 JRR_Tolkien_complete.tar
lz5 2.0 RC2 -22 27 MB/s 795 MB/s 12308578 41.58 JRR_Tolkien_complete.tar
lzo1f 2.09 -999 9.38 MB/s 313 MB/s 12731846 43.01 JRR_Tolkien_complete.tar
lzvn 2016-08-16 23 MB/s 442 MB/s 13043579 44.06 JRR_Tolkien_complete.tar
gipfeli 2016-07-13 145 MB/s 237 MB/s 13138745 44.38 JRR_Tolkien_complete.tar
quicklz 1.5.0 -3 24 MB/s 433 MB/s 13276029 44.85 JRR_Tolkien_complete.tar
density 0.12.5 beta -3 199 MB/s 175 MB/s 13290754 44.90 JRR_Tolkien_complete.tar
lzg 1.0.8 -8 5.30 MB/s 361 MB/s 13359972 45.13 JRR_Tolkien_complete.tar
lzrw 15-Jul-1991 -5 61 MB/s 235 MB/s 13422479 45.34 JRR_Tolkien_complete.tar
lz5 2.0 RC2 -12 56 MB/s 831 MB/s 13563721 45.82 JRR_Tolkien_complete.tar
lz5 2.0 RC2 -30 121 MB/s 446 MB/s 13616121 46.00 JRR_Tolkien_complete.tar
pithy 2011-12-24 -9 178 MB/s 613 MB/s 13931959 47.06 JRR_Tolkien_complete.tar
lz5 2.0 RC2 -20 86 MB/s 699 MB/s 14376604 48.56 JRR_Tolkien_complete.tar
yappy 2014-03-22 -100 36 MB/s 644 MB/s 15212116 51.39 JRR_Tolkien_complete.tar
shrinker 0.1 149 MB/s 425 MB/s 15507304 52.38 JRR_Tolkien_complete.tar
lzf 3.6 -1 153 MB/s 317 MB/s 15677799 52.96 JRR_Tolkien_complete.tar
fastlz 0.1 -2 143 MB/s 273 MB/s 15870622 53.61 JRR_Tolkien_complete.tar
slz_zlib 1.0.0 -3 110 MB/s 157 MB/s 16040002 54.18 JRR_Tolkien_complete.tar
blosclz 2015-11-10 -9 121 MB/s 288 MB/s 16146775 54.54 JRR_Tolkien_complete.tar
snappy 1.1.3 157 MB/s 490 MB/s 16479966 55.67 JRR_Tolkien_complete.tar
lz4 1.7.3 178 MB/s 983 MB/s 16650998 56.25 JRR_Tolkien_complete.tar
lz5 2.0 RC2 -10 152 MB/s 942 MB/s 16968102 57.32 JRR_Tolkien_complete.tar
wflz 2015-09-16 127 MB/s 405 MB/s 19398162 65.53 JRR_Tolkien_complete.tar
lzjb 2010 123 MB/s 266 MB/s 20535710 69.37 JRR_Tolkien_complete.tar
lz4fast 1.7.3 -17 415 MB/s 1254 MB/s 24116945 81.47 JRR_Tolkien_complete.tar
D:\TEXTUAL_MADNESS_old\Nakamichi_Okamigan\LZ5[HUF]_v2.0_RC2_vs_Okamigan>lzbench.exe -c4 -ebrotli,11/brotli24/tornado,16/blosclz,9/brieflz/crush,2/csc,5/density,3/fastlz,2/gipfeli/zstd,12,14,16,18,20,22/lzo1b,999/lzo1c,999/lzo1f,999/lzo1x,999/lzo1y,999/lzham,4/libdeflate,12/lz4/lz4fast,17/lz4hc,16/lz5,10,12,15,19,20,22,25,29,30,32,35,39,40,42,45,49/lzf,1/lzfse/lzg,8/lzham,1/lzjb/lzlib,9/lzma,9/lzrw,5/lzsse2,17/lzsse4,17/lzsse8,17/lzvn/pithy,9/quicklz,3/snappy/slz_zlib,3/ucl_nrv2b,9/ucl_nrv2d,9/ucl_nrv2e,9/xpack,9/xz,9/yalz77,12/yappy,100/zlib,9/zling,4/shrinker/wflz/lzmat Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lzbench 1.5 (64-bit Windows) Assembled by P.Skibinski
...
The results sorted by column number 4:
Compressor name Compress. Decompress. Compr. size Ratio Filename
brotli24 0.5.2 -11 0.09 MB/s 246 MB/s 6234190 11.52 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
brotli 0.5.2 -11 0.14 MB/s 267 MB/s 6281327 11.61 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
csc 2016-10-13 -5 1.87 MB/s 58 MB/s 6556444 12.12 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
brotli24 0.5.2 -10 0.23 MB/s 247 MB/s 6733920 12.45 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lzlib 1.7 -9 0.85 MB/s 52 MB/s 6950867 12.85 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lzma 9.38 -9 1.47 MB/s 79 MB/s 6979585 12.90 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
xz 5.2.2 -9 1.56 MB/s 68 MB/s 6988492 12.92 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lzham 1.0 -d26 -4 0.78 MB/s 130 MB/s 7511351 13.88 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lzham 1.0 -d26 -1 2.08 MB/s 132 MB/s 7749388 14.32 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
zstd 1.1.1 -22 0.77 MB/s 408 MB/s 7827812 14.47 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
zstd 1.1.1 -20 1.37 MB/s 409 MB/s 7829273 14.47 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
zstd 1.1.1 -18 2.54 MB/s 413 MB/s 7863394 14.53 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
tornado 0.6a -16 1.41 MB/s 136 MB/s 8072569 14.92 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
brotli24 0.5.2 -9 3.86 MB/s 291 MB/s 8304563 15.35 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
libdeflate 16-08-29 -12 3.88 MB/s 487 MB/s 8345954 15.42 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
brotli24 0.5.2 -8 6.29 MB/s 290 MB/s 8389409 15.51 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
brotli24 0.5.2 -7 9.47 MB/s 289 MB/s 8455556 15.63 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
brotli24 0.5.2 -6 13 MB/s 283 MB/s 8766786 16.20 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
brotli24 0.5.2 -5 17 MB/s 279 MB/s 8824349 16.31 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
zling 2016-01-10 -4 32 MB/s 158 MB/s 9218367 17.04 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
brotli24 0.5.2 -2 62 MB/s 265 MB/s 9251327 17.10 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
zstd 1.1.1 -16 6.54 MB/s 462 MB/s 9497523 17.55 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
zstd 1.1.1 -12 16 MB/s 461 MB/s 9522897 17.60 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
brotli24 0.5.2 -3 51 MB/s 270 MB/s 9526635 17.61 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
zstd 1.1.1 -14 8.98 MB/s 464 MB/s 9583490 17.71 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
brotli24 0.5.2 -4 27 MB/s 275 MB/s 9645205 17.83 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
xpack 2016-06-02 -9 8.93 MB/s 417 MB/s 9795144 18.10 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
zlib 1.2.8 -9 3.14 MB/s 282 MB/s 10052370 18.58 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lzfse 2016-08-16 40 MB/s 471 MB/s 10059545 18.59 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lz5 2.0 RC2 -39 4.11 MB/s 608 MB/s 10701923 19.78 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lz5 2.0 RC2 -49 0.68 MB/s 683 MB/s 11566159 21.38 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lz5 2.0 RC2 -35 32 MB/s 616 MB/s 11625384 21.49 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lz5 2.0 RC2 -32 67 MB/s 603 MB/s 11770425 21.75 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lzmat 1.01 6.17 MB/s 247 MB/s 11830613 21.86 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lz5 2.0 RC2 -45 6.54 MB/s 644 MB/s 11990039 22.16 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
brotli24 0.5.2 -1 142 MB/s 243 MB/s 12132185 22.42 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
crush 1.0 -2 0.15 MB/s 242 MB/s 12169879 22.49 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
yappy 2014-03-22 -100 32 MB/s 1125 MB/s 12567098 23.23 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
brotli24 0.5.2 -0 187 MB/s 253 MB/s 12593615 23.28 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lz5 2.0 RC2 -42 27 MB/s 667 MB/s 12717833 23.50 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
Nakamichi 'Okamigan' 699 MB/s 13001650 ! Outside lzbench !
lzo1y 2.09 -999 2.53 MB/s 505 MB/s 13019601 24.06 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
ucl_nrv2e 1.03 -9 0.70 MB/s 247 MB/s 13124457 24.26 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
brieflz 1.1.0 97 MB/s 160 MB/s 13206620 24.41 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
ucl_nrv2d 1.03 -9 0.70 MB/s 252 MB/s 13296975 24.58 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lzsse2 2016-05-14 -17 3.81 MB/s 1187 MB/s 13339144 24.65 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
ucl_nrv2b 1.03 -9 0.69 MB/s 248 MB/s 13343641 24.66 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lzsse4 2016-05-14 -17 4.64 MB/s 1011 MB/s 13432676 24.83 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
quicklz 1.5.0 -3 36 MB/s 676 MB/s 13854819 25.61 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lz5 2.0 RC2 -29 0.69 MB/s 947 MB/s 13918354 25.72 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lzsse8 2016-05-14 -17 4.37 MB/s 832 MB/s 14106936 26.07 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lzvn 2016-08-16 36 MB/s 579 MB/s 14265175 26.36 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
gipfeli 2016-07-13 250 MB/s 415 MB/s 14385863 26.59 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lz5 2.0 RC2 -30 195 MB/s 512 MB/s 14404799 26.62 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lzo1b 2.09 -999 5.33 MB/s 629 MB/s 14503221 26.80 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lz5 2.0 RC2 -25 6.91 MB/s 917 MB/s 14630660 27.04 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lzo1f 2.09 -999 8.25 MB/s 586 MB/s 14664688 27.10 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lzo1x 2.09 -999 2.13 MB/s 584 MB/s 14731905 27.23 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lz5 2.0 RC2 -40 116 MB/s 612 MB/s 14751147 27.26 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lz5 2.0 RC2 -19 4.17 MB/s 1051 MB/s 14788537 27.33 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
density 0.12.5 beta -3 237 MB/s 218 MB/s 14839414 27.43 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lzo1c 2.09 -999 9.27 MB/s 600 MB/s 14878305 27.50 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lzrw 15-Jul-1991 -5 100 MB/s 416 MB/s 15048687 27.81 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lz4hc 1.7.3 -16 3.06 MB/s 1187 MB/s 15101394 27.91 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
pithy 2011-12-24 -9 307 MB/s 837 MB/s 15307937 28.29 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lz5 2.0 RC2 -22 30 MB/s 921 MB/s 15689902 29.00 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lz5 2.0 RC2 -15 33 MB/s 1043 MB/s 15719791 29.05 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lz5 2.0 RC2 -12 71 MB/s 1008 MB/s 16324878 30.17 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
shrinker 0.1 226 MB/s 545 MB/s 16392567 30.30 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lzg 1.0.8 -8 7.10 MB/s 499 MB/s 16450203 30.40 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lzjb 2010 249 MB/s 405 MB/s 16654197 30.78 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
slz_zlib 1.0.0 -3 194 MB/s 205 MB/s 16679004 30.83 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
snappy 1.1.3 248 MB/s 798 MB/s 16728811 30.92 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lzf 3.6 -1 276 MB/s 385 MB/s 17487561 32.32 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
yalz77 2015-09-19 -12 23 MB/s 187 MB/s 17626700 32.58 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
fastlz 0.1 -2 261 MB/s 349 MB/s 17639609 32.60 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
blosclz 2015-11-10 -9 198 MB/s 387 MB/s 17691518 32.70 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lz5 2.0 RC2 -20 134 MB/s 823 MB/s 18053625 33.37 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lz4 1.7.3 328 MB/s 974 MB/s 19826005 36.64 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lz5 2.0 RC2 -10 282 MB/s 852 MB/s 19843581 36.67 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
lz4fast 1.7.3 -17 354 MB/s 992 MB/s 22529970 41.64 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
wflz 2015-09-16 236 MB/s 508 MB/s 26654439 49.26 Slownik-Jezyka-Polskiego_sjp-odm-20160208_(win-1250)_(Polish).tar
D:\TEXTUAL_MADNESS_old\Nakamichi_Okamigan\LZ5[HUF]_v2.0_RC2_vs_Okamigan>lzbench.exe -c4 -ebrotli,11/brotli24/tornado,16/blosclz,9/brieflz/crush,2/csc,5/density,3/fastlz,2/gipfeli/zstd,12,14,16,18,20,22/lzo1b,999/lzo1c,999/lzo1f,999/lzo1x,999/lzo1y,999/lzham,4/libdeflate,12/lz4/lz4fast,17/lz4hc,16/lz5,10,12,15,19,20,22,25,29,30,32,35,39,40,42,45,49/lzf,1/lzfse/lzg,8/lzham,1/lzjb/lzlib,9/lzma,9/lzrw,5/lzsse2,17/lzsse4,17/lzsse8,17/lzvn/pithy,9/quicklz,3/snappy/slz_zlib,3/ucl_nrv2b,9/ucl_nrv2d,9/ucl_nrv2e,9/xpack,9/xz,9/yalz77,12/yappy,100/zlib,9/zling,4/shrinker/wflz/lzmat Slownik_jezyka_polskiego_(Pol-Pol).dsl
lzbench 1.5 (64-bit Windows) Assembled by P.Skibinski
...
The results sorted by column number 4:
Compressor name Compress. Decompress. Compr. size Ratio Filename
lzlib 1.7 -9 1.03 MB/s 67 MB/s 2134984 12.41 Slownik_jezyka_polskiego_(Pol-Pol).dsl
xz 5.2.2 -9 1.24 MB/s 98 MB/s 2154088 12.52 Slownik_jezyka_polskiego_(Pol-Pol).dsl
lzma 9.38 -9 1.14 MB/s 106 MB/s 2154680 12.52 Slownik_jezyka_polskiego_(Pol-Pol).dsl
lzham 1.0 -d26 -4 0.75 MB/s 232 MB/s 2183163 12.69 Slownik_jezyka_polskiego_(Pol-Pol).dsl
zstd 1.1.1 -22 1.24 MB/s 469 MB/s 2272747 13.21 Slownik_jezyka_polskiego_(Pol-Pol).dsl
zstd 1.1.1 -20 1.33 MB/s 468 MB/s 2279628 13.25 Slownik_jezyka_polskiego_(Pol-Pol).dsl
csc 2016-10-13 -5 1.29 MB/s 97 MB/s 2289523 13.31 Slownik_jezyka_polskiego_(Pol-Pol).dsl
brotli24 0.5.2 -11 0.33 MB/s 299 MB/s 2293506 13.33 Slownik_jezyka_polskiego_(Pol-Pol).dsl
tornado 0.6a -16 1.21 MB/s 201 MB/s 2301798 13.38 Slownik_jezyka_polskiego_(Pol-Pol).dsl
brotli24 0.5.2 -10 0.82 MB/s 287 MB/s 2359089 13.71 Slownik_jezyka_polskiego_(Pol-Pol).dsl
brotli 0.5.2 -11 0.34 MB/s 382 MB/s 2379199 13.83 Slownik_jezyka_polskiego_(Pol-Pol).dsl
zstd 1.1.1 -18 1.84 MB/s 504 MB/s 2478055 14.40 Slownik_jezyka_polskiego_(Pol-Pol).dsl
lz5 2.0 RC2 -49 1.10 MB/s 696 MB/s 2613114 15.19 Slownik_jezyka_polskiego_(Pol-Pol).dsl
zstd 1.1.1 -16 2.78 MB/s 557 MB/s 2646452 15.38 Slownik_jezyka_polskiego_(Pol-Pol).dsl
lzham 1.0 -d26 -1 1.78 MB/s 184 MB/s 2878864 16.73 Slownik_jezyka_polskiego_(Pol-Pol).dsl
zstd 1.1.1 -14 6.01 MB/s 537 MB/s 2893057 16.82 Slownik_jezyka_polskiego_(Pol-Pol).dsl
Nakamichi 'Okamigan' 590 MB/s 2973800 ! Outside lzbench !
zstd 1.1.1 -12 12 MB/s 524 MB/s 3011298 17.50 Slownik_jezyka_polskiego_(Pol-Pol).dsl
brotli24 0.5.2 -9 5.31 MB/s 305 MB/s 3036511 17.65 Slownik_jezyka_polskiego_(Pol-Pol).dsl
crush 1.0 -2 0.10 MB/s 300 MB/s 3060956 17.79 Slownik_jezyka_polskiego_(Pol-Pol).dsl
lz5 2.0 RC2 -29 1.15 MB/s 810 MB/s 3079787 17.90 Slownik_jezyka_polskiego_(Pol-Pol).dsl
xpack 2016-06-02 -9 7.19 MB/s 449 MB/s 3139879 18.25 Slownik_jezyka_polskiego_(Pol-Pol).dsl
brotli24 0.5.2 -8 7.28 MB/s 297 MB/s 3162994 18.39 Slownik_jezyka_polskiego_(Pol-Pol).dsl
zling 2016-01-10 -4 31 MB/s 158 MB/s 3265078 18.98 Slownik_jezyka_polskiego_(Pol-Pol).dsl
libdeflate 16-08-29 -12 2.86 MB/s 639 MB/s 3271057 19.01 Slownik_jezyka_polskiego_(Pol-Pol).dsl
brotli24 0.5.2 -7 9.49 MB/s 288 MB/s 3296148 19.16 Slownik_jezyka_polskiego_(Pol-Pol).dsl
lz5 2.0 RC2 -39 2.99 MB/s 837 MB/s 3363504 19.55 Slownik_jezyka_polskiego_(Pol-Pol).dsl
brotli24 0.5.2 -6 12 MB/s 274 MB/s 3448542 20.04 Slownik_jezyka_polskiego_(Pol-Pol).dsl
lzsse2 2016-05-14 -17 3.51 MB/s 1254 MB/s 3496527 20.32 Slownik_jezyka_polskiego_(Pol-Pol).dsl
lzsse4 2016-05-14 -17 3.93 MB/s 1077 MB/s 3520474 20.46 Slownik_jezyka_polskiego_(Pol-Pol).dsl
zlib 1.2.8 -9 2.84 MB/s 272 MB/s 3572549 20.77 Slownik_jezyka_polskiego_(Pol-Pol).dsl
brotli24 0.5.2 -5 13 MB/s 261 MB/s 3615718 21.02 Slownik_jezyka_polskiego_(Pol-Pol).dsl
lzsse8 2016-05-14 -17 3.76 MB/s 953 MB/s 3646231 21.19 Slownik_jezyka_polskiego_(Pol-Pol).dsl
brotli24 0.5.2 -4 18 MB/s 270 MB/s 3772153 21.93 Slownik_jezyka_polskiego_(Pol-Pol).dsl
ucl_nrv2e 1.03 -9 0.63 MB/s 223 MB/s 3828376 22.25 Slownik_jezyka_polskiego_(Pol-Pol).dsl
lz5 2.0 RC2 -35 30 MB/s 865 MB/s 3870006 22.49 Slownik_jezyka_polskiego_(Pol-Pol).dsl
lzo1b 2.09 -999 9.34 MB/s 668 MB/s 3891142 22.62 Slownik_jezyka_polskiego_(Pol-Pol).dsl
ucl_nrv2d 1.03 -9 0.62 MB/s 235 MB/s 3893110 22.63 Slownik_jezyka_polskiego_(Pol-Pol).dsl
brotli24 0.5.2 -3 56 MB/s 253 MB/s 3917200 22.77 Slownik_jezyka_polskiego_(Pol-Pol).dsl
ucl_nrv2b 1.03 -9 0.61 MB/s 227 MB/s 3962530 23.03 Slownik_jezyka_polskiego_(Pol-Pol).dsl
brotli24 0.5.2 -2 64 MB/s 244 MB/s 3985719 23.17 Slownik_jezyka_polskiego_(Pol-Pol).dsl
lz5 2.0 RC2 -19 2.93 MB/s 988 MB/s 4012398 23.32 Slownik_jezyka_polskiego_(Pol-Pol).dsl
lz4hc 1.7.3 -16 4.80 MB/s 1034 MB/s 4138751 24.06 Slownik_jezyka_polskiego_(Pol-Pol).dsl
lzfse 2016-08-16 35 MB/s 406 MB/s 4144779 24.09 Slownik_jezyka_polskiego_(Pol-Pol).dsl
lz5 2.0 RC2 -45 5.80 MB/s 628 MB/s 4153589 24.14 Slownik_jezyka_polskiego_(Pol-Pol).dsl
lzmat 1.01 14 MB/s 243 MB/s 4207157 24.45 Slownik_jezyka_polskiego_(Pol-Pol).dsl
lz5 2.0 RC2 -42 27 MB/s 674 MB/s 4227061 24.57 Slownik_jezyka_polskiego_(Pol-Pol).dsl
lzo1y 2.09 -999 1.76 MB/s 468 MB/s 4237296 24.63 Slownik_jezyka_polskiego_(Pol-Pol).dsl
lzo1x 2.09 -999 1.73 MB/s 487 MB/s 4294075 24.96 Slownik_jezyka_polskiego_(Pol-Pol).dsl
brotli24 0.5.2 -1 135 MB/s 209 MB/s 4386651 25.50 Slownik_jezyka_polskiego_(Pol-Pol).dsl
lzo1c 2.09 -999 8.65 MB/s 534 MB/s 4398550 25.57 Slownik_jezyka_polskiego_(Pol-Pol).dsl
lz5 2.0 RC2 -40 111 MB/s 612 MB/s 4400476 25.58 Slownik_jezyka_polskiego_(Pol-Pol).dsl
brotli24 0.5.2 -0 189 MB/s 233 MB/s 4420151 25.69 Slownik_jezyka_polskiego_(Pol-Pol).dsl
lz5 2.0 RC2 -32 62 MB/s 699 MB/s 4442242 25.82 Slownik_jezyka_polskiego_(Pol-Pol).dsl
lz5 2.0 RC2 -15 31 MB/s 1028 MB/s 4503744 26.18 Slownik_jezyka_polskiego_(Pol-Pol).dsl
lzo1f 2.09 -999 6.55 MB/s 517 MB/s 4529153 26.33 Slownik_jezyka_polskiego_(Pol-Pol).dsl
lzg 1.0.8 -8 6.56 MB/s 582 MB/s 4693501 27.28 Slownik_jezyka_polskiego_(Pol-Pol).dsl
yappy 2014-03-22 -100 37 MB/s 927 MB/s 4776139 27.76 Slownik_jezyka_polskiego_(Pol-Pol).dsl
lzrw 15-Jul-1991 -5 112 MB/s 375 MB/s 4863497 28.27 Slownik_jezyka_polskiego_(Pol-Pol).dsl
yalz77 2015-09-19 -12 30 MB/s 257 MB/s 4902253 28.49 Slownik_jezyka_polskiego_(Pol-Pol).dsl
lz5 2.0 RC2 -25 6.59 MB/s 854 MB/s 4972947 28.91 Slownik_jezyka_polskiego_(Pol-Pol).dsl
quicklz 1.5.0 -3 39 MB/s 551 MB/s 5040773 29.30 Slownik_jezyka_polskiego_(Pol-Pol).dsl
lz5 2.0 RC2 -30 181 MB/s 740 MB/s 5291540 30.76 Slownik_jezyka_polskiego_(Pol-Pol).dsl
lzvn 2016-08-16 33 MB/s 523 MB/s 5352822 31.11 Slownik_jezyka_polskiego_(Pol-Pol).dsl
lz5 2.0 RC2 -22 29 MB/s 944 MB/s 5370661 31.22 Slownik_jezyka_polskiego_(Pol-Pol).dsl
lz5 2.0 RC2 -12 67 MB/s 952 MB/s 5427501 31.55 Slownik_jezyka_polskiego_(Pol-Pol).dsl
lz5 2.0 RC2 -20 125 MB/s 787 MB/s 5483820 31.88 Slownik_jezyka_polskiego_(Pol-Pol).dsl
brieflz 1.1.0 85 MB/s 132 MB/s 5500759 31.97 Slownik_jezyka_polskiego_(Pol-Pol).dsl
gipfeli 2016-07-13 212 MB/s 355 MB/s 5917967 34.40 Slownik_jezyka_polskiego_(Pol-Pol).dsl
density 0.12.5 beta -3 239 MB/s 204 MB/s 6102042 35.47 Slownik_jezyka_polskiego_(Pol-Pol).dsl
pithy 2011-12-24 -9 239 MB/s 802 MB/s 6314535 36.70 Slownik_jezyka_polskiego_(Pol-Pol).dsl
lzf 3.6 -1 258 MB/s 460 MB/s 6355527 36.94 Slownik_jezyka_polskiego_(Pol-Pol).dsl
lz4 1.7.3 277 MB/s 981 MB/s 6399646 37.20 Slownik_jezyka_polskiego_(Pol-Pol).dsl
lz5 2.0 RC2 -10 240 MB/s 884 MB/s 6403549 37.22 Slownik_jezyka_polskiego_(Pol-Pol).dsl
fastlz 0.1 -2 236 MB/s 375 MB/s 6652850 38.67 Slownik_jezyka_polskiego_(Pol-Pol).dsl
blosclz 2015-11-10 -9 197 MB/s 394 MB/s 6759511 39.29 Slownik_jezyka_polskiego_(Pol-Pol).dsl
snappy 1.1.3 213 MB/s 657 MB/s 6936167 40.32 Slownik_jezyka_polskiego_(Pol-Pol).dsl
slz_zlib 1.0.0 -3 160 MB/s 181 MB/s 7289144 42.37 Slownik_jezyka_polskiego_(Pol-Pol).dsl
lz4fast 1.7.3 -17 299 MB/s 985 MB/s 7449387 43.30 Slownik_jezyka_polskiego_(Pol-Pol).dsl
shrinker 0.1 206 MB/s 428 MB/s 7785374 45.25 Slownik_jezyka_polskiego_(Pol-Pol).dsl
lzjb 2010 182 MB/s 344 MB/s 8246073 47.93 Slownik_jezyka_polskiego_(Pol-Pol).dsl
wflz 2015-09-16 204 MB/s 511 MB/s 9568334 55.62 Slownik_jezyka_polskiego_(Pol-Pol).dsl
D:\TEXTUAL_MADNESS_old\Nakamichi_Okamigan\LZ5[HUF]_v2.0_RC2_vs_Okamigan>lzbench.exe -c4 -ebrotli,11/brotli24/tornado,16/blosclz,9/brieflz/crush,2/csc,5/density,3/fastlz,2/gipfeli/zstd,12,14,16,18,20,22/lzo1b,999/lzo1c,999/lzo1f,999/lzo1x,999/lzo1y,999/lzham,4/libdeflate,12/lz4/lz4fast,17/lz4hc,16/lz5,10,12,15,19,20,22,25,29,30,32,35,39,40,42,45,49/lzf,1/lzfse/lzg,8/lzham,1/lzjb/lzlib,9/lzma,9/lzrw,5/lzsse2,17/lzsse4,17/lzsse8,17/lzvn/pithy,9/quicklz,3/snappy/slz_zlib,3/ucl_nrv2b,9/ucl_nrv2d,9/ucl_nrv2e,9/xpack,9/xz,9/yalz77,12/yappy,100/zlib,9/zling,4/shrinker/wflz/lzmat Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
lzbench 1.5 (64-bit Windows) Assembled by P.Skibinski
...
The results sorted by column number 4:
Compressor name Compress. Decompress. Compr. size Ratio Filename
lzlib 1.7 -9 0.85 MB/s 53 MB/s 6520569 17.92 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
lzma 9.38 -9 1.25 MB/s 79 MB/s 6537834 17.97 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
xz 5.2.2 -9 1.32 MB/s 72 MB/s 6538163 17.97 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
csc 2016-10-13 -5 1.45 MB/s 71 MB/s 6604774 18.15 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
lzham 1.0 -d26 -4 0.58 MB/s 166 MB/s 6625429 18.21 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
zstd 1.1.1 -22 0.77 MB/s 328 MB/s 6641528 18.25 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
zstd 1.1.1 -20 1.46 MB/s 330 MB/s 6688213 18.38 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
brotli24 0.5.2 -11 0.37 MB/s 236 MB/s 6705599 18.43 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
tornado 0.6a -16 1.21 MB/s 156 MB/s 6751897 18.55 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
brotli24 0.5.2 -10 0.87 MB/s 229 MB/s 6871517 18.88 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
brotli 0.5.2 -11 0.39 MB/s 307 MB/s 7111617 19.54 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
zstd 1.1.1 -18 2.05 MB/s 448 MB/s 7116714 19.56 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
brotli24 0.5.2 -9 2.59 MB/s 253 MB/s 7635462 20.98 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
zstd 1.1.1 -16 3.64 MB/s 462 MB/s 7646420 21.01 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
brotli24 0.5.2 -8 4.38 MB/s 259 MB/s 7861590 21.60 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
lzham 1.0 -d26 -1 1.56 MB/s 157 MB/s 7895650 21.70 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
zstd 1.1.1 -14 4.74 MB/s 475 MB/s 7948246 21.84 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
zling 2016-01-10 -4 29 MB/s 133 MB/s 7955968 21.86 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
lz5 2.0 RC2 -49 0.34 MB/s 519 MB/s 7969229 21.90 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
brotli24 0.5.2 -7 7.27 MB/s 262 MB/s 8123168 22.32 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
zstd 1.1.1 -12 10 MB/s 471 MB/s 8152963 22.40 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
crush 1.0 -2 0.72 MB/s 253 MB/s 8366468 22.99 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
brotli24 0.5.2 -6 11 MB/s 269 MB/s 8638981 23.74 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
brotli24 0.5.2 -5 14 MB/s 259 MB/s 9014124 24.77 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
Nakamichi 'Okamigan' 350 MB/s 9104050 ! Outside lzbench !
lz5 2.0 RC2 -29 0.35 MB/s 686 MB/s 9261314 25.45 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
xpack 2016-06-02 -9 16 MB/s 407 MB/s 9343429 25.68 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
brotli24 0.5.2 -4 24 MB/s 250 MB/s 9663081 26.55 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
lz5 2.0 RC2 -45 5.16 MB/s 625 MB/s 9723439 26.72 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
libdeflate 16-08-29 -12 4.37 MB/s 418 MB/s 10023832 27.55 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
lzfse 2016-08-16 32 MB/s 408 MB/s 10073855 27.68 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
brotli24 0.5.2 -3 47 MB/s 229 MB/s 10120193 27.81 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
brotli24 0.5.2 -2 55 MB/s 222 MB/s 10310945 28.33 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
lz5 2.0 RC2 -39 0.58 MB/s 766 MB/s 10342071 28.42 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
zlib 1.2.8 -9 15 MB/s 221 MB/s 10397232 28.57 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
ucl_nrv2e 1.03 -9 2.39 MB/s 182 MB/s 10422749 28.64 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
ucl_nrv2d 1.03 -9 2.39 MB/s 188 MB/s 10530701 28.94 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
lz5 2.0 RC2 -42 28 MB/s 630 MB/s 10585799 29.09 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
lzsse2 2016-05-14 -17 1.18 MB/s 929 MB/s 10658848 29.29 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
ucl_nrv2b 1.03 -9 2.35 MB/s 182 MB/s 10750326 29.54 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
brotli24 0.5.2 -1 113 MB/s 201 MB/s 10751993 29.55 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
lzsse4 2016-05-14 -17 1.24 MB/s 830 MB/s 10758893 29.57 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
lzsse8 2016-05-14 -17 1.20 MB/s 783 MB/s 10907574 29.97 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
lz5 2.0 RC2 -25 5.48 MB/s 864 MB/s 11206496 30.80 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
lz5 2.0 RC2 -35 39 MB/s 914 MB/s 11398346 31.32 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
lzo1b 2.09 -999 16 MB/s 445 MB/s 11532263 31.69 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
lz5 2.0 RC2 -40 90 MB/s 598 MB/s 11576661 31.81 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
lzo1x 2.09 -999 8.00 MB/s 370 MB/s 11582541 31.83 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
lzo1y 2.09 -999 8.05 MB/s 362 MB/s 11584455 31.83 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
lz5 2.0 RC2 -19 0.59 MB/s 996 MB/s 11594659 31.86 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
lz4hc 1.7.3 -16 15 MB/s 1090 MB/s 11649702 32.01 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
lzmat 1.01 26 MB/s 212 MB/s 11904180 32.71 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
brotli24 0.5.2 -0 136 MB/s 183 MB/s 11997367 32.97 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
lz5 2.0 RC2 -15 40 MB/s 1108 MB/s 12110954 33.28 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
yalz77 2015-09-19 -12 17 MB/s 189 MB/s 12239706 33.63 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
lz5 2.0 RC2 -32 62 MB/s 882 MB/s 12259777 33.69 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
brieflz 1.1.0 68 MB/s 117 MB/s 12542459 34.47 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
lz5 2.0 RC2 -22 30 MB/s 904 MB/s 12675992 34.83 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
lzo1c 2.09 -999 21 MB/s 415 MB/s 12720157 34.95 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
lzg 1.0.8 -8 7.41 MB/s 414 MB/s 12785392 35.13 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
quicklz 1.5.0 -3 30 MB/s 490 MB/s 12993917 35.71 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
lzvn 2016-08-16 27 MB/s 525 MB/s 13014016 35.76 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
lzo1f 2.09 -999 19 MB/s 364 MB/s 13028829 35.80 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
lz5 2.0 RC2 -12 67 MB/s 1074 MB/s 13072389 35.92 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
density 0.12.5 beta -3 202 MB/s 179 MB/s 13135364 36.10 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
gipfeli 2016-07-13 155 MB/s 253 MB/s 13743563 37.77 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
lz5 2.0 RC2 -30 149 MB/s 557 MB/s 14011926 38.50 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
lz5 2.0 RC2 -20 107 MB/s 877 MB/s 14221852 39.08 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
pithy 2011-12-24 -9 205 MB/s 734 MB/s 14271427 39.22 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
lzrw 15-Jul-1991 -5 67 MB/s 260 MB/s 14689747 40.37 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
shrinker 0.1 178 MB/s 536 MB/s 15340218 42.15 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
lz4 1.7.3 217 MB/s 1200 MB/s 16521132 45.40 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
fastlz 0.1 -2 161 MB/s 324 MB/s 16543653 45.46 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
lzf 3.6 -1 172 MB/s 352 MB/s 16667875 45.80 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
blosclz 2015-11-10 -9 145 MB/s 352 MB/s 16927750 46.52 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
slz_zlib 1.0.0 -3 127 MB/s 180 MB/s 16971486 46.64 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
yappy 2014-03-22 -100 46 MB/s 808 MB/s 17104595 47.00 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
lz5 2.0 RC2 -10 191 MB/s 1197 MB/s 17168517 47.18 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
snappy 1.1.3 195 MB/s 600 MB/s 17465666 48.00 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
wflz 2015-09-16 149 MB/s 502 MB/s 18529166 50.92 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
lzjb 2010 142 MB/s 320 MB/s 22656574 62.26 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
lz4fast 1.7.3 -17 564 MB/s 1620 MB/s 25456673 69.95 Small_Medical_Encyclopedia_3640-HTM_articles_(1991-96)_(Russian).tar
D:\TEXTUAL_MADNESS_old\Nakamichi_Okamigan\LZ5[HUF]_v2.0_RC2_vs_Okamigan>lzbench.exe -c4 -ebrotli,11/brotli24/tornado,16/blosclz,9/brieflz/crush,2/csc,5/density,3/fastlz,2/gipfeli/zstd,12,14,16,18,20,22/lzo1b,999/lzo1c,999/lzo1f,999/lzo1x,999/lzo1y,999/lzham,4/libdeflate,12/lz4/lz4fast,17/lz4hc,16/lz5,10,12,15,19,20,22,25,29,30,32,35,39,40,42,45,49/lzf,1/lzfse/lzg,8/lzham,1/lzjb/lzlib,9/lzma,9/lzrw,5/lzsse2,17/lzsse4,17/lzsse8,17/lzvn/pithy,9/quicklz,3/snappy/slz_zlib,3/ucl_nrv2b,9/ucl_nrv2d,9/ucl_nrv2e,9/xpack,9/xz,9/yalz77,12/yappy,100/zlib,9/zling,4/shrinker/wflz/lzmat www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
lzbench 1.5 (64-bit Windows) Assembled by P.Skibinski
...
The results sorted by column number 4:
Compressor name Compress. Decompress. Compr. size Ratio Filename
lzlib 1.7 -9 0.89 MB/s 36 MB/s 4623136 23.97 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
xz 5.2.2 -9 1.17 MB/s 47 MB/s 4647026 24.09 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
lzma 9.38 -9 1.12 MB/s 52 MB/s 4648795 24.10 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
brotli24 0.5.2 -11 0.32 MB/s 174 MB/s 4741390 24.58 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
brotli 0.5.2 -11 0.34 MB/s 212 MB/s 4836627 25.08 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
lzham 1.0 -d26 -4 0.66 MB/s 109 MB/s 4839072 25.09 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
csc 2016-10-13 -5 1.25 MB/s 45 MB/s 4852766 25.16 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
brotli24 0.5.2 -10 0.69 MB/s 166 MB/s 4889352 25.35 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
zstd 1.1.1 -22 0.91 MB/s 279 MB/s 4990335 25.87 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
tornado 0.6a -16 1.15 MB/s 117 MB/s 5016123 26.01 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
zstd 1.1.1 -20 1.22 MB/s 278 MB/s 5017339 26.01 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
zstd 1.1.1 -18 1.63 MB/s 356 MB/s 5152883 26.72 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
lzham 1.0 -d26 -1 1.39 MB/s 103 MB/s 5191671 26.92 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
zling 2016-01-10 -4 22 MB/s 105 MB/s 5423318 28.12 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
zstd 1.1.1 -16 2.89 MB/s 368 MB/s 5563229 28.85 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
brotli24 0.5.2 -9 1.74 MB/s 200 MB/s 5613923 29.11 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
zstd 1.1.1 -14 2.86 MB/s 376 MB/s 5692102 29.51 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
brotli24 0.5.2 -8 2.93 MB/s 207 MB/s 5722672 29.67 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
zstd 1.1.1 -12 6.88 MB/s 373 MB/s 5799800 30.07 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
brotli24 0.5.2 -7 4.60 MB/s 209 MB/s 5843328 30.30 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
lz5 2.0 RC2 -49 0.69 MB/s 460 MB/s 5879798 30.49 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
brotli24 0.5.2 -6 7.21 MB/s 205 MB/s 6047058 31.35 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
crush 1.0 -2 0.31 MB/s 199 MB/s 6103452 31.65 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
brotli24 0.5.2 -5 8.73 MB/s 197 MB/s 6211890 32.21 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
xpack 2016-06-02 -9 10 MB/s 320 MB/s 6326458 32.80 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
Nakamichi 'Okamigan' 333 MB/s 6496052 ! Outside lzbench !
libdeflate 16-08-29 -12 3.74 MB/s 339 MB/s 6508271 33.75 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
lz5 2.0 RC2 -45 4.62 MB/s 502 MB/s 6542920 33.92 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
brotli24 0.5.2 -4 13 MB/s 194 MB/s 6613143 34.29 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
lz5 2.0 RC2 -39 1.34 MB/s 648 MB/s 6708336 34.78 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
brotli24 0.5.2 -2 47 MB/s 179 MB/s 6802389 35.27 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
brotli24 0.5.2 -3 40 MB/s 181 MB/s 6806910 35.29 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
lzfse 2016-08-16 28 MB/s 333 MB/s 6825045 35.39 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
zlib 1.2.8 -9 6.55 MB/s 188 MB/s 6836775 35.45 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
lzsse2 2016-05-14 -17 0.79 MB/s 811 MB/s 6895904 35.76 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
lzsse4 2016-05-14 -17 0.87 MB/s 728 MB/s 6954705 36.06 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
lz5 2.0 RC2 -29 0.71 MB/s 686 MB/s 7029476 36.45 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
lz5 2.0 RC2 -42 24 MB/s 541 MB/s 7039592 36.50 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
lzsse8 2016-05-14 -17 0.81 MB/s 685 MB/s 7054001 36.57 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
brotli24 0.5.2 -1 86 MB/s 151 MB/s 7188521 37.27 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
ucl_nrv2e 1.03 -9 1.05 MB/s 148 MB/s 7384273 38.29 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
ucl_nrv2d 1.03 -9 1.05 MB/s 153 MB/s 7433481 38.54 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
lz5 2.0 RC2 -35 31 MB/s 793 MB/s 7566977 39.23 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
ucl_nrv2b 1.03 -9 1.03 MB/s 150 MB/s 7599684 39.40 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
lz5 2.0 RC2 -25 4.76 MB/s 742 MB/s 7638795 39.61 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
lz5 2.0 RC2 -19 1.36 MB/s 857 MB/s 7655036 39.69 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
lzo1b 2.09 -999 10 MB/s 386 MB/s 7682557 39.83 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
lz4hc 1.7.3 -16 11 MB/s 998 MB/s 7708242 39.97 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
lz5 2.0 RC2 -40 72 MB/s 510 MB/s 7814208 40.52 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
brotli24 0.5.2 -0 112 MB/s 148 MB/s 7867695 40.79 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
lz5 2.0 RC2 -32 54 MB/s 725 MB/s 7882052 40.87 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
lzo1y 2.09 -999 3.66 MB/s 303 MB/s 7909652 41.01 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
lzmat 1.01 17 MB/s 183 MB/s 7930721 41.12 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
lzo1x 2.09 -999 3.31 MB/s 311 MB/s 7973415 41.34 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
brieflz 1.1.0 59 MB/s 102 MB/s 8058186 41.78 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
lz5 2.0 RC2 -15 32 MB/s 975 MB/s 8093884 41.97 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
density 0.12.5 beta -3 186 MB/s 167 MB/s 8227388 42.66 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
lz5 2.0 RC2 -22 24 MB/s 792 MB/s 8471319 43.92 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
quicklz 1.5.0 -3 26 MB/s 432 MB/s 8486955 44.00 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
yalz77 2015-09-19 -12 15 MB/s 170 MB/s 8531303 44.23 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
gipfeli 2016-07-13 139 MB/s 227 MB/s 8565624 44.41 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
lz5 2.0 RC2 -12 59 MB/s 889 MB/s 8590350 44.54 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
lzvn 2016-08-16 24 MB/s 444 MB/s 8619599 44.69 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
lzg 1.0.8 -8 6.33 MB/s 351 MB/s 8799975 45.63 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
lzo1c 2.09 -999 14 MB/s 345 MB/s 8857758 45.93 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
lzrw 15-Jul-1991 -5 62 MB/s 226 MB/s 9008131 46.71 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
pithy 2011-12-24 -9 180 MB/s 641 MB/s 9095162 47.16 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
lzo1f 2.09 -999 11 MB/s 303 MB/s 9161855 47.50 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
lz5 2.0 RC2 -30 127 MB/s 480 MB/s 9363224 48.55 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
lz5 2.0 RC2 -20 86 MB/s 757 MB/s 9551138 49.52 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
shrinker 0.1 153 MB/s 468 MB/s 9631855 49.94 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
lzf 3.6 -1 155 MB/s 317 MB/s 10229234 53.04 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
fastlz 0.1 -2 141 MB/s 275 MB/s 10278664 53.29 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
slz_zlib 1.0.0 -3 111 MB/s 161 MB/s 10376781 53.80 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
blosclz 2015-11-10 -9 123 MB/s 301 MB/s 10531249 54.60 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
yappy 2014-03-22 -100 42 MB/s 677 MB/s 10718595 55.58 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
lz4 1.7.3 185 MB/s 1115 MB/s 11074573 57.42 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
snappy 1.1.3 163 MB/s 504 MB/s 11075872 57.43 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
lz5 2.0 RC2 -10 163 MB/s 1091 MB/s 11486699 59.56 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
wflz 2015-09-16 129 MB/s 445 MB/s 12074008 62.60 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
lzjb 2010 135 MB/s 288 MB/s 12596146 65.31 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
lz4fast 1.7.3 -17 460 MB/s 1420 MB/s 15884909 82.36 www.tvsubtitles.net_The_Simpsons_seasons_1-27.tar
D:\TEXTUAL_MADNESS_old\Nakamichi_Okamigan\LZ5[HUF]_v2.0_RC2_vs_Okamigan>
In 100+MB long textual files my bet is on Okamigan, inthere its balanced greediness (meaning: well-optimized 16MB window and touch-and-go 64MB and 256MB windows) will deliver more.
Thanks for results. It would be easier to have Nakamichi in lzbench. You can create your fork of lzbench and add Nakamichi to it.
Sure, if there are some texts of interest I will include them gladly.
It would be helpful Nakamichi 'Okamigan' (my favorite variant) to be "annexed" into Lzbench, so please consider adding it, it is compilable by GCC. See, my maintenance (github,make,*nix...) skills are nonexisting, don't want to mess up with forking - I won't make it right.
The C source, GCC compiles (for Core 2 and Haswell) and the compile line are here:
https://1drv.ms/u/s!AmWWFXGMzDmEgmyObB9z2fIV4e0i
GCC that is installed on my laptop is 5.10, sometimes it outperforms the Intel 15.0 compiles, it is interesting ALWAYS to see the two optimizers assembly dumps, for example the Haswell code enforces alignments before most labels, not so in Intel's dumps, at all.
; GCC 5.10 64bit kit
; gcc -O3 -m64 -fomit-frame-pointer -march=haswell -S
.seh_proc Decompress
Decompress:
pushq %r14
.seh_pushreg %r14
pushq %r13
.seh_pushreg %r13
pushq %r12
.seh_pushreg %r12
pushq %rbp
.seh_pushreg %rbp
pushq %rdi
.seh_pushreg %rdi
pushq %rsi
.seh_pushreg %rsi
pushq %rbx
.seh_pushreg %rbx
.seh_endprologue
addq %rdx, %r8
cmpq %r8, %rdx
jnb .L177
movq %rcx, %rax
movl $-1, %esi
movl $8, %ebp
movl $16, %r12d
movl $4, %r11d
movl $16, %edi
movl $18, %r13d
jmp .L176
.p2align 4,,10
.L169:
cmpl $12, %r9d
movl %ebx, %r9d
je .L180
movl %ebx, %r10d
andl $12, %r9d
andl $3, %r10d
jne .L175
addl %r9d, %r9d
shrx %r9d, %esi, %r10d
andl %r10d, %ebx
movq %rax, %r10
shrl $3, %r9d
shrl $4, %ebx
addq $24, %rax
subq %rbx, %r10
movq (%r10), %r10
movq %r10, -24(%rax)
movq %rbp, %r10
subq %rbx, %r10
movq -24(%rax,%r10), %r10
movq %r10, -16(%rax)
movq %rdi, %r10
subq %rbx, %r10
movl %r11d, %ebx
movq -24(%rax,%r10), %r10
subl %r9d, %ebx
addq %rbx, %rdx
movq %r10, -8(%rax)
.L172:
cmpq %r8, %rdx
jnb .L181
.L176:
movl (%rdx), %ebx
movl %ebx, %r9d
andl $15, %r9d
cmpl $3, %r9d
jne .L169
movzbl %bl, %r9d
shrl $4, %r9d
cmpl $8, %r9d
ja .L170
testl %r9d, %r9d
je .L182
movq 1(%rdx), %r10
movq %r10, (%rax)
movl %r9d, %r10d
addl $1, %r9d
addq %r9, %rdx
addq %r10, %rax
cmpq %r8, %rdx
jb .L176
.p2align 4,,10
.L181:
subq %rcx, %rax
.L179:
popq %rbx
popq %rsi
popq %rdi
popq %rbp
popq %r12
popq %r13
popq %r14
ret
.p2align 4,,10
.L180:
andl $48, %r9d
jne .L174
salq $48, %rbx
movq %rax, %r9
addq $2, %rdx
shrq $54, %rbx
addq $6, %rax
subq %rbx, %r9
movq (%r9), %r9
movq %r9, -6(%rax)
jmp .L172
.p2align 4,,10
.L175:
sall $3, %r10d
shrx %r10d, %esi, %r14d
andl %r14d, %ebx
movq %rax, %r14
shrl $3, %r10d
shrl $4, %ebx
subq %rbx, %r14
movl %r12d, %ebx
vlddqu (%r14), %xmm0
subl %r9d, %ebx
movl %ebx, %r9d
vmovups %xmm0, (%rax)
addq %r9, %rax
movl %r11d, %r9d
subl %r10d, %r9d
addq %r9, %rdx
jmp .L172
.p2align 4,,10
.L170:
shrl $8, %ebx
movq %rax, %r10
addq $4, %rdx
subq %rbx, %r10
movl %r13d, %ebx
subl %r9d, %ebx
vlddqu (%r10), %xmm0
movl %ebx, %r9d
addl %r9d, %r9d
vmovups %xmm0, (%rax)
addq %r9, %rax
jmp .L172
.p2align 4,,10
.L174:
movq %rax, %r10
shrl $6, %ebx
movl %r9d, %r9d
subq %rbx, %r10
addq $4, %rdx
vlddqu (%r10), %xmm0
vmovups %xmm0, (%rax)
vlddqu 16(%r10), %xmm0
vmovups %xmm0, 16(%rax)
vlddqu 32(%r10), %xmm0
vmovups %xmm0, 32(%rax)
addq %r9, %rax
jmp .L172
.p2align 4,,10
.L182:
movq %rax, %r9
movzbl %bh, %ebx
addq $32, %rax
subq %rbx, %r9
addq $2, %rdx
vlddqu (%r9), %xmm0
vmovups %xmm0, -32(%rax)
vlddqu 16(%r9), %xmm0
vmovups %xmm0, -16(%rax)
jmp .L172
.L177:
xorl %eax, %eax
jmp .L179
.seh_endproc
Worth comparing 5.10 vs 15.0, sadly no Haswell around.
What about a video that I watched in the summer, the fastest RAM @4500MHz cl16:
https://youtu.be/vJctFSiM-JA?t=250
Food for thought or RAM for madmen.
I repeated your experiments (https://1drv.ms/u/s!AmWWFXGMzDmEgmsa1z7eIcSRxJ30) with files compressed independently but joined results (lzbench.exe -jrc4 -t0,8
). My laptop has i5-4300U:
Compressor name Compress. Decompress. Compr. size Ratio Filename
lzlib 1.7 -9 1.04 MB/s 57 MB/s 39241572 18.30 8 files
lzma 9.38 -9 1.42 MB/s 85 MB/s 39385569 18.37 8 files
xz 5.2.2 -9 1.50 MB/s 76 MB/s 39391906 18.37 8 files
csc 2016-10-13 -5 1.88 MB/s 64 MB/s 39505541 18.43 8 files
brotli24 0.5.2 -11 0.26 MB/s 291 MB/s 39782573 18.55 8 files
lzham 1.0 -d26 -4 0.96 MB/s 191 MB/s 40548061 18.91 8 files
brotli 0.5.2 -11 0.34 MB/s 322 MB/s 41205419 19.22 8 files
brotli24 0.5.2 -10 0.63 MB/s 276 MB/s 41300352 19.26 8 files
zstd 1.1.1 -22 1.05 MB/s 475 MB/s 41856678 19.52 8 files
zstd 1.1.1 -20 1.57 MB/s 469 MB/s 42048011 19.61 8 files
tornado 0.6a -16 1.50 MB/s 162 MB/s 42377250 19.77 8 files
zstd 1.1.1 -18 2.36 MB/s 553 MB/s 44458626 20.74 8 files
lzham 1.0 -d26 -1 2.11 MB/s 182 MB/s 44970302 20.97 8 files
brotli24 0.5.2 -9 3.23 MB/s 320 MB/s 47419084 22.12 8 files
brotli24 0.5.2 -8 4.82 MB/s 327 MB/s 48447801 22.60 8 files
zstd 1.1.1 -16 4.15 MB/s 567 MB/s 48592086 22.66 8 files
zling 2016-01-10 -4 28 MB/s 142 MB/s 49488295 23.08 8 files
brotli24 0.5.2 -7 8.38 MB/s 329 MB/s 49633848 23.15 8 files
zstd 1.1.1 -14 4.51 MB/s 609 MB/s 50287699 23.45 8 files
zstd 1.1.1 -12 10 MB/s 603 MB/s 51036555 23.80 8 files
brotli24 0.5.2 -6 14 MB/s 329 MB/s 52054981 24.28 8 files
lz5 2.0 RC2 -49 0.94 MB/s 945 MB/s 53295371 24.86 8 files
brotli24 0.5.2 -5 19 MB/s 323 MB/s 53704913 25.05 8 files
xpack 2016-06-02 -9 7.77 MB/s 702 MB/s 54995591 25.65 8 files
crush 1.0 -2 0.16 MB/s 289 MB/s 55108586 25.70 8 files
libdeflate 16-08-29 -12 4.59 MB/s 646 MB/s 55671734 25.97 8 files
brotli24 0.5.2 -4 32 MB/s 314 MB/s 58154027 27.12 8 files
zlib 1.2.8 -9 5.30 MB/s 266 MB/s 59459388 27.73 8 files
brotli24 0.5.2 -3 68 MB/s 300 MB/s 59752585 27.87 8 files
lzfse 2016-08-16 45 MB/s 551 MB/s 59883389 27.93 8 files
brotli24 0.5.2 -2 74 MB/s 291 MB/s 59929338 27.95 8 files
lz5 2.0 RC2 -39 2.79 MB/s 1344 MB/s 60301574 28.13 8 files
lz5 2.0 RC2 -45 6.31 MB/s 1015 MB/s 60705037 28.31 8 files
lz5 2.0 RC2 -29 0.97 MB/s 1451 MB/s 61608316 28.73 8 files
ucl_nrv2e 1.03 -9 0.72 MB/s 273 MB/s 64180998 29.93 8 files
lzsse2 2016-05-14 -17 2.89 MB/s 2769 MB/s 64679706 30.17 8 files
ucl_nrv2d 1.03 -9 0.71 MB/s 278 MB/s 64781987 30.21 8 files
lzsse4 2016-05-14 -17 3.19 MB/s 2873 MB/s 64916823 30.28 8 files
brotli24 0.5.2 -1 136 MB/s 268 MB/s 65406472 30.51 8 files
ucl_nrv2b 1.03 -9 0.71 MB/s 275 MB/s 65758524 30.67 8 files
lzsse8 2016-05-14 -17 3.14 MB/s 2637 MB/s 66017136 30.79 8 files
lz5 2.0 RC2 -42 31 MB/s 1076 MB/s 66095950 30.83 8 files
lz5 2.0 RC2 -35 43 MB/s 1441 MB/s 67041268 31.27 8 files
lzmat 1.01 14 MB/s 271 MB/s 68190303 31.80 8 files
lzo1y 2.09 -999 3.43 MB/s 477 MB/s 68785649 32.08 8 files
lzo1b 2.09 -999 6.57 MB/s 585 MB/s 69424912 32.38 8 files
lz5 2.0 RC2 -25 6.55 MB/s 1633 MB/s 69801005 32.56 8 files
lz5 2.0 RC2 -19 2.89 MB/s 2264 MB/s 70313683 32.79 8 files
lzo1x 2.09 -999 3.17 MB/s 484 MB/s 70470874 32.87 8 files
lz5 2.0 RC2 -32 89 MB/s 1362 MB/s 70822655 33.03 8 files
brotli24 0.5.2 -0 180 MB/s 253 MB/s 71032154 33.13 8 files
lz4hc 1.7.3 -16 7.53 MB/s 2214 MB/s 71100109 33.16 8 files
lz5 2.0 RC2 -40 121 MB/s 1015 MB/s 72933122 34.02 8 files
brieflz 1.1.0 100 MB/s 148 MB/s 72967702 34.03 8 files
lzo1c 2.09 -999 12 MB/s 543 MB/s 74356197 34.68 8 files
lz5 2.0 RC2 -15 46 MB/s 2369 MB/s 74961332 34.96 8 files
quicklz 1.5.0 -3 38 MB/s 689 MB/s 75117273 35.04 8 files
lzo1f 2.09 -999 10 MB/s 478 MB/s 75682437 35.30 8 files
lzvn 2016-08-16 41 MB/s 754 MB/s 76053473 35.47 8 files
lz5 2.0 RC2 -22 33 MB/s 1717 MB/s 77313169 36.06 8 files
yalz77 2015-09-19 -12 19 MB/s 288 MB/s 78057851 36.41 8 files
density 0.12.5 beta -3 162 MB/s 261 MB/s 78099644 36.43 8 files
lzg 1.0.8 -8 5.38 MB/s 483 MB/s 78265043 36.50 8 files
gipfeli 2016-07-13 153 MB/s 410 MB/s 79180439 36.93 8 files
lz5 2.0 RC2 -12 99 MB/s 2271 MB/s 80292633 37.45 8 files
lzrw 15-Jul-1991 -5 108 MB/s 426 MB/s 80686433 37.63 8 files
lz5 2.0 RC2 -30 231 MB/s 923 MB/s 81583169 38.05 8 files
pithy 2011-12-24 -9 243 MB/s 1231 MB/s 83036806 38.73 8 files
yappy 2014-03-22 -100 53 MB/s 1905 MB/s 84211394 39.28 8 files
lz5 2.0 RC2 -20 142 MB/s 1558 MB/s 85994364 40.11 8 files
shrinker 0.1 267 MB/s 699 MB/s 89232822 41.62 8 files
slz_zlib 1.0.0 -3 168 MB/s 210 MB/s 91939453 42.88 8 files
lzf 3.6 -1 243 MB/s 500 MB/s 92161068 42.98 8 files
fastlz 0.1 -2 233 MB/s 409 MB/s 92947773 43.35 8 files
blosclz 2015-11-10 -9 201 MB/s 621 MB/s 94291118 43.98 8 files
snappy 1.1.3 264 MB/s 838 MB/s 94731827 44.18 8 files
lz4 1.7.3 363 MB/s 2088 MB/s 96920726 45.20 8 files
lz5 2.0 RC2 -10 202 MB/s 2247 MB/s 98480639 45.93 8 files
lzjb 2010 209 MB/s 377 MB/s 110417025 51.50 8 files
wflz 2015-09-16 184 MB/s 610 MB/s 115183256 53.72 8 files
lz4fast 1.7.3 -17 592 MB/s 2296 MB/s 128978863 60.16 8 files
Something like Silesia_Corpus, right?
It is a good idea to have file-by-file as we as all-in-one rosters, the latter will be more informative I reckon.
Your 49 and 39 modes are really fast and tight, however ratiowise one of my 100+MB testdatafiles showed you can add maybe mode 50 in RC3:
D:\BENCHMARKING>lzbench.exe -c4 -ebrotli,11/brotli24/tornado,16/blosclz,9/brieflz/crush,2/csc,5/density,3/fastlz,2/gipfeli/zstd,12,14,16,18,20,22/lzo1b,999/lzo1c,999/lzo1f,999/lzo1x,999/lzo1y,999/lzham,4/libdeflate,12/lz4/lz4fast,17/lz4hc,16/lz5,10,12,15,19,20,22,25,29,30,32,35,39,40,42,45,49/lzf,1/lzfse/lzg,8/lzham,1/lzjb/lzlib,9/lzma,9/lzrw,5/lzsse2,17/lzsse4,17/lzsse8,17/lzvn/pithy,9/quicklz,3/snappy/slz_zlib,3/ucl_nrv2b,9/ucl_nrv2d,9/ucl_nrv2e,9/xpack,9/xz,9/yalz77,12/yappy,100/zlib,9/zling,4/shrinker/wflz/lzmat Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
lzbench 1.5 (64-bit Windows) Assembled by P.Skibinski
...
The results sorted by column number 4:
Compressor name Compress. Decompress. Compr. size Ratio Filename
zstd 1.1.1 -22 1.43 MB/s 513 MB/s 13361605 11.02 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
tornado 0.6a -16 1.47 MB/s 274 MB/s 13658759 11.27 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
lzma 9.38 -9 1.17 MB/s 123 MB/s 14762661 12.18 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
xz 5.2.2 -9 1.26 MB/s 112 MB/s 14763226 12.18 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
lzham 1.0 -d26 -4 0.79 MB/s 257 MB/s 15052723 12.42 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
csc 2016-10-13 -5 1.85 MB/s 105 MB/s 16111500 13.29 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
lzlib 1.7 -9 1.01 MB/s 70 MB/s 16239377 13.39 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
zstd 1.1.1 -20 1.47 MB/s 398 MB/s 18117681 14.94 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
brotli24 0.5.2 -11 0.38 MB/s 325 MB/s 18210332 15.02 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
brotli24 0.5.2 -10 0.89 MB/s 317 MB/s 18669532 15.40 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
lzham 1.0 -d26 -1 2.10 MB/s 225 MB/s 18766148 15.48 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
brotli 0.5.2 -11 0.41 MB/s 376 MB/s 19440642 16.03 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
Nakamichi 'Okamigan' 922 MB/s 20865306 ! outside lzbench !
zstd 1.1.1 -18 2.17 MB/s 476 MB/s 20882234 17.22 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
zstd 1.1.1 -16 3.20 MB/s 524 MB/s 21906087 18.07 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
lz5 2.0 RC2 -49 1.23 MB/s 905 MB/s 22385785 18.46 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
brotli24 0.5.2 -9 4.37 MB/s 366 MB/s 22394216 18.47 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
brotli24 0.5.2 -8 6.86 MB/s 367 MB/s 22943251 18.92 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
zstd 1.1.1 -14 4.96 MB/s 606 MB/s 23002521 18.97 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
zling 2016-01-10 -4 30 MB/s 165 MB/s 23098424 19.05 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
zstd 1.1.1 -12 11 MB/s 615 MB/s 23516254 19.40 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
brotli24 0.5.2 -7 10 MB/s 367 MB/s 23539698 19.42 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
crush 1.0 -2 0.10 MB/s 340 MB/s 23616395 19.48 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
brotli24 0.5.2 -6 17 MB/s 371 MB/s 24593974 20.28 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
xpack 2016-06-02 -9 8.66 MB/s 593 MB/s 24609800 20.30 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
lz5 2.0 RC2 -29 1.25 MB/s 1226 MB/s 25138283 20.73 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
brotli24 0.5.2 -5 25 MB/s 363 MB/s 25543406 21.07 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
libdeflate 16-08-29 -12 3.46 MB/s 667 MB/s 25882591 21.35 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
lz5 2.0 RC2 -39 3.53 MB/s 1597 MB/s 27032824 22.30 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
brotli24 0.5.2 -4 54 MB/s 363 MB/s 27197722 22.43 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
zlib 1.2.8 -9 4.86 MB/s 303 MB/s 27512819 22.69 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
lzsse4 2016-05-14 -17 4.70 MB/s 2946 MB/s 28076399 23.16 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
lzsse2 2016-05-14 -17 4.11 MB/s 2827 MB/s 28142742 23.21 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
ucl_nrv2e 1.03 -9 0.80 MB/s 293 MB/s 28179335 23.24 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
brotli24 0.5.2 -3 78 MB/s 346 MB/s 28243943 23.29 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
ucl_nrv2d 1.03 -9 0.80 MB/s 306 MB/s 28528456 23.53 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
lzsse8 2016-05-14 -17 4.53 MB/s 2749 MB/s 28574041 23.57 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
brotli24 0.5.2 -2 90 MB/s 326 MB/s 28882241 23.82 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
ucl_nrv2b 1.03 -9 0.83 MB/s 304 MB/s 28899404 23.84 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
lzfse 2016-08-16 48 MB/s 498 MB/s 29436761 24.28 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
lz5 2.0 RC2 -35 48 MB/s 1628 MB/s 29737742 24.53 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
lz5 2.0 RC2 -45 6.34 MB/s 1097 MB/s 30056862 24.79 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
lz5 2.0 RC2 -19 3.50 MB/s 2261 MB/s 30265832 24.96 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
lzo1b 2.09 -999 10 MB/s 738 MB/s 30291489 24.98 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
yalz77 2015-09-19 -12 23 MB/s 314 MB/s 30463832 25.13 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
lzmat 1.01 29 MB/s 285 MB/s 30499359 25.16 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
lz5 2.0 RC2 -42 32 MB/s 939 MB/s 30600515 25.24 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
lz4hc 1.7.3 -16 11 MB/s 2028 MB/s 30765997 25.38 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
lzo1y 2.09 -999 3.27 MB/s 584 MB/s 30919230 25.50 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
lzo1x 2.09 -999 3.23 MB/s 585 MB/s 31168484 25.71 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
brotli24 0.5.2 -1 164 MB/s 294 MB/s 31199649 25.73 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
lzo1c 2.09 -999 14 MB/s 653 MB/s 32322780 26.66 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
lz5 2.0 RC2 -40 143 MB/s 929 MB/s 32671683 26.95 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
lz5 2.0 RC2 -15 50 MB/s 2237 MB/s 32706450 26.98 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
lzo1f 2.09 -999 11 MB/s 578 MB/s 32798979 27.05 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
brotli24 0.5.2 -0 221 MB/s 291 MB/s 33022898 27.24 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
lz5 2.0 RC2 -25 6.67 MB/s 1543 MB/s 33128665 27.32 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
lz5 2.0 RC2 -32 98 MB/s 1548 MB/s 33166619 27.36 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
quicklz 1.5.0 -3 47 MB/s 728 MB/s 34707722 28.63 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
lzg 1.0.8 -8 6.42 MB/s 550 MB/s 34776602 28.68 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
lz5 2.0 RC2 -22 35 MB/s 1634 MB/s 35629429 29.39 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
lzvn 2016-08-16 45 MB/s 696 MB/s 35981896 29.68 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
yappy 2014-03-22 -100 61 MB/s 1966 MB/s 35993632 29.69 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
brieflz 1.1.0 115 MB/s 151 MB/s 36298697 29.94 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
lz5 2.0 RC2 -12 103 MB/s 2136 MB/s 36732308 30.30 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
lzrw 15-Jul-1991 -5 133 MB/s 485 MB/s 36843271 30.39 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
lz5 2.0 RC2 -20 169 MB/s 1507 MB/s 37943780 31.30 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
gipfeli 2016-07-13 242 MB/s 345 MB/s 38584452 31.82 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
lz5 2.0 RC2 -30 231 MB/s 1495 MB/s 38780113 31.98 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
density 0.12.5 beta -3 275 MB/s 235 MB/s 39566686 32.63 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
pithy 2011-12-24 -9 269 MB/s 1147 MB/s 40526911 33.43 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
lzf 3.6 -1 294 MB/s 539 MB/s 42107911 34.73 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
fastlz 0.1 -2 278 MB/s 482 MB/s 42992113 35.46 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
lz4 1.7.3 359 MB/s 1898 MB/s 43373876 35.77 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
lz5 2.0 RC2 -10 313 MB/s 2072 MB/s 43405069 35.80 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
blosclz 2015-11-10 -9 248 MB/s 705 MB/s 43803035 36.13 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
slz_zlib 1.0.0 -3 182 MB/s 224 MB/s 44986909 37.10 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
snappy 1.1.3 289 MB/s 813 MB/s 44996010 37.11 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
shrinker 0.1 312 MB/s 663 MB/s 46746307 38.56 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
lzjb 2010 225 MB/s 398 MB/s 54893308 45.27 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
wflz 2015-09-16 272 MB/s 675 MB/s 56165251 46.32 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
lz4fast 1.7.3 -17 480 MB/s 1848 MB/s 57714797 47.60 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
memcpy 6454 MB/s 6627 MB/s 121244828 100.00 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
D:\BENCHMARKING>turbobenchs.exe Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl -ezlib,9/libdeflate,9,12/xpack,9/fastlz,2/lzturbo,19,29,39/bzip2/chameleon,2/snappy_c/zstd,12,22/density,3/lz4,16/lz5,15/lzham,4/brieflz/brotli,11/crush,2/lzma,9/zpaq,2,5/lzf/yappy/trle/memcpy/lzsse2,1,17/bsc_st,6/shrinker/rans_static16 -g -k0 -J13 -B2G
...
TurboBench: - Fri Dec 02 06:26:59 2016
C Size ratio% C MB/s D MB/s Name File
12327751 10.2 1.00 147.70 lzma 9 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
12876783 10.6 0.84 287.34 lzham 4 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
13097015 10.8 1.07 668.14 lzturbo 39 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
13376024 11.0 1.45 498.01 zstd 22 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
14004155 11.6 0.35 0.35 zpaq 5 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
15159296 12.5 14.84 9.48 bsc_st 6 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
16562339 13.7 1.60 528.22 xpack 9 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
16720872 13.8 1.11 1020.01 lzturbo 29 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
18210336 15.0 0.39 320.24 brotli 11 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
18933363 15.6 7.75 28.09 bzip2 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
20865306 922 Nakamichi 'Okamigan' ! outside TurboBench !
22894194 18.9 3.30 74.68 zpaq 2 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
23516258 19.4 11.69 641.04 zstd 12 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
23616399 19.5 0.10 344.82 crush 2 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
24698086 20.4 1.53 643.27 lz5 15 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
25882601 21.3 3.45 621.78 libdeflate 12 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
26890277 22.2 8.17 607.28 libdeflate 9 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
27512823 22.7 4.99 302.67 zlib 9 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
28142746 23.2 4.08 2824.44 lzsse2 17 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
30238083 24.9 0.93 2829.12 lzturbo 19 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
30766001 25.4 12.14 1886.76 lz4 16 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
36298701 29.9 114.68 201.11 brieflz Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
36544651 30.1 79.46 1896.82 yappy Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
37010892 30.5 11.30 2410.43 lzsse2 1 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
39566228 32.6 287.18 248.91 density 3 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
42256528 34.9 294.02 539.60 lzf Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
42992117 35.5 276.56 464.86 fastlz 2 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
44996014 37.1 360.28 883.49 snappy_c Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
46746725 38.6 308.52 629.54 shrinker Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
65064159 53.7 234.75 394.17 rans_static16 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
66247214 54.6 1201.24 2646.92 chameleon 2 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
121244832 100.0 6200.20 5587.58 memcpy Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
121244832 100.0 165.70 5581.40 trle Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
An unfinished booklet with some lzbench&TurboBench logs:
https://1drv.ms/b/s!AmWWFXGMzDmEgm0v7emnl4D7ys2t
The paragon test - 'Sea-Of-Words' shows mode 49 being faster on i5-2430M but a bit weaker:
https://1drv.ms/i/s!AmWWFXGMzDmEgm7j6nvbEd0Ukjaf
Also a few lines were changed in benchmarking of Okamigan, now the results are stable, simply I made 16 repetitions of 64 back-to-back decompressions and choosing the best value, that way the strange Turbo Modes will kick in and picking up the best result is ok.
My Toshiba laptop (Core 2 T7500) is crunching 'enwik8', progress bar shows 80% ratio 3.03:1 ...
Thanks inikep for the new lzbench v1.6, will post some walls with a few textual files in next hours...
Your lz5 -49 is kickass, BRAVO!
It is something special and superspeedy, it kicked my ass in my unfinished MEGA ROSTER (only ~10 files are done).
A good trio is being formed, lz5 49 vs lzturbo 29 vs Nakamichi 'Washigan+'.
Haven't planned to write a successor to 'Okamigan', however there were 2 uncovered matchlength-windowsize areas, now happy with the balance in Washigan+, it is my latest/last favorite, my intent is to throw all my efforts/resources to create the richest roster of textual decompressors of today, will be something very informative and easy-on-the-eyes...
I've added draft for Nakamichi in master
branch:
inikep/lzbench@0d382cc
To turn it on you have to use make BENCH_HAS_NAKAMICHI=1
and lzbench.exe -enakamichi
So far it's only alias for LZ4 but you can replace it with Nakamichi at the end of _lzbench/compressors.cpp
.
You also have to add file names of objects to MISC_FILES
in Makefile
:
ifeq "$(BENCH_HAS_NAKAMICHI)" "1"
DEFINES += -DBENCH_HAS_NAKAMICHI
MISC_FILES +=
endif
Thanks a lot for the possible inclusion into lzbench, Hamid already included Okamigan into TurboBench, it is good to have 'Washigan+' compiled and juxtaposed under one roof.
Unfortunately, it is still hard to me to deal with Git/make and such, I fully rely on you and Hamid to include 'Washigan+' into your benches. Moreover, my time is devoured completely by the preparation/presentation of 60+ files for lzbench and TurboBench.
A month or so ago, Yann, very modestly, suggested that Zstd v1.1.2 features faster decompression in ultra modes, it is not only so but a lot so, hee-hee.
For the first time I witnessed Zstd max mode to be on par speedwise with LzTurbo 39, however, Hamid's amazing 39 is not sleeping, it also got a heavy boost, in my view-n-tests his decompressor is simply the fastest in the realm of LZMA ratios. I am really sorry that for the moment I can only show only few dumps (in PDF file at http://www.sanmayce.com/Nakamichi/Nakamichi_Washigan+_(source-executable-booklet).zip), but I did tests with ~20 textual files (in 200-700MB range) and Zstd v1.1.2 as well as Oodle 129 were no match to the latest LzTurbo - most notable was the brutal domination with ~900MB DNA .fasta file of Dragonfly - did beat LZMA even in compression ratio department, as for speed, ay-ay-ya, 12x faster. After a month or two I promise to include in my PDF those and more big 100+MB files. simply the three laptops that I use are compressing non-stop with all threads available.
Logo&Intro:
www.sanmayce.com/Nakamichi/Washigan+_booklet_01.png
www.sanmayce.com/Nakamichi/Washigan+_booklet_02.png
www.sanmayce.com/Nakamichi/Washigan+_booklet_03.png
www.sanmayce.com/Nakamichi/Washigan+_booklet_04.png
www.sanmayce.com/Nakamichi/Washigan+_booklet_05.png
Dragonfly DNA:
www.sanmayce.com/Nakamichi/Washigan+_booklet_06a.png
www.sanmayce.com/Nakamichi/Washigan+_booklet_06b.png
Soljenicin:
www.sanmayce.com/Nakamichi/Washigan+_booklet_07a.png
www.sanmayce.com/Nakamichi/Washigan+_booklet_07b.png
Dostoevski:
www.sanmayce.com/Nakamichi/Washigan+_booklet_08a.png
www.sanmayce.com/Nakamichi/Washigan+_booklet_08b.png
Sadly, no time for more files this night, only these two:
www.sanmayce.com/Nakamichi/Washigan+_booklet_new_01.png
This is how I want to present every single file, with dedicated 2-3 pages:
www.sanmayce.com/Nakamichi/Booklet_Washigan+_DRAFT_7-pages.pdf
D:\Washigan+_vs_lzbench_vs_TurboBench_(LzTurbo_vs_Zstd_vs_Oodle)_2017-Feb>_BENCH_a_file.BAT lzbench-1.6_(sources).tar
D:\Washigan+_vs_lzbench_vs_TurboBench_(LzTurbo_vs_Zstd_vs_Oodle)_2017-Feb>"Nakamichi_Washigan+_(1xQWORD+1xXMM)_Intel_15.0_64bit_SSE41.exe" lzbench-1.6_(sources).tar.Nakamichi /bench
Nakamichi 'Washigan+', written by Kaze, based on Nobuo Ito's LZSS source, babealicious suggestion by m^2 enforced, muffinesque suggestion by Jim Dempsey enforced.
Note0: Nakamichi 'Eye-of-the-Eagle' is 100% FREE, licenseless that is.
Note1: Hamid Buzidi's LzTurbo ([a] FASTEST [Textual] Decompressor, Levels 19/39) retains kingship, his TurboBench (2016-Dec-26) proves the supremacy of LzTurbo, Turbo-Amazing!
Note2: Conor Stokes' LZSSE2 ([a] FASTEST Textual Decompressor, Level 17) is embedded, all credits along with many thanks go to him.
Note3: 'Washigan' predecessors are 'Okamigan', 'Zato', 'Tsubame', 'Tengu-Tsuyo' and 'Tengu'.
Note4: This compile can handle files up to 5120MB.
Note5: The matchfinder/memmem() is 'Railgun_BawBaw_reverse'.
Note6: Instead of '_mm_loadu_si128' '_mm_lddqu_si128' is used.
Note7: The lookahead 'Tsuyo' heuristic which looks one char ahead is applied thrice, still not strengthened, though.
Note8: The compile made 2017-Feb-07, the decompression time measuring is done in 16x8 passes choosing the top score from 64 back-to-back runs - the goal - to enter [maximal] Turbo Mode.
Note9: Just to reduce the codesize, the 3xQWORD become (in this compile) 1xQWORD+1xXMMWORD.
NoteA: Please send me (at sanmayce@sanmayce.com) decompression results obtained on machines with fast CPU-RAM subsystems.
Current priority class is REALTIME_PRIORITY_CLASS.
Allocating Source-Buffer 1 MB ...
Allocating Target-Buffer 5,120 MB ...
Decompressing 2,038,792 bytes (being the compressed stream) ...
Warming up ...
RAM-to-RAM performance:
1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1234 MB/s; 1245 MB/s; 1272 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s
Enforcing 17 seconds idling to avoid throttling ...
1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s
Enforcing 17 seconds idling to avoid throttling ...
1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s
Enforcing 17 seconds idling to avoid throttling ...
1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s
Enforcing 17 seconds idling to avoid throttling ...
1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s
Enforcing 17 seconds idling to avoid throttling ...
1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1245 MB/s; 1209 MB/s; 1243 MB/s; 1243 MB/s; 1243 MB/s; 1243 MB/s; 1243 MB/s
Enforcing 17 seconds idling to avoid throttling ...
1243 MB/s; 1243 MB/s; 1243 MB/s; 1243 MB/s; 1243 MB/s; 1243 MB/s; 1243 MB/s; 1243 MB/s; 1243 MB/s; 1243 MB/s; 1243 MB/s; 1243 MB/s; 1243 MB/s; 1243 MB/s; 1243 MB/s; 1243 MB/s
Enforcing 17 seconds idling to avoid throttling ...
1243 MB/s; 1243 MB/s; 1243 MB/s; 1243 MB/s; 1243 MB/s; 1243 MB/s; 1243 MB/s; 1243 MB/s; 1243 MB/s; 1243 MB/s; 1243 MB/s; 1243 MB/s; 1243 MB/s; 1243 MB/s; 1243 MB/s; 1243 MB/s
Enforcing 17 seconds idling to avoid throttling ...
This CPU seems to be working at 2,394 MHz, or more due to ensleeping.
RAM-to-RAM (peak) performance: 1272 MB/s.
Source-file-Hash(FNV1A_YoshimitsuTRIAD) = 0x56c5,a49c
Target-file-Hash(FNV1A_YoshimitsuTRIAD) = 0x85b6,6898
Allocating Source-Buffer 2 MB ...
Allocating Target-Buffer 5,120 MB ...
Decompressing 'lzbench-1.6_(sources).tar.L17.LZSSE2' (2,133,383 bytes, being the compressed stream) ...
Warming up ...
RAM-to-RAM performance:
3243 MB/s; 3243 MB/s; 3243 MB/s; 3243 MB/s; 3259 MB/s; 3243 MB/s; 3243 MB/s; 3243 MB/s; 3243 MB/s; 3259 MB/s; 3243 MB/s; 3243 MB/s; 3243 MB/s; 3243 MB/s; 3259 MB/s; 3243 MB/s
Enforcing 17 seconds idling to avoid throttling ...
3259 MB/s; 3243 MB/s; 3243 MB/s; 3243 MB/s; 3243 MB/s; 3259 MB/s; 3243 MB/s; 3243 MB/s; 3243 MB/s; 3243 MB/s; 3259 MB/s; 3243 MB/s; 3243 MB/s; 3243 MB/s; 3243 MB/s; 3259 MB/s
Enforcing 17 seconds idling to avoid throttling ...
3243 MB/s; 3243 MB/s; 3243 MB/s; 3243 MB/s; 3259 MB/s; 3243 MB/s; 3243 MB/s; 3243 MB/s; 3243 MB/s; 3259 MB/s; 3243 MB/s; 3243 MB/s; 3243 MB/s; 3243 MB/s; 3259 MB/s; 3243 MB/s
Enforcing 17 seconds idling to avoid throttling ...
3243 MB/s; 3243 MB/s; 3243 MB/s; 3259 MB/s; 3243 MB/s; 3243 MB/s; 3243 MB/s; 3243 MB/s; 3259 MB/s; 3243 MB/s; 3243 MB/s; 3243 MB/s; 3243 MB/s; 3259 MB/s; 3243 MB/s; 3243 MB/s
Enforcing 17 seconds idling to avoid throttling ...
3243 MB/s; 3243 MB/s; 3259 MB/s; 3243 MB/s; 3243 MB/s; 3243 MB/s; 3243 MB/s; 3259 MB/s; 3243 MB/s; 3243 MB/s; 3243 MB/s; 3243 MB/s; 3259 MB/s; 3243 MB/s; 3243 MB/s; 3243 MB/s
Enforcing 17 seconds idling to avoid throttling ...
3243 MB/s; 3021 MB/s; 3259 MB/s; 3243 MB/s; 3243 MB/s; 3243 MB/s; 3243 MB/s; 3259 MB/s; 3243 MB/s; 3243 MB/s; 3243 MB/s; 3243 MB/s; 3259 MB/s; 3243 MB/s; 3243 MB/s; 3243 MB/s
Enforcing 17 seconds idling to avoid throttling ...
3243 MB/s; 3259 MB/s; 3243 MB/s; 3243 MB/s; 3243 MB/s; 3243 MB/s; 3259 MB/s; 3243 MB/s; 3243 MB/s; 3243 MB/s; 3243 MB/s; 3259 MB/s; 3243 MB/s; 3243 MB/s; 3243 MB/s; 3243 MB/s
Enforcing 17 seconds idling to avoid throttling ...
3243 MB/s; 3243 MB/s; 3259 MB/s; 3243 MB/s; 3243 MB/s; 3243 MB/s; 3243 MB/s; 3259 MB/s; 3243 MB/s; 3243 MB/s; 3243 MB/s; 3243 MB/s; 3259 MB/s; 3243 MB/s; 3243 MB/s; 3243 MB/s
Enforcing 17 seconds idling to avoid throttling ...
This CPU seems to be working at 2,394 MHz, or more due to ensleeping.
RAM-to-RAM (peak) performance: 3259 MB/s.
Nakamichi 'Washigan+' vs LZSSE2 17, c.size: 0.96x
LZSSE2 17 vs Nakamichi 'Washigan+', d.rate: 2.56x
Bottomline:
Nakamichi 'Washigan+' expanding 5.32x to 10,840,064 at 1272 MB/s.
D:\Washigan+_vs_lzbench_vs_TurboBench_(LzTurbo_vs_Zstd_vs_Oodle)_2017-Feb>lzbench.exe -c4 -ebrotli24,11/tornado,16/blosclz,9/brieflz/crush,2/csc,5/density,3/fastlz,2/gipfeli/zstd,12,22/lzo1b,999/lzham,4/libdeflate,12/lz4hc,16/lz5,19,29,39,49/lzf,1/lzfse/lzg,8/lzham,1/lzjb/lzlib,9/lzma,9/lzrw,5/lzsse2,17/lzsse4,17/lzsse8,17/lzvn/pithy,9/quicklz,3/snappy/slz_zlib,3/ucl_nrv2b,9/ucl_nrv2d,9/ucl_nrv2e,9/xpack,9/xz,9/yalz77,12/yappy,10000/zlib,9/zling,4/shrinker/wflz/lzmat lzbench-1.6_(sources).tar
lzbench 1.6 (64-bit Windows) Assembled by P.Skibinski
Compressor name Compress. Decompress. Compr. size Ratio Filename
memcpy 6445 MB/s 6447 MB/s 10840064 100.00 lzbench-1.6_(sources).tar
...
The results sorted by column number 4:
Compressor name Compress. Decompress. Compr. size Ratio Filename
lzlib 1.7 -9 1.52 MB/s 73 MB/s 1329892 12.27 lzbench-1.6_(sources).tar
brotli24 0.5.2 -11 0.42 MB/s 388 MB/s 1339615 12.36 lzbench-1.6_(sources).tar
lzma 9.38 -9 2.19 MB/s 117 MB/s 1344492 12.40 lzbench-1.6_(sources).tar
xz 5.2.2 -9 2.40 MB/s 100 MB/s 1344842 12.41 lzbench-1.6_(sources).tar
csc 2016-10-13 -5 2.84 MB/s 97 MB/s 1407023 12.98 lzbench-1.6_(sources).tar
zstd 1.1.3 -22 1.50 MB/s 668 MB/s 1409442 13.00 lzbench-1.6_(sources).tar
lzham 1.0 -d26 -4 1.35 MB/s 243 MB/s 1441269 13.30 lzbench-1.6_(sources).tar
tornado 0.6a -16 2.09 MB/s 249 MB/s 1452118 13.40 lzbench-1.6_(sources).tar
lzham 1.0 -d26 -1 2.55 MB/s 229 MB/s 1540492 14.21 lzbench-1.6_(sources).tar
zling 2016-01-10 -4 48 MB/s 219 MB/s 1621278 14.96 lzbench-1.6_(sources).tar
zstd 1.1.3 -12 19 MB/s 764 MB/s 1656360 15.28 lzbench-1.6_(sources).tar
lz5 2.0 -49 1.08 MB/s 1308 MB/s 1730670 15.97 lzbench-1.6_(sources).tar
xpack 2016-06-02 -9 17 MB/s 705 MB/s 1766257 16.29 lzbench-1.6_(sources).tar
crush 1.0 -2 0.66 MB/s 395 MB/s 1766899 16.30 lzbench-1.6_(sources).tar
libdeflate 0.6 -12 3.77 MB/s 725 MB/s 1829572 16.88 lzbench-1.6_(sources).tar
zlib 1.2.8 -9 6.36 MB/s 356 MB/s 1932397 17.83 lzbench-1.6_(sources).tar
lzfse 2016-08-16 53 MB/s 620 MB/s 1965164 18.13 lzbench-1.6_(sources).tar
ucl_nrv2e 1.03 -9 1.81 MB/s 341 MB/s 1977837 18.25 lzbench-1.6_(sources).tar
lz5 2.0 -29 1.08 MB/s 1946 MB/s 1985200 18.31 lzbench-1.6_(sources).tar
ucl_nrv2d 1.03 -9 1.81 MB/s 353 MB/s 1995246 18.41 lzbench-1.6_(sources).tar
ucl_nrv2b 1.03 -9 1.87 MB/s 349 MB/s 2015251 18.59 lzbench-1.6_(sources).tar
lz5 2.0 -39 1.76 MB/s 1719 MB/s 2037273 18.79 lzbench-1.6_(sources).tar
Nakamichi 'Washigan+' 1272 MB/s 2038792 5.32x ! outside lzbench !
lzmat 1.01 20 MB/s 314 MB/s 2131474 19.66 lzbench-1.6_(sources).tar
lzsse2 2016-05-14 -17 1.59 MB/s 3055 MB/s 2133383 19.68 lzbench-1.6_(sources).tar
lzsse4 2016-05-14 -17 1.71 MB/s 3208 MB/s 2157301 19.90 lzbench-1.6_(sources).tar
lzsse8 2016-05-14 -17 1.62 MB/s 2986 MB/s 2202805 20.32 lzbench-1.6_(sources).tar
lzo1b 2.09 -999 10 MB/s 814 MB/s 2209863 20.39 lzbench-1.6_(sources).tar
lz5 2.0 -19 1.80 MB/s 2442 MB/s 2275195 20.99 lzbench-1.6_(sources).tar
quicklz 1.5.0 -3 53 MB/s 857 MB/s 2411886 22.25 lzbench-1.6_(sources).tar
brieflz 1.1.0 137 MB/s 176 MB/s 2495913 23.02 lzbench-1.6_(sources).tar
lzg 1.0.8 -8 10 MB/s 576 MB/s 2526687 23.31 lzbench-1.6_(sources).tar
lzvn 2016-08-16 48 MB/s 812 MB/s 2554967 23.57 lzbench-1.6_(sources).tar
yalz77 2015-09-19 -12 33 MB/s 348 MB/s 2638164 24.34 lzbench-1.6_(sources).tar
gipfeli 2016-07-13 274 MB/s 448 MB/s 2839645 26.20 lzbench-1.6_(sources).tar
pithy 2011-12-24 -9 337 MB/s 1297 MB/s 2854482 26.33 lzbench-1.6_(sources).tar
lzrw 15-Jul-1991 -5 130 MB/s 529 MB/s 2986229 27.55 lzbench-1.6_(sources).tar
shrinker 0.1 324 MB/s 779 MB/s 3096315 28.56 lzbench-1.6_(sources).tar
yappy 2014-03-22 -10000 30 MB/s 2085 MB/s 3205475 29.57 lzbench-1.6_(sources).tar
slz_zlib 1.0.0 -3 207 MB/s 249 MB/s 3212992 29.64 lzbench-1.6_(sources).tar
fastlz 0.1 -2 293 MB/s 482 MB/s 3301899 30.46 lzbench-1.6_(sources).tar
snappy 1.1.3 326 MB/s 919 MB/s 3418571 31.54 lzbench-1.6_(sources).tar
blosclz 2015-11-10 -9 249 MB/s 705 MB/s 3449644 31.82 lzbench-1.6_(sources).tar
density 0.12.5 beta -3 239 MB/s 210 MB/s 3529368 32.56 lzbench-1.6_(sources).tar
lzf 3.6 -1 287 MB/s 550 MB/s 3598702 33.20 lzbench-1.6_(sources).tar
wflz 2015-09-16 288 MB/s 701 MB/s 4165927 38.43 lzbench-1.6_(sources).tar
lzjb 2010 228 MB/s 416 MB/s 4661546 43.00 lzbench-1.6_(sources).tar
lz4hc 1.7.5 -16 92 MB/s 6772 MB/s 10882575 100.39 lzbench-1.6_(sources).tar
D:\Washigan+_vs_lzbench_vs_TurboBench_(LzTurbo_vs_Zstd_vs_Oodle)_2017-Feb>call turbobench_singlefile_noNakamichi_STRONG_2G.bat lzbench-1.6_(sources).tar
D:\Washigan+_vs_lzbench_vs_TurboBench_(LzTurbo_vs_Zstd_vs_Oodle)_2017-Feb>turbobenchs.exe lzbench-1.6_(sources).tar -elibdeflate,12/oodle,19,49,89,112,114,116,118,129/lzsse2,17/lzturbo,19,29,39/zstd,22/lz5,19,29,39,49/brotli,11/lzma,9/bzip2/xpack,9/chameleon,2/density,3/lzham,4/trle/bsc_st,6 -g -J15 -B2G
TurboBench: - Mon Feb 08 03:48:10 2016
C Size ratio% C MB/s D MB/s Name File
1335630 12.3 1.61 117.76 lzma 9 lzbench-1.6_(sources).tar.tbb
1339171 12.4 0.44 386.49 brotli 11 lzbench-1.6_(sources).tar.tbb
1401068 12.9 15.16 11.30 bsc_st 6 lzbench-1.6_(sources).tar.tbb
1409446 13.0 1.56 679.84 zstd 22 lzbench-1.6_(sources).tar.tbb
1417296 13.1 1.27 1233.39 lzturbo 39 lzbench-1.6_(sources).tar.tbb
1434389 13.2 0.50 658.73 oodle 19 lzbench-1.6_(sources).tar.tbb
1436709 13.3 1.47 246.78 lzham 4 lzbench-1.6_(sources).tar.tbb
1449961 13.4 1.39 1061.74 oodle 89 lzbench-1.6_(sources).tar.tbb
1449961 13.4 0.97 1060.21 oodle 129 lzbench-1.6_(sources).tar.tbb
1560355 14.4 8.33 36.79 bzip2 lzbench-1.6_(sources).tar.tbb
1599944 14.8 2.75 701.90 xpack 9 lzbench-1.6_(sources).tar.tbb
1730674 16.0 1.06 1325.99 lz5 49 lzbench-1.6_(sources).tar.tbb
1829582 16.9 3.77 677.51 libdeflate 12 lzbench-1.6_(sources).tar.tbb
1845547 17.0 1.49 1389.21 lzturbo 29 lzbench-1.6_(sources).tar.tbb
1985204 18.3 1.10 1970.30 lz5 29 lzbench-1.6_(sources).tar.tbb
2020723 18.6 1.97 2959.11 oodle 118 lzbench-1.6_(sources).tar.tbb
2037277 18.8 1.73 1714.99 lz5 39 lzbench-1.6_(sources).tar.tbb
2038792 5.32x 1272 Nakamichi 'Washigan+' ! outside TurboBench !
2039140 18.8 1.97 3122.07 oodle 116 lzbench-1.6_(sources).tar.tbb
2133387 19.7 1.58 3117.86 lzsse2 17 lzbench-1.6_(sources).tar.tbb
2261530 20.9 3.45 1950.74 oodle 49 lzbench-1.6_(sources).tar.tbb
2270379 20.9 1.68 3070.33 lzturbo 19 lzbench-1.6_(sources).tar.tbb
2275199 21.0 1.72 2435.90 lz5 19 lzbench-1.6_(sources).tar.tbb
2390428 22.1 27.93 3131.05 oodle 114 lzbench-1.6_(sources).tar.tbb
2733195 25.2 69.40 3139.27 oodle 112 lzbench-1.6_(sources).tar.tbb
3529320 32.6 254.54 223.79 density 3 lzbench-1.6_(sources).tar.tbb
6298284 58.1 1163.64 2089.81 chameleon 2 lzbench-1.6_(sources).tar.tbb
9246575 85.3 169.23 1246.42 trle lzbench-1.6_(sources).tar.tbb
D:\Washigan+_vs_lzbench_vs_TurboBench_(LzTurbo_vs_Zstd_vs_Oodle)_2017-Feb>zstd-v1.1.2-win64.exe -b3 lzbench-1.6_(sources).tar
3#1.6_(sources).tar : 10840064 -> 2020698 (5.365), 190.9 MB/s , 618.1 MB/s
D:\Washigan+_vs_lzbench_vs_TurboBench_(LzTurbo_vs_Zstd_vs_Oodle)_2017-Feb>zstd-v1.1.2-win64.exe -b12 lzbench-1.6_(sources).tar
12#1.6_(sources).tar : 10840064 -> 1656360 (6.545), 20.0 MB/s , 715.7 MB/s
D:\Washigan+_vs_lzbench_vs_TurboBench_(LzTurbo_vs_Zstd_vs_Oodle)_2017-Feb>zstd-v1.1.2-win64.exe -b22 --ultra lzbench-1.6_(sources).tar
22#1.6_(sources).tar : 10840064 -> 1409442 (7.691), 1.4 MB/s , 676.3 MB/s
Done. To copy the console content into clipboard: 1] Right Click 2] Select All 3] Enter
D:\Washigan+_vs_lzbench_vs_TurboBench_(LzTurbo_vs_Zstd_vs_Oodle)_2017-Feb>
And the second one:
D:\Washigan+_vs_lzbench_vs_TurboBench_(LzTurbo_vs_Zstd_vs_Oodle)_2017-Feb>_BENCH_a_file.BAT James_Bond_Collection_-_52_Ebooks.tar
D:\Washigan+_vs_lzbench_vs_TurboBench_(LzTurbo_vs_Zstd_vs_Oodle)_2017-Feb>"Nakamichi_Washigan+_(1xQWORD+1xXMM)_Intel_15.0_64bit_SSE41.exe" James_Bond_Collection_-_52_Ebooks.tar.Nakamichi /bench
Nakamichi 'Washigan+', written by Kaze, based on Nobuo Ito's LZSS source, babealicious suggestion by m^2 enforced, muffinesque suggestion by Jim Dempsey enforced.
Note0: Nakamichi 'Eye-of-the-Eagle' is 100% FREE, licenseless that is.
Note1: Hamid Buzidi's LzTurbo ([a] FASTEST [Textual] Decompressor, Levels 19/39) retains kingship, his TurboBench (2016-Dec-26) proves the supremacy of LzTurbo, Turbo-Amazing!
Note2: Conor Stokes' LZSSE2 ([a] FASTEST Textual Decompressor, Level 17) is embedded, all credits along with many thanks go to him.
Note3: 'Washigan' predecessors are 'Okamigan', 'Zato', 'Tsubame', 'Tengu-Tsuyo' and 'Tengu'.
Note4: This compile can handle files up to 5120MB.
Note5: The matchfinder/memmem() is 'Railgun_BawBaw_reverse'.
Note6: Instead of '_mm_loadu_si128' '_mm_lddqu_si128' is used.
Note7: The lookahead 'Tsuyo' heuristic which looks one char ahead is applied thrice, still not strengthened, though.
Note8: The compile made 2017-Feb-07, the decompression time measuring is done in 16x8 passes choosing the top score from 64 back-to-back runs - the goal - to enter [maximal] Turbo Mode.
Note9: Just to reduce the codesize, the 3xQWORD become (in this compile) 1xQWORD+1xXMMWORD.
NoteA: Please send me (at sanmayce@sanmayce.com) decompression results obtained on machines with fast CPU-RAM subsystems.
Current priority class is REALTIME_PRIORITY_CLASS.
Allocating Source-Buffer 5 MB ...
Allocating Target-Buffer 5,120 MB ...
Decompressing 6,228,357 bytes (being the compressed stream) ...
Warming up ...
RAM-to-RAM performance:
540 MB/s; 540 MB/s; 540 MB/s; 540 MB/s; 540 MB/s; 540 MB/s; 532 MB/s; 517 MB/s; 540 MB/s; 578 MB/s; 540 MB/s; 540 MB/s; 540 MB/s; 540 MB/s; 540 MB/s; 540 MB/s
Enforcing 17 seconds idling to avoid throttling ...
540 MB/s; 540 MB/s; 574 MB/s; 574 MB/s; 578 MB/s; 574 MB/s; 578 MB/s; 578 MB/s; 574 MB/s; 578 MB/s; 573 MB/s; 573 MB/s; 573 MB/s; 573 MB/s; 578 MB/s; 574 MB/s
Enforcing 17 seconds idling to avoid throttling ...
540 MB/s; 540 MB/s; 540 MB/s; 540 MB/s; 540 MB/s; 540 MB/s; 540 MB/s; 540 MB/s; 540 MB/s; 540 MB/s; 540 MB/s; 540 MB/s; 540 MB/s; 540 MB/s; 540 MB/s; 532 MB/s
Enforcing 17 seconds idling to avoid throttling ...
540 MB/s; 540 MB/s; 540 MB/s; 540 MB/s; 574 MB/s; 574 MB/s; 578 MB/s; 573 MB/s; 578 MB/s; 574 MB/s; 574 MB/s; 578 MB/s; 578 MB/s; 578 MB/s; 578 MB/s; 574 MB/s
Enforcing 17 seconds idling to avoid throttling ...
574 MB/s; 578 MB/s; 548 MB/s; 544 MB/s; 573 MB/s; 573 MB/s; 578 MB/s; 574 MB/s; 578 MB/s; 578 MB/s; 540 MB/s; 540 MB/s; 540 MB/s; 540 MB/s; 540 MB/s; 540 MB/s
Enforcing 17 seconds idling to avoid throttling ...
532 MB/s; 517 MB/s; 540 MB/s; 540 MB/s; 540 MB/s; 540 MB/s; 574 MB/s; 574 MB/s; 574 MB/s; 574 MB/s; 578 MB/s; 578 MB/s; 574 MB/s; 574 MB/s; 574 MB/s; 578 MB/s
Enforcing 17 seconds idling to avoid throttling ...
540 MB/s; 540 MB/s; 540 MB/s; 540 MB/s; 540 MB/s; 525 MB/s; 525 MB/s; 540 MB/s; 540 MB/s; 540 MB/s; 540 MB/s; 540 MB/s; 540 MB/s; 540 MB/s; 540 MB/s; 540 MB/s
Enforcing 17 seconds idling to avoid throttling ...
578 MB/s; 578 MB/s; 574 MB/s; 578 MB/s; 578 MB/s; 578 MB/s; 574 MB/s; 578 MB/s; 578 MB/s; 574 MB/s; 574 MB/s; 574 MB/s; 574 MB/s; 574 MB/s; 574 MB/s; 578 MB/s
Enforcing 17 seconds idling to avoid throttling ...
This CPU seems to be working at 2,394 MHz, or more due to ensleeping.
RAM-to-RAM (peak) performance: 578 MB/s.
Source-file-Hash(FNV1A_YoshimitsuTRIAD) = 0xb4da,89f9
Target-file-Hash(FNV1A_YoshimitsuTRIAD) = 0x2257,9374
Allocating Source-Buffer 6 MB ...
Allocating Target-Buffer 5,120 MB ...
Decompressing 'James_Bond_Collection_-_52_Ebooks.tar.L17.LZSSE2' (7,077,598 bytes, being the compressed stream) ...
Warming up ...
RAM-to-RAM performance:
2052 MB/s; 2052 MB/s; 2056 MB/s; 2056 MB/s; 2052 MB/s; 2052 MB/s; 2052 MB/s; 2056 MB/s; 2056 MB/s; 2052 MB/s; 2052 MB/s; 2052 MB/s; 2056 MB/s; 2056 MB/s; 2052 MB/s; 2052 MB/s
Enforcing 17 seconds idling to avoid throttling ...
2052 MB/s; 2056 MB/s; 2056 MB/s; 1999 MB/s; 2056 MB/s; 1945 MB/s; 1945 MB/s; 1999 MB/s; 2056 MB/s; 2056 MB/s; 2052 MB/s; 2052 MB/s; 2052 MB/s; 2056 MB/s; 2056 MB/s; 2052 MB/s
Enforcing 17 seconds idling to avoid throttling ...
2052 MB/s; 2056 MB/s; 2056 MB/s; 2052 MB/s; 2052 MB/s; 2052 MB/s; 2056 MB/s; 2056 MB/s; 2052 MB/s; 2052 MB/s; 2052 MB/s; 2056 MB/s; 2056 MB/s; 2052 MB/s; 2052 MB/s; 2052 MB/s
Enforcing 17 seconds idling to avoid throttling ...
2056 MB/s; 2056 MB/s; 2052 MB/s; 2052 MB/s; 2052 MB/s; 2056 MB/s; 2056 MB/s; 2052 MB/s; 2052 MB/s; 2052 MB/s; 2056 MB/s; 2056 MB/s; 2052 MB/s; 2052 MB/s; 2052 MB/s; 2056 MB/s
Enforcing 17 seconds idling to avoid throttling ...
2056 MB/s; 2052 MB/s; 2052 MB/s; 2052 MB/s; 2056 MB/s; 2056 MB/s; 2052 MB/s; 2052 MB/s; 2052 MB/s; 2056 MB/s; 2056 MB/s; 2052 MB/s; 2052 MB/s; 2052 MB/s; 2056 MB/s; 2056 MB/s
Enforcing 17 seconds idling to avoid throttling ...
2052 MB/s; 2052 MB/s; 2052 MB/s; 2056 MB/s; 2056 MB/s; 2052 MB/s; 2052 MB/s; 2052 MB/s; 2056 MB/s; 2056 MB/s; 2052 MB/s; 2052 MB/s; 2052 MB/s; 2056 MB/s; 2056 MB/s; 2052 MB/s
Enforcing 17 seconds idling to avoid throttling ...
2052 MB/s; 2056 MB/s; 2056 MB/s; 2052 MB/s; 2052 MB/s; 2052 MB/s; 2056 MB/s; 2056 MB/s; 2052 MB/s; 2052 MB/s; 2052 MB/s; 2056 MB/s; 2056 MB/s; 2052 MB/s; 2052 MB/s; 2052 MB/s
Enforcing 17 seconds idling to avoid throttling ...
2056 MB/s; 2056 MB/s; 2052 MB/s; 2052 MB/s; 2052 MB/s; 2056 MB/s; 2056 MB/s; 2052 MB/s; 2052 MB/s; 2052 MB/s; 2056 MB/s; 2056 MB/s; 2052 MB/s; 2052 MB/s; 2052 MB/s; 2056 MB/s
Enforcing 17 seconds idling to avoid throttling ...
This CPU seems to be working at 2,394 MHz, or more due to ensleeping.
RAM-to-RAM (peak) performance: 2056 MB/s.
Nakamichi 'Washigan+' vs LZSSE2 17, c.size: 0.88x
LZSSE2 17 vs Nakamichi 'Washigan+', d.rate: 3.56x
Bottomline:
Nakamichi 'Washigan+' expanding 3.04x to 18,933,760 at 578 MB/s.
D:\Washigan+_vs_lzbench_vs_TurboBench_(LzTurbo_vs_Zstd_vs_Oodle)_2017-Feb>lzbench.exe -c4 -ebrotli24,11/tornado,16/blosclz,9/brieflz/crush,2/csc,5/density,3/fastlz,2/gipfeli/zstd,12,22/lzo1b,999/lzham,4/libdeflate,12/lz4hc,16/lz5,19,29,39,49/lzf,1/lzfse/lzg,8/lzham,1/lzjb/lzlib,9/lzma,9/lzrw,5/lzsse2,17/lzsse4,17/lzsse8,17/lzvn/pithy,9/quicklz,3/snappy/slz_zlib,3/ucl_nrv2b,9/ucl_nrv2d,9/ucl_nrv2e,9/xpack,9/xz,9/yalz77,12/yappy,10000/zlib,9/zling,4/shrinker/wflz/lzmat James_Bond_Collection_-_52_Ebooks.tar
lzbench 1.6 (64-bit Windows) Assembled by P.Skibinski
Compressor name Compress. Decompress. Compr. size Ratio Filename
memcpy 6343 MB/s 6419 MB/s 18933760 100.00 James_Bond_Collection_-_52_Ebooks.tar
...
The results sorted by column number 4:
Compressor name Compress. Decompress. Compr. size Ratio Filename
csc 2016-10-13 -5 2.18 MB/s 47 MB/s 4852776 25.63 James_Bond_Collection_-_52_Ebooks.tar
lzlib 1.7 -9 1.00 MB/s 43 MB/s 4957086 26.18 James_Bond_Collection_-_52_Ebooks.tar
lzma 9.38 -9 1.02 MB/s 67 MB/s 4960182 26.20 James_Bond_Collection_-_52_Ebooks.tar
xz 5.2.2 -9 1.06 MB/s 60 MB/s 4960285 26.20 James_Bond_Collection_-_52_Ebooks.tar
brotli24 0.5.2 -11 0.34 MB/s 203 MB/s 4965956 26.23 James_Bond_Collection_-_52_Ebooks.tar
lzham 1.0 -d26 -4 0.81 MB/s 136 MB/s 4983692 26.32 James_Bond_Collection_-_52_Ebooks.tar
tornado 0.6a -16 1.19 MB/s 145 MB/s 5010099 26.46 James_Bond_Collection_-_52_Ebooks.tar
zstd 1.1.3 -22 1.11 MB/s 370 MB/s 5012053 26.47 James_Bond_Collection_-_52_Ebooks.tar
lzham 1.0 -d26 -1 1.60 MB/s 133 MB/s 5733651 30.28 James_Bond_Collection_-_52_Ebooks.tar
zling 2016-01-10 -4 23 MB/s 117 MB/s 5782269 30.54 James_Bond_Collection_-_52_Ebooks.tar
lz5 2.0 -49 1.19 MB/s 601 MB/s 5859826 30.95 James_Bond_Collection_-_52_Ebooks.tar
zstd 1.1.3 -12 4.70 MB/s 444 MB/s 5963684 31.50 James_Bond_Collection_-_52_Ebooks.tar
crush 1.0 -2 0.15 MB/s 237 MB/s 6129097 32.37 James_Bond_Collection_-_52_Ebooks.tar
Nakamichi 'Washigan+' 578 MB/s 6228357 3.04x ! outside lzbench !
xpack 2016-06-02 -9 6.54 MB/s 477 MB/s 6519881 34.44 James_Bond_Collection_-_52_Ebooks.tar
libdeflate 0.6 -12 5.23 MB/s 413 MB/s 6727797 35.53 James_Bond_Collection_-_52_Ebooks.tar
lz5 2.0 -39 5.24 MB/s 1212 MB/s 6837199 36.11 James_Bond_Collection_-_52_Ebooks.tar
lz5 2.0 -29 1.20 MB/s 931 MB/s 7045802 37.21 James_Bond_Collection_-_52_Ebooks.tar
zlib 1.2.8 -9 9.69 MB/s 218 MB/s 7060922 37.29 James_Bond_Collection_-_52_Ebooks.tar
lzsse2 2016-05-14 -17 5.47 MB/s 2024 MB/s 7077598 37.38 James_Bond_Collection_-_52_Ebooks.tar
lzsse4 2016-05-14 -17 6.53 MB/s 2088 MB/s 7114758 37.58 James_Bond_Collection_-_52_Ebooks.tar
lzfse 2016-08-16 36 MB/s 367 MB/s 7124987 37.63 James_Bond_Collection_-_52_Ebooks.tar
lzsse8 2016-05-14 -17 6.16 MB/s 1983 MB/s 7183994 37.94 James_Bond_Collection_-_52_Ebooks.tar
ucl_nrv2e 1.03 -9 0.72 MB/s 198 MB/s 7549981 39.88 James_Bond_Collection_-_52_Ebooks.tar
ucl_nrv2d 1.03 -9 0.72 MB/s 199 MB/s 7643102 40.37 James_Bond_Collection_-_52_Ebooks.tar
lzo1b 2.09 -999 7.59 MB/s 433 MB/s 7787857 41.13 James_Bond_Collection_-_52_Ebooks.tar
ucl_nrv2b 1.03 -9 0.75 MB/s 195 MB/s 7825295 41.33 James_Bond_Collection_-_52_Ebooks.tar
lz5 2.0 -19 5.13 MB/s 1875 MB/s 7984273 42.17 James_Bond_Collection_-_52_Ebooks.tar
lzmat 1.01 16 MB/s 196 MB/s 8237538 43.51 James_Bond_Collection_-_52_Ebooks.tar
brieflz 1.1.0 76 MB/s 107 MB/s 8566422 45.24 James_Bond_Collection_-_52_Ebooks.tar
yalz77 2015-09-19 -12 14 MB/s 199 MB/s 8609303 45.47 James_Bond_Collection_-_52_Ebooks.tar
density 0.12.5 beta -3 261 MB/s 230 MB/s 9025276 47.67 James_Bond_Collection_-_52_Ebooks.tar
gipfeli 2016-07-13 156 MB/s 257 MB/s 9099088 48.06 James_Bond_Collection_-_52_Ebooks.tar
lzvn 2016-08-16 30 MB/s 548 MB/s 9151196 48.33 James_Bond_Collection_-_52_Ebooks.tar
lzg 1.0.8 -8 3.74 MB/s 382 MB/s 9159953 48.38 James_Bond_Collection_-_52_Ebooks.tar
quicklz 1.5.0 -3 31 MB/s 542 MB/s 9232779 48.76 James_Bond_Collection_-_52_Ebooks.tar
lzrw 15-Jul-1991 -5 83 MB/s 316 MB/s 9321087 49.23 James_Bond_Collection_-_52_Ebooks.tar
pithy 2011-12-24 -9 191 MB/s 921 MB/s 9775164 51.63 James_Bond_Collection_-_52_Ebooks.tar
shrinker 0.1 213 MB/s 529 MB/s 10757865 56.82 James_Bond_Collection_-_52_Ebooks.tar
yappy 2014-03-22 -10000 55 MB/s 1270 MB/s 10759888 56.83 James_Bond_Collection_-_52_Ebooks.tar
lzf 3.6 -1 175 MB/s 361 MB/s 10796621 57.02 James_Bond_Collection_-_52_Ebooks.tar
fastlz 0.1 -2 178 MB/s 301 MB/s 10999817 58.10 James_Bond_Collection_-_52_Ebooks.tar
blosclz 2015-11-10 -9 143 MB/s 461 MB/s 11193325 59.12 James_Bond_Collection_-_52_Ebooks.tar
slz_zlib 1.0.0 -3 123 MB/s 165 MB/s 11214807 59.23 James_Bond_Collection_-_52_Ebooks.tar
snappy 1.1.3 178 MB/s 596 MB/s 11541215 60.96 James_Bond_Collection_-_52_Ebooks.tar
wflz 2015-09-16 135 MB/s 459 MB/s 13266291 70.07 James_Bond_Collection_-_52_Ebooks.tar
lzjb 2010 142 MB/s 287 MB/s 14308530 75.57 James_Bond_Collection_-_52_Ebooks.tar
lz4hc 1.7.5 -16 91 MB/s 6305 MB/s 19008011 100.39 James_Bond_Collection_-_52_Ebooks.tar
D:\Washigan+_vs_lzbench_vs_TurboBench_(LzTurbo_vs_Zstd_vs_Oodle)_2017-Feb>call turbobench_singlefile_noNakamichi_STRONG_2G.bat James_Bond_Collection_-_52_Ebooks.tar
D:\Washigan+_vs_lzbench_vs_TurboBench_(LzTurbo_vs_Zstd_vs_Oodle)_2017-Feb>turbobenchs.exe James_Bond_Collection_-_52_Ebooks.tar -elibdeflate,12/oodle,19,49,89,112,114,116,118,129/lzsse2,17/lzturbo,19,29,39/zstd,22/lz5,19,29,39,49/brotli,11/lzma,9/bzip2/xpack,9/chameleon,2/density,3/lzham,4/trle/bsc_st,6 -g -J15 -B2G
TurboBench: - Mon Feb 08 02:57:16 2016
C Size ratio% C MB/s D MB/s Name File
4180458 22.1 9.27 5.77 bsc_st 6 James_Bond_Collection_-_52_Ebooks.tar.tbb
4961552 26.2 1.05 67.67 lzma 9 James_Bond_Collection_-_52_Ebooks.tar.tbb
4964400 26.2 0.35 210.43 brotli 11 James_Bond_Collection_-_52_Ebooks.tar.tbb
4984057 26.3 0.88 138.39 lzham 4 James_Bond_Collection_-_52_Ebooks.tar.tbb
5012057 26.5 1.16 374.39 zstd 22 James_Bond_Collection_-_52_Ebooks.tar.tbb
5015571 26.5 1.00 441.09 lzturbo 39 James_Bond_Collection_-_52_Ebooks.tar.tbb
5110548 27.0 0.73 455.81 oodle 89 James_Bond_Collection_-_52_Ebooks.tar.tbb
5110548 27.0 0.56 455.23 oodle 129 James_Bond_Collection_-_52_Ebooks.tar.tbb
5165874 27.3 10.27 20.32 bzip2 James_Bond_Collection_-_52_Ebooks.tar.tbb
5195593 27.4 0.28 286.22 oodle 19 James_Bond_Collection_-_52_Ebooks.tar.tbb
5859830 30.9 1.22 604.48 lz5 49 James_Bond_Collection_-_52_Ebooks.tar.tbb
5896011 31.1 0.58 307.24 xpack 9 James_Bond_Collection_-_52_Ebooks.tar.tbb
6228357 3.04x 578 Nakamichi 'Washigan+' ! outside TurboBench !
6438082 34.0 1.05 602.34 lzturbo 29 James_Bond_Collection_-_52_Ebooks.tar.tbb
6727807 35.5 5.18 398.90 libdeflate 12 James_Bond_Collection_-_52_Ebooks.tar.tbb
6837203 36.1 5.20 1194.41 lz5 39 James_Bond_Collection_-_52_Ebooks.tar.tbb
7045806 37.2 1.25 935.98 lz5 29 James_Bond_Collection_-_52_Ebooks.tar.tbb
7077602 37.4 5.37 2057.95 lzsse2 17 James_Bond_Collection_-_52_Ebooks.tar.tbb
7273120 38.4 0.74 1843.77 oodle 116 James_Bond_Collection_-_52_Ebooks.tar.tbb
7276205 38.4 0.94 1846.39 oodle 118 James_Bond_Collection_-_52_Ebooks.tar.tbb
7980945 42.2 1.24 2587.93 lzturbo 19 James_Bond_Collection_-_52_Ebooks.tar.tbb
7984277 42.2 5.24 1834.12 lz5 19 James_Bond_Collection_-_52_Ebooks.tar.tbb
7984323 42.2 2.71 1906.34 oodle 49 James_Bond_Collection_-_52_Ebooks.tar.tbb
8264088 43.6 10.33 2072.30 oodle 114 James_Bond_Collection_-_52_Ebooks.tar.tbb
9025960 47.7 269.91 237.28 density 3 James_Bond_Collection_-_52_Ebooks.tar.tbb
9523600 50.3 36.49 2350.38 oodle 112 James_Bond_Collection_-_52_Ebooks.tar.tbb
10847044 57.3 1092.03 1897.20 chameleon 2 James_Bond_Collection_-_52_Ebooks.tar.tbb
18897762 99.8 148.84 1324.37 trle James_Bond_Collection_-_52_Ebooks.tar.tbb
D:\Washigan+_vs_lzbench_vs_TurboBench_(LzTurbo_vs_Zstd_vs_Oodle)_2017-Feb>zstd-v1.1.2-win64.exe -b3 James_Bond_Collection_-_52_Ebooks.tar
3#n_-_52_Ebooks.tar : 18933760 -> 6804789 (2.782), 99.2 MB/s , 364.6 MB/s
D:\Washigan+_vs_lzbench_vs_TurboBench_(LzTurbo_vs_Zstd_vs_Oodle)_2017-Feb>zstd-v1.1.2-win64.exe -b12 James_Bond_Collection_-_52_Ebooks.tar
12#n_-_52_Ebooks.tar : 18933760 -> 5963684 (3.175), 4.4 MB/s , 392.4 MB/s
D:\Washigan+_vs_lzbench_vs_TurboBench_(LzTurbo_vs_Zstd_vs_Oodle)_2017-Feb>zstd-v1.1.2-win64.exe -b22 --ultra James_Bond_Collection_-_52_Ebooks.tar
22#n_-_52_Ebooks.tar : 18933760 -> 5012053 (3.778), 1.1 MB/s , 373.0 MB/s
Done. To copy the console content into clipboard: 1] Right Click 2] Select All 3] Enter
D:\Washigan+_vs_lzbench_vs_TurboBench_(LzTurbo_vs_Zstd_vs_Oodle)_2017-Feb>
In order to speed up the slowest compression rate of 'Wahigan+' my intention is to write an additional (very simple) compressing mode using 4bytes "hash" lookup table:
All unique chunks of order 4 (4 bytes long) will be used as a respective key - unaltered i.e. unhashed. Each "hash" will point to a slot (in the 4GB pool) housing one 8 bytes offset pointing to an external pool (file). In the file, "slots" will begin with 4bytes hosuing the number of occurrences of a given chunk order 4. After that number, all 8 bytes offsets (pointing to RAM), they are to be sorted (no sort is needed) as they come and will take FileSize*8 external memory.
Memory greedy, yes but the load falls into RAM while the I/O is limited to a single read. Thus 8x4GB=32GB + (4+8)xFileSize, as a max, are to be available as physical memory.
Nothing special, but I am curious how much of a boost such matchfinding will deliver, after all, current brute-force memmem() becomes really unbearable with files 100MB of size let alone 800MB.
Oh, just found the console log in which latest LzTurbo overpowers everything (Zstd v1.1.2 is there):
'28-2' Textual Decompression Showdown - 2017-Jan-03
Performers: libdeflate vs oodle vs lzsse2 vs lzturbo vs zstd vs lz5 vs brotli vs lzma
Benchmark tool: TurboBench, using the outside (883,712 bytes) oo2core_4_win64.dll
Testmachine: Laptop Toshiba i5-2430M @2.4GHz, 16GB DDR3 @666MHz
Tester: Kaze
D:\turbobench_win64_2016-Dec-28>dir
12/28/2016 10:03 PM 15,583,440 Arabian_Nights_complete.html
12/30/2016 12:39 PM 273,401,856 Autobiography_411-ebooks_Collection.tar
12/28/2016 10:03 PM 193,367,552 Big_Soviet_Encyclopedia_in_30_volumes_(1239-HTMs).tar
12/28/2016 10:03 PM 681,979,392 book_serie_SPETSNAZ_803_novels_(Russian).tar
12/30/2016 12:39 PM 595,963,560 Britannica_Encyclopedia_2010_1.563_miled_(En-En).dsl
12/28/2016 10:03 PM 135,944,758 DUDEN_-_das_grosse_worterbuch_der_deutschen_sprache_(Deu-Deu).dsl
12/28/2016 10:03 PM 107,784,192 Encyclopaedia_Judaica_(in_22_volumes)_TXT.tar
12/30/2016 12:39 PM 302,959,104 encyclopediadramaticase-20150628-current.tar
12/30/2016 12:39 PM 1,000,000,000 enwik9
12/30/2016 12:39 PM 146,759,168 glibc-2.21.tar
12/28/2016 10:03 PM 396,120,046 GreatSovietEncyclopaediaRuRu.dsl
12/28/2016 10:03 PM 150,634,496 GreatSovietEncyclopaedia_Russian_(Windows_Cyrillic_encoding).tar
12/28/2016 10:03 PM 42,920,232 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
12/28/2016 10:03 PM 121,244,828 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl
12/28/2016 10:03 PM 1,195,397 Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt
12/30/2016 12:39 PM 205,242,368 NASA_Kennedy_Space_Center_WWW_server_access_log_Jul95
12/28/2016 10:03 PM 259,707,904 open_watcom_1.9.0-src.tar
12/28/2016 10:03 PM 206,908,949 OSHO.TXT
12/30/2016 12:39 PM 560,714,120 Oxford_English_Dictionary_2nd_Edition_Version_4_(En-En).dsl
12/30/2016 12:39 PM 1,198,966,784 Sacred_Texts_7_(97830_htm_files).tar
12/28/2016 10:03 PM 611,741,184 sourcecode.opera.com_Opera_source_code_package_04-Aug-2016.tar
12/28/2016 10:03 PM 325,071,872 Star_Trek_-_737_Ebooks.tar
12/30/2016 12:39 PM 61,382,144 Stephen_King_67-books.tar
12/28/2016 10:03 PM 153,703,936 the-anarchist-library-2016-01-18-en_html.tar
12/28/2016 10:03 PM 900,933,776 Urban_Dictionary_2015_(Eng-Eng)_utf8.txt
12/28/2016 10:03 PM 681,378,816 webdevdata.org_8000_home_pages_from_the_top_10000_most_popular_web_sites.tar
12/28/2016 10:03 PM 686,991,360 www.kernel.org_linux-4.8.4.tar
12/30/2016 12:39 PM 975,021,056 www.ncbi.nlm.nih.gov_Dragonfly_(Ladona_fulva)_whole_genome_shotgun.tar
D:\turbobench_win64_2016-Dec-28>
D:\turbobench_win64_2016-Dec-28>turbobenchs.exe Arabian_Nights_complete.html -elibdeflate,12/oodle,49,129/lzsse2,17/lzturbo,19,29,39/zstd,22/lz5,19,29,39,49/brotli,11/lzma,9 -g -J15 -B2G
C Size ratio% C MB/s D MB/s Name File
3892786 25.0 1.03 68.75 lzma 9 Arabian_Nights_complete.html.tbb
3913051 25.1 0.35 214.84 brotli 11 Arabian_Nights_complete.html.tbb
3985968 25.6 1.02 391.32 zstd 22 Arabian_Nights_complete.html.tbb
3987581 25.6 0.98 481.84 lzturbo 39 Arabian_Nights_complete.html.tbb
4046409 26.0 0.56 475.97 oodle 129 Arabian_Nights_complete.html.tbb
4676927 30.0 0.99 646.19 lz5 49 Arabian_Nights_complete.html.tbb
5035111 32.3 1.08 655.96 lzturbo 29 Arabian_Nights_complete.html.tbb
5242942 33.6 4.95 406.57 libdeflate 12 Arabian_Nights_complete.html.tbb
5396929 34.6 4.80 1230.02 lz5 39 Arabian_Nights_complete.html.tbb
5524858 35.5 5.31 2106.55 lzsse2 17 Arabian_Nights_complete.html.tbb
5539896 35.5 0.97 1024.32 lz5 29 Arabian_Nights_complete.html.tbb
6183165 39.7 1.26 2604.83 lzturbo 19 Arabian_Nights_complete.html.tbb
6185837 39.7 4.81 1881.48 lz5 19 Arabian_Nights_complete.html.tbb
6186341 39.7 2.78 1826.81 oodle 49 Arabian_Nights_complete.html.tbb
D:\turbobench_win64_2016-Dec-28>turbobenchs.exe Autobiography_411-ebooks_Collection.tar -elibdeflate,12/oodle,49,129/lzsse2,17/lzturbo,19,29,39/zstd,22/lz5,19,29,39,49/brotli,11/lzma,9 -g -J15 -B2G
C Size ratio% C MB/s D MB/s Name File
68687733 25.1 0.68 66.77 lzma 9 Autobiography_411-ebooks_Collection.tar.tbb
69226676 25.3 0.60 336.40 lzturbo 39 Autobiography_411-ebooks_Collection.tar.tbb
70175123 25.7 0.81 355.52 zstd 22 Autobiography_411-ebooks_Collection.tar.tbb
71582373 26.2 0.25 342.52 oodle 129 Autobiography_411-ebooks_Collection.tar.tbb
72644598 26.6 0.34 202.79 brotli 11 Autobiography_411-ebooks_Collection.tar.tbb
86065771 31.5 1.09 578.90 lz5 49 Autobiography_411-ebooks_Collection.tar.tbb
89819743 32.9 0.62 475.64 lzturbo 29 Autobiography_411-ebooks_Collection.tar.tbb
97409376 35.6 5.25 396.93 libdeflate 12 Autobiography_411-ebooks_Collection.tar.tbb
99191332 36.3 5.27 1195.58 lz5 39 Autobiography_411-ebooks_Collection.tar.tbb
102571309 37.5 5.35 2044.82 lzsse2 17 Autobiography_411-ebooks_Collection.tar.tbb
103530599 37.9 1.07 902.24 lz5 29 Autobiography_411-ebooks_Collection.tar.tbb
115558714 42.3 0.71 2564.73 lzturbo 19 Autobiography_411-ebooks_Collection.tar.tbb
115605073 42.3 2.71 1892.89 oodle 49 Autobiography_411-ebooks_Collection.tar.tbb
115608665 42.3 5.34 1826.31 lz5 19 Autobiography_411-ebooks_Collection.tar.tbb
D:\turbobench_win64_2016-Dec-28>turbobenchs.exe Big_Soviet_Encyclopedia_in_30_volumes_(1239-HTMs).tar -elibdeflate,12/oodle,49,129/lzsse2,17/lzturbo,19,29,39/zstd,22/lz5,19,29,39,49/brotli,11/lzma,9 -g -J15 -B2G
C Size ratio% C MB/s D MB/s Name File
44338677 22.9 0.78 70.45 lzma 9 Big_Soviet_Encyclopedia_in_30_volumes_(1239-HTMs).tar.tbb
45393843 23.5 0.67 377.22 lzturbo 39 Big_Soviet_Encyclopedia_in_30_volumes_(1239-HTMs).tar.tbb
45892314 23.7 0.95 388.90 zstd 22 Big_Soviet_Encyclopedia_in_30_volumes_(1239-HTMs).tar.tbb
46879644 24.2 0.33 380.17 oodle 129 Big_Soviet_Encyclopedia_in_30_volumes_(1239-HTMs).tar.tbb
47806683 24.7 0.36 201.32 brotli 11 Big_Soviet_Encyclopedia_in_30_volumes_(1239-HTMs).tar.tbb
56069030 29.0 0.71 562.64 lzturbo 29 Big_Soviet_Encyclopedia_in_30_volumes_(1239-HTMs).tar.tbb
60127082 31.1 1.07 596.90 lz5 49 Big_Soviet_Encyclopedia_in_30_volumes_(1239-HTMs).tar.tbb
69034453 35.7 5.60 367.79 libdeflate 12 Big_Soviet_Encyclopedia_in_30_volumes_(1239-HTMs).tar.tbb
69776988 36.1 1.12 938.98 lz5 29 Big_Soviet_Encyclopedia_in_30_volumes_(1239-HTMs).tar.tbb
72591668 37.5 3.93 1272.14 lz5 39 Big_Soviet_Encyclopedia_in_30_volumes_(1239-HTMs).tar.tbb
74482316 38.5 4.45 1917.90 lzsse2 17 Big_Soviet_Encyclopedia_in_30_volumes_(1239-HTMs).tar.tbb
80601200 41.7 0.83 2713.96 lzturbo 19 Big_Soviet_Encyclopedia_in_30_volumes_(1239-HTMs).tar.tbb
80646051 41.7 3.92 1987.27 lz5 19 Big_Soviet_Encyclopedia_in_30_volumes_(1239-HTMs).tar.tbb
80659373 41.7 2.92 1944.67 oodle 49 Big_Soviet_Encyclopedia_in_30_volumes_(1239-HTMs).tar.tbb
D:\turbobench_win64_2016-Dec-28>turbobenchs.exe book_serie_SPETSNAZ_803_novels_(Russian).tar -elibdeflate,12/oodle,49,129/lzsse2,17/lzturbo,19,29,39/zstd,22/lz5,19,29,39,49/brotli,11/lzma,9 -g -J15 -B2G
C Size ratio% C MB/s D MB/s Name File
91822906 13.5 0.65 116.07 lzma 9 book_serie_SPETSNAZ_803_novels_(Russian).tar.tbb
92190437 13.5 0.52 519.89 lzturbo 39 book_serie_SPETSNAZ_803_novels_(Russian).tar.tbb
99592865 14.6 0.19 496.51 oodle 129 book_serie_SPETSNAZ_803_novels_(Russian).tar.tbb
107524585 15.8 0.93 466.83 zstd 22 book_serie_SPETSNAZ_803_novels_(Russian).tar.tbb
119302760 17.5 0.33 295.14 brotli 11 book_serie_SPETSNAZ_803_novels_(Russian).tar.tbb
125170117 18.4 0.53 717.87 lzturbo 29 book_serie_SPETSNAZ_803_novels_(Russian).tar.tbb
133463325 19.6 1.07 713.91 lz5 49 book_serie_SPETSNAZ_803_novels_(Russian).tar.tbb
157283872 23.1 1.08 944.34 lz5 29 book_serie_SPETSNAZ_803_novels_(Russian).tar.tbb
172354213 25.3 3.83 1448.84 lz5 39 book_serie_SPETSNAZ_803_novels_(Russian).tar.tbb
175092031 25.7 3.50 604.65 libdeflate 12 book_serie_SPETSNAZ_803_novels_(Russian).tar.tbb
178282598 26.1 0.50 2782.13 lzsse2 17 book_serie_SPETSNAZ_803_novels_(Russian).tar.tbb
203810125 29.9 0.51 2859.63 lzturbo 19 book_serie_SPETSNAZ_803_novels_(Russian).tar.tbb
203918268 29.9 3.83 2083.81 lz5 19 book_serie_SPETSNAZ_803_novels_(Russian).tar.tbb
203919530 29.9 2.59 1619.64 oodle 49 book_serie_SPETSNAZ_803_novels_(Russian).tar.tbb
D:\turbobench_win64_2016-Dec-28>turbobenchs.exe Britannica_Encyclopedia_2010_1.563_miled_(En-En).dsl -elibdeflate,12/oodle,49,129/lzsse2,17/lzturbo,19,29,39/zstd,22/lz5,19,29,39,49/brotli,11/lzma,9 -g -J15 -B2G
C Size ratio% C MB/s D MB/s Name File
67667992 11.4 0.68 130.91 lzma 9 Britannica_Encyclopedia_2010_1.563_miled_(En-En).dsl.tbb
70480198 11.8 0.48 564.95 lzturbo 39 Britannica_Encyclopedia_2010_1.563_miled_(En-En).dsl.tbb
77251600 13.0 1.03 526.62 zstd 22 Britannica_Encyclopedia_2010_1.563_miled_(En-En).dsl.tbb
77993552 13.1 0.27 539.97 oodle 129 Britannica_Encyclopedia_2010_1.563_miled_(En-En).dsl.tbb
81543601 13.7 0.36 364.24 brotli 11 Britannica_Encyclopedia_2010_1.563_miled_(En-En).dsl.tbb
91413513 15.3 1.09 846.93 lz5 49 Britannica_Encyclopedia_2010_1.563_miled_(En-En).dsl.tbb
96097656 16.1 0.50 807.74 lzturbo 29 Britannica_Encyclopedia_2010_1.563_miled_(En-En).dsl.tbb
108679471 18.2 1.12 1100.40 lz5 29 Britannica_Encyclopedia_2010_1.563_miled_(En-En).dsl.tbb
115999431 19.5 3.23 736.74 libdeflate 12 Britannica_Encyclopedia_2010_1.563_miled_(En-En).dsl.tbb
117285259 19.7 3.34 1544.37 lz5 39 Britannica_Encyclopedia_2010_1.563_miled_(En-En).dsl.tbb
122740057 20.6 3.80 3222.55 lzsse2 17 Britannica_Encyclopedia_2010_1.563_miled_(En-En).dsl.tbb
139217908 23.4 0.57 2814.80 lzturbo 19 Britannica_Encyclopedia_2010_1.563_miled_(En-En).dsl.tbb
139352308 23.4 2.50 1506.26 oodle 49 Britannica_Encyclopedia_2010_1.563_miled_(En-En).dsl.tbb
139384640 23.4 3.34 2120.88 lz5 19 Britannica_Encyclopedia_2010_1.563_miled_(En-En).dsl.tbb
D:\turbobench_win64_2016-Dec-28>turbobenchs.exe DUDEN_-_das_grosse_worterbuch_der_deutschen_sprache_(Deu-Deu).dsl -elibdeflate,12/oodle,49,129/lzsse2,17/lzturbo,19,29,39/zstd,22/lz5,19,29,39,49/brotli,11/lzma,9 -g -J15 -B2G
C Size ratio% C MB/s D MB/s Name File
12817203 9.4 0.87 159.26 lzma 9 DUDEN_-_das_grosse_worterbuch_der_deutschen_sprache_(Deu-Deu).dsl.tbb
13383282 9.8 0.67 786.25 lzturbo 39 DUDEN_-_das_grosse_worterbuch_der_deutschen_sprache_(Deu-Deu).dsl.tbb
14042691 10.3 1.10 649.82 zstd 22 DUDEN_-_das_grosse_worterbuch_der_deutschen_sprache_(Deu-Deu).dsl.tbb
14520138 10.7 0.39 428.30 brotli 11 DUDEN_-_das_grosse_worterbuch_der_deutschen_sprache_(Deu-Deu).dsl.tbb
14737132 10.8 0.45 684.70 oodle 129 DUDEN_-_das_grosse_worterbuch_der_deutschen_sprache_(Deu-Deu).dsl.tbb
16537558 12.2 1.02 1063.47 lz5 49 DUDEN_-_das_grosse_worterbuch_der_deutschen_sprache_(Deu-Deu).dsl.tbb
17944138 13.2 0.72 1141.00 lzturbo 29 DUDEN_-_das_grosse_worterbuch_der_deutschen_sprache_(Deu-Deu).dsl.tbb
19442211 14.3 1.04 1354.01 lz5 29 DUDEN_-_das_grosse_worterbuch_der_deutschen_sprache_(Deu-Deu).dsl.tbb
21459853 15.8 3.19 823.43 libdeflate 12 DUDEN_-_das_grosse_worterbuch_der_deutschen_sprache_(Deu-Deu).dsl.tbb
22000250 16.2 2.72 1729.68 lz5 39 DUDEN_-_das_grosse_worterbuch_der_deutschen_sprache_(Deu-Deu).dsl.tbb
23405587 17.2 3.49 3427.45 lzsse2 17 DUDEN_-_das_grosse_worterbuch_der_deutschen_sprache_(Deu-Deu).dsl.tbb
25778587 19.0 0.84 2971.54 lzturbo 19 DUDEN_-_das_grosse_worterbuch_der_deutschen_sprache_(Deu-Deu).dsl.tbb
25819986 19.0 2.55 1734.03 oodle 49 DUDEN_-_das_grosse_worterbuch_der_deutschen_sprache_(Deu-Deu).dsl.tbb
25825483 19.0 2.70 2316.89 lz5 19 DUDEN_-_das_grosse_worterbuch_der_deutschen_sprache_(Deu-Deu).dsl.tbb
D:\turbobench_win64_2016-Dec-28>turbobenchs.exe Encyclopaedia_Judaica_(in_22_volumes)_TXT.tar -elibdeflate,12/oodle,49,129/lzsse2,17/lzturbo,19,29,39/zstd,22/lz5,19,29,39,49/brotli,11/lzma,9 -g -J15 -B2G
C Size ratio% C MB/s D MB/s Name File
27526894 25.5 0.78 64.84 lzma 9 Encyclopaedia_Judaica_(in_22_volumes)_TXT.tar.tbb
27989008 26.0 0.69 351.84 lzturbo 39 Encyclopaedia_Judaica_(in_22_volumes)_TXT.tar.tbb
28050152 26.0 0.86 355.23 zstd 22 Encyclopaedia_Judaica_(in_22_volumes)_TXT.tar.tbb
28631854 26.6 0.37 359.89 oodle 129 Encyclopaedia_Judaica_(in_22_volumes)_TXT.tar.tbb
28791645 26.7 0.34 189.57 brotli 11 Encyclopaedia_Judaica_(in_22_volumes)_TXT.tar.tbb
35077489 32.5 1.16 534.26 lz5 49 Encyclopaedia_Judaica_(in_22_volumes)_TXT.tar.tbb
35525296 33.0 0.75 516.53 lzturbo 29 Encyclopaedia_Judaica_(in_22_volumes)_TXT.tar.tbb
40516809 37.6 5.59 377.53 libdeflate 12 Encyclopaedia_Judaica_(in_22_volumes)_TXT.tar.tbb
41420278 38.4 1.19 818.50 lz5 29 Encyclopaedia_Judaica_(in_22_volumes)_TXT.tar.tbb
42104125 39.1 5.75 1186.58 lz5 39 Encyclopaedia_Judaica_(in_22_volumes)_TXT.tar.tbb
42926057 39.8 6.01 1931.39 lzsse2 17 Encyclopaedia_Judaica_(in_22_volumes)_TXT.tar.tbb
47817238 44.4 0.89 2560.87 lzturbo 19 Encyclopaedia_Judaica_(in_22_volumes)_TXT.tar.tbb
47834366 44.4 5.80 1829.62 lz5 19 Encyclopaedia_Judaica_(in_22_volumes)_TXT.tar.tbb
47836827 44.4 2.77 1850.11 oodle 49 Encyclopaedia_Judaica_(in_22_volumes)_TXT.tar.tbb
D:\turbobench_win64_2016-Dec-28>turbobenchs.exe encyclopediadramaticase-20150628-current.tar -elibdeflate,12/oodle,49,129/lzsse2,17/lzturbo,19,29,39/zstd,22/lz5,19,29,39,49/brotli,11/lzma,9 -g -J15 -B2G
C Size ratio% C MB/s D MB/s Name File
49921606 16.5 0.85 95.06 lzma 9 encyclopediadramaticase-20150628-current.tar.tbb
51464446 17.0 0.69 518.95 lzturbo 39 encyclopediadramaticase-20150628-current.tar.tbb
52920512 17.5 0.92 504.03 zstd 22 encyclopediadramaticase-20150628-current.tar.tbb
53288327 17.6 0.35 510.56 oodle 129 encyclopediadramaticase-20150628-current.tar.tbb
55013024 18.2 0.33 263.97 brotli 11 encyclopediadramaticase-20150628-current.tar.tbb
64930697 21.4 0.75 756.69 lzturbo 29 encyclopediadramaticase-20150628-current.tar.tbb
68917242 22.7 0.95 796.20 lz5 49 encyclopediadramaticase-20150628-current.tar.tbb
77426528 25.6 5.20 501.42 libdeflate 12 encyclopediadramaticase-20150628-current.tar.tbb
81475202 26.9 0.96 1296.91 lz5 29 encyclopediadramaticase-20150628-current.tar.tbb
83394972 27.5 2.73 1575.25 lz5 39 encyclopediadramaticase-20150628-current.tar.tbb
86884545 28.7 0.37 2350.65 lzsse2 17 encyclopediadramaticase-20150628-current.tar.tbb
92724282 30.6 2.71 2387.02 lz5 19 encyclopediadramaticase-20150628-current.tar.tbb
92752238 30.6 0.87 3112.68 lzturbo 19 encyclopediadramaticase-20150628-current.tar.tbb
92803122 30.6 3.18 2174.29 oodle 49 encyclopediadramaticase-20150628-current.tar.tbb
D:\turbobench_win64_2016-Dec-28>turbobenchs.exe glibc-2.21.tar -elibdeflate,12/oodle,49,129/lzsse2,17/lzturbo,19,29,39/zstd,22/lz5,19,29,39,49/brotli,11/lzma,9 -g -J15 -B2G
C Size ratio% C MB/s D MB/s Name File
12284390 8.4 1.35 150.83 lzma 9 glibc-2.21.tar.tbb
12916881 8.8 0.47 509.17 brotli 11 glibc-2.21.tar.tbb
13467562 9.2 1.09 1328.48 lzturbo 39 glibc-2.21.tar.tbb
13642644 9.3 1.22 766.40 zstd 22 glibc-2.21.tar.tbb
13883171 9.5 0.65 1228.77 oodle 129 glibc-2.21.tar.tbb
18047998 12.3 0.76 1536.08 lz5 49 glibc-2.21.tar.tbb
20622690 14.1 1.29 1694.39 lzturbo 29 glibc-2.21.tar.tbb
22205298 15.1 4.31 705.42 libdeflate 12 glibc-2.21.tar.tbb
22537676 15.4 0.77 2368.72 lz5 29 glibc-2.21.tar.tbb
26400268 18.0 1.46 1490.30 lz5 39 glibc-2.21.tar.tbb
30368106 20.7 1.24 2977.90 lzsse2 17 glibc-2.21.tar.tbb
31831515 21.7 3.50 2313.56 oodle 49 glibc-2.21.tar.tbb
32073543 21.9 1.45 2757.89 lz5 19 glibc-2.21.tar.tbb
32090405 21.9 1.32 3416.94 lzturbo 19 glibc-2.21.tar.tbb
D:\turbobench_win64_2016-Dec-28>turbobenchs.exe GreatSovietEncyclopaediaRuRu.dsl -elibdeflate,12/oodle,49,129/lzsse2,17/lzturbo,19,29,39/zstd,22/lz5,19,29,39,49/brotli,11/lzma,9 -g -J15 -B2G
C Size ratio% C MB/s D MB/s Name File
42372850 10.7 0.76 140.11 lzma 9 GreatSovietEncyclopaediaRuRu.dsl.tbb
44435664 11.2 0.54 630.86 lzturbo 39 GreatSovietEncyclopaediaRuRu.dsl.tbb
47851071 12.1 1.03 559.38 zstd 22 GreatSovietEncyclopaediaRuRu.dsl.tbb
48607448 12.3 0.33 575.60 oodle 129 GreatSovietEncyclopaediaRuRu.dsl.tbb
51180164 12.9 0.37 374.51 brotli 11 GreatSovietEncyclopaediaRuRu.dsl.tbb
57857179 14.6 0.97 912.16 lz5 49 GreatSovietEncyclopaediaRuRu.dsl.tbb
59252143 15.0 0.57 916.69 lzturbo 29 GreatSovietEncyclopaediaRuRu.dsl.tbb
67583375 17.1 1.00 1168.91 lz5 29 GreatSovietEncyclopaediaRuRu.dsl.tbb
77736919 19.6 3.66 693.47 libdeflate 12 GreatSovietEncyclopaediaRuRu.dsl.tbb
78612453 19.8 2.62 1608.22 lz5 39 GreatSovietEncyclopaediaRuRu.dsl.tbb
83196644 21.0 3.04 3086.67 lzsse2 17 GreatSovietEncyclopaediaRuRu.dsl.tbb
92109457 23.3 0.65 2932.38 lzturbo 19 GreatSovietEncyclopaediaRuRu.dsl.tbb
92215539 23.3 2.61 2245.15 lz5 19 GreatSovietEncyclopaediaRuRu.dsl.tbb
92249095 23.3 2.66 1642.68 oodle 49 GreatSovietEncyclopaediaRuRu.dsl.tbb
D:\turbobench_win64_2016-Dec-28>turbobenchs.exe GreatSovietEncyclopaedia_Russian_(Windows_Cyrillic_encoding).tar -elibdeflate,12/oodle,49,129/lzsse2,17/lzturbo,19,29,39/zstd,22/lz5,19,29,39,49/brotli,11/lzma,9 -g -J15 -B2G
C Size ratio% C MB/s D MB/s Name File
39793313 26.4 0.75 61.83 lzma 9 GreatSovietEncyclopaedia_Russian_(Windows_Cyrillic_encoding).tar.tbb
40536027 26.9 0.66 335.22 lzturbo 39 GreatSovietEncyclopaedia_Russian_(Windows_Cyrillic_encoding).tar.tbb
40771239 27.1 0.86 344.12 zstd 22 GreatSovietEncyclopaedia_Russian_(Windows_Cyrillic_encoding).tar.tbb
41558214 27.6 0.31 344.52 oodle 129 GreatSovietEncyclopaedia_Russian_(Windows_Cyrillic_encoding).tar.tbb
42881493 28.5 0.34 176.72 brotli 11 GreatSovietEncyclopaedia_Russian_(Windows_Cyrillic_encoding).tar.tbb
50518616 33.5 0.70 498.93 lzturbo 29 GreatSovietEncyclopaedia_Russian_(Windows_Cyrillic_encoding).tar.tbb
52921894 35.1 1.18 510.74 lz5 49 GreatSovietEncyclopaedia_Russian_(Windows_Cyrillic_encoding).tar.tbb
61563910 40.9 1.21 783.57 lz5 29 GreatSovietEncyclopaedia_Russian_(Windows_Cyrillic_encoding).tar.tbb
61691495 41.0 6.27 331.63 libdeflate 12 GreatSovietEncyclopaedia_Russian_(Windows_Cyrillic_encoding).tar.tbb
64452843 42.8 6.33 1148.05 lz5 39 GreatSovietEncyclopaedia_Russian_(Windows_Cyrillic_encoding).tar.tbb
65820740 43.7 6.42 1754.02 lzsse2 17 GreatSovietEncyclopaedia_Russian_(Windows_Cyrillic_encoding).tar.tbb
72117325 47.9 0.80 2501.52 lzturbo 19 GreatSovietEncyclopaedia_Russian_(Windows_Cyrillic_encoding).tar.tbb
72141903 47.9 2.72 1830.53 oodle 49 GreatSovietEncyclopaedia_Russian_(Windows_Cyrillic_encoding).tar.tbb
72143625 47.9 6.39 1795.85 lz5 19 GreatSovietEncyclopaedia_Russian_(Windows_Cyrillic_encoding).tar.tbb
D:\turbobench_win64_2016-Dec-28>turbobenchs.exe Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl -elibdeflate,12/oodle,49,129/lzsse2,17/lzturbo,19,29,39/zstd,22/lz5,19,29,39,49/brotli,11/lzma,9 -g -J15 -B2G
C Size ratio% C MB/s D MB/s Name File
10293623 24.0 1.37 63.86 lzma 9 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl.tbb
11029847 25.7 1.19 429.34 lzturbo 39 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl.tbb
11086975 25.8 0.39 208.14 brotli 11 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl.tbb
11199509 26.1 1.58 369.74 zstd 22 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl.tbb
11237343 26.2 0.74 476.64 oodle 129 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl.tbb
13700855 31.9 1.35 715.61 lzturbo 29 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl.tbb
14737682 34.3 1.68 850.84 lz5 49 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl.tbb
14779867 34.4 5.17 426.99 libdeflate 12 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl.tbb
15897920 37.0 1.76 1248.01 lz5 29 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl.tbb
15936171 37.1 4.91 1475.30 lz5 39 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl.tbb
16550171 38.6 6.13 1893.76 lzsse2 17 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl.tbb
16935814 39.5 1.59 2744.17 lzturbo 19 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl.tbb
16942674 39.5 2.97 1647.79 oodle 49 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl.tbb
16949363 39.5 4.92 2123.12 lz5 19 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl.tbb
D:\turbobench_win64_2016-Dec-28>turbobenchs.exe Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl -elibdeflate,12/oodle,49,129/lzsse2,17/lzturbo,19,29,39/zstd,22/lz5,19,29,39,49/brotli,11/lzma,9 -g -J15 -B2G
C Size ratio% C MB/s D MB/s Name File
12327751 10.2 1.03 147.68 lzma 9 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
12913230 10.7 1.06 800.11 lzturbo 39 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
13363534 11.0 1.43 652.63 zstd 22 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
13769452 11.4 0.57 731.92 oodle 129 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
16706895 13.8 1.13 1159.97 lzturbo 29 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
18204942 15.0 0.40 328.19 brotli 11 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
22385789 18.5 1.23 905.28 lz5 49 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
25138287 20.7 1.28 1219.06 lz5 29 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
25882601 21.3 3.60 621.57 libdeflate 12 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
27032828 22.3 3.54 1603.36 lz5 39 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
28142746 23.2 4.16 2823.76 lzsse2 17 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
30238244 24.9 0.95 2919.40 lzturbo 19 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
30261966 25.0 2.68 1659.97 oodle 49 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
30265836 25.0 3.51 2268.51 lz5 19 Kenkyusha's_New_Japanese-English_Dictionary_(Jp-En).dsl.tbb
D:\turbobench_win64_2016-Dec-28>turbobenchs.exe Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt -elibdeflate,12/oodle,49,129/lzsse2,17/lzturbo,19,29,39/zstd,22/lz5,19,29,39,49/brotli,11/lzma,9 -g -J15 -B2G
C Size ratio% C MB/s D MB/s Name File
337771 28.3 0.44 273.38 brotli 11 Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.tbb
343393 28.7 1.89 61.35 lzma 9 Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.tbb
346446 29.0 2.31 477.38 zstd 22 Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.tbb
347484 29.1 1.70 840.78 lzturbo 39 Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.tbb
352220 29.5 0.81 817.32 oodle 129 Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.tbb
395492 33.1 2.21 872.28 lz5 49 Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.tbb
409038 34.2 4.93 415.94 libdeflate 12 Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.tbb
420029 35.1 4.96 1260.92 lz5 39 Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.tbb
433556 36.3 5.39 2173.27 lzsse2 17 Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.tbb
454747 38.0 1.79 853.38 lzturbo 29 Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.tbb
472687 39.5 2.28 1380.52 lz5 29 Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.tbb
489322 40.9 2.14 2733.36 lzturbo 19 Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.tbb
489480 40.9 2.77 1952.10 oodle 49 Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.tbb
489583 41.0 5.00 1921.90 lz5 19 Mike_Tyson_-_Undisputed_Truth_-_My_Autobiography_-_2013.epub.txt.tbb
D:\turbobench_win64_2016-Dec-28>turbobenchs.exe NASA_Kennedy_Space_Center_WWW_server_access_log_Jul95 -elibdeflate,12/oodle,49,129/lzsse2,17/lzturbo,19,29,39/zstd,22/lz5,19,29,39,49/brotli,11/lzma,9 -g -J15 -B2G
C Size ratio% C MB/s D MB/s Name File
11883945 5.8 0.90 235.38 lzma 9 NASA_Kennedy_Space_Center_WWW_server_access_log_Jul95.tbb
11898836 5.8 0.72 1422.98 lzturbo 39 NASA_Kennedy_Space_Center_WWW_server_access_log_Jul95.tbb
12424559 6.1 0.40 654.05 brotli 11 NASA_Kennedy_Space_Center_WWW_server_access_log_Jul95.tbb
12617357 6.1 0.88 1006.36 zstd 22 NASA_Kennedy_Space_Center_WWW_server_access_log_Jul95.tbb
14883793 7.3 0.46 902.34 oodle 129 NASA_Kennedy_Space_Center_WWW_server_access_log_Jul95.tbb
15884624 7.7 0.98 1831.32 lz5 49 NASA_Kennedy_Space_Center_WWW_server_access_log_Jul95.tbb
16898254 8.2 0.79 2160.18 lzturbo 29 NASA_Kennedy_Space_Center_WWW_server_access_log_Jul95.tbb
18473887 9.0 3.11 1124.60 libdeflate 12 NASA_Kennedy_Space_Center_WWW_server_access_log_Jul95.tbb
19226560 9.4 1.00 2566.88 lz5 29 NASA_Kennedy_Space_Center_WWW_server_access_log_Jul95.tbb
21399767 10.4 2.96 2425.60 lz5 39 NASA_Kennedy_Space_Center_WWW_server_access_log_Jul95.tbb
23654468 11.5 3.82 3985.40 lzsse2 17 NASA_Kennedy_Space_Center_WWW_server_access_log_Jul95.tbb
24331362 11.9 0.93 4109.17 lzturbo 19 NASA_Kennedy_Space_Center_WWW_server_access_log_Jul95.tbb
24368285 11.9 3.34 2575.38 oodle 49 NASA_Kennedy_Space_Center_WWW_server_access_log_Jul95.tbb
24408147 11.9 2.85 3273.66 lz5 19 NASA_Kennedy_Space_Center_WWW_server_access_log_Jul95.tbb
D:\turbobench_win64_2016-Dec-28>turbobenchs.exe open_watcom_1.9.0-src.tar -elibdeflate,12/oodle,49,129/lzsse2,17/lzturbo,19,29,39/zstd,22/lz5,19,29,39,49/brotli,11/lzma,9 -g -J15 -B2G
C Size ratio% C MB/s D MB/s Name File
20839672 8.0 1.37 177.35 lzma 9 open_watcom_1.9.0-src.tar.tbb
21869578 8.4 0.96 1370.40 lzturbo 39 open_watcom_1.9.0-src.tar.tbb
22207079 8.6 1.26 905.42 zstd 22 open_watcom_1.9.0-src.tar.tbb
22416653 8.6 0.50 520.11 brotli 11 open_watcom_1.9.0-src.tar.tbb
23004024 8.9 0.63 1197.99 oodle 129 open_watcom_1.9.0-src.tar.tbb
28314355 10.9 1.13 1751.46 lzturbo 29 open_watcom_1.9.0-src.tar.tbb
29421038 11.3 0.80 1828.44 lz5 49 open_watcom_1.9.0-src.tar.tbb
32725514 12.6 0.81 2517.17 lz5 29 open_watcom_1.9.0-src.tar.tbb
33794944 13.0 4.04 835.04 libdeflate 12 open_watcom_1.9.0-src.tar.tbb
37588412 14.5 1.16 2196.93 lz5 39 open_watcom_1.9.0-src.tar.tbb
41036396 15.8 4.02 2443.93 oodle 49 open_watcom_1.9.0-src.tar.tbb
41246888 15.9 1.16 3846.70 lzturbo 19 open_watcom_1.9.0-src.tar.tbb
41480035 16.0 1.15 3165.62 lz5 19 open_watcom_1.9.0-src.tar.tbb
41900738 16.1 0.06 3340.72 lzsse2 17 open_watcom_1.9.0-src.tar.tbb
D:\turbobench_win64_2016-Dec-28>turbobenchs.exe OSHO.TXT -elibdeflate,12/oodle,49,129/lzsse2,17/lzturbo,19,29,39/zstd,22/lz5,19,29,39,49/brotli,11/lzma,9 -g -J15 -B2G
C Size ratio% C MB/s D MB/s Name File
39814875 19.2 0.72 83.74 lzma 9 OSHO.TXT.tbb
40008175 19.3 0.57 421.81 lzturbo 39 OSHO.TXT.tbb
40646441 19.6 0.89 411.61 zstd 22 OSHO.TXT.tbb
41794188 20.2 0.27 398.52 oodle 129 OSHO.TXT.tbb
42175862 20.4 0.33 247.23 brotli 11 OSHO.TXT.tbb
49762716 24.1 1.08 581.10 lz5 49 OSHO.TXT.tbb
52794486 25.5 0.59 593.14 lzturbo 29 OSHO.TXT.tbb
59209289 28.6 4.51 486.98 libdeflate 12 OSHO.TXT.tbb
59379097 28.7 1.07 901.20 lz5 29 OSHO.TXT.tbb
60796309 29.4 3.94 1340.20 lz5 39 OSHO.TXT.tbb
62276366 30.1 4.72 2425.81 lzsse2 17 OSHO.TXT.tbb
70085202 33.9 0.68 2727.80 lzturbo 19 OSHO.TXT.tbb
70092863 33.9 3.96 1988.04 lz5 19 OSHO.TXT.tbb
70136192 33.9 3.01 1710.68 oodle 49 OSHO.TXT.tbb
D:\turbobench_win64_2016-Dec-28>turbobenchs.exe Oxford_English_Dictionary_2nd_Edition_Version_4_(En-En).dsl -elibdeflate,12/oodle,49,129/lzsse2,17/lzturbo,19,29,39/zstd,22/lz5,19,29,39,49/brotli,11/lzma,9 -g -J15 -B2G
C Size ratio% C MB/s D MB/s Name File
109421460 19.5 0.67 80.96 lzma 9 Oxford_English_Dictionary_2nd_Edition_Version_4_(En-En).dsl.tbb
110787898 19.8 0.51 384.93 lzturbo 39 Oxford_English_Dictionary_2nd_Edition_Version_4_(En-En).dsl.tbb
116533787 20.8 0.89 398.48 zstd 22 Oxford_English_Dictionary_2nd_Edition_Version_4_(En-En).dsl.tbb
117189681 20.9 0.22 382.75 oodle 129 Oxford_English_Dictionary_2nd_Edition_Version_4_(En-En).dsl.tbb
122003537 21.8 0.35 223.39 brotli 11 Oxford_English_Dictionary_2nd_Edition_Version_4_(En-En).dsl.tbb
136527551 24.3 0.55 569.36 lzturbo 29 Oxford_English_Dictionary_2nd_Edition_Version_4_(En-En).dsl.tbb
147408951 26.3 1.11 631.13 lz5 49 Oxford_English_Dictionary_2nd_Edition_Version_4_(En-En).dsl.tbb
172536450 30.8 1.14 967.65 lz5 29 Oxford_English_Dictionary_2nd_Edition_Version_4_(En-En).dsl.tbb
182418547 32.5 4.68 409.66 libdeflate 12 Oxford_English_Dictionary_2nd_Edition_Version_4_(En-En).dsl.tbb
190396886 34.0 4.66 1252.68 lz5 39 Oxford_English_Dictionary_2nd_Edition_Version_4_(En-En).dsl.tbb
192302404 34.3 5.50 2110.20 lzsse2 17 Oxford_English_Dictionary_2nd_Edition_Version_4_(En-En).dsl.tbb
212304140 37.9 0.64 2545.10 lzturbo 19 Oxford_English_Dictionary_2nd_Edition_Version_4_(En-En).dsl.tbb
212401993 37.9 2.88 1698.46 oodle 49 Oxford_English_Dictionary_2nd_Edition_Version_4_(En-En).dsl.tbb
212428080 37.9 4.65 1896.21 lz5 19 Oxford_English_Dictionary_2nd_Edition_Version_4_(En-En).dsl.tbb
D:\turbobench_win64_2016-Dec-28>turbobenchs.exe sourcecode.opera.com_Opera_source_code_package_04-Aug-2016.tar -elibdeflate,12/oodle,49,129/lzsse2,17/lzturbo,19,29,39/zstd,22/lz5,19,29,39,49/brotli,11/lzma,9 -g -J15 -B2G
C Size ratio% C MB/s D MB/s Name File
147938075 24.2 1.37 62.56 lzma 9 sourcecode.opera.com_Opera_source_code_package_04-Aug-2016.tar.tbb
149578894 24.5 1.05 1447.97 lzturbo 39 sourcecode.opera.com_Opera_source_code_package_04-Aug-2016.tar.tbb
151491398 24.8 1.48 980.50 zstd 22 sourcecode.opera.com_Opera_source_code_package_04-Aug-2016.tar.tbb
151700344 24.8 0.46 1299.10 oodle 129 sourcecode.opera.com_Opera_source_code_package_04-Aug-2016.tar.tbb
153387289 25.1 0.43 291.98 brotli 11 sourcecode.opera.com_Opera_source_code_package_04-Aug-2016.tar.tbb
164223065 26.8 1.18 1861.00 lzturbo 29 sourcecode.opera.com_Opera_source_code_package_04-Aug-2016.tar.tbb
170513029 27.9 0.83 1758.28 lz5 49 sourcecode.opera.com_Opera_source_code_package_04-Aug-2016.tar.tbb
180241428 29.5 0.85 2507.49 lz5 29 sourcecode.opera.com_Opera_source_code_package_04-Aug-2016.tar.tbb
194364405 31.8 4.99 554.88 libdeflate 12 sourcecode.opera.com_Opera_source_code_package_04-Aug-2016.tar.tbb
206325695 33.7 1.51 2066.96 lz5 39 sourcecode.opera.com_Opera_source_code_package_04-Aug-2016.tar.tbb
215541838 35.2 3.61 2463.46 oodle 49 sourcecode.opera.com_Opera_source_code_package_04-Aug-2016.tar.tbb
216014716 35.3 1.07 3630.64 lzturbo 19 sourcecode.opera.com_Opera_source_code_package_04-Aug-2016.tar.tbb
217147895 35.5 1.50 2999.78 lz5 19 sourcecode.opera.com_Opera_source_code_package_04-Aug-2016.tar.tbb
240349176 39.3 0.03 1844.07 lzsse2 17 sourcecode.opera.com_Opera_source_code_package_04-Aug-2016.tar.tbb
D:\turbobench_win64_2016-Dec-28>turbobenchs.exe Star_Trek_-_737_Ebooks.tar -elibdeflate,12/oodle,49,129/lzsse2,17/lzturbo,19,29,39/zstd,22/lz5,19,29,39,49/brotli,11/lzma,9 -g -J15 -B2G
C Size ratio% C MB/s D MB/s Name File
71943246 22.1 0.67 75.11 lzma 9 Star_Trek_-_737_Ebooks.tar.tbb
72467083 22.3 0.57 367.07 lzturbo 39 Star_Trek_-_737_Ebooks.tar.tbb
75007208 23.1 0.81 381.26 zstd 22 Star_Trek_-_737_Ebooks.tar.tbb
75222337 23.1 0.24 365.86 oodle 129 Star_Trek_-_737_Ebooks.tar.tbb
79554047 24.5 0.34 214.69 brotli 11 Star_Trek_-_737_Ebooks.tar.tbb
92993537 28.6 1.07 564.48 lz5 49 Star_Trek_-_737_Ebooks.tar.tbb
95095886 29.3 0.59 512.56 lzturbo 29 Star_Trek_-_737_Ebooks.tar.tbb
111798931 34.4 5.14 412.76 libdeflate 12 Star_Trek_-_737_Ebooks.tar.tbb
112249518 34.5 1.10 856.53 lz5 29 Star_Trek_-_737_Ebooks.tar.tbb
113118398 34.8 5.16 1213.06 lz5 39 Star_Trek_-_737_Ebooks.tar.tbb
116948221 36.0 5.34 2135.14 lzsse2 17 Star_Trek_-_737_Ebooks.tar.tbb
132340111 40.7 0.66 2612.75 lzturbo 19 Star_Trek_-_737_Ebooks.tar.tbb
132391865 40.7 5.19 1853.40 lz5 19 Star_Trek_-_737_Ebooks.tar.tbb
132396180 40.7 2.71 1877.96 oodle 49 Star_Trek_-_737_Ebooks.tar.tbb
D:\turbobench_win64_2016-Dec-28>turbobenchs.exe Stephen_King_67-books.tar -elibdeflate,12/oodle,49,129/lzsse2,17/lzturbo,19,29,39/zstd,22/lz5,19,29,39,49/brotli,11/lzma,9 -g -J15 -B2G
C Size ratio% C MB/s D MB/s Name File
15500837 25.3 0.81 68.28 lzma 9 Stephen_King_67-books.tar.tbb
15631838 25.5 0.75 377.36 lzturbo 39 Stephen_King_67-books.tar.tbb
15637309 25.5 0.91 369.21 zstd 22 Stephen_King_67-books.tar.tbb
15859133 25.8 0.35 199.32 brotli 11 Stephen_King_67-books.tar.tbb
15968837 26.0 0.46 386.32 oodle 129 Stephen_King_67-books.tar.tbb
18734735 30.5 1.03 564.36 lz5 49 Stephen_King_67-books.tar.tbb
20188966 32.9 0.78 510.46 lzturbo 29 Stephen_King_67-books.tar.tbb
21821077 35.5 5.11 401.49 libdeflate 12 Stephen_King_67-books.tar.tbb
22256558 36.3 5.27 1194.73 lz5 39 Stephen_King_67-books.tar.tbb
22539397 36.7 1.11 867.89 lz5 29 Stephen_King_67-books.tar.tbb
23014362 37.5 5.44 2044.48 lzsse2 17 Stephen_King_67-books.tar.tbb
25937877 42.3 0.90 2559.15 lzturbo 19 Stephen_King_67-books.tar.tbb
25946659 42.3 2.71 1889.29 oodle 49 Stephen_King_67-books.tar.tbb
25951762 42.3 5.31 1825.60 lz5 19 Stephen_King_67-books.tar.tbb
D:\turbobench_win64_2016-Dec-28>turbobenchs.exe the-anarchist-library-2016-01-18-en_html.tar -elibdeflate,12/oodle,49,129/lzsse2,17/lzturbo,19,29,39/zstd,22/lz5,19,29,39,49/brotli,11/lzma,9 -g -J15 -B2G
C Size ratio% C MB/s D MB/s Name File
31423875 20.4 0.82 82.53 lzma 9 the-anarchist-library-2016-01-18-en_html.tar.tbb
31723337 20.6 0.70 434.90 lzturbo 39 the-anarchist-library-2016-01-18-en_html.tar.tbb
31960094 20.8 0.88 428.68 zstd 22 the-anarchist-library-2016-01-18-en_html.tar.tbb
32855387 21.4 0.34 429.11 oodle 129 the-anarchist-library-2016-01-18-en_html.tar.tbb
33324343 21.7 0.36 248.03 brotli 11 the-anarchist-library-2016-01-18-en_html.tar.tbb
39384386 25.6 1.01 667.34 lz5 49 the-anarchist-library-2016-01-18-en_html.tar.tbb
41196330 26.8 0.74 615.60 lzturbo 29 the-anarchist-library-2016-01-18-en_html.tar.tbb
41732169 601 Nakamichi 'Okamigan' ! Outside TurboBench !
46894318 30.5 5.01 453.36 libdeflate 12 the-anarchist-library-2016-01-18-en_html.tar.tbb
47091592 30.6 1.04 1043.65 lz5 29 the-anarchist-library-2016-01-18-en_html.tar.tbb
47571033 30.9 3.39 1344.69 lz5 39 the-anarchist-library-2016-01-18-en_html.tar.tbb
49079017 31.9 2.79 2303.23 lzsse2 17 the-anarchist-library-2016-01-18-en_html.tar.tbb
54739724 35.6 2.84 1937.36 oodle 49 the-anarchist-library-2016-01-18-en_html.tar.tbb
54849613 35.7 0.84 2823.19 lzturbo 19 the-anarchist-library-2016-01-18-en_html.tar.tbb
54892744 35.7 3.38 2046.32 lz5 19 the-anarchist-library-2016-01-18-en_html.tar.tbb
D:\turbobench_win64_2016-Dec-28>turbobenchs.exe "Urban_Dictionary_2015_(Eng-Eng)_utf8.txt" -elibdeflate,12/oodle,49,129/lzsse2,17/lzturbo,19,29,39/zstd,22/lz5,19,29,39,49/brotli,11/lzma,9 -g -J15 -B2G
C Size ratio% C MB/s D MB/s Name File
233766162 25.9 0.53 60.59 lzma 9 Urban_Dictionary_2015_(Eng-Eng)_utf8.txt.tbb
235913911 26.2 0.48 288.11 lzturbo 39 Urban_Dictionary_2015_(Eng-Eng)_utf8.txt.tbb
245887427 27.3 0.76 334.08 zstd 22 Urban_Dictionary_2015_(Eng-Eng)_utf8.txt.tbb
246744697 27.4 0.18 294.36 oodle 129 Urban_Dictionary_2015_(Eng-Eng)_utf8.txt.tbb
253587117 28.1 0.33 167.64 brotli 11 Urban_Dictionary_2015_(Eng-Eng)_utf8.txt.tbb
294959588 32.7 0.49 394.91 lzturbo 29 Urban_Dictionary_2015_(Eng-Eng)_utf8.txt.tbb
307429247 34.1 1.09 545.08 lz5 49 Urban_Dictionary_2015_(Eng-Eng)_utf8.txt.tbb
334412605 37.1 5.50 380.73 libdeflate 12 Urban_Dictionary_2015_(Eng-Eng)_utf8.txt.tbb
348426118 38.7 5.40 1182.90 lz5 39 Urban_Dictionary_2015_(Eng-Eng)_utf8.txt.tbb
358101381 39.7 0.28 1912.25 lzsse2 17 Urban_Dictionary_2015_(Eng-Eng)_utf8.txt.tbb
365530890 40.6 1.11 873.97 lz5 29 Urban_Dictionary_2015_(Eng-Eng)_utf8.txt.tbb
397099478 44.1 0.56 2518.91 lzturbo 19 Urban_Dictionary_2015_(Eng-Eng)_utf8.txt.tbb
397133738 44.1 2.76 1891.85 oodle 49 Urban_Dictionary_2015_(Eng-Eng)_utf8.txt.tbb
397506505 44.1 5.46 1826.99 lz5 19 Urban_Dictionary_2015_(Eng-Eng)_utf8.txt.tbb
D:\turbobench_win64_2016-Dec-28>turbobenchs.exe webdevdata.org_8000_home_pages_from_the_top_10000_most_popular_web_sites.tar -elibdeflate,12/oodle,49,129/lzsse2,17/lzturbo,19,29,39/zstd,22/lz5,19,29,39,49/brotli,11/lzma,9 -g -J15 -B2G
C Size ratio% C MB/s D MB/s Name File
81301216 11.9 1.10 119.35 lzma 9 webdevdata.org_8000_home_pages_from_the_top_10000_most_popular_web_sites.tar.tbb
85643816 12.6 0.64 738.15 lzturbo 39 webdevdata.org_8000_home_pages_from_the_top_10000_most_popular_web_sites.tar.tbb
90499557 13.3 1.35 647.78 zstd 22 webdevdata.org_8000_home_pages_from_the_top_10000_most_popular_web_sites.tar.tbb
90597112 13.3 0.36 736.64 oodle 129 webdevdata.org_8000_home_pages_from_the_top_10000_most_popular_web_sites.tar.tbb
91090316 13.4 0.38 353.24 brotli 11 webdevdata.org_8000_home_pages_from_the_top_10000_most_popular_web_sites.tar.tbb
102924132 15.1 0.70 1045.53 lzturbo 29 webdevdata.org_8000_home_pages_from_the_top_10000_most_popular_web_sites.tar.tbb
118150605 17.3 1.23 1252.12 lz5 49 webdevdata.org_8000_home_pages_from_the_top_10000_most_popular_web_sites.tar.tbb
121766342 17.9 4.41 637.97 libdeflate 12 webdevdata.org_8000_home_pages_from_the_top_10000_most_popular_web_sites.tar.tbb
130799479 19.2 1.26 1890.64 lz5 29 webdevdata.org_8000_home_pages_from_the_top_10000_most_popular_web_sites.tar.tbb
138987558 20.4 2.13 1946.66 lz5 39 webdevdata.org_8000_home_pages_from_the_top_10000_most_popular_web_sites.tar.tbb
146176061 21.5 0.77 2826.27 lzsse2 17 webdevdata.org_8000_home_pages_from_the_top_10000_most_popular_web_sites.tar.tbb
148281757 21.8 0.76 3349.31 lzturbo 19 webdevdata.org_8000_home_pages_from_the_top_10000_most_popular_web_sites.tar.tbb
148499923 21.8 2.10 2756.61 lz5 19 webdevdata.org_8000_home_pages_from_the_top_10000_most_popular_web_sites.tar.tbb
148512426 21.8 3.48 2091.69 oodle 49 webdevdata.org_8000_home_pages_from_the_top_10000_most_popular_web_sites.tar.tbb
D:\turbobench_win64_2016-Dec-28>turbobenchs.exe www.kernel.org_linux-4.8.4.tar -elibdeflate,12/oodle,49,129/lzsse2,17/lzturbo,19,29,39/zstd,22/lz5,19,29,39,49/brotli,11/lzma,9 -g -J15 -B2G
C Size ratio% C MB/s D MB/s Name File
88400047 12.9 1.04 113.76 lzma 9 www.kernel.org_linux-4.8.4.tar.tbb
91746349 13.4 0.71 745.79 lzturbo 39 www.kernel.org_linux-4.8.4.tar.tbb
93176199 13.6 0.41 381.90 brotli 11 www.kernel.org_linux-4.8.4.tar.tbb
93784876 13.7 1.22 598.90 zstd 22 www.kernel.org_linux-4.8.4.tar.tbb
95676243 13.9 0.33 689.48 oodle 129 www.kernel.org_linux-4.8.4.tar.tbb
116531156 17.0 0.78 971.90 lzturbo 29 www.kernel.org_linux-4.8.4.tar.tbb
120034375 17.5 1.01 1142.74 lz5 49 www.kernel.org_linux-4.8.4.tar.tbb
134168764 19.5 4.28 612.04 libdeflate 12 www.kernel.org_linux-4.8.4.tar.tbb
135506079 19.7 1.03 1660.70 lz5 29 www.kernel.org_linux-4.8.4.tar.tbb
147728582 21.5 2.19 1582.69 lz5 39 www.kernel.org_linux-4.8.4.tar.tbb
152192448 22.2 0.81 2880.61 lzsse2 17 www.kernel.org_linux-4.8.4.tar.tbb
163850810 23.9 3.27 1811.60 oodle 49 www.kernel.org_linux-4.8.4.tar.tbb
164265668 23.9 0.84 2935.40 lzturbo 19 www.kernel.org_linux-4.8.4.tar.tbb
164323421 23.9 2.17 2332.59 lz5 19 www.kernel.org_linux-4.8.4.tar.tbb
D:\turbobench_win64_2016-Dec-28>turbobenchs.exe www.ncbi.nlm.nih.gov_Dragonfly_(Ladona_fulva)_whole_genome_shotgun.tar -elibdeflate,12/oodle,49,129/lzsse2,17/lzturbo,19,29,39/zstd,22/lz5,19,29,39,49/brotli,11/lzma,9 -g -J15 -B2G
C Size ratio% C MB/s D MB/s Name File
234296590 24.0 0.52 739.70 lzturbo 39 www.ncbi.nlm.nih.gov_Dragonfly_(Ladona_fulva)_whole_genome_shotgun.tar.tbb
243280599 25.0 0.37 60.85 lzma 9 www.ncbi.nlm.nih.gov_Dragonfly_(Ladona_fulva)_whole_genome_shotgun.tar.tbb
253267207 26.0 0.51 358.23 zstd 22 www.ncbi.nlm.nih.gov_Dragonfly_(Ladona_fulva)_whole_genome_shotgun.tar.tbb
253484725 26.0 0.22 109.09 brotli 11 www.ncbi.nlm.nih.gov_Dragonfly_(Ladona_fulva)_whole_genome_shotgun.tar.tbb
266596733 27.3 0.15 906.74 oodle 129 www.ncbi.nlm.nih.gov_Dragonfly_(Ladona_fulva)_whole_genome_shotgun.tar.tbb
270889079 27.8 3.36 512.02 libdeflate 12 www.ncbi.nlm.nih.gov_Dragonfly_(Ladona_fulva)_whole_genome_shotgun.tar.tbb
270972006 27.8 0.82 931.13 lz5 49 www.ncbi.nlm.nih.gov_Dragonfly_(Ladona_fulva)_whole_genome_shotgun.tar.tbb
275821055 28.3 3.38 1315.27 lz5 39 www.ncbi.nlm.nih.gov_Dragonfly_(Ladona_fulva)_whole_genome_shotgun.tar.tbb
302151139 31.0 0.41 2509.11 lzsse2 17 www.ncbi.nlm.nih.gov_Dragonfly_(Ladona_fulva)_whole_genome_shotgun.tar.tbb
320414954 32.9 0.56 465.85 lzturbo 29 www.ncbi.nlm.nih.gov_Dragonfly_(Ladona_fulva)_whole_genome_shotgun.tar.tbb
348061500 35.7 0.82 1323.71 lz5 29 www.ncbi.nlm.nih.gov_Dragonfly_(Ladona_fulva)_whole_genome_shotgun.tar.tbb
354823539 36.4 0.70 2744.96 lzturbo 19 www.ncbi.nlm.nih.gov_Dragonfly_(Ladona_fulva)_whole_genome_shotgun.tar.tbb
354961248 36.4 2.33 2199.09 oodle 49 www.ncbi.nlm.nih.gov_Dragonfly_(Ladona_fulva)_whole_genome_shotgun.tar.tbb
355158572 36.4 3.39 1926.95 lz5 19 www.ncbi.nlm.nih.gov_Dragonfly_(Ladona_fulva)_whole_genome_shotgun.tar.tbb
Failed ones:
D:\turbobench_win64_2016-Dec-28>turbobenchs.exe enwik9 -elibdeflate,12/oodle,49,129/lzsse2,17/lzturbo,19,29,39/zstd,22/lz5,19,29,39,49/brotli,11/lzma,9 -g -J15 -B2G
310824795 31.1 5.08 412.68 libdeflate 12 enwik9
372018969 37.2 2.95 1883.88 oodle 49 enwik9
212477149 21.2 0.20 373.69 oodle 129 enwik9
340270597 34.0 0.34 2125.80 lzsse2 17 enwik9
371849159 37.2 0.57 2692.60 lzturbo 19 enwik9
VirtualAlloc failed
D:\turbobench_win64_2016-Dec-28>turbobenchs.exe Sacred_Texts_7_(97830_htm_files).tar -elibdeflate,12/oodle,49,129/lzsse2,17/lzturbo,19,29,39/zstd,22/lz5,19,29,39,49/brotli,11/lzma,9 -g -J15 -B2G
301761925 25.2 4.44 524.64 libdeflate 12 Sacred_Texts_7_(97830_htm_files).tar
354675982 29.6 3.06 1940.50 oodle 49 Sacred_Texts_7_(97830_htm_files).tar
213600255 17.8 0.22 493.77 oodle 129 Sacred_Texts_7_(97830_htm_files).tar
320797178 26.8 0.38 2585.94 lzsse2 17 Sacred_Texts_7_(97830_htm_files).tar
354585985 29.6 0.63 2961.98 lzturbo 19 Sacred_Texts_7_(97830_htm_files).tar
VirtualAlloc failed
As for the two failed ones (at LzTurbo 29 stage) I remember those two files passing previous compiles of TurboBench, the reason: I got 3 prompts/tasks on pause which consumed some 2GB of RAM.
In almost all the 26 cases above, LzTurbo 39 is second only to LZMA 9 sizewise and SECOND-TO-NONE (except several cases) speedwise!
Also, Oodle's DLL was retrieved from the Warframe free installation:
https://warframe.com/landing
Now, I won't go into comments, but one thing is just in plain sight over and over again, LZMA being 5-12x slower while on par with LzTurbo 39, is the world blind for such a paragon performer?!
Ugh, each and every textual file from the roster will be downloadable, that way everyone will be able to play with them.
Hm, in the previous v1.5 compile the last line have had no 'lz4fast', now I see:
lz4hc 1.7.5 -16 92 MB/s 6772 MB/s 10882575 100.39 lzbench-1.6_(sources).tar
lz4hc 1.7.5 -16 91 MB/s 6305 MB/s 19008011 100.39 James_Bond_Collection_-_52_Ebooks.tar
I use only:
/lz4hc,16
Why so? Maybe there is some misreplacement!
lz4hc 1.7.5 has now 12 levels:
a) level 10 is equal to old level 16
b) levels 11 and 12 use my optimal parsing
Nakamichi Okamigan is now added to lzbench (but disabled by default).
To compile:
- download https://github.com/inikep/lzbench/archive/master.zip
- compile it with gcc using
make BENCH_HAS_NAKAMICHI=1
- run it with
lzbench.exe -enakamichi
>lz4hc 1.7.5 has now 12 levels:
Oh, good, /lz4hc,16 will be replaced with /lz4hc,10,12.
Many thanks for Okamigan inclusion. When I have more time will install MinGW and compile it myself.
Grrr, just saw that my site is down, don't know why, cannot check the server myself at the moment. Hate when such Murphysms happen, when one needs something to work and b-a-a-m. So, I uploaded/doubled the source/booklet/executable on my Internet drive:
Nakamichi_Washigan+_(source-executable-booklet).zip:
https://1drv.ms/u/s!AmWWFXGMzDmEgnMw6vvGgo6R7E8C
Booklet_Washigan+_DRAFT_7-pages.pdf:
https://1drv.ms/b/s!AmWWFXGMzDmEgnLvDlhpaK311z3f
Glad I am.
sanmayce, hamid is cheating all his life. he compares m/t compressor with s/t ones. he raised priority to make his executables faster. he probably using stolen preprocessors to increase compression ratio. and once we have found that, he just prohibited us to download his executables
Hi Bulat,
if you believe all these statements and feel that way for so long time I can tell you - no problema.
You have your choice whatever it is and it is okay as long as you are sincere.
When I see something of great value, I do not judge author's imperfections, but lock my eyes on the beauty of his work.
You have much more knowledge and experience than me/I and I would expect an expert like you to be among the first appreciators of Hamid's turbo achievements, allowing personal issues to cloud your judgment, performancewise, is not good.
As far as I remember, back in 2011, when I was enjoying participating in encode.ru, LzTurbo was breaking speed barriers in unseen ways, I remember you saying the same stuff, then I thought accusing him of m/t vs s/t cheat, WAS THE ULTIMATE COMPLIMENT, really! It was funny.
I do not judge your position, but mine is quite different, to me, Hamid's work is so badly not only underappreciated but neglected that sometimes I see how hypocritical the guys in computercraft really are, it enrages me sometimes. For example, once on Intel Developer Zone forum I asked the community to consider giving/lending a Knight's Landing machine to the developer of the speediest multi-threaded decompressor on Internet, in there all the notions were "we are craving for modern code, modern hardware, modern approaches", so I naively expected if they were bona fide persons to give a helping hand to one of the master pioneers, alas, they didn't bother even to answer.
Does Igor's timer report correctly? It says 61% i.e. lack of multi-threading, in such cases it goes higher.
As for the higher priority, I also use highest one i.e. REAL-TIME, thus the results are more stable and make more sense, isn't it?
Putting our different views aside, let us see one hot, from the burner, textual benchmark featuring the second, or third, most published author of all times:
Let us see how the usual/same testmachine (laptop, i5-2430M) behaves in two different configurations:
- default: 2 cores / 4 threads;
- 1 core / 1 thread, set manually by me via msconfig (run from Windows 7 start menu).
I wanted to include the Russian (with 104 books) counterpart, but didn't have enough time, to be done in next month.
4 threads:
D:\Nakamichi_Washigan+>dir
02/03/2017 10:31 AM 60,371,456 Agatha_Christie_104-ebooks_TXT_(Russian).tar
...
10/04/2016 02:11 PM 52,078,592 Agatha_Christie_108-ebooks_TXT.tar
02/06/2016 04:20 PM 18,143,846 Agatha_Christie_108-ebooks_TXT.tar.L17.LZSSE2
01/26/2017 10:56 PM 11,441,180 Agatha_Christie_108-ebooks_TXT.tar.method29.zpaq
01/26/2017 10:46 PM 17,387,802 Agatha_Christie_108-ebooks_TXT.tar.mx9.zip
02/06/2016 04:19 PM 12,371,121 Agatha_Christie_108-ebooks_TXT.tar.Nakamichi
...
10/04/2016 02:11 PM 42,920,232 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl
02/10/2016 09:32 AM 16,550,167 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl.L17.LZSSE2
02/10/2016 09:31 AM 14,349,795 Hanyu_Cihai_new_Sea-of-Words_(Zho-Zho).dsl.Nakamichi
...
10/04/2016 02:11 PM 56,852,480 Jiddu_Krishnamurti_-_Complete_Works_(84_books).tar
02/10/2016 11:22 AM 16,877,731 Jiddu_Krishnamurti_-_Complete_Works_(84_books).tar.L17.LZSSE2
02/10/2016 11:22 AM 13,983,343 Jiddu_Krishnamurti_-_Complete_Works_(84_books).tar.Nakamichi
...
D:\Washigan+_vs_lzbench_vs_TurboBench_(LzTurbo_vs_Zstd_vs_Oodle)_2017-Feb>timer64.exe turbobenchs.exe Agatha_Christie_108-ebooks_TXT.tar -elzturbo,19,29,39 -g -J15
20530632 39.4 0.95 2619.54 lzturbo 19 Agatha_Christie_108-ebooks_TXT.tar
12359445 23.7 1.04 753.68 lzturbo 29 Agatha_Christie_108-ebooks_TXT.tar
9441172 18.1 1.00 545.11 lzturbo 39 Agatha_Christie_108-ebooks_TXT.tar
TurboBench: - Wed Feb 10 21:25:07 2016
C Size ratio% C MB/s D MB/s Name File
9441172 18.1 1.00 545.11 lzturbo 39 Agatha_Christie_108-ebooks_TXT.tar.tbb
12359445 23.7 1.04 753.68 lzturbo 29 Agatha_Christie_108-ebooks_TXT.tar.tbb
20530632 39.4 0.95 2619.54 lzturbo 19 Agatha_Christie_108-ebooks_TXT.tar.tbb
Kernel Time = 0.748 = 0%
User Time = 202.816 = 61%
Process Time = 203.565 = 61% Virtual Memory = 4437 MB
Global Time = 328.630 = 100% Physical Memory = 687 MB
D:\Washigan+_vs_lzbench_vs_TurboBench_(LzTurbo_vs_Zstd_vs_Oodle)_2017-Feb>_BENCH_a_file.BAT Agatha_Christie_108-ebooks_TXT.tar
D:\Washigan+_vs_lzbench_vs_TurboBench_(LzTurbo_vs_Zstd_vs_Oodle)_2017-Feb>"Nakamichi_Washigan+_(1xQWORD+1xXMM)_Intel_15.0_64bit_SSE41.exe" Agatha_Christie_108-ebooks_TXT.tar.Nakamichi /bench
Nakamichi 'Washigan+', written by Kaze, based on Nobuo Ito's LZSS source, babealicious suggestion by m^2 enforced, muffinesque suggestion by Jim Dempsey enforced.
Note0: Nakamichi 'Eye-of-the-Eagle' is 100% FREE, licenseless that is.
Note1: Hamid Buzidi's LzTurbo ([a] FASTEST [Textual] Decompressor, Levels 19/39) retains kingship, his TurboBench (2016-Dec-26) proves the supremacy of LzTurbo, Turbo-Amazing!
Note2: Conor Stokes' LZSSE2 ([a] FASTEST Textual Decompressor, Level 17) is embedded, all credits along with many thanks go to him.
Note3: 'Washigan' predecessors are 'Okamigan', 'Zato', 'Tsubame', 'Tengu-Tsuyo' and 'Tengu'.
Note4: This compile can handle files up to 5120MB.
Note5: The matchfinder/memmem() is 'Railgun_BawBaw_reverse'.
Note6: Instead of '_mm_loadu_si128' '_mm_lddqu_si128' is used.
Note7: The lookahead 'Tsuyo' heuristic which looks one char ahead is applied thrice, still not strengthened, though.
Note8: The compile made 2017-Feb-07, the decompression time measuring is done in 16x8 passes choosing the top score from 64 back-to-back runs - the goal - to enter [maximal] Turbo Mode.
Note9: Just to reduce the codesize, the 3xQWORD become (in this compile) 1xQWORD+1xXMMWORD.
NoteA: Please send me (at sanmayce@sanmayce.com) decompression results obtained on machines with fast CPU-RAM subsystems.
Current priority class is REALTIME_PRIORITY_CLASS.
Allocating Source-Buffer 11 MB ...
Allocating Target-Buffer 5,120 MB ...
Decompressing 12,371,121 bytes (being the compressed stream) ...
Warming up ...
RAM-to-RAM performance:
702 MB/s; 717 MB/s; 717 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s
Enforcing 17 seconds idling to avoid throttling ...
719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 717 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s
Enforcing 17 seconds idling to avoid throttling ...
719 MB/s; 719 MB/s; 719 MB/s; 717 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 688 MB/s; 719 MB/s; 719 MB/s; 719 MB/s
Enforcing 17 seconds idling to avoid throttling ...
719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 717 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s
Enforcing 17 seconds idling to avoid throttling ...
719 MB/s; 719 MB/s; 719 MB/s; 712 MB/s; 717 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s
Enforcing 17 seconds idling to avoid throttling ...
719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 717 MB/s; 717 MB/s; 719 MB/s; 719 MB/s; 719 MB/s
Enforcing 17 seconds idling to avoid throttling ...
719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 717 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s
Enforcing 17 seconds idling to avoid throttling ...
719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 719 MB/s; 717 MB/s; 719 MB/s; 719 MB/s; 719 MB/s
Enforcing 17 seconds idling to avoid throttling ...
This CPU seems to be working at 2,394 MHz, or more due to ensleeping.
RAM-to-RAM (peak) performance: 719 MB/s.
Source-file-Hash(FNV1A_YoshimitsuTRIAD) = 0x517a,d911
Target-file-Hash(FNV1A_YoshimitsuTRIAD) = 0x341f,6b5c
Allocating Source-Buffer 17 MB ...
Allocating Target-Buffer 5,120 MB ...
Decompressing 'Agatha_Christie_108-ebooks_TXT.tar.L17.LZSSE2' (18,143,846 bytes, being the compressed stream) ...
Warming up ...
RAM-to-RAM performance:
2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s
Enforcing 17 seconds idling to avoid throttling ...
2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s
Enforcing 17 seconds idling to avoid throttling ...
2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s
Enforcing 17 seconds idling to avoid throttling ...
2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s
Enforcing 17 seconds idling to avoid throttling ...
2165 MB/s; 2143 MB/s; 2166 MB/s; 2166 MB/s; 2166 MB/s; 2166 MB/s; 2166 MB/s; 2166 MB/s; 2166 MB/s; 2166 MB/s; 2166 MB/s; 2166 MB/s; 2166 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s
Enforcing 17 seconds idling to avoid throttling ...
2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s
Enforcing 17 seconds idling to avoid throttling ...
2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s
Enforcing 17 seconds idling to avoid throttling ...
2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s; 2165 MB/s
Enforcing 17 seconds idling to avoid throttling ...
This CPU seems to be working at 2,394 MHz, or more due to ensleeping.
RAM-to-RAM (peak) performance: 2166 MB/s.
Nakamichi 'Washigan+' vs LZSSE2 17, c.size: 0.68x
LZSSE2 17 vs Nakamichi 'Washigan+', d.rate: 3.01x
Bottomline:
Nakamichi 'Washigan+' expanding 4.21x to 52,078,592 at 719 MB/s.
D:\Washigan+_vs_lzbench_vs_TurboBench_(LzTurbo_vs_Zstd_vs_Oodle)_2017-Feb>lzbench.exe -c4 -ebrotli24,11/tornado,16/blosclz,9/brieflz/crush,2/csc,5/density,3/fastlz,2/gipfeli/zstd,12,22/lzo1b,999/lzham,4/libdeflate,12/lz4hc,10,12/lz5,19,29,39,49/lzf,1/lzfse/lzg,8/lzham,1/lzjb/lzlib,9/lzma,9/lzrw,5/lzsse2,17/lzsse4,17/lzsse8,17/lzvn/pithy,9/quicklz,3/snappy/slz_zlib,3/ucl_nrv2b,9/ucl_nrv2d,9/ucl_nrv2e,9/xpack,9/xz,9/yalz77,12/yappy,10000/zlib,9/zling,4/shrinker/wflz/lzmat Agatha_Christie_108-ebooks_TXT.tar
lzbench 1.6 (64-bit Windows) Assembled by P.Skibinski
Compressor name Compress. Decompress. Compr. size Ratio Filename
memcpy 6369 MB/s 6266 MB/s 52078592 100.00 Agatha_Christie_108-ebooks_TXT.tar
...
The results sorted by column number 4:
Compressor name Compress. Decompress. Compr. size Ratio Filename
csc 2016-10-13 -5 2.21 MB/s 62 MB/s 9255865 17.77 Agatha_Christie_108-ebooks_TXT.tar
xz 5.2.2 -9 1.02 MB/s 85 MB/s 9300334 17.86 Agatha_Christie_108-ebooks_TXT.tar
lzma 9.38 -9 0.97 MB/s 95 MB/s 9300545 17.86 Agatha_Christie_108-ebooks_TXT.tar
lzlib 1.7 -9 0.90 MB/s 59 MB/s 9330101 17.92 Agatha_Christie_108-ebooks_TXT.tar
lzham 1.0 -d26 -4 0.74 MB/s 185 MB/s 9366806 17.99 Agatha_Christie_108-ebooks_TXT.tar
zstd 1.1.3 -22 1.13 MB/s 485 MB/s 9438446 18.12 Agatha_Christie_108-ebooks_TXT.tar
tornado 0.6a -16 1.25 MB/s 188 MB/s 9603758 18.44 Agatha_Christie_108-ebooks_TXT.tar
brotli24 0.5.2 -11 0.38 MB/s 245 MB/s 10570883 20.30 Agatha_Christie_108-ebooks_TXT.tar
lzham 1.0 -d26 -1 1.72 MB/s 177 MB/s 11360659 21.81 Agatha_Christie_108-ebooks_TXT.tar
Nakamichi 'Washigan+' 719 MB/s 12371121 ! outside lzbench !
lz5 2.0 -49 1.13 MB/s 647 MB/s 12492111 23.99 Agatha_Christie_108-ebooks_TXT.tar
zling 2016-01-10 -4 24 MB/s 131 MB/s 14387805 27.63 Agatha_Christie_108-ebooks_TXT.tar
zstd 1.1.3 -12 4.79 MB/s 481 MB/s 14950902 28.71 Agatha_Christie_108-ebooks_TXT.tar
lz5 2.0 -29 1.18 MB/s 975 MB/s 14979621 28.76 Agatha_Christie_108-ebooks_TXT.tar
crush 1.0 -2 0.15 MB/s 256 MB/s 15288557 29.36 Agatha_Christie_108-ebooks_TXT.tar
xpack 2016-06-02 -9 6.77 MB/s 501 MB/s 16716768 32.10 Agatha_Christie_108-ebooks_TXT.tar
libdeflate 0.6 -12 5.00 MB/s 442 MB/s 17345834 33.31 Agatha_Christie_108-ebooks_TXT.tar
lz5 2.0 -39 5.05 MB/s 1248 MB/s 17626712 33.85 Agatha_Christie_108-ebooks_TXT.tar
yalz77 2015-09-19 -12 17 MB/s 235 MB/s 17898478 34.37 Agatha_Christie_108-ebooks_TXT.tar
lzsse2 2016-05-14 -17 5.03 MB/s 2147 MB/s 18143846 34.84 Agatha_Christie_108-ebooks_TXT.tar
zlib 1.2.8 -9 10 MB/s 228 MB/s 18241465 35.03 Agatha_Christie_108-ebooks_TXT.tar
lzsse4 2016-05-14 -17 5.84 MB/s 2200 MB/s 18247250 35.04 Agatha_Christie_108-ebooks_TXT.tar
lzsse8 2016-05-14 -17 5.35 MB/s 2058 MB/s 18494273 35.51 Agatha_Christie_108-ebooks_TXT.tar
lzfse 2016-08-16 37 MB/s 377 MB/s 18524527 35.57 Agatha_Christie_108-ebooks_TXT.tar
brieflz 1.1.0 89 MB/s 122 MB/s 19416145 37.28 Agatha_Christie_108-ebooks_TXT.tar
ucl_nrv2e 1.03 -9 0.71 MB/s 207 MB/s 19429930 37.31 Agatha_Christie_108-ebooks_TXT.tar
ucl_nrv2d 1.03 -9 0.70 MB/s 209 MB/s 19671707 37.77 Agatha_Christie_108-ebooks_TXT.tar
lzo1b 2.09 -999 8.29 MB/s 454 MB/s 20023808 38.45 Agatha_Christie_108-ebooks_TXT.tar
ucl_nrv2b 1.03 -9 0.77 MB/s 205 MB/s 20150309 38.69 Agatha_Christie_108-ebooks_TXT.tar
lz4hc 1.7.5 -12 6.66 MB/s 1754 MB/s 20522704 39.41 Agatha_Christie_108-ebooks_TXT.tar
lz5 2.0 -19 5.10 MB/s 1910 MB/s 20539784 39.44 Agatha_Christie_108-ebooks_TXT.tar
lz4hc 1.7.5 -10 16 MB/s 1769 MB/s 20787436 39.92 Agatha_Christie_108-ebooks_TXT.tar
lzmat 1.01 17 MB/s 204 MB/s 21159660 40.63 Agatha_Christie_108-ebooks_TXT.tar
density 0.12.5 beta -3 272 MB/s 238 MB/s 23350652 44.84 Agatha_Christie_108-ebooks_TXT.tar
lzg 1.0.8 -8 3.92 MB/s 407 MB/s 23498566 45.12 Agatha_Christie_108-ebooks_TXT.tar
lzvn 2016-08-16 31 MB/s 557 MB/s 23738648 45.58 Agatha_Christie_108-ebooks_TXT.tar
gipfeli 2016-07-13 165 MB/s 296 MB/s 23759167 45.62 Agatha_Christie_108-ebooks_TXT.tar
quicklz 1.5.0 -3 32 MB/s 544 MB/s 23938953 45.97 Agatha_Christie_108-ebooks_TXT.tar
lzrw 15-Jul-1991 -5 87 MB/s 336 MB/s 24084436 46.25 Agatha_Christie_108-ebooks_TXT.tar
pithy 2011-12-24 -9 203 MB/s 976 MB/s 25178117 48.35 Agatha_Christie_108-ebooks_TXT.tar
yappy 2014-03-22 -10000 57 MB/s 1314 MB/s 27886357 53.55 Agatha_Christie_108-ebooks_TXT.tar
shrinker 0.1 220 MB/s 536 MB/s 28153655 54.06 Agatha_Christie_108-ebooks_TXT.tar
lzf 3.6 -1 182 MB/s 370 MB/s 28313580 54.37 Agatha_Christie_108-ebooks_TXT.tar
fastlz 0.1 -2 185 MB/s 308 MB/s 28807607 55.32 Agatha_Christie_108-ebooks_TXT.tar
slz_zlib 1.0.0 -3 127 MB/s 169 MB/s 29280448 56.22 Agatha_Christie_108-ebooks_TXT.tar
blosclz 2015-11-10 -9 150 MB/s 473 MB/s 29339431 56.34 Agatha_Christie_108-ebooks_TXT.tar
snappy 1.1.3 184 MB/s 618 MB/s 30109214 57.81 Agatha_Christie_108-ebooks_TXT.tar
wflz 2015-09-16 144 MB/s 458 MB/s 34937744 67.09 Agatha_Christie_108-ebooks_TXT.tar
lzjb 2010 145 MB/s 290 MB/s 37628084 72.25 Agatha_Christie_108-ebooks_TXT.tar
D:\Washigan+_vs_lzbench_vs_TurboBench_(LzTurbo_vs_Zstd_vs_Oodle)_2017-Feb>turbobenchs.exe Agatha_Christie_108-ebooks_TXT.tar -elibdeflate,12/oodle,19,49,89,112,114,116,118,129/lzsse2,17/lzturbo,19,29,39/zstd,22/lz5,19,29,39,49/brotli,11/lzma,9/bzip2/xpack,9/chameleon,2/density,3/lzham,4/trle/bsc_st,6 -g -J15 -B2G
TurboBench: - Wed Feb 10 23:17:35 2016
C Size ratio% C MB/s D MB/s Name File
9299223 17.9 0.91 95.59 lzma 9 Agatha_Christie_108-ebooks_TXT.tar.tbb
9362016 18.0 0.79 191.62 lzham 4 Agatha_Christie_108-ebooks_TXT.tar.tbb
9438450 18.1 1.18 497.74 zstd 22 Agatha_Christie_108-ebooks_TXT.tar.tbb
9441172 18.1 0.94 544.81 lzturbo 39 Agatha_Christie_108-ebooks_TXT.tar.tbb
9609003 18.5 0.65 547.07 oodle 89 Agatha_Christie_108-ebooks_TXT.tar.tbb
9609255 18.5 0.54 521.93 oodle 129 Agatha_Christie_108-ebooks_TXT.tar.tbb
9846926 18.9 0.30 362.14 oodle 19 Agatha_Christie_108-ebooks_TXT.tar.tbb
10199904 19.6 10.13 5.80 bsc_st 6 Agatha_Christie_108-ebooks_TXT.tar.tbb
10553091 20.3 0.39 245.79 brotli 11 Agatha_Christie_108-ebooks_TXT.tar.tbb
11593500 22.3 0.70 394.67 xpack 9 Agatha_Christie_108-ebooks_TXT.tar.tbb
12359445 23.7 0.99 752.16 lzturbo 29 Agatha_Christie_108-ebooks_TXT.tar.tbb
12371121 719 Nakamichi 'Washigan+' ! outside TurboBench !
12492115 24.0 1.13 674.92 lz5 49 Agatha_Christie_108-ebooks_TXT.tar.tbb
13039734 25.0 10.34 20.89 bzip2 Agatha_Christie_108-ebooks_TXT.tar.tbb
14029726 26.9 0.48 2090.54 oodle 116 Agatha_Christie_108-ebooks_TXT.tar.tbb
14088000 27.1 0.77 2086.65 oodle 118 Agatha_Christie_108-ebooks_TXT.tar.tbb
14979625 28.8 1.20 1014.58 lz5 29 Agatha_Christie_108-ebooks_TXT.tar.tbb
16634061 31.9 13.18 2347.76 oodle 114 Agatha_Christie_108-ebooks_TXT.tar.tbb
17345844 33.3 4.95 426.10 libdeflate 12 Agatha_Christie_108-ebooks_TXT.tar.tbb
17626716 33.8 5.01 1233.16 lz5 39 Agatha_Christie_108-ebooks_TXT.tar.tbb
18143850 34.8 4.95 2182.60 lzsse2 17 Agatha_Christie_108-ebooks_TXT.tar.tbb
20530632 39.4 0.91 2619.88 lzturbo 19 Agatha_Christie_108-ebooks_TXT.tar.tbb
20537986 39.4 2.73 1819.25 oodle 49 Agatha_Christie_108-ebooks_TXT.tar.tbb
20539788 39.4 5.03 1872.76 lz5 19 Agatha_Christie_108-ebooks_TXT.tar.tbb
20617915 39.6 46.74 2628.09 oodle 112 Agatha_Christie_108-ebooks_TXT.tar.tbb
23350450 44.8 282.81 245.37 density 3 Agatha_Christie_108-ebooks_TXT.tar.tbb
29349830 56.4 1097.51 1978.94 chameleon 2 Agatha_Christie_108-ebooks_TXT.tar.tbb
52000723 99.9 148.34 1322.91 trle Agatha_Christie_108-ebooks_TXT.tar.tbb
D:\Washigan+_vs_lzbench_vs_TurboBench_(LzTurbo_vs_Zstd_vs_Oodle)_2017-Feb>zstd-v1.1.2-win64.exe -b3 Agatha_Christie_108-ebooks_TXT.tar
3#08-ebooks_TXT.tar : 52078592 -> 17515824 (2.973), 106.2 MB/s , 381.5 MB/s
D:\Washigan+_vs_lzbench_vs_TurboBench_(LzTurbo_vs_Zstd_vs_Oodle)_2017-Feb>zstd-v1.1.2-win64.exe -b12 Agatha_Christie_108-ebooks_TXT.tar
12#08-ebooks_TXT.tar : 52078592 -> 14950902 (3.483), 4.8 MB/s , 426.5 MB/s
D:\Washigan+_vs_lzbench_vs_TurboBench_(LzTurbo_vs_Zstd_vs_Oodle)_2017-Feb>zstd-v1.1.2-win64.exe -b22 --ultra Agatha_Christie_108-ebooks_TXT.tar
22#08-ebooks_TXT.tar : 52078592 -> 9438446 (5.518), 1.1 MB/s , 489.4 MB/s
Done. To copy the console content into clipboard: 1] Right Click 2] Select All 3] Enter
1 thread:
C:\Windows\system32>d:
D:\>cd "Washigan+_vs_lzbench_vs_TurboBench_(LzTurbo_vs_Zstd_vs_Oodle)_2017-Feb"
D:\Washigan+_vs_lzbench_vs_TurboBench_(LzTurbo_vs_Zstd_vs_Oodle)_2017-Feb>_BENCH_a_file.BAT Agatha_Christie_108-ebooks_TXT.tar
D:\Washigan+_vs_lzbench_vs_TurboBench_(LzTurbo_vs_Zstd_vs_Oodle)_2017-Feb>"Nakamichi_Washigan+_(1xQWORD+1xXMM)_Intel_15.0_64bit_SSE41.exe" Agatha_Christie_108-ebooks_TXT.tar.Nakamichi /bench
Nakamichi 'Washigan+', written by Kaze, based on Nobuo Ito's LZSS source, babealicious suggestion by m^2 enforced, muffinesque suggestion by Jim Dempsey enforced.
Note0: Nakamichi 'Eye-of-the-Eagle' is 100% FREE, licenseless that is.
Note1: Hamid Buzidi's LzTurbo ([a] FASTEST [Textual] Decompressor, Levels 19/39) retains kingship, his TurboBench (2016-Dec-26) proves the supremacy of LzTurbo, Turbo-Amazing!
Note2: Conor Stokes' LZSSE2 ([a] FASTEST Textual Decompressor, Level 17) is embedded, all credits along with many thanks go to him.
Note3: 'Washigan' predecessors are 'Okamigan', 'Zato', 'Tsubame', 'Tengu-Tsuyo' and 'Tengu'.
Note4: This compile can handle files up to 5120MB.
Note5: The matchfinder/memmem() is 'Railgun_BawBaw_reverse'.
Note6: Instead of '_mm_loadu_si128' '_mm_lddqu_si128' is used.
Note7: The lookahead 'Tsuyo' heuristic which looks one char ahead is applied thrice, still not strengthened, though.
Note8: The compile made 2017-Feb-07, the decompression time measuring is done in 16x8 passes choosing the top score from 64 back-to-back runs - the goal - to enter [maximal] Turbo Mode.
Note9: Just to reduce the codesize, the 3xQWORD become (in this compile) 1xQWORD+1xXMMWORD.
NoteA: Please send me (at sanmayce@sanmayce.com) decompression results obtained on machines with fast CPU-RAM subsystems.
Current priority class is REALTIME_PRIORITY_CLASS.
Allocating Source-Buffer 11 MB ...
Allocating Target-Buffer 5,120 MB ...
Decompressing 12,371,121 bytes (being the compressed stream) ...
Warming up ...
RAM-to-RAM performance:
646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 619 MB/s; 644 MB/s; 646 MB/s; 646 MB/s; 617 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s
Enforcing 17 seconds idling to avoid throttling ...
646 MB/s; 646 MB/s; 617 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 615 MB/s
Enforcing 17 seconds idling to avoid throttling ...
646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 617 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s
Enforcing 17 seconds idling to avoid throttling ...
646 MB/s; 634 MB/s; 628 MB/s; 617 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 617 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s
Enforcing 17 seconds idling to avoid throttling ...
646 MB/s; 634 MB/s; 626 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 617 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 617 MB/s
Enforcing 17 seconds idling to avoid throttling ...
646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 634 MB/s; 626 MB/s; 646 MB/s; 617 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s
Enforcing 17 seconds idling to avoid throttling ...
646 MB/s; 646 MB/s; 617 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 617 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s
Enforcing 17 seconds idling to avoid throttling ...
646 MB/s; 646 MB/s; 646 MB/s; 636 MB/s; 626 MB/s; 617 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s; 646 MB/s
Enforcing 17 seconds idling to avoid throttling ...
This CPU seems to be working at 2,394 MHz, or more due to ensleeping.
RAM-to-RAM (peak) performance: 646 MB/s.
Source-file-Hash(FNV1A_YoshimitsuTRIAD) = 0x517a,d911
Target-file-Hash(FNV1A_YoshimitsuTRIAD) = 0x341f,6b5c
Allocating Source-Buffer 17 MB ...
Allocating Target-Buffer 5,120 MB ...
Decompressing 'Agatha_Christie_108-ebooks_TXT.tar.L17.LZSSE2' (18,143,846 bytes, being the compressed stream) ...
Warming up ...
RAM-to-RAM performance:
1755 MB/s; 1756 MB/s; 1755 MB/s; 1755 MB/s; 1756 MB/s; 1756 MB/s; 1755 MB/s; 1755 MB/s; 1756 MB/s; 1756 MB/s; 1755 MB/s; 1755 MB/s; 1756 MB/s; 1755 MB/s; 1755 MB/s; 1755 MB/s
Enforcing 17 seconds idling to avoid throttling ...
1756 MB/s; 1755 MB/s; 1755 MB/s; 1756 MB/s; 1629 MB/s; 1655 MB/s; 1739 MB/s; 1755 MB/s; 1755 MB/s; 1755 MB/s; 1756 MB/s; 1756 MB/s; 1755 MB/s; 1755 MB/s; 1755 MB/s; 1756 MB/s
Enforcing 17 seconds idling to avoid throttling ...
1756 MB/s; 1755 MB/s; 1755 MB/s; 1755 MB/s; 1756 MB/s; 1629 MB/s; 1669 MB/s; 1740 MB/s; 1755 MB/s; 1755 MB/s; 1756 MB/s; 1756 MB/s; 1755 MB/s; 1755 MB/s; 1755 MB/s; 1756 MB/s
Enforcing 17 seconds idling to avoid throttling ...
1756 MB/s; 1755 MB/s; 1755 MB/s; 1755 MB/s; 1756 MB/s; 1756 MB/s; 1755 MB/s; 1629 MB/s; 1669 MB/s; 1740 MB/s; 1755 MB/s; 1756 MB/s; 1756 MB/s; 1755 MB/s; 1755 MB/s; 1755 MB/s
Enforcing 17 seconds idling to avoid throttling ...
1756 MB/s; 1756 MB/s; 1739 MB/s; 1756 MB/s; 1756 MB/s; 1739 MB/s; 1755 MB/s; 1755 MB/s; 1756 MB/s; 1756 MB/s; 1755 MB/s; 1755 MB/s; 1629 MB/s; 1669 MB/s; 1740 MB/s; 1755 MB/s
Enforcing 17 seconds idling to avoid throttling ...
1755 MB/s; 1755 MB/s; 1756 MB/s; 1756 MB/s; 1755 MB/s; 1755 MB/s; 1756 MB/s; 1755 MB/s; 1755 MB/s; 1755 MB/s; 1756 MB/s; 1755 MB/s; 1755 MB/s; 1756 MB/s; 1756 MB/s; 1755 MB/s
Enforcing 17 seconds idling to avoid throttling ...
1755 MB/s; 1629 MB/s; 1669 MB/s; 1740 MB/s; 1755 MB/s; 1755 MB/s; 1756 MB/s; 1755 MB/s; 1755 MB/s; 1755 MB/s; 1755 MB/s; 1756 MB/s; 1756 MB/s; 1755 MB/s; 1755 MB/s; 1755 MB/s
Enforcing 17 seconds idling to avoid throttling ...
1756 MB/s; 1756 MB/s; 1755 MB/s; 1755 MB/s; 1755 MB/s; 1755 MB/s; 1740 MB/s; 1756 MB/s; 1755 MB/s; 1755 MB/s; 1755 MB/s; 1655 MB/s; 1655 MB/s; 1710 MB/s; 1756 MB/s; 1756 MB/s
Enforcing 17 seconds idling to avoid throttling ...
This CPU seems to be working at 2,394 MHz, or more due to ensleeping.
RAM-to-RAM (peak) performance: 1756 MB/s.
Nakamichi 'Washigan+' vs LZSSE2 17, c.size: 0.68x
LZSSE2 17 vs Nakamichi 'Washigan+', d.rate: 2.72x
Bottomline:
Nakamichi 'Washigan+' expanding 4.21x to 52,078,592 at 646 MB/s.
D:\Washigan+_vs_lzbench_vs_TurboBench_(LzTurbo_vs_Zstd_vs_Oodle)_2017-Feb>lzbench.exe -c4 -ebrotli24,11/tornado,16/blosclz,9/brieflz/crush,2/csc,5/density,3/fastlz,2/gipfeli/zstd,12,22/lzo1b,999/lzham,4/libdeflate,12/lz4hc,10,12/lz5,19,29,39,49/lzf,1/lzfse/lzg,8/lzham,1/lzjb/lzlib,9/lzma,9/lzrw,5/lzsse2,17/lzsse4,17/lzsse8,17/lzvn/pithy,9/quicklz,3/snappy/slz_zlib,3/ucl_nrv2b,9/ucl_nrv2d,9/ucl_nrv2e,9/xpack,9/xz,9/yalz77,12/yappy,10000/zlib,9/zling,4/shrinker/wflz/lzmat Agatha_Christie_108-ebooks_TXT.tar
lzbench 1.6 (64-bit Windows) Assembled by P.Skibinski
Compressor name Compress. Decompress. Compr. size Ratio Filename
memcpy 5807 MB/s 5794 MB/s 52078592 100.00 Agatha_Christie_108-ebooks_TXT.tar
...
The results sorted by column number 4:
Compressor name Compress. Decompress. Compr. size Ratio Filename
csc 2016-10-13 -5 1.97 MB/s 50 MB/s 9255865 17.77 Agatha_Christie_108-ebooks_TXT.tar
xz 5.2.2 -9 0.93 MB/s 70 MB/s 9300334 17.86 Agatha_Christie_108-ebooks_TXT.tar
lzma 9.38 -9 0.87 MB/s 78 MB/s 9300545 17.86 Agatha_Christie_108-ebooks_TXT.tar
lzlib 1.7 -9 0.81 MB/s 45 MB/s 9330101 17.92 Agatha_Christie_108-ebooks_TXT.tar
lzham 1.0 -d26 -4 0.66 MB/s 158 MB/s 9366806 17.99 Agatha_Christie_108-ebooks_TXT.tar
zstd 1.1.3 -22 1.03 MB/s 413 MB/s 9438446 18.12 Agatha_Christie_108-ebooks_TXT.tar
tornado 0.6a -16 1.14 MB/s 163 MB/s 9603758 18.44 Agatha_Christie_108-ebooks_TXT.tar
brotli24 0.5.2 -11 0.32 MB/s 226 MB/s 10570883 20.30 Agatha_Christie_108-ebooks_TXT.tar
lzham 1.0 -d26 -1 1.44 MB/s 144 MB/s 11360659 21.81 Agatha_Christie_108-ebooks_TXT.tar
Nakamichi 'Washigan+' 646 MB/s 12371121 ! outside lzbench !
lz5 2.0 -49 1.02 MB/s 576 MB/s 12492111 23.99 Agatha_Christie_108-ebooks_TXT.tar
zling 2016-01-10 -4 19 MB/s 108 MB/s 14387805 27.63 Agatha_Christie_108-ebooks_TXT.tar
zstd 1.1.3 -12 4.57 MB/s 390 MB/s 14950902 28.71 Agatha_Christie_108-ebooks_TXT.tar
lz5 2.0 -29 1.03 MB/s 865 MB/s 14979621 28.76 Agatha_Christie_108-ebooks_TXT.tar
crush 1.0 -2 0.14 MB/s 208 MB/s 15288557 29.36 Agatha_Christie_108-ebooks_TXT.tar
xpack 2016-06-02 -9 5.52 MB/s 399 MB/s 16716768 32.10 Agatha_Christie_108-ebooks_TXT.tar
libdeflate 0.6 -12 3.98 MB/s 354 MB/s 17345834 33.31 Agatha_Christie_108-ebooks_TXT.tar
lz5 2.0 -39 4.03 MB/s 1000 MB/s 17626712 33.85 Agatha_Christie_108-ebooks_TXT.tar
yalz77 2015-09-19 -12 16 MB/s 204 MB/s 17898478 34.37 Agatha_Christie_108-ebooks_TXT.tar
lzsse2 2016-05-14 -17 4.08 MB/s 1722 MB/s 18143846 34.84 Agatha_Christie_108-ebooks_TXT.tar
zlib 1.2.8 -9 8.48 MB/s 183 MB/s 18241465 35.03 Agatha_Christie_108-ebooks_TXT.tar
lzsse4 2016-05-14 -17 4.77 MB/s 1766 MB/s 18247250 35.04 Agatha_Christie_108-ebooks_TXT.tar
lzsse8 2016-05-14 -17 4.51 MB/s 1654 MB/s 18494273 35.51 Agatha_Christie_108-ebooks_TXT.tar
lzfse 2016-08-16 30 MB/s 302 MB/s 18524527 35.57 Agatha_Christie_108-ebooks_TXT.tar
brieflz 1.1.0 71 MB/s 98 MB/s 19416145 37.28 Agatha_Christie_108-ebooks_TXT.tar
ucl_nrv2e 1.03 -9 0.61 MB/s 166 MB/s 19429930 37.31 Agatha_Christie_108-ebooks_TXT.tar
ucl_nrv2d 1.03 -9 0.60 MB/s 168 MB/s 19671707 37.77 Agatha_Christie_108-ebooks_TXT.tar
lzo1b 2.09 -999 6.56 MB/s 364 MB/s 20023808 38.45 Agatha_Christie_108-ebooks_TXT.tar
ucl_nrv2b 1.03 -9 0.62 MB/s 164 MB/s 20150309 38.69 Agatha_Christie_108-ebooks_TXT.tar
lz4hc 1.7.5 -12 5.34 MB/s 1406 MB/s 20522704 39.41 Agatha_Christie_108-ebooks_TXT.tar
lz5 2.0 -19 4.11 MB/s 1526 MB/s 20539784 39.44 Agatha_Christie_108-ebooks_TXT.tar
lz4hc 1.7.5 -10 13 MB/s 1418 MB/s 20787436 39.92 Agatha_Christie_108-ebooks_TXT.tar
lzmat 1.01 14 MB/s 163 MB/s 21159660 40.63 Agatha_Christie_108-ebooks_TXT.tar
density 0.12.5 beta -3 224 MB/s 193 MB/s 23350652 44.84 Agatha_Christie_108-ebooks_TXT.tar
lzg 1.0.8 -8 3.27 MB/s 327 MB/s 23498566 45.12 Agatha_Christie_108-ebooks_TXT.tar
lzvn 2016-08-16 23 MB/s 446 MB/s 23738648 45.58 Agatha_Christie_108-ebooks_TXT.tar
gipfeli 2016-07-13 125 MB/s 238 MB/s 23759167 45.62 Agatha_Christie_108-ebooks_TXT.tar
quicklz 1.5.0 -3 25 MB/s 436 MB/s 23938953 45.97 Agatha_Christie_108-ebooks_TXT.tar
lzrw 15-Jul-1991 -5 68 MB/s 269 MB/s 24084436 46.25 Agatha_Christie_108-ebooks_TXT.tar
pithy 2011-12-24 -9 164 MB/s 781 MB/s 25178117 48.35 Agatha_Christie_108-ebooks_TXT.tar
yappy 2014-03-22 -10000 46 MB/s 1055 MB/s 27886357 53.55 Agatha_Christie_108-ebooks_TXT.tar
shrinker 0.1 176 MB/s 429 MB/s 28153655 54.06 Agatha_Christie_108-ebooks_TXT.tar
lzf 3.6 -1 145 MB/s 297 MB/s 28313580 54.37 Agatha_Christie_108-ebooks_TXT.tar
fastlz 0.1 -2 148 MB/s 246 MB/s 28807607 55.32 Agatha_Christie_108-ebooks_TXT.tar
slz_zlib 1.0.0 -3 102 MB/s 136 MB/s 29280448 56.22 Agatha_Christie_108-ebooks_TXT.tar
blosclz 2015-11-10 -9 119 MB/s 379 MB/s 29339431 56.34 Agatha_Christie_108-ebooks_TXT.tar
snappy 1.1.3 148 MB/s 495 MB/s 30109214 57.81 Agatha_Christie_108-ebooks_TXT.tar
wflz 2015-09-16 115 MB/s 367 MB/s 34937744 67.09 Agatha_Christie_108-ebooks_TXT.tar
lzjb 2010 116 MB/s 232 MB/s 37628084 72.25 Agatha_Christie_108-ebooks_TXT.tar
D:\Washigan+_vs_lzbench_vs_TurboBench_(LzTurbo_vs_Zstd_vs_Oodle)_2017-Feb>call turbobench_singlefile_noNakamichi_STRONG_2G.bat Agatha_Christie_108-ebooks_TXT.tar
D:\Washigan+_vs_lzbench_vs_TurboBench_(LzTurbo_vs_Zstd_vs_Oodle)_2017-Feb>turbobenchs.exe Agatha_Christie_108-ebooks_TXT.tar -elibdeflate,12/oodle,19,49,89,112,114,116,118,129/lzsse2,17/lzturbo,19,29,39/zstd,22/lz5,19,29,39,49/brotli,11/lzma,9/bzip2/xpack,9/chameleon,2/density,3/lzham,4/trle/bsc_st,6 -g -J15 -B2G
TurboBench: - Thu Feb 11 02:12:47 2016
C Size ratio% C MB/s D MB/s Name File
9299223 17.9 0.81 78.58 lzma 9 Agatha_Christie_108-ebooks_TXT.tar.tbb
9362016 18.0 0.70 161.07 lzham 4 Agatha_Christie_108-ebooks_TXT.tar.tbb
9438450 18.1 1.04 421.99 zstd 22 Agatha_Christie_108-ebooks_TXT.tar.tbb
9441172 18.1 0.86 485.74 lzturbo 39 Agatha_Christie_108-ebooks_TXT.tar.tbb
9609003 18.5 0.60 479.67 oodle 89 Agatha_Christie_108-ebooks_TXT.tar.tbb
9609255 18.5 0.48 478.97 oodle 129 Agatha_Christie_108-ebooks_TXT.tar.tbb
9846926 18.9 0.26 312.07 oodle 19 Agatha_Christie_108-ebooks_TXT.tar.tbb
10199904 19.6 8.20 4.97 bsc_st 6 Agatha_Christie_108-ebooks_TXT.tar.tbb
10553091 20.3 0.33 225.59 brotli 11 Agatha_Christie_108-ebooks_TXT.tar.tbb
11593500 22.3 0.68 336.85 xpack 9 Agatha_Christie_108-ebooks_TXT.tar.tbb
12359445 23.7 0.90 665.48 lzturbo 29 Agatha_Christie_108-ebooks_TXT.tar.tbb
12371121 646 Nakamichi 'Washigan+' ! outside TurboBench !
12492115 24.0 1.02 578.93 lz5 49 Agatha_Christie_108-ebooks_TXT.tar.tbb
13039734 25.0 8.34 18.03 bzip2 Agatha_Christie_108-ebooks_TXT.tar.tbb
14029726 26.9 0.45 1743.67 oodle 116 Agatha_Christie_108-ebooks_TXT.tar.tbb
14088000 27.1 0.73 1739.35 oodle 118 Agatha_Christie_108-ebooks_TXT.tar.tbb
14979625 28.8 1.04 870.12 lz5 29 Agatha_Christie_108-ebooks_TXT.tar.tbb
16634061 31.9 11.83 1937.97 oodle 114 Agatha_Christie_108-ebooks_TXT.tar.tbb
17345844 33.3 3.98 342.31 libdeflate 12 Agatha_Christie_108-ebooks_TXT.tar.tbb
17626716 33.8 4.03 988.17 lz5 39 Agatha_Christie_108-ebooks_TXT.tar.tbb
18143850 34.8 3.97 1755.29 lzsse2 17 Agatha_Christie_108-ebooks_TXT.tar.tbb
20530632 39.4 0.84 2105.00 lzturbo 19 Agatha_Christie_108-ebooks_TXT.tar.tbb
20537986 39.4 2.16 1462.36 oodle 49 Agatha_Christie_108-ebooks_TXT.tar.tbb
20539788 39.4 4.05 1499.70 lz5 19 Agatha_Christie_108-ebooks_TXT.tar.tbb
20617915 39.6 38.43 2154.60 oodle 112 Agatha_Christie_108-ebooks_TXT.tar.tbb
23350450 44.8 213.93 200.69 density 3 Agatha_Christie_108-ebooks_TXT.tar.tbb
29349830 56.4 880.95 1617.90 chameleon 2 Agatha_Christie_108-ebooks_TXT.tar.tbb
52000723 99.9 119.45 1061.17 trle Agatha_Christie_108-ebooks_TXT.tar.tbb
D:\Washigan+_vs_lzbench_vs_TurboBench_(LzTurbo_vs_Zstd_vs_Oodle)_2017-Feb>zstd-v1.1.2-win64.exe -b3 Agatha_Christie_108-ebooks_TXT.tar
3#08-ebooks_TXT.tar : 52078592 -> 17515824 (2.973), 85.3 MB/s , 310.6 MB/s
D:\Washigan+_vs_lzbench_vs_TurboBench_(LzTurbo_vs_Zstd_vs_Oodle)_2017-Feb>zstd-v1.1.2-win64.exe -b12 Agatha_Christie_108-ebooks_TXT.tar
12#08-ebooks_TXT.tar : 52078592 -> 14950902 (3.483), 4.5 MB/s , 351.9 MB/s
D:\Washigan+_vs_lzbench_vs_TurboBench_(LzTurbo_vs_Zstd_vs_Oodle)_2017-Feb>zstd-v1.1.2-win64.exe -b22 --ultra Agatha_Christie_108-ebooks_TXT.tar
22#08-ebooks_TXT.tar : 52078592 -> 9438446 (5.518), 1.0 MB/s , 407.1 MB/s
Done. To copy the console content into clipboard: 1] Right Click 2] Select All 3] Enter
D:\Washigan+_vs_lzbench_vs_TurboBench_(LzTurbo_vs_Zstd_vs_Oodle)_2017-Feb>
Now, do tell me, do these 2 tests prove to you the supremacy of LzTurbo? Unless you look at me as a cheater also.
- I don't think that Hamid is cheating especially that IMHO lzturbo can be beaten by Mermaid/Selkie/Kraken at least in ratio to decompression speed.
- When you compare LZ5 to lzturbo keep in mind that LZ5 doesn't use SSE/AVX and have a full checking of buffers. Removing a single
if
from the main loop gave 20% better decompression speed in my experiments. Everything works fine until files are not corrupted. I mean that I expect that lzturbo is not as good tested as open source compressors what can give some advantage in compression/decompression speed.
I will close it as it's too long. You can always open a new issue.