Here are the results of tests performed in August 2002 to compare lossless compression of "plain" texts by all known good enough programs developed for such purpose, including RK, DC, YBS, Bzip2, RAR, ACE and 7-zip. See Archive Comparison Test by J.Gilchrist for more details: http://compression.ca If anybody wants to start or continue such tests, or can suggest some other sets of texts, or other compression programs, (not sources or algorithm descriptions, executable programs only) or knows we have missed something important, (some new fantastic technology, an algorithm or even a program capable of lossless compression of up to 1000:1 etc.) please let us know immediately: artest@inbox.ru Thank you! [[1]] COMPRESSION QUALITY ========================= (see also [[2]] Speed [[3]] Details [[4]] Comments) Last seventh line shows results for the sum of all 1231 texts in six sets. Original Entropy PPMonstr PPMN Slim Compressia PPMd RK PPMy BEE 553.31% 100% 101.76 105.51 104.60 105.43 107.64 105.64 108.51 110.23 543.05% 100% 108.50 110.03 111.28 110.13 113.63 112.26 115.04 113.97 435.56% 100% 107.96 107.05 109.84 108.56 111.94 110.78 110.84 112.84 492.76% 100% 110.61 110.13 113.47 112.24 115.48 114.58 115.34 116.03 799.24% 101.80 100% 115.93 115.32 117.76 109.06 110.51 126.27 114.11 353.09% 100% 102.50 101.06 104.12 108.60 105.61 109.98 105.80 106.40 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 468.44% 100% 107.25 107.48 110.27 110.72 111.76 112.23 112.56 112.71 RAR DC SBC BOA YBS UHARC ERI 7-zip BZip2 Pkzip 109.41 108.66 108.98 110.03 108.95 107.33 109.53 116.80 124.06 159.23 114.56 114.28 115.55 117.47 117.38 115.17 119.44 120.55 130.92 178.03 112.57 111.19 112.57 113.19 113.95 112.43 115.21 115.85 124.48 163.20 116.21 115.77 116.82 117.62 118.62 117.78 120.29 121.73 131.87 174.67 121.49 121.44 118.06 122.31 120.56 122.76 125.99 138.39 149.67 205.34 106.15 111.66 110.30 107.42 109.44 113.54 111.44 106.72 116.85 148.43 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 113.08 114.02 114.27 114.34 115.32 115.72 117.20 117.69 127.59 167.57 [[2]] Speed =========== Canterbury Corpus Large Set http://corpus.canterbury.ac.nz/resources/large.zip was used for this test, and a 970MHz PC with 256Mb RAM and Windows98. Programs, Compression/ Overall Average Users' Compressed options Extraction, Score Score Size seconds seconds, % seconds, % bytes , % no compression 0 0 4446 559 4446 577 16005619 600 777 a -mg 140 84 1209 152 1070 139 3544038 133 777 a -mg -mu32 157 102 1234 155 1079 140 3513162 132 7za a -t7z 82 2 1110 140 1028 134 3692764 138 7za a -t7z -mx 127 2 1089 137 963 125 3454527 129 7za a -tzip 24 1 1245 157 1222 159 4393637 165 7za a -tzip -mx 45 1 1269 160 1224 159 4401174 165 acb B 395 396 1722 217 1331 173 3352388 126 acb b 514 516 1939 244 1430 186 3272388 123 acb u 710 711 2317 291 1614 210 3225662 121 ace32 a -d4096 66 2 1124 141 1058 137 3801917 142 ace32 a -d4096 -m1 31 2 1134 143 1104 143 3965841 149 ace32 a -d4096 -m5 206 2 1249 157 1045 136 3746553 140 arh a 38 40 1091 137 1053 137 3647067 137 arh a -2 -1 68 40 1121 141 1054 137 3647067 137 ba -k -50 35 12 964 121 929 121 3298943 124 bee a -m2 123 125 1134 143 1012 131 3188565 120 bee a -m3 162 164 1203 151 1043 135 3156801 118 bee a -m3 -s 204 206 1294 163 1092 142 3185012 119 bix a -mdg -s 92 1 1069 134 978 127 3514944 132 boa -m1 86 88 1253 158 1168 152 3886863 146 boa -m15 139 141 1165 146 1027 133 3182739 119 boa -m15 -s 138 140 1148 144 1011 131 3132810 117 bzip2 -k 21 6 1032 130 1011 131 3616113 136 bzip2 -k -9 20 6 1031 130 1011 131 3616113 136 ery-e.bat t o12 94 95 1003 126 910 118 2932445 110 ery-e.bat t o16 98 99 1001 126 904 117 2892711 108 ery-e.bat t o32 105 106 1009 127 905 118 2873677 108 ery-e.bat t o64 112 111 1022 128 911 118 2873318 108 compcl c -b15 37 20 904 114 868 113 3049569 114 compcl c -b15 -s 38 29 808 102 770 100 2668128 100 dc e 13 7 903 114 890 116 3179173 119 dc e -b16300 -mt5 17 7 795 100 778 101 2773427 104 eri a 39 17 936 118 897 116 3168414 119 eri a -m3 59 21 996 125 937 122 3295385 124 eri a -m6 59 21 989 124 931 121 3272926 123 gcac a 26 12 980 123 954 124 3390603 127 gcac s 26 12 981 123 955 124 3395064 127 imp98 a -mm 31 1 1175 148 1143 148 4112387 154 imp98 a -mm -2 13 5 999 126 986 128 3533761 132 imp98 a -2 -s4 13 5 999 126 986 128 3533693 132 pkzip -es 1 1 1654 208 1652 215 5945622 223 pkzip -a 4 1 1308 164 1304 169 4691491 176 pkzip -exx 16 1 1296 163 1280 166 4605942 173 ppmdi e -o7 -m232 11 12 904 114 893 116 3169000 119 ppmdi e -o12 -m232 25 26 915 115 891 116 3113630 117 ppmdi e -o16 -m232 27 28 916 115 890 116 3100943 116 ppmn_km e -o6 -MT1 30 30 931 117 901 117 3132278 117 ppmn_km e -o8 -MT1 64 65 993 125 929 121 3107654 116 ppmn_km e -o9 62 63 990 125 929 121 3115560 117 ppmn_km e -o9 -M:50 49 50 949 119 900 117 3058436 115 ppmonstr e -o7 -m232 64 67 974 123 911 118 3035498 114 ppmonstr e -o8 -m232 71 74 980 123 910 118 3007964 113 ppmonstr e -o64 -m232 101 103 1020 128 920 119 2937387 110 ppmy /o6 /m220 240 248 1430 180 1193 155 3391576 127 ppmy /o7 /m220 273 281 1456 183 1186 154 3251362 122 ppmy /o9 /m220 323 333 1514 190 1194 155 3088212 116 qlfc a 22 11 973 122 952 124 3385084 127 rar a -m4 20 11 914 115 895 116 3178768 119 rar a -m5 25 16 920 116 896 116 3164821 119 rar a -m5 -s 25 17 927 117 902 117 3185542 119 rar a -mc16:128t -s 41 31 927 117 886 115 3077033 115 rk -mf2 50 20 1108 139 1058 137 3735704 140 rk -mx1 144 143 1147 144 1004 130 3093640 116 rk -mx2 173 173 1203 151 1032 134 3086312 116 sbc c -b63 29 9 914 115 885 115 3151930 118 sbc c -os -b63 29 9 810 102 782 101 2779632 104 slim a -d32 -w22 524 522 1862 234 1343 174 2935640 110 slim a -d16 -w22 507 512 1835 231 1333 173 2935647 110 slim a -d8 -w22 477 485 1778 224 1306 170 2935701 110 slim a -d4 -w22 483 414 1713 215 1235 160 2936380 110 szip -o4 4 10 1027 129 1023 133 3647445 137 szip -o6 17 14 996 125 979 127 3475264 130 szip -o8 -b41 27 17 973 122 947 123 3348344 125 ufa a -mg 93 104 1138 143 1046 136 3387626 127 ufa a -mg -mu32 118 129 1176 148 1059 137 3344003 125 ufa a -mg -s 247 11 1339 168 1094 142 3890454 146 uharc a -m3 -md32768 112 5 983 124 872 113 3115786 117 uharc a -mz -md32768 8 10 1093 137 1084 141 3868781 145 uharc a -mx -md32768 51 47 934 117 883 115 3009015 113 ybs -m16mu 34 9 837 105 803 104 2857446 107 ybs -m16mu -r 34 9 843 106 809 105 2878433 108 zzip a 21 11 977 123 956 124 3400243 127 zzip a -mx 22 12 973 122 952 124 3383060 127 zzip a -mx -30m 30 12 940 118 910 118 3233147 121 Overall score is calculated by adding compression time, extraction time, and time it would take to transfer the compressed file over a 28,800bps network: (compressed_size)/3600 Average Users' score is calculated by adding (compress_time/10)+ extract_time + time it would take to transfer the compressed file over a 28,800bps network. Compression time is divided by 10 here, because more than 90% of people would never compress anything during their life (with compression programs), but they use compressed data almost _every_ time they use computers and/or Internet. That's why compression time is not so actual for them. [[3]] Details ============= are no longer put to this main text (1513 lines reporting 73042 results on 1231 files in 6 sets), but can be found in FULL version with TEXTS.DAT and *.BAT at http://geocities.com/SiliconValley/Bay/1995/artest24.zip or https://artest1.tripod.com/artest24.zip [[4]] Comments ============== Links to download programs: ~~~~~~~~~~~~~~~~~~~~~~~~~~~ ACE 2.04 :W http://winace.host.sk/ace204.exe 593K ERI 5.1fre :e http://geocities.com/eri32/eri51fre.zip 89K GCac 0.9k :W http://www.emit.jp/gca/gca_v09k.exe 295K UHArc 0.4b :eW ftp://ftp.elf.stuba.sk/pub/pc/pack/uharc04.zip 220K QLFC 6.6W :W http://ghido.shelter.ro/DownloadQLFC.php 49K ZZip 0.36c :W http://www.via.ecp.fr/~damien/downloads/zzip-win32.zip 35K PPMD var.I, PPmonstr v.I :W ftp://ftp.elf.stuba.sk/pub/pc/pack/ppmdi1.rar 73K PkzipC 4.00 :W ftp://ftp.pkware.com/pkzc400s.exe 3470K PkZip 2.50 :a ftp://ftp.simtel.net/pub/simtelnet/msdos/arcers/pk250dos.exe 202K RK-dos 1.04.1 :e http://rksoft.virtualave.net/downloads/rk104a1d.exe 461K RK 1.04.1 :W http://rksoft.virtualave.net/downloads/rk104a1w.exe 380K BA 1.01b5 :e http://hem.spray.se/mikael.lundqvist/ba101br5.zip 61K BIX 1.00b7 :W http://www.7-zip.org/dl/ufa/bix100b7.zip 89K 777 0.04b1 :W http://www.7-zip.org/dl/ufa/777004b1.zip 72K UFA 0.04b1 :W http://www.7-zip.org/dl/ufa/ufa004b1.zip 64K ArHanGeL 1.40 :a http://geocities.com/SiliconValley/Lab/6606/arh140.zip 50K Imp 1.1 :e http://www.technelysium.com.au/imp110d.zip 266K Imp-win 1.12 :W http://www.technelysium.com.au/imp112.exe 122K ACB 2.00c :e ftp://ftp.simtel.net/pub/simtelnet/msdos/compress/acb_200c.zip 42K BOA 0.58b :e ftp://ftp.elf.stuba.sk/pub/pc/pack/boa058.zip 74K DC 0.98b :W ftp://ftp.elf.stuba.sk/pub/pc/pack/dc124.zip 55K SZip 1.12a :W http://www.compressconsult.com/szip/szip_112a_win32.zip 71K YBS 0.03e :e http://compression.graphicon.ru/ybs/ybs003ed.zip 56K YBS 0.03e :W http://compression.graphicon.ru/ybs/ybs003ew.zip 44K Slim b10 :W http://slim-fb.by.ru/slim0010.zip 22K Bzip2 1.0.2 :W ftp://sources.redhat.com/pub/bzip2/v102/bzip2-102-x86-win32.exe Compressia 0.98b :W http://www.compressia.com/compcl.exe SBC_d 0.969br1 :e http://personal.inet.fi/musiikki/sjm/sbc0969b_dos.zip SBC 0.969br1 :W http://personal.inet.fi/musiikki/sjm/sbc0969b_win32.zip BEE 0.6.3 :W http://compression.graphicon.ru/fa/files2/bee063.rar PPMN_km b4 :W http://compression.graphicon.ru/ms/ppmn_km.rar PPMY 0.3c :W http://compression.graphicon.ru/sh/ppmy_3c.rar 7-Zip 2.30b23 :W http://belnet.dl.sourceforge.net/sevenzip/7z230b23.exe WinRAR 3.00 :W http://www.rarlab.com/rar/wrar300.exe RAR32 3.00 :e http://www.rarlab.com/rar/rarx300.exe :a - any DOS - DOS programs, will run under pure DOS or in a DOS box :e - extender - DOS programs using DOS extenders like DOS/4GW or CWSDPMI :W - windows - Windows95/98/NT/etc programs If direct link doesn't work-most probably newer version of the program appeared at the same site: visit web page, or read the whole directory from ftp server (i.e. try the same URL, but without filename). Homepages: ~~~~~~~~~~ Arhangel : http://geocities.com/SiliconValley/Lab/6606 BA : http://hem.spray.se/mikael.lundqvist Eri32 : http://geocities.com/eri32 mirror : http://artest1.tripod.com RK : http://rksoft.virtualave.net Imp,WinImp : http://www.technelysium.com.au/winimp.html ACE,WinACE : http://www.winace.com PkZip : http://www.pkware.com RAR,WinRAR : http://www.rarlab.com BZip2 : http://sources.redhat.com/bzip2 SZip : http://www.compressconsult.com/szip PPMN : http://compression.graphicon.ru/ms YBS : http://compression.graphicon.ru/ybs SBC : http://sbcarchiver.netfirms.com QLFC : http://ghido.shelter.ro GCAC : http://emit.jp/gca/gca.html PPMy : http://www.pilabs.org.ua/sh ZZip : ? http://www.zzip.f2s.com Compressia : http://www.compressia.com/ Slim : http://slim-fb.by.ru/ Ufa,777, BIX,7-Zip : http://www.7-zip.org What's new: ~~~~~~~~~~~ 12 new programs were tested: PPMd v.I PPMonstr v.I 7-zip 2.30b22 RAR 3.00 BZip2 1.0.2 PPMN_km b4 SBC 0.969b r1 Entropy 0.7 Compressia 0.98b Bee 0.6.3 u1 PPMy 0.3c Slim aug17 7-zip, RAR and BZip2 perform exactly as their previous versions tested in March or earlier. Latest beta versions of Entropy, Slim, DC were available from authors by e-mail request: Entropy: artest@inbox.ru Slim: grayw@secom.lg.ua DC: EdgarBinder@t-online.de Results of BA, ZZip, ACB, 777, GCAC, SZip, QLFC, ArHanGeL, IMP, BICOM, BIX, ACE are in full version only, TEXTS.DAT file. The set of Russian texts is at http://arte.nm.ru/m120 Some old or less efficient programs will not be included next time: 777, UFA, BIX, ACB, BA, PPMy. WARNINGS: ~~~~~~~~~ BA 1.00beta5 can't correctly decompress shaks12.txt and set used for speed measurements. DC 0.99.158b failed to decompress 1DFRE10.dc , ANDES10.dc , and BTI0110.dc, saying "Corrupted block" (while t(est) command writes "Test successful"). ERI 5.1fre can't compress files larger than (free DPMI memory)/6, i.e. about 10Mb on a PC with 64Mb RAM. The largest 44Mb file was split to 5 chunks 9000000 bytes long (last chunk was 8894190 bytes). Problems in all other compressors were not found. The LATEST RELEASE, and all previous versions of these tests can be found at http://geocities.com/SiliconValley/Bay/1995/ and https://artest1.tripod.com/ Send your suggestions, comments to artest@inbox.ru With best kind regards, A.Ratushnyak Back to main ARTest page
The Art of Lossless Data Compression vol. 24t 
