The Art
of Lossless
Data Compression
vol. 24b
Here are the results of tests performed in August 2002 to compare
lossless compression of "binary" files by all known good enough programs
developed for such purpose, including RK, DC, YBS, Bzip2, RAR, ACE and 7-zip.
See Archive Comparison Test by J.Gilchrist for more details:
http://compression.ca
If anybody wants to start or continue such tests,
or can suggest some other sets of files, or other compression programs,
(not sources or algorithm descriptions, executable programs only)
or knows we have missed something important,
(some new fantastic technology, an algorithm or even a program capable
of lossless compression of up to 1000:1 etc.)
please let us know immediately: artest@inbox.ru Thank you!
[[1]] COMPRESSION QUALITY
=========================
(see also
[[2]] Speed
[[3]] Details
[[4]] Comments)
Last eleventh line shows results for the sum of all 5960 files in ten sets.
Original Entropy UHARC PPMonstr RK 7-zip 777 Slim RAR PPMN
257.68% 100% 104.66 101.56 107.16 108.53 109.54 109.25 110.08 109.78
264.52% 100% 102.93 104.25 104.57 104.38 101.98 108.26 109.44 107.91
187.28% 100% 101.06 102.09 103.24 103.26 102.83 104.39 106.01 103.61
346.78% 100% 102.29 113.32 117.47 116.52 121.33 120.26 113.30 125.70
179.82% 100.86 103.11 112.05 111.76 114.98 115.23 108.61 108.24 115.96
393.85% 100% 102.06 101.25 101.74 108.34 109.35 115.75 117.06 117.56
198.15% 100% 103.32 103.66 104.55 103.53 105.74 106.01 108.97 105.68
268.20% 100% 100.24 100.31 101.15 102.28 104.42 109.55 107.13 110.68
237.23% 100% 103.15 103.90 104.30 104.87 104.73 106.60 108.08 105.73
371.66% 100% 106.00 102.67 105.32 107.69 111.36 114.84 118.66 115.55
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
246.50% 100% 102.51 103.77 105.26 106.18 106.83 108.47 109.25 109.31
SBC Compressia ACE BEE PPMd ERI IMP DC BZip2 Pkzip
113.67 111.16 112.74 111.58 112.21 116.94 118.71 114.17 121.17 125.37
111.05 117.82 110.39 111.72 113.25 116.72 112.32 120.04 124.14 131.99
106.33 106.03 106.26 106.92 108.11 109.71 107.52 111.40 113.64 112.97
115.05 120.78 127.34 121.74 125.41 120.90 123.25 122.64 138.61 155.89
100% 108.56 107.23 117.45 119.50 104.06 119.90 110.52 120.53 127.93
122.77 120.73 120.28 118.04 118.01 127.87 126.85 122.09 131.89 133.52
107.57 105.30 109.95 108.16 110.25 111.05 111.00 112.32 117.13 119.63
109.91 111.50 108.71 113.43 114.34 113.03 119.90 113.97 122.04 125.31
109.40 108.77 108.98 109.87 111.51 112.15 110.19 114.30 118.39 119.62
118.57 113.26 119.61 116.93 119.56 126.73 126.36 127.45 135.84 140.91
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
109.83 110.68 110.89 111.68 113.18 113.94 114.83 115.22 121.24 124.95
[[2]] Speed
===========
4th set, all from ftp://ftp.simtel.net/pub/simtelnet/win95/graphics/sface10.zip
was used for this test, and a 970MHz PC with 256Mb RAM and Windows98.
Programs, Compression/ Overall Average Users' Compressed
options Extraction, Score Score Size
seconds seconds, % seconds, % bytes , %
no compression 0 0 7613 392 7613 419 27408516 422
777 a -mg 727 401 3792 195 3072 169 9586586 148
777 a -mg -mu32 735 405 3804 196 3076 169 9588918 148
7za a -t7z 70 4 2783 143 2714 149 9752090 150
7za a -t7z -mx 127 4 2616 135 2491 137 8948766 138
7za a -tzip 23 2 3388 174 3365 185 12104526 186
7za a -tzip -mx 56 2 3409 175 3353 184 12062635 186
acb B 412 414 3723 191 3315 182 10426759 161
acb b 581 583 4013 206 3438 189 10254633 158
ace32 a -d4096 57 3 2600 134 2543 140 9141767 141
ace32 a -d4096 -m1 48 3 2604 134 2557 141 9190071 142
ace32 a -d4096 -m5 62 3 2610 134 2548 140 9158751 141
arh a -2 -mm 197 184 3213 165 3018 166 10196406 157
arh a -1 -mm 28 6 2986 154 2958 163 10625915 164
arh a -2 -1 304 203 3676 189 3375 186 11408516 176
ba -k -50 47 25 3016 155 2970 163 10601804 163
ba -k 38 23 2974 153 2936 161 10487070 162
ba -k -10 38 23 2937 151 2899 159 10353984 160
bee a -m1 209 202 3298 170 3090 170 10390747 160
bee a -m2 374 367 3422 176 3052 168 9651819 149
bee a -m3 -s 649 697 3971 204 3328 183 9450207 146
bix a 68 4 3020 155 2953 162 10612578 164
bix a -mdg 74 2 2999 154 2926 161 10524303 162
bix a -mdg -s 99 2 2822 145 2723 150 9792685 151
boa -m1 236 227 3624 186 3390 186 11379129 175
boa -m15 690 616 4186 215 3503 193 10368786 160
boa -m15 -s 696 617 4191 216 3502 193 10359887 160
bzip2 -k 33 10 3130 161 3098 170 11112953 171
bzip2 -k -5 31 10 3132 161 3101 171 11126137 171
bzip2 -k -9 33 10 3130 161 3098 170 11112953 171
ery-e b o12 261 275 2745 141 2487 137 7953204 123
ery-e b o16 260 278 2740 141 2483 137 7928059 122
ery-e b o32 270 287 2753 142 2486 137 7907407 122
ery-e b o64 301 307 2804 144 2506 138 7903715 122
compcl c -b15 51 42 2744 141 2694 148 9544827 147
compcl c -b15 -s 51 42 2743 141 2693 148 9540017 147
dc e 108 14 2797 144 2690 148 9630736 148
dc e -b16300 131 14 2337 120 2207 121 7888232 122
dc e -b16300 -mb5 130 14 2335 120 2207 121 7888421 122
eri a 55 31 2782 143 2727 150 9706022 150
eri a -m3 85 38 2777 143 2693 148 9555684 147
eri a -m6 86 38 2785 143 2700 149 9582523 148
gcac a 44 17 2898 149 2854 157 10212208 157
gcac s 45 18 2935 151 2890 159 10337588 159
imp98 a -mm 33 1 2749 141 2716 149 9770169 151
imp98 a -mm -m3 53 1 2757 142 2705 149 9730287 150
imp98 a -mm -s4 34 4 2753 142 2720 150 9775588 151
pkzip -es 3 1 3952 203 3949 217 14212209 219
pkzip -a 6 1 3437 177 3431 189 12347196 190
pkzip -exx 7 1 3431 176 3423 188 12320267 190
ppmdi e -o12 -m232 53 57 2868 148 2816 155 9930336 153
ppmdi e -o16 -m232 55 58 2866 147 2812 155 9911769 153
ppmn_km e -o6 -M:50 217 219 3150 162 2935 161 9772905 151
ppmn_km e -o7 -M:50 237 239 3188 164 2953 162 9760047 150
ppmn_km e -o8 -M:50 245 246 3183 164 2941 162 9692957 149
ppmn_km e -o9 -M:50 245 246 3185 164 2943 162 9697928 149
ppmonstr e -o12 -m250 276 288 3063 158 2790 153 8996048 139
ppmonstr e -o16 -m250 279 301 3073 158 2797 154 8974666 138
ppmonstr e -o128 -m250 644 703 3834 197 3196 176 8954077 138
ppmy /o6 /m220 2874 2746 8698 447 5852 322 11078479 171
ppmy /o7 /m220 2619 2647 8549 440 5956 328 11819257 182
ppmy /o8 /m220 2572 2598 8596 442 6050 333 12335730 190
qlfc a 31 19 3019 155 2988 164 10689214 165
rar a -m5 -s 73 5 2373 122 2301 127 8260230 127
rar a -mc16:128t -s 49 6 2354 121 2305 127 8275443 127
rar a -mc16:128t+ -s 68 47 2399 123 2332 128 8222366 127
rk -mf3 128 73 2815 145 2688 148 9410064 145
rk -mx1 498 499 3672 189 3179 175 9627044 148
rk -mx3 844 845 4074 210 3238 178 8584928 132
sbc c -m3 64 21 2181 112 2118 116 7548923 116
sbc c -m3 -b63 74 21 2192 113 2119 117 7548878 116
sbc c -ad -b63 59 26 2193 113 2134 117 7587006 117
slim a -d32 -w22 1940 1954 6487 334 4567 251 9336416 144
slim a -d16 -w22 1936 1972 6500 334 4584 252 9333547 144
slim a -d8 -w22 1948 2017 6556 337 4627 254 9328191 144
slim a -d4 -w22 1923 1922 6435 331 4531 249 9322631 144
szip -o4 15 20 3163 163 3149 173 11262438 174
szip -o8 -b41 53 24 3042 156 2989 164 10671420 164
ufa a -mg 234 39 3023 155 2792 154 9900254 153
ufa a -mg -mu32 242 43 3036 156 2796 154 9902586 153
ufa a -mg -s 352 25 3164 163 2815 155 10030871 155
uharc a -m1 -md32768 103 14 1944 100 1842 101 6577686 101
uharc a -m2 -md32768 128 14 1954 100 1827 100 6522084 100
uharc a -m3 -md32768 143 14 1960 101 1818 100 6490844 100
uharc a -mz -md32768 23 25 2638 136 2616 144 9325552 144
uharc a -mx -md32768 160 136 2138 110 1979 109 6626726 102
ybs -m15mu 49 17 2693 139 2644 145 9457129 146
ybs -m15mu -r 52 17 2690 138 2639 145 9436857 145
zzip a -a 38 20 2946 152 2909 160 10398266 160
zzip a -mx -mm 40 22 2814 145 2774 153 9907114 153
zzip a -mx -30m 43 23 2976 153 2934 161 10478036 161
Overall score is calculated by adding compression time, extraction time, and
time it would take to transfer the compressed file over a 28,800bps network:
(compressed_size)/3600
Average Users' score is calculated by adding (compress_time/10)+ extract_time +
time it would take to transfer the compressed file over a 28,800bps network.
Compression time is divided by 10 here, because more than 90% of people would
never compress anything during their life (with compression programs), but they
use compressed data almost _every_ time they use computers and/or Internet.
That's why compression time is not so actual for them.
[[3]] Details
=============
are no longer put to this main text
(6290 lines reporting 238840 results on 5960 files in 10 sets),
but can be found in FULL version with BINARIES.DAT and *.BAT
at http://geocities.com/SiliconValley/Bay/1995/artest24.zip
or https://artest1.tripod.com/artest24.zip
[[4]] Comments
==============
Links to download programs:
~~~~~~~~~~~~~~~~~~~~~~~~~~~
ACE 2.04 :W http://winace.host.sk/ace204.exe 593K
ERI 5.1fre :e http://geocities.com/eri32/eri51fre.zip 89K
GCac 0.9k :W http://www.emit.jp/gca/gca_v09k.exe 295K
UHArc 0.4b :eW ftp://ftp.elf.stuba.sk/pub/pc/pack/uharc04.zip 220K
QLFC 6.6W :W http://ghido.shelter.ro/DownloadQLFC.php 49K
ZZip 0.36c :W http://www.via.ecp.fr/~damien/downloads/zzip-win32.zip 35K
PPMD var.I,
PPmonstr v.I :W ftp://ftp.elf.stuba.sk/pub/pc/pack/ppmdi1.rar 73K
PkzipC 4.00 :W ftp://ftp.pkware.com/pkzc400s.exe 3470K
PkZip 2.50 :a ftp://ftp.simtel.net/pub/simtelnet/msdos/arcers/pk250dos.exe 202K
RK-dos 1.04.1 :e http://rksoft.virtualave.net/downloads/rk104a1d.exe 461K
RK 1.04.1 :W http://rksoft.virtualave.net/downloads/rk104a1w.exe 380K
BA 1.01b5 :e http://hem.spray.se/mikael.lundqvist/ba101br5.zip 61K
BIX 1.00b7 :W http://www.7-zip.org/dl/ufa/bix100b7.zip 89K
777 0.04b1 :W http://www.7-zip.org/dl/ufa/777004b1.zip 72K
UFA 0.04b1 :W http://www.7-zip.org/dl/ufa/ufa004b1.zip 64K
ArHanGeL 1.40 :a http://geocities.com/SiliconValley/Lab/6606/arh140.zip 50K
Imp 1.1 :e http://www.technelysium.com.au/imp110d.zip 266K
Imp-win 1.12 :W http://www.technelysium.com.au/imp112.exe 122K
ACB 2.00c :e ftp://ftp.simtel.net/pub/simtelnet/msdos/compress/acb_200c.zip 42K
BOA 0.58b :e ftp://ftp.elf.stuba.sk/pub/pc/pack/boa058.zip 74K
DC 0.98b :W ftp://ftp.elf.stuba.sk/pub/pc/pack/dc124.zip 55K
SZip 1.12a :W http://www.compressconsult.com/szip/szip_112a_win32.zip 71K
YBS 0.03e :e http://compression.graphicon.ru/ybs/ybs003ed.zip 56K
YBS 0.03e :W http://compression.graphicon.ru/ybs/ybs003ew.zip 44K
Slim b10 :W http://slim-fb.by.ru/slim0010.zip 22K
Bzip2 1.0.2 :W ftp://sources.redhat.com/pub/bzip2/v102/bzip2-102-x86-win32.exe
Compressia 0.98b :W http://www.compressia.com/compcl.exe
SBC_d 0.969br1 :e http://personal.inet.fi/musiikki/sjm/sbc0969b_dos.zip
SBC 0.969br1 :W http://personal.inet.fi/musiikki/sjm/sbc0969b_win32.zip
BEE 0.6.3 :W http://compression.graphicon.ru/fa/files2/bee063.rar
PPMN_km b4 :W http://compression.graphicon.ru/ms/ppmn_km.rar
PPMY 0.3c :W http://compression.graphicon.ru/sh/ppmy_3c.rar
7-Zip 2.30b23 :W http://belnet.dl.sourceforge.net/sevenzip/7z230b23.exe
WinRAR 3.00 :W http://www.rarlab.com/rar/wrar300.exe
RAR32 3.00 :e http://www.rarlab.com/rar/rarx300.exe
:a - any DOS - DOS programs, will run under pure DOS or in a DOS box
:e - extender - DOS programs using DOS extenders like DOS/4GW or CWSDPMI
:W - windows - Windows95/98/NT/etc programs
If direct link doesn't work-most probably newer version of the program appeared
at the same site: visit web page, or read the whole directory from ftp server
(i.e. try the same URL, but without filename).
Homepages:
~~~~~~~~~~
Arhangel : http://geocities.com/SiliconValley/Lab/6606
BA : http://hem.spray.se/mikael.lundqvist
Eri32 : http://geocities.com/eri32
mirror : http://artest1.tripod.com
RK : http://rksoft.virtualave.net
Imp,WinImp : http://www.technelysium.com.au/winimp.html
ACE,WinACE : http://www.winace.com
PkZip : http://www.pkware.com
RAR,WinRAR : http://www.rarlab.com
BZip2 : http://sources.redhat.com/bzip2
SZip : http://www.compressconsult.com/szip
PPMN : http://compression.graphicon.ru/ms
YBS : http://compression.graphicon.ru/ybs
SBC : http://sbcarchiver.netfirms.com
QLFC : http://ghido.shelter.ro
GCAC : http://emit.jp/gca/gca.html
PPMy : http://www.pilabs.org.ua/sh
ZZip : ? http://www.zzip.f2s.com
Compressia : http://www.compressia.com/
Slim : http://slim-fb.by.ru/
Ufa,777,
BIX,7-Zip : http://www.7-zip.org
What's new:
~~~~~~~~~~~
12 new programs were tested:
PPMd v.I
PPMonstr v.I
7-zip 2.30b22
RAR 3.00
BZip2 1.0.2
PPMN_km b4
SBC 0.969b r1
Entropy 0.7
Compressia 0.98b
Bee 0.6.3 u1
PPMy 0.3c
Slim aug17
7-zip, RAR and BZip2 perform exactly as their previous versions
tested in March or earlier.
Latest beta versions of Entropy, Slim, DC were available
from authors by e-mail request:
Entropy: artest@inbox.ru
Slim: grayw@secom.lg.ua
DC: EdgarBinder@t-online.de
Results of BOA, ZZip, GCAC, YBS, BA, Arhangel, SZip, QLFC, PPMy,
7-zip with .zip format are in full version only, BINARIES.DAT file.
FULL version contains all *.BAT and *.DAT files
you'll need to build 10 directories with 5960 files (artest24.zip\COOK_SET\*.*)
and to repeat all our tests (BINS.BAT, BINARIES.DAT).
Some old or less efficient programs will not be included next time:
777, UFA, BIX, ACB, BA, PPMy.
WARNINGS:
~~~~~~~~~
BA 1.00beta5 can't losslessly decompress many files: CUN5IF~1.bin, CUN6IF~1 etc
It types nothing like "CRC fails".
DC 0.99.158b fails to decompress HLPCOPY..bin, but only if you compress
with "-mb5" switch and [