Date: Sun, 23 Jan 2000 21:30:23 -0800 From: "David O'Brien" <obrien@FreeBSD.ORG> To: Dag-Erling Smorgrav <des@flood.ping.uio.no> Cc: freebsd-current@FreeBSD.ORG Subject: Re: bzip2 in src tree (Was Re: ports/16252: bsd.port.mk: Add bzip2 support for distribution patches) Message-ID: <20000123213022.B44712@dragon.nuxi.com> In-Reply-To: <xzp7lh0lhlj.fsf@flood.ping.uio.no>; from des@flood.ping.uio.no on Sun, Jan 23, 2000 at 08:21:12PM %2B0100 References: <Pine.BSF.4.21.0001221703020.4454-100000@localhost> <200001230222.SAA18355@salsa.gv.tsc.tdk.com> <20000123141413.A49567@keltia.freenix.fr> <xzp7lh0lhlj.fsf@flood.ping.uio.no>
next in thread | previous in thread | raw e-mail | index | archive | help
On Sun, Jan 23, 2000 at 08:21:12PM +0100, Dag-Erling Smorgrav wrote:
Taking my 243662 KB ~/Mail:
gzip -9 every file: 80420 KB
bzip2 -9 every file: 70034 KB
tar ~/Mail and gzip -9: 78840 KB (4m37s)
tar ~/Mail and bzip2 -9: 68960 KB (14m29s)
Who cares if it took longer, I enjoy the better compression and I'm not
running Winloose, so I actually *CAN* run this in the background. I
certainly was not idle while Bzip2 was compressing.
> Using it for one-shot compression (e.g. compressing
> backup archives, or in a gather-compress-transfer-decompress-process
> pipeline to save bandwidth) is downright stupid unless the cost of
> storing or transferring the compressed data is unusually high.
Feh. Your opinion. Why is it stupid? When is the cost of transfer not
high? Most at home only have 53Kbps download speed. I can start the
compression of what I want to take home before I leave the lab, by the
time I'm home, it is done and I start the download.
I Bzip2 *everything*. When I moved to Bzip2 a year ago, I bzip2'ed and
gzip'ed every to keep the smaller of the two. Only 2% of my bzip2'ed
files were larger. I don't ever bother comparing anymore.
> Not only is it slower (and more memory-hungry), but it was designed and
> optimized for compressing text. The less text-like the input is, the
> worse bzip2 fares;
Lets look at the Ports distfiles on the FreeBSD CDROM:
I grabbed a few -- the kde stuff, GCC, qt, rxvt, tin, xchat:
the BZIP'ed versions = 35625 Kbytes
the GZIP'ed versions = 47593 Kbytes
a savings of 11MB on a small sample size. The 3.1 CDROM set had 946M of
packages. If these had been bzip2'ed, it would have taken 843M.
[ BTW, while downloading the KDE files looks like I was saving
significant download time (and this was over 10Mbit Ethernet over an OC3
pipe to the Internet)]
kdeadmin-1.1.2.tar.bz2: 722195 bytes received in 26.38 seconds, 26.73 kB/s.
kdeadmin-1.1.2.tar.gz: 1175621 bytes received in 44.44 seconds, 25.84 kB/s.
kdebase-1.1.2.tar.bz2: 7181379 bytes received in 219.63 seconds, 31.93 kB/s.
kdebase-1.1.2.tar.gz: 9178899 bytes received in 416.31 seconds, 21.53 kB/s.
kdegames-1.1.2.tar.bz2: 2268814 bytes received in 82.58 seconds, 26.83 kB/s.
kdegames-1.1.2.tar.gz: 2965071 bytes received in 136.58 seconds, 21.20 kB/s.
kdegraphics-1.1.2.tar.bz2: 1759634 bytes received in 69.06 seconds, 24.88 kB/s.
kdegraphics-1.1.2.tar.gz: 2595697 bytes received in 92.14 seconds, 27.51 kB/s.
kdelibs-1.1.2.tar.bz2: 1436365 bytes received in 44.88 seconds, 31.26 kB/s.
kdelibs-1.1.2.tar.gz: 2001196 bytes received in 69.84 seconds, 27.98 kB/s.
kdemultimedia-1.1.2.tar.bz2: 1543683 bytes received in 46.02 seconds, 32.76 kB/
kdemultimedia-1.1.2.tar.gz: 2034164 bytes received in 61.22 seconds, 32.45 kB/s
kdenetwork-1.1.2.tar.bz2: 2926118 bytes received in 95.69 seconds, 29.86 kB/s.
kdenetwork-1.1.2.tar.gz: 4515573 bytes received in 154.57 seconds, 28.53 kB/s.
kdesupport-1.1.2.tar.bz2: 979489 bytes received in 34.06 seconds, 28.08 kB/s.
kdesupport-1.1.2.tar.gz: 1209234 bytes received in 30.06 seconds, 39.29 kB/s.
kdetoys-1.1.2.tar.bz2: 318167 bytes received in 16.68 seconds, 18.63 kB/s.
kdetoys-1.1.2.tar.gz: 378929 bytes received in 9.23 seconds, 40.09 kB/s.
kdeutils-1.1.2.tar.bz2: 1603520 bytes received in 41.20 seconds, 38.01 kB/s.
kdeutils-1.1.2.tar.gz: 2409082 bytes received in 63.95 seconds, 36.79 kB/s.
korganizer-1.1.2.tar.bz2: 737251 bytes received in 27.96 seconds, 25.75 kB/s.
korganizer-1.1.2.tar.gz: 922786 bytes received in 19.96 seconds, 45.14 kB/s.
--
-- David (obrien@NUXI.com)
To Unsubscribe: send mail to majordomo@FreeBSD.org
with "unsubscribe freebsd-current" in the body of the message
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20000123213022.B44712>