From owner-freebsd-ports@FreeBSD.ORG Sun Dec 5 16:03:57 2010 Return-Path: Delivered-To: freebsd-ports@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 59EEA106564A for ; Sun, 5 Dec 2010 16:03:57 +0000 (UTC) (envelope-from itetcu@FreeBSD.org) Received: from worf.ds9.tecnik93.com (worf.ds9.tecnik93.com [81.196.207.130]) by mx1.freebsd.org (Postfix) with ESMTP id E7CEF8FC0A for ; Sun, 5 Dec 2010 16:03:56 +0000 (UTC) Received: from it.buh.tecnik93.com (unknown [188.26.230.56]) (using TLSv1 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by worf.ds9.tecnik93.com (Postfix) with ESMTPSA id 80CC722C5430; Sun, 5 Dec 2010 18:03:55 +0200 (EET) Date: Sun, 5 Dec 2010 18:03:54 +0200 From: Ion-Mihai Tetcu To: Volodymyr Kostyrko Message-ID: <20101205180354.085e5b04@it.buh.tecnik93.com> In-Reply-To: <4CF95C27.4030507@gmail.com> References: <4CF38D7F.6070206@gmx.de> <4CF3F16E.3020501@DataIX.net> <4CF439F1.6050703@gmx.de> <4CF95C27.4030507@gmail.com> X-Mailer: Claws Mail 3.7.6 (GTK+ 2.22.1; amd64-portbld-freebsd8.1) Mime-Version: 1.0 Content-Type: multipart/signed; micalg=PGP-SHA1; boundary="Sig_/iI3yj2v0Qndyp/.VL+Z1tcR"; protocol="application/pgp-signature" Cc: Matthias Andree , freebsd-ports@freebsd.org, Julien Laffaye Subject: Re: packages compressed with xz X-BeenThere: freebsd-ports@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Porting software to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 05 Dec 2010 16:03:57 -0000 --Sig_/iI3yj2v0Qndyp/.VL+Z1tcR Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: quoted-printable On Fri, 03 Dec 2010 23:07:51 +0200 Volodymyr Kostyrko wrote: > 30.11.2010 04:40, Julien Laffaye wrote: > > You can specify limits during compression, so the question is > > should we do that so that hosts with N MB of RAM can decompress > > packages? Do we retain the compression ratio over bzip2 if we > > limit compression memory to 512 MB so that decompression would be > > possible with, say, 128 MB? > > > > According to xz(1), in its default mode (-6), xz uses ~100MiB for > > compression and ~10MiB for decompression. > > That seems to be acceptable. >=20 > You possibly miss something about compression/decompression. >=20 > The designated memory size is not directly affected only by > compression mode. When decompressing you will need memory for: >=20 > 1. Data history. > 2. Dictionary. > 3. Some indexes. >=20 > And those ones are all empty at start. So say, if you are compressing=20 > something really huge trying to use 4G of memory you end using that > much memory between 2G - 3G of source data. And we will need 512MB to=20 > decompress that hunk of data. >=20 > Are the packages _that_ large? [ .. ] The biggest package that can be produced by a port it's a bit over 10G. --=20 IOnut - Un^d^dregistered ;) FreeBSD "user" "Intellectual Property" is nowhere near as valuable as "Intellect" FreeBSD committer -> itetcu@FreeBSD.org, PGP Key ID 057E9F8B493A297B --Sig_/iI3yj2v0Qndyp/.VL+Z1tcR Content-Type: application/pgp-signature; name=signature.asc Content-Disposition: attachment; filename=signature.asc -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.16 (FreeBSD) iEYEARECAAYFAkz7t+oACgkQJ7GIuiH/oeVV/wCfWWHeZRc6ORruSJwl3hHe8CTZ QC8AniUjslXCuonYZjBM5D1wgaK7ZQcU =KSo4 -----END PGP SIGNATURE----- --Sig_/iI3yj2v0Qndyp/.VL+Z1tcR--