Skip site navigation (1)Skip section navigation (2)
Date:      Sun, 5 Dec 2010 18:03:54 +0200
From:      Ion-Mihai Tetcu <itetcu@FreeBSD.org>
To:        Volodymyr Kostyrko <c.kworr@gmail.com>
Cc:        Matthias Andree <matthias.andree@gmx.de>, freebsd-ports@freebsd.org, Julien Laffaye <jlaffaye@freebsd.org>
Subject:   Re: packages compressed with xz
Message-ID:  <20101205180354.085e5b04@it.buh.tecnik93.com>
In-Reply-To: <4CF95C27.4030507@gmail.com>
References:  <AANLkTimHL9_qj3nB0jCvH_rah5JZBzEroz_J_Ou-TH52@mail.gmail.com> <4CF38D7F.6070206@gmx.de> <4CF3F16E.3020501@DataIX.net> <4CF439F1.6050703@gmx.de> <AANLkTikUvDkw3o-mY1sCnkXQsVt10rUcVcqqbYN7oMvN@mail.gmail.com> <4CF95C27.4030507@gmail.com>

next in thread | previous in thread | raw e-mail | index | archive | help
--Sig_/iI3yj2v0Qndyp/.VL+Z1tcR
Content-Type: text/plain; charset=US-ASCII
Content-Transfer-Encoding: quoted-printable

On Fri, 03 Dec 2010 23:07:51 +0200
Volodymyr Kostyrko <c.kworr@gmail.com> wrote:

> 30.11.2010 04:40, Julien Laffaye wrote:
> > You can specify limits during compression, so the question is
> > should we do that so that hosts with N MB of RAM can decompress
> > packages?  Do we retain the compression ratio over bzip2 if we
> > limit compression memory to 512 MB so that decompression would be
> > possible with, say, 128 MB?
> >
> > According to xz(1), in its default mode (-6), xz uses ~100MiB for
> > compression and ~10MiB for decompression.
> > That seems to be acceptable.
>=20
> You possibly miss something about compression/decompression.
>=20
> The designated memory size is not directly affected only by
> compression mode. When decompressing you will need memory for:
>=20
> 1. Data history.
> 2. Dictionary.
> 3. Some indexes.
>=20
> And those ones are all empty at start. So say, if you are compressing=20
> something really huge trying to use 4G of memory you end using that
> much memory between 2G - 3G of source data. And we will need 512MB to=20
> decompress that hunk of data.
>=20
> Are the packages _that_ large?
 [ .. ]

The biggest package that can be produced by a port it's a bit over 10G.

--=20
IOnut - Un^d^dregistered ;) FreeBSD "user"
  "Intellectual Property" is   nowhere near as valuable   as "Intellect"
FreeBSD committer -> itetcu@FreeBSD.org, PGP Key ID 057E9F8B493A297B

--Sig_/iI3yj2v0Qndyp/.VL+Z1tcR
Content-Type: application/pgp-signature; name=signature.asc
Content-Disposition: attachment; filename=signature.asc

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.16 (FreeBSD)

iEYEARECAAYFAkz7t+oACgkQJ7GIuiH/oeVV/wCfWWHeZRc6ORruSJwl3hHe8CTZ
QC8AniUjslXCuonYZjBM5D1wgaK7ZQcU
=KSo4
-----END PGP SIGNATURE-----

--Sig_/iI3yj2v0Qndyp/.VL+Z1tcR--



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20101205180354.085e5b04>