Skip site navigation (1)Skip section navigation (2)
Date:      Wed, 12 Apr 2017 12:06:42 +0200
From:      Michael Gmelin <grembo@freebsd.org>
To:        Alexey Dokuchaev <danfe@FreeBSD.org>
Cc:        ports@FreeBSD.org
Subject:   Re: LLVM port(s) take very long time to package
Message-ID:  <2B393FE8-C076-4714-A718-0EDA155A5037@freebsd.org>
In-Reply-To: <20170412093737.GB22201@FreeBSD.org>
References:  <20170412034308.GA56148@FreeBSD.org> <79A96B5B-8E4C-4E2E-8108-BA4F05CBFA4F@freebsd.org> <20170412093737.GB22201@FreeBSD.org>

next in thread | previous in thread | raw e-mail | index | archive | help


> On 12. Apr 2017, at 11:37, Alexey Dokuchaev <danfe@FreeBSD.org> wrote:
>=20
> On Wed, Apr 12, 2017 at 10:43:14AM +0200, Michael Gmelin wrote:
>>> On 12. Apr 2017, at 05:43, Alexey Dokuchaev <danfe@FreeBSD.org> wrote:
>>> ...
>>> pkg was eating 100% (of a single core) during that time, so it looks
>>> like it's actually busy (not waiting for I/O or something), but with
>>> what?  And can it be fixed?  LLVM ports are real PITA to (re)build,
>>> and while ccache helps to greatly reduce the build times, 3/4-hour
>>> package time still cripples it.
>>=20
>> It's probably busy compressing the package. Try setting PKG_NOCOMPRESS=3D=
1
>> in /etc/make.conf (works ok when just building a package with make,
>> didn't test with poudriere[0]). When creating packages, the current
>> compression algorithm can't take advantage of multiple cores, so it's
>> kind of a bottleneck on modern machines.
>=20
> That is my current best guest as well, but I could not confirm it because
> /usr/local/sbin/pkg-static is stripped by default and I could not see any
> function names when I attached gdb(1) to it.  Will rebuild pkg(8) shortly
> WITH_DEBUG to get more information.
>=20
> Other alternative to PKG_NOCOMPRESS=3D1 could be PKGSUFFIX=3D.tbz (pkg-sta=
tic
> create -f tbz ...), will play with that as well.

I don't think bzip will buy you much in terms of performance, supporting som=
ething like lz4 would be useful.

-m





Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?2B393FE8-C076-4714-A718-0EDA155A5037>