Skip site navigation (1)Skip section navigation (2)
Date:      Thu, 13 Apr 2017 17:42:32 +0000
From:      Alexey Dokuchaev <danfe@FreeBSD.org>
To:        Jan Beich <jbeich@FreeBSD.org>
Cc:        Michael Gmelin <grembo@freebsd.org>, ports@FreeBSD.org
Subject:   Re: LLVM port(s) take very long time to package
Message-ID:  <20170413174232.GA31071@FreeBSD.org>
In-Reply-To: <mvbl-g1eq-wny@FreeBSD.org>
References:  <20170412034308.GA56148@FreeBSD.org> <79A96B5B-8E4C-4E2E-8108-BA4F05CBFA4F@freebsd.org> <mvbl-g1eq-wny@FreeBSD.org>

next in thread | previous in thread | raw e-mail | index | archive | help
On Wed, Apr 12, 2017 at 04:12:45PM +0200, Jan Beich wrote:
> Michael Gmelin <grembo@freebsd.org> writes:
> > It's probably busy compressing the package. Try setting
> > PKG_NOCOMPRESS=1 in /etc/make.conf (works ok when just building a
> > package with make, didn't test with poudriere[0]). When creating
> > packages, the current compression algorithm can't take advantage of
> > multiple cores, so it's kind of a bottleneck on modern machines.
> 
> Nah, libarchive just defaults to 1 thread instead of using hw.ncpu.
> The tricky part is propagating the fix into old releases or setting
> compression options from within pkg(8).

Nice, I've rebuilt pkg(8) against patched libarchive, and run `make
package' for devel/llvm40:

$ make
...
$ time make package
===>  Building package for llvm40-4.0.0_2
2029.111u 6.614s 11:03.25 306.9%        7884+502k 4+2240io 1pf+0w
$ xzcat -t llvm40-4.0.0_2.txz ; echo $?
0

It went down from ~50 minutes to eleven on a 4-core APU.  I've filed an
issue on GitHub:

	https://github.com/freebsd/pkg/issues/1564

./danfe



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20170413174232.GA31071>