Skip site navigation (1)Skip section navigation (2)
Date:      Sat, 15 Apr 2017 19:06:22 +0000
From:      Alexey Dokuchaev <danfe@FreeBSD.org>
To:        Michael Gmelin <grembo@freebsd.org>
Cc:        ports@FreeBSD.org
Subject:   Re: LLVM port(s) take very long time to package
Message-ID:  <20170415190622.GC99481@FreeBSD.org>
In-Reply-To: <B04AEF51-72A0-4C16-848F-B67F5BD1977D@freebsd.org>
References:  <20170412034308.GA56148@FreeBSD.org> <79A96B5B-8E4C-4E2E-8108-BA4F05CBFA4F@freebsd.org> <20170412093737.GB22201@FreeBSD.org> <2B393FE8-C076-4714-A718-0EDA155A5037@freebsd.org> <20170414142228.GA52898@FreeBSD.org> <B04AEF51-72A0-4C16-848F-B67F5BD1977D@freebsd.org>

next in thread | previous in thread | raw e-mail | index | archive | help
On Fri, Apr 14, 2017 at 04:42:35PM +0200, Michael Gmelin wrote:
> > On 14. Apr 2017, at 16:22, Alexey Dokuchaev <danfe@FreeBSD.org> wrote:
> > On Wed, Apr 12, 2017 at 12:06:42PM +0200, Michael Gmelin wrote:
> >>> On 12. Apr 2017, at 11:37, Alexey Dokuchaev <danfe@FreeBSD.org> wrote:
> >>> ...
> >>> Other alternative to PKG_NOCOMPRESS=1 could be PKGSUFFIX=.tbz
> >>> (pkg-static create -f tbz ...), will play with that as well.
> >> 
> >> I don't think bzip will buy you much in terms of performance,
> > 
> > Surprisingly, it actually did:
> > 
> > $ time make package PKG_SUFX=.tbz
> > ===>  Building package for llvm40-4.0.0_2
> > 565.215u 5.316s 9:34.18 99.3%   7899+502k 1+3020io 0pf+0w
> >                 ^^^^^^^
> > Single-threaded bzip2 was faster than multi-threaded xz [...]
> > of larger package of course:
> 
> Interesting, I'll tried that on our high-frequency builders.

Cool, please share your numbers with us once you have them.

Meanwhile, I've patched my tinderbox to package with PKG_NOCOMPRESS=1 and
then use `archivers/pbzip2' to compress the file.  This cut down the time
to package `devel/llvm40' from previous ~50 minutes to just three without
touching any libarchive(3) or pkg(8) code.  I guess I can live with that
until libarchive(3) and/or pkg(8) gain proper support of multicore-aware
efficient modern compression algorithm(s).

./danfe



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20170415190622.GC99481>