From owner-freebsd-ports@freebsd.org Wed Apr 12 10:06:46 2017 Return-Path: Delivered-To: freebsd-ports@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 64D3ED3AB9C for ; Wed, 12 Apr 2017 10:06:46 +0000 (UTC) (envelope-from grembo@freebsd.org) Received: from mailman.ysv.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 54518997 for ; Wed, 12 Apr 2017 10:06:46 +0000 (UTC) (envelope-from grembo@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 539B7D3AB9B; Wed, 12 Apr 2017 10:06:46 +0000 (UTC) Delivered-To: ports@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 53414D3AB9A for ; Wed, 12 Apr 2017 10:06:46 +0000 (UTC) (envelope-from grembo@freebsd.org) Received: from mail.grem.de (outcast.grem.de [213.239.217.27]) by mx1.freebsd.org (Postfix) with SMTP id AFEB5991 for ; Wed, 12 Apr 2017 10:06:45 +0000 (UTC) (envelope-from grembo@freebsd.org) Received: (qmail 6878 invoked by uid 89); 12 Apr 2017 10:06:43 -0000 Received: from unknown (HELO ?192.168.100.239?) (mg@grem.de@195.30.121.97) by mail.grem.de with ESMTPA; 12 Apr 2017 10:06:43 -0000 Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (1.0) Subject: Re: LLVM port(s) take very long time to package From: Michael Gmelin X-Mailer: iPhone Mail (14E304) In-Reply-To: <20170412093737.GB22201@FreeBSD.org> Date: Wed, 12 Apr 2017 12:06:42 +0200 Cc: ports@FreeBSD.org Content-Transfer-Encoding: quoted-printable Message-Id: <2B393FE8-C076-4714-A718-0EDA155A5037@freebsd.org> References: <20170412034308.GA56148@FreeBSD.org> <79A96B5B-8E4C-4E2E-8108-BA4F05CBFA4F@freebsd.org> <20170412093737.GB22201@FreeBSD.org> To: Alexey Dokuchaev X-BeenThere: freebsd-ports@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Porting software to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 12 Apr 2017 10:06:46 -0000 > On 12. Apr 2017, at 11:37, Alexey Dokuchaev wrote: >=20 > On Wed, Apr 12, 2017 at 10:43:14AM +0200, Michael Gmelin wrote: >>> On 12. Apr 2017, at 05:43, Alexey Dokuchaev wrote: >>> ... >>> pkg was eating 100% (of a single core) during that time, so it looks >>> like it's actually busy (not waiting for I/O or something), but with >>> what? And can it be fixed? LLVM ports are real PITA to (re)build, >>> and while ccache helps to greatly reduce the build times, 3/4-hour >>> package time still cripples it. >>=20 >> It's probably busy compressing the package. Try setting PKG_NOCOMPRESS=3D= 1 >> in /etc/make.conf (works ok when just building a package with make, >> didn't test with poudriere[0]). When creating packages, the current >> compression algorithm can't take advantage of multiple cores, so it's >> kind of a bottleneck on modern machines. >=20 > That is my current best guest as well, but I could not confirm it because > /usr/local/sbin/pkg-static is stripped by default and I could not see any > function names when I attached gdb(1) to it. Will rebuild pkg(8) shortly > WITH_DEBUG to get more information. >=20 > Other alternative to PKG_NOCOMPRESS=3D1 could be PKGSUFFIX=3D.tbz (pkg-sta= tic > create -f tbz ...), will play with that as well. I don't think bzip will buy you much in terms of performance, supporting som= ething like lz4 would be useful. -m