From owner-freebsd-ports@freebsd.org  Fri Apr 14 14:22:29 2017
Return-Path: <owner-freebsd-ports@freebsd.org>
Delivered-To: freebsd-ports@mailman.ysv.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 by mailman.ysv.freebsd.org (Postfix) with ESMTP id D09CBD3DBD8
 for <freebsd-ports@mailman.ysv.freebsd.org>;
 Fri, 14 Apr 2017 14:22:29 +0000 (UTC)
 (envelope-from danfe@freebsd.org)
Received: from mailman.ysv.freebsd.org (unknown [127.0.1.3])
 by mx1.freebsd.org (Postfix) with ESMTP id BF2F29EA
 for <freebsd-ports@freebsd.org>; Fri, 14 Apr 2017 14:22:29 +0000 (UTC)
 (envelope-from danfe@freebsd.org)
Received: by mailman.ysv.freebsd.org (Postfix)
 id BE739D3DBD7; Fri, 14 Apr 2017 14:22:29 +0000 (UTC)
Delivered-To: ports@mailman.ysv.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 by mailman.ysv.freebsd.org (Postfix) with ESMTP id BE15DD3DBD6
 for <ports@mailman.ysv.freebsd.org>; Fri, 14 Apr 2017 14:22:29 +0000 (UTC)
 (envelope-from danfe@freebsd.org)
Received: from freefall.freebsd.org (freefall.freebsd.org
 [IPv6:2610:1c1:1:6074::16:84])
 (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
 (Client CN "freefall.freebsd.org",
 Issuer "Let's Encrypt Authority X3" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id A077B9E9;
 Fri, 14 Apr 2017 14:22:29 +0000 (UTC)
 (envelope-from danfe@freebsd.org)
Received: by freefall.freebsd.org (Postfix, from userid 1033)
 id CB87917F0; Fri, 14 Apr 2017 14:22:28 +0000 (UTC)
Date: Fri, 14 Apr 2017 14:22:28 +0000
From: Alexey Dokuchaev <danfe@FreeBSD.org>
To: Michael Gmelin <grembo@freebsd.org>
Cc: ports@FreeBSD.org
Subject: Re: LLVM port(s) take very long time to package
Message-ID: <20170414142228.GA52898@FreeBSD.org>
References: <20170412034308.GA56148@FreeBSD.org>
 <79A96B5B-8E4C-4E2E-8108-BA4F05CBFA4F@freebsd.org>
 <20170412093737.GB22201@FreeBSD.org>
 <2B393FE8-C076-4714-A718-0EDA155A5037@freebsd.org>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <2B393FE8-C076-4714-A718-0EDA155A5037@freebsd.org>
User-Agent: Mutt/1.7.1 (2016-10-04)
X-BeenThere: freebsd-ports@freebsd.org
X-Mailman-Version: 2.1.23
Precedence: list
List-Id: Porting software to FreeBSD <freebsd-ports.freebsd.org>
List-Unsubscribe: <https://lists.freebsd.org/mailman/options/freebsd-ports>,
 <mailto:freebsd-ports-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-ports/>
List-Post: <mailto:freebsd-ports@freebsd.org>
List-Help: <mailto:freebsd-ports-request@freebsd.org?subject=help>
List-Subscribe: <https://lists.freebsd.org/mailman/listinfo/freebsd-ports>,
 <mailto:freebsd-ports-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Fri, 14 Apr 2017 14:22:29 -0000

On Wed, Apr 12, 2017 at 12:06:42PM +0200, Michael Gmelin wrote:
> > On 12. Apr 2017, at 11:37, Alexey Dokuchaev <danfe@FreeBSD.org> wrote:
> > ...
> > Other alternative to PKG_NOCOMPRESS=1 could be PKGSUFFIX=.tbz (pkg-static
> > create -f tbz ...), will play with that as well.
> 
> I don't think bzip will buy you much in terms of performance,

Surprisingly, it actually did:

$ time make package PKG_SUFX=.tbz
===>  Building package for llvm40-4.0.0_2
565.215u 5.316s 9:34.18 99.3%   7899+502k 1+3020io 0pf+0w
                ^^^^^^^
Single-threaded bzip2 was faster than multi-threaded xz, at the expense
of larger package of course:

$ ls -s1 llvm40-4.0.0_2.t*
386752 llvm40-4.0.0_2.tbz
286816 llvm40-4.0.0_2.txz

> supporting something like lz4 would be useful.

Or, like vsevolod@ had mentioned, Zstandard.  But I'm afraid it would
take some time before we'd arrive there.

./danfe