From owner-freebsd-ports@FreeBSD.ORG Sun Oct 19 20:23:19 2008 Return-Path: Delivered-To: freebsd-ports@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 2A698106566B for ; Sun, 19 Oct 2008 20:23:19 +0000 (UTC) (envelope-from dougb@FreeBSD.org) Received: from mail2.fluidhosting.com (mx24.fluidhosting.com [204.14.89.7]) by mx1.freebsd.org (Postfix) with ESMTP id B79288FC0A for ; Sun, 19 Oct 2008 20:23:18 +0000 (UTC) (envelope-from dougb@FreeBSD.org) Received: (qmail 18569 invoked by uid 399); 19 Oct 2008 20:23:18 -0000 Received: from localhost (HELO lap.dougb.net) (dougb@dougbarton.us@127.0.0.1) by localhost with ESMTPAM; 19 Oct 2008 20:23:18 -0000 X-Originating-IP: 127.0.0.1 X-Sender: dougb@dougbarton.us Message-ID: <48FB9735.7020106@FreeBSD.org> Date: Sun, 19 Oct 2008 13:23:17 -0700 From: Doug Barton Organization: http://www.FreeBSD.org/ User-Agent: Thunderbird 2.0.0.17 (X11/20081010) MIME-Version: 1.0 To: Stephen Montgomery-Smith References: <48FB344E.9040904@gmail.com> <48FB5E59.1000702@math.missouri.edu> In-Reply-To: <48FB5E59.1000702@math.missouri.edu> X-Enigmail-Version: 0.95.7 OpenPGP: id=D5B2F0FB Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: Eitan Adler , freebsd-ports@freebsd.org Subject: Re: speed up ports install X-BeenThere: freebsd-ports@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Porting software to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 19 Oct 2008 20:23:19 -0000 Stephen Montgomery-Smith wrote: > Eitan Adler wrote: >> -----BEGIN PGP SIGNED MESSAGE----- >> Hash: SHA1 >> >> I have a simple idea to make use the threads without any possibility of >> conflicts. I am sure there will be someone to point out a negative, but >> I don't see any. >> When you do "make install" launch a "make fetch-recursive" thread at the >> same time. That way you don't need to wait for the files to >> install->fetch the next one->install it->fetch the next one... >> For those who don't want that you could get the old behavior with "make >> onlyinstall". I currently do this with a "make" wrapper script and I >> find installation to be faster. > > I quite often so this also. But I do find I have to watch it, because > sometimes the two make threads try to download the files at the same > time. And that tends to screw things up. ports-mgmt/portmaster already has solutions to both of these problems. It only launches background fetches for files related to ports that need upgrading, and it has collision detection built in so if a second port tries to d/l the same sources the background fetch will exit. Eitan is right however, having the sources ready when it's time to build the port does speed up the overall process quite a bit. hth, Doug -- This .signature sanitized for your protection