From owner-freebsd-questions@FreeBSD.ORG Mon Mar 5 22:45:55 2007 Return-Path: X-Original-To: freebsd-questions@freebsd.org Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 66B3216A402 for ; Mon, 5 Mar 2007 22:45:55 +0000 (UTC) (envelope-from Thomas.Sparrevohn@btinternet.com) Received: from smtp803.mail.ird.yahoo.com (smtp803.mail.ird.yahoo.com [217.146.188.63]) by mx1.freebsd.org (Postfix) with SMTP id E4AA113C4B5 for ; Mon, 5 Mar 2007 22:45:54 +0000 (UTC) (envelope-from Thomas.Sparrevohn@btinternet.com) Received: (qmail 59484 invoked from network); 5 Mar 2007 22:45:53 -0000 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=btinternet.com; h=Received:X-YMail-OSG:Reply-To:From:To:References:In-Reply-To:Subject:Date:Message-ID:MIME-Version:Content-Type:Content-Transfer-Encoding:X-Mailer:Thread-Index:Content-Language; b=l4WCODyARC+q9qMJqa8JYLyGe8buU1d2hHz/H+oujdlbnMAgHvUL/T+t0LMQlMTbDMDAcclgDMWz48CsSMjPsdAauTo23Z8ZCSzpchOZSq98XQDxTEH7azX4epXg7cYBIrEPtVYuAlty2Oc2Mt+vkR63GN0dPhmmHPmCyoU56tE= ; Received: from unknown (HELO w2fzz0vc03) (thomas.sparrevohn@btinternet.com@86.143.68.236 with login) by smtp803.mail.ird.yahoo.com with SMTP; 5 Mar 2007 22:45:53 -0000 X-YMail-OSG: ZzXSK.sVM1nQS2gmPFPqtITknRppbceJZtSTm8kPAfGlVRmFZ22qN60Y4z6yrIJIw2JAMJj3tqbw8xP7KOkVZ3hV0m.ONGY7BWDXJCewvEK3BanQOWc- From: "Thomas Sparrevohn" To: "'RW'" , References: <20070228183733.4f6ddfe7@gumby.homeunix.com> <20070305212122.672136df@gumby.homeunix.com> In-Reply-To: <20070305212122.672136df@gumby.homeunix.com> Date: Mon, 5 Mar 2007 22:45:53 -0000 Message-ID: <006c01c75f78$08097420$181c5c60$@Sparrevohn@btinternet.com> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Mailer: Microsoft Office Outlook 12.0 Thread-Index: AcdfbIeiLUeRCcHnQ9+E3O5i/2A7gQACfbbw Content-Language: en-gb Cc: Subject: RE: compiling ports with more than one job X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Thomas.Sparrevohn@btinternet.com List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 05 Mar 2007 22:45:55 -0000 There really two answers possible here - 1) Let's call it one depth e.g. make -j - Which works with some not all ports - Nice when it works and I guess ports/Mk could hold a flag 2) Let's call it width - e.g. the ability to compile packages at the same time given that all dependencies has been resolved 3) combination of 1 and 2 In practical terms option 2 is much more attractive as it is possible to determine that just from the INDEX file and the installed ports. However due to the way compilation options are treated e.g. I am not sure that it is completely safe - I will require some locking during the make (de/re)install phase but possible to handle - It would still cut portupgrade significantly With 15-16000+ ports I think that 1 and 3 are unpractical - however it could make sense to have some packages (kde/gnome) handled with make -j and it seems to work with at least some of the kde packages - but only I think if make extract/patch/configure are run without -j -----Original Message----- From: owner-freebsd-questions@freebsd.org [mailto:owner-freebsd-questions@freebsd.org] On Behalf Of RW Sent: 05 March 2007 21:21 To: freebsd-questions@freebsd.org Subject: Re: compiling ports with more than one job On Sat, 3 Mar 2007 13:55:53 +0100 (CET) Christian Baer wrote: > On Wed, 28 Feb 2007 18:37:33 +0000 RW wrote: > > > There are two problems here. The first is that not all of the > > underlying builds support this. The second is that we are using > > Make as our ports scripting language - I'm guessing that in Gentoo > > no-one expects portage itself to be parallel. > > I don't actually *expect* anything. :-) I'm not sure why you think > that Gentoo should be an exeption here, but that won't hold up > forever - on any OS. I don't, it was an analogy. Gentoo has a portage system based on Python that mostly builds software using Gnu make, FreeBSD has a ports system based on BSD make that also mostly builds software using Gnu make. Gentoo can make use of parallel processes by passing -j to gnu make,and IMO this is how it should be done in FreeBSD. The fact that FreeBSD uses Make as its ports scripting language confuses the issue, people expect to be able to type make -j in a ports directory, but when they do that they are applying the -j to the wrong make - it's analogous the python part of Gentoo portage. I don't see any good reason why the ports system *itself* should ever support -j, there's nothing to be gained by it. All that's needed is a better mechanism to tell the underlying build to use multiple processes. > So you mean a MAKE_ARGS= -j 4 would help? Worth a try, a few ports already do this > > Probably you would want to set it conditionally in make.conf, so you > > can exclude any problematical ports. > > What do you mean with that? You wouldn't want to use it on ports that are known to fail would you? _______________________________________________ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "freebsd-questions-unsubscribe@freebsd.org"