From owner-freebsd-arch@FreeBSD.ORG Sat May 31 14:04:27 2014 Return-Path: Delivered-To: freebsd-arch@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id C4E8BFD for ; Sat, 31 May 2014 14:04:27 +0000 (UTC) Received: from mho-02-ewr.mailhop.org (mho-02-ewr.mailhop.org [204.13.248.72]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 977CE2C07 for ; Sat, 31 May 2014 14:04:27 +0000 (UTC) Received: from c-24-8-230-52.hsd1.co.comcast.net ([24.8.230.52] helo=damnhippie.dyndns.org) by mho-02-ewr.mailhop.org with esmtpsa (TLSv1:AES256-SHA:256) (Exim 4.72) (envelope-from ) id 1WqjtZ-000GoO-QQ; Sat, 31 May 2014 14:04:25 +0000 Received: from [172.22.42.240] (revolution.hippie.lan [172.22.42.240]) by damnhippie.dyndns.org (8.14.3/8.14.3) with ESMTP id s4VE4NZL001203; Sat, 31 May 2014 08:04:23 -0600 (MDT) (envelope-from ian@FreeBSD.org) X-Mail-Handler: Dyn Standard SMTP by Dyn X-Originating-IP: 24.8.230.52 X-Report-Abuse-To: abuse@dyndns.com (see http://www.dyndns.com/services/sendlabs/outbound_abuse.html for abuse reporting information) X-MHO-User: U2FsdGVkX1+TAo89zN1rqdHOHDNRuHlW Subject: Re: CFR, CFT: Fine-grained SUBDIR dependencies for parallel builds From: Ian Lepore To: Jia-Shiun Li In-Reply-To: References: <1401115733.1152.339.camel@revolution.hippie.lan> <1401280050.1152.377.camel@revolution.hippie.lan> Content-Type: text/plain; charset="us-ascii" Date: Sat, 31 May 2014 08:04:23 -0600 Message-ID: <1401545063.20883.41.camel@revolution.hippie.lan> Mime-Version: 1.0 X-Mailer: Evolution 2.32.1 FreeBSD GNOME Team Port Content-Transfer-Encoding: 7bit Cc: freebsd-arch X-BeenThere: freebsd-arch@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion related to FreeBSD architecture List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 31 May 2014 14:04:27 -0000 On Fri, 2014-05-30 at 13:54 +0800, Jia-Shiun Li wrote: > Updated patch works fine for me surviving -j64 buildworld on > quad-core. Compile time did not differ much, ~35 mins. I 'd guess > that's because build has already been well paralleled inside each > subdirs for ~4 jobs. > > It would be even better if someone can stress it on multicore system, > say 12+ cores, to explore higher hw concurrency to see the difference. > > Looks other targets using .for loops can be translated to this finer > dependency rules as well? e.g. _bootstrap-tools, probably already on > your todo list? > > > -Jia-Shiun. Yes, I wouldn't expect much build time difference because this doesn't really increase the parallelism other than for a couple of the early-build libraries. It does add new dependencies that weren't expressed before and were apparently just accidentally not causing problems for anyone. The parallelism in the bootstrap stuff in Makefile.inc1 is done with a different-but-similar mechanism, and it would be nice to fix that to just use bsd.subdir.mk instead of almost-duplicating it inline. That's on a longer-term to-do list for me. -- Ian