From owner-freebsd-arch@FreeBSD.ORG Wed Dec 17 19:49:44 2014 Return-Path: Delivered-To: freebsd-arch@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 83DDE529; Wed, 17 Dec 2014 19:49:44 +0000 (UTC) Received: from mail-pd0-x22c.google.com (mail-pd0-x22c.google.com [IPv6:2607:f8b0:400e:c02::22c]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4A09511ED; Wed, 17 Dec 2014 19:49:44 +0000 (UTC) Received: by mail-pd0-f172.google.com with SMTP id y13so16890987pdi.3 for ; Wed, 17 Dec 2014 11:49:43 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=content-type:mime-version:subject:from:in-reply-to:date:cc :message-id:references:to; bh=kkSAJIPZErNIP5k4gjYNLmCsLY9kp1ULMWuBkYTzl44=; b=q+ddgSUb1GSS+57xj8y7NN1MVd945JBCny2Zuzu1l1QVtxyxOrGeoOV+HtUvZz3ZA6 VRdVsFTjxaZ9jyR2QX+TkMraPNd5Zy+e+IlsJMi+m00N6KYS16W4geFR+S1cea2Cki35 27651/OKFg2rQW3orLa0gadS83rQJl2cSNH5fkvd9K/sRaMKRWcgQdSJFMR2zlEWm+pO +wdQjVvceI7qgZsyH2DAl2+errIgdtVEEoNCWP+u+/TV/JXBQqTnFPwDFy7EFXUgd+sh H6YmzKMS9wE/Tv++F7VDaOyvX6jqxkpnVYUw0GeB7qJvFTbsgL5MPMnIvjbQ2z1jqZ0K IfLQ== X-Received: by 10.68.172.34 with SMTP id az2mr71772616pbc.113.1418845783757; Wed, 17 Dec 2014 11:49:43 -0800 (PST) Received: from [192.168.20.5] (c-98-247-240-204.hsd1.wa.comcast.net. [98.247.240.204]) by mx.google.com with ESMTPSA id nz4sm4642240pdb.69.2014.12.17.11.49.42 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Wed, 17 Dec 2014 11:49:43 -0800 (PST) Content-Type: multipart/signed; boundary="Apple-Mail=_DE47CF0E-56AA-4000-ADDD-446C5AF35C1E"; protocol="application/pgp-signature"; micalg=pgp-sha512 Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) Subject: Re: _bootstrap-tools parallel build (was: Re: CFR, CFT: Fine-grained SUBDIR dependencies for parallel builds From: Garrett Cooper In-Reply-To: Date: Wed, 17 Dec 2014 11:49:41 -0800 Message-Id: <8F3BDC42-83EE-46FA-AEFB-F35561290D48@gmail.com> References: To: Jia-Shiun Li X-Mailer: Apple Mail (2.1878.6) Cc: Ian Lepore , freebsd-arch X-BeenThere: freebsd-arch@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Discussion related to FreeBSD architecture List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Dec 2014 19:49:44 -0000 --Apple-Mail=_DE47CF0E-56AA-4000-ADDD-446C5AF35C1E Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=windows-1252 On Dec 15, 2014, at 21:00, Jia-Shiun Li wrote: > On Sat, May 31, 2014 at 10:04 PM, Ian Lepore wrote: >>=20 >> The parallelism in the bootstrap stuff in Makefile.inc1 is done with = a >> different-but-similar mechanism, and it would be nice to fix that to >> just use bsd.subdir.mk instead of almost-duplicating it inline. = That's >> on a longer-term to-do list for me. >>=20 >=20 > Hi Ian & all, >=20 > I did it manually for _bootstrap-tools anyway. Patches attached. >=20 > It reduces 'make -j24 _botostrap-tools' time from ~55 sec. to ~25 sec. > on a 12C IVB-EP. > It scales more linearly in comparison to single-job ~250 sec on the > same machine. > Main blockers were tblgen & groff. >=20 > On -j4 it reduces time from ~82 sec. to ~60 sec. too. >=20 > It passed 'make -j24 universe' except the seemingly broken i386 = kernels. >=20 > Any comments? Hi Jia-Shiun! I submitted the gnu/usr.bin/groff portion of your patch in = r275866 . I=92m going to look at stripping down bootstrap-tools, et al a = bit more in the next couple days and I=92ll be using your patch in part = with some parallel efforts I=92ve done on a branch on my github fork as = well: https://github.com/yaneurabeya/freebsd/tree/faster-build . Thank you! --Apple-Mail=_DE47CF0E-56AA-4000-ADDD-446C5AF35C1E Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- Comment: GPGTools - https://gpgtools.org iQEbBAEBCgAGBQJUkd5VAAoJEMZr5QU6S73eluoH+MIyjUBfSsG2XIJ/bDIE7aU6 QYl6otb/aPE9Ayuc80HD/M+3uzQJEx+aaqAqkyLPdsRZpypo2nfQE57uqSHvSJu0 eB4gkoF6cRA8WuZeo9ozBtRUud3WQj9JwOjta+DLVCfSGDnoHSxFrDI1v7Zmfhj9 ikhimJygh5afUEsx0nAUKKLObjf9/cfgNUfIr3bhSXRRmCFVPBS1fWjRg1VMuTkH cgPSOYAIxN04oDRSiXFEhVqDG5dJt+J/6xSatmzL+AV3nITCutVx6BEkCgtTCTf/ PJ1ErTFzZKeM/Dgd4+OMnzSI2o1BbZlgBFWRSsu4BJpZU3JLysY0cU2h3/VbBQ== =IFZq -----END PGP SIGNATURE----- --Apple-Mail=_DE47CF0E-56AA-4000-ADDD-446C5AF35C1E--