From nobody Mon Oct 28 00:49:44 2024 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XcFCb3j5Bz5bdDj for ; Mon, 28 Oct 2024 00:49:47 +0000 (UTC) (envelope-from david@catwhisker.org) Received: from mx.catwhisker.org (mx.catwhisker.org [107.204.234.170]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4XcFCZ2jp8z43dT for ; Mon, 28 Oct 2024 00:49:46 +0000 (UTC) (envelope-from david@catwhisker.org) Authentication-Results: mx1.freebsd.org; none Received: from albert.catwhisker.org (localhost [127.0.0.1]) by albert.catwhisker.org (8.18.1/8.18.1) with ESMTP id 49S0nimF008620; Mon, 28 Oct 2024 00:49:44 GMT (envelope-from david@albert.catwhisker.org) Received: (from david@localhost) by albert.catwhisker.org (8.18.1/8.18.1/Submit) id 49S0niZv008619; Sun, 27 Oct 2024 17:49:44 -0700 (PDT) (envelope-from david) Date: Sun, 27 Oct 2024 17:49:44 -0700 From: David Wolfskill To: Maku Bex Cc: freebsd-current@freebsd.org Subject: Re: speedup build time Message-ID: Mail-Followup-To: David Wolfskill , Maku Bex , freebsd-current@freebsd.org References: <012d01db28cc$5fc66ac0$1f534040$@gmail.com> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="ySbbNwu/7EFCexY0" Content-Disposition: inline In-Reply-To: <012d01db28cc$5fc66ac0$1f534040$@gmail.com> X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:7018, ipnet:107.192.0.0/12, country:US] X-Rspamd-Queue-Id: 4XcFCZ2jp8z43dT X-Spamd-Bar: ---- --ySbbNwu/7EFCexY0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sun, Oct 27, 2024 at 07:00:17PM -0500, Maku Bex wrote: > ... > I'm trying to figure out a way to decrease build time of -CURRENT and/or > -STABLE but it is not working out that well.=20 > I've tried the following: > * Tuning /etc/make.conf and /etc/src-env.conf based on their manpages > (make.conf(5), make(1), src.conf(5)). > * Removed certain options from GENERIC, which reduced the kernel build > time significantly.=20 >=20 > Hardware specs: > * I7-10700T 8C/16T @2.0GHz. > * 16GB RAM. > * 256GB NVMe. >=20 > Currently, 'make buildworld' has been running for 7hrs and counting. Is > there anything else I can do to speed up world build? > .... First, some questions -- whether or not you wish to share the answers, I believe that answering the questions (if only for yourself) may be helpful: * What (if any) "max_jobs" (make's "-j" parameter) are you using? For a 16T system, I expect I would start with a value of around 28. * Are you using make's "meta" mode? I do. * Can you get more memory for that system? Some context: I am in the (definitely peculiar; perhaps unfortunate) habit of "tracking" FreeBSD head and latest stable branch on a small collection of machines ... daily. One of those is the laptop that I use for normal "desktop" stuff, as well as accessing all other machines on the planet that I access. (Oh: I also update ports daily, too -- though I let my dedicated "build machine" handle chromium.) That laptop has 4C/8T & 32 GB RAM. This morning, it took: * 17:46 for stable/14-n269310-bbd018d0aaaf -> stable/14-n269315-b21c677ed28a (0:02 to update /usr/src; 17:44 to build; 0:00 to delete old libraries) * 24:03 for main-n273250-9d585fc395c3 -> main-n273270-cadb71e4b013 (0:03 to update /usr/src; 23:59 to build; 0:01 to delete old libraries) * Updating ports (other than www/chromium) took 1:52. (Those times are "mm:ss" in case it wasn't obvious.) The above is fairly classic "sample size of 1" -- it's not necessarily representative. Folks who are "sufficiently interested" are welcome to trawl through the logs at https://www.catwhisker.org/~david/FreeBSD/history/ to get a rough idea of how long it is before the "uname" output from a successful build is logged; there is probably some correlation to build times. I also recently acquired a replacement "build machine": 64C/128T; 256 GB RAM; a fistful of SATA SSDs (build/boot on one; the rest is a poudriere play area in a zraid). That's a wee bit faster than the laptop. :-) Peace, david --=20 David H. Wolfskill david@catwhisker.org It has been said that history repeats itself. This is perhaps not quite correct; it merely rhymes. -- Theodor Reik See https://www.catwhisker.org/~david/publickey.gpg for my public key. --ySbbNwu/7EFCexY0 Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iNUEARYKAH0WIQSTLzOSbomIK53fjFliipiWhXYx5QUCZx7fqF8UgAAAAAAuAChp c3N1ZXItZnByQG5vdGF0aW9ucy5vcGVucGdwLmZpZnRoaG9yc2VtYW4ubmV0OTMy RjMzOTI2RTg5ODgyQjlEREY4QzU5NjI4QTk4OTY4NTc2MzFFNQAKCRBiipiWhXYx 5f1kAQDBQlwcBHN38Gx2AnKjL/Z7krOjsPc62cGMQ3NZ95aBbQD/U2bjim+/vWe0 w9p+GLPbfiCSBKKRxm8NxGvmhqvmfQk= =eqKu -----END PGP SIGNATURE----- --ySbbNwu/7EFCexY0--