From nobody Mon Jul 7 18:56:02 2025 X-Original-To: freebsd-pkg@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4bbYNx1V6xz60xSS for ; Mon, 07 Jul 2025 18:56:17 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic309-21.consmr.mail.gq1.yahoo.com (sonic309-21.consmr.mail.gq1.yahoo.com [98.137.65.147]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4bbYNv3mlvz3WCy for ; Mon, 07 Jul 2025 18:56:15 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=qFImDIcc; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.65.147 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1751914573; bh=YojzPza8XYq9r2M/cKwx4VQvoB54tixjr+WYg6rCEx8=; h=From:Subject:Date:References:To:In-Reply-To:From:Subject:Reply-To; b=qFImDIcc24e1wAQ7A+UK3w5e9qmu2fyodwDdnueSNH9OpA1IVNRwD+yaTHm2S3ZSrkQUVLwMIAA24ziTpBVtTkulK7+xbXzzEAPi10ZPKMvdrsWXqfIFw5zrFH5Lvb14YJ6fKyqRxCQ1aKQAf4+RrtlcNwXrIUUpuyWRCdPM4YFipTFSdOxCEeFkYRcjPrNB4ARrk4qXkjUHxDf5aksGF6kHADRsitbA85AvD5+a/F7H4U5F79Oedg9pQSWrlfBBgOJJOx/UncnXignBuh4ZFZOudnPBDN5RF8lTgAnKDOlucJYGnJHNRzHnV7os1E6cG1U1HK6qEAigtTUjsrOdXQ== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1751914573; bh=ww+fIciRz0JQZ6mIpO8WEj6Hrod9W8Fn3ljoPUIKMfG=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=MYqbDyaDv8sWvqwiMFpJroonERYwiKt+4iNITnsr8LK1zN/rCnx9Q20oXv60LYPlER+z8oF5AYEuQL13AM4BgUaKo5UZ0zWMUerTt3rgsuFawKA/5dc2TutvBOhE49bBuqGUJ1U09DbFB5WfJUlOzHCLl9/mzVsamKoXpcBYaw4oyyESp5g8yH5plXCs3iTC0urDozhKPaf6vtlWiktnRQY1tb+dh2oWvUshMEmrqXNsofmQnufYuubeIfzpecw4vDnEJfMGIhCQbitTt+G4tYw5NxlN67nOy6yPWYYHMYhS3kcs0YIm29s6wtuliZSBCJWZy61Ao/zwLF6kfkMFEA== X-YMail-OSG: QJrxnmgVM1l9mMOhCzdvPY2uPwPGNPcFGm63hsSAcj0GrixW8COMaXq5QuNBril BRyF09Q8Bq47sGU2qaKTl_iF9DKdGDR.WK.QWInPR_aeKN.QXZ3N3TouS_mdOf5Ak8tj4WNnOQIO vdJPerjQ6gyuimz3gQOKtl4A7dSFtp8_r8Gu3cr9njtRcue47diHaajXyy6y2uwGfixYicl8m_tN gXYEUYJuJG9wCTpB30P1Vs96.7odw.i24nIgfgT9hw1Zb.K38QdvaJy_0IsTTQ6NjAEOA6SSeA6X TtLZPFHxEYaWPCU6pq.potxEXU6qjPuN.MT9FC1rCek1afP_OG6oQQeeNEj9_yIRcmqU3xGZNH4h YHovusa9g2hZq6l.Bp.Wf8Tf9w1evZnzqLmAFMBZO98vCUfHsCMa3gcsoe092PUEDP9w4l_DTsk8 2H7gEt2ZQN_n.OTqTzDdekUxle2RC9P7quj6oCqoxhCJRkqI3nP7.N9sQtG1rBf7yBwDgij5XN4C CDBfup9NGNsLJmqNKXSEj.AA8YzS1JSRyK77vWsZuPTVnJlLr7cGHsa7rrm3X_782BzyUC1bt56z rDK.GEC9SYOv8kvoxFJM_13_3rWnm8Q4CebuZO46eboP8mtUkxe5T2pw0qF0TL7GDmEx73OjwYDm aw1wZUELyGskov6MuCnpTJRwbzCntK_6nUze8_NLHQGX9CPQ5K31ZMhNCpITSwsVgYFsqalTbitY lK3Z2UuevvgHhN..qbdBKrckeIFoh9a4SHAgNIBgL3PowqqDLX4MhtrjdAp2RIcs01UlbmAr0RPI qDLzYNfpH1T90Q56lFV02Ql8Z6oOn4hw3yzOX1lijkSSqefKorAZoEVNCA_uPQMLDeOUqn_SsYQA 7iTSz5GEvR6Yq_hUIw.7voki9YC29ar0PpVDUfLmoG5n5MPV22NRB.tEYC5N3Ln1Co9wrpxSE_.z IM5pOtplGUrBkZeT4MeZz_PNpFb6cmfomDuMVqS.rjAs..Lk2gHad38rMGcH_Etajo1McM4GYbEa ilaRby1HzNkBwM5HDwDna8N9Krl.PYS_NPWBz0QQmjXsL0MgnZAj9Idi1XapXAadqyABKfybg42m KGo0edV16zNpExcdjq0G6ZsEXZb7SwRAu1E2xpvIaMDOFaXdRfyZ2pTX8QZ9G4duP2cQ5hCezN63 ajWiYPblUagX2ft1bOm_d1mmNgGS98IBEX2erQDZ53xb.Bjj71fVYPT3ill7JMPBocZDZRAHGhfk EL6wgbsZKkp4_31PGTwWZMYNRjeVOE76k4gtsmWB5c46izZXc6mawuQNnuZ2v3XhDNqW7aSoHyZv .z4pZ4uHl3ULaAHL__kamPeX1c.2i_SaTFdfchhjOIDaJNsNNUzhftkYuVV9MTH05sWxqyDHV_Or iCs0wMj00ItluT98RrHdSiMp6LtaNyOgXowZvbRKiu42N9EwVwb_ccM5lTo2CO1WpoJDL_C79lQ1 hviRFZS0nZC6drmwF2fblwGk2hnIdO_WFCK6SQKKmDGHgrVjWYFBjnZpb6J8DJrlXLbyb_Sz4za1 iR291q1I6K3LrqJYiM.plOKpixcJAyGigDAHg4DetpVRzZfPRG9YX5IBKi.pIC7c0p1HHiPJsyEZ 4NHL1HYvw0An34poY8591uVqVDGZds_Oubve.8jw9c2Mm5nFw4zneFlfb6vve3o.wmhjW887E8ck vOCYLPotn5..9SOrjnaBUghCrSVBtCUkxoKFK8mHcavRn2KM_6ZCLAdyIBwCr2ObMiV9aICBhccl aJLww_m7NX4GoD_5vICKIwF2a5ty.EWBW.z.AxRZOuDs8h32I_ZWp5MkQW5OVn6ABqaQ3DZRI3fL AWSf8pAoJKUro7x_4Ynolwtok5Ij8f9ISRny1NriUWDLuNdNxtZrDFjLhl8_1CNAPaCfzR99_iDE FONcS86NOXSuoG_QUvlIaW1vfxIdW6asNG9SkHUEXGf3V7QDvK4IOoFq1NmMK00IXd7fMP521MDs 9LBdM0Zg0v4imyHUPgVNTVinQ6PTmN4r68wdY5rRMlIqAFxwXeIIcZaSKhSiK5UiIXkHRuQecuHn LnI7_SXBmzOabAx9FmY3DtFT1f.uAWlljS4HgTri41iOXcg3uK7UFVbsQRZ_sudYnRBCWOybpxzL myuN8EY_KINKAfbNWWn7gRoDZdGUheLplpTdXulLsBaWzjPc2IcuOq1WVVLfJ..rAGeiv.nkfdly ljiRC61fuNs36XZC0pz4wzvhyG6puz3_MeYaL9F9wI0RW0.n_UhALLNt1JUjKYoCWbQA- X-Sonic-MF: X-Sonic-ID: a1bc7ce0-a0ed-429f-9b9e-82895b849b51 Received: from sonic.gate.mail.ne1.yahoo.com by sonic309.consmr.mail.gq1.yahoo.com with HTTP; Mon, 7 Jul 2025 18:56:13 +0000 Received: by hermes--production-gq1-74d64bb7d7-grhph (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 1f0b1539a7e6f992139166e9155f107e; Mon, 07 Jul 2025 18:56:12 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable List-Id: Binary package management and package tools discussion List-Archive: https://lists.freebsd.org/archives/freebsd-pkg List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-pkg@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3826.600.51.1.1\)) Subject: Re: FYI: pkg 2.2.1 and official main-amd64 package builder beefy18's time frames: good news and bad news (preliminary) Date: Mon, 7 Jul 2025 11:56:02 -0700 References: <7047F445-B6BC-4DB1-919D-E62A3FAD5C19@yahoo.com> <881FFA75-17B0-4A5A-8E49-0C13693D8B0F@yahoo.com> To: FreeBSD-pkg@freebsd.org In-Reply-To: <881FFA75-17B0-4A5A-8E49-0C13693D8B0F@yahoo.com> Message-Id: <957AC9AC-26F5-4D6B-8486-9A76ED04DB97@yahoo.com> X-Mailer: Apple Mail (2.3826.600.51.1.1) X-Spamd-Result: default: False [-1.32 / 15.00]; NEURAL_HAM_LONG(-0.96)[-0.964]; NEURAL_SPAM_MEDIUM(0.89)[0.888]; NEURAL_HAM_SHORT(-0.74)[-0.743]; MV_CASE(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; ARC_NA(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_LAST(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; FREEMAIL_FROM(0.00)[yahoo.com]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.147:from]; MLMMJ_DEST(0.00)[FreeBSD-pkg@freebsd.org]; TO_DN_NONE(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.147:from]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; FROM_HAS_DN(0.00)[] X-Rspamd-Queue-Id: 4bbYNv3mlvz3WCy X-Spamd-Bar: - On Jul 6, 2025, at 13:48, Mark Millard wrote: > [Sending to the right list this time, not to the one > for PkgBase.] >=20 > On Jul 6, 2025, at 13:29, Mark Millard wrote: >=20 > Context for these comments: >=20 > = https://pkg-status.freebsd.org/beefy18/build.html?mastername=3Dmain-amd64-= default&build=3Dpe02807e84be6_s24ebe9fa0ec >=20 > as of having built 31634 packages (plus 122 failed), > 4336 or so packages Remaining to attempt to finish. >=20 > I'll note that the example being main-amd64, it > involves the debug FreeBSD kernel. That mixed with > the pkg 2.1+ or pkg 2.2+ involvement make for things > taking a lot longer to build overall. >=20 >=20 > The good news: The built-pkg-count vs. time curve > structure generally looks much closer to linear for > the package count involved so far, unlike the concave > up structure that pkg 2.1.* lead to. Concave-up cannot > be viable long term as the number of packages > to build increases. The scale for that issue has > shifted signifcantly in the better direction. >=20 > (There will be better data about this once the overall > build completes.) >=20 >=20 > The bad news: The basically linear rate for 2.2.1 > (so far) vs. 2.0.6 for the fairly modern pkgs built > counts ends up with: >=20 > Official build examples on beefy18: > Newer, pkg 2.2.1 involvement: Built 31634 (so far) in elapsed-time = 210.3 hrs or so. > Older, pkg 2.0.6 involvement: Built 35771 in elapsed-time = 96.5 hrs or so. >=20 >=20 > So: the overall build had already taken more than > twice as long as it used to and still had 4336 > to attempt to finish building. >=20 >=20 > ampere2'main-arm64 and main-armv7 take noticeably > longer on the slower hardware. So the above for > main-amd64 (beefy18) is likely not the worst case. >=20 > But, as ampere2 is still working on finishing with > pkg 2.1.4 for main-armv7 builds before it starts > building main-arm64 with pkg 2.2.1 involved, it > might be 4+ weeks to have that 2.2.1 example > complete and main-armv7 with pkg 2.2.1 involved > start. As stands: >=20 > Built 16638 Remaining 16109 but Elapsed 154:43:03. > (So it suggests another 150 or so hrs overall as a > quick estimate for it finishing the pkg 2.1.4 based > example.) >=20 >=20 > Note: > Builds of main-i386 (beefy17) are scheduled to stop. > So I've ignored it here, although it looks similar > to the figures for main-amd64 (beefy18). As things have progressed, it is now clear that 2.2.1 still has a concave up structure for this debug-kernel (main-amd64) context, just with less curvature compared to the various 2.1.* versions, the actual comparison involved being against 2.1.2. (Faster systems make this harder to see. Slower ones make it easier to see.) As stands, at 33558 built, it has already taken somewhat over 2.3 times longer to get that far than using 2.0.6 took to finish, having built 35958 packages in the process with 2.0.6 involved. For ampere2's main-arm64/main-armv7 cycle, I'd not be surprised if each of those takes around 2 weeks when it is a (nearly) full rebuild of the packages. So a full cycle of such might take about a month. The longer intervals between builds of a specific type makes large rebuilds more common. It is too bad there could not be 2 builder machines for the main-arm64/main-armv7 pair: one using the non-debug kernel for more frequent distribution builds and one using the debug-kernel for testing main. =3D=3D=3D Mark Millard marklmi at yahoo.com