From nobody Mon Apr 7 17:15:07 2025 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4ZWbSg1Vnrz5rcLd for ; Mon, 07 Apr 2025 17:15:31 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic313-20.consmr.mail.gq1.yahoo.com (sonic313-20.consmr.mail.gq1.yahoo.com [98.137.65.83]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4ZWbSf4glvz3GPH for ; Mon, 07 Apr 2025 17:15:30 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=MHSTMFqZ; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.65.83 as permitted sender) smtp.mailfrom=marklmi@yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1744046124; bh=NWL9TZ9UKpM1Ijzgw/xUg+cv+1CCFEKaHg7eBgWTam0=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=MHSTMFqZJjNKv5V3xs3Zw7qJLXr7y9QenUWPWm0og0Mb9GkUzEY4GAbf3By4MYNfXFa9HocUn8z4iQ8qrJtErKIRSiDfFRfOzo4hg2JTCGGD1a3Vd6+hER1fm18Gar4LTxX/wjV216KHx8NOdQ32Vt7Y1+iQqR3OKC8VHDFnIg24EstzutsjPHHMY27g5KWx2Yzdx0zfB45txJkMRxCat1WNEHD2s8gs6+7LYXft2KgfsqsuNpylaw+Sa1YUlNfdRQRNEq9CUHm3nPAIq2ndWIOsFm3/2RQj/OfgptUZmtM/UVfi/ldN2xPavux05ex76xshqH0jnqBw6BmrU/fCHg== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1744046124; bh=5Ab74orTwcbb574c5nhXIeMKbR8c5XqI8C1LodXPDlm=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=WU3Zt81/M9bCMtxOY6EcIHtoK4Gty+k8cH2+MATVMjtZ2z5JCYUxrobNGQhMpIui5strEJaOjmkyOLaQlohgzkH1c8Qa/1wcLLNFn203F+cC9v2Ys7HMkCj98fHUDl0K4tF0KzH3/LD8NYxEs29+efw27fgk0/4hTSfVtI3SL/tHThkw/hba2DntzqUVbS74KTKFv/2bMTv40gVsuDGo2aNE0ebQqtrbccF7dxL5NaIVJwcY+O3ubPEGMOx6ReWdXXPdgi0zThSd0tAX0k29bAxMLUdQy7Q3QhT33D8O7PmPh0gR8PL/qLAllFbiFDP6aTiE7Ipipztc5ZTrSzyVHg== X-YMail-OSG: QdDs5lEVM1n9xozsSMZ0n_az1NGa1ksB2xK8Mb3cwpS7_NgI0SM3.x6RolCAE46 6qJpz25c0adIu4Tgaob6taOD3UVwMfnq1SXFnPGzNWWhl_IYIguQLmQw7NivNJ98_rZWc79R3Z4c V9l96xE_GIzCXSls7FhwZsrfa0.TZImdyAxb50uSlvalV..cePwNqiCSAOQDZsWnG92eEFldMZGu .FbrsfCFSxBc50nlf2IxExk6FH_Se6oSBr3ErBSsh5CLoNds.b8KJhtUkFQeaWqsmjFr2wqHyOgS scWRJ85YDBonyeRMZ0qcPx6h1Em4rdFy9frc.n2NVeqkELfXDnM6alWAxtA7NxCYuUNPWWzxKFiU 56KDrEpr0ZxhsNaqQmdECkUxxfNt6dDhyYerrB8fy5c_NBafNTLNmDYi2dOjkwxcMiZcM1CyJ7tj MoHWPPzC25ZMLWNl5wS69jUPRt9S42Xwf43c.fbJ.4V7Itx6T5Xp1kJEksA.AHbUcTRnj.D8APP0 p9bWTpz9QF7ELRfNjTb8esDiOCC3tVxuh3wW8Yx8gb6_ePcJFo9vyR0EFpEgSPQfQ0.MjDhXQYhE LOncaQATMviBqfow_etf4SoiWljiYdX7tbfldYLTS9UMAmlv_bv.ediLZndB2LvSNercR1uQhzeT 48roXuiA00JTKw2b8C6rAxm4JIbLBp2NX0uSZraIGJbV1UacnC8aTWUSoS2O4XgGZp98pNhJM4r3 YgyyQqJq5.CvuFQGDGt40fhqprw5fpvWt6UziRHmlc75L6akjo0PlcduiasBqhal.e8uDcOIGJpx l.jLpFvb8glRnaRKcmDS5Pc3MhLTtqgPvop6DJQbPVIsb2j4b60suM6lUlM.NyufNKbFfqLjE9S8 2pM0JdP1GMrgVopSRoHKl3hHWFG0wxGRzcsXfk31adUsBNQDVq3XuTb5pUAf93THJsdrnNFwdgOO QjM0y4WRsfhAteXFZ78WrRaSWAz388J7_20WzDw.gjxJcdqFJpp0snrCroXFQcp.bAF_db5GyHml g6aaWKsv3sYDjC9RA3n.qGT2EdfFS8pEs5LtnAItumrF4EB4Ed7D8OzSYl9UkpbtN33uZMyumepK zuFK1J4VxHE7yGA8j6088QE3VezU2yOwEUrFFdOwyF2Xr9nmK_RHkK9__8AQYclvGE8HY53U39Yy QCE5nN6hr5ZUPaUFfKKJFFErhMBC5uNym5c9SyPgssgIG8Rgg.7pvX1WvASNclBPfcfnRXg7gbd. Srp0YV9uM6oyqje5UsPoM5Qp4IZJz1WFO2070O_yaUBQ0Ig7sG5CQDm6noaSe45WNp9yU1l4rn6s PbFuxxiIopnr70AK2qD9I.cEd.hBIBnDKJqcjXOpKOh2.aB7JkGyQt0OcBf5Ml1JFedLKXvi7ouf RwixOSVw4Bv_xWBtIesTKa3ZNr9OowMxa0rmuLh97JCFVPLdeSL5ODab985tTrPFVs1hyR1rLLQ5 PMKj8lA7hJFyoHtHQvFULLVBOm6YxY8ixI2vKNAZc5_qiFeJHjlPwN7vxBVmV4NExwtJJCEHONjr zPN6we4q4u4XptaVhR3VJLHzjkdOCRPAQL5AzExZentN7Pp9zHAOiaGgHyoL17mavYXM1OOWSgRm hiOzO_L3vJe1rNdNecm0RtE8mPoc2s1MtSOni8JWOQoVDMfQdhV5DPqjm.yLBPOWYalaUx6mtWn1 lA62FQaCk9PCZo5JuvNJJrdgUNDa2F8GZtFXj9OusW4d6UaUyDnQtG6sBtvEBiJT_it73WK5hafw Wj0Yv2Z4eoDUhtuz0T9ExWIgP1VPpb9GGu9P80L08UHkFMaZkFhb3lKeu82fKyZTvt3QT.NSWQeJ F12qcmJk1NZ7nqVS8V2HefqZ5pwGpoMaT5e9VtVSXA7CxIl78llN46Sv4k_FjGXDD3ydnJ6lslB_ V4WNd8eoyhA6XjnkbXSQQX1uuBz3nb8K_G2ZMz2YQWj_Afxi5nKG9SHHU8B7ri90sDG5aJs.N9P8 UtTbKClUvKrbBJ_yV.Z4I1yM76mZ6K2yGYBpzbzdQ4nAesKX2zkFow.VZc2RogONT2yv9xwX8SC5 hfR6.FUR2sH3mfH2LGF4QCh3ciS42gOkbTNQBMEfyrFdy3zWdh1RngowAY619Ygeu.IQlPgad6LE DPgsxAtqmb5tueXAjgLJTZ1zgFZrCcXI.TZKmUEilxaf74bq6mPJz6Yi8Kr6hjFchVJOMxLTPc7X dAeGuWCkfVrtHaLmEcQfqVZ5kiiln X-Sonic-MF: X-Sonic-ID: 4e2e1eaa-f17c-4ec5-94f4-82beb273c498 Received: from sonic.gate.mail.ne1.yahoo.com by sonic313.consmr.mail.gq1.yahoo.com with HTTP; Mon, 7 Apr 2025 17:15:24 +0000 Received: by hermes--production-gq1-5c477bf655-pf5cp (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID c7dce3d65c4c384637c4d818d1708b89; Mon, 07 Apr 2025 17:15:18 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3826.500.181.1.5\)) Subject: Re: UPDATE: pkg 2.1.0 looks to be making official bulk builds of packages take much longer [a specific package with large time factor] From: Mark Millard In-Reply-To: <0414EBFB-B63A-4738-ADB0-38B6CF3725DA@yahoo.com> Date: Mon, 7 Apr 2025 10:15:07 -0700 Cc: Gleb Popov <6yearold@gmail.com>, FreeBSD Current , FreeBSD Mailing List Content-Transfer-Encoding: quoted-printable Message-Id: <05128806-8F20-43A6-946B-A3780259F61A@yahoo.com> References: <8E2FBAD3-EF6F-4D99-A340-21F8FD19AE0F@yahoo.com> <84FBBAF8-025E-4B9D-9797-51735567A8DB@yahoo.com> <366E27FD-FA5B-4BF8-B6C4-6C495DB289C5@yahoo.com> <7ziazrj7szuqhov3oppjbh3jyu3f2p2owntv4oxprelrdjzc6u@hkuf5szf3zwy> <0414EBFB-B63A-4738-ADB0-38B6CF3725DA@yahoo.com> To: Baptiste Daroussin X-Mailer: Apple Mail (2.3826.500.181.1.5) X-Spamd-Result: default: False [-3.25 / 15.00]; RBL_SENDERSCORE_REPUT_9(-1.00)[98.137.65.83:from]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.91)[-0.912]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; NEURAL_SPAM_LONG(0.16)[0.162]; MIME_GOOD(-0.10)[text/plain]; MIME_TRACE(0.00)[0:+]; FREEMAIL_CC(0.00)[gmail.com,freebsd.org]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; TO_DN_ALL(0.00)[]; ARC_NA(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; FROM_HAS_DN(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.83:from]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.83:from]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RCVD_VIA_SMTP_AUTH(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim] X-Rspamd-Queue-Id: 4ZWbSf4glvz3GPH X-Spamd-Bar: --- On Apr 7, 2025, at 09:44, Mark Millard wrote: > On Apr 7, 2025, at 08:14, Baptiste Daroussin wrote: >=20 >> On Mon 07 Apr 08:07, Mark Millard wrote: >>> . . . >>=20 >> Listing like this is clearly not any useful, the problem we have is = the >> performance changes depending on what is happening in parallel on the = machines. >=20 > I've been exploring looking for an example that reproduces the > timing issue via commands like: >=20 > # poudriere bulk -jrelease-aarch64 -v -p default -c www/gitlab@ee > vs. > # poudriere bulk -jrelease-aarch64 -v -p alt -c www/gitlab@ee >=20 > so that prior builds are not involved in creating such a context. > Also, when www/gitlab@ee itself is building, no other builder will > be active. >=20 > I've started such a build based on a pkg 2.0.6 /usr/ports/ context > and will try one based on a pkg 2.1.0 /usr/ports-alt/ context. >=20 > I'm trying www/gitlab@ee because, on beefy17, it went from: >=20 > 00:09:01 (pre pkg 2.1.0 example) I must have clicked on the wrong thing for the above. Looking again: build of www/gitlab@ee | gitlab-ee-17.10.0 ended at Wed Mar 26 10:27:22 = UTC 2025 build time: 00:13:50 > to: > 05:35:01 (pkg 23.1.0 example) >=20 > (so somewhat over 37 times longer) and when I looked it up > it has a huge number of dependencies: >=20 > # pkg rquery -U -r FreeBSD "%#d : %n %o" www/gitlab@ee > 298 : gitlab-ee www/gitlab >=20 > The factor of 37 is large enough to be unlikely to have only > load averages on beefy17 as a major contributor. Given the > evidence about the count of dependencies, I will see. what > I get. >=20 > The test environment is a Apple Silicon M4 MAX system with > FreeBSD running under Parallels in macOS. >=20 > [00:00:07] Building 943 packages using up to 14 builders >=20 >=20 > OOPS (via checking ampere2 logs): >=20 > Looks like aarch64 might end up blocked for a > rubygem-redis-actionpack-rails70 "Phase: stage" failure. I > may have to set up a amd64 context for such experiments. The above looks to be another example of looking at that wrong thing. But, as I'm using 2 different vintages of ports tree, there could be an issue for 1 even if there is not for the other. >> which makes the performance issues invisible on local poudriere if = you want to >> test it on port A or port B, if we want to reduce the performance = penalty we >> need to be able to make a reproducible case which can then be = profiled, to know >> where to optimize if needed. >>=20 >> I have tried to reproduce each individual case which happen in the = ports tree >> and I am not able to reproduce them, so impossible to know where to = look at >> exactly. >=20 > I'm hoping to supply reproducible steps. >=20 >> I know what is new and what causes the performance penalty, but not >> which part is causing the super extra penalty on the cluster. =3D=3D=3D Mark Millard marklmi at yahoo.com