From nobody Mon Jul 10 06:08:32 2023 X-Original-To: freebsd-ports@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4QztqR28zfz2tmTZ for ; Mon, 10 Jul 2023 06:08:51 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic312-25.consmr.mail.gq1.yahoo.com (sonic312-25.consmr.mail.gq1.yahoo.com [98.137.69.206]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4QztqQ6xYWz3mst for ; Mon, 10 Jul 2023 06:08:50 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1688969328; bh=E7GlX0kj7qY+iQazwcQU6U+TjofPNNIMHa4Qpn0C41w=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=JOKVd3iH2dEXeh0kfDKZCFe4UNHk7CxBbMucgnO9G5nyq5glu4AmGLOXKbJ1FcS5zRfNuLEv6gfE3Df04RYgBaETX2pamNRrYvwHfjq4ayUNtSIZ+qb36InSpKZahkOcn/dXQxfLLqgNx4muUZEJnbJkXYMIlLmfmA7GfNryTZSFLaZMtI42tHXiI+452I7mWSweuJ15qHv40VAY5KQyoXHTH1sU3N4Al5hAps7Xp8JOoJmD323ue4knDnO+2FdOKX4xPyFBg/qvLPwX7NRVEoFy8qaufpD/6u6thKdb1GWpSk5gSjASp+fzHXfm4IupOWViewh36SVxw9gv9fy+hA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1688969328; bh=RLfL2tvTVUXQ4wFqOA9bEkMwBaipw8DyZ8/YkdosO9E=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=Y+v48AzAHTg2gjmpOjR1RW0r7q8l8jgCDhIWL+4sHMbsNxhbdQIcw1p3Z3jQ1+fVks3NU/eiU0ljPJ9F6Brbmm1O44QyNJXz2aVDX80UTJyq9OAlZWX/rdKJyfKoxRVitLqgEiJI/Ab9kkAUIRXrveCbdubOO+XvFiwze6Y4kBiJZZRTB6ntbz6/rXlcQz4Mua9xJt7LrrCpMvC54hn7uhOcc3beHyaVSrf0GhYfxIOjD5u60v7b3MH78QZjIKN0Q4hbfv/f4ae/z+EXf3iNQ8ljoF5c9o9pC2w1wDR1JlT12ODCE7L3ObjkQ+AUi4R4ie4T1xjdyTxypgUmTiZgzg== X-YMail-OSG: gJsy9OMVM1nx628rt.YIWoJig3B7X6G.1cVlYFRYTyOVW2eC4HIGTAj7QhohCae _Xx8R3nD9LsO5v6EfOJ2rYU5a7HwS7wsRjqpXCaUdMKooZ4dOWwzNShXaHy5qMYx6jgU1AvGzrCU CNfOZ6S5d4JFgGKSgo_RHzvDFs0UUtZCHpYOSHCqQ.a6Sk_APc9ZVfSrtETQvKpqoG_vdBKCQ8Fn XNNWQnDxqehrNWraZfsa.3BXyjAidlhJqW3tII2JHNyncsu7a9E2WDDnIAmHxafhxvoDP2Oqg.eT 49LTh6I32Tw9EpTVV3auYx.LNse92YmNFctxepyPR.mnM49I.D8LznDABJGo57zOwa9nhagj_ujt GDJdQbjehxxLkfIwdJtiXQOsaxR_RYKK7JcrkJsx2Gvxy2we1MEv8VjLFL3wNyvpCELnm1_aITyx czDNyFMS9wcakETF3epLv80unV2AYUyhmgWTSq_C6y80t1xcxsZOz1LJOJ8WPqJgFpZB0cxgbe3q bEtXECMSGJi2BJ3Q.9AElGQgdwCpUrz4V5wSAzoMwhZEZ8vu74tEODJa8mlCI58uRpIwed4f9.eS wQrQPW9eeZQTPbnhb5sUS3vaLH5s9PBBgXmrTwSTTwgb.qn9ZB4sde2xypm5ObEMi4a8vYDVq6my jzI4FNeSQZUcwV5cxODa5G0juZ3UVH60TQUy9wsWKATbrzTf_Mx76MKjAro93mmUL7U_D1U_NzVs t2p.AxuIOqN8zF4jbpFsKDrcajyV_9_QpN_meHRSnIaXnKwLo49uM6f32y1vx4LYrErLGGb4mXq_ .mLg.CHoPYRa_5hDfuxLd.Wu8P8zyH7Duau4WYsrZmzzcIzzd62nKYl3Khry28xjHH1OZrF3zuwI LJyxSLDmpIRpRG3JU6g8drxYuE8MeSKpuagPj1quha4q7VGVbqt5_1MgC.x03bmxXSRkDgKgZYcJ oQXWrk8ru6ROVkVT8oj3C67iqxpd1RFFtIiGdSZTyV.dpSGU2vm7B_LcuLeX.QX6BlNztzJbKm.B _Nh2ZeM4yxeiI6p_GBavhcu68fnl_PDvzo4Il5QW2tJ5w9XCeBfpXeyUoC8bt03w7mBp1HI5aiea i8_xtBiLk6C.ASejYd5oMcipyqHPgsm6U6SfzQ3BfMkT718zxJvtmhhEJAof4I7jn9wuIjcuPdbW KQY675LXFvUN6lVS34AgaqHudYYsTUKk.6NtZQ4CpNMq_Pgpw5Vm0rcQFrPsUxaGQpmd8XrHvVyE QnYUQpYCWvo2FD4XSXNOIrvOTRMwm4Q3aC7uOTQaoWlPUjhQ6haGm4IOBh9R4DXJFGB7ZeuFIq8x 25vaGKDZpFmzM90EU0PAcjwjFgiztAYz7vgHtiNZhy2MwrEYDby1SokdWNtNb7w7CHUQD.OGONU6 FzyvaqzWcch2FQkKRVqZ5JETTjNQWKpOCBcB7.8EtHTJdmMp7mwBPD_AUPv1vXNAvdsRCzFhFUgI sWz3IE3ZBIPcJ8ugUrM2.EBQVegkg2qt5pQBL_CZKzK1AOUqb3iGMbsCr5xQidLbKTMXjV4.FjES uJxVBkdgbLaH1dtGNC8bVyl7a5zBXGr61uR.BnnLxvxFRG_7ALOG7BhIjDUAjet2P1G53k2Rh0sK tHMG6Pq.jNM3fV2kadu4uSOTEer645cVaCaE46IhcWIk8xAISWO0JrmgfRlLI1qgwrfu7R1wtAgE Pa3fj7kqxp6ft2yPFc0BovhR9STS1cqkrUm4IK5dPbwXxDADF_BOCGI0SLvbbzJjsYgutuJPtePi zH.2hfoozRsWOvQw4DE1bZWf5fZgtTFxBEQweAmmMOpjB1S_n0811k4wgkzOOd6nD3.8bub7kJyo .0Kg9h5DuxO0ZFYGxivZhD5Mu0PNUWITT5bZ428uYsxVRz2w3awGqDXQ8IzhrAj.r9bweL5IpRw7 FGIaKWzs8JZMYSRafbMa82dPTxJKlBvw51FeH6yeZKSSG5vDLPr3D42LDsGmU.9RTeGwyJrvPKew YmRXm_sZqacemOSewWTVwRXJzplYAmagGgxzU3bYrfaGeP4gJGAdM7lSj.ZjsLWRUwdtoQvr9yD. ML1SObZBjwOpw7c59HOetrD1y4EZKVzC4FJg.4nyuskx7mS44ioQxGJezVCufOT3mFoG3Qh1pIZM tC4x0SUgywRgcGVSQ10qeOQ6r_owMYVBiZ8yHOiSyCU7MAsX0D9phT0vcjUoN0Lz.Zb_AoZxPJPL 1ttg8APCaDsLx6HHwdvlAPKPyqCnKiQ6rv_mJ2M6a73wbCx58xgfr2zpzDrItyiqbSKR7HxLQu38 - X-Sonic-MF: X-Sonic-ID: ca91345d-1fa7-4278-a993-91e55983ad59 Received: from sonic.gate.mail.ne1.yahoo.com by sonic312.consmr.mail.gq1.yahoo.com with HTTP; Mon, 10 Jul 2023 06:08:48 +0000 Received: by hermes--production-gq1-5748b5bccb-fpxlw (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 948484a7d7ab108d391693374cfbba55; Mon, 10 Jul 2023 06:08:43 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Porting software to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-ports List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-ports@freebsd.org X-BeenThere: freebsd-ports@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.600.7\)) Subject: Re: Problem with the package builds From: Mark Millard In-Reply-To: <1aaeafcc-9812-64bd-a369-bae7b9fc0e5f@gwdg.de> Date: Sun, 9 Jul 2023 23:08:32 -0700 Cc: Konstantin Belousov , Kevin Oberman , FreeBSD Mailing List Content-Transfer-Encoding: quoted-printable Message-Id: <422DBC3B-D85F-4AFB-ABDE-842A08482EC8@yahoo.com> References: <2DCC0132-0307-4A73-A473-B749ABF87367.ref@yahoo.com> <2DCC0132-0307-4A73-A473-B749ABF87367@yahoo.com> <1aaeafcc-9812-64bd-a369-bae7b9fc0e5f@gwdg.de> To: "Hurling, Rainer" X-Mailer: Apple Mail (2.3731.600.7) X-Rspamd-Queue-Id: 4QztqQ6xYWz3mst X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On Jul 9, 2023, at 22:52, Rainer Hurling wrote: > Am 10.07.23 um 06:53 schrieb Mark Millard: >> Konstantin Belousov wrote on >> Date: Mon, 10 Jul 2023 01:18:05 UTC : >>> On Sun, Jul 09, 2023 at 05:52:50PM -0700, Kevin Oberman wrote: >>>> Something looks really messed up on the beefy16 package builder for >>>> 13.1amd64. >>>>=20 >>>> It is building about 9500 packages and started almost two days ago. = It has >>>> only completed 459 packages, a rate of 10 packages/hour and, if it >>>> continues at this rate, will not complete for about 40 days. Nt = sure if >>>> this was triggered by the recent updated to pkg, something that may = have >>>> changed in poudriere or in the configuration, but almost all jails = are are >>>> in one of the depends states, lib-depends, build-depends, = run-depends, >>>> often running for hours. >>>> E.g. gnome-desktop-42.4_1 is in lib_depends and has been building = for >>>> 1:09:59. Last build of the port took about 55 minutes. ATM there = are 7 >>>> lib-depends builds, 5 build-depends, and 1 run-depends building. No = jail is >>>> actually boulding the package, itself. >>>>=20 >>>> Wild guess... It is rebuilding all depends every time. In any case, = someone >>>> needs to look at this. >>>>=20 >>>> Build report is at >>>> = http://beefy16.nyi.freebsd.org/build.html?mastername=3D131amd64-default&bu= ild=3De81dafc952d7 >>>=20 >>> I noted that 'pkg-static install' seems to be much slower locally. >>> Not looked into it. >> Summarizing the later observations: >> Slow: pre-1400000 Jail OSVERSION and recent ports (such as pkg) = ("default") >> Fast: pre-1400000 Jail OSVERSION and older ports (such as pkg) = ("quarterly") >> Fast: 1400093 Jail OSVERSION and recent ports (such as pkg) = ("default") >> (Host OSVERSION 1400089 is a common context across them all.) >> Details: >> The list of build contexts with 50+ hr Elapsed but under 500 >> ports built looks like: >> All started on Sat, 08 Jul 2023 01:0[12]:?? GMT: >> beefy6 124amd64 default >> Host OSVERSION: 1400089 >> Jail OSVERSION: 1204000 >> beefy15 131i386 default >> Host OSVERSION: 1400089 >> Jail OSVERSION: 1301000 >> beefy16 131amd64 default >> Host OSVERSION: 1400089 >> Jail OSVERSION: 1301000 >> But the following 2 built over 5700 ports in under 50 hr Elapsed. >> Both started on Sat, 08 Jul 2023 01:01:?? GMT: >> beefy14 131amd64 quarterly >> Host OSVERSION: 1400089 >> Jail OSVERSION: 1301000 >> beefy13 131i386 quarterly >> Jail OSVERSION: 1301000 >> Ignoring armv6's qemu based builds, the more recently started >> main-amd64 and main-arm64 builds do not show the problem. >> Started Sat, 08 Jul 2023 01:29:09 GMT and built over 4400 ports >> in under 51 hr: >> beefy18 main-amd64 default >> Host OSVERSION: 1400089 >> Jail OSVERSION: 1400093 >> Started Sun, 09 Jul 2023 03:11:16 GMT 25:00:07 GMT and built over >> 1500 ports in under 26 hrs: >> ampere2 main-arm64 default >> Host OSVERSION: 1400089 >> Jail OSVERSION: 1400093 >> =3D=3D=3D >> Mark Millard >> marklmi at yahoo.com >=20 > Since this does not seem to be mentioned in the previous posts. The = phenomenon does not only occur in the pkg clusters. >=20 > In fact, I also observe this severely delayed behavior under Poudriere = on my very current 14.0-CURRENT box. All *-depends sections need a = multiple of the usual times ... >=20 So, something like: Host OSVERSION: 1400093 Jail OSVERSION: 1400093 and: /packages/All/pkg-1.20.1_1.pkg is shown in the port build log files? That would invalidate the utility of the limited observations behind my earlier listing: Fast: 1400093 Jail OSVERSION and recent ports (such as pkg) = ("default") Something else would have to contribute to the distinctions. =3D=3D=3D Mark Millard marklmi at yahoo.com