From nobody Tue Jul 11 04:42:01 2023 X-Original-To: freebsd-ports@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4R0Ss54d9Jz4glkC for ; Tue, 11 Jul 2023 04:42:17 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic307-8.consmr.mail.gq1.yahoo.com (sonic307-8.consmr.mail.gq1.yahoo.com [98.137.64.32]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4R0Ss52Hhcz41DK for ; Tue, 11 Jul 2023 04:42:17 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1689050535; bh=AROvD8WrHKzCF/AMKjBkfyOxGVUmwaHFUznOluBr2Xw=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=fgetHbwg6U9YBQxqT67UXB0RxJwe/ogpizAmp5v90XjlgbSHEurv4T1dAnUstII8rq4u2tcJtpALtZxHBMM7YitwtxxFs85u/xK+w7sGkGWV8zEUpvDPWT4uROFJwj/Bkj+v/SAC0fYHp7R0IquzntBIJifD8jNlAz7E1JH+6roUwqjdnWcWFQSC6SbK40VHnBr8pMYyeHxMXTfUttfRrn4S2ueMy6EPyGzEgWCoV915sZOiYZRH3RvzISrnIgyg2pWBka0eshnzqp+9GHN2NH4Q957/n4Hv307/yyDLSkho8tdjMDam77TK2OhKCQ4KYJTqEdIhEgE2+qvZ15zjRg== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1689050535; bh=6Snh32XkCTu4l2yCQ8YqlZyuoXGg8i9p82WNs/WgAyV=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=KrXg5DgmpS9HU3+Hv4hGE34JUGdAeVaqDdH2voG+8zVSZjJhPitLrWPf/s9EWoNSXnmpobvmWOapE1obS1egyHJgsbdmOg6ZVAveZCEGxD2KW4Yq+eVLzEyOXrQ6/l5XMksbLj4P96x/evhE1B4eF2GgFzyrijYtzWW4rvG8JclHwROqcvRdw53PHcgSkGCIXJc/x1HP4jMYB75JsknkvL8I4txOBXXi37WWxPBQbTbkP6CLUlvK83PXdoj9o9nlRE1sUZuQB0+iAKi84K3KWmaXWAazisN59rIQoAf0BSD6NAIFgajWEdh5Bvie4o24ufAf5T+SO/2zGdJjM79AYA== X-YMail-OSG: syX4incVM1kt9Br7fpY50fRQvisfSI0G_jLw3MtUa7k93ai4foZCfagB5j.6Wsa PN750SEbVlUIZuhE9DincU9qzgje5yK_5wSImf6Vad5ooPbY4_5AXn.Z2yaYh3oCM0Q8PK5bY4tG mdioJloYUgGv1i0F7lhATV4f5gcy9gpg3p8TcA5ZfXuy9cejdvsAd_jzBzhmtf1a9zhIDSdyJgXF iwHK0AstMvtptE.NavTmYYA6HUZaht09YSOY6Ha6U3dPPFRDd.XZiZ_Jqz99I6aLCCL3ZRTQP.YC wSdevMERjni795nSeKf5SxMEfbCnJIJofU4FpWFmtXqD9XKsYq8mcIrCKTv.yjPwkV4FPGmgrwJv lGnYVQ2gxmX.CIteA9BIr7xemJ.hNU8mGvIVH5SlvIkwqk1kTficsjbBeW1AopVyFPDS1kLqsXb0 _asK8KZ.D1NtBj9IG5oPFJW4OJdLJvNA1G9HbdTZVtYr7c50kz0fdaB_Mt4nwDpxg9dxGSHLTsU6 M1l5X2ttK3YuSFsMXHXPqA4x_Nnq7mN7X8GA3eOBUWpYm1pRZyEiBrgaKqdxp5sd935suilZ.AD. pGMEfe7dNuRSafs_2p8bLQb8KTz8IDT_EPo.pBhzRbs.QvmfXFg2zwHpP5cc0.2yFTtDPVyJb_VH SUDsLyFnczpV.Ah3S11Vf_heQ_lgA75bR1MkwQxfWXrc8kz03VAMQ662L5rRTiBleC1NwGBUhXNw vXHtpM2qRn5uUqU_Di7nogMTiA5UkxdZ2pMp0SGzOKGs7ZFlztnljHa5242uhHI7C3l3L_p9B0y. UMEWw.dHUZt8ogNQvvZEguiXN705ptZsmHpEeOFLkQmbsQWmYJIwQRpJmtPoNzd8WvNrDOlTaome m6ucK4JCGL3lkrozmFYAnt054ESW3BKCoCG8Kpg0bQz0UapDvKSEyv3PwWLuBcm1HKBj7abEViIt HwqT87tpZkNWB6B3VPkjxr4fRV13.krNHfnPPL9a.R8bj2oZB1wjb8MPbF39wqEcxqyvvRh12eEV qH2aAo6QAUF.W8KnN_KZX6w5T.X3geQ5XsIwpS33s7ZXpPZX2JysnLLKWvHbB6t5sffXqDQiJBcc q_Vvev7aFSwDvKoat9loW9MXsWjvAKon_r62BYz8OcmJBm_ixPwA8GUrlUXu5ZQ.m9WnKcgiDz7C xTEuG1rjOoyEM8NntM4KjefRg6IveJ0JEAHa1ynCbKqREJ3yKyJez4Ca5FISmsPTCMAdB75eweaa pmSGT3v_eKXdftiMFJRDbg9riUs2iTSh0vYKELE4Vd39F9QRbJrt8ewyx1xCh0725qrMwL6kEKYF NUaFFe.mSX2J.O2HgUkgs0QlVz1EHRrOXKBNF6ioS0Lvh62iHM7XXjQcdRLfUjFi1VC3NjEp091c UsMOByaIoQvoPbr3gTqCRhSTIXNil6Xa38mWo.mncF5KNPYjO.7e7gkQ18hT5pmBhpkAI.Ca3Xq5 FroqYyGBVKtsyDX7DIKNRnmBHnUzCgoN9mlhkmnLBLk7h3Gn.Tw06I5sECXu_45RGZwY.7czJOqm 6JWA2vEJ6SZBQyiLXCCnmVO9TFdkR_SQrZgBBzeK9GwESylWXFsXjp39uRZSezAkE357hbAlt0Nf ruA1_6GZwRfe5mwLZRO8mOwKt9JVTF.QhTtZ9sMvilQRMPijNIy72D3CYTSVFrnklNza4noMz1kq HFo1gJS0Vm6PmbwjBnpflTxALgytMia38e38ZGbiMQSR9hNEl5Io2wC.LJaqcEsvtVJkagy8JNXU rIz782i.XATTqkr3Uqsq6Tqiunyz5hW79YhnALqpRs3SiwCdOlHUZKYFNn9GRr0d.GZIiEo9FH7V Tw0BbqaWec167jdnliCQ44YnjuZ82KLlAr_GBdqAIA1fk7pQuQfMWkpXeuumy7zufET2gIZWBAvp ei6O6XsDalSmKrP5NydCJOdJYHriUkApRkNG028m9dumGfsnALHddwW0y.wfbU.tNwtXHxyMhAX. GVIY8QDOaAc2A3Ua2z6lLopl1W5gj6gJf9ijYYvMSEVR.2TjFEMiXA4PE.gV50124efUzAo9nIeS MhzyYmq8lMFMlDvVqzgJiPD_lgImo5NI_l8dYTQirSSA4DGoyGED0HCKrIcPK7Rn.PQR7QlHMOXD pb0qZPbMvYrmX9Ezf9krEP1BXl0Yaw34ubV.smugCR3u_pGOH5v0AYkgMtq4ADd6u30Y5aSWqdmz JcUTp2UfkwP2.DaedEAr4OcWwjHhmpKQHcmDZH66ngeRZVUYhuM5PNdNe2QvJ6M.Mdmih3IMZcyy ulfXkNA-- X-Sonic-MF: X-Sonic-ID: 782d2e30-992d-460b-9600-7eb3c2900c2f Received: from sonic.gate.mail.ne1.yahoo.com by sonic307.consmr.mail.gq1.yahoo.com with HTTP; Tue, 11 Jul 2023 04:42:15 +0000 Received: by hermes--production-ne1-6d679867d5-bcsgq (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 8fc00a8e5c9c5bcf20ca1e0072857231; Tue, 11 Jul 2023 04:42:13 +0000 (UTC) Content-Type: text/plain; charset=utf-8 List-Id: Porting software to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-ports List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-ports@freebsd.org X-BeenThere: freebsd-ports@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.600.7\)) Subject: Re: Problem with the package builds From: Mark Millard In-Reply-To: <78c1497b-1ec7-08b6-a407-d671e3c4f9dd@gwdg.de> Date: Mon, 10 Jul 2023 21:42:01 -0700 Cc: Kevin Oberman , FreeBSD Mailing List Content-Transfer-Encoding: quoted-printable Message-Id: References: <2DCC0132-0307-4A73-A473-B749ABF87367.ref@yahoo.com> <2DCC0132-0307-4A73-A473-B749ABF87367@yahoo.com> <1aaeafcc-9812-64bd-a369-bae7b9fc0e5f@gwdg.de> <422DBC3B-D85F-4AFB-ABDE-842A08482EC8@yahoo.com> <58250d08-ce0a-c1ac-ed15-7d55d517218e@gwdg.de> <2ea168aa-3e0e-ee31-d4a3-82b4ce46b330@gwdg.de> <78c1497b-1ec7-08b6-a407-d671e3c4f9dd@gwdg.de> To: "Hurling, Rainer" X-Mailer: Apple Mail (2.3731.600.7) X-Rspamd-Queue-Id: 4R0Ss52Hhcz41DK X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On Jul 10, 2023, at 21:27, Rainer Hurling wrote: > Am 10.07.23 um 23:26 schrieb Kevin Oberman: >> On Mon, Jul 10, 2023 at 10:31=E2=80=AFAM Rainer Hurling = > wrote: >> Am 10.07.23 um 08:15 schrieb Rainer Hurling: >> > Am 10.07.23 um 08:08 schrieb Mark Millard: >> >> On Jul 9, 2023, at 22:52, Rainer Hurling > > wrote: >> >> >> >>> Am 10.07.23 um 06:53 schrieb Mark Millard: >> >>>> Konstantin Belousov > > wrote on >> >>>> Date: Mon, 10 Jul 2023 01:18:05 UTC : >> >>>>> On Sun, Jul 09, 2023 at 05:52:50PM -0700, Kevin Oberman = wrote: >> >>>>>> Something looks really messed up on the beefy16 package >> builder for >> >>>>>> 13.1amd64. >> >>>>>> >> >>>>>> It is building about 9500 packages and started almost two = days >> >>>>>> ago. It has >> >>>>>> only completed 459 packages, a rate of 10 packages/hour = and, >> if it >> >>>>>> continues at this rate, will not complete for about 40 = days. Nt >> >>>>>> sure if >> >>>>>> this was triggered by the recent updated to pkg, something = that >> >>>>>> may have >> >>>>>> changed in poudriere or in the configuration, but almost = all >> jails >> >>>>>> are are >> >>>>>> in one of the depends states, lib-depends, build-depends, >> >>>>>> run-depends, >> >>>>>> often running for hours. >> >>>>>> E.g. gnome-desktop-42.4_1 is in lib_depends and has been >> building for >> >>>>>> 1:09:59. Last build of the port took about 55 minutes. ATM >> there >> >>>>>> are 7 >> >>>>>> lib-depends builds, 5 build-depends, and 1 run-depends >> building. >> >>>>>> No jail is >> >>>>>> actually boulding the package, itself. >> >>>>>> >> >>>>>> Wild guess... It is rebuilding all depends every time. In = any >> >>>>>> case, someone >> >>>>>> needs to look at this. >> >>>>>> >> >>>>>> Build report is at >> >>>>>> >> = http://beefy16.nyi.freebsd.org/build.html?mastername=3D131amd64-default&bu= ild=3De81dafc952d7 = >> >>>>> >> >>>>> I noted that 'pkg-static install' seems to be much slower >> locally. >> >>>>> Not looked into it. >> >>>> Summarizing the later observations: >> >>>> Slow: pre-1400000 Jail OSVERSION and recent ports (such as = pkg) >> >>>> ("default") >> >>>> Fast: pre-1400000 Jail OSVERSION and older ports (such as = pkg) >> >>>> ("quarterly") >> >>>> Fast: 1400093 Jail OSVERSION and recent ports (such as = pkg) >> >>>> ("default") >> >>>> (Host OSVERSION 1400089 is a common context across them = all.) >> >>>> Details: >> >>>> The list of build contexts with 50+ hr Elapsed but under 500 >> >>>> ports built looks like: >> >>>> All started on Sat, 08 Jul 2023 01:0[12]:?? GMT: >> >>>> beefy6 124amd64 default >> >>>> Host OSVERSION: 1400089 >> >>>> Jail OSVERSION: 1204000 >> >>>> beefy15 131i386 default >> >>>> Host OSVERSION: 1400089 >> >>>> Jail OSVERSION: 1301000 >> >>>> beefy16 131amd64 default >> >>>> Host OSVERSION: 1400089 >> >>>> Jail OSVERSION: 1301000 >> >>>> But the following 2 built over 5700 ports in under 50 hr = Elapsed. >> >>>> Both started on Sat, 08 Jul 2023 01:01:?? GMT: >> >>>> beefy14 131amd64 quarterly >> >>>> Host OSVERSION: 1400089 >> >>>> Jail OSVERSION: 1301000 >> >>>> beefy13 131i386 quarterly >> >>>> Jail OSVERSION: 1301000 >> >>>> Ignoring armv6's qemu based builds, the more recently = started >> >>>> main-amd64 and main-arm64 builds do not show the problem. >> >>>> Started Sat, 08 Jul 2023 01:29:09 GMT and built over 4400 = ports >> >>>> in under 51 hr: >> >>>> beefy18 main-amd64 default >> >>>> Host OSVERSION: 1400089 >> >>>> Jail OSVERSION: 1400093 >> >>>> Started Sun, 09 Jul 2023 03:11:16 GMT 25:00:07 GMT and built = over >> >>>> 1500 ports in under 26 hrs: >> >>>> ampere2 main-arm64 default >> >>>> Host OSVERSION: 1400089 >> >>>> Jail OSVERSION: 1400093 >> >>>> =3D=3D=3D >> >>>> Mark Millard >> >>>> marklmi at yahoo.com >> >>> >> >>> Since this does not seem to be mentioned in the previous = posts. >> The >> >>> phenomenon does not only occur in the pkg clusters. >> >>> >> >>> In fact, I also observe this severely delayed behavior under >> >>> Poudriere on my very current 14.0-CURRENT box. All *-depends >> sections >> >>> need a multiple of the usual times ... >> >>> >> >> >> >> So, something like: >> >> >> >> Host OSVERSION: 1400093 >> >> Jail OSVERSION: 1400093 >> >> and: >> >> /packages/All/pkg-1.20.1_1.pkg >> > >> > Yes, this corresponds exactly to my versions of the system, the >> jail and >> > ports-mgmt/pkg. >> The newest update of ports-mgmt/pkg to version 1.20.2 by bapt@ = solves >> the problem for me :) >> Great! So, can anyone restart the build or kill it until it will = start again at 1:00 UTC tomorrow morning or will it start building with = the updated pkg? I see no signs of using any change to this point. >=20 > As I understand it, the ports-mgmt/pkg of the system running Poudriere = must be updated beforehand? >=20 > At least on my side, this seems to work as expected :) >=20 poudriere builds pkg updates first (if needed) and then uses the pkg it built for building the later ports into packages. But, after the restarts of main-* builds, the FreeBSD build servers are still showing examples were, after an 1hr, some builds are still in build-depends. Also there was an example I saw were after 1.5 hr it was still in run-depends. It may be that things are improved but not fully fixed relative to some performance issues. =3D=3D=3D Mark Millard marklmi at yahoo.com