Date: Tue, 11 Jul 2023 06:27:46 +0200 From: Rainer Hurling <rhurlin@gwdg.de> To: Kevin Oberman <rkoberman@gmail.com> Cc: Mark Millard <marklmi@yahoo.com>, Konstantin Belousov <kostikbel@gmail.com>, FreeBSD Mailing List <freebsd-ports@freebsd.org> Subject: Re: Problem with the package builds Message-ID: <78c1497b-1ec7-08b6-a407-d671e3c4f9dd@gwdg.de> In-Reply-To: <CAN6yY1sqtLCbqW4%2BxtXfduN7WPPQBnd=FbiknnvDFtGMisveaw@mail.gmail.com> References: <2DCC0132-0307-4A73-A473-B749ABF87367.ref@yahoo.com> <2DCC0132-0307-4A73-A473-B749ABF87367@yahoo.com> <1aaeafcc-9812-64bd-a369-bae7b9fc0e5f@gwdg.de> <422DBC3B-D85F-4AFB-ABDE-842A08482EC8@yahoo.com> <58250d08-ce0a-c1ac-ed15-7d55d517218e@gwdg.de> <2ea168aa-3e0e-ee31-d4a3-82b4ce46b330@gwdg.de> <CAN6yY1sqtLCbqW4%2BxtXfduN7WPPQBnd=FbiknnvDFtGMisveaw@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
Am 10.07.23 um 23:26 schrieb Kevin Oberman: > On Mon, Jul 10, 2023 at 10:31 AM Rainer Hurling <rhurlin@gwdg.de > <mailto:rhurlin@gwdg.de>> wrote: > > Am 10.07.23 um 08:15 schrieb Rainer Hurling: > > Am 10.07.23 um 08:08 schrieb Mark Millard: > >> On Jul 9, 2023, at 22:52, Rainer Hurling <rhurlin@gwdg.de > <mailto:rhurlin@gwdg.de>> wrote: > >> > >>> Am 10.07.23 um 06:53 schrieb Mark Millard: > >>>> Konstantin Belousov <kostikbel_at_gmail.com > <http://kostikbel_at_gmail.com>>; wrote on > >>>> Date: Mon, 10 Jul 2023 01:18:05 UTC : > >>>>> On Sun, Jul 09, 2023 at 05:52:50PM -0700, Kevin Oberman wrote: > >>>>>> Something looks really messed up on the beefy16 package > builder for > >>>>>> 13.1amd64. > >>>>>> > >>>>>> It is building about 9500 packages and started almost two days > >>>>>> ago. It has > >>>>>> only completed 459 packages, a rate of 10 packages/hour and, > if it > >>>>>> continues at this rate, will not complete for about 40 days. Nt > >>>>>> sure if > >>>>>> this was triggered by the recent updated to pkg, something that > >>>>>> may have > >>>>>> changed in poudriere or in the configuration, but almost all > jails > >>>>>> are are > >>>>>> in one of the depends states, lib-depends, build-depends, > >>>>>> run-depends, > >>>>>> often running for hours. > >>>>>> E.g. gnome-desktop-42.4_1 is in lib_depends and has been > building for > >>>>>> 1:09:59. Last build of the port took about 55 minutes. ATM > there > >>>>>> are 7 > >>>>>> lib-depends builds, 5 build-depends, and 1 run-depends > building. > >>>>>> No jail is > >>>>>> actually boulding the package, itself. > >>>>>> > >>>>>> Wild guess... It is rebuilding all depends every time. In any > >>>>>> case, someone > >>>>>> needs to look at this. > >>>>>> > >>>>>> Build report is at > >>>>>> > http://beefy16.nyi.freebsd.org/build.html?mastername=131amd64-default&build=e81dafc952d7 <http://beefy16.nyi.freebsd.org/build.html?mastername=131amd64-default&build=e81dafc952d7>; > >>>>> > >>>>> I noted that 'pkg-static install' seems to be much slower > locally. > >>>>> Not looked into it. > >>>> Summarizing the later observations: > >>>> Slow: pre-1400000 Jail OSVERSION and recent ports (such as pkg) > >>>> ("default") > >>>> Fast: pre-1400000 Jail OSVERSION and older ports (such as pkg) > >>>> ("quarterly") > >>>> Fast: 1400093 Jail OSVERSION and recent ports (such as pkg) > >>>> ("default") > >>>> (Host OSVERSION 1400089 is a common context across them all.) > >>>> Details: > >>>> The list of build contexts with 50+ hr Elapsed but under 500 > >>>> ports built looks like: > >>>> All started on Sat, 08 Jul 2023 01:0[12]:?? GMT: > >>>> beefy6 124amd64 default > >>>> Host OSVERSION: 1400089 > >>>> Jail OSVERSION: 1204000 > >>>> beefy15 131i386 default > >>>> Host OSVERSION: 1400089 > >>>> Jail OSVERSION: 1301000 > >>>> beefy16 131amd64 default > >>>> Host OSVERSION: 1400089 > >>>> Jail OSVERSION: 1301000 > >>>> But the following 2 built over 5700 ports in under 50 hr Elapsed. > >>>> Both started on Sat, 08 Jul 2023 01:01:?? GMT: > >>>> beefy14 131amd64 quarterly > >>>> Host OSVERSION: 1400089 > >>>> Jail OSVERSION: 1301000 > >>>> beefy13 131i386 quarterly > >>>> Jail OSVERSION: 1301000 > >>>> Ignoring armv6's qemu based builds, the more recently started > >>>> main-amd64 and main-arm64 builds do not show the problem. > >>>> Started Sat, 08 Jul 2023 01:29:09 GMT and built over 4400 ports > >>>> in under 51 hr: > >>>> beefy18 main-amd64 default > >>>> Host OSVERSION: 1400089 > >>>> Jail OSVERSION: 1400093 > >>>> Started Sun, 09 Jul 2023 03:11:16 GMT 25:00:07 GMT and built over > >>>> 1500 ports in under 26 hrs: > >>>> ampere2 main-arm64 default > >>>> Host OSVERSION: 1400089 > >>>> Jail OSVERSION: 1400093 > >>>> === > >>>> Mark Millard > >>>> marklmi at yahoo.com <http://yahoo.com>; > >>> > >>> Since this does not seem to be mentioned in the previous posts. > The > >>> phenomenon does not only occur in the pkg clusters. > >>> > >>> In fact, I also observe this severely delayed behavior under > >>> Poudriere on my very current 14.0-CURRENT box. All *-depends > sections > >>> need a multiple of the usual times ... > >>> > >> > >> So, something like: > >> > >> Host OSVERSION: 1400093 > >> Jail OSVERSION: 1400093 > >> and: > >> /packages/All/pkg-1.20.1_1.pkg > > > > Yes, this corresponds exactly to my versions of the system, the > jail and > > ports-mgmt/pkg. > > The newest update of ports-mgmt/pkg to version 1.20.2 by bapt@ solves > the problem for me :) > > > Great! So, can anyone restart the build or kill it until it will start > again at 1:00 UTC tomorrow morning or will it start building with the > updated pkg? I see no signs of using any change to this point. As I understand it, the ports-mgmt/pkg of the system running Poudriere must be updated beforehand? At least on my side, this seems to work as expected :) > -- > Kevin Oberman, Part time kid herder and retired Network Engineer > E-mail: rkoberman@gmail.com <mailto:rkoberman@gmail.com> > PGP Fingerprint: D03FB98AFA78E3B78C1694B318AB39EF1B055683
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?78c1497b-1ec7-08b6-a407-d671e3c4f9dd>