Skip site navigation (1)Skip section navigation (2)
Date:      Mon, 10 Jul 2023 07:52:52 +0200
From:      Rainer Hurling <rhurlin@gwdg.de>
To:        Mark Millard <marklmi@yahoo.com>, Konstantin Belousov <kostikbel@gmail.com>, Kevin Oberman <rkoberman@gmail.com>, "FreeBSD Mailing List" <freebsd-ports@freebsd.org>
Subject:   Re: Problem with the package builds
Message-ID:  <1aaeafcc-9812-64bd-a369-bae7b9fc0e5f@gwdg.de>
In-Reply-To: <2DCC0132-0307-4A73-A473-B749ABF87367@yahoo.com>
References:  <2DCC0132-0307-4A73-A473-B749ABF87367.ref@yahoo.com> <2DCC0132-0307-4A73-A473-B749ABF87367@yahoo.com>

next in thread | previous in thread | raw e-mail | index | archive | help
Am 10.07.23 um 06:53 schrieb Mark Millard:
> Konstantin Belousov <kostikbel_at_gmail.com> wrote on
> Date: Mon, 10 Jul 2023 01:18:05 UTC :
> 
>> On Sun, Jul 09, 2023 at 05:52:50PM -0700, Kevin Oberman wrote:
>>> Something looks really messed up on the beefy16 package builder for
>>> 13.1amd64.
>>>
>>> It is building about 9500 packages and started almost two days ago. It has
>>> only completed 459 packages, a rate of 10 packages/hour and, if it
>>> continues at this rate, will not complete for about 40 days. Nt sure if
>>> this was triggered by the recent updated to pkg, something that may have
>>> changed in poudriere or in the configuration, but almost all jails are are
>>> in one of the depends states, lib-depends, build-depends, run-depends,
>>> often running for hours.
>>> E.g. gnome-desktop-42.4_1 is in lib_depends and has been building for
>>> 1:09:59. Last build of the port took about 55 minutes. ATM there are 7
>>> lib-depends builds, 5 build-depends, and 1 run-depends building. No jail is
>>> actually boulding the package, itself.
>>>
>>> Wild guess... It is rebuilding all depends every time. In any case, someone
>>> needs to look at this.
>>>
>>> Build report is at
>>> http://beefy16.nyi.freebsd.org/build.html?mastername=131amd64-default&build=e81dafc952d7
>>
>> I noted that 'pkg-static install' seems to be much slower locally.
>> Not looked into it.
> 
> Summarizing the later observations:
> 
> Slow: pre-1400000 Jail OSVERSION and recent ports (such as pkg) ("default")
> Fast: pre-1400000 Jail OSVERSION and older ports  (such as pkg) ("quarterly")
> Fast: 1400093     Jail OSVERSION and recent ports (such as pkg) ("default")
> 
> (Host OSVERSION 1400089 is a common context across them all.)
> 
> 
> Details:
> 
> The list of build contexts with 50+ hr Elapsed but under 500
> ports built looks like:
> 
> All started on Sat, 08 Jul 2023 01:0[12]:?? GMT:
> 
> beefy6	124amd64	default
> Host OSVERSION: 1400089
> Jail OSVERSION: 1204000
> 
> beefy15	131i386		default
> Host OSVERSION: 1400089
> Jail OSVERSION: 1301000
> 
> beefy16	131amd64	default
> Host OSVERSION: 1400089
> Jail OSVERSION: 1301000
> 
> 
> But the following 2 built over 5700 ports in under 50 hr Elapsed.
> 
> Both started on Sat, 08 Jul 2023 01:01:?? GMT:
> 
> beefy14	131amd64	quarterly
> Host OSVERSION: 1400089
> Jail OSVERSION: 1301000
> 
> beefy13	131i386		quarterly
> Jail OSVERSION: 1301000
> 
> 
> Ignoring armv6's qemu based builds, the more recently started
> main-amd64 and main-arm64 builds do not show the problem.
> 
> Started Sat, 08 Jul 2023 01:29:09 GMT and built over 4400 ports
> in under 51 hr:
> 
> beefy18	main-amd64	default
> Host OSVERSION: 1400089
> Jail OSVERSION: 1400093
> 
> Started Sun, 09 Jul 2023 03:11:16 GMT 25:00:07 GMT and built over
> 1500 ports in under 26 hrs:
> 
> ampere2	main-arm64	default
> Host OSVERSION: 1400089
> Jail OSVERSION: 1400093
> 
> 
> ===
> Mark Millard
> marklmi at yahoo.com
> 
> 

Since this does not seem to be mentioned in the previous posts. The 
phenomenon does not only occur in the pkg clusters.

In fact, I also observe this severely delayed behavior under Poudriere 
on my very current 14.0-CURRENT box. All *-depends sections need a 
multiple of the usual times ...




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?1aaeafcc-9812-64bd-a369-bae7b9fc0e5f>