From nobody Sun Mar 1 01:48:15 2026 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fNlMj6vjrz6Sm0C for ; Sun, 01 Mar 2026 01:48:33 +0000 (UTC) (envelope-from kob6558@gmail.com) Received: from mail-yx1-xb134.google.com (mail-yx1-xb134.google.com [IPv6:2607:f8b0:4864:20::b134]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4fNlMj4hQCz3nXr for ; Sun, 01 Mar 2026 01:48:33 +0000 (UTC) (envelope-from kob6558@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-yx1-xb134.google.com with SMTP id 956f58d0204a3-64c9c8f8783so3493193d50.1 for ; Sat, 28 Feb 2026 17:48:33 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1772329711; cv=none; d=google.com; s=arc-20240605; b=JdFs/c4IjCKhDmQX1T2YfwguB2xuq/3U3IUNnjv+V8rpiS+JfIZo/0NzysXID4+G5I MXvO3OS/BSscHYFosji/y5xkXRTdnD0iPTPT7EZHSPnqG+OD12BJoEBR114rIXJlR0bu 7EhNBNeY66APK9+KKONCbIFgrkJR7hM22ibgALwyf1hFjIE8oueySKQgM4wfTTvilpen gucy/Wnipflqz/czEbS7DiIi2lvykmIBf5JpAigmg2g0LY/k84yCDrfkcZucdq8uLewY EeFVTt+9fcRxtPQoKiE0xX1ORLMVfPdpnXtEtAOxZcdCBGH2HuimajwF9ekzZMJpTJSq 2/sQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:dkim-signature; bh=ASAeKplJzOvbfHLvMJVKFUgurUcHMDqW/5QP/gMPXcY=; fh=Xm+2y58Xeg/86S/wqA3YUSPH4zyCoVBn9p5W2Fgxa8g=; b=gidoxGtl8QLbQXTE6zNFY5K1TV78c/0M94bw73NUSqRgJAgXv8wuPGHapRdmB2XoYA wMbQ/0qfU4IGe8ei3CM/vwvtrb2Bqtcn0XGyDKtMIv/0pWLtxDdrEUcXzSlDcrYCEmLI KqrEIIwQePfTebfle+iJmgj7P/6k7TD2psik5yz1iGraqwJnK9QsCgYQFIXAzybvfhC4 w55AbBD6Bkk395hqTWIptIZtQWMcPSqFsTohAG83I0KfKwW98mr1JyA9dIMkqjThGW9o 4uVQ6VFcwCbL7LUOC35oAARD7192v+0IZZt/W1l8LNcCGnrvXQkpu1127J7GEwPCh2Q/ 6k5g==; darn=freebsd.org ARC-Authentication-Results: i=1; mx.google.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1772329711; x=1772934511; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=ASAeKplJzOvbfHLvMJVKFUgurUcHMDqW/5QP/gMPXcY=; b=TCrqeJP3p2fYeF92TdldjpIQbuKPoltsUnyza6eic3pgXL1DUyYW7senRO7XxsWnoD 8ITD489c4mPl7aegPdL51lC9jsYl9zbwvxSRDtciPlyvGpvhQMzYVP/n8/XqqDaXnzyn jqJiiV63acfIwt32z9WPtnOAjZ9OaLRLsoEG+tcxn68/OwBFQWNLSvATI/pl/X7vqPOR aMPRnsln7sTO4y92TtOMWD+WUC48xUJS66KhS9g59pfya3PQOvft2JndkgMOv94jakdQ VoaOqykYXjK7oGCigiEdw1pFw06FdkYSicGEg2YLV4ewp9ZWvoUmT9mbnM9Wjc/KkhJ8 qhUA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1772329711; x=1772934511; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-gg:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=ASAeKplJzOvbfHLvMJVKFUgurUcHMDqW/5QP/gMPXcY=; b=wxnWyxOEqwWSeb/i92haRYAl/UhJGB9WMNYduVnPPPOdN4NeW2lasTggRV/i7hCWRu v5PMhd6JnagnXC1pvld5uuk3Wwze8tuy6vmdHX79LXczK6vwksHkD/Vrs//KHdDrcASN 1t3E1j1xHpvkI0X5WsayN8t5hEI6+uefre3czkZbe6NvHuk/EoU4/XmimBpaoP2HgPbj fKH1UHvGRAYcU0eC+x66WVCZuaSabzt9LlnytHzv6htDuOngpTNb6SEV2uvwSoCD4MfR jz7ZZ+8qmv7L2zgjWL4jXcLmcQgzf9a+XpLRqRjAd14P6uAVYE2AEttdBInd1of49dcV A5ZA== X-Gm-Message-State: AOJu0Yx2r6tLGoCZtQoEwmyDENye5LZEEfwxE/0GexE4eKUiwrMQepT0 9+yibaVhxV/kwFjSSWGzLIlGyFVkenHxFEi11e/9iZA4Qc6C4eOj58Oq7o2GjGgjOz5oS2ps9Wk 8PxzjOdM57Pb7/3q0wxfnyalgujLwSWU= X-Gm-Gg: ATEYQzxH45JOx99mqVKgJr++jFmBA4cdTEAnRuFMo+0SJRpUD3ltChelBEhJM/hEgCu 2NJP348Hk21GfYaqHwLEnBmkX6YLEkC9o4xCGQtI0SiZvZF1+Z2Erz6Pc5TOPun6hZyWeQzWjBH AW3uxnvJQflPzsBDtnHPOkpUH61MvTNi7T3F2G3qa0561UiV2umaPDPb+oeRrNF2d+7e343Rw8S tudQJaAx9pj2R9AN5Y3k6FcR3iRe0VUwZWq1Zrdy8upg19nG3lmNUBzd18m050Jwto8fVtLp0vv rr0++k/Q6vKh8QncEc9IB4oIZ//FkD+5UzC8MNPUc2d/WNfdql865L/wMSOq3v4323u/ X-Received: by 2002:a05:690e:d06:b0:64c:b7a6:ec59 with SMTP id 956f58d0204a3-64cc2f0c958mr5764942d50.19.1772329711305; Sat, 28 Feb 2026 17:48:31 -0800 (PST) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 References: <1895ba62-b069-4e28-a910-6c666703ee8e@gmail.com> In-Reply-To: <1895ba62-b069-4e28-a910-6c666703ee8e@gmail.com> From: Kevin Oberman Date: Sat, 28 Feb 2026 17:48:15 -0800 X-Gm-Features: AaiRm513R-L5VofFdJ9yl-L-xraYqAdf2jALsk86RWO4lUpK68E95MtSv8BKQG8 Message-ID: Subject: Re: 504 gateway time-outs (was: FYI: The elapsed time shown for beefy24 [main-amd64] and beefy23 [150amd64-default] stopped over 2hrs ago) To: Graham Perrin Cc: freebsd-current@freebsd.org, freebsd-stable@freebsd.org Content-Type: multipart/alternative; boundary="000000000000de0ae5064becaaaf" X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Queue-Id: 4fNlMj4hQCz3nXr X-Spamd-Bar: ---- --000000000000de0ae5064becaaaf Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Sat, Feb 28, 2026 at 3:33=E2=80=AFAM Graham Perrin wrote: > On 28/02/2026 10:32, Mark Millard wrote: > > =E2=80=A6 > > > > The following got "504 Gateway Time-out" when I tried them: > > > > < > https://pkg-status.freebsd.org/beefy24/build.html?mastername=3Dmain-amd64= -default&build=3Dpdf4f957ea181_s178d0b5b8d > > > > > > < > https://pkg-status.freebsd.org/beefy23/build.html?mastername=3D150amd64-d= efault&build=3Ddf4f957ea181 > > > > > Both somewhat slow to load, however they do load for me. > > Thanks beefy22 is showing hte same issues. Something is tying up the builders with builds hanging in "build-depends" and "lib-depends" for very long periods of time, as long as over 4 hours) with high load averages. This has been going on for months and seems to be getting worse. Chromium builds which used to take around 20 hours are now running around 40 and I really don't think that this is just code bloat. At times, about half of the active builds are in some state other than "build"; mostly one of the depends states which should never take long as all dependencies are built before a build is started. After some time passes (often hours) things clear up. Dependencies are suddenly loaded in a few minutes or less. Note that things do continue to complete, but the 10 minute averages are in single digits and frequently go to 0. During this time, my connection to beefy22 will timeout and sometimes I can't establish a connection. I don't have any special access to the machines... just via pkg-status, so I'm fairly limited in any analysis. --=20 Kevin Oberman, Part time kid herder and retired Network Engineer E-mail: rkoberman@gmail.com PGP Fingerprint: D03FB98AFA78E3B78C1694B318AB39EF1B055683 --000000000000de0ae5064becaaaf Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
On Sat, Feb 28, 2026 at 3:33=E2= =80=AFAM Graham Perrin <graham= perrin@gmail.com> wrote:
On 28/02= /2026 10:32, Mark Millard wrote:
> =E2=80=A6
>
> The following got "504 Gateway Time-out" when I tried them:<= br> >
> <https://pkg-status.freebsd.org/beefy24/build.ht= ml?mastername=3Dmain-amd64-default&build=3Dpdf4f957ea181_s178d0b5b8d>
>
> <https://pkg-status.freebsd.org/beefy23/build.html?mastername= =3D150amd64-default&build=3Ddf4f957ea181>


Both somewhat slow to load, however they do load for me.

Thanks
=C2=A0
beefy22 is showing= hte same issues. Something is tying up the builders with builds hanging in= "build-depends" and "lib-depends" for very long period= s of time, as long as over 4 hours) with high load averages. This has been = going on for months and seems to be getting worse. Chromium builds which us= ed to take around 20 hours are now running around 40 and I really don't= think=C2=A0that this is just code bloat. At times, about half of the activ= e builds=C2=A0are in some state=C2=A0other than "build"; mostly o= ne of the depends states which should never take long as all dependencies a= re built before a build is started.

Afte= r some time passes (often hours) things clear up. Dependencies are suddenly= loaded in a few minutes or less. Note that things do continue to complete,= but the 10 minute averages are in single digits and frequently go to 0. Du= ring this time, my connection to beefy22 will timeout and sometimes I can&#= 39;t establish a connection.

I don't= have any special access to the machines... just via pkg-status, so I'm= fairly limited in any analysis.
--
= Kevin Oberman, Part time kid herder and retired Network Engineer
E-mail:= rkoberman@gmail.c= om
PGP Fingerprint: D03FB98AFA78E3B78C1694B318AB39EF1B055= 683
--000000000000de0ae5064becaaaf--