From nobody Mon Apr 13 17:12:32 2026 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fvYrc0ZfXz6ZRP8 for ; Mon, 13 Apr 2026 17:13:04 +0000 (UTC) (envelope-from janm@transactionware.com) Received: from mail3.transactionware.com (mail.transactionware.com [203.14.245.7]) by mx1.freebsd.org (Postfix) with SMTP id 4fvYrZ6dfyz3L0l for ; Mon, 13 Apr 2026 17:13:02 +0000 (UTC) (envelope-from janm@transactionware.com) Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of janm@transactionware.com designates 203.14.245.7 as permitted sender) smtp.mailfrom=janm@transactionware.com Received: (qmail 66256 invoked by uid 907); 13 Apr 2026 17:12:49 -0000 Received: from ip-109-41-48-64.web.vodafone.de (HELO smtpclient.apple) (109.41.48.64) (smtp-auth username janm, mechanism plain) by mail3.transactionware.com (qpsmtpd/0.84) with (ECDHE-RSA-AES256-GCM-SHA384 encrypted) ESMTPSA; Tue, 14 Apr 2026 03:12:49 +1000 Content-Type: text/plain; charset=utf-8 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3864.500.181\)) Subject: Re: Panic: cache_vop_rename: lingering negative entry From: Jan Martin Mikkelsen In-Reply-To: <44E3FE9A-4244-49EB-97E0-16080B68F12B@transactionware.com> Date: Mon, 13 Apr 2026 19:12:32 +0200 Cc: Konstantin Belousov Content-Transfer-Encoding: quoted-printable Message-Id: References: <2016260A-5C07-45EE-87CA-73918BA16E83@transactionware.com> <44E3FE9A-4244-49EB-97E0-16080B68F12B@transactionware.com> To: current@freebsd.org X-Mailer: Apple Mail (2.3864.500.181) X-Spamd-Result: default: False [-2.70 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.986]; NEURAL_HAM_LONG(-0.51)[-0.515]; R_SPF_ALLOW(-0.20)[+ip4:203.14.245.0/24:c]; MIME_GOOD(-0.10)[text/plain]; RCVD_NO_TLS_LAST(0.10)[]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:17559, ipnet:203.14.245.0/24, country:AU]; ARC_NA(0.00)[]; RCVD_COUNT_ONE(0.00)[1]; TO_DN_SOME(0.00)[]; MIME_TRACE(0.00)[0:+]; MLMMJ_DEST(0.00)[current@freebsd.org]; RCVD_VIA_SMTP_AUTH(0.00)[]; DMARC_NA(0.00)[transactionware.com]; MID_RHS_MATCH_FROM(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; TO_MATCH_ENVRCPT_SOME(0.00)[]; APPLE_MAILER_COMMON(0.00)[]; FROM_HAS_DN(0.00)[] X-Rspamd-Queue-Id: 4fvYrZ6dfyz3L0l X-Spamd-Bar: -- > On 7 Apr 2026, at 20:20, Jan Martin Mikkelsen = wrote: >=20 > On 7 Apr 2026, at 18:53, Konstantin Belousov wrote: >>=20 >> On Tue, Apr 07, 2026 at 05:02:05PM +0200, Jan Martin Mikkelsen wrote: >>> Hi, >>>=20 >>> I am consistently getting the panic below while building = lang/perl5.42. This is the command from the perl build that triggers the = panic: >>>=20 >>> /usr/bin/strip = /ports-work/usr/ports/lang/perl5.42/work/stage/usr/local/bin/perl5.42.0 >>>=20 >>> CURRENT on aarch64, with a kernel from last week, also with a later = one from the weekend. A kernel from mid-January worked fine. >>>=20 >>> I can reproduce on demand, no parallelism in the build required. >>>=20 >>> Does this look familiar to anyone? >>>=20 >>> panic: cache_vop_rename: lingering negative entry >>> cpuid =3D 4 >>> time =3D 1775410763 >>> KDB: stack backtrace: >>> db_trace_self() at db_trace_self >>> db_trace_self_wrapper() at db_trace_self_wrapper+0x38 >>> vpanic() at vpanic+0x1a0 >>> panic() at panic+0x48 >>> cache_vop_rename() at cache_vop_rename+0xb0 >>> zfs_do_rename() at zfs_do_rename+0xafc >>> zfs_freebsd_rename() at zfs_freebsd_rename+0x5c >>> VOP_RENAME_APV() at VOP_RENAME_APV+0x44 >>> kern_renameat () at kern_renameat+0x574 >>> do_el0_sync() at do_el0_sync+0x5f8 >>> handle_el0_sync() at handle_el0_sync+0x4c >>> --- exception, esr 0x56000000 >>> KDB: enter: panic >>> [ thread pid 81230 tid 101738 ] >>> Stopped at kdb_enter+0x48: str xzr, [x19, #3072] >>=20 >> Is it reproducable on UFS and/or tmpfs? >=20 > Successful completion (no panic) when the work directory is on UFS, = and when the work directory is on tmpfs. I didn=E2=80=99t try multiple = times, but it never works on ZFS. The panic consistently reproduces on a ZFS filesystem with the = properties =E2=80=9Cutf8only=3Don=E2=80=9D and "normalization=3DformD=E2=80= =9D. A ZFS file system with =E2=80=9Cutf8only=3Doff=E2=80=9D and = "normalization=3Dnone=E2=80=9D works fine. As far as I can see, strip makes a simple rename(2) call, and testing = rename(2) works fine (as expected). Running the same strip command on = the same files on a fresh system works fine. The smallest reproducer I have at the moment is building lang/perl5.42.0 = with a workdir on a ZFS filesystem enforcing UTF8. Jan M. From nobody Mon Apr 13 18:41:54 2026 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fvbqf3pCrz6ZXWb for ; Mon, 13 Apr 2026 18:42:22 +0000 (UTC) (envelope-from gperciva@tarsnap.com) Received: from mail.tarsnap.com (mail.tarsnap.com [54.86.246.204]) by mx1.freebsd.org (Postfix) with SMTP id 4fvbqc3ztGz3cT6 for ; Mon, 13 Apr 2026 18:42:20 +0000 (UTC) (envelope-from gperciva@tarsnap.com) Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=tarsnap.com; spf=pass (mx1.freebsd.org: domain of gperciva@tarsnap.com designates 54.86.246.204 as permitted sender) smtp.mailfrom=gperciva@tarsnap.com Received: (qmail 69190 invoked from network); 13 Apr 2026 18:42:19 -0000 Received: from unknown (HELO localhost) (127.0.0.1) by mail.tarsnap.com with SMTP; 13 Apr 2026 18:42:19 -0000 Date: Mon, 13 Apr 2026 11:41:54 -0700 From: Graham Percival To: freebsd-current@freebsd.org, freebsd-git-weekly@tarsnap.com Cc: Colin Percival Subject: FreeBSD Git Weekly 2026-04-06 to 2026-04-12 Message-ID: List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline X-Spamd-Result: default: False [-3.68 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.992]; NEURAL_HAM_LONG(-0.99)[-0.988]; DMARC_POLICY_ALLOW(-0.50)[tarsnap.com,none]; R_SPF_ALLOW(-0.20)[+ip4:54.86.246.204/32]; MIME_GOOD(-0.10)[text/plain]; RCVD_NO_TLS_LAST(0.10)[]; ASN(0.00)[asn:14618, ipnet:54.86.0.0/16, country:US]; RCVD_COUNT_ONE(0.00)[1]; MIME_TRACE(0.00)[0:+]; TO_DN_SOME(0.00)[]; ARC_NA(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[54.86.246.204:from]; R_DKIM_NA(0.00)[]; FROM_HAS_DN(0.00)[]; MISSING_XM_UA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCPT_COUNT_THREE(0.00)[3] X-Rspamd-Queue-Id: 4fvbqc3ztGz3cT6 X-Spamd-Bar: --- Hi all, I'm happy to announce FreeBSD git weekly for 2026-04-06 -- 2026-04-12: https://freebsd-git-weekly.tarsnap.net/2026-04-06.html It's a list of the 137 commits in that week, split into categories. Highlighted commits: - RELNOTES: Make an entry for supporting an NFSv4 root fs - MFV: zstd 1.5.7. "Highlighted" commits are selected automatically if a commit modifies UPDATING, or if the commit message contains a "Relnotes:" line. If you think that another commit should be highlighted, let me know and I'm happy to make it so. To see all reports: https://freebsd-git-weekly.tarsnap.net/ This work is funded by cperciva@ and Tarsnap Backup Inc. Cheers, - Graham Percival From nobody Mon Apr 13 20:13:00 2026 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fvdrY16m4z6ZfPH for ; Mon, 13 Apr 2026 20:13:17 +0000 (UTC) (envelope-from kib@freebsd.org) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4fvdrX4mzgz3vTV for ; Mon, 13 Apr 2026 20:13:16 +0000 (UTC) (envelope-from kib@freebsd.org) Authentication-Results: mx1.freebsd.org; none Received: from tom.home (kib@localhost [127.0.0.1] (may be forged)) by kib.kiev.ua (8.18.1/8.18.1) with ESMTP id 63DKD0jB015080; Mon, 13 Apr 2026 23:13:03 +0300 (EEST) (envelope-from kib@freebsd.org) DKIM-Filter: OpenDKIM Filter v2.10.3 kib.kiev.ua 63DKD0jB015080 Received: (from kostik@localhost) by tom.home (8.18.1/8.18.1/Submit) id 63DKD06n015079; Mon, 13 Apr 2026 23:13:00 +0300 (EEST) (envelope-from kib@freebsd.org) X-Authentication-Warning: tom.home: kostik set sender to kib@freebsd.org using -f Date: Mon, 13 Apr 2026 23:13:00 +0300 From: Konstantin Belousov To: Jan Martin Mikkelsen Cc: current@freebsd.org Subject: Re: Panic: cache_vop_rename: lingering negative entry Message-ID: References: <2016260A-5C07-45EE-87CA-73918BA16E83@transactionware.com> <44E3FE9A-4244-49EB-97E0-16080B68F12B@transactionware.com> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED,BAYES_00 autolearn=ham autolearn_force=no version=4.0.2 X-Spam-Checker-Version: SpamAssassin 4.0.2 (2025-08-27) on tom.home X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US] X-Rspamd-Queue-Id: 4fvdrX4mzgz3vTV X-Spamd-Bar: ---- On Mon, Apr 13, 2026 at 07:12:32PM +0200, Jan Martin Mikkelsen wrote: > > > On 7 Apr 2026, at 20:20, Jan Martin Mikkelsen wrote: > > > > On 7 Apr 2026, at 18:53, Konstantin Belousov wrote: > >> > >> On Tue, Apr 07, 2026 at 05:02:05PM +0200, Jan Martin Mikkelsen wrote: > >>> Hi, > >>> > >>> I am consistently getting the panic below while building lang/perl5.42. This is the command from the perl build that triggers the panic: > >>> > >>> /usr/bin/strip /ports-work/usr/ports/lang/perl5.42/work/stage/usr/local/bin/perl5.42.0 > >>> > >>> CURRENT on aarch64, with a kernel from last week, also with a later one from the weekend. A kernel from mid-January worked fine. > >>> > >>> I can reproduce on demand, no parallelism in the build required. > >>> > >>> Does this look familiar to anyone? > >>> > >>> panic: cache_vop_rename: lingering negative entry > >>> cpuid = 4 > >>> time = 1775410763 > >>> KDB: stack backtrace: > >>> db_trace_self() at db_trace_self > >>> db_trace_self_wrapper() at db_trace_self_wrapper+0x38 > >>> vpanic() at vpanic+0x1a0 > >>> panic() at panic+0x48 > >>> cache_vop_rename() at cache_vop_rename+0xb0 > >>> zfs_do_rename() at zfs_do_rename+0xafc > >>> zfs_freebsd_rename() at zfs_freebsd_rename+0x5c > >>> VOP_RENAME_APV() at VOP_RENAME_APV+0x44 > >>> kern_renameat () at kern_renameat+0x574 > >>> do_el0_sync() at do_el0_sync+0x5f8 > >>> handle_el0_sync() at handle_el0_sync+0x4c > >>> --- exception, esr 0x56000000 > >>> KDB: enter: panic > >>> [ thread pid 81230 tid 101738 ] > >>> Stopped at kdb_enter+0x48: str xzr, [x19, #3072] > >> > >> Is it reproducable on UFS and/or tmpfs? > > > > Successful completion (no panic) when the work directory is on UFS, and when the work directory is on tmpfs. I didn’t try multiple times, but it never works on ZFS. > > The panic consistently reproduces on a ZFS filesystem with the properties “utf8only=on” and "normalization=formD”. > > A ZFS file system with “utf8only=off” and "normalization=none” works fine. > > As far as I can see, strip makes a simple rename(2) call, and testing rename(2) works fine (as expected). Running the same strip command on the same files on a fresh system works fine. > > The smallest reproducer I have at the moment is building lang/perl5.42.0 with a workdir on a ZFS filesystem enforcing UTF8. I am now sure that the reason is that the options you used cause the same inode to have more than one name (but not hardlinks). I remember that zfs had option to be case-insensitive, but I may mis-remember. The solution, in any case, is to either stop using namecache when these options are activated, or at least purge all cached entries that has the given dst when the dst vnode is renamed or deleted. Somebody who knows zfs would be needed to make the change. From nobody Tue Apr 14 09:45:08 2026 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fvzsm0zb7z6ZWg9 for ; Tue, 14 Apr 2026 09:45:32 +0000 (UTC) (envelope-from janm@transactionware.com) Received: from mail3.transactionware.com (mail.transactionware.com [203.14.245.7]) by mx1.freebsd.org (Postfix) with SMTP id 4fvzsl2C2Bz3Kjb for ; Tue, 14 Apr 2026 09:45:31 +0000 (UTC) (envelope-from janm@transactionware.com) Authentication-Results: mx1.freebsd.org; none Received: (qmail 96649 invoked by uid 907); 14 Apr 2026 09:45:24 -0000 Received: from ip-109-41-48-64.web.vodafone.de (HELO smtpclient.apple) (109.41.48.64) (smtp-auth username janm, mechanism plain) by mail3.transactionware.com (qpsmtpd/0.84) with (ECDHE-RSA-AES256-GCM-SHA384 encrypted) ESMTPSA; Tue, 14 Apr 2026 19:45:24 +1000 Content-Type: text/plain; charset=utf-8 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3864.500.181\)) Subject: Re: Panic: cache_vop_rename: lingering negative entry From: Jan Martin Mikkelsen In-Reply-To: Date: Tue, 14 Apr 2026 11:45:08 +0200 Cc: current@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <0610AE32-DD37-401B-BA04-8C092D61C8B3@transactionware.com> References: <2016260A-5C07-45EE-87CA-73918BA16E83@transactionware.com> <44E3FE9A-4244-49EB-97E0-16080B68F12B@transactionware.com> To: Konstantin Belousov X-Mailer: Apple Mail (2.3864.500.181) X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:17559, ipnet:203.14.245.0/24, country:AU] X-Rspamd-Queue-Id: 4fvzsl2C2Bz3Kjb X-Spamd-Bar: ---- > On 13 Apr 2026, at 22:13, Konstantin Belousov wrote: >=20 > On Mon, Apr 13, 2026 at 07:12:32PM +0200, Jan Martin Mikkelsen wrote: >>=20 >>> On 7 Apr 2026, at 20:20, Jan Martin Mikkelsen = wrote: >>>=20 >>> On 7 Apr 2026, at 18:53, Konstantin Belousov = wrote: >>>>=20 >>>> On Tue, Apr 07, 2026 at 05:02:05PM +0200, Jan Martin Mikkelsen = wrote: >>>>> Hi, >>>>>=20 >>>>> I am consistently getting the panic below while building = lang/perl5.42. This is the command from the perl build that triggers the = panic: >>>>>=20 >>>>> /usr/bin/strip = /ports-work/usr/ports/lang/perl5.42/work/stage/usr/local/bin/perl5.42.0 >>>>>=20 >>>>> CURRENT on aarch64, with a kernel from last week, also with a = later one from the weekend. A kernel from mid-January worked fine. >>>>>=20 >>>>> I can reproduce on demand, no parallelism in the build required. >>>>>=20 >>>>> Does this look familiar to anyone? >>>>>=20 >>>>> panic: cache_vop_rename: lingering negative entry >>>>> cpuid =3D 4 >>>>> time =3D 1775410763 >>>>> KDB: stack backtrace: >>>>> db_trace_self() at db_trace_self >>>>> db_trace_self_wrapper() at db_trace_self_wrapper+0x38 >>>>> vpanic() at vpanic+0x1a0 >>>>> panic() at panic+0x48 >>>>> cache_vop_rename() at cache_vop_rename+0xb0 >>>>> zfs_do_rename() at zfs_do_rename+0xafc >>>>> zfs_freebsd_rename() at zfs_freebsd_rename+0x5c >>>>> VOP_RENAME_APV() at VOP_RENAME_APV+0x44 >>>>> kern_renameat () at kern_renameat+0x574 >>>>> do_el0_sync() at do_el0_sync+0x5f8 >>>>> handle_el0_sync() at handle_el0_sync+0x4c >>>>> --- exception, esr 0x56000000 >>>>> KDB: enter: panic >>>>> [ thread pid 81230 tid 101738 ] >>>>> Stopped at kdb_enter+0x48: str xzr, [x19, #3072] >>>>=20 >>>> Is it reproducable on UFS and/or tmpfs? >>>=20 >>> Successful completion (no panic) when the work directory is on UFS, = and when the work directory is on tmpfs. I didn=E2=80=99t try multiple = times, but it never works on ZFS. >>=20 >> The panic consistently reproduces on a ZFS filesystem with the = properties =E2=80=9Cutf8only=3Don=E2=80=9D and "normalization=3DformD=E2=80= =9D. >>=20 >> A ZFS file system with =E2=80=9Cutf8only=3Doff=E2=80=9D and = "normalization=3Dnone=E2=80=9D works fine. >>=20 >> As far as I can see, strip makes a simple rename(2) call, and testing = rename(2) works fine (as expected). Running the same strip command on = the same files on a fresh system works fine. >>=20 >> The smallest reproducer I have at the moment is building = lang/perl5.42.0 with a workdir on a ZFS filesystem enforcing UTF8. >=20 > I am now sure that the reason is that the options you used cause the = same > inode to have more than one name (but not hardlinks). I remember that > zfs had option to be case-insensitive, but I may mis-remember. >=20 > The solution, in any case, is to either stop using namecache when = these > options are activated, or at least purge all cached entries that has = the > given dst when the dst vnode is renamed or deleted. >=20 > Somebody who knows zfs would be needed to make the change. I had a look at the ZFS source, and found this: /* * Only use the name cache if we are looking for a * name on a file system that does not require normalization * or case folding. We can also look there if we happen to be * on a non-normalizing, mixed sensitivity file system IF we * are looking for the exact name (which is always the case on * FreeBSD). */ zfsvfs->z_use_namecache =3D !zfsvfs->z_norm || ((zfsvfs->z_case =3D=3D ZFS_CASE_MIXED) && !(zfsvfs->z_norm & ~U8_TEXTPREP_TOUPPER)); The call to cache_vop_rename() which causes the panic is not protected = by an =E2=80=9Cif (zfsvfs->z_use_namecache)=E2=80=9D, unlike the rest of = the code that uses that to decide whether or not to use the namecache. Elsewhere in zfs_vnops_os.c, there is another call to a cache_vop* = function, which is protected by a test: if (zfsvfs->z_use_namecache) cache_vop_rmdir(dvp, vp); It seems to me that this patch could resolve the problem. Does this seem = reasonable? --- a/src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_vnops_os.c = 2026-03-28 20:55:06.000000000 1100 +++ b/src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_vnops_os.c = 2026-03-28 20:55:06.000000000 1100 @@ -3524,7 +3524,7 @@ ZRENAMING, NULL)); } } - if (error =3D=3D 0) { + if (error =3D=3D 0 && zfsvfs->z_use_namecache) { cache_vop_rename(sdvp, *svpp, tdvp, *tvpp, scnp, = tcnp); } } From nobody Tue Apr 14 09:52:53 2026 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fw02W0msCz6ZXPj for ; Tue, 14 Apr 2026 09:53:07 +0000 (UTC) (envelope-from kib@freebsd.org) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4fw02V39sfz3MKM for ; Tue, 14 Apr 2026 09:53:06 +0000 (UTC) (envelope-from kib@freebsd.org) Authentication-Results: mx1.freebsd.org; none Received: from tom.home (kib@localhost [127.0.0.1] (may be forged)) by kib.kiev.ua (8.18.1/8.18.1) with ESMTP id 63E9qssM042532; Tue, 14 Apr 2026 12:52:57 +0300 (EEST) (envelope-from kib@freebsd.org) DKIM-Filter: OpenDKIM Filter v2.10.3 kib.kiev.ua 63E9qssM042532 Received: (from kostik@localhost) by tom.home (8.18.1/8.18.1/Submit) id 63E9qrX5042531; Tue, 14 Apr 2026 12:52:54 +0300 (EEST) (envelope-from kib@freebsd.org) X-Authentication-Warning: tom.home: kostik set sender to kib@freebsd.org using -f Date: Tue, 14 Apr 2026 12:52:53 +0300 From: Konstantin Belousov To: Jan Martin Mikkelsen Cc: current@freebsd.org Subject: Re: Panic: cache_vop_rename: lingering negative entry Message-ID: References: <2016260A-5C07-45EE-87CA-73918BA16E83@transactionware.com> <44E3FE9A-4244-49EB-97E0-16080B68F12B@transactionware.com> <0610AE32-DD37-401B-BA04-8C092D61C8B3@transactionware.com> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <0610AE32-DD37-401B-BA04-8C092D61C8B3@transactionware.com> X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED,BAYES_00 autolearn=ham autolearn_force=no version=4.0.2 X-Spam-Checker-Version: SpamAssassin 4.0.2 (2025-08-27) on tom.home X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US] X-Rspamd-Queue-Id: 4fw02V39sfz3MKM X-Spamd-Bar: ---- On Tue, Apr 14, 2026 at 11:45:08AM +0200, Jan Martin Mikkelsen wrote: > > > On 13 Apr 2026, at 22:13, Konstantin Belousov wrote: > > > > On Mon, Apr 13, 2026 at 07:12:32PM +0200, Jan Martin Mikkelsen wrote: > >> > >>> On 7 Apr 2026, at 20:20, Jan Martin Mikkelsen wrote: > >>> > >>> On 7 Apr 2026, at 18:53, Konstantin Belousov wrote: > >>>> > >>>> On Tue, Apr 07, 2026 at 05:02:05PM +0200, Jan Martin Mikkelsen wrote: > >>>>> Hi, > >>>>> > >>>>> I am consistently getting the panic below while building lang/perl5.42. This is the command from the perl build that triggers the panic: > >>>>> > >>>>> /usr/bin/strip /ports-work/usr/ports/lang/perl5.42/work/stage/usr/local/bin/perl5.42.0 > >>>>> > >>>>> CURRENT on aarch64, with a kernel from last week, also with a later one from the weekend. A kernel from mid-January worked fine. > >>>>> > >>>>> I can reproduce on demand, no parallelism in the build required. > >>>>> > >>>>> Does this look familiar to anyone? > >>>>> > >>>>> panic: cache_vop_rename: lingering negative entry > >>>>> cpuid = 4 > >>>>> time = 1775410763 > >>>>> KDB: stack backtrace: > >>>>> db_trace_self() at db_trace_self > >>>>> db_trace_self_wrapper() at db_trace_self_wrapper+0x38 > >>>>> vpanic() at vpanic+0x1a0 > >>>>> panic() at panic+0x48 > >>>>> cache_vop_rename() at cache_vop_rename+0xb0 > >>>>> zfs_do_rename() at zfs_do_rename+0xafc > >>>>> zfs_freebsd_rename() at zfs_freebsd_rename+0x5c > >>>>> VOP_RENAME_APV() at VOP_RENAME_APV+0x44 > >>>>> kern_renameat () at kern_renameat+0x574 > >>>>> do_el0_sync() at do_el0_sync+0x5f8 > >>>>> handle_el0_sync() at handle_el0_sync+0x4c > >>>>> --- exception, esr 0x56000000 > >>>>> KDB: enter: panic > >>>>> [ thread pid 81230 tid 101738 ] > >>>>> Stopped at kdb_enter+0x48: str xzr, [x19, #3072] > >>>> > >>>> Is it reproducable on UFS and/or tmpfs? > >>> > >>> Successful completion (no panic) when the work directory is on UFS, and when the work directory is on tmpfs. I didn’t try multiple times, but it never works on ZFS. > >> > >> The panic consistently reproduces on a ZFS filesystem with the properties “utf8only=on” and "normalization=formD”. > >> > >> A ZFS file system with “utf8only=off” and "normalization=none” works fine. > >> > >> As far as I can see, strip makes a simple rename(2) call, and testing rename(2) works fine (as expected). Running the same strip command on the same files on a fresh system works fine. > >> > >> The smallest reproducer I have at the moment is building lang/perl5.42.0 with a workdir on a ZFS filesystem enforcing UTF8. > > > > I am now sure that the reason is that the options you used cause the same > > inode to have more than one name (but not hardlinks). I remember that > > zfs had option to be case-insensitive, but I may mis-remember. > > > > The solution, in any case, is to either stop using namecache when these > > options are activated, or at least purge all cached entries that has the > > given dst when the dst vnode is renamed or deleted. > > > > Somebody who knows zfs would be needed to make the change. > > I had a look at the ZFS source, and found this: > > /* > * Only use the name cache if we are looking for a > * name on a file system that does not require normalization > * or case folding. We can also look there if we happen to be > * on a non-normalizing, mixed sensitivity file system IF we > * are looking for the exact name (which is always the case on > * FreeBSD). > */ > zfsvfs->z_use_namecache = !zfsvfs->z_norm || > ((zfsvfs->z_case == ZFS_CASE_MIXED) && > !(zfsvfs->z_norm & ~U8_TEXTPREP_TOUPPER)); > > > The call to cache_vop_rename() which causes the panic is not protected by an “if (zfsvfs->z_use_namecache)”, unlike the rest of the code that uses that to decide whether or not to use the namecache. > > Elsewhere in zfs_vnops_os.c, there is another call to a cache_vop* function, which is protected by a test: > > if (zfsvfs->z_use_namecache) > cache_vop_rmdir(dvp, vp); > > It seems to me that this patch could resolve the problem. Does this seem reasonable? > > --- a/src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_vnops_os.c 2026-03-28 20:55:06.000000000 1100 > +++ b/src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_vnops_os.c 2026-03-28 20:55:06.000000000 1100 > @@ -3524,7 +3524,7 @@ > ZRENAMING, NULL)); > } > } > - if (error == 0) { > + if (error == 0 && zfsvfs->z_use_namecache) { > cache_vop_rename(sdvp, *svpp, tdvp, *tvpp, scnp, tcnp); > } > } > Yes, but please test. If works for you, please either create a Github PR or a review on the FreeBSD' phab. From nobody Tue Apr 14 12:45:51 2026 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fw3tD1Tbdz6YVjn for ; Tue, 14 Apr 2026 12:46:12 +0000 (UTC) (envelope-from rick.macklem@gmail.com) Received: from mail-ed1-x529.google.com (mail-ed1-x529.google.com [IPv6:2a00:1450:4864:20::529]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4fw3tC6Tj9z3pCF for ; Tue, 14 Apr 2026 12:46:11 +0000 (UTC) (envelope-from rick.macklem@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-ed1-x529.google.com with SMTP id 4fb4d7f45d1cf-6715006f4f7so3552847a12.2 for ; Tue, 14 Apr 2026 05:46:11 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1776170765; cv=none; d=google.com; s=arc-20240605; b=Vn5w40n0j1tXVaZBuocoz5jhPTncnoxqh2CuY19oR1qGIn6uyCyVGiAnxDEpLlbXUV JuDrnPwtFioIlGXl9v1SV0HNkMieIOFDqUIpVi5rFonNPHpunvK9PHMWKqr90ztkYYaF 3IynEVIjTjDbFrBGBn1dfZ3BZQ8A+NJLCOiiW3KIByzwHZL9bcXQ8EPglXjOwxiGrFg6 Q3j93Y7YUWzU/HOtDgIf75jILgKyASBRcfG1ntVxy3NiabeZCdd6ac3zs0DJ6hAFIaRK WblLuzFPNFVrkB2F92XOc8h7TlCBhlh/3uc6RWI8cMxwFXGaJ4lBMufeJU5f4HJ6eYGZ 6RAw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:dkim-signature; bh=KKrOQMj7ewOeiEyVKW/Zc+6sfgtdzIOBYajGFhmEzBs=; fh=LgYVcvPvf5xwsitCg3eGR1jep5cgs7EpM2qNONtYrpE=; b=euPoNynej94oaQ+VV4Fu/UnSFccVFZw81lqBrWzoNObzdJpKzuNxdMm1mVoBQU5Y5a RkzKgomd65xUny3QG1CQoPjrvPilMdwQqLWh9ofHLK6w1hZZnqr5vUucGkIhYO3JeLMP ffyj+f9Xfr0I72EeFaUW4T9KXgLMHP7jVk1NJOZKDXKw0U2wZxY+dvMmSrZAfETLbw03 DPDtzEYWUm4wQStdxGYkQrizCn3EGBH49u7LBSNj/D6LyIiZYDgcseWlpabrnqZfd1hH XSev7k0TRU/32hEzuu29OiOk/0587/l//mK1jTlZ6fnBfDYKDoVfqtc/LzIfqZRtfRYZ EJKw==; darn=freebsd.org ARC-Authentication-Results: i=1; mx.google.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20251104; t=1776170765; x=1776775565; darn=freebsd.org; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=KKrOQMj7ewOeiEyVKW/Zc+6sfgtdzIOBYajGFhmEzBs=; b=rOTjtLUCq2r5zI7nG+jF9DiKa0xHL1YNSGYss6BkXsHY9R3c/F94FBcdlVLY1bpZ2E vV8N8kPosJb9LRb9P6AINCjNQuNA81+CCOqKud5fF7F2+b7ITc+YJC+k8iP2PHi8g1pm bCiniGxzBH8t7FiG6AeW9N2j6Apx65s02zsDInSkgwrcMse0nrqZamsyVMdL/pWkM069 132uWnsZ3tdwhtiz59im/osgb/ROTMcSH/d5sFk9F1lfg3pgS2dtUwGStWF+k03qtqPQ duioO4mDAr7LpkJO+J89dcn9X9AfEHrWrd3u6soCNxp5nRTJy1z4iQBGEA9x/V08b+/B QhPg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1776170765; x=1776775565; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-gg:x-gm-message-state:from :to:cc:subject:date:message-id:reply-to; bh=KKrOQMj7ewOeiEyVKW/Zc+6sfgtdzIOBYajGFhmEzBs=; b=YNQig8130h43Hjfn2EIScx1enPmO2+I3vVan5E5ucHAFhu7QxlWAX+T07Ij9xMxgOu O+G4vJsAlmdN35lBITQyxa5dXZajX4gniuDv/0RsGSOqGSMexE2v/aSbWzhpGegyWXRR 4+silEhfjEMzqEZzjhkZVPqDLYyz8nujF7iyN1f2KOFl0dqpv7qAjwOa1zo7u4w+nU2m VQof3xIsQyP3vSDJqLDuf85OiARikh+0JpMZx+mbobPsGYhMbc0jydcnPgZSgcHZ/jEp unSvfV4Dq8IngKGYKOfDvkZBMKLMuLPx5iQOg1836GTsmkLOrWDdnm9PBf0K13E59YLD o9TQ== X-Forwarded-Encrypted: i=1; AFNElJ8E+wCCpOfDwHf9c279Ne+3xffpKqZMw9oVD5U1hBOG3+O3v6YUQsl+UOzsCPOOoXC2E4/DOm43@freebsd.org X-Gm-Message-State: AOJu0YwDRiqtnOF49stmygS0uvifIbhsWoHFSoAdvjZ9P+k1IiqZqHq/ dIcPAWLGY4PqKNmccQ7FIC30vzTa5ffcVEQl3CCkh0P6+IZ8AR/oQGXMYgJbocpucqgxKusVu85 NFa8aVQzzjkif15o2aCxdSLYQjDDGpg== X-Gm-Gg: AeBDieuEoN3UF1ADtNWdrVgkBZJCJz7mkI6hatkLjfwjd8/FMdIVTmtCe3M8FKcn37R xJ5DO6RYId+dvmTlshp1RwXtuY8NtFGwqEnzKPraXFViegzAAlR4RplBo+xbDOaCfmQY4P5dICk oOanqVtS4O3yjdm40okakYSPEjWoJ8xuO08NrcZP7aCndkfFwTDSyjsvyI4TuXkhBI9jwNbR3kO 2amuNWmgY66UZifYB9N3sIIWaj9xSZ7ZKaXmE3+BI7Nhc7iOuRMuwxnyKVchNVSLHMyWSBBAHyM Ds74Ea/Ru5r63YNT7mf31ZJCaU7pbIXggwMbUng= X-Received: by 2002:a05:6402:280c:b0:670:64fd:2301 with SMTP id 4fb4d7f45d1cf-670795162d8mr8327729a12.15.1776170764575; Tue, 14 Apr 2026 05:46:04 -0700 (PDT) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 References: <2016260A-5C07-45EE-87CA-73918BA16E83@transactionware.com> <44E3FE9A-4244-49EB-97E0-16080B68F12B@transactionware.com> <0610AE32-DD37-401B-BA04-8C092D61C8B3@transactionware.com> In-Reply-To: From: Rick Macklem Date: Tue, 14 Apr 2026 05:45:51 -0700 X-Gm-Features: AQROBzDpUBNAQdB6AdRK51k14SfN784x6RBBheGTUx9yT8EruJbxdj3_sh3egNk Message-ID: Subject: Re: Panic: cache_vop_rename: lingering negative entry To: Konstantin Belousov Cc: Jan Martin Mikkelsen , current@freebsd.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; TAGGED_FROM(0.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Queue-Id: 4fw3tC6Tj9z3pCF X-Spamd-Bar: ---- On Tue, Apr 14, 2026 at 2:53=E2=80=AFAM Konstantin Belousov wrote: > > On Tue, Apr 14, 2026 at 11:45:08AM +0200, Jan Martin Mikkelsen wrote: > > > > > On 13 Apr 2026, at 22:13, Konstantin Belousov wrote= : > > > > > > On Mon, Apr 13, 2026 at 07:12:32PM +0200, Jan Martin Mikkelsen wrote: > > >> > > >>> On 7 Apr 2026, at 20:20, Jan Martin Mikkelsen wrote: > > >>> > > >>> On 7 Apr 2026, at 18:53, Konstantin Belousov wrot= e: > > >>>> > > >>>> On Tue, Apr 07, 2026 at 05:02:05PM +0200, Jan Martin Mikkelsen wro= te: > > >>>>> Hi, > > >>>>> > > >>>>> I am consistently getting the panic below while building lang/per= l5.42. This is the command from the perl build that triggers the panic: > > >>>>> > > >>>>> /usr/bin/strip /ports-work/usr/ports/lang/perl5.42/work/stage/usr= /local/bin/perl5.42.0 > > >>>>> > > >>>>> CURRENT on aarch64, with a kernel from last week, also with a lat= er one from the weekend. A kernel from mid-January worked fine. > > >>>>> > > >>>>> I can reproduce on demand, no parallelism in the build required. > > >>>>> > > >>>>> Does this look familiar to anyone? > > >>>>> > > >>>>> panic: cache_vop_rename: lingering negative entry > > >>>>> cpuid =3D 4 > > >>>>> time =3D 1775410763 > > >>>>> KDB: stack backtrace: > > >>>>> db_trace_self() at db_trace_self > > >>>>> db_trace_self_wrapper() at db_trace_self_wrapper+0x38 > > >>>>> vpanic() at vpanic+0x1a0 > > >>>>> panic() at panic+0x48 > > >>>>> cache_vop_rename() at cache_vop_rename+0xb0 > > >>>>> zfs_do_rename() at zfs_do_rename+0xafc > > >>>>> zfs_freebsd_rename() at zfs_freebsd_rename+0x5c > > >>>>> VOP_RENAME_APV() at VOP_RENAME_APV+0x44 > > >>>>> kern_renameat () at kern_renameat+0x574 > > >>>>> do_el0_sync() at do_el0_sync+0x5f8 > > >>>>> handle_el0_sync() at handle_el0_sync+0x4c > > >>>>> --- exception, esr 0x56000000 > > >>>>> KDB: enter: panic > > >>>>> [ thread pid 81230 tid 101738 ] > > >>>>> Stopped at kdb_enter+0x48: str xzr, [x19, #3072] > > >>>> > > >>>> Is it reproducable on UFS and/or tmpfs? > > >>> > > >>> Successful completion (no panic) when the work directory is on UFS,= and when the work directory is on tmpfs. I didn=E2=80=99t try multiple tim= es, but it never works on ZFS. > > >> > > >> The panic consistently reproduces on a ZFS filesystem with the prope= rties =E2=80=9Cutf8only=3Don=E2=80=9D and "normalization=3DformD=E2=80=9D. > > >> > > >> A ZFS file system with =E2=80=9Cutf8only=3Doff=E2=80=9D and "normali= zation=3Dnone=E2=80=9D works fine. > > >> > > >> As far as I can see, strip makes a simple rename(2) call, and testin= g rename(2) works fine (as expected). Running the same strip command on the= same files on a fresh system works fine. > > >> > > >> The smallest reproducer I have at the moment is building lang/perl5.= 42.0 with a workdir on a ZFS filesystem enforcing UTF8. > > > > > > I am now sure that the reason is that the options you used cause the = same > > > inode to have more than one name (but not hardlinks). I remember tha= t > > > zfs had option to be case-insensitive, but I may mis-remember. > > > > > > The solution, in any case, is to either stop using namecache when the= se > > > options are activated, or at least purge all cached entries that has = the > > > given dst when the dst vnode is renamed or deleted. > > > > > > Somebody who knows zfs would be needed to make the change. > > > > I had a look at the ZFS source, and found this: > > > > /* > > * Only use the name cache if we are looking for a > > * name on a file system that does not require normalization > > * or case folding. We can also look there if we happen to be > > * on a non-normalizing, mixed sensitivity file system IF we > > * are looking for the exact name (which is always the case on > > * FreeBSD). > > */ > > zfsvfs->z_use_namecache =3D !zfsvfs->z_norm || > > ((zfsvfs->z_case =3D=3D ZFS_CASE_MIXED) && > > !(zfsvfs->z_norm & ~U8_TEXTPREP_TOUPPER)); > > > > > > The call to cache_vop_rename() which causes the panic is not protected = by an =E2=80=9Cif (zfsvfs->z_use_namecache)=E2=80=9D, unlike the rest of th= e code that uses that to decide whether or not to use the namecache. > > > > Elsewhere in zfs_vnops_os.c, there is another call to a cache_vop* func= tion, which is protected by a test: > > > > if (zfsvfs->z_use_namecache) > > cache_vop_rmdir(dvp, vp); > > > > It seems to me that this patch could resolve the problem. Does this see= m reasonable? > > > > --- a/src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_vnops_os.c 2= 026-03-28 20:55:06.000000000 1100 > > +++ b/src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_vnops_os.c 2= 026-03-28 20:55:06.000000000 1100 > > @@ -3524,7 +3524,7 @@ > > ZRENAMING, NULL)); > > } > > } > > - if (error =3D=3D 0) { > > + if (error =3D=3D 0 && zfsvfs->z_use_namecache) { > > cache_vop_rename(sdvp, *svpp, tdvp, *tvpp, scnp, = tcnp); > > } > > } > > > > Yes, but please test. > If works for you, please either create a Github PR or a review on the > FreeBSD' phab. I find a Pull Request for OpenZFS on github tends to get mav@'s attention pretty quickly, so I think that is the better way to go. rick > From nobody Tue Apr 14 15:57:43 2026 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fw87g3SRLz6Z2fc for ; Tue, 14 Apr 2026 15:58:07 +0000 (UTC) (envelope-from janm@transactionware.com) Received: from mail3.transactionware.com (mail.transactionware.com [203.14.245.7]) by mx1.freebsd.org (Postfix) with SMTP id 4fw87f4VCqz3Jsx for ; Tue, 14 Apr 2026 15:58:06 +0000 (UTC) (envelope-from janm@transactionware.com) Authentication-Results: mx1.freebsd.org; none Received: (qmail 10412 invoked by uid 907); 14 Apr 2026 15:57:59 -0000 Received: from ip-109-41-48-64.web.vodafone.de (HELO smtpclient.apple) (109.41.48.64) (smtp-auth username janm, mechanism plain) by mail3.transactionware.com (qpsmtpd/0.84) with (ECDHE-RSA-AES256-GCM-SHA384 encrypted) ESMTPSA; Wed, 15 Apr 2026 01:57:59 +1000 Content-Type: text/plain; charset=utf-8 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3864.500.181\)) Subject: Re: Panic: cache_vop_rename: lingering negative entry From: Jan Martin Mikkelsen In-Reply-To: Date: Tue, 14 Apr 2026 17:57:43 +0200 Cc: current@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <8E5A88B4-1EDC-415B-BF35-45AED0B18042@transactionware.com> References: <2016260A-5C07-45EE-87CA-73918BA16E83@transactionware.com> <44E3FE9A-4244-49EB-97E0-16080B68F12B@transactionware.com> <0610AE32-DD37-401B-BA04-8C092D61C8B3@transactionware.com> To: Konstantin Belousov X-Mailer: Apple Mail (2.3864.500.181) X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:17559, ipnet:203.14.245.0/24, country:AU] X-Rspamd-Queue-Id: 4fw87f4VCqz3Jsx X-Spamd-Bar: ---- > On 14 Apr 2026, at 11:52, Konstantin Belousov wrote: >=20 > On Tue, Apr 14, 2026 at 11:45:08AM +0200, Jan Martin Mikkelsen wrote: >>=20 >>> On 13 Apr 2026, at 22:13, Konstantin Belousov = wrote: >>>=20 >>> On Mon, Apr 13, 2026 at 07:12:32PM +0200, Jan Martin Mikkelsen = wrote: >>>>=20 >>>>> On 7 Apr 2026, at 20:20, Jan Martin Mikkelsen = wrote: >>>>>=20 >>>>> On 7 Apr 2026, at 18:53, Konstantin Belousov = wrote: >>>>>>=20 >>>>>> On Tue, Apr 07, 2026 at 05:02:05PM +0200, Jan Martin Mikkelsen = wrote: >>>>>>> Hi, >>>>>>>=20 >>>>>>> I am consistently getting the panic below while building = lang/perl5.42. This is the command from the perl build that triggers the = panic: >>>>>>>=20 >>>>>>> /usr/bin/strip = /ports-work/usr/ports/lang/perl5.42/work/stage/usr/local/bin/perl5.42.0 >>>>>>>=20 >>>>>>> CURRENT on aarch64, with a kernel from last week, also with a = later one from the weekend. A kernel from mid-January worked fine. >>>>>>>=20 >>>>>>> I can reproduce on demand, no parallelism in the build required. >>>>>>>=20 >>>>>>> Does this look familiar to anyone? >>>>>>>=20 >>>>>>> panic: cache_vop_rename: lingering negative entry >>>>>>> cpuid =3D 4 >>>>>>> time =3D 1775410763 >>>>>>> KDB: stack backtrace: >>>>>>> db_trace_self() at db_trace_self >>>>>>> db_trace_self_wrapper() at db_trace_self_wrapper+0x38 >>>>>>> vpanic() at vpanic+0x1a0 >>>>>>> panic() at panic+0x48 >>>>>>> cache_vop_rename() at cache_vop_rename+0xb0 >>>>>>> zfs_do_rename() at zfs_do_rename+0xafc >>>>>>> zfs_freebsd_rename() at zfs_freebsd_rename+0x5c >>>>>>> VOP_RENAME_APV() at VOP_RENAME_APV+0x44 >>>>>>> kern_renameat () at kern_renameat+0x574 >>>>>>> do_el0_sync() at do_el0_sync+0x5f8 >>>>>>> handle_el0_sync() at handle_el0_sync+0x4c >>>>>>> --- exception, esr 0x56000000 >>>>>>> KDB: enter: panic >>>>>>> [ thread pid 81230 tid 101738 ] >>>>>>> Stopped at kdb_enter+0x48: str xzr, [x19, #3072] >>>>>>=20 >>>>>> Is it reproducable on UFS and/or tmpfs? >>>>>=20 >>>>> Successful completion (no panic) when the work directory is on = UFS, and when the work directory is on tmpfs. I didn=E2=80=99t try = multiple times, but it never works on ZFS. >>>>=20 >>>> The panic consistently reproduces on a ZFS filesystem with the = properties =E2=80=9Cutf8only=3Don=E2=80=9D and "normalization=3DformD=E2=80= =9D. >>>>=20 >>>> A ZFS file system with =E2=80=9Cutf8only=3Doff=E2=80=9D and = "normalization=3Dnone=E2=80=9D works fine. >>>>=20 >>>> As far as I can see, strip makes a simple rename(2) call, and = testing rename(2) works fine (as expected). Running the same strip = command on the same files on a fresh system works fine. >>>>=20 >>>> The smallest reproducer I have at the moment is building = lang/perl5.42.0 with a workdir on a ZFS filesystem enforcing UTF8. >>>=20 >>> I am now sure that the reason is that the options you used cause the = same >>> inode to have more than one name (but not hardlinks). I remember = that >>> zfs had option to be case-insensitive, but I may mis-remember. >>>=20 >>> The solution, in any case, is to either stop using namecache when = these >>> options are activated, or at least purge all cached entries that has = the >>> given dst when the dst vnode is renamed or deleted. >>>=20 >>> Somebody who knows zfs would be needed to make the change. >>=20 >> I had a look at the ZFS source, and found this: >>=20 >> /* >> * Only use the name cache if we are looking for a >> * name on a file system that does not require normalization >> * or case folding. We can also look there if we happen to be >> * on a non-normalizing, mixed sensitivity file system IF we >> * are looking for the exact name (which is always the case on >> * FreeBSD). >> */ >> zfsvfs->z_use_namecache =3D !zfsvfs->z_norm || >> ((zfsvfs->z_case =3D=3D ZFS_CASE_MIXED) && >> !(zfsvfs->z_norm & ~U8_TEXTPREP_TOUPPER)); >>=20 >>=20 >> The call to cache_vop_rename() which causes the panic is not = protected by an =E2=80=9Cif (zfsvfs->z_use_namecache)=E2=80=9D, unlike = the rest of the code that uses that to decide whether or not to use the = namecache. >>=20 >> Elsewhere in zfs_vnops_os.c, there is another call to a cache_vop* = function, which is protected by a test: >>=20 >> if (zfsvfs->z_use_namecache) >> cache_vop_rmdir(dvp, vp); >>=20 >> It seems to me that this patch could resolve the problem. Does this = seem reasonable? >>=20 >> --- a/src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_vnops_os.c = 2026-03-28 20:55:06.000000000 1100 >> +++ b/src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_vnops_os.c = 2026-03-28 20:55:06.000000000 1100 >> @@ -3524,7 +3524,7 @@ >> ZRENAMING, NULL)); >> } >> } >> - if (error =3D=3D 0) { >> + if (error =3D=3D 0 && zfsvfs->z_use_namecache) { >> cache_vop_rename(sdvp, *svpp, tdvp, *tvpp, scnp, = tcnp); >> } >> } >>=20 >=20 > Yes, but please test. > If works for you, please either create a Github PR or a review on the > FreeBSD' phab. That does seem to fix the panic. I=E2=80=99ll do a GitHub PR. Thanks for = your help. Regards, Jan M.= From nobody Tue Apr 14 19:42:05 2026 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fwF6g0vGPz6ZKwD for ; Tue, 14 Apr 2026 19:42:35 +0000 (UTC) (envelope-from janm@transactionware.com) Received: from mail3.transactionware.com (mail.transactionware.com [203.14.245.7]) by mx1.freebsd.org (Postfix) with SMTP id 4fwF6f1bLnz41C4 for ; Tue, 14 Apr 2026 19:42:33 +0000 (UTC) (envelope-from janm@transactionware.com) Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of janm@transactionware.com designates 203.14.245.7 as permitted sender) smtp.mailfrom=janm@transactionware.com Received: (qmail 18108 invoked by uid 907); 14 Apr 2026 19:42:20 -0000 Received: from p579b0a39.dip0.t-ipconnect.de (HELO smtpclient.apple) (87.155.10.57) (smtp-auth username janm, mechanism plain) by mail3.transactionware.com (qpsmtpd/0.84) with (ECDHE-RSA-AES256-GCM-SHA384 encrypted) ESMTPSA; Wed, 15 Apr 2026 05:42:20 +1000 From: Jan Martin Mikkelsen Message-Id: <019D4A17-B8AF-4768-ADC4-9BDF80BF566B@transactionware.com> Content-Type: multipart/alternative; boundary="Apple-Mail=_2599E8D2-7F1C-46BE-B974-E34D442877AA" List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3864.500.181\)) Subject: Re: Panic: cache_vop_rename: lingering negative entry Date: Tue, 14 Apr 2026 21:42:05 +0200 In-Reply-To: <8E5A88B4-1EDC-415B-BF35-45AED0B18042@transactionware.com> Cc: current@freebsd.org To: Konstantin Belousov References: <2016260A-5C07-45EE-87CA-73918BA16E83@transactionware.com> <44E3FE9A-4244-49EB-97E0-16080B68F12B@transactionware.com> <0610AE32-DD37-401B-BA04-8C092D61C8B3@transactionware.com> <8E5A88B4-1EDC-415B-BF35-45AED0B18042@transactionware.com> X-Mailer: Apple Mail (2.3864.500.181) X-Spamd-Result: default: False [-2.33 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-0.998]; NEURAL_HAM_SHORT(-0.96)[-0.961]; R_SPF_ALLOW(-0.20)[+ip4:203.14.245.0/24:c]; NEURAL_HAM_LONG(-0.17)[-0.167]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; RCVD_NO_TLS_LAST(0.10)[]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:17559, ipnet:203.14.245.0/24, country:AU]; ARC_NA(0.00)[]; RCVD_COUNT_ONE(0.00)[1]; TO_DN_SOME(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; MLMMJ_DEST(0.00)[current@freebsd.org]; RCVD_VIA_SMTP_AUTH(0.00)[]; DMARC_NA(0.00)[transactionware.com]; MID_RHS_MATCH_FROM(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; TO_MATCH_ENVRCPT_SOME(0.00)[]; APPLE_MAILER_COMMON(0.00)[]; FROM_HAS_DN(0.00)[] X-Rspamd-Queue-Id: 4fwF6f1bLnz41C4 X-Spamd-Bar: -- --Apple-Mail=_2599E8D2-7F1C-46BE-B974-E34D442877AA Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 > On 14. Apr 2026, at 17:57, Jan Martin Mikkelsen = wrote: >=20 >=20 >> On 14 Apr 2026, at 11:52, Konstantin Belousov = wrote: >>=20 >> On Tue, Apr 14, 2026 at 11:45:08AM +0200, Jan Martin Mikkelsen wrote: >>>=20 >>>> On 13 Apr 2026, at 22:13, Konstantin Belousov = wrote: >>>>=20 >>>> On Mon, Apr 13, 2026 at 07:12:32PM +0200, Jan Martin Mikkelsen = wrote: >>>>>=20 >>>>>> On 7 Apr 2026, at 20:20, Jan Martin Mikkelsen = wrote: >>>>>>=20 >>>>>> On 7 Apr 2026, at 18:53, Konstantin Belousov = wrote: >>>>>>>=20 >>>>>>> On Tue, Apr 07, 2026 at 05:02:05PM +0200, Jan Martin Mikkelsen = wrote: >>>>>>>> Hi, >>>>>>>>=20 >>>>>>>> I am consistently getting the panic below while building = lang/perl5.42. This is the command from the perl build that triggers the = panic: >>>>>>>>=20 >>>>>>>> /usr/bin/strip = /ports-work/usr/ports/lang/perl5.42/work/stage/usr/local/bin/perl5.42.0 >>>>>>>>=20 >>>>>>>> CURRENT on aarch64, with a kernel from last week, also with a = later one from the weekend. A kernel from mid-January worked fine. >>>>>>>>=20 >>>>>>>> I can reproduce on demand, no parallelism in the build = required. >>>>>>>>=20 >>>>>>>> Does this look familiar to anyone? >>>>>>>>=20 >>>>>>>> panic: cache_vop_rename: lingering negative entry >>>>>>>> cpuid =3D 4 >>>>>>>> time =3D 1775410763 >>>>>>>> KDB: stack backtrace: >>>>>>>> db_trace_self() at db_trace_self >>>>>>>> db_trace_self_wrapper() at db_trace_self_wrapper+0x38 >>>>>>>> vpanic() at vpanic+0x1a0 >>>>>>>> panic() at panic+0x48 >>>>>>>> cache_vop_rename() at cache_vop_rename+0xb0 >>>>>>>> zfs_do_rename() at zfs_do_rename+0xafc >>>>>>>> zfs_freebsd_rename() at zfs_freebsd_rename+0x5c >>>>>>>> VOP_RENAME_APV() at VOP_RENAME_APV+0x44 >>>>>>>> kern_renameat () at kern_renameat+0x574 >>>>>>>> do_el0_sync() at do_el0_sync+0x5f8 >>>>>>>> handle_el0_sync() at handle_el0_sync+0x4c >>>>>>>> --- exception, esr 0x56000000 >>>>>>>> KDB: enter: panic >>>>>>>> [ thread pid 81230 tid 101738 ] >>>>>>>> Stopped at kdb_enter+0x48: str xzr, [x19, #3072] >>>>>>>=20 >>>>>>> Is it reproducable on UFS and/or tmpfs? >>>>>>=20 >>>>>> Successful completion (no panic) when the work directory is on = UFS, and when the work directory is on tmpfs. I didn=E2=80=99t try = multiple times, but it never works on ZFS. >>>>>=20 >>>>> The panic consistently reproduces on a ZFS filesystem with the = properties =E2=80=9Cutf8only=3Don=E2=80=9D and "normalization=3DformD=E2=80= =9D. >>>>>=20 >>>>> A ZFS file system with =E2=80=9Cutf8only=3Doff=E2=80=9D and = "normalization=3Dnone=E2=80=9D works fine. >>>>>=20 >>>>> As far as I can see, strip makes a simple rename(2) call, and = testing rename(2) works fine (as expected). Running the same strip = command on the same files on a fresh system works fine. >>>>>=20 >>>>> The smallest reproducer I have at the moment is building = lang/perl5.42.0 with a workdir on a ZFS filesystem enforcing UTF8. >>>>=20 >>>> I am now sure that the reason is that the options you used cause = the same >>>> inode to have more than one name (but not hardlinks). I remember = that >>>> zfs had option to be case-insensitive, but I may mis-remember. >>>>=20 >>>> The solution, in any case, is to either stop using namecache when = these >>>> options are activated, or at least purge all cached entries that = has the >>>> given dst when the dst vnode is renamed or deleted. >>>>=20 >>>> Somebody who knows zfs would be needed to make the change. >>>=20 >>> I had a look at the ZFS source, and found this: >>>=20 >>> /* >>> * Only use the name cache if we are looking for a >>> * name on a file system that does not require normalization >>> * or case folding. We can also look there if we happen to be >>> * on a non-normalizing, mixed sensitivity file system IF we >>> * are looking for the exact name (which is always the case on >>> * FreeBSD). >>> */ >>> zfsvfs->z_use_namecache =3D !zfsvfs->z_norm || >>> ((zfsvfs->z_case =3D=3D ZFS_CASE_MIXED) && >>> !(zfsvfs->z_norm & ~U8_TEXTPREP_TOUPPER)); >>>=20 >>>=20 >>> The call to cache_vop_rename() which causes the panic is not = protected by an =E2=80=9Cif (zfsvfs->z_use_namecache)=E2=80=9D, unlike = the rest of the code that uses that to decide whether or not to use the = namecache. >>>=20 >>> Elsewhere in zfs_vnops_os.c, there is another call to a cache_vop* = function, which is protected by a test: >>>=20 >>> if (zfsvfs->z_use_namecache) >>> cache_vop_rmdir(dvp, vp); >>>=20 >>> It seems to me that this patch could resolve the problem. Does this = seem reasonable? >>>=20 >>> --- a/src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_vnops_os.c = 2026-03-28 20:55:06.000000000 1100 >>> +++ b/src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_vnops_os.c = 2026-03-28 20:55:06.000000000 1100 >>> @@ -3524,7 +3524,7 @@ >>> ZRENAMING, NULL)); >>> } >>> } >>> - if (error =3D=3D 0) { >>> + if (error =3D=3D 0 && zfsvfs->z_use_namecache) { >>> cache_vop_rename(sdvp, *svpp, tdvp, *tvpp, scnp, = tcnp); >>> } >>> } >>>=20 >>=20 >> Yes, but please test. >> If works for you, please either create a Github PR or a review on the >> FreeBSD' phab. >=20 > That does seem to fix the panic. I=E2=80=99ll do a GitHub PR. Thanks = for your help. https://github.com/openzfs/zfs/pull/18430 --Apple-Mail=_2599E8D2-7F1C-46BE-B974-E34D442877AA Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8
On= 14. Apr 2026, at 17:57, Jan Martin Mikkelsen = <janm@transactionware.com> wrote:


On 14 Apr 2026, at 11:52, Konstantin Belousov = <kib@freebsd.org> wrote:

On Tue, Apr 14, 2026 at 11:45:08AM = +0200, Jan Martin Mikkelsen wrote:

On 13 Apr 2026, at 22:13, = Konstantin Belousov <kib@freebsd.org> wrote:

On Mon, Apr = 13, 2026 at 07:12:32PM +0200, Jan Martin Mikkelsen wrote:

On 7 Apr 2026, at 20:20, Jan = Martin Mikkelsen <janm@transactionware.com> wrote:

On 7 Apr = 2026, at 18:53, Konstantin Belousov <kib@freebsd.org> = wrote:

On Tue, Apr 07, 2026 at = 05:02:05PM +0200, Jan Martin Mikkelsen wrote:
Hi,

I am consistently getting the panic below while = building lang/perl5.42. This is the command from the perl build that = triggers the panic:

/usr/bin/strip = /ports-work/usr/ports/lang/perl5.42/work/stage/usr/local/bin/perl5.42.0
CURRENT on aarch64, with a kernel from last week, also with a later = one from the  weekend. A kernel from mid-January worked = fine.

I can reproduce on demand, no parallelism in the build = required.

Does this look familiar to anyone?

panic: = cache_vop_rename: lingering negative entry
cpuid =3D 4
time =3D = 1775410763
KDB: stack backtrace:
db_trace_self() at = db_trace_self
db_trace_self_wrapper() at = db_trace_self_wrapper+0x38
vpanic() at vpanic+0x1a0
panic() at = panic+0x48
cache_vop_rename() at = cache_vop_rename+0xb0
zfs_do_rename() at = zfs_do_rename+0xafc
zfs_freebsd_rename() at = zfs_freebsd_rename+0x5c
VOP_RENAME_APV() at = VOP_RENAME_APV+0x44
kern_renameat () at = kern_renameat+0x574
do_el0_sync() at = do_el0_sync+0x5f8
handle_el0_sync() at handle_el0_sync+0x4c
--- = exception, esr 0x56000000
KDB: enter: panic
[ thread pid 81230 tid = 101738 ]
Stopped at kdb_enter+0x48: str xzr, [x19, = #3072]

Is it reproducable on UFS and/or = tmpfs?

Successful completion (no panic) when the = work directory is on UFS, and when the work directory is on tmpfs. I = didn=E2=80=99t try multiple times, but it never works on = ZFS.

The panic consistently reproduces on a ZFS = filesystem with the properties  =E2=80=9Cutf8only=3Don=E2=80=9D and = "normalization=3DformD=E2=80=9D.

A ZFS file system with = =E2=80=9Cutf8only=3Doff=E2=80=9D and "normalization=3Dnone=E2=80=9D = works fine.

As far as I can see, strip makes a simple rename(2) = call, and testing rename(2) works fine (as expected). Running the same = strip command on the same files on a fresh system works fine.

The = smallest reproducer I have at the moment is building lang/perl5.42.0 = with a workdir on a ZFS filesystem enforcing UTF8.

I = am now sure that the reason is that the options you used cause the = same
inode to have more than one name (but not hardlinks).  I = remember that
zfs had option to be case-insensitive, but I may = mis-remember.

The solution, in any case, is to either stop using = namecache when these
options are activated, or at least purge all = cached entries that has the
given dst when the dst vnode is renamed = or deleted.

Somebody who knows zfs would be needed to make the = change.

I had a look at the ZFS source, and found = this:

      /*
=        * Only use the name cache if = we are looking for a
       * = name on a file system that does not require normalization
=        * or case folding.  We = can also look there if we happen to be
=        * on a non-normalizing, mixed = sensitivity file system IF we
=        * are looking for the exact = name (which is always the case on
=        * FreeBSD).
=        */
=       zfsvfs->z_use_namecache =3D = !zfsvfs->z_norm ||
=           ((zfsvfs->z= _case =3D=3D ZFS_CASE_MIXED) &&
=           !(zfsvfs->z= _norm & ~U8_TEXTPREP_TOUPPER));


The call to = cache_vop_rename() which causes the panic is not protected by an =E2=80=9C= if (zfsvfs->z_use_namecache)=E2=80=9D, unlike the rest of the code = that uses that to decide whether or not to use the = namecache.

Elsewhere in zfs_vnops_os.c, there is another call to = a cache_vop* function, which is protected by a test:

=       if (zfsvfs->z_use_namecache)
=             &n= bsp; cache_vop_rmdir(dvp, vp);

It seems to me that this = patch could resolve the problem. Does this seem reasonable?

--- = a/src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_vnops_os.c = 2026-03-28 20:55:06.000000000 1100
+++ = b/src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_vnops_os.c = 2026-03-28 20:55:06.000000000 1100
@@ -3524,7 +3524,7 = @@
= = = =    ZRENAMING, NULL));
= }
= = }
- = = if (error =3D=3D 0) {
+ if (error =3D=3D 0 && = zfsvfs->z_use_namecache) {
cache_vop_rename(sdvp, *svpp, = tdvp, *tvpp, scnp, tcnp);
}
}


Yes, = but please test.
If works for you, please either create a Github PR = or a review on the
FreeBSD' phab.

That does seem = to fix the panic. I=E2=80=99ll do a GitHub PR. Thanks for your = help.



= --Apple-Mail=_2599E8D2-7F1C-46BE-B974-E34D442877AA-- From nobody Wed Apr 15 10:24:46 2026 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fwchp062vz6ZfH9; Wed, 15 Apr 2026 10:24:58 +0000 (UTC) (envelope-from vermaden@interia.pl) Received: from smtpo49.interia.pl (smtpo49.interia.pl [217.74.67.49]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4fwchm6Wdcz3G7w; Wed, 15 Apr 2026 10:24:56 +0000 (UTC) (envelope-from vermaden@interia.pl) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=interia.pl header.s=dk header.b=nnS6Ktki; dmarc=pass (policy=none) header.from=interia.pl; spf=pass (mx1.freebsd.org: domain of vermaden@interia.pl designates 217.74.67.49 as permitted sender) smtp.mailfrom=vermaden@interia.pl Date: Wed, 15 Apr 2026 12:24:46 +0200 From: vermaden Subject: Re: Building VM-IMAGE(s) from Source To: "freebsd-stable@FreeBSD.org" , "freebsd-hackers@FreeBSD.org" , "freebsd-current@freebsd.org" X-Mailer: interia.pl/pf09 In-Reply-To: References: X-Originating-IP: 45.148.42.24 Message-Id: List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=interia.pl; s=dk; t=1776248689; bh=XPieJgnPOE7kBBdVbQlaOFFaML/q7rsTcPBDI8tIuy0=; h=Date:From:Subject:To:Message-Id:MIME-Version:Content-Type; b=nnS6KtkiCRJ9NcUVgx7Jzm+7rCS3uNSuaI8+U/kPCmfgdRE0fRjFBTTEUdurUONHZ c9tmj2QgCj3U9BlOcG2x7ojzE2W8Pi8rYcWGXgVh2noqFiwrTQtgoqf6HqmScfPgFj quSM3r44CBg7bZqYmWFcgKScYH5QAWMSKo8KeKNs= X-Spamd-Result: default: False [-1.01 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_SPAM_SHORT(0.81)[0.811]; DMARC_POLICY_ALLOW(-0.50)[interia.pl,none]; MID_RHS_NOT_FQDN(0.50)[]; NEURAL_HAM_MEDIUM(-0.32)[-0.320]; R_DKIM_ALLOW(-0.20)[interia.pl:s=dk]; R_SPF_ALLOW(-0.20)[+ip4:217.74.64.0/22]; ONCE_RECEIVED(0.10)[]; RWL_MAILSPIKE_GOOD(-0.10)[217.74.67.49:from]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; SUSPICIOUS_AUTH_ORIGIN(0.00)[]; FREEMAIL_FROM(0.00)[interia.pl]; MIME_TRACE(0.00)[0:+]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DKIM_TRACE(0.00)[interia.pl:+]; FREEMAIL_ENVFROM(0.00)[interia.pl]; HAS_XOIP(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; TO_DN_EQ_ADDR_ALL(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org,freebsd-hackers@freebsd.org,freebsd-stable@freebsd.org]; ASN(0.00)[asn:16138, ipnet:217.74.64.0/22, country:PL]; RCVD_COUNT_ZERO(0.00)[0]; RCPT_COUNT_THREE(0.00)[3]; DWL_DNSWL_NONE(0.00)[interia.pl:dkim] X-Rspamd-Queue-Id: 4fwchm6Wdcz3G7w X-Spamd-Bar: - I was not able to get 'release.sh' to success even a single time - it always failed with different errors - the 'help' I received here also did not pushed things forward ... so I wrote my own verimg(8) tool for similar things as 'release.sh' does. Here are the details: - https://vermaden.wordpress.com/2026/04/15/freebsd-image-builder-installer-verimg-tool/ Here is the verimg(8) repo: - https://github.com/vermaden/verimg Maybe someone will find that useful. Regards, vermaden Temat: Building VM-IMAGE(s) from Source Data: 2026-04-09 0:34 Nadawca: "vermaden" <vermaden@interia.pl> Adresat: freebsd-stable@FreeBSD.org; freebsd-hackers@FreeBSD.org; freebsd-current@freebsd.org; > Hi, > > I want to build VM images from source, the same ones that are here: > - https://download.freebsd.org/releases/VM-IMAGES/15.0-RELEASE/amd64/Latest/ > > What I did: > > (...) > > ... but the VMIMAGES are not built ... or maybe I am doing something wrong. > > The contents in /usr/src/release/Makefile and release(7) are alsoe different. > > Please advice. > > Thanks, > vermaden From nobody Wed Apr 15 10:35:08 2026 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fwcwc5GS2z6Zg5X; Wed, 15 Apr 2026 10:35:12 +0000 (UTC) (envelope-from des@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R13" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4fwcwc4bzQz3KMc; Wed, 15 Apr 2026 10:35:12 +0000 (UTC) (envelope-from des@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776249312; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=y9hq6qb9Loc0fmo/0BpxpZWYkFYKPS+clzQJtVIDS8Q=; b=NBKG5BkBpESITTiUCbhzOm4HWniRirHc0Q/tG/6Lb96lQjoQdTE63apktS0pEmtmVZL6qW WRF6ckecoV0GpUDyOz7oRLPZuiKfTPRf+7fYo6UlymRXVy8ZAfkA7YxS4GtDKY6L11yqL6 3q2L5ydBiXTCVss5euqBo5VeYhpp02P7J23OntqhUKdZwFoK5DoW3g/P8atu7fByhqBgV9 p/Rr2QfZwfliBroPNk3CbuWjuLu6QpoapbRTo5wTW5mv2FCbPnp/FcBVu6sFf/tmWTrO4X KkulywZy8Gwmc/GgsIVQrbA3qCBQbhJ4lubycGVngV1lztpza8jBcMm9KLsxLQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1776249312; a=rsa-sha256; cv=none; b=I6cykfqq3yHgNBByB1eDLL2Ji+IdkCRYUIaxV8J0zBv78p2wNgjbAl8cffL6NqBX2J7NtJ ES3YCruNAwVDzqMrsx7DRAqaxRuUqbwRCRN0qBzSzRPAmTtPj+Dk/WNfKexb0+7TW+EiSN p9ia4FvtjOVDPX+eyW5DWCz4nijKIzHrD8IuWV20fbuE3zYrc3Vvoq4BOYwaDMV6xkvcQd tFmA06Kq6HivGI3VnB+3k769veqBEJi70tzOAzKqohD9Q2dCFBx4KFARWYskmdRj0W4MW2 ++ZjF1hkcnVfvv+dvWPB5GJ2NUcWnZFc4tw1t/sYNz9SJRJHsGgdD/umTx4Z5A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776249312; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=y9hq6qb9Loc0fmo/0BpxpZWYkFYKPS+clzQJtVIDS8Q=; b=dZB/jLX8gPe6RLnyui+CjHjFvc/Vh/ZI9mOnQkDZbxGBTpPYQbZgrDLFgyVySmaGMVym4E NaHDTglDmIxzz8vMy5spPWLUXt9EvjF0lzey7ZzEEq0cGqKyBhv/sCwo15TeAO88vyGwRW hXxfl6bwR6h/QG0FEL1PckjC3YRL9ziB2iQAq6uF8SBlGlIUqLV6snTygLhsj5SkKIavKX YY7O582qCcSyuSGK/JMNcH5iyUrnHF16ceGPA2+NQ5d5sAfhobav8eJji4sL3U3h6XDngX yBAr5dPIAm5NeG3F2DP/id+tuEx69R8L6eRQQUqgdK0julPQQkseZjVPh8Oy4g== Received: from ltc.des.dev (lfbn-nan-1-698-103.w86-236.abo.wanadoo.fr [86.236.35.103]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: des/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 4fwcwc2ZY6zRPZ; Wed, 15 Apr 2026 10:35:12 +0000 (UTC) (envelope-from des@freebsd.org) Received: by ltc.des.dev (Postfix, from userid 1001) id 9EF90F797; Wed, 15 Apr 2026 12:35:08 +0200 (CEST) From: =?utf-8?Q?Dag-Erling_Sm=C3=B8rgrav?= To: vermaden Cc: "freebsd-stable@FreeBSD.org" , "freebsd-hackers@FreeBSD.org" , "freebsd-current@freebsd.org" Subject: Re: Building VM-IMAGE(s) from Source In-Reply-To: (vermaden@interia.pl's message of "Wed, 15 Apr 2026 12:24:46 +0200") References: User-Agent: Gnus/5.13 (Gnus v5.13) Date: Wed, 15 Apr 2026 12:35:08 +0200 Message-ID: <86h5pceckj.fsf@ltc.des.dev> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable vermaden writes: > I was not able to get 'release.sh' to success even a single time - it > always failed with different errors - the 'help' I received here also > did not pushed things forward ... You mean the correct advice that you ignored? You ran this: make -j 24 release.conf=3Dcustom.conf release First of all, as Colin told you, you need to define WITH_VMIMAGES either in your environment, in make.conf, or on the make command line. Adding it to your release configuration file has no effect. Second, `release.conf=3Dcustom.conf` has no effect either. You just made that up. The correct variable name is RELEASECONF. Third, you could easily have learned this by reading the Makefile and release.sh, they're not particularly complex. DES --=20 Dag-Erling Sm=C3=B8rgrav - des@FreeBSD.org From nobody Wed Apr 15 10:52:42 2026 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fwdJt63Mmz6ZhZm; Wed, 15 Apr 2026 10:52:46 +0000 (UTC) (envelope-from vermaden@interia.pl) Received: from smtpo49.interia.pl (smtpo49.interia.pl [217.74.67.49]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4fwdJt52qfz3PNj; Wed, 15 Apr 2026 10:52:46 +0000 (UTC) (envelope-from vermaden@interia.pl) Authentication-Results: mx1.freebsd.org; none Date: Wed, 15 Apr 2026 12:52:42 +0200 From: vermaden Subject: Re: Building VM-IMAGE(s) from Source To: Dag-Erling =?iso-8859-1?q?Sm=F8rgrav?= Cc: "freebsd-stable@FreeBSD.org" , "freebsd-hackers@FreeBSD.org" , "freebsd-current@freebsd.org" X-Mailer: interia.pl/pf09 In-Reply-To: <86h5pceckj.fsf@ltc.des.dev> References: <86h5pceckj.fsf@ltc.des.dev> X-Originating-IP: 45.148.42.24 Message-Id: List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=interia.pl; s=dk; t=1776250365; bh=GbhPrhtuHCRho3FKcpqy2ouLMpJdOWlrIx06PZJz0b4=; h=Date:From:Subject:To:Message-Id:MIME-Version:Content-Type; b=ZCjvjsA4C5IMxWCchoS/4JqlQIlfZkAl6lNmYuT1KRBMj5n5+1E59CV4hy8LbcgiH ZPoMMedF6mfCUQ4aWEjfH8JYb8vRBLy3e3Wc8+jh5mGT9mnUxdSNsv6iyEaCa8YRjG vrJhkOw2QkYGJDTTpL91N+POKdU61qclsVY4pitA= X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:16138, ipnet:217.74.64.0/22, country:PL] X-Rspamd-Queue-Id: 4fwdJt52qfz3PNj X-Spamd-Bar: ---- > Adding it to your release configuration file has no effect. Colin did not wrote WHERE to put it - he just wrote this: > You want WITH_VMIMAGES=YES. ... and I had that in release config. But contents of 'release.conf.sample' are useless and misleading. % grep -m 1 -B 2 WITH_VMIMAGES /usr/src/release/release.conf.sample ## Set to a non-empty value to build virtual machine images as part of the ## release build. #WITH_VMIMAGES= > Second, `release.conf=custom.conf` has no effect either. I later moved to this ... and it failed on build stage everytime in different places: # ./release.sh -c build.conf ... on system with 8 AMD Ryzen CPUs and 28 GB RAM and 200 GB of SSD. But 'regular' command like that below worked without any problem: # make -j 8 buildworld buildkernel But all this is pointless now - I moved on to verimg(8) and I am more then happy with it. From nobody Wed Apr 15 13:03:47 2026 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fwhDH6P8cz6ZrLj for ; Wed, 15 Apr 2026 13:03:59 +0000 (UTC) (envelope-from freebsd-current-freebsd-org111@ketas.si.pri.ee) Received: from mail.ketas.si.pri.ee (d004-fea2-0bff-021e-13e8-8437-07d0-2001.dyn.estpak.ee [IPv6:2001:7d0:8437:13e8:21e:bff:fea2:d004]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4fwhDG1HwWz3dP6 for ; Wed, 15 Apr 2026 13:03:57 +0000 (UTC) (envelope-from freebsd-current-freebsd-org111@ketas.si.pri.ee) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=ketas.si.pri.ee header.s=ketas-si-pri-ee-20240416002854-4096 header.b=zemKC+zX; dmarc=pass (policy=reject) header.from=ketas.si.pri.ee; spf=pass (mx1.freebsd.org: domain of freebsd-current-freebsd-org111@ketas.si.pri.ee designates 2001:7d0:8437:13e8:21e:bff:fea2:d004 as permitted sender) smtp.mailfrom=freebsd-current-freebsd-org111@ketas.si.pri.ee X-Original-To: freebsd-current@freebsd.org DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=ketas.si.pri.ee; s=ketas-si-pri-ee-20240416002854-4096; t=1776258228; bh=j/VPU7vMI33cx6ANb9/1X0rEg8zvk8jY827vMnAvV/s=; h=Date:From:To:Subject:In-Reply-To:References; b=zemKC+zXMmiwsRIxUvwb4M1S09z6/Jb0HHNLAPosqmvnqYUpV/qm+mc05BcvadTVR QBT4MGdK0JkV/aDVG4snr2XkVAXbILO9mwc2bpiddI0+FUSQUi7etIN7Y//W9DgtC9 yIQMZU2C2tBB1HIpqvkyl9zZm68FyrMp+lh/JHA99BRT8qwYIphf4VYP0apSKiLAlw qrUS0hAZOjdTE8oKIp77zN19ClVBDWopFgbkoh0aJcZTZbRW2RT1sdEC9kgcv17gf6 lc0/kvL5mJtuvF0AtqMsjkHf3B5wIILiz0lx4sBqoBQbLK+WbMI0jNfx+MViMSzQBS 3tIQppfufQcEihmb2GPIqIgb6mi2xwKovkn2RcIkHaOmGD45IufUb9EXwls00Iw/u0 Gdxogl0A+6B4CqRirTBNPNKztGqmSwL6BlouuQCTE2clGTecJAcFE5oy8gV0BTaroe r8gzbbQ5GB97cbJwNszmPgOjoG6OPsONMKzuWeiT1rhlFNpiwzWC3+p9BTRMJSDJOV LSyDmO63aBVM4s0Ex4ER4ITdiUh7qVa/fKUZ2lXdDUE5Ww91kSpJHhjXLhiTxTk+GR uz4j8eNc3jIsFDWSC5jQsIKLwZPJDkbLBrZZ66MQJrCFMaRvpcnBRJ8+lb1wIKu5bs xOcoYtsng2enayHYEjq3gQdA= Received: from ehlo.thunderbird.net (0115-0000-0000-0000-13c8-8437-07d0-2001.dyn.estpak.ee [IPv6:2001:7d0:8437:13c8::115]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by mail.ketas.si.pri.ee (Postfix) with ESMTPSA id D4ED25D73B8 for ; Wed, 15 Apr 2026 16:03:47 +0300 (EEST) Date: Wed, 15 Apr 2026 16:03:47 +0300 From: Sulev-Madis Silber To: freebsd-current@freebsd.org Subject: Re: Building VM-IMAGE(s) from Source User-Agent: K-9 Mail for Android In-Reply-To: References: <86h5pceckj.fsf@ltc.des.dev> Message-ID: List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spamd-Result: default: False [-0.80 / 15.00]; HFILTER_HOSTNAME_5(3.00)[d004-fea2-0bff-021e-13e8-8437-07d0-2001.dyn.estpak.ee]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; DMARC_POLICY_ALLOW(-0.50)[ketas.si.pri.ee,reject]; R_DKIM_ALLOW(-0.20)[ketas.si.pri.ee:s=ketas-si-pri-ee-20240416002854-4096]; R_SPF_ALLOW(-0.20)[+ip6:2001:7d0:8437:1300::/56]; ONCE_RECEIVED(0.20)[]; MIME_GOOD(-0.10)[text/plain]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_ONE(0.00)[1]; ASN(0.00)[asn:3249, ipnet:2001:7d0::/32, country:EE]; RCVD_VIA_SMTP_AUTH(0.00)[]; MIME_TRACE(0.00)[0:+]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCVD_TLS_ALL(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_NONE(0.00)[]; DKIM_TRACE(0.00)[ketas.si.pri.ee:+] X-Rspamd-Queue-Id: 4fwhDG1HwWz3dP6 X-Spamd-Bar: / funnily, i had huge problems with release too, so i also wrote my own tool release parts have been improved lately, especially man pages around it but it's still very complex to get=2E even when i have tried to read confi= gs, manpages, makefiles, handbook etc=2E it feels like something is missing= =2E it's either in releng private repo or inside someone's brain=2E if in b= rain, those sometimes sadly expire and take all data with them, so=2E=2E=2E this comes from someone who installed 4=2E6 at age of 19 On April 15, 2026 1:52:42 PM GMT+03:00, vermaden w= rote: >> Adding it to your release configuration file has no effect=2E > >Colin did not wrote WHERE to put it - he just wrote this: > >> You want WITH_VMIMAGES=3DYES=2E > >=2E=2E=2E and I had that in release config=2E > >But contents of 'release=2Econf=2Esample' are useless and misleading=2E > >% grep -m 1 -B 2 WITH_VMIMAGES /usr/src/release/release=2Econf=2Esample >## Set to a non-empty value to build virtual machine images as part of th= e >## release build=2E >#WITH_VMIMAGES=3D > > > >> Second, `release=2Econf=3Dcustom=2Econf` has no effect either=2E > >I later moved to this =2E=2E=2E and it failed on build stage everytime in= different places: > ># =2E/release=2Esh -c build=2Econf > >=2E=2E=2E on system with 8 AMD Ryzen CPUs and 28 GB RAM and 200 GB of SSD= =2E > >But 'regular' command like that below worked without any problem: > ># make -j 8 buildworld buildkernel > > > >But all this is pointless now - I moved on to verimg(8) and I am more the= n happy with it=2E > > > > > From nobody Wed Apr 15 19:32:26 2026 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fwrrd3jgKz6ZLbT for ; Wed, 15 Apr 2026 19:32:33 +0000 (UTC) (envelope-from shawn.webb@hardenedbsd.org) Received: from mail-oi1-x230.google.com (mail-oi1-x230.google.com [IPv6:2607:f8b0:4864:20::230]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4fwrrc4RMZz3VJw for ; Wed, 15 Apr 2026 19:32:32 +0000 (UTC) (envelope-from shawn.webb@hardenedbsd.org) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=hardenedbsd.org header.s=google header.b=XJt6MCxt; dmarc=pass (policy=none) header.from=hardenedbsd.org; spf=pass (mx1.freebsd.org: domain of shawn.webb@hardenedbsd.org designates 2607:f8b0:4864:20::230 as permitted sender) smtp.mailfrom=shawn.webb@hardenedbsd.org Received: by mail-oi1-x230.google.com with SMTP id 5614622812f47-464ba2bb3aeso4162903b6e.1 for ; Wed, 15 Apr 2026 12:32:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hardenedbsd.org; s=google; t=1776281546; x=1776886346; darn=freebsd.org; h=content-disposition:mime-version:message-id:subject:to:from:date :from:to:cc:subject:date:message-id:reply-to; bh=8rRLSPpTkfrLysetvANIv5gMAlBmWt49rQ1AdxhHNPY=; b=XJt6MCxtM+WzqcdvVucrdQFUrx9a0VJ3Wa1DyatZa2/Irhel1yi5lrI9m2HSlXfADK EJXv14tSlxKBOdmLqhZXWOc75bvnHzbW6za4ga37VU6QfmEBlB8+NOY7sN7Z8jlkozPg wArpKdnEVFjR9FIz/KFGFyub2v0pWqeWFHQSuMVBb36+4XQJOInNfjmYoGVf7fg6mueR 5UTbtWJsBLXJltDJPYlEYRzbA27oa0Z2VRAfjsEQWJaozEzuSexWhlqHppL5YKU0FV5D oeaqXv/RD7O9RRUOEWxfi4YPntK0iuS2za7i7v/CneBKVQeVh2YhZb+Wr4zhC1Nqu/2E YSvg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1776281546; x=1776886346; h=content-disposition:mime-version:message-id:subject:to:from:date :x-gm-gg:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=8rRLSPpTkfrLysetvANIv5gMAlBmWt49rQ1AdxhHNPY=; b=XDzqB9QOpo4QrLEmp7IbPSwVnEtz4FQZ/RufBjit9RV+xvWrxuohyJKS6dKskNZBjJ dT16AVbGgCXx5GyllBJP8LeUUS48HW0rVK9kxnOzM7wW+6ocOQ8P7z0SNzaMjA5+fEk1 1KWAnzMkPbKq4UCP4xJwE1vqCpPWrQn6qnZ1MrsuQ8RvXOHM1uSTCUG8Bq2Sx3bbzFF0 rcTMXXdke3pVfbkW6v4BUNCMRLq8OB9iGIPSMMDoFV5MuXSEvyyEIcoxxjxglV2AwZtY JEqTfp8DYCwf1gAIM5UbMhmyxSkxUqj12pt5aC+09n1oFpvbDkonX2OGel+FYwtXjdsD q+eQ== X-Gm-Message-State: AOJu0Ywb9rBvnH7fz5tjKD48JZb4NvcBvKI9L75dqu3VAwuT7RQA8wFh Gj2sNyILKWOhVa2jEPwBWDviAOprcOL0eQ20xEdCEzTOoe/WJvmOi8YaKS1ygMdHl0R5ucZhOpx A4jDnQsFmDijRfHDOwWv0mf8vXQVHVvfKqUo/YJfnx7njJWtMqMBq6MJkG5prnOKtIEhetscF5H fvi0NsR8hvZ5TSTKLvZvwmYXn2m48UWmOPAIUBuF66PTTk3WgvvkxbgY4dkL0= X-Gm-Gg: AeBDieuvUljEeJUNgQZZQWXyu855OVHgyZv6r5lSD7DSeYq3qE6nrSNHTo5qM1al1Rs /EFWYLSYcxGwwoVMqtnbAweGX7gGTM/8d/u7Gnl5tWukJda/igJgwbjfGzvKC5Gxcvtd8Kc2aGv 4/K5EgSiGM1NOIjMk0GavhN47xdFHe7aFoFiIMHJUE1ziCgx3ChuEOFasUWvZ9dRhjPiQAq/LEf Fsz2Rr1yemlTXcADJjUOf+s53jKhWUJRDBlt2OiEQ/o8dkD+4cN2G0xEIhVUqBcvZOSqIKbYyRC tSDwsoedLIGZM2N+0PvUTQAFoggTIzr7saArm3bBs/rjqS0FoA1ZgbLRQq8Tfvp4ivRBbK10E6+ QIluAbxng4MXpEuieAm7z/EzPR/CtNblJbymGAAn3A9yPp94XnXu7A6Kj9qBCSniZuuAvhRBDPu MX+aQ+LcKLVielDTM= X-Received: by 2002:a05:6808:690a:b0:467:f9f7:6356 with SMTP id 5614622812f47-4798500625amr473513b6e.16.1776281546153; Wed, 15 Apr 2026 12:32:26 -0700 (PDT) Received: from mutt-hbsd ([2001:470:4001:1::95]) by smtp.gmail.com with ESMTPSA id 586e51a60fabf-426896a07cesm2037341fac.15.2026.04.15.12.32.25 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 15 Apr 2026 12:32:25 -0700 (PDT) Date: Wed, 15 Apr 2026 19:32:26 +0000 From: Shawn Webb To: freebsd-current@freebsd.org Subject: LRO Kernel Panic on Hyper-V VM Message-ID: X-Operating-System: FreeBSD mutt-hbsd 15.0-STABLE-HBSD FreeBSD 15.0-STABLE-HBSD HARDENEDBSD amd64 X-PGP-Key: https://git.hardenedbsd.org/hardenedbsd/pubkeys/-/blob/master/Shawn_Webb/03A4CBEBB82EA5A67D9F3853FF2E67A277F8E1FA.pub.asc List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="lqzq3p5wfupredzm" Content-Disposition: inline X-Spamd-Result: default: False [-5.60 / 15.00]; SIGNED_PGP(-2.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.996]; DMARC_POLICY_ALLOW(-0.50)[hardenedbsd.org,none]; MID_RHS_NOT_FQDN(0.50)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4864::/56]; R_DKIM_ALLOW(-0.20)[hardenedbsd.org:s=google]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCPT_COUNT_ONE(0.00)[1]; MISSING_XM_UA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; TO_DN_NONE(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::230:from]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; DKIM_TRACE(0.00)[hardenedbsd.org:+] X-Rspamd-Queue-Id: 4fwrrc4RMZz3VJw X-Spamd-Bar: ----- --lqzq3p5wfupredzm Content-Type: text/plain; protected-headers=v1; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Subject: LRO Kernel Panic on Hyper-V VM MIME-Version: 1.0 Hey all, I've updated one of my Hyper-V VMs earlier today against an up-to-date source tree. I've noticed quite a few networking-related changes in FreeBSD on 16-CURRENT and I suspect (at least) one of those changes is problematic. I'm not at all well-versed in the networking code, so I'm unsure what's going on. I've uploaded a core.txt dump: https://hardenedbsd.org/~shawn/2026-04-15_lro-panic-r01.txt Thanks, --=20 Shawn Webb Cofounder / Security Engineer HardenedBSD Signal Username: shawn_webb.74 Tor-ified Signal: +1 303-901-1600 / shawn_webb_opsec.50 https://git.hardenedbsd.org/hardenedbsd/pubkeys/-/raw/master/Shawn_Webb/03A= 4CBEBB82EA5A67D9F3853FF2E67A277F8E1FA.pub.asc --lqzq3p5wfupredzm Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEEA6TL67gupaZ9nzhT/y5nonf44foFAmnf57cACgkQ/y5nonf4 4foCGQ/9F0/u6djDWHSZa/DtvlwSzlhq+rxVKSvK0GNa2qQihrNTziwPIyVQ7tHu 7A0bJC1WzTVd+6z1AE5a3cfmT1k8/GVs6IaqVTPCGmVsa8TipaNc7fnjh12Kpqhu kvlerIeFQniqIJnt0lLygcg9JbqvFKmkEmwrHz0lOI2ivjvKNJartp1NBXi6g1dM xruy7mfhYzHuMOSXOrecG8lxZEmO00NDdQt/6LQVUpKJdQGZi99ulF91qei8afFb Mkg1gKfRWiUY0/wq0uZC/dcLkEVH7MEgObUunEYu/TxfB6bfVMzMRsbmdWcfcVZX /uq5AMgkMulh+7FYwEWxEpBLRgvEmSii9bKeT1M5AcDT/TPGG2Tp6jHH+6Igrn7s p2j+GVfnj7lhcF/va15+6MlNFFM9ABrkMByNLdO9NJfSLT01x9su8YW5wk+P813H 38llo4rzXVXPQSDt3yEQsYid6VMMKD8WplKHU7MaFe3ym8ARlY4GxsJS4G5xUB50 vAPiawdN+7nUxosl9S14dfbWpL2EuOzW1WS3HLOiFPD8NxNEpIJJXZ3DbDHqGjuk 5zjYykoMpkmxIzEtAUvpKeiQRdjf2qVDd2TgYDmdkMrGaamIi+Rk1lo2Ha63NLEf 3PyuDL6/bv5xJY/O4zUN9kivqN9bBReSxtmBcs0kgB8meE0n4/0= =K3ew -----END PGP SIGNATURE----- --lqzq3p5wfupredzm-- From nobody Wed Apr 15 20:12:27 2026 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fwskj5ZM1z6ZPpP for ; Wed, 15 Apr 2026 20:12:29 +0000 (UTC) (envelope-from tuexen@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R13" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4fwskj57Xtz3YvY; Wed, 15 Apr 2026 20:12:29 +0000 (UTC) (envelope-from tuexen@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776283949; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=n3bXxXXrLg/bGaCOZNqijfDbkIzUYPq/i3XDbxlJMqo=; b=w4+PGg+CwhVDyZkbZYrXX1wy1q1XJep72UBlYuepV4vp2uMO6sWLmpb9zWHv7msua4pH6v IBVf+AcQSGfnTcFVca1ONKTet19e7Q7o6GOTVD7K1kkUjAVz+fmGFrSQvAcdudNtaMKgF8 cNZA2zoEmTisvsgzK1KNxSHgWERyOFl7WR4nz8kgQlf81w4nwFdMmSsmfTKH8+4w4ZGmxg sKr3XiOgk554nM0c3KOcrdwj3n4tCEGZesMdPO93AofT+LuRHKeOIVxDwFe3fUYcyk1T7u 7zbF72PQYhfCLom8GOl+ZK3YMglurF6tpDs1J2NiWqQLu3tEQ+W2y/C3cRYKdA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1776283949; a=rsa-sha256; cv=none; b=wwF7Bw+VKyibU9QqLcmT95rznMXLwnrNO37LvR08Z8NJgaMTA4ksu0GI1Az5caPb5S4GtV eQMybYoEBkPaT76LozpkPk0FLFgVAg+iwHskbrnMhocQNa+f1QsRRytlN9rVdfSrtUgwqK QFTTcV8H03WG2cbhNRzJgP4PhQ/idIUEBxJBdBlGF2A8eMoV/dIM4IkjF1udU4imcQToRl Tiuo0vuOlE5M9c00qElZvEmA7TPuztGr7rT0sPUBwGfyxaNGImw7eXLu/AtbQD5nMe85HA X95rU55LJWqk9dkY395wQObRWLkDuZmceiSYwj+3VIfk/I39oA2WOi7cQSMOIQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776283949; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=n3bXxXXrLg/bGaCOZNqijfDbkIzUYPq/i3XDbxlJMqo=; b=M5W/Dyj7JCcshEgxBN8+Xw0mfNXBoNE2GPJWuDDwA2BPZe2edlBRW2X0kqKZEFmvEE5ziP m43bD7IZM2hmH5r/6Z1ctUoBV1I5G7rgFyg1Xe92IhDJf8yPGb7flzjJrBUBPUC+vwWwft MYckx17RYq3xD7PnQcKbzaUetsqfwydQlpz9xdQDh89UnEyWLOd4WG2ROXQX4vnsD+Zsc/ 5EkhZJT9/5oVzJfj7vAqsTct7X0WQUOMU6PyFAD5aCtYmU+gGHwP7sBCDbf3+4/AXrF2lI i2yfg942B5ufkK7ABelDEZVneyc9v3M7elmOxnC5nmDSjrZN2a4l7rmXgUuGmA== Received: from smtpclient.apple (unknown [IPv6:2a02:8109:1101:be00:6542:79de:f71d:eaf6]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: tuexen) by smtp.freebsd.org (Postfix) with ESMTPSA id 4fwskj1svbzxTM; Wed, 15 Apr 2026 20:12:29 +0000 (UTC) (envelope-from tuexen@FreeBSD.org) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3864.500.181\)) Subject: Re: LRO Kernel Panic on Hyper-V VM From: Michael Tuexen In-Reply-To: Date: Wed, 15 Apr 2026 22:12:27 +0200 Cc: freebsd-current@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <58C7670B-6D2A-402B-BBB8-865D652B9B08@FreeBSD.org> References: To: Shawn Webb X-Mailer: Apple Mail (2.3864.500.181) > On 15. Apr 2026, at 21:32, Shawn Webb = wrote: >=20 > Hey all, >=20 > I've updated one of my Hyper-V VMs earlier today against an up-to-date > source tree. I've noticed quite a few networking-related changes in > FreeBSD on 16-CURRENT and I suspect (at least) one of those changes is > problematic. >=20 > I'm not at all well-versed in the networking code, so I'm unsure > what's going on. >=20 > I've uploaded a core.txt dump: > https://hardenedbsd.org/~shawn/2026-04-15_lro-panic-r01.txt Thanks. The problem is that the vnet is not set correctly. This should fix it: https://reviews.freebsd.org/D56420 Best regards Michael >=20 > Thanks, >=20 > --=20 > Shawn Webb > Cofounder / Security Engineer > HardenedBSD >=20 > Signal Username: shawn_webb.74 > Tor-ified Signal: +1 303-901-1600 / shawn_webb_opsec.50 > = https://git.hardenedbsd.org/hardenedbsd/pubkeys/-/raw/master/Shawn_Webb/03= A4CBEBB82EA5A67D9F3853FF2E67A277F8E1FA.pub.asc From nobody Wed Apr 15 20:37:08 2026 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fwtHB6GnQz6ZRmN for ; Wed, 15 Apr 2026 20:37:10 +0000 (UTC) (envelope-from tuexen@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R13" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4fwtHB5Zr5z3dYQ; Wed, 15 Apr 2026 20:37:10 +0000 (UTC) (envelope-from tuexen@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776285430; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=qeZMTPtpYHwCLdNlUFu56xYBxUoSgZuVwoyud5x8M4o=; b=Bh5IiRUKr1QYdYcx4DN9EtHxgN2eHssoMxzvNgkHJntnzbH4+yKjxi/ZcL7+1uJtRNK5ZR ro2MnUcMPF9SQ2zfIVqFasLC5XY/IhgJ0VxkK/7PoBW1Luh3X7+BwDI2tluXOiGjty9WtG 8kosayZKDcHce+2cB4QMC4Ufqz2DeOmu7O46dD2NTCedVhIh/7SjUkB+KKHsxk8NFbgyGe 5u/hsofxyZKcsmFUsliIAcRlmJG4XHVJHdaH6feDGyABNRAAR4hz+7nD+H6y15setJtQvx bmKqVbExWtKyEjn3GdpERJt5RMkcgOPTBapPRAgwL/7arJ38LEBfOul3oqB1Hg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1776285430; a=rsa-sha256; cv=none; b=ZeSYSwJWGAk3U1n4AzJFA3JIVXCVz1XZ47wt1UGhgPJNkJteEmRq/NWP6PDAqYv+FjD6wX 7a5ZWkTFev6X7ixcXx6wf48SWg0BOLnwdLEHU8bS6GiHR9u+WKPp38HizY2B/WrhLLVo6A BI7tx3DD5IlBxWsSFiNeJPKc2wUhZp3rj2jQ2WTvnqGRd8yDosUCoVaUW5fqEiy678vZCZ lhZprUmnYN2Dj4DS/7+aPRSI1kwE4EL1Qjj1bYR/z01CF4ymysuwj7SUFrMhS4ivbGm02y 4GS/NK7DEmBnkNdrs8mPkZVedL6EZm6eOye4lgEAIXYZgJChL9r+z8UDbLTZOA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776285430; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=qeZMTPtpYHwCLdNlUFu56xYBxUoSgZuVwoyud5x8M4o=; b=emxFQZnfZr+FciGSYWVDnqYY68D/7usZEWvKG/JN04BIgoxtoM2IxboEO1LESwRmkQ65dU FMjWiVjfFrpaKb6bOYJHnRlyVQjBGbR6gAkUkxTk2i8KE98ivTc1eRWUY/b4SAnCHoKp5Q BFwud+4SyBWfJQlGULb4W7Wvp3iMKdV/4QVAxH7nk+rFeAZKxdL3/oCfn1JS/B0htl25Pf 8ZDz2eIrgaMv/7mwZY40PmrMyIbjv3/nGq5UyLE2vioGa8G25hLmh5VEvgN6gvOvQ65c9u NeeG1grFT0SJ2V5G8vmHuvauvkmW/uWCOz2jAUkYOgfM4QoBZU25Rbf3TFzbPQ== Received: from smtpclient.apple (unknown [IPv6:2a02:8109:1101:be00:6542:79de:f71d:eaf6]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: tuexen) by smtp.freebsd.org (Postfix) with ESMTPSA id 4fwtHB2MwBzx3v; Wed, 15 Apr 2026 20:37:10 +0000 (UTC) (envelope-from tuexen@FreeBSD.org) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3864.500.181\)) Subject: Re: LRO Kernel Panic on Hyper-V VM From: Michael Tuexen In-Reply-To: <58C7670B-6D2A-402B-BBB8-865D652B9B08@FreeBSD.org> Date: Wed, 15 Apr 2026 22:37:08 +0200 Cc: freebsd-current@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <58C7670B-6D2A-402B-BBB8-865D652B9B08@FreeBSD.org> To: Shawn Webb X-Mailer: Apple Mail (2.3864.500.181) > On 15. Apr 2026, at 22:12, Michael Tuexen wrote: >=20 >> On 15. Apr 2026, at 21:32, Shawn Webb = wrote: >>=20 >> Hey all, >>=20 >> I've updated one of my Hyper-V VMs earlier today against an = up-to-date >> source tree. I've noticed quite a few networking-related changes in >> FreeBSD on 16-CURRENT and I suspect (at least) one of those changes = is >> problematic. >>=20 >> I'm not at all well-versed in the networking code, so I'm unsure >> what's going on. >>=20 >> I've uploaded a core.txt dump: >> https://hardenedbsd.org/~shawn/2026-04-15_lro-panic-r01.txt > Thanks. The problem is that the vnet is not set correctly. >=20 > This should fix it: > https://reviews.freebsd.org/D56420 The fix has been committed: = https://cgit.FreeBSD.org/src/commit/?id=3D2d13620c6e1be7f8136095f648a6b824= 158d0941 = Thanks for reporting the issue! Best regards Michael >=20 > Best regards > Michael >>=20 >> Thanks, >>=20 >> --=20 >> Shawn Webb >> Cofounder / Security Engineer >> HardenedBSD >>=20 >> Signal Username: shawn_webb.74 >> Tor-ified Signal: +1 303-901-1600 / shawn_webb_opsec.50 >> = https://git.hardenedbsd.org/hardenedbsd/pubkeys/-/raw/master/Shawn_Webb/03= A4CBEBB82EA5A67D9F3853FF2E67A277F8E1FA.pub.asc >=20 >=20 From nobody Thu Apr 16 00:15:13 2026 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fwz6r6xhYz6ZkxH for ; Thu, 16 Apr 2026 00:15:16 +0000 (UTC) (envelope-from shawn.webb@hardenedbsd.org) Received: from mail-ot1-x329.google.com (mail-ot1-x329.google.com [IPv6:2607:f8b0:4864:20::329]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4fwz6q1qskz41bZ for ; Thu, 16 Apr 2026 00:15:15 +0000 (UTC) (envelope-from shawn.webb@hardenedbsd.org) Authentication-Results: mx1.freebsd.org; none Received: by mail-ot1-x329.google.com with SMTP id 46e09a7af769-7d1872504cbso119683a34.0 for ; Wed, 15 Apr 2026 17:15:15 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hardenedbsd.org; s=google; t=1776298513; x=1776903313; darn=freebsd.org; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:from:to:cc:subject:date:message-id:reply-to; bh=2kdBg/rcs7Ld3r8gkVOuXnNPR9hQFHBznCfkXcEvUk8=; b=O7qwFv+5xOcaueThVN3XTcGHGzbG++FK06VSHLKdutTY12SxsrXvxfzg8/KDBwch8Y TO3ujcoRiLWvXfNTECjvIk/QozfovyvsZArkSOoxQFmaiQWCiFx6WYO+dnTXXU9fTvlh Ma/voc/6l6yy9LVgoIbPFS1KwqJ+/PnPiQVPGylTm6/Xw9nAvfhxM50TAfMPsjqZ3YZI 8i/cM2NMVIHkCo6V1BDpe7GBVjTatF0xM8JtH6VEoVAbEHA2UXCXhrdcbI737YaYdwvl rx9fXQhST/zTHs1V0mj+24dgrnB1LchMMSlTRoll60BoQuiUoJB0b4jVudOMZr2w8Xsm xP6Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1776298513; x=1776903313; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:x-gm-gg:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=2kdBg/rcs7Ld3r8gkVOuXnNPR9hQFHBznCfkXcEvUk8=; b=bvdegL37Ni/YH3Ks1r3cbrRYHuIaCrwh7xsQRRjB7p06inVPT1iayoYFdU1kelfyfR so/cm26UGPKEI7yLZykslMOndDL2SZsicWtXkDSoDyNg0PgXhE+XyfOF1IJCBVlL59Ih cI+SlHrN/koeCrrwnbGQe6YcuV9Om4tX2e8QKhYD0LY0l2Qf8LjrRDlMTgMlvKPz50UX Fb/Z/0FEOqNnpEr7kWrqeW5M8AAAkpj3u3EILW4H2grVKqoZY6m5eVEVru9HNVxxzVqK QB9t+C69hO7N8ESGgobMuKufKYuLbhjyeTqa33Pp+r9Ybv+euiHpPeKKpAq5BFr+QFbd USxw== X-Gm-Message-State: AOJu0Yzgl9Cd1LjCz6EVA2C0J2QcTF1SwzxKPktCWwRiG3O3oe06T2aK TDuP5X0V7dfMSCW0HsaWnOz1Z5VJdYKnuqorilbQ3wamMVYxaf8albFB6t2DnhheZwc= X-Gm-Gg: AeBDiesFTeRgHsmpUKCzwIJ8Jj90WftUZ21x7iMmV/QO943VwvPpCLF6EJ9L+DoMrhM 7KZ8vqKhNPJq/xGCy71VUaJHlblYGPNpyPTvcQVt95I1D6jFQNPbM19+IN/YeuMf5abA/vo0Ep1 /eMnUE2MGsW2gS+JEsJ6RJb8Zd79m+qvGSdftbm6/h90pFgrvwyprdCpBymCn7M6tbLGZ57HW0S A/mqfmI/0bnuCwdUgiinW75FgqZTIKVHMR4eEHtTMBdujvdrNgyQsyapFOYlyYNY0FE3w6Aucnk /zHFlp3w1aKD+QQHhoISQvGgPN2SUDROVQQeGYMnb0AFKeUItitGI+exjFHLsnmBmySN3vUG8iO jwRgrNxkpzNFpOpOf7PJSuHnXwuvFybJc74bAwkWtTqvME6lF1J8DIxRKMeiB1zPfunBGXHJEOZ r7+9+Zewzle6waP8I= X-Received: by 2002:a05:6830:368b:b0:7d7:c004:9d92 with SMTP id 46e09a7af769-7dc804116c4mr995664a34.8.1776298512906; Wed, 15 Apr 2026 17:15:12 -0700 (PDT) Received: from mutt-hbsd ([2001:470:4001:1::95]) by smtp.gmail.com with ESMTPSA id 46e09a7af769-7dc76a3612dsm2588014a34.10.2026.04.15.17.15.11 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 15 Apr 2026 17:15:12 -0700 (PDT) Date: Thu, 16 Apr 2026 00:15:13 +0000 From: Shawn Webb To: Michael Tuexen Cc: freebsd-current@freebsd.org Subject: Re: LRO Kernel Panic on Hyper-V VM Message-ID: X-Operating-System: FreeBSD mutt-hbsd 15.0-STABLE-HBSD FreeBSD 15.0-STABLE-HBSD HARDENEDBSD amd64 X-PGP-Key: https://git.hardenedbsd.org/hardenedbsd/pubkeys/-/blob/master/Shawn_Webb/03A4CBEBB82EA5A67D9F3853FF2E67A277F8E1FA.pub.asc References: <58C7670B-6D2A-402B-BBB8-865D652B9B08@FreeBSD.org> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="l6nu2ifpyi3u4xhx" Content-Disposition: inline In-Reply-To: X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN_FAIL(0.00)[9.2.3.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.asn6.rspamd.com:server fail] X-Rspamd-Queue-Id: 4fwz6q1qskz41bZ X-Spamd-Bar: ---- --l6nu2ifpyi3u4xhx Content-Type: text/plain; protected-headers=v1; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Subject: Re: LRO Kernel Panic on Hyper-V VM MIME-Version: 1.0 On Wed, Apr 15, 2026 at 10:37:08PM +0200, Michael Tuexen wrote: > > On 15. Apr 2026, at 22:12, Michael Tuexen wrote: > >=20 > >> On 15. Apr 2026, at 21:32, Shawn Webb wro= te: > >>=20 > >> Hey all, > >>=20 > >> I've updated one of my Hyper-V VMs earlier today against an up-to-date > >> source tree. I've noticed quite a few networking-related changes in > >> FreeBSD on 16-CURRENT and I suspect (at least) one of those changes is > >> problematic. > >>=20 > >> I'm not at all well-versed in the networking code, so I'm unsure > >> what's going on. > >>=20 > >> I've uploaded a core.txt dump: > >> https://hardenedbsd.org/~shawn/2026-04-15_lro-panic-r01.txt > > Thanks. The problem is that the vnet is not set correctly. > >=20 > > This should fix it: > > https://reviews.freebsd.org/D56420 > The fix has been committed: > https://cgit.FreeBSD.org/src/commit/?id=3D2d13620c6e1be7f8136095f648a6b82= 4158d0941 >=20 > Thanks for reporting the issue! Thanks a bunch for the quick fix! My Hyper-V VM is happy once again. --=20 Shawn Webb Cofounder / Security Engineer HardenedBSD Signal Username: shawn_webb.74 Tor-ified Signal: +1 303-901-1600 / shawn_webb_opsec.50 https://git.hardenedbsd.org/hardenedbsd/pubkeys/-/raw/master/Shawn_Webb/03A= 4CBEBB82EA5A67D9F3853FF2E67A277F8E1FA.pub.asc --l6nu2ifpyi3u4xhx Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEEA6TL67gupaZ9nzhT/y5nonf44foFAmngKgoACgkQ/y5nonf4 4fpiuA/+JX6qrzFcBEKAVwNq8fBJYqMA1hidARyRp4s7I6ahMCr8t60DoVIya3+A fQyjB/veVaVzL4xgF0/Utp/l2Dx8as39PVQ0DTh1CBj8q4mvbg1YPKdmm812Komq eyu6MH4H7wE7/I92yX9XKaMGg4eV8bl07h1NcS6VCjKaWFhGVuVYDJlYYGSPKITx mnH0uA7/P0T6BzUFW0b5lAQXZz/Ln6LmVvLaYHZMi1WIG7bMfW5b0LYI8DWwZqT5 upNqcCckSg37NY0fIzHkYm14G6Y2bdbvZAbMkefPNf0Uas99RUJ4aMeI/WP7XZdK +EYnb/QRVvS2YC4gWauA/xN0v2JRKwS9he8BW0WVpLaYrROLvxiyw2ReOD6VTOKn vYMrHiK8AXYK4U7M4Tjf4LkECqw7oUNyBQY1HpmGwM1DYpGffu8hEspqsRUwo5Gg eatqhx9Tp2FEiyoWWiqY8Eq22Domfgzf9Rz3+RdYRIz2GusbeVzwvkKYdXMoT/NP k0yXKNrhxo9lNzilruWcIekKPvYgCMCFLcKwnSgBwY6hB7te2DVUKh3l+bSqkSv8 yonfcLyWOnx1L6msUjrcmBoioDaH7vCjf99BNA4MahzLNsK8vgUDPVvRiTaJvm2E J3ZAgz8EvcBALcCTDJ/WbgYaoyyxtyDTp3jBLDX/O+fTcF2fz3Q= =YgE7 -----END PGP SIGNATURE----- --l6nu2ifpyi3u4xhx-- From nobody Thu Apr 16 01:43:52 2026 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fx15M3Wm8z6Zrlp for ; Thu, 16 Apr 2026 01:44:07 +0000 (UTC) (envelope-from zagazaw2004@gmail.com) Received: from mail-qv1-xf32.google.com (mail-qv1-xf32.google.com [IPv6:2607:f8b0:4864:20::f32]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4fx15K3gp3z3Dhs for ; Thu, 16 Apr 2026 01:44:05 +0000 (UTC) (envelope-from zagazaw2004@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-qv1-xf32.google.com with SMTP id 6a1803df08f44-8a1e1817db6so64225486d6.2 for ; Wed, 15 Apr 2026 18:44:05 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1776303843; cv=none; d=google.com; s=arc-20240605; b=QTahj2hLLENmsezPjvrgjl676IZ9vJCPo/3vOwJ4Gpb2tsDC9O3B17dfW97c0UcHum u6hEZphQ3EZh3FP8EEx6YgyQOnFgo/HxfWPK9s9PAHNz+Ubr/PG4y5bdgMjpiby5SyVs 3dJEHv9TBoNS7laXWTzYtnbjhvEs7UaAdjTDUduvAkY2eDMhgl9P2nhf8xfCdrAWkJU0 ce9v8h5PGKuZM+lGXV8wkizKBzDtB0GH/sz954v+8aPM4ftNUZfouZEf1Hw75SXF5X6f fvgvzn6sXIIbfu6Uxk58UER3yqDigfNA6e01P0NjFRot8b44Plo0FtWjnk8PnVmeScs5 AEFw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:dkim-signature; bh=T6WH7eQ03iDUhDmhGhYu0CMFus3lOfBX464VPIO1VoA=; fh=GhXotVUlVreTY3Lsmc6AxviI3oUzW1GAR3YlbGm5vBY=; b=HYXk2cKlwIboU4zHViFV55K2lH3ZX+NF6PGM9GRotyvlskB454lJhZa3VMsRy2GrsO 4FtMusCZrBBxniflNF5PuU7jrlDAkCEVXf7wSMOLdx21JG2pbtEd0g5W/zj+szEZNFXj 16elFFlwatbpeusE/gyDgDcQxBOmnAR83ooyIgyuazhhRiX928jdmINO3T6fMYV2LZHg qx4R1MwLCE/H2glmImuQHAWXr6ziARb0QYxFQLJoyUssIcm2HZooA723mi9rBWBVuWmV MMaBieh6ZHNPL2/22ZV+3r2jgsXtxTnUwOkHUOiQbve3xKUcGAvGFHQQK/gyJNVhkn3C KRqg==; darn=freebsd.org ARC-Authentication-Results: i=1; mx.google.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20251104; t=1776303843; x=1776908643; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=T6WH7eQ03iDUhDmhGhYu0CMFus3lOfBX464VPIO1VoA=; b=rQM0vGzlHZc+kNWa2b7vHv/GXWhTbH7UlhYenHNGUpDntdxjik5Zu6x7zJibjh01Nf PkecPalenl6YiC1oUcSa1aNLpDDRH+TApohDkE9jpuAJjS6YLDnd+9ElRRJSD1nGYnRU lf/K92HdpPGbPPH5i9JA/MpzgPMKRqMgVPiM+IY+N/7SKeNZcxxod1YckWYSn0+PATKh jhn1mWHZCV7Z+G0LrZWwq+580HkwiGpC7iuIvp/kehhyodQqiawP5Fc7XqBDr6Y9fYhn 5nHgTy4kdcJe3bzr5Tv6Uo5GWl2P3uR7Oo7+/Ejy2b+FpM1h4AJKAwlOjG7YPbSzH0KM R1PA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1776303843; x=1776908643; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-gg:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=T6WH7eQ03iDUhDmhGhYu0CMFus3lOfBX464VPIO1VoA=; b=DXjaFy6afGuH3uXk+A+1jw2cA4AJ6ivSyz+vrpOg7ZZNbzQVpsD5e20Giyng/pJ8zY 61OGY1SI+IZyBnQR3FwEp3Mc/bDzBFUyOzb59TV8lSQTYh1+DDsEu/FAtahqQAhuiJwp CRNvDFoBgQ1Djp0CKocg6ynk+7Jc/5ZQMFKnJbJp5Tg+bH5KdtY0vfadQhCTkUXJe6t1 4RhM74hzpc61cEPpagn1diGPcY4wRsqTSqNMImMLa3QHRpOvEYr/KVIjhDoq1nq1jaHG jdb6DjD3uaOpVBARg/Yjuiugb+5iBuGcjdAFgrtFcZop6++3EpMr2BdVSXVU6tFLyN21 t1Wg== X-Forwarded-Encrypted: i=1; AFNElJ8FaX9qApO3tbFa1hPdNIDauN65Vzz43ojpZkhIYZv0eWlRFsBctl6UZOzqBiVZ9xbuZn0M9gk6bR6dJX2RV/k=@freebsd.org X-Gm-Message-State: AOJu0Yz0pC4sKj8B5USSO0v4R3HfJca4LU7hElbMKx/rshakNvOQtvSm FIaGIQCtW7bpx9q3vPu0yF1C7tpDwLlcplS27ZCtwJ42N/IZh+kfUId39s66MmE88kiNM3/H+42 LgorUL+QFfIPxSsKJ6rxUjpYkzpRATrw= X-Gm-Gg: AeBDiesUNgEXsmt1eTG5jGLQXibmZ3UoD3ERoynQHJ+oJkgYhZfnx4Hu9cM3vhrpLXy mcmm9B8d1WTFIWh+fMUntWnPWZ1uAqPSPWAC63/fxs1SOn7Mb1yPrFXPhHn70h6N2FKJ0fiDSZr ckyGQcbxMEGjqrH8M6eTCAQuVdp3OlWl/OOleMt1YFdXGZcG7yO/A7kVVRI38E2BbU9fewXOXUb +AcVxRA7AHzLsp4QDPCxL7ZWJRe7SF83TDJ03qhmN7z/vKuFQ9KA1XGtHkOPTxm1hfWw4kCVsD/ 31Z8FX7ZowZNW2ezvg== X-Received: by 2002:a05:6214:20ea:b0:8ae:5f0f:cc80 with SMTP id 6a1803df08f44-8ae5f0fd039mr146585566d6.38.1776303843194; Wed, 15 Apr 2026 18:44:03 -0700 (PDT) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 References: In-Reply-To: From: Maku Bex Date: Wed, 15 Apr 2026 20:43:52 -0500 X-Gm-Features: AQROBzDnur7oUqP0ltX-DXOYsTUja8aILEpX5AmZPAhkVBK6HKqu7t1RBNPCkh4 Message-ID: Subject: Re: Building VM-IMAGE(s) from Source To: vermaden Cc: "freebsd-stable@FreeBSD.org" , "freebsd-hackers@FreeBSD.org" , FreeBSD Current Content-Type: multipart/alternative; boundary="000000000000963b4b064f89f78a" X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN_FAIL(0.00)[2.3.f.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.asn6.rspamd.com:server fail] X-Rspamd-Queue-Id: 4fx15K3gp3z3Dhs X-Spamd-Bar: ---- --000000000000963b4b064f89f78a Content-Type: text/plain; charset="UTF-8" Vermaden, Very useful script! Thx. Also, I noticed that your custom.conf contains "release/15" instead of "releng/15" as a source branch. I'm confident you're aware there is no "release/15" branch on the git repo so you probably just added it subconsciously. It happens when working with FreeBSD (it always tends to push you beyond the limits). Happy hacking /#\ On Wed, Apr 15, 2026, 05:26 vermaden wrote: > I was not able to get 'release.sh' to success even a single time - it > always failed with different errors - the 'help' I received here also did > not pushed things forward ... so I wrote my own verimg(8) tool for similar > things as 'release.sh' does. > > Here are the details: > - > https://vermaden.wordpress.com/2026/04/15/freebsd-image-builder-installer-verimg-tool/ > > Here is the verimg(8) repo: > - https://github.com/vermaden/verimg > > Maybe someone will find that useful. > > Regards, > vermaden > > > > Temat: Building VM-IMAGE(s) from Source > Data: 2026-04-09 0:34 > Nadawca: "vermaden" <vermaden@interia.pl> > Adresat: freebsd-stable@FreeBSD.org; freebsd-hackers@FreeBSD.org; > freebsd-current@freebsd.org; > > > Hi, > > > > I want to build VM images from source, the same ones that are here: > > - > https://download.freebsd.org/releases/VM-IMAGES/15.0-RELEASE/amd64/Latest/ > > > > What I did: > > > > (...) > > > > ... but the VMIMAGES are not built ... or maybe I am doing something > wrong. > > > > The contents in /usr/src/release/Makefile and release(7) are alsoe > different. > > > > Please advice. > > > > Thanks, > > vermaden > > --000000000000963b4b064f89f78a Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Vermaden,

Ve= ry useful script! Thx.

A= lso, I noticed that your custom.conf contains "release/15" instea= d of "releng/15" as a source branch. I'm confident you're= aware there is no "release/15" branch on the git repo so you pro= bably just added it subconsciously. It happens when working with FreeBSD (i= t always tends to push you beyond the limits).=C2=A0

Happy hacking /#\

O= n Wed, Apr 15, 2026, 05:26 vermaden <vermaden@interia.pl> wrote:
I was not able to get 'release.sh' to succes= s even a single time - it always failed with different errors - the 'he= lp' I received here also did not pushed things forward ... so I wrote m= y own verimg(8) tool for similar things as 'release.sh' does.

Here are the details:
- h= ttps://vermaden.wordpress.com/2026/04/15/freebsd-image-builder-installer-ve= rimg-tool/

Here is the verimg(8) repo:
- https://github.com/vermaden/verimg

Maybe someone will find that useful.

Regards,
vermaden



Temat: Building VM-IMAGE(s) from Source
Data: 2026-04-09 0:34
Nadawca: "vermaden" &lt;vermaden@interia.pl>
Adresat: freebsd-stable@FreeBSD.org; freebsd-hackers@FreeBSD.org; freebsd-current@freebsd.org;

> Hi,
>
> I want to build VM images from source, the same ones that are here: > - https://= download.freebsd.org/releases/VM-IMAGES/15.0-RELEASE/amd64/Latest/
>
> What I did:
>
> (...)
>
> ... but the VMIMAGES are not built ... or maybe I am doing something w= rong.
>
> The contents in /usr/src/release/Makefile and release(7) are alsoe dif= ferent.
>
> Please advice.
>
> Thanks,
> vermaden

--000000000000963b4b064f89f78a-- From nobody Thu Apr 16 08:27:41 2026 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fxB2m3FBSz6ZCn0 for ; Thu, 16 Apr 2026 08:27:28 +0000 (UTC) (envelope-from pi@freebsd.org) Received: from fc.opsec.eu (fc.opsec.eu [IPv6:2001:14f8:200:4::4]) by mx1.freebsd.org (Postfix) with ESMTP id 4fxB2h6g6Pz47Pd for ; Thu, 16 Apr 2026 08:27:24 +0000 (UTC) (envelope-from pi@freebsd.org) Authentication-Results: mx1.freebsd.org; none Received: from pi (uid 104) (envelope-from pi@freebsd.org) id 31f70 by fc.opsec.eu (DragonFly Mail Agent v0.13+ on fc.opsec.eu); Thu, 16 Apr 2026 10:27:41 +0200 Date: Thu, 16 Apr 2026 10:27:41 +0200 From: Kurt Jaeger To: vermaden Cc: "freebsd-current@freebsd.org" Subject: Re: Building VM-IMAGE(s) from Source Message-ID: References: <86h5pceckj.fsf@ltc.des.dev> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN_FAIL(0.00)[4.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.4.0.0.0.0.0.2.0.8.f.4.1.1.0.0.2.asn6.rspamd.com:server fail] X-Rspamd-Queue-Id: 4fxB2h6g6Pz47Pd X-Spamd-Bar: ---- Hi! > I moved on to verimg(8) and I am more then happy with it. This helps to find verimg: https://vermaden.wordpress.com/2026/04/15/freebsd-image-builder-installer-verimg-tool/ -- pi@FreeBSD.org +49 171 3101372 Now what ? From nobody Thu Apr 16 09:34:50 2026 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fxCXk3cl7z6ZK0Y; Thu, 16 Apr 2026 09:35:02 +0000 (UTC) (envelope-from vermaden@interia.pl) Received: from smtpo75.interia.pl (smtpo75.interia.pl [217.74.67.75]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4fxCXk17wlz3H22; Thu, 16 Apr 2026 09:35:02 +0000 (UTC) (envelope-from vermaden@interia.pl) Authentication-Results: mx1.freebsd.org; none Date: Thu, 16 Apr 2026 11:34:50 +0200 From: vermaden Subject: Re: Building VM-IMAGE(s) from Source To: Maku Bex Cc: "freebsd-stable@FreeBSD.org" , "freebsd-hackers@FreeBSD.org" , FreeBSD Current X-Mailer: interia.pl/pf09 In-Reply-To: References: X-Originating-IP: 45.148.42.24 Message-Id: List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=interia.pl; s=dk; t=1776332093; bh=1uDiMBzrWgM6sBoQqX881WRZN9D4vFi7L49OzLWz2us=; h=Date:From:Subject:To:Message-Id:MIME-Version:Content-Type; b=VM3fwgnjXEA5jujnsBvYoDR020fnB0DXjq5LTRZOwZ5mUDVcywqCSPlJDdYXMNSLI oFxnqNZ/tBH3sCsMSmHq3gyE4mbviKV6HviksZ3JclMblQhuSt/IXW8QIlBEx5tS3w c2Rm1kSyL1nwfJMQADheTnmMaQvn2H0kL6V4Kcbk= X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:16138, ipnet:217.74.64.0/22, country:PL] X-Rspamd-Queue-Id: 4fxCXk17wlz3H22 X-Spamd-Bar: ---- Thank You. The 'release/15' was my early error - I later switched to 'releng/15.0' ... the fetching of source was not a problem ... but I also needed to set these two in the /usr/src/release/config.conf to 'see' what is fetched because by default they are silenced with '-q' option and the only way to see 'something' is happening is either checking with ps(1) on other terminal or ^T for status w/o them. GITCMD="/usr/local/bin/git clone" VCSCMD="/usr/local/bin/git clone" ... and if fetching failed ... the 'release.sh' thrown very 'strange' errors - like these: root@release:/usr/src/release # ./release.sh -c proxy.conf load: 0.10 cmd: git 37073 [piperd] 9.59r 0.04u 0.06s 0% 11192k load: 0.05 cmd: git 37076 [piperd] 432.96r 17.20u 3.23s 4% 334472k load: 0.26 cmd: git 37076 [piperd] 808.76r 29.21u 5.59s 3% 360796k error: RPC failed; curl 56 Recv failure: Connection reset by peer error: 1054 bytes of body are still expected fetch-pack: unexpected disconnect while reading sideband packet fatal: early EOF fatal: fetch-pack: invalid index-pack output umount: /usr/obj/chroot/dev: statfs: No such file or directory umount: /usr/obj/chroot/dev: unknown file system So fetching was 'covered' - the building was problematic part ... but I do not want to 'spam' these MLs with long error messages as I already found peace with verimg(8) tool. Regards, vermaden Temat: Re: Building VM-IMAGE(s) from Source Data: 2026-04-16 3:44 Nadawca: "Maku Bex" Adresat: "vermaden" ; DW: "freebsd-stable@FreeBSD.org" ; "freebsd-hackers@FreeBSD.org" ; "FreeBSD Current" ; > Vermaden, > > Very useful script! Thx. > > Also, I noticed that your custom.conf contains "release/15" > instead of "releng/15" as a source branch. I'm confident > you're aware there is no "release/15" branch on the git repo > so you probably just added it subconsciously. It happens > when working with FreeBSD (it always tends to push you > beyond the limits). > > Happy hacking /#\ > > On Wed, Apr 15, 2026, 05:26 vermaden wrote: > >> I was not able to get 'release.sh' to success even a single time >> - it always failed with different errors - the 'help' I received here >> also did not pushed things forward ... so I wrote my own >> verimg(8) tool for similar things as 'release.sh' does. >> >> Here are the details: >> - https://vermaden.wordpress.com/2026/04/15/freebsd-image-builder-installer-verimg-tool/ >> >> Here is the verimg(8) repo: >> - https://github.com/vermaden/verimg >> >> Maybe someone will find that useful. >> >> Regards, >> vermaden From nobody Thu Apr 16 10:29:38 2026 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fxDly599vz6ZP4y; Thu, 16 Apr 2026 10:29:50 +0000 (UTC) (envelope-from theraven@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R13" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4fxDly4Hvyz3Q4g; Thu, 16 Apr 2026 10:29:50 +0000 (UTC) (envelope-from theraven@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776335390; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=1wcUaReY98Fn6GVsx7QfyCdsNpdvuaq2hP1LEvbuIyM=; b=plX/DJwXT88ihTqaVllv6gsCeo4B3C88dTPJZhkEqlv/srmqXopDxqTciDhl111vv5/tKa M2uUBIldaKEtpMw+2F9AVbQyfg/peMxkUx8+LeY5zcuyUkaZ2I8oTXTUGy9KDVZxil+fwL Bjq75Msvno+uMkUVvZc6ZcscCtZ1Hctr4dn1hDA/rKvSJm/5rkHTuIYfFkO1RqVY7I3Z+0 gu087WstCbrUGELRt74x5MyRnFPUKbYPFh0Ti71oUwgryzfsMbCxTvfaVtM2rvPPSw4LdC WYoaBakpApXcq/pz08CRHSn+T5JJ4GubcS2t+9eW8k4sY6qmM4WMHqKo0zfr4w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1776335390; a=rsa-sha256; cv=none; b=tZqYPGf35OPQ3ZPGyDOsH1g8tc6eFWJ4ac6/jSuv3XAWHZm3xRylDuPwKlUD9JPW/pf0oj 5omw7P4xd3Gh77D3wAQ+D476FXdPvO7qcAXGbrQ0A506jIP3jtJC+Q9H5ZEzZrulG4lWyx 4IVKDHHKsGJumS0RHgQLGwnwdgI8xtaHIJP8BIHL80YiufetsTFNrHayqnXeZfZWgkCErA OUEAc/cM/9Xf4yYcoh24ZVhxhZqnmGvzxYyKUd+kw4oIrx0M95LypMI4PvRtjfVB4r1lOC 0rNFHggJKQOO5vQpSqAgsF/hQq9m/+wLrZr1CThV67NJLVOOwlBHBBSs+wxdZQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776335390; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=1wcUaReY98Fn6GVsx7QfyCdsNpdvuaq2hP1LEvbuIyM=; b=FzuSTUhsQWxo1kL+vx9P9I9nzBNg0CiL8OjAgVUG0U/nTVTZl8pgHnGOzCfoXIrdwIfo3E /Pl6DBighsqPqXjLqo3gh9sAA9LD7Q6R0qcUMzs7Z884IMpA3QUsdnfgvB3u1jRBlXwAyu GV4jnfs/nTmrri9dHMAi6juJV7Plex9ktoU2XjhlUU5e2vz+Z1Yxt+anztT2C0WQw1K26K LQMtRX349YY8bcbkgQRN7UgpHGqOv14SFzXwXQ6rqK33+ZIwbvvK/GZRe2kMFkMoD9cLsG 1SL4Cy/3PLAxzEZtGRTcD+SC89w5nw+BPQweHAR+7wmsZvU0HWuO0R1n/sTBsA== Received: from smtp.theravensnest.org (smtp.theravensnest.org [45.77.103.195]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: theraven) by smtp.freebsd.org (Postfix) with ESMTPSA id 4fxDly3NLKz1dH; Thu, 16 Apr 2026 10:29:50 +0000 (UTC) (envelope-from theraven@FreeBSD.org) Received: from smtpclient.apple (host109-150-128-1.range109-150.btcentralplus.com [109.150.128.1]) by smtp.theravensnest.org (Postfix) with ESMTPSA id A5CC98568; Thu, 16 Apr 2026 11:29:49 +0100 (BST) Content-Type: text/plain; charset=utf-8 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3864.400.21\)) Subject: Re: Building VM-IMAGE(s) from Source From: David Chisnall In-Reply-To: Date: Thu, 16 Apr 2026 11:29:38 +0100 Cc: "freebsd-stable@FreeBSD.org" , "freebsd-hackers@FreeBSD.org" , "freebsd-current@freebsd.org" Content-Transfer-Encoding: quoted-printable Message-Id: References: To: vermaden X-Mailer: Apple Mail (2.3864.400.21) On 15 Apr 2026, at 11:24, vermaden wrote: >=20 > I was not able to get 'release.sh' to success even a single time - it = always failed with different errors - the 'help' I received here also = did not pushed things forward ... so I wrote my own verimg(8) tool for = similar things as 'release.sh' does. The only reason I would ever use the release script is if I wanted to = have VM images with the same hashes as the public ones. Your tool = doesn=E2=80=99t do exactly the same thing, so probably won=E2=80=99t = achieve that. For every other use case, `poudriere image` is a far more flexible tool = (does custom builds, can do base-system overlays, install packages, = build packages from ports-tree overlays, and so on), so why would you = write a tool that does a small subset of what it does? David From nobody Thu Apr 16 10:34:37 2026 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fxDs142D6z6ZPWT for ; Thu, 16 Apr 2026 10:34:13 +0000 (UTC) (envelope-from pi@freebsd.org) Received: from fc.opsec.eu (fc.opsec.eu [IPv6:2001:14f8:200:4::4]) by mx1.freebsd.org (Postfix) with ESMTP id 4fxDs05rWcz3TJR for ; Thu, 16 Apr 2026 10:34:12 +0000 (UTC) (envelope-from pi@freebsd.org) Authentication-Results: mx1.freebsd.org; none Received: from pi (uid 104) (envelope-from pi@freebsd.org) id 2602d by fc.opsec.eu (DragonFly Mail Agent v0.13+ on fc.opsec.eu); Thu, 16 Apr 2026 12:34:37 +0200 Date: Thu, 16 Apr 2026 12:34:37 +0200 From: Kurt Jaeger To: David Chisnall Cc: vermaden , "freebsd-current@freebsd.org" Subject: Re: Building VM-IMAGE(s) from Source Message-ID: References: List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:12502, ipnet:2001:14f8::/32, country:DE] X-Rspamd-Queue-Id: 4fxDs05rWcz3TJR X-Spamd-Bar: ---- Hi! > For every other use case, `poudriere image` is a far more flexible tool (does custom builds, can do base-system overlays, install packages, build packages from ports-tree overlays, and so on), so why would you write a tool that does a small subset of what it does? The man page poudriere-image(8) (of 3.4.7) says: WARNING: This feature is still considered ALPHA. -- pi@FreeBSD.org +49 171 3101372 Now what ? From nobody Thu Apr 16 11:06:03 2026 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fxFYz71sHz6ZRnh for ; Thu, 16 Apr 2026 11:06:15 +0000 (UTC) (envelope-from theraven@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R13" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4fxFYz4xtmz3bNt; Thu, 16 Apr 2026 11:06:15 +0000 (UTC) (envelope-from theraven@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776337575; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=aVxCzX74Z9pcDuB2TZNd6JufdydAQiV/XAxb3HEv1n8=; b=u7euGqizQ7IYnIsFw5nYdcegIwiZXe/EHzrJeslPGb0D182llnnn7AOs6Uu1UsnWjHAysJ dSAR8p1+FMElP1APMmCfFT+4IyN5zUhUiAMROl2RIgxyzN26G8rk0sM7XkSDjfH8VfQQzz g497aG56PJ4/sKOOIxJGM8QRP5CwaevoVdzAMsDkdBEXSXaEzwtdSzt2vf4T/iuadDU9jN YUO1Bc69fLmAyfVh63Sz0WbPdZK3KIGdJRGqHBiAXiqfVduEyM8RxIhKR7KWU9xyU52w8u WYKUDJzpjy7lrI00YlhcfCNuCSAk3w/HP7dgHmsST0nRjGC3FXhl8ClUQ6T8bw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1776337575; a=rsa-sha256; cv=none; b=YLDtQMEwkvB0pIz+xkgMOUYPSqNpdirMxuzgJnh/eo/r+JRl6L9AZIPqdpsoEc3RhlM4D2 WyoWPjTi1Y2aoGuCd+ek+S1nTD/yowfR69v0b1Umi/ntxWSXmOzsV6KO7UR2fyp5LsyvHA RayZa6gAESSipW5noJe4t8zi7iBvLDWaRITadtOfuBsoq+FrzlHXRaHM/wIG9n59AexON3 lji3jzVeMbWjheYC2L4WS29TAzyh/K98e60yCJnbpESs8XdCtB9RutPT6sy4pNgO+NUQWr 6fCeuJ0I+HduwmdUtkQFQfuqHkXcTsqnl381x6ysxuJ+Wbkrl1lxCQ7EHSru1Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776337575; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=aVxCzX74Z9pcDuB2TZNd6JufdydAQiV/XAxb3HEv1n8=; b=ifKBnOb/NDd9VZ2efrQVju2Qiei2H1/MKAxb2T8VEcyzknNG5A1vklDkh0TvDdKNAsKghS 41n7QrFiTcttyHdInv6Q0+GZoESqzVd4P7q0jbPAXkO/TPfpqgEHMfxVq9nO7G3bK50p8m MQE5/MM5Quti0T2Kw7itNa4u1vVOtMmU50fQptjpkp1Cggwfcv3UY1wum+VRaSHAPTMlg6 sMEzbx5tD6qCgz/48y4kvKsbxb1Ac4+6fW2XwnIjELDyYTEbWkOP1x/oaDM1gYLjSpoPS2 9eV9USsB0ey6oRERAVYniHS1NZM2U4ZYN0sXjgCcuYETo/yf0CbIPlIU/EtVgQ== Received: from smtp.theravensnest.org (smtp.theravensnest.org [45.77.103.195]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: theraven) by smtp.freebsd.org (Postfix) with ESMTPSA id 4fxFYz3x1Zz2d9; Thu, 16 Apr 2026 11:06:15 +0000 (UTC) (envelope-from theraven@FreeBSD.org) Received: from smtpclient.apple (host109-150-128-1.range109-150.btcentralplus.com [109.150.128.1]) by smtp.theravensnest.org (Postfix) with ESMTPSA id DD45B856A; Thu, 16 Apr 2026 12:06:14 +0100 (BST) Content-Type: text/plain; charset=utf-8 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3864.400.21\)) Subject: Re: Building VM-IMAGE(s) from Source From: David Chisnall In-Reply-To: Date: Thu, 16 Apr 2026 12:06:03 +0100 Cc: vermaden , "freebsd-current@freebsd.org" Content-Transfer-Encoding: quoted-printable Message-Id: <43EE066F-5E8E-4FC5-AD57-F50356107AD8@FreeBSD.org> References: To: Kurt Jaeger X-Mailer: Apple Mail (2.3864.400.21) On 16 Apr 2026, at 11:34, Kurt Jaeger wrote: >=20 >>=20 >> For every other use case, `poudriere image` is a far more flexible = tool (does custom builds, can do base-system overlays, install packages, = build packages from ports-tree overlays, and so on), so why would you = write a tool that does a small subset of what it does? >=20 > The man page poudriere-image(8) (of 3.4.7) says: >=20 > WARNING: This feature is still considered ALPHA. It=E2=80=99s said that for many years, yet has worked well for most of = that time. Probably time to fix the man page... David From nobody Thu Apr 16 12:44:54 2026 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fxHm22Y8xz6ZbYk; Thu, 16 Apr 2026 12:45:06 +0000 (UTC) (envelope-from vermaden@interia.pl) Received: from smtpo49.interia.pl (smtpo49.interia.pl [217.74.67.49]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4fxHm16xFTz3rHt; Thu, 16 Apr 2026 12:45:05 +0000 (UTC) (envelope-from vermaden@interia.pl) Authentication-Results: mx1.freebsd.org; none Date: Thu, 16 Apr 2026 14:44:54 +0200 From: vermaden Subject: Re: Building VM-IMAGE(s) from Source To: David Chisnall Cc: "freebsd-stable@FreeBSD.org" , "freebsd-hackers@FreeBSD.org" , "freebsd-current@freebsd.org" X-Mailer: interia.pl/pf09 In-Reply-To: References: X-Originating-IP: 45.148.42.24 Message-Id: List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=interia.pl; s=dk; t=1776343497; bh=hak5z+L3osPgZ9xJl9bCFbjvWRxIeONDgw22Uf8zO6c=; h=Date:From:Subject:To:Message-Id:MIME-Version:Content-Type; b=ULDhTzRrKfvjXmTVhYIAA75TFNnfhcym/pOgBkaLf0ePXPi4h7XbdMdgKsH+//jEt 3V9nyvL758OqntJkKPVJvilfAEclTzLE27Z9x9aPcP7mRK3CZMopE7P5FU0NAsQ9xt JqKzPGvNnly3aY57FeHGQRpxGry4jTQIgzWDl4vo= X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:16138, ipnet:217.74.64.0/22, country:PL] X-Rspamd-Queue-Id: 4fxHm16xFTz3rHt X-Spamd-Bar: ---- Yes and no. For a start - I do not see options for PKGBASE in the poudriere-image(8) man page ... so I am not sure if I end up with PKGBASE system (probably not) or classic Distribution Sets system - but that can (can?) be probably configured some undocumented way. I already have a system that builds packages - so 3rd party packages are ready in some repo. I also already have a system that builds PKGBASE repo - so PKGBASE packages are ready. So when I will try to use poudriere-image(8) instead of verimg(8) I would have these downgrades: - I need to build PKGBASE FreeBSD 'Base System' everytime from source (which I do not need/want). - I need to build 3rd party pkg(8) packages from FreeBSD Ports (which I do not need/want). - I can not create custom/additional ZFS datasets and custom ZFS filesystem sizes. - I can not create additional FAT32 filesystems with configs for cloud-init(1) use. - I am not sure if poudriere-image(8) supports geli(8) - which I also sometimes need in images - and I plan to add geli(8) support to verimg(8) ... and I doubt it will be added to poudriere-image(8) anytime soon. With verimg(8) I just use PKGBASE packages as 'Base System' from repo I previously built and then add 3rd party pkg(8) packages from other repo that I already built. That way I 'suffer' once and then I can build various images in minutes/seconds - not in long hours compiling everything each time. One can also as a question ... why FreeBSD as a project maintains 3 different 'building systems'? 1. We have 'classic' # make buildworld buildkernel update-packages at /usr/src dir. 2. We have 'release.sh' inside /usr/src/release dir. 3. We have poudriere-image(8) for similar purposes. 4. We also have mkimg(8) which is used by both 'release.sh' and poudriere-image(8) tools. But as they exists ... so I can only assume that they all are needed. Regards, vermaden Temat: Re: Building VM-IMAGE(s) from Source Data: 2026-04-16 12:29 Nadawca: "David Chisnall" Adresat: "vermaden" ; DW: "freebsd-stable@FreeBSD.org" ; "freebsd-hackers@FreeBSD.org" ; "freebsd-current@freebsd.org" ; > For every other use case, `poudriere image` is a far more flexible > tool (does custom builds, can do base-system overlays, install > packages, build packages from ports-tree overlays, and so on), > so why would you write a tool that does a small subset of what > it does? > > David From nobody Thu Apr 16 13:00:45 2026 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fxJ6P4LWRz6Zcf8; Thu, 16 Apr 2026 13:01:01 +0000 (UTC) (envelope-from vermaden@interia.pl) Received: from smtpo63.interia.pl (smtpo63.interia.pl [217.74.67.63]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4fxJ6J3DQtz3vfY; Thu, 16 Apr 2026 13:00:56 +0000 (UTC) (envelope-from vermaden@interia.pl) Authentication-Results: mx1.freebsd.org; none Date: Thu, 16 Apr 2026 15:00:45 +0200 From: vermaden Subject: Re: Building VM-IMAGE(s) from Source To: David Chisnall Cc: "freebsd-stable@FreeBSD.org" , "freebsd-hackers@FreeBSD.org" , "freebsd-current@freebsd.org" X-Mailer: interia.pl/pf09 In-Reply-To: References: X-Originating-IP: 45.148.42.24 Message-Id: List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=interia.pl; s=dk; t=1776344448; bh=ak0WRZJ6YBe+6WOWcvCEQRfVLSotqG83yv9wtGrMwfg=; h=Date:From:Subject:To:Message-Id:MIME-Version:Content-Type; b=YliPC6YK6cRfrIQf7Kl7FtGJ2LEEnekUOyp1N+p2kFxVKUejTHrDiXVhY+Td0AJom ITz3GCZvS+D6lBX1+GPug9JjzYhZBgOjmIW3C9v219fIy8HjWnuCiI4jY8AKP7vl6X mjaz9RxOd8D0snuMj9tM9huPVPWTjZjXJ0YT69lg= X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN_FAIL(0.00)[63.67.74.217.asn.rspamd.com:query timed out] X-Rspamd-Queue-Id: 4fxJ6J3DQtz3vfY X-Spamd-Bar: ---- Temat: Re: Building VM-IMAGE(s) from Source Data: 2026-04-16 12:31 Nadawca: "David Chisnall" Adresat: "vermaden" ;=20 DW: "freebsd-stable@FreeBSD.org" ; "freebsd-hackers@FreeBSD.org" ; "freebsd-current@freebsd.org" ;=20 > The only reason I would ever use the release script is if I wanted > to have VM images with the same hashes as the public ones. > Your tool doesn=E2=80=99t do exactly the same thing, so probably won=E2= =80=99t > achieve that. >=20 > (...) >=20 > David Forgot to address that part ... I have wrote verimg(8) because I need to build custom images in predictable= and flexible way ... if 'generic' images from FTP would suit me - I would= use them and would not write the tool. Its not verimg(8) target to 'clone'= the 'release.sh' with hashes or anything. The task of verimg(8) is to prov= ide reliable/easy/fast interface for creating PKGBASE FreeBSD images from p= kg(8) repos that are already available - often custom ones - with custom ne= eds. Hope that help. Regards, vermaden From nobody Sat Apr 18 09:47:14 2026 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fyRk92fQTz6ZMn4 for ; Sat, 18 Apr 2026 09:47:29 +0000 (UTC) (envelope-from rbranco@suse.de) Received: from smtp-out1.suse.de (smtp-out1.suse.de [IPv6:2a07:de40:b251:101:10:150:64:1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4fyRk82Pv4z3ynC for ; Sat, 18 Apr 2026 09:47:28 +0000 (UTC) (envelope-from rbranco@suse.de) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=suse.de header.s=susede2_rsa header.b=KehJNDwU; dkim=pass header.d=suse.de header.s=susede2_ed25519 header.b=YyhANRBZ; dkim=pass header.d=suse.de header.s=susede2_rsa header.b=KehJNDwU; dkim=pass header.d=suse.de header.s=susede2_ed25519 header.b=YyhANRBZ; dmarc=pass (policy=none) header.from=suse.de; spf=pass (mx1.freebsd.org: domain of rbranco@suse.de designates 2a07:de40:b251:101:10:150:64:1 as permitted sender) smtp.mailfrom=rbranco@suse.de Received: from imap1.dmz-prg2.suse.org (imap1.dmz-prg2.suse.org [IPv6:2a07:de40:b281:104:10:150:64:97]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by smtp-out1.suse.de (Postfix) with ESMTPS id 7C65F6A88A for ; Sat, 18 Apr 2026 09:47:15 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.de; s=susede2_rsa; t=1776505635; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc: mime-version:mime-version:content-type:content-type; bh=rFysKb+4+Cg7sIK0pcAr8ElYMLG2ox6vtE/Td8lcnvA=; b=KehJNDwUZRuQ8xKFe4Y8q2AviSLMtta4S2fmMUnhQZYbfTCzeT0b7juf2nESHLWr3H0l2C bG1qEF2apcZFR4PQSfx0OFk8AjMs3PJVHWrTYTVARPt3HNsQI7FWMwJ/r/fZlwyIKkSrND amxDiOQQHjdZl8NPH3WHIm/X9quSJcA= DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; d=suse.de; s=susede2_ed25519; t=1776505635; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc: mime-version:mime-version:content-type:content-type; bh=rFysKb+4+Cg7sIK0pcAr8ElYMLG2ox6vtE/Td8lcnvA=; b=YyhANRBZCXqSP3LMCw1ZriMqRf6tA4vbBlxxRHnQ9mMPpJ4KhH0pzS3N7NyZzg07qrY8jp xAqMAp0RZcp7b/Bw== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.de; s=susede2_rsa; t=1776505635; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc: mime-version:mime-version:content-type:content-type; bh=rFysKb+4+Cg7sIK0pcAr8ElYMLG2ox6vtE/Td8lcnvA=; b=KehJNDwUZRuQ8xKFe4Y8q2AviSLMtta4S2fmMUnhQZYbfTCzeT0b7juf2nESHLWr3H0l2C bG1qEF2apcZFR4PQSfx0OFk8AjMs3PJVHWrTYTVARPt3HNsQI7FWMwJ/r/fZlwyIKkSrND amxDiOQQHjdZl8NPH3WHIm/X9quSJcA= DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; d=suse.de; s=susede2_ed25519; t=1776505635; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc: mime-version:mime-version:content-type:content-type; bh=rFysKb+4+Cg7sIK0pcAr8ElYMLG2ox6vtE/Td8lcnvA=; b=YyhANRBZCXqSP3LMCw1ZriMqRf6tA4vbBlxxRHnQ9mMPpJ4KhH0pzS3N7NyZzg07qrY8jp xAqMAp0RZcp7b/Bw== Received: from imap1.dmz-prg2.suse.org (localhost [127.0.0.1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by imap1.dmz-prg2.suse.org (Postfix) with ESMTPS id 5650D593A3 for ; Sat, 18 Apr 2026 09:47:15 +0000 (UTC) Received: from dovecot-director2.suse.de ([2a07:de40:b281:106:10:150:64:167]) by imap1.dmz-prg2.suse.org with ESMTPSA id f2LaESNT42nOdQAAD6G6ig (envelope-from ) for ; Sat, 18 Apr 2026 09:47:15 +0000 Content-Type: multipart/mixed; boundary="------------nB042EuVov4JsMOIxeTCO4Iw" Message-ID: <9d640ae4-7133-4d4f-917f-d715ab71ee7b@suse.de> Date: Sat, 18 Apr 2026 11:47:14 +0200 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird To: freebsd-current@freebsd.org Content-Language: en-US From: Ricardo Branco Subject: panic: assertion failed in iflib_txq_drain() X-Rspamd-Action: no action X-Spam-Flag: NO X-Spam-Score: -4.50 X-Spam-Level: X-Rspamd-Server: rspamd1.dmz-prg2.suse.org X-Spamd-Result: default: False [-5.00 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; DWL_DNSWL_LOW(-1.00)[suse.de:dkim]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; DMARC_POLICY_ALLOW(-0.50)[suse.de,none]; R_DKIM_ALLOW(-0.20)[suse.de:s=susede2_rsa,suse.de:s=susede2_ed25519]; R_SPF_ALLOW(-0.20)[+ip6:2a07:de40:b251:101:10:150:64:1/128]; MIME_GOOD(-0.10)[multipart/mixed,text/plain]; RCPT_COUNT_ONE(0.00)[1]; ASN(0.00)[asn:29298, ipnet:2a07:de40:b240::/42, country:DE]; RCVD_VIA_SMTP_AUTH(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; HAS_ATTACHMENT(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; ARC_NA(0.00)[]; RCVD_TLS_ALL(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[suse.de:+] X-Rspamd-Queue-Id: 4fyRk82Pv4z3ynC X-Spamd-Bar: ---- This is a multi-part message in MIME format. --------------nB042EuVov4JsMOIxeTCO4Iw Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit I'm getting this on FreeBSD-kernel-generic 16.snap20260416224424 This is happening as soon as I try to ssh to a GMKTec NucBox G3 Plus with Ethernet Controller I226-V. It also happens when trying to do any TCP connection.  Attached gzipped /var/crash/core.txt panic: Assertion mp != NULL && *mp != NULL failed at /home/pkgbuild/worktrees/main/sys/net/iflib.c:3922 cpuid= 3 time 1776500574 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffff81078b7450 vpanic at vpanic+0x136/frame 0xfffffe01078b7580 panic at panic+0x43/frame 0xfffffe01078b75e0 iflib_txq_drain at iflib_txq_drain+0x429/frame 0xfffffe81078b7660 drain_ring_lockless() at drain_ring_lockless+0x8a/frame 0xfffffe01078b76b0 ifmp_ring_enqueue() at ifmp_ring_enqueue+0x332/frame 0xfffffe81078b7700 iflib_if_transmit at iflib_if_transmit+0x273/frame 0xfffffe01078b7780 ether_output_frame() at ether_output_frame+0xd3/frame 0xfffffe81078b77b8 ether_output at ether_output+0x71d/frame 0xfffffe01078b7840 ip_output at ip_output+0x183d/frame 0xfffffe01078b7960 tcp_default_output() at tcp_default_output+0x21d8/frame 0xfffffe01078b7b30 tcp_usr_send at top_usr_send+0x500/frame 0xfffffe01078b7be0 sosend_generic locked at sosend_generic_locked+0x59b/frame 0xfffffe01078b7c98 sosend_generic at sosend_generic+0x61/frame 0xfffffe81078b7ce0 sousrsendat sousrsend+0x79/frame 0xfffffe01078b7d40 dofilewrite) at dofilewrite+0x81/frame 0xfffffe81078b7d90 sys_write at sys_write+0x127/frame 0xfffffe01078b7e00 amd64_syscall at amd64_syscall+0x169/frame 0xfffffe01078b7f30 fast_syscall_common at fast_syscall_common+0xf8/frame 0xfffffe01078b7f30 syscall (4, FreeBSD ELF64, write), rip = 0x8ea71c6154a, rsp = 0x8ea6806fb98, rbp = 0x8ea6806fbc0 KDB: enter: panic [ thread pid 6281 tid 101448 1 Stopped at db> kdb_enter+0x33: movq $0,0x15dd302(rip) Best, R --------------nB042EuVov4JsMOIxeTCO4Iw Content-Type: application/gzip; name="core.txt.gz" Content-Disposition: attachment; filename="core.txt.gz" Content-Transfer-Encoding: base64 H4sICMpS42kCA2NvcmUudHh0AOw9aZPbOHaf078Cades25k+APB2LO96Pc6uKzNel49MVaZT LJAAJW6Lh3n0YZd/QP5cflMeQFI8pW5JHo894y7rII73cLwbD7KXc8TLKBUc+Ukm0AnKhUBn lyw78zOWL84uI1l+Sg8OXrMCPUkzRGxEyENde6hZ6Omz128QxdQ8OPiPTIi/vv4BeQCRmKf4 5OnbV6+evXiDmopeYcTC+CSmtkEM6yQwPd/HDjUCLNDfnr149ur5U4RYxE394CBlceg/RE/y XGRFmMQoStG/ztCLtz/+iP70J/RvnceAhUuYCIzzbJFE4iy9mHtluORnV0l2UcAw8jOJ9yy/ yc9iUZyFwTL0Tv2HmkNhfq8E42E8R/lN5CXLHAVZEqEzL0mKswuRxWJZf5yenq5pW+bZGUA8 48Ir52dTXVXNegDdHnLZCxGlpxfJThi7/bdA+z7Id8VYd90CWRrsiqvquQWqgIvc331une5b IA0DNyuubHtXrN3+W6BdhrFqvft0+xDugjpKeLkEBgsdYlxEDeKjFwlSvee9bkkZcxTGa7s+ uAsmnkW7YKm6PbjL7oX+zhtXdd1uz8rrizR0L0Mukj32bQBlm73jEfPKYKdFbXreaeeKYqed q7rdZeeYD0twFYW7LmO3/xZ7uIh2Zri66zbIQlj0nbVD23sbceYv8sjbmSdWvbdACT3KnRd1 1Xl7ke3sKbKdbdHO9Z0xVl23lTV7iZgtEUbvSlGK3dVRt/+283T9JIqSeK/pdmBsi97U98Js bru3aXGzs01Vdd1uhmmW+HvZGS2A7RCDEb8X3lX/baRRzN2SlTzcWUH3IWyBOp67pVfsirbt vQ1KUcwzli52Rtrpv91MF364x0zr3tuh9JalKKBosQfiHoyt3KBlMt/dE6o7byOPme/GRcp3 lsed/iu0ruuXWbHIABg6enA3L1z5+Gdh7C9LDi39tHQZaJfFQ8M6uGJZDKN6iAzrX/aAhMDE zEt/gYJwKVCSIR5mwi+S7Obg6GLOvQfoHkaoP/gDBH97TwDVfwVHM/QoSYswCt8LjpKyeHxw jyDEEyZjL+ioENeF/DZrvvxFxEV2M8NbjERujXpz80VZ8OQqVpENZzUMkWUw+xnCqxIZIlAD mBgeRQhfB/WfjXWPayaTNjn33GrQ8B7dzAYdj5GCrurouFKVa2vK9WH5FrPnHAjVU3qaxRxm bjjmaOajSWqjSRKD15OsQaGjJcsL1494umauUOUWzFuKiWklKZuLbFZkpdhrMtheTQa8oTCA yRyeY4w3v6h+TuGTWgZ8knPNsrqv63NqmO+hJVGtNQuvam+D7HWfhkgBjMIG2Cu45gouNeGZ WNOVtwz35Vqwuhz7f6q+gz7V8DQ1Q7r1LOVUNgzo9v4bkB+u9pNxLmnzhBJNt4iFDa3Dn2Vc yDrSFkVSmHSIljBiBthGjyTBRDz/3iTm41XzBbsUbo1hSP0r8bShLhN5uZxqcE8fso4vyIB1 3GWSpFtJ0zHhG8YByO9l4rNlfnpwzxhg9bFNzBprAbYGiNKbdIIR/YSL/aWLfIZBUbOV7f/0 YHE+fHCrT3ws99ExdFOjlBBqd5+x41B4ti3HxLppYwvruBYh7R80B1KjmqXrA1g92FjTTPWs UwNjxzCnADV9gbFUW810dE23HfVATB2bpgUj0j5+/Ljq7F2kcrsDWG6xKrxihb+YKE8zcVnN HF+3WuVqcTNFMGZ/63zKbRzIrbvo7518q9WfVm+cfGs0Yj3RIpgVQVNWgRUYc10jXHO2Vpt5 6WUujAM213Lambhu6g8mN1EE9p7IXND8uSQB1/XCQn0jMFb4R2xdN2E7sUUMm1ogTLThttdN iG3ZFLZMIwTDjlmYmsQgBiWGY8vTEUwqgNZ0d4XB0m1LN+WG9/AS08EOIccTqAx662gkrQ2Q mEDEzhQ4Wx+A06mjO0BoNmBvvkPnyQHiLiWKkaCzGMMg6KQF4nmilVIhkAE0tto94SF38yJJ m21ZJ98WIGbkkdEEvVo9eoVF8G2hBFxFq0HGon1ESmU4Vu8SIpCe6Vhbkt5E0UUeSuKDDxec 3Av5vXgn3BgMy6rlMZLPknWr54/Hso8bxkEiG/f2DsrzcB4nlX5SskaXxADlYFOpckLVo2RR uQW2RU3dosaACKBFGsplJqZmOCC9JDVAYakKdfU9L1ihNguPO9cqbMDpgRSgUHvJwPGSg89D +ApTUUrT0G3qGNS2R7KxapYWFUjiORoPDMK4bArzvSOM+TogsKIuOBJ5EiuBELBKhX4YQIDt kxuvVnG1brIvUJTIVFf1TS3RuoVVYJJL2I0y7i2vBBSJfP5OAYre8SGWNFkup0flSbN3NiV/ ZD+fpXnol9F0XyBtUNXLITI3T1kmXHe6U1VLVPWk1Ktb0AoAwdg8RnhiJUDtWZruUAfLHTsx JHF29xCsK6ct0W3QfB97YCQnBEs2l2SoVYwBG/1ObbFJbCIs6CeE7+ncaEXVikcsWHhHt3Vj VVXWjCHHstkhXCnVHp37NCAB81rzn2dmz4eT6lIOdmhPrgUfbKgMpwShjdAjOUO2rMVlhuQW C/64Z5o5SGlyUMnQ4AiMgLEVFuXzPSTmUFMbhtkbAME9A8PjTDc9KbAvVQoBOlKogqiYdeU6 2OeWMNBhm1/wXd5JJPguf/gdP6xphKUzlk4bHYa/t6/umC2FeKVy8X7tpAeY2H3pmdxHjzKR CgaGC7AdkmInf7y/LlprGUlDpouyxtjR/kXHzbFhhNSHncItaBmNStJNrkssrqp9n4q9kCGp UK5JUtlEKZxp1INh+3FaFrkbFdePlRNuglurnx9OuYiH+9KEbbcmAUuVqzFP3SQIciHnroF8 CzrP+lBPSc0QLJMrl2VzeAk2VqJGMJSkmZi7uXIcpzs40ky7R2hvDbkOzpgj11ARmFtcv3N5 BpNDR1mXWQzGQX43KP2QX4/lRDpRusVKjlJ72olFGwjGuylE7uZCaf6W0tKLYlwIs+svjMH8 Hn36xXWfgIkXaHanQRik4wZ6p0Em/CUDttikK9glMP+G+siXsavR6POLME0VYDyKNawDBRZG r324CW06XBxOKGv7btqFTAai11fzRJqugQCHdBMQNgnkHtEGNGsRvwpqSkp1JW4X9MnFUuS5 pNsRZSb57PT0tCZeaUNLh9Qr+VwUs+qjcV3plgQbpQo9kCz4Re2uACdsUuZVtdEGeVMR82oF O+ZGUrBlryTeJDfzyZXTBytnBh6tuL0eOWh+dUo7uW4KeliIKB/XqeJprWoZsLzxLK5rSQ1o esGPEfN46LNCzJovO4TR+3uhd0I9idJdH+Sauwt5TjBapkpyucUkUw6E7PTOgjivrU/pl0mP SIwbfdy8V3fhUDVOAJ8VtzdKJs8HQGn3CcJwLK0V/2EgnZs4j8ICHYGsm40lXb0gUacKTGuH wuY/2F7Q62DR3136vtvMV5WwWxswvU34N+SnBOY9YvZXijJSrZRQ5hGABnvCVfGEXZZqW73o KrTSjparZg9saGswVidgfDjWapTT5D01xGPE82LcPkv21vH9uWitEyRDHwvlBx3+5burc40S dc7Rjf5Tgk/PNYOcNqH5NiQPzk2XfIgvDN9xOhu87kCp64OJTY5WurjFSaulwNq41VJskuFi sWO8X0bsXT9JJyO4xO4TB7cNrogjTFeUMb3/Cj6AuwsR1CJQKtYwStapkihZaQzZME5n8Oor Edg4TiyLGvqWTBIq4mrmJK1w0oqWMM2gXEWbssSNFz05I0MDlXULdT0qkvW6Tih2+tZ2puwZ qbUn24KDQSlGT8C50EfnT2trDhX+tKIRg8ijBHhexTU0TR5MQElUlPBsGobWDyupYEtbAy2B gVV8jbkVUFz7jaCjmBuwKFzeKPcD3Zdl/egdczkrmDqx3OYkrntY1nEMK7v5Fr6gHVtTzXGD oN/IyJdLFoNfm/YP4UK2yX5KXEUhrgdS3V8I/8LN001GfJgOaQi4xrY79fWiyyObVWkQenG5 yZCutmzAC6bTwp1fba4Pcy9LGJcuxAY0eeZv8gTwxolLz3VS0jh9SRPoAbNV7N1PXS5URHUl cor003C8hL1iedI9cm84h7aGeRV7OKxPz8m5dx4X//e/8nT6xXkMnGmea5oxSddU184xMZ0R E1BqrZhjsqOFnXNqaKfrz5JzBtRW+bHZdTRwWVV4v2jlADGPodAt8kvlHWiGacACYqspFr7k DM0iFph2ltU/14EWElnel1o4YJ7j6ehRGTH3PVuCXeGq/KDvDfoYPQpjP4lALIH4zAU4C7Ev 0LlmwiSw9lhhVXHGosx6+le3AsfSLRukYQ5N4lU8bjWUIkhAayUX4UDiUmowE/o9uqrcujAv pCz6npi2ZtqP0eEIUpTLKRkmxbYa0JUMZ0uouoPuk/uqLG5mTgkFOQh7fn9qQENJKadXC1ZK TKwT+Ge1gq3mcaPD+XkykAzM68cQ4nTMwoaON6T8gM20uILNTSJ2nYt54/Vr1roWObClnD7u 5NPcLrGAeFxgkXoJ2mg4T4eHxSwuBO9sXsfTj1XogrNl0qfkMDUHUEK+FBuzGPyrMFYKzXJa L1gCr8rXCrcp9IXaFjLQMJ2oZxDcEt5fLxBXa7auyapB5zgBbMla1bdlMpstrKh07eSksAAx EY4P9qOJ/e3QXVmhA+NZp+AhWy1lFJsMz+V8mCoQ5mF6aW7S50CJy8mABO1H+wVmFsGNiqh9 qjjhmcxA+ZQa4pJlp4uHVsfCyC4nx0fUSMo8U0SMjvJkNmbljrEbVaZszOovVXwUmCBLlmMr uOCzcXR8xynBGDPxTio93GFiFVD+IIq7HSM3vjCxA6ExbveP1QDKmoD+sawDaaEOOQCJV/oX CjMZQUiWHPCFSRYWNyrohe7/+/3uIVxcHQHHjblk6yB7QWtKKxVKV2aqYaH7Tl2YJioEQoij 99MqZGV9lPYhb75V+Qvq5HDU+L3IkiYtz57W0x/vLrmLrSX7paIkJreDKJ1D7nfQ+W1to5G6 SV5FAv7qLT5nPhg01hwsmNaRC9DCvCuH36P98wPfMZ1AHdfliWQYdy5ikYW+UtzQqTqTASbK k6Gb1+EmuU8z+db1DlXPMkxm8JqOM3KmtH039NJMTpWPoDV8WX926yuGVu9tztK+7KoOh8ow 9d1cLoe0UKnRiRODkJTxV9ev0hbAJ2wZ2d+sUViRROqUDHehbYofAK6sPnammiQmavWIKeQj Rd74zD0cSjAqc7R/OpEyXx1pE6ejrG/z1NKsB07lAchEObtH5tMBz3tUG9KiZpMxLa4V4ors +rS2nsLw8Yp8OgSzSmz7FSjF7ETG1uZCU324BkJzqjUABTHUYetORJuT8mpB+nl5MiGuszQK BCXcl7lA7YrInI3+kpS5yOQtIblcD/ZYBUsbGNtrKZxvNJsuwWC9jEUxEHXrV7YfKvcNFgSK usBJuAJtJtBRP+rr+IZtsNuoiYHSvBSunwk+uaR3oau7raZ8ydsTYPhoFu0FjKkJ/C3r6okA moKPBHSr7QM+C5r6Jui0ZvJMTpxtltkHtcGdi2JWfdSNT8ikJN463eQmb5hfZpyYbRwQmsPQ BiRQid+eD7eeKqwhVTi+pfJhZQ6AWs5LtZ5rlrFZPTZNH/vNVO9I3uFBdb1BoxkSGyZlIwmo JYapwZcs3TsNqD9a3MmSqHblA3y4YXI5Tl/g3FZiSNbW+9Wz5WTVKqECttKqWq/0WvUInnGw lIrm7fN/uG9fP3v1+uWTp89GgLKrusnPr56/eVZ1XWMJt8Yhq8b9AT5cj+VVTINiYVOwSQKu 6cdIVtXO9cc7kJozSGXlFq1Ee5WtV+ds7at6uimtp6fyX5uyVWOSToajdfzrYY6vj7EJGgWa w6C+J9S+c2JczsbLqhP7zgZEfuMWi0xloSpzSN7ZaTVCBjbJJq3gyjudRZX9Np1PrOHqF21W KZLr2KPCNcP7JROT7i2FbZOCV94cd2Chh95ON124kyFMidHLDMa9xODqKW14aJjgWycCO6ZM /7QHCcFVIuetOcHNaNfnBNfwTXxLSnAfooYHacGbwMw3wdkhM5isywiWabFt4i/u5fuO4VUJ wKSb+Nvk+Y6yejtJvAMvvJOtW6Xi9lJ3R4m6dTIudcwmGdeaztqtbkrIGy6mZeoaNY0qM7eb jtsA0+iIGFcpup2UPsMJHBM9qjJWxSUwZv69YdPHH4ETyZ0SWjXpoGJ1CO9ogumWZegqWejP f5aXmuS1UnVfFqnLf0hxhErIko+nB39l/oViZSRTKFLBH6KnLI6TAgw3X+YXRSJKshvJ4Oq4 GEr6aeTN9dQ3AESm9DQXEg9ltFN68Mup9E2tzqWU2RuIEHiCDzkLDR09ffkWgViR911lUqa8 H9EswDa3tK5tU72i1IUPdViiGepCa0/LYAziuToeDt04Cj8RLmmaDG6nEhwYjqkuE7V4XHUr pLmnUcarrXm8A3p5rzdi/oKLtIqTmery6Doykrfj1G/IyH4+2WnGfZSaqY9vvwnT9Aw56xUu FQg/yr1in8tu4lL9AI7Pzhq4cs7EwsNLXHLdDV1FXRvkruxSjUAeHhuUOmTvyVuEju7jAGqz uvrXztsr8+1s/Gl0NiYq671nnhOQ4bqymfwF+H+lJDBACsbc9EXorS3aBqzcbGLaKqG+J9Fs x+G0chuzC1dcy8yqKhglD9rKXrKyHK9tSUNqMFpw0Fk278QqKv7o2siUiEDfLZtdjkzZHnIF CV7PHyoBG3PT7L5a2bqT7DQFtbuvg4NPJDn1SnKSb5Lzm+T8LJKT6ES3bVPTv0nOr0xyOp9H cpqOzruvPSUnD7jXfU1Izjxf8BNWFou7/OqBfB0qMWpSx2gEKXVwJUhpJUh/jZ9c+Xy/qvK7 +IGUr+oHUD7jT058Ob8z8TX9bMJvdGV+0wXV3+ZW6u/iKurXdUnya7qO+PVcQ/sjX/v6Mm84 ffG3ib76K0R/7GsuX0rq/ReQ3/n1pnB+y637FLl1f4SssD9G1tfvLgPrj5d29eWnS/2GuU9f XoLPb5Ltsulg/7bT/P1P6z/VaZNZBUm1b6dN306bPs9pk2HaOrU0rH07bvq6jptw8HmOm6RD 1X3tKTY9Q9O7r4Mm0+ng4OQT/R2kOTph18urq4ODt89/QOglvL2Ub0/Ry1fP0YvnsGb/9fq/ 4f3V69fop5+f/v3JC3h4/ebJG/Tmjcose/P8p2fo6T9++unJix9gjbFKVKveKDohRv20ej9p UtJ++DGXv0QJZQ8xPjUo+qX6bxP+p4FCqg7wYTjqCwWbEYp1x0RXDMhlDAVb6JcwDosVDNrA ODH0tSP5+UfUgaHZ6BdfunwrIFrVXpuajp/dpPICNAykCwRjAKKqVlD0/+ft2prbRo71u37F vKRqt9bKwVwB+CFVXlk+cdZaO5a92SR1SkVRpIQj3kxQkr2//nT3XIAZABQNKccPLogcfujp e/cMBntQWkzpoEyWAUIHiD2z6UKAH7laTgKKaQiRKcru+C9/4P7eBIUDT/6Y1yigAJPvEfJm vlv2EcPZvzdztrnbXs8CThFE9F182eI61s1kez+rd18CWLkHbFMvZrNNLxguv11NwAjD9Pg+ Hba7mB/WPUj0VQBxKgwEleXg3D56EP5SiD+Drv8bfVvAEB7jcBXOFJrBbhswZDMZeSiPQVbX s3VQPq5GKB9g3NWXAUKHqXR5uvuDdtz2SYfiNvYfl5PgHbgZJ+n7ZSLnfI9Z7sG5vJsnQMWe yd0vtncPu36CVvBdAAn6y47zFKT+tppC0OkDsV85FF1y6z6FdaIApzSoBBOlNuz2C20lAJST OjWpXb1eXAUUbVEa/+tRBNAyW8ymNKGa7UcxFiXrohTfgVIM0qK+A6UMtCR8UQej6EzLPZ7B K0yPjFbXF7QE5HBEoYOU/JwMyIdJvp+/VzfTRQWlasApPM4xOq0WTikOxDGaaVnKwGOeOxwD gBLP72hwOlqT0GOMm5cM89KoMUyZbC+XIVH3PDZeUo288XwmwMhyoOXSRf8uBr3lCVGMYjrP pIVq7MChQCbBLiEQWZfFBlHg3rrITGNNxF8pCpgP5KN6mL/g+GiH/PHd6hJf02knZnB/eQCT TgWJyRKENWSaHA28djRZGBN4zPI2jIh4zLp+IobJu8ZJMDw3+0QVYLiQzHBeJP5GGA0ArBRy Lwy+G8uRIrRqZkRcxsUJfIU2FA97SalvGowy1Tw8Hwymk4GXWE1W9WLTizHdejduhMk7nqbA uUhgbSvr7HL2JiAUFqZFBUcviBNqUXHSQUDXEUDKjnOAmhldFQzdVJvZ9qoXBMRy7QOBgWq1 I1+Lku93DTFKoRq36ZStQBSpQUANS/pQqsDXouMVlJTIlRxks9t9g1qJQH5KQK5n8GUAMV2u fD9IPkhJcThIMQQixeEgHS83Yjpl1pWxA8kOB+HPwBPQKVIWkI7gbdOJQX4aNp1SWU8QArTQ Bhw+x97LY07guIayuSJDFsLuqCTA4GmF1kAcx3XPVu590ouFWzj/5xnr7PslPqXHjusjbEMI I7jOsdFDSzv4eGH9UO2mN7PaPrKlCjAXiIfVFB+Y2uHTa5ud+w4qE87q9Xz3gIdkxd8aU2Qy p31k9LfSqiw4trd3syV1KzwIA+Ww5Taze0trqGRnk93syg7QIH9GnZkffox+WECOcd/zOYQe tu37HJOih8mG0Q5H+r9a7fmypv9xI8HwmPXd7gAEGGUHQXwq2P0Kn7DsEoFNBdP5tpeKdFBC xhBGoMOWFPAZs5UD+M7b2d2mTr6t2ezrZFmt4KeX30A6s/ZvWmOni9lkZb+jQ9CXE9oMV9+s t7t5IgGLCwLGpTiU8gC0ANUEI8CjTY/Xq2O7SEObGTyaKPPk66ZP2AyEoF0qw+iwn3kFZZ0l AP/2GkZ0pQM221kyJqfXFkHUhDBziV0ZXDsgqpu7GSMlxFZ7gPdvZ+4btgP2OobxDBKV1q+A FV/uKjpE/e1/ve8wajKfg6uxXIqsxBpJZZnFSynyvp84uyFYUUhIObtj7ltjQENF35htGMM5 p5TKjplvZxEXW5/izzqaknyPrVbi4naNzcdZV1Hsim3n42o1+AUp02ICme72G6MypzPoocJH vnEzYttoqu3uDqSGy9j7xm2w+F9BlbH4xujARFJi+kHvRFsf0kGPCEBft76w+rLCLWCL9fq2 bYnYhAZ3zG7wVRw/ZH9im3XNfmJwsZpd/+gdKn4+2x43b0ptfn4FwQr1pIZBL+yxcYSFf+3W 68Ua+J/96T8QYZZH0YPDn/AAIva5nrEz22L+OPvCzsFaf6h/PDp5dYbqz86xqX63oN4CdV2x PrKZifAnA+BYmGy1ufG9zIJKe8PxhEwpXhj1At/kBxHbE4A/sZseyY4lRDXXcbG/oDfucSPt AU04GkJe8wtJJibspWkOcaKR52/P/Bhp81PZItYN+v3DJ/JpUIlozGbgXqyhFJ+0JhLwGKgX eHLjiwLu9wKP8zUx0OvT39ysC0dRzqLDo2jUycnP7VaAgugbjyIeTnY3vpXLsdbiXAFRLaGt 7vEAzjYSptqs4e+L5pRJfMnbdLKho0BJYER867I5LWO6qWgJ0TfWjcvq25xldqGMCSVkAf9n XGOlK3PKBlM5vwDOD3Exuu9uUt+6xF2UMnf0HUV3rcGeSEAio+ICLyOB4iDUD9AfDTgqy+xl axD1CUFJ515FtW2eqi7S5mHrpYCFHV1GnGCze7ob9adLYduNBQtTbT9bf3m1vPtqO+uigO/s JbcMaphD2hX0vSVvcEAMi0N8axb8n2Ulqilyued2uFcETx73cpQ4RZ010onOILUHX06mbrhw 1PFEfdkcYsPsMZYsq6/BR+Bd7GXnfuzz+c9klyzngtRMSW/yLc0JCnMU/dJyXWG+zokM3fUw pHV9v2f3O3wnFExUMQWZPjWegKM9RMJQ29UWKjeFvYQ7IGWkxamgwAe8OcdmQg71o8mku+Qm HSPRSyCDc1zQhWvFWk7Rj+L4c5Az+ERkJJga6dZRa8jFx8/vTq2LFbwQyl5aGttzocH0Csng lS3DI623wz7EnlUYL+JlfbWu5/UFJbGR74EKytHvxyzpOFyngNK3BwJVfth8sht2Sr++OX/N 6u29jbPWx5dGOndPEoDsyhRh7G/Kthn9fYX2zQDHXBq1mN7SC8z3DnKVohuEbHfRrhEA2zhe QK2JS7m80AY9Dl4HaeKY+1WYAfrxwrpVvGzoZ2y3hLEs4luHNP/vv0/fY2wzUPfiC22xcSr7 LaAvekVqu51UV/ZY+UiiecEaW2zdu6onzue1nKeOnSemRm7Q4CxQAsC5qVuA9TFTJFa4ebhy o7D5JxVAQcVuEqdTV9fVOtHIKGrh3fBcFk838QxMP/CsQbu9sqvwrIQqVgihgbA8VyUaVSoG qB0w2KBnlSXqOG87WWReFOfgBz5zwagOepAxI7PcQQePFfQLku/jyfa6RgXElitoP1aqwgzm U+TLbyBTdYu4QmbKXkYOoXKlCnogSEIyRMfLXpFvtlVNlkABTpHz4I6E1rBfPn18dXJqScVZ UPB1161heGoSRoicmjaC5wIMmstMf1fuYHXYmk+ajeG7N8DEqRClpmyBgjEuOzryQ67xuddJ Xe/NI32SH0VSdGQiSuTvMaJAllZiHyoTJiuQnfn3TWlgMgzKCOwGK3TxSmCiUprDofcxarnG lB5sC7iTQ/lY4GUZGfNy9/ViA8WIZU2uc5uaSdakK12K2bq+Qp5L1FlqJkPc2UtwczTZcorq W+8pM5qRexPVxoMjhNQUgyDhSIHQypzgc+3rBJpdyzkT4N2lHQtaCzMyJTgRI7FeKHoyKtzK TOYCcQHbR6AyKjZCtllUS+qMYyu0yKhfDoyKBt1VV3Qcku2rQ+R2+yp6nAs+Km1zL0EscYHZ 1THtM5a/1dPdIvKX3Bp/wz87Zl1dQd6Iei1KXaC315ksh92P/dWO9DWASzw+OvwCJR9JHPdr 3kzqG1eglQatp4nwiXa5jV8uZQcpaauQKj4M6w70lokcnJ9UBr09XbdFvwHfJP/ML4MOcRel eCzH83+8+uC+kJpMJC5M7ON0+OpNjiE400qBmIo+he/LRuGnxxjfOKSDvCwzDJaQIcB9nsEd 0jsJZtuLLb5Byzovl8nAZduFgQej1oArYF3Epgwl0Esnf/ldbUArRjoKHHgZ+VaMt9sl9Z5d 0a20K+nKprh2g6+x8vNhUWbYus5IdaUPpTT32BQxlK4v/xfzY1BGqIsoQdagpzF7P8y2x9hC 3+u+IQdaTlZohZC35biiyHLJu8kxqLctHBqzkbnuT7u65cFuvVm7ZJE2ucBXbr9Ly35avMBw JBTuOoAQlnXvEk0UhLyscNeh3U9E/Wq6jCP551W1W6EvkeiTOYlEGZZkQFj3LGdLl9iBfdkq Tjcuv1VpolLMrzq5V5tz1Ro9iU2+wqASCliv1H0Fc1jJQd8oDK2l5aIbBfCAz3ZDJYPwi8zq 2k2UMM4WRLTBEqsEzyBkWbajBzp6n54WbavpELCsr52tZLlwm/j25duegKV3YQV6jPhnydib pdfa3Pufrj3g6pndCsaFXXrEy8jREpQVFm9Sbs6SOALJHvY7XZ0vMEnNtG6q8yQMTy9tA01y XQjSaaNaltsn3Mtq7SwJYlrunGoeU3s/r1t1XyFLbgq307ILCYMvfAzhkCmVyuW9kae+9/bX W5bgpCt8EHl6a6NoVN7GHsNVaQoDW4nhjUr4jo0m7EcXO68TaNVyWUTgcrJ1BEjKoYzN360G T2+AJxOR4c7G9XJvdUr//lhUl0mbMEvlDf9+/vDGJfUZJEFa2BZsqxnjfVr7Z9UcT+62IUPi kpBvo6XzruZ0wCi6SwYZrDWlvKfdE0e2I/e6CnzWeXm32FW2iQX8onQvKbWinH2xXs2c6fp2 VhH7wsXCnjWJJRJ2f0hx4dKREs/TMlFjpud6kzpnA7V2b0yOE06oRl2+wSk7xsvuJFY3zmfi /Zzhm8j/0KsAdpcL2yAWnEpQuB07JG+I/b2T5EAyjV+HHoFodWgFmlf49gJXVfbE2iITnPc0 j9o5F40By1/5L0LvqOtFq2ubaA63celNQNWVI1tpT3WPW65WQckof3aAolGbanOxxIVMXLHp 4dVsNZ1sLmZf8T0oFzdr255HqSmvgHGcffsBF1vr2ieXHPetpS7r5AQXZbwvdjl9u4ah93W1 atQ+HCSmNWR/GHn38b27h+Rc+pZ2JwPbTTfzu9XeCgw3nDZ3DZ27hq5qZQLPwR+AdRHlkmzL s73amIjtqikKk0URGInvkrNRhecU3XjRxgrjVlcbP45bbydYKE+O/Htlppeb9aKafrNbIRz7 cT1Btt98NZ3U95PtY664ntzYfXtDo+hNX+F+w1g07riefHGK6v1bGuzBKOmAajeKkr1CWP/c W4wsbjcVWd8+LcFBt0taXWU5lMu4cSdHv1Nk+vCeRKp2iDp/SDxH3mYzjli1eorOOjlLEjt8 gdmWdrUAMXaQou5k6tS3k6vKr8d4v2CS6gFvWt+C69eQ3hR4aAhyxMDg9iIwPcHhNdPxTPmW nrurO9L83jWcsB2CTUUMnLSQ4/HuII/5cre2jnYgkblfXmyuvTPe3yL5fPYKqweFnWKh7GVo 2wHOvJruKrCsu9qqCdho6TxkUhCw7cbnwqW1GLh0c4yYtpm6g9FdgLP5S1+Am2yWLYEOTMI+ lgLpn8gh/koJEqXrTjMWd9BOZ/glmCdQVGJCQn/F0cAtb0LWVeRKuMS7p4N1dvKKckS3E5gu XbaShiF8sDQ8RxSMMeqOrmZfYSJ2trnvP1PK27ot1Fy+5BhaPFtOrnYXPnGJE9TOql61vphs quneOEr7j1vDhosCqnQqly7RZni6jKRVrxeTbVXj/jnJaYE4N8APqKmjDtBT2ru3mEP7VAQs W5mMqgI08iT3pVray8XNXrC0YdUs4WCbEGInKTdcRlLezEN5YSgwYg/WeY92HQLjfFaMD9Eo SWgy9roR7Lqeb/Cdaaj4CrTWXqfGAgO3dzZbBXdc2opJcAsb11Z2eHgSzHLHLvU9thSEtwnK ZRnq8o3mHnNU0WZ1TzT+WjTKTC8qndd4xD/ES4xfdjUg57Y0dxsTtsuL5WRFG+AwSwp9C6Ua 94ODrrbVfbPxpL+JM7+8uF3Wj0RhXNV/WFbJEnaeODtwX7RUL7F6UNKqT3sMDKi/1fOhlQOQ //V2srkJ66SiqTZtA+H5t/T8cXT09tPpWfd9AOz87b9wgfjd27O3n9z6+andmv7m4+mp2+F6 +nf25tXbd+z83enpB/b76/dnRxg7fpld1y8TPLTL8KoBu9tPvmB9n2TNf4T2LyjKEjhSyei3 MjMJmvskRTtfTC5rlkV4HM8+aX4rRCZEhBY+6UfjMVpuYtoYzxLa3Ccp2l/BV6R8Q+uPfzt0 0UYT7Gd6jWOKhrEo4bm7yIW9T1HiS0RiNDWEhm/6aKNx6T4ocnehyjxFK4bQiiyhLXNCVpZq 9HQd2sDye+HonesRl0pHkrATxC5eR9/kAOM6UhBepjxzapxrjhctyCMzwDjNRco3B+81UZWW tW00zCd64Lq2wCzPkaMWjRve0V50LD1o5OfjmWqPJizfOKSDLwTufG7BnZ99ZOd/ffXx9HXK uZQ45vB1Fn+SJWgnHz53NKSjvgehYVe6C0X7LlK0YPYm+iRFY5e7yXUKGaNxkXNvA5alWGKX L7CF3UL77Yy9//lvpyefOmyLjYHLvPQKRxelhmwipe3jq9dvf2e/vn99mvhLHfMt195dCnzp Kj60U5QqRfvl7NUHdvrrp4//TIgrU76VKnFJXHRc0hBYisaVcQqnFc4UnzVUHUP97Yxe99UR q07DDJP+A+eSjMg7GjKf3M421z06UhQjnC8eiH2setCYGotW9KHFtKkycxpinKpoUfajcdOF 46lMveFCchl90kGT4hA7PXSmpodxJuGb8ioDtXD0SRvNdht65tqZqeRupoULDHmRj0fzaU0p pA8VYjRa4WNiYaOXzrjgY9GgqM49u3Cmxgit9Ug0Dh4j6BuBiIyrYjRtklvauLB8g+Bc8CfI 1EuhcBfcqPFozGoIz3zqUKpsAK1rDR1b8Mll6d2myMxoNO5dVCEKLw4+Fg33U3m+2WxGCSNH o3FvUAVFGWa0cyZj0MpcevOX4ZPxfDOZs3pjSI25KnkxXgre95aZMzGu+XgN8Wl06dNoLssB tK6/TL2lV2d7yraVhxyNJr1/M9ZOQWWUGosm6A1+pCqKeKAyM+jJH0Urhfbaa9VYiXLQWz6K hnso/JTtJ+B8s9G08dL7N+vowDYGveUBUjDORRntjSLLn01DZKn4YFwQSS7CRZyH4MPBvgK3 9yl4LsaiYVPQoRXesmQ2mjbhXbu22brO3ZARaNwUpfZEUjzNgFg+Gi3jpRcut5/wfCxtuIqh Y7RM6XK0FIQvKWUIrOVoDYFKSfjKyIrD8MEcCerUl480RLxMhfejucrHooEJ8Hb1QWmNGY2m uPchNuhrI4UaP1MvU+6csNBcjkeTRdzLEKUZjcal6w4w4ewUpp6Npi1XviHi67k8H4/WqLEq ohKpLzoXibvsNC6b5kD4hj0BzdsClK6+UJVj0bhLZhDEWr10BjuONplHCQOahx6Nxn1Fyb3B 5oPR+QDavGVx18rQ3JgnzFT7merok3FoQQFDpNVDnlzzJB3sNAddF5C6qoPt48PReOgjcV+P jEfjOqix6yzlg1HmUTRltKfNtraYyrPyCTPlSXLuKv1xaCKPC3yeG/EEmXrm+yn3dBq/Ay1u u5HhD0XnTETq29M+blyT/Uar4TzkcTTltVeEKY+mjesi+DcyT44HDD+BNm/s2tNmnoDmmwNM lVHQH4UWMgffwASw/AkyDVII+pY/A9+C21RD3hIXFF7uXWBoOWExuHR3OFrwvQGtKEejQY4f o3GXmYykLfSilV8jeAJtWZ5Y1nBv8AA0n1s614E7+PkTZMpTo+DPoSF7uscODfcotNFoz0Ly 22ACOnJ049DC+gIPSeZ42vLg2t1SVF6Icjxtwfc24YY/gW+qszr2BNqKGE1AOH2CFIK3DETq J6B1U302FLNwO0wbjbbHDKF5gx3smB2AZjomNpiHHIAm0hVPMehDDpmp6kz5CTNlooP2hJny hEguymehjT/HTHlnpsNrH1H9YTe8DdEWgr4cjxYceIOmnkBb6i3NYGf7ELT/EN8e1bfvmamz LFHuWWt7HK1LpHgOtEfjKe2lfNlaqshN8bgtyPFowqSw8glorKO9nD8BTR5s9YegPa8UdOLf ikI/h0wftYXnnSnt2m3Q6M9BNPVYPD0ALSz2skf7IYfQdngE/K6ZPgvfDpfpd6H5fsjwCtT/ +0wPQKM9q3//fPo53USU7PnhUvuNHIWOPmmj4ZEufXt0hE5twe8Kg7La7ZoQnYryTbWY1b1b frJ046Dyq7GEJnMjO/rmz8zJ0k20uRiqTx0snpmTon34x+s+yjCP7s8cmiUV0Y3128UFvaHu 0a2lB8l0O1ldz+rZjm2mu201Y7RF/2V3/9thaJ8+f/z1/NPbd6mCcGkGNITLYQ3Bp4Kmd9tt d7NJMeSRgrS7HgnRln27GrtrH7KzSa9jp3TsxabqwpVjLAvRLuqbLnWjdtPVD/9H3pP1No4z +Rz/CgH7sN3Y7WkdtnxgdoF0kukOJklnYvd8mH0xZImONZEltY4c/eu3ipcokXISpQdYYP1i W6wqFsmqYrFYIotNvdVoub6IrfvjV1F7OEzNc19BLd2WuYHcQN7u0/wgb82+1kuohUn+E/vN SEul5ryGt9+uv63L4J6sg4IEC4VaV95mIvl4zPc+nPHM1TNLT6wk2JCkazI1i/QS3q5vvp6Y soU9TU8nbZeSHgyuUft8c20yl02k3u4EZsdTGVPVWrr6cnN2rJtfZ+bb3X6btPLv8fYFjRq+ gGZIwwdrY/fsGbkyeqzHLaMMbzkzEBw0CvldUVvMnHc2d4esZdh7lAUJsyJatBIThvC2B11Y 54GeO9+XT+7YcrPSkGNm1ixKzR/juQf85QfPk+8tzPnersHDR97CpC4ros40NKYKE7HLqVlz V0SPxzyYP3cN63qk9ne932RrPOB40YqYTWxH7NMpO+zShbAmB6jN7xrm5jQpBxR7PJ2+dhQY NceX5MRqd+ZNhKP1Imokz8IdlxALE5EXvWM67u7X6x4+vZHguynJuuu/STMgErpcPUoA1LK6 0snpvEljLMJ6jp4hWd5Bx20NNsTuZulosUF/qlE7/3p5+W19eXy9buf2O84Qj+v07M+T1YXO G9+BUjIYNWq+nk13u97EmUG1xk5/fgjLxfLGemyQvt63jvbBmjmXUuIG+ZYNtWzzNwkbQzIo c/6+wrM0wOvaRW3/cpC1ZK+m57q8DbKW9H3a9Y8sJYvDutAkN8rYoL4b+6f+cgu3Yt0Z0Jab YnORoaRFfj59+81a3ZxrBLUxdcU7fY7QelfXhaWFh+We4NkVnTe0OrvYni9ypaZ87TzW33BZ rsz09BfbXjIKFz28eW7vmHr9MdWLHt48f4iEXB1fnp0bjOWzmQkTm7810KJ2cmGUEd8esvpY XV5DO3Ed2XVD7L5YtO/09tvp+c2X4+WXxStaeshHinNi8hymXu8akPMG4qbNMsfnX43rendQ vwG1k0+m5ekgawnULkzsudMh1C7xLfQ8i9Oq5VviW+Rdn1yL9+o7KQXZkoKkIVmHbW0Y90SP wRsUPzzNJ/+xLdcbvDR4nZBgK0ma9nZn3TwHw74zAesLS6M1jZzRQ8oEm4N6blNULFzTaavT G/F1Zn6vlxRFVbfPLHZIhN0b27Z7vUukxnjbJoFC2Bm0+9FQg06LGmreoNg2UkuyW52/Yca8 TU5h0HOHcPcjzgzjQI846nnblmd0T+2JQYKBGp7kopHsi+g5LkvtdWGkZiZq6Oh3k+D0HDiZ h8EkDtwL19hSeuJYh6ROTcz3YzZ3w7LCdvt46yRMGay5tCNjYUd0v7zFW0PSQE2mDMr0XL+3 35xWrJyeq9Nr4+a9Nq7NmyRpojbuBjEnfh9vncQfU96P390U1Of7Fm8NSQO1JrQnSibTPt7w VE7VsdFj5TKZozFOh3lrSBqoeZ6WI9Irb50EFn1umPgdao47PsxbQ9Iw08iFrvTL9T1UwZsP Fk3hzTcYuHF3A8k5rKcNyUPUpAbrno3grZOIYcrDmHQNnT0+yFtD0kRNG1M9l0vqKR6+2syn +K8318FvWbx+PRUkjdQmXa337F7eWgkFhnwC+XaQbOnYnx/mTZA0Zid0M4bdybiPtzDbb9b0 JLYFtT6Tqd+biTh+1lpSanI/+2AGgJS36fwgtTGee7agkVjDfDrvypt3uKVy7/PgrqdMfHft g9TmM8+mo0B/PKdZ3uwwNXaE5IIfJdk9LmXStiGO4/iHqdED3Rf8YPeBXk0jIb5LrQj77qXm tCavfgmZey6+Nc6+38rbxB1TRWXfb6U2nfljfMOYfb+VGj8pf8G/30xuMsVrbBb8+82jas+n qF38+63kPGeMfC3491vJ8VMYF/z7reTwJt3xxF/w77eSm3mzGSoY/37zyLqTGTDmLsSPNxP0 p9Mpapn4MWTbZwMLo12d3i06G1JtFwfPHWzH8sFw6i8elYFplWQIQkyltzqRLy9qLnWEMaW1 vvs278ix05DnvjXYUs08BUVIu24XFetqva2ThHuanQnMmUrXkJ2yAw/0F7ba1BI3SxOWoDEo HUBQq549koFHpxxHvCJveAE62teUWrzPE5WkN+0ediKY5ceIObOZvnUcIakoLqonvvfDSXq9 tk4e/DV3DFN1sk4eNpqYGKjpr/QZqf0IH3Sh6w3De9NZa85uSa9Y5K87Z98NSp5qqHXOvhtk hRtq7UW+MyjY8iPI13govy5us8OvzU1ck9sK1IKqKrrD0D9Vyz09w6FEgrc13tKq5OjagzRL 8obUlIiX3T89CJ0bGxZd23L9g1qldlO1yUbaN8fpt293eLlautX23/SNwbFYM4hcD0df5MdV vCeF4ZypQfL2+9XXlWkTSd+SEg10PbmBr88LmfE0Qxa4mTje3J20wg1o4/kBXTN9KXJ+XZLQ Wh5bybZah2roZlAqFp5Gbmgp3fZp8SYaOOdnBk58/VWhIu6hNu3dJG/Cv9qYVmG+jnX+HIOv NOm+g6sf8ldHRmow2c/6Xgv2xNvGvm2glsQV0SiOB3lKeOEC3opNr2ZYHNrAF8rhiIPNDC9b QL/RCwDMKZO+63uvSXzAUUgy/ew73CSf2PTzemrrOIJJWlELZ9DaQaHW2oFz3CHbjEVlzjQ1 JGBKwZj2hkTj/Ls5DZaOqQeL4PlrZkB+54E5ORTjrHZ/oo2mp/LiBuPBPyZqB3kLwrtdlpBn z5J92ZhuM3O/DTocsbnGgm6GxDJbbFCqQr619lWgn108bAsJqJmIaekAL6aGRzZraeEehh0d VU+FmzOXHop+xJGgZt2RpxZFzasR1MbT/oA+UsvqImwSrlVv0HmlDQFq306vrX2Q52A0FWpD +y1Iw11WlB3XUhxu0H3jVk18cA3UzvBiITyrXSHrYDqA64yn45nnj6evFRI8Op3aJnHzHhD1 B4ucoNYoA5vh3JYxF2ksY793SgVq28Igwe6w0z0ZtT3es9yy5tM3UOs2VGSbTl4tckwdyrCo Nxq11y54owCMku4oDctW6CFmTQZtHZcP7ew1VVVBQPyJ+7ps+k1yZ06WZtScV7W02IPXEEVP 6w3exNvQHdZvQK2EiSFabzE7ozEj8yHUgrCK78laTwQaxFsMSp6swwy+HtWVw1zPn5p3t2n1 k13iuTNZJ3W1ZrdsLt42QWO/UYq3ZK8kJzqufpqFlimm5+tRSgX5XpOytUSauc/v5OkZI+SR hDW45Zo+DJruKW8RyUkagYQojuGgxTillhdxlsTtpg56k4lSu98HugenvTfgdA978Lw+ajAS bKJe9C3cJDV5kJjh7dvvuhr05NV62sLNQA0vLjXkdg07BeQe9xgNJmnQfIotreJt3A09DAtH X5HqM17wYcHKcq/OqlN+9uncH0KN3mqjkBxE7edfLRKPqJkrippdrmb+VFlFr5/FD143PIqL 77i1Vka7MF7nYWz/hwkNb8kRH/oii72gEaL+ivzxxGmmAAdxnGdxbHsucaYzxHGfw5naU7vJ aJkjjvcsjue6jWhNaR/gIZqP0Ad2H5I7cRUKFMezF1Z6vyf2Ioj2cWqZUmqVlQPDcQROnBnr ms/HSm4ew3EbHMc0Oo4yPh6vx2twXGM9s7lWz7jB8Yz1uHo9k4UV34b2onj8bmwPv0Or1Qd+ g+MYO9uxVXmjONMGx30pzqzB8cw4joYz5zjs5j6jJHRxxjCm97dB3is9zmSsOJKjlaKEPR/P meJVi3yovPlPNBg5sxer0QgG/CMLSlr4znI5si8/2pdW+RDkVpkHIfn5tZaj0Sm5j0OidM7v H6j/Se9psr6V9Jop6/g+iBPrJAA24urpJzISZ8jJSF7lTa9jbj5pFLQGMQ/Ksj2qYGFGVoXq XuEN979/+oj2tsJLYC8/fSz1B1ZdWmlslU8WIMUR1kyvFMfLyye/zKkLhnfw/YJ3ldm/yOvi 4KfNxM2mt8va1tz9mR2Rh6X1IRiNLklZBrfE+gMdg3IxWimNPT9tfv9+9pd1+fX0TPz/+q+r sxv88fnm67dr/HFyc3a8+grPTuSj1ufk01+rs6X2+I+rb90rsf5oQV4srxtGLm7wz3J1fkk5 uRE/TviP0Wi5CwqQokuyz4qnf6I9V8er1ckX8W959nn5P00bFVatC/xzLDg8NbBK9uBTZMU/ 1O9Xy7PLpfVVr/dnixFYk33JNqBGR/BrHzy2M9iO3sEjvBe7gKUdKUrUhcDaM9F7z3DSuH1O 2NG7f7OyrQCyqONaClhlSYK5pwfpM1SGWX1PurUgploTRS6fSvDxGE5Z/mg5pFBbGf8giNLU URIabOEY5LbLX6stHLhV06jc7XkPwi/RgxPPn03tueMyPksm23sq24KMhdy8Z2hx2g68ARrW 8Rxaq+9hzc5qS+v9BjwpYLxNIIYVHHPUS4bfai/mqx/gtrRyoJkXWQidwdCDRA4KS2dj6AG7 wFCvPrXw/dgS+4zIPiOdVsCCmfd6KbSsyziiqCsDb6yhtIWBYtStDG+BUadRZpVVUYdVbUIr k25FUu6UyrBr4oihZPm+leeuomQAGLDblhGFQlsh9CNDrdv78RMVlTLKA3ndoQDMlqz7nstl HZqzeaoAQ2sqw7vfPyovVU79KeDJboe6Y+DJug+SmsMHyiVh3EIE0d91CcOdWuQxrhBJIPxE e5WSSroiVZiD4HgWe7m8hF5Mq9ERPKBrPPH0netPbNZ4YP3I7pSKIqsgVRGk5T6uKhLpgHWa EuzmoIiTJwMwjD5JI5SbuIphaRYBXety9c2K4jLM7knxBGCOBdQ+YIIQp4v1RyQJnkjEmPt2 89lSykv68CGGEXvAgd4QU0GdRxiOVUswWlZkSfPMly0poB3xPWXbQ36gE7ZZgSeDu61uqvMk DpEuwjDmTq+tCjsigebld5X5qRWC0j/E1c6C5WxWMCBaD1ZDOzXNKusJWs9HTCsmeBPphpCU QljvbulN7wj03gC+IbhdXGWZlSWsVerYj5sBZu2GIfpQYowtBReZ9dU+T0hFoNebRmsCQkGh Ah2Glgh42vAy2xOE+4UxKGjgIzHQ4Hx+yLYfsiJCFTZWpssoKC8lGGxhkuSjr0nIc6LRlQPG coQbl2zg8RdnWMK8SzNrdXENfXefJfeiEWZQhAN1yMG6xZuEvDfXytoQJlnJRgH1JIDeiOjA boII3AEC41zvy55yvOudTm9bPMQIZoUk6oJuSBjUpWg/lZESTFrVAYtqAmUWZgJaNFuA7Dcg DdTvGDFtAu1He23x6CxU5KiPgzAkeYWwlHOlACzEPkd428JYJ8g0JWuhTdgm2QMtiW/TDGfI m+WKTj3VjvAR7FYEdQcbILTDno7TMKkjlH5WPxccDKCAxcK12M1qZW2LbG/JXW4TxD1YtQBv 9j4MWgK7H6D+AnpyByO8Q3XoongKtyUb3xan0O9FlnNOVVAmqtB5SIfxBe1tBOQZWNmGlyKV JWuEgmBbMPDFU5bGYQsTOc7RYnqNFySoFRUYKFBMVw71+xGdD8QMQXsQ1L3UGOJkcaYoyKMC igRgai9BXl6E3YFF9BMF8t02TtcPQVyt3fcNGlcNYF1BuyMkDxJQ0Ha9zWNmYhrL3cORRBj1 wHCVI48hIVQugPAtDEdJK2ZCX4CxqKzjk9+FquegIzElNDpyJYAyT+uAVH9EwgjfNw6iSM7a 2qRf5wDNfopRp8ywOYIBsWwdqcKsI2gFrUfoE7BeAqVJmEAGGzA/gkwQCaNbp2B3wh39jac/ WNsgTtARZT2R3cVE7XP835rJoYq8LuKsLpVS3I3ipUgORV8rsxvdlV5l0z9aQ21rieOB6b/o 01gkj0vMYsASsS5hskztWD9wVWYWzTZ/GTjOMS+DpCVZziWf/mMBqvdKfx0EY/0sW8olpCwp KBiKphA8u4JsMphEWl1knmHPTq6skzNrE6PfUx2GOztZvbPfvxzWMcJS5+kFNHW4Nr2yDtH1 hemRAuDGKazo7vhA0vkBn4PO1SFwhpMXqDys8OiMJdwUGzT5zFr+ddX2la6y9ANU2VsOZfah Qqe38ORs1HXM9kEV7tDalDDjBrj8aQlFCxYncjMYazJXKTBie+gLBZSbNvCYlscNeJ2Sx5wq 3UGqgNUUg028jyNmUbl2IeR1AOy11hYgu+iJYeIZrCcq6ZRU8X3AreDL0TDicLlcDkVvLJdo k+K+AGmMYn341/H5ijuJkRBm0KjncR6CkjFG6DIsfAoTtfteWBX4WaPVybUKTpOJaEdjbsui O28BtZOLr8uzU1Y+Ohp3iy/Ol6uzK1GsYYN4rpdnV6uDADcnf8oKWm4fApwtV8efoJYvDRNm Hte0yX0gv51fUYC1c5DK+dXn3vKL4+VqTQ3gc3W4vSA4NiqjdYSr+bFPp/PbItiXLe2gwwZe JJ+H+UQvS1BZqR+QkPQW/tPVQKtUrCbkwzRTno27jgnqIU1VR09jU2RBFAZl9XFfJ1WMvxQ2 a5ArdHUKxmmHEF1UMFIWniVGCqoZuATGhcwuoK58Hm6ACddSKI0nSh3gieXMQ2Ny3vDBcwm3 cYLrKWrgADumoRGH7xjrS39bXUEpCy3eNzRmVGJgD4orMPhoFDAGJCFoZ1OwX9WOb4YqF0Px 3zQUBP+5i4ZIEoxzwEF/bci2K5LlLfjW+PK5vCUrzD+8R+8YdIiFQxFApNa1e6R5KobwHXiD FgwS7hRhoA931d6bQdlyVvXfZZ/z9SQAZeDseU0Rjn+1i0vqgqk4WACuUZo9pB/rtKzznDqN OB9UWZglHdgHtop9pzxEyZAl79GY8N7ncocFmPtodC2U6hVBuy2yOmdLmyjGjhWrAHfW9iTo itDYrsbR2AabggZRIpSMRpmZnEsEXSlBhcr/tEgV/mIC767oAQFfJyAKbKNTYhC7ox/CkPGH DTAoQQU+fvrvoMWkg8qiX3QRwxlRoGHtFVm38bZNToot+Np01QMWkfdCHO5ReR0aD8ZG4IM1 jaXRFSoNqtFxvCUphpFpSEtEXGizQV8RSexXjI6+srbDmFQZMgD0jyL0z1I6v4vlB0rEwqIe ldxMaQwoeNgyyqIAJHTRhjYCHT9uJxQNNVBSTLFeqmBK2SPhLpOhFxEtaYNQu1gF0GojHN+5 Eb1UNp1H4y/pPaxWI/T26yIVg0K4pRaPqSiVo6Bgcefjm+umLrFoaD1sXERW7PDiPHnqPKEI ijVyJWR7ocdqNdnztqXXFQfx6PJXcEn/sOV2ZHGjdSpjm+fX2CaSwkziY2vdA1PJT5oy/i9a 8QaEqjQLVwBgEsNKFAGCKtvHYQN30PS7LzL9zGirDw1Gu2uEx+P/50a4ZXrv4yyh7YKVSg5a X2N+DChPYy7kUm8XhzvrARYwGZL9O4vT0dF5qlnLXZbj4mCHJ3167ujoEvqAeq4AFIclgrie hZEbPGoX/s3pH/JYiQegog8ZyuEe99SaAmXZCUMlPFtY5RSEDjxu5cS3dVaXr5pr9OFQI34Z rlrTJ1HZiIeI6NZnJl9QEZNTSRLCw27tEoROcbqBcb3NkKvzj7/hFoyrQNAx+C/bhAs1BXvC IBDNfilaAO3a0qMEK4ltrHPZRZZtoVJhBTma2AjHz4c+iIuSdmYURzS/EmZRX5uM/UGzsd9M xz14ygDhA2ZkAtbvphmcz9p0xj6iKlbAyIEB51ggqVCQkvh2t8m6Rb5aFERgXkGUCerTwhpD 2eXF6b3LtyyALkxF4IPSotc4B78aHILO3s5hH+DgtMbn16tTuuGUJTXrK4P68t7ptNPt7x73 QPdAr34RxHGw6GA2rQDGwDrJYV1Q3W+MIE4amHAKFDAHgAYywLHfxZtYBobJU5ZGUrClVqh+ Gg1L45h0HtrqZtcmvpWbOHzysmg8M660583GFy3CRqUEA8p8zcWX1DxYHWa3KUzlkZWiJRNz R7eQTec8GM4mLA5EVxcv8MzasiHt1tWp6iroAtQuxyfGcZaYGlRryDUwg7L1wTxDiPdKqyAi 2wAmKk6hbG8V5gXZxo/tZ5zrupAh/FaxrKT1tN1pwgPGeU46N7kI+YF0YTwX32n3Fy1k1fUS So3GMqwTnuBCQ3HAXBq9YjXQH41Rff6XgfcA9QRm2rGcbgAm396RpwXrVMXzZ+4W2O4iCVg7 2aa4uczc893IlRlKuMHPgAmtqp5yYoBVNsK7FHiSFj0DN1ADujpokwkBNoCkJVX1Po4kCOWp H64MngEQtrBVZ3s0YHR7xqJTonQIOtewOklvwSkwCA8HCKTMlKbigtzihIlb+SaoZzr4H0iT 2o9GeBfG9KPje95H53/Zu9bmxHEu/XnzK1T9ZZNZEyz5nsp0FbckbIeEwSSdd2enUsY2id8Q zIDJZWt//B7JYIxtbHDUyVu1ZKYxF59HR0ePjo4uliRDE1nYyQYcaKxxSE9ZAstU2RRglTW3 Rwc6NuBuWTGqhqqQ6uIsDCaJFudl5CJUn623owMqiGUm9R+R1KIXthwMhLZi7FhgDzbrmQl5 dCBWiSKzf+ExGkh+QocTthKTroFE7GCLHRQTq/S/8BANZDyVlGenZiCs7i6PDVkTf1RlSSY/ qkTSMfmxIOmCFeGgAZTiqz992lBGTInYWAMNQVjJOu7Yo91e9qm61Kq6Vgy54mw9Wgn5hBki IPmpajwBA5+2kwq1jwvRuuvQhxzomkwaic+yvltN0rOKRonWrl4vEztIJEt/Wlust8Q7EMPl qTQgWvsBWTP4ZRqE/Y8VbHj3K9R6tPBQ4WhUeF8knSdAg735AHqSwXxR9gP/YT5jd64LLFAW o7RMRetxoSjry9iLGbuEVPy+WE7D2YRIR3e8eKaejoVAx25EBd+heZy9L3VZM+JsGGPcxh8Z DX6Fd7PGtYODGpsNRDdX7TsUHqsU+d7aoqmI/vq0OUSo59ovlT+QCdmGS3zhPn1Wc/2hB3+8 /mhYzx3GAK+gFYKADNGUDob0Twdf6UoDItl02QfY7xktHwkJL8PFn46xM1Sk1ENHavhgnEi3 1cMy1mVrXUR1xfWUFPFTUhoqBMuflRLRPyulTyonSEn7jDxJljywtE+yniyr8mflSRQ/KyX8 aXkin8aIT2E51oey9il5YimJn+P3XFX7lYxA1RdrWp3Ox1Ua+Y3u52Ff+dgORuvuwxK/Wglo awZfbwlZVsR/geLQ7X+B4vgcTjjui3NMz09at4Ctf2Hijv1licuyKH5h4p/jjDYkTvQvTFz6 ojJnrc3XmR3qufOVOadmd9hcxxfUcxpgfk3iYHb9i3LOQrbPSXzkP0ym3st6vqln/5Sk18ua BRfu3xPL/uXmDpN5coPQ8L9ibOLy4GA+9t5AfzrWSPTN24XktPYrBDlvw5EMLpWS/GVmGYbb drDLCQo3zg6XgqJnb8ZWrQrhoiDbn4/oVDh6nfrjh73EXmIvsZfYS+wl9hJ7ib3EXmIvsZfY S+wl9hJ7ib3EXmIvsZfYS+wl9hJ7ib3E/2OJGzPcWRs1OrENuMMdvc+aqHN9c7XYpbtN9yyP 78qNzP/63+Yt6lV/Hsxmj2wPe0TfVKx58EhnGImhoKnvB6ga2ydZwRJyKpW3yqtZeQ0Qkokh G6pGDA2haQ4QQq8OF6B/0m32eQDRo5ViQDrdx3kNSBclUTdUSRGLsoZERCcTY/tnI3v6Wgn/ Z5v0s202X/NBMA8QwgNE+g2xednlAozU2uvTyneUXPqdDyn/huj8aijliuJQsbFhO/oKavnl QI8mwYv0VH5D7AgZetreQtXAniw1ww7WNKLI9HxVP1iBzFy2sR2DkZMMZ1tdL2kwraT4lAeV 4PhHoDLIiXPIma/V1vQsgMF8YAgfGIkPjMwHRuEDo26seYtnEdZrXvjYQBGoxqGa0FNd8rwC XTGV8grgKgpAsZjlF6gLSPkF6ixWfmEF+xhbFEMMUr5CJ4GS1VlWRTGnpdkMtF6ZsSgRTd6q MieBbHr4yxrPVInxLPwLT4d5KbBP2h+UA8E8QAgHELxzdh7c1Sk6AIJLcyYFVLYJSAElOSMr irINZ1JAac5oOG0fLd8+ac6UA8E8QMgHQURexS3yKm6RV3GLWcUtpu2j5tsno7hLgWAeIORj ILrBqbjZ8XM8ihuA+BQ3AGW0CHraPkq+fTJahFIgmAcI+SCIzqu4dV7FrfMqbj2ruLW0feR8 +2QUdykQzAOEfBBE41XcGq/i1ngVt5ZV3GraPlK+fTKKuxQI5gFCPgii8ipulVdxq7yKW80q biVtH5Jvn4ziLgWCeYCQD4IovIpb4VXcCq/iVrKKW07bB+fbJ6O4S4FgHiBkV5CR/xAdQwwg 5UfjUkBlO+8poHRxS1sVdwqoTOc9I1u7d96zQDAPEMIDJBprDp++Sj2GlxpUsuMDXoD4sDw5 WyWa9BECrQOV9RcpoAwCyVsSKKnR7gO5WSCYBwjhASKhP+lRjo47s//Kv3PTuGi090diXJRt 07EJUjU40UQ1ONFENTjRRA17c6lBVUOSiJscVIUvZSlzUDULFKNKlMfVO7qdIf0iX5Z8QFbe PCQebsYSL/olH2IDhiPXnUQ+Ry3fPUwBlZ7uSQJljA9v1cRkaLSdhygCwVn8oVRJ8YeSKmtQ PgOUfBh0behX1TiN9Kvle34pID4j/apWriQzQDB3o/MoSXvqj1egSnl3nAJKLzMQ5W3CvhRQ YgJWIzLRtynJDI12b7WzQDAPEMIDRForKYVoYBca9u1aUnTqNdJEJbKoRUX+2l83cGLeNAb0 sQn8NaCPTN+vAWVM3pNtJ+8TGpWbuk+CYB4ghAeIxANE5gGi8ABRVzPrasbUOoQjhk2s5Ax9 EiV/fh5AMJZS8/NJECNv5QDRM1YOYIAcB5MQKXpDITHeOUzaDLRjtdoMlHTJuoHzGtc8jbZu XHNBMA8QwgNkQyc62tElsxOdh0jEOLND1LkziRNI0rBdAIJjxM7GMCBSyMcgRYroqlIIIm0B YssFIPIWIFaRXZUCkwCGXmRWdQtFtCKTaFuAKEUm0YtzIxVZBBwX2/UfTa3X5cY3TNhybbsg F5KY5/W0LK8nFVhXwnmQ6RGpMJ2Yb36fQS82RFVF8QO9lCRQ6fgkCZSOT6StYtsMjUrEJxkg mAcI4QCCs0eksu7MHZESxYxhCSxvponKiyYqL5qovGii8qCJyoMmKg+aqFvTRC2kSTIsW+5b uxFS4kUTiRdNJF40kXjQROJBE4kHTaTSPeUsoPWesiqTrXrKGUCJXo+UmKFDTyBRqI2aE23a upgvrPGyiZ6txXIjwXxhg5MWmAdjsZznJJIhx9Jz5EPm+h2cNWouivmQRNlyED9LVg133WPs ouqBh2C8S3uIfFNBQa0DbR5YKQDS14GQsqpSuwEZCY20khpJYkIjtSwQTgDpZYFIAqh01qSE jaSyQHICSM4BWmwqicKKUIk+Kno63MJEVPU1Bqz7gFys1KDzB7BSj7d9ACs1YCJLak7LXJDH rRvnIhzMCYdwwikcHBgMDeoci3DkLQYDMe1SFwEVjREMBmzEowhGLRpWBHW2yZe2sUMcnhNQ CKBvAIiONIi3RcsTFQpRjTzUZGS9TOrgfjIMncryygyupSProgdLNwPt+KjrZqAdH3XdDJSc lsSqkfc0YV7WtvYCuSCYBwjhAZKYkJASC1IhvpkMC0GSrdJGL1sEpOSNPVlZD94O4oMKa5Cq UX5eNQVUtreYAtqRinka7d5bzALBPEAID5BtqZgLIuc9pDnIeoDUisf9dEvsqFekquXX36aA yjIoBZQcbyAEG9swKEOj3RmUBYJ5gBAeIAkGQS83ziD4yQ5GhTbJZVA+WdY8GN1X/Qkld7vP l1bLdMuzgLS1AROiqdsMmGQB6ZvGOhYHNWTOrN07jzZb/gTXkUcPYaWIkrHz8N1moB2r02ag 1EIXXc5bfJan0faxQR4I5gFCeIDEh+8wNpRl93dWqfR3Kam8JYxKxvxseN5TPqSyRnAl6tiF uq0TPBdI26bVKcqgvmkObzBgXYxc4fhYnCSB5jkjMXlAOHOxm4Yz1qUpdua6tDXQjzxKmAIq 3folgXasrnkalWj9MkAwDxDCA2SX6poLVK665kLuUl1zgfStqmsBiBEbGaA11ouPLjiquzah nQGAMxeYK3bGAnMN61vUNIVXTVN41TSFV01TeNQ0hUdNU3jUNGXzcxtZd6p5i/fTO0mF9WsF OX64/3vuztn5xIqolJ/+TAGVpck0mPmjZZSofKCLnQLiplGyi62Q7R5QzNBod+JmgWAeIIQH iJJJ3Kw79bw2wM5aWOTEiZuA1HnRROdFE50XTXQeNNF50ETnQRM9NSOQaCAli2iSo4v5CFsR TS8gWnjqZirYWFtHlIBUeRFN5UU0lRfRVB5EU3kQTeVBNHVrmqiFNCFZD0BKOf5I4UUThRdN FF40UXjQROFBE4UHTZStaaIUTrXhrPGqvGYL86IJ5kUTzIsmmAdNMA+aYB40waWXm2UBJR/M 2mq5WRZQstu71WqdLCA1b1DasTMme/NaSVzoUaWsXj7RCyCNPMiM3TtZA58LiXMXuDtZq9Ht Ai3pMFn2YJ0hKnqRPiQnNGJjB1ZR8lIRghHXwRt7QYzU5T1SCqisR0oBpZ7clw1pG4/0RG0w ioDKb0uYAtoxa/zOvHWe3dkDwzs9rV9f979/p982/Mn71Ht4DNChfYSwYZAKEYmK+o8uOpu6 bt1sou7U/6drB8epmzVDgFddZK8Se1XZq85e2a8GZq+EvbJ7DPng3yh8z31wx8EM+UMUwMeb sffiTmde8E6/aVgjb+hPx551jGrUv9JkZ2jqztzpi+scHyyV82bIgq8fvBnw1nVQMLUc99ma PlGUeC7O6BIVK/D88UoYq8dipXHT67Wu+ujZ8saVMdEVrGiVoTqwbdEgylB00XnrqtVrN5D1 7KhyJGyPrPEDYjr7Y8jXMT7W0OFjEExmJ9Xqgxc8zgfHtv9cHY1ewpfKZGFJ+BHRL/zpQyUU rIiVB9vRRF0khisOyNHBz1rvqn11foJ+tvtXLdNE/oQqj9yxNRi5joDctwlgQd6duQ0Zn7hT MNizNbbd44M/8bHI/v5Ct/1Dd+gNB0cn1Hr+aB6E6hLxDUNy0a34L9To3qBnz4ZwxnfcEzSf gL0AeTj1nxHcbaHAhyvBkQxhMieoDU5jdNg7QlcYKtKhLqrHsljpXPwP+qFXwE6zGb3vKJKT /gLeX0OZeuPfv52747k3dhnGN4Tazu/i20Ckh2SjM+vZG73DZ4izO6DTiP7kImQG7mTijR9+ X6kvU8gz1wrmkEt629AdDAfD4elZ90a47bSEZkvomi2hbzaEjtkTurWW0Gm0hMadLtS67YZg trpCp9+DX87pLzWh0bm+hdv6VExShcbl2eWNeSE0+6ZQa3TbQqdzJ5zdAZQJsPCPwItw0e8L /Y7Qrbe+R6opcdUI6KYNhxbTDaQkodu47Nxc/tH8A6BbpioLnesroWneN7qXoPidYMK/lklh aQpUwmzWz4WzDqh4h1Xhrd8FpZsNSLXRblJN5GMcXojwRljmICt1yP91t3HVpyZoXvaFWsu8 agt3Zu22JVyb4bV2C3nCakPoNXu1q+YqDyrNQ63TjJuY0DVq0DKcmv8wG7XLS+HqTuhaDy4+ r4M8pNIVLjsrCC0JQU2BCT69rF2cCbU66D91h25gP65kdCpjBtO5TSUc1HoL3LEDb+JqSIZt ae7g9Mw8N+u1sIxrzf8U6p02pjkiwlmz27qDIu5AGcO3RGj1OqbQvrplFrsCipjnQvePFqht tlpNodakZq91l4V+3e3D2591odu7bvR7NeCNeVFbqWkUqUmzaug2GGFgn9502l2h++MGrN79 0RJ+1tr97o9z4fwMiuMWSkW4XVGi1+yChlB8zXavvbiqcj1KGotFSUuQ9NDGOkQ5Ipio1xE6 zfvGZavWE9r1Pvzr1gWzDxfhEjfPLoVar3Fx36B5v+612BvTrK+YgHFRgjIkqOOoZmJCBRi9 4qU2PGVfUcuyNw3hrn11A4XHPpmr9JivaNckcr/UzKS8UWxx6KiD016zcXl/dQ356Jn3lITm j3b3nmXlnlb7DtQk+Llfq8FlhcrcxW2/8naCaBW/gPrQ6Z9BdacqtECpm3MoBjD9Lfzr+rMA 3NM0kmY1GlgGwhV6LogLkceLNfWscSDEHTGiP0LL5NmzSBZqEkSLI/Tsgvt/R+h3hDWsQctp QBmhQ6xKcOnUI2eJod5YL3S54UICBFQJAhYdyxoBAUXR9DUBqDStFzrYH3jP7hR9u6Qu4Bv6 ew5tKrSuqrgqGyAu9WWI3oH6tGE5Qae1y5r5o4ZqqIPaKDIZAaZFbdKltDjyxLKhibV92goi 0M4NkdrNGbTp1hia5ollP4FPQIca+o6kSEkCNFo0pFWz0z1Bnfko8GhP2p3N/Cky36E9f0ZN N4A2znVOoN8DLUhkRUIS4niZ0OHsCL3B3TYoA+8jAaDR1Bo7/vNJFC1AA4KG1ixAM38+hcJi LRAyXRsoin647/DWdSIAeQXAhEDXF89xpyfoW6bgt0hSWUnOxwPoMjzRlKFP6cWaagnM6/nW xKP9httFUEGOxe/Im/49Q2IFYyO6FzJzac3H9iMFqnVnJ9C/xIhEv2urFIEHUwjbFslB0EDD e6Afi/OHlu0uhRQw6dPAEZEV0Ovz/C2iiQ4/QQwxDWwR6NE6a0PsZo0ou1CDZifiiC7FbowF ZRYN0uj9FX9Ycax3iJ1ATFgLSBYBS1TEOhh89jzw/BlNdMGHjjWGMn6m5K63r83vVFnPh4oB cYkmDawBCFaWb7EWYSkxrBZY5B1NfLDACXqR0KEqVwZecCSghdnBmsdqJAr11XJnY49qAc65 0qg3BHaFBpdezxfX9uJ6B/EBNA6YvhBFXdmG1mN7EuJk1DCMJcjxmTd9frWARq3pFKrBIa2d ELk12NFCYz8ITfYCnuX9eeCP0J//DWL3Zv242xDF4/7dReO4d3FTPzZNCOgEVGuB1+vfn13f XDXRIUT2CjS4pOrMXke+5ZCKhJWjKHll4QxY0idrsgJqzll9GVtQ6CPff5pPqjZ4ALqudoU7 mfkDGuBWJI2scFWu2SK7Zkv7JdmSDD0qz67/Cn62Pg8CIPLh0HtzncVtkk5D8MeJG9Biv4BO DPSmXNtjtTt00n3qpL9HLB66DqsHlcVbaThEcC9LKcIE50nFbOjSBNTDX3Rb/W8Qp7t/z92x /c6ie/qHIAJfun1DieRp0LDWQmwjr8TkcYY8LgKQ5RUAyQAguwBIGQDSLgByBoC8CwD1CwF4 Okzrc5+16cwjMtf2PVVmrBlf3P/Tgo7t+GHB//G/B9D3nKB29fo4ultf3f0hPwpQRiKnvX4j nk+JaKoez2SkMm3xrYBJiWEmg5CrE38aAFVlSlJZEsQ3hb5TJNpUITGVdZKkq6cTZd3W2JCw TrK1SHJlG2ksruSlROrUGVRoE75mBUUzFFlZqzAxDDms6/eRMQhrMxYqQSMkHYcA0OeN7IN1 Ua+wyyBtE3C2E9sbMMNS73QBMWYFuiNoMPWcBzcCsYcUw87wAqrKICIEJjyfMeox6OhGoN7L g7W49/a8VrH95wkEphDuIcebTUbWe6xQme+RwfGg0COp4vKvEn5gI4JDIbw3+kVe/jCk9liE GxDALNRZaaPHtKnTcTIaRvkLieguYO3bY6hxGF7VRhBsQdjz5KIbsw4GJxDj0eBmNKKcjHTF OKYrfEhqJKZV0sQoMYmgwXvgzhg2HTykB/0JKAwRULNTi2RwJPPWanQhEp5YAw+I44HwKfQT +9dC+Hrbumoe2uKRcNk6rzX+sfisHi3eaMs35Ehotuq038E+Sv9H25M2p5Ek+9nzK+qNYmPt HYS6jr54tiMQwhLPQjCAbO86HETTh+gQV9AgWfPrX2ZWV9MgJGx5dhwjtboys7KuvAvMe2Ue YvPgmQffPATmYWQeQvMQvXlf8AxHaZ3BHqEZIO6LJmWaasyuWuejRcb6a3BlWH8BxixN+Z2s buC9YvNpt6TCevX2++2JBu9kBgu7xMAeShJ0Fjaa0fULEhkY42CT0u4tUQC4Zyl41oZCOl1M 0BOZTrdpiEM0YB2DfKPVL+AI9euD+tbOKg6Gr7e579LW9/RfnqS/HP2Xaw6Nh4ERvQ3xkesD g49y81ZaxVuxeSvc7Q0rH29YNMhzponnO16VnN2nqzG4AQ4tHnKdVcA0Aea1bzVJYfxoa2Xr BbYa3wbISU0uHHMzCyF4b7N4QlOZPwNpFEHlXUN2dQRvhvkynMczWMqQ9c8YUNk6lcIvnUrh 75xKZ88gnW3inGWT+Qr9u2CCeZfyAEDCTafknbTbjRPo3QjCDYECVu/cES/JzS3BW+LKe8yV r/ccf0rq8gKQF4CzeHU/X96WSVsHtqUvNJfiB7j093CpCF08xaUoAGEFZ3fTuLx4V5/aMXje SPx9sZ2dzXZ20ChNdgajCW/oupp/+UP8i0f8a9kgn+Jf5oA+mtfpTVioCQxCN1djXT/bKE4x awnhHH/aDEdthqOMOvMse/PWfnqQm8656bzZBFnfZp9EVYhji8WDZRDeUkfkjqsCQxiM6wz9 Dm4JxQZfGJYPLNPFar4EC28W6fe9rfcFCblNguCogDJjREs/F+BqG7zdbx1/0d7/cr1YZVpq 2OwO/JtyL3YxNDObQRSBnZnVGGwWm9cir8aTWhjU7KBAcgwSwKNJq1k5wXMLeMCbOsGRVZBl /Vigwn5Js4DsIdwqrX59z1aR/NFW9zFGDJi0AxAp3yVErICB7TSOgnCfNXF8xS7O6qW9si21 yraEkHqj4B9li0gbGck2o3KXUW4d0HeAZD8jFJSleG6GjsjVpLgIfZqzdj13nQ5AgFUMF+vC RGx0rx8BicK4zRYkQs/6bZbBeuuJypVFHt2Dtjyyp7NPYBm8tr67MbvLMAITvKkWVP1tqiaC o33lUhyndEhf510jLf7mMadSbY0fRWvZ9X6EIB3DxOovZGEAO3kK8/6f+Sx+DOwXHD9kqP+D dKZt/Zzzhnn3CFWhFHqEyn8E1RXGj7T2+5GwPXIDxLXIv/Ly3b2h4G4oHPIs8fb9BvqXPEsg 5W9INQLTWSFaii6ltYGbzWfH3asuw6Oab/v7dDLBb81egh15Z9KNJuWazlgpWVtQhJ4xwAtz u8B5w8RlZ3Z8lsbMrHE/nmUgz2jC8QgYVIXxmPsFRe2HyOtkIxS0qdsfp8nqMR6no4Qeo+lx 4z3m5uJjJLHbGX+uM17gyaIzfqizDZLa7Uw815ko8OyiM3Gosw2Ss9uZfK4zWeC5RWfyUGcF km3tuPCD/lYIA0wSkHW+x3dCAMU62O4WARBhKajnGITsg97WbJrFIUG73EELcX0Tz6zqZrW+ oFFMVR0X16d0KrW3pHGkg6JpPV6PSD2Vm2yFFiM17SdWYTpB7p9YeNzuwLO1rBPkqkIql/H3 2zQ5KEsfpv8/H/osSSdxpmXMnQle2xpIuKhTESgDxY4pmMV8PtmAJXkuzkh49hqtH9I1QvrS L0zqqzkrxQvCYBllLKHP+wC2gCnCUI7CQE1uStaNgQ6Htn3KxvNsZbJXo3WSxJRJE7Yi7wtx huC/4fzgM3QxpSETMYKEBcT0xCwKKD1BDdg1s1gWwm/OVsHyBnSWxSZrkFS/ISSQu4y/B+DB gvC4+tOpc2ZzcX4KzgZY8ezP87ol/J4lbGF7XYwTv8/R+lo7X62nI9hsj+E0S56ylWapRgxt KkGqKicE45MeTsBrTikvW3AHeaAQAyg6srj0jPvgUcOaDpYPaKSt5qBuYavqTUIC8a8kq/2F f570Op3BSRQnAXh17Ou3arWqKfhSllN0Lywb8WH7o0bJdywwrNW/di4dLaWRVAUGMEmg9R4V yG9fRVVZQqKRo88OypLzSYqWY/6rAbtonqWrjXNROkaE7viSwhDjNNIHCZnI21y+aTtI2hwq yxwq8eyhog58DCcAdR0EeXvR2niRebcaUEobzUnMlR3kA7OBozkcGSKTE9dkbMt1KOPGcRqI XN7gormqu+Q7s2CTMs3b/huzYPt4JDWjfO8scA3oOOj861dih0vHtYq1Ev8NLh0fxYHmUuzl UhCgyz0buOzhKdIH6j5IV5T3xVTQhqSnuHQKsU+aqd8YND9S3Ku+jtI5uWXQz86m9ZTg6Onr XuXWRECbQO8kb3uG6P4p8MDldPM5EDtzALRttL/0HMi9cwD6U4Kg8iXaLnpkCgApdxvfstPJ Ol7BzIxZLwBetgYmq7YnOaa4+vGKJgxl+HqdRjUmQKaFCfg+kfKiY84T6zhQ8CPhkSWs2LFc y6pqErDHd0ggAev7SNlB4nkJgTmW5+PZ7oMM12sDSo3lWg38n/A2qxEcl8IBOKzGPrlZrE7i JB0B/3AKP7Qum/1/9wfNNsPKlqv/ZVgF0gU5yBoXzcbHPuGDwMaYYxs3Avaji3c3KjSrET+u tGGIINrnpDEzXX2BIg/lcjpFeUhwti0VwF3OYfqAXF7qOZ1Ha6BYYyxNhsvVveex1Of27RQU paoqzi0bkN46779Gy+k3dj43ntbNMliM0zBDfT2JZ4XCDLIYpgw2Boai8Smno1BhAA3yA/E3 LX0eWs9hbJTHRbQ9HKeTSKMwMp4yVNHQNtTaYZjOCzz3RXiUrcl5ysc3sLA+sGRBbCmk4c06 fHeM318FBsU8XKNLiD7AJLjRJAVZ7Fsk/9Xs9Tq9f7HrWeGE5hxqmQtmZJLe6OlSFntdQEkf zz37dDoolLWwnTe6I+WgyZN3lK1DLERJ1pPJA8OcMvJkctjpFK2pf+KqngTRZDGMpmF1lM7+ qQk5EuPsk1twB9OU3LrLdLb+/hH875Zo0CJRLwYaTxkA5mqnCyNJFxmCFse5oJWjKJR+OW2E u8kDd+Dn6diHppZD23i4DAl+iB1b8p3p/pDO0mwMEzDJN/pZu1GajN1ZYK/vRFVYbwp60gyP HxgeNygYvcx5fXp4BtoRpeGJQ8NzVMGOOMCOMCio6HLaT7NjoN3ybMtD7Lg425qAPMCONCiY zstpP81OAY0BXkNCHWKH0uKagDrAjjIotkZRz7JTQKN1YUjYB9nBkIwmYB9gx85RfKlR7GfZ KaBxLg0J5xA7fr4RgIBzgB1Ho7hUNZfTfpqdAlqV2HEPsONaTsGOe4AdN0fhlt477rPsFNDo 1BoS3iF2uO0adrwD7HgGJV9f71l2NLQUPhpoPyufVzcTVDFD19pIaGlLl7+M1HhdkvRgh2KR 2mN1d77eFZDbbBTaB/6UTtUy1EoKqETtYi+1nJMNqapf1YdeucL2niBUY8F6NQYdm2r3HNVh MJkwTE/h2LWNYivJ97Jyft3ACRtN0ywrOZUayaVI0hNI/ctuYxvce66P3jawZ3toBWB0dTUZ gkE8nKMhGVLQcRkfr8FECtgkDhL2enxfjZZpNYpH65s3/6PRHdqchc3VmoETEEzAPohoQsFl x/yjAP/V8oU2ErS1A2OcpjP4k9YIdCNHD/XTADiMF5MgpEJOHa3/nW5Z/K4d5Vl8z34HEvCi SpgemOGAmaGNyz6cDltXHzq1ogUN+RhvuLzDWpz7NFqN31EKKIoX8CiFgcQY3wItwne6+iII qUTpLn9VfLyLG1KDQbMxzBJM43d6VGn0DodN/JGphQXZFl5jS6P4nbJ8p0AEEzMGHyXnGF87 SlDIub4GMzW3CLTNW9Mx8PtpquFsBx2PfXBjbQw7YGirJ0il4TibjggKtAZ6cXuhtIntExyA +U9RuyEN5Fpc6vyZMubTbjaoTRJrk5Q4th6VJBR5HU1Q2SWCRZJNtwrpFtad/1gq6kLI4zEG UCOd8Mgp/fbVrrpcWL4Wqv6zEtInaMEVRhT0xO2tm+m3T9fZvtqGOAkwlRUno2Qr+eWVk1+e tZviUpupoP5tW9fZrp8q2TW5Oc2ixnIlKiVaRcSihyEspRhtiqDymgmslygyuO4mV+vupt82 uVpOnYCowYS66eRHRD7BnpD/BqwMk/tjnkt+oueVmd4l8QQuodqWlCXUojDWyHGrivlwv8rx LkBkuU7sjd5UWDiNNiAVtnpYxBjo1QRd++8hCPrDqeInQ2HJriEIrtWCLZN4SCBpxjhCOcKn sLyBWia3mMYZB8uIete3IrBy5AYv5c1zcY6oHqhyOy+GRmFhspPHn9stzCDhxa5ynkxjYLVb CQNEP5ayJCkIp2ajKB5DWDjhfAu2OR3FES5Qu/NBR641oKJLbwaQ/wAbim4klTCeYQNDlluw +9nwues6GHKbZj8QTqQrGqtSMJFrGh7YR4aGx3R6VFcSfP3y788XmC2bL0EiBlja1jp7Zxk0 DIgA2uFYIoZNsrjUs8hJOFh8o0n8YM8u2ChSoiozkaH1AnfOXZytKHnZve41h/lVLLyG1mmf NT9VvuIds8714Fvl63W7Dj8/9If1Qavd/Fbpf25VWleDZq933R1UrpqD4dV55Sv+bg4umr1v 9GpwfVVpd/B+z8fmv0879d5ZpT4Y1BsXlQb8aJ5pxvAjzMHnjWPSH/ntiRqrYqutlI8irnn5 gU2iPMywCFbjGjuZpCN2ss6WpQcML+3580THQk4Wtzc/3rKIlxP7xK4qcTINwvEJXs4ilmxB FSFSUIGiCbOklALb5TFnD80JwPQ47f9ydA5thBobZREN1xGOIIeBSjpgW9w+PtbXXQOJiWwy umD3DIPZwzBN8ElfIq2x0yBi0WxIN7SXcYa5C8prIHH2Ok0WLDdfUOfwUYJnDcRUegPWF7Cn GbItB/XpZH6AH1dYnms/z/lZ5/PVb185aDGpqDLy0DC5rMLqWxjya83u5nSJp9W9c1he3mWU T14ng+nFGabEH/Kv3M7L8/Qf6WwMq5RX3BBhjkXx0HF4y0bwY7UMwriWNzoSK/6OLDNHNE2h rUIeotYDyjPocUjTfxMv/wCVHeaorsIk9BHfQQXTyy+jgtCeAZoK/RwP7wsCntjCi3kcWC5d upk5+dLCOgeAGTpujulLlNVHchtThZGdGExAiaI/SKEbJKrkOlI7SF4cB5Txi5zhMoDds1iv AI87VHQEiI7FHUS0d/j0lE4VpuF04RR4NpUEEZrCOM2Rs40mwcC3Ca2ENBrZBsnBzM+Ru4UU we5xFTEZr9JsOcSK6mAVjofZMkR0ZbCpqOrI28YWgRQ0xBjrrGAJp+vvNEIzQOAIB+jvoI08 P96gzcYFu5KKqAlTYvDniFsv4xdvIiI632XYde1Nz6bbyEwSp8LeIy52epXgktDUJiCChsvv 8TwBNC8xKyK4IG63900kY8VpfoarILsdJjNA/QNLjQyaxADUEd/eOaEYOS7Nzw2iUR3acLme DbGqJcatxz0zTeAt0wmxdynIkdyhsBov4yACIvMFDlkaCnTL54hv7yZYIT8SSAH8ydth/D3F efJEjoSuJiJt7SbOrdCRcYEEUgDUMGpkQDUMS0pP/P0yCAgr/ykZ5ICnJl8mgxxJpQg/LYMc 6dPZ/nkZBD6q9dMyyFHKUS+SQZhnfIEMUj7qqJ+UQbbgvyCDbCpa+GkZZDsYkn+JDLJ9UiMv lUEgTawXyCBH8RfJIPhPvUAGOVTu/CsyCFx9/9dkkEsG9U/KINeR9s/LIAfLmjxUhUXK9kqL H3SFLTKkqhrOA/WscoNNB5roIyOU//a6W7nsdLqn9cbHSu/6CmtWKu3ry0GrUe8PoOlzsze8 7mIt7goDHhabrtaMLscXlDF6/EpnE7N3DtqN8m3vS6N/3a4M9K/L1tXH/qA+aFb0+2Gr+8nJ G+n5vSEmMAb3ijwfLtyqBf+4rmLObmlydO1jAY6JAwJ3WK3G2WIZJ+l3zNpy4RkgqojKgZLY swDwHzg/G2BHsSycL+I0ws9VyfE43a98dbOcrxcZzmj+XlCl7isQQ8wMWvC33WbvQ6fXvroG b+Z60BnikC874CqZoTlU8qmN280SgMOIS3Da69TPaMbNGvRb7e5l88sPrIVdTIfjqvJSqFgJ dzTaWYtPl/WrYXtwrR8uPg/q5+fY4f9dt0875QaN1O8o/OFULnudyufO5bBdP281CuR+56kl rVx8xiXvV9rNL4Pu+WYaUMu/IoGxt4KdgDwM6G8tWSwIMklqSUzQdvAP8lmeWEVuSJFblpMS gSVqQtl2jXvQ60hYVi32pVsLpZQ1T0Z2beTKZJtmsF7N0X9jC10QLB2M9OpncHCKyfcxx2R4 jhy7FjuBXwMZEdWsGlhVfi1R0Gli2VENv/T7Rb2AXYc7fgpucVC+EwDYWTzBgrLXAjbEaZDF xwP2FkNrx9F6MYm/v39TkMC4zCv0rdYZxopX6V1s2qj6bWtve0Jube5Go9kdDHuD+tmnnZ1e gfU+vWzWz856erW5cjyMqRTiSX/WGcokrwoyhGN+pGjErxaBJiGqtmvb6LvsiyBns2i4DrBo Jwf1FYYC9KutYjXdiKXneePfWfgDxD3Lxurbgnh3Ejx8tb5huaG+rlxhAnzXCkhLign0jy+b rNtoM6rzW0HrdzXN8kLMKnut14+uGeTkbX8fee68gHxB09lL0/sFks4WyV4czpfRzjzwX5oH B22PfR1sZoK/gG3vCba9XyHql4lezVm7ddbC7/nBAukSHFWkL8Kp3rAaPm8THpZGlGlgRdnd fLIGSXAbP+RFv5qUC64CVikuV5PRKrmv6Ydhcj9E46QGhzie1coxrGwcLOMTgjo2cXL8kyLk a0DEADn1mq3DsS4BwyxcuqQq2QfqFXU+uu37zufsZrgerQBMVi0fPO1yQZn59PsqNXOuFMZa zi4a3V7zz+tmf6ATLyDUV3MmbLta+l+nINCxIFSPvFREBcNFR7C4L0CogGBx4X8NBiYh6mr9 rYhAswzicXZ8DGd9Ft/Tx7AwJfGSEZYDz2dRpnm0LU7Xtosh0PeJ5W0cv23wm34FK7UAJtIs XM/XeEknijeZUwJWxDF+qN+xpY65N+C8pkAbYX0eqAP+B6gm6H6UReZLy+j7yo7h39fFMr2D nTnNbli31/o07HSbV8PLzjmwH8YgvfM+YLR4f5g+uRKgwZfDFEo6iyjLDF6o/uSND7ioYIJm q8zgKfoYhSjSJeKF5VVjN4B4HzyQPZmkI4YpBvpgzGCCO+wBJ26lMwoCSwgtF42tn+XAQWNU lDgAE+3/Wzu65kaR3PPkV/hetmaudhPb+CNOVR4wYIezMazB2czsQxcGHHMxNgu2k7lff1ID rcYxdXVV+6aW1OoPqdUfdIv/v+xuB9WBMnBKLJYNJAVElny99lDm20DHX+Xr93hskZLv4QFX 5Q9t3jPta/wDHtCD+JtZu10e5sdAAymsqjCpwT3sBOT1PB+0rPyvZ8EzxCgLeMGcbtDyb8o8 IGOGVs4/bt/e3rZeD4fCMu4xTgZoWIN+45lg2ruDfLCMTJKinOK6Z2n293284Qz8u8jncVnu jklakobtLp79rnDDz0n4W0fYTt0d8t8ycN14TTI87KOCfYSRtkYSe3I4hni/s9uDGXbInbBo bfk345IK+3Lcs/BnDxnIPCWp5Pt6t51+sanl8Z7wmB03R0H1IfGhZana3f6Yhq2viR8whL6V +e65kYpikVSI7OLRQ1e+mornzxc3U4Fv0Glzt+AUl/Z53f091oHfk+UPnvNtWN6APGVluEue FbbEPbl0ZCxJfdCt7GyCTOSCDfxQXizhsRDuTPbhlWu6ODAGNU8GEoYDbnNlYtjG5zAu7C3V NMN/jZfeqNfS0A+jm7r5U2nfDpShgk9Xa1xK4aZAV/H+zwFMWOCb8DVEC1ySuWh9xecR31r2 onU8/jzjLebe7QgWgvhVPIVuCh5aag7myq+fJmnrH4+txWo+b/3yS+ufUnLjQ8NC3P7ebQ9J hF9j1qd4F97hDveYRVF+h6FC76DpdzDg7vhhwm3woIy63bLMUR/9WpCeYEvw2Cqxow5/AspX 1hj0bTjAv530+yW118UNykwfP1w5geMcA/5CIVwzjmX4/IK9Z36aRtnXb/zr9zUSbNq767tN hhGO6IZI2FM6YQ9D+ih9fADVRwd+5r1UyCpgPKRQBtdz9++r3L0uHlFLmau8PaUha1RlHY5w JBbnMcePv1iYQdcWQi6QKK47ui5vMCjldTpDvA7KMzD0IPywBYZRXvbQZwKeh/gNYteV2D7/ XBBvkrTIHO35YUxV0Qs0noAp3esyh+1KJlhDt2p6vEHN7fMkPsqNl9CoxmFDdw4rTeDfFDEE Gz8VgykrPcGaDHMUQj/j+QlSg9Cq8d1BD+cGOfNncXgc1gmvS7rvlZKUdge/EsZpTYxI8hMx pUHIqFKxUkS+OQYpKx9B1aR9xmPPQSWui10rldjhAD0TZodVK4ygfUgCKwwe34btBkmVTfdg fQneND9gDlbe2CkP/QqRV0koe9QwUINRJbvfxetGdQHXhOLxe6dBmKjoiIdhzGHhmFF7RRJV 2jDewkqjfZiT8RbfASeDd5gNS0uTEDi+GmoSVs3qD/p4mRU8KpOEiCQaRnd4XUZUjSeYZnBb z2M083fY/m5XyKmh+Ll2Q7M2lTEMilfxGCSqyscwtMyhdE1XCCB3c/+/xA57eI0RfwdXZm59 7f0qHjgb88kAkrzJ335tZXEK8wRUdz1SIr83HPZ7PmBzwoabfscPMdp2tr7ErttYTlEuLp2U cm7B9xWwEuYe+m+MLl4+fikWHjc35SHOF81eTMwpw/Ma/qJb9Qz9Jg6hEl/KF943eJ0h3kdf iuDaMGd+eVIty1gC4S2q5Pxhek9M8yaPnRqax0t6/O1VlGeaGuxamataztxcTAUekZxZYIxn 3Xhm7spx7KUnsC/G4unZEsmVO77IVlxHYcYCT5wYv07SQJuN9QaK51AJ6hNTlzC7DJi4v8Is 0zOnqmfaC2qXYRiwU+l0qhozy3CfrpDrtXU15pgvxhwqqlM9Hcdl7veFJmnJclQPD9RWLzPH JEbNZKb9XEs/OVSqbVkrKssiysLwpvpYTuoricwrCUhSxkyjzvrherppi+T0h5TwNAdq4Lls 5sFyUaBnOg/KDD03Zq5OeHXusfHSUGfMs4uumYJhVdRnYzm2XQP6wjUXpvfYFhQLbxppRQ5m qS8/7IXhPt7fSOaIb2sZvjJzHXNxSRDp31fGCqqlasuyfAYVlRW3eFaXprrwPlmioLhSt6n6 fLY0CCN38gTWrmy8mmAJ2kw2fl3iusoAjoEjDRlDxqt5c8mSNc2DpkzUFfQt9qrpolHrdQ6p Gdp8pRusdAT4UE+uF47pT1p8su2Z+wk7WaqWIWlIMl/VUcfmHEaN1DUC+b1u/OpKN6l6T384 lnZZ4FiHweh6YANMAydB5r+EMTrBPl4y1/xhPOK3norIZo7tmi8MmOwllurinbJVzQuBoT27 hlVLW+4F/Umie6AoqlddRa7mmqCIufr9ER/uXw7mydIwYFLp9JoIShOh20ToNBGaCh814IcN +EEDvt+Ab2qbQk0wJqY0qKYGeOG5OjbmddRSNcmAPcuZkDU4rrHSbRmxtDUpqekj3H0Iu3R1 25XIi4nLcIsqI8C1zHQZUUtoVDdLr+f9fWV7Kk1OIHr6L3u1XKjzGlI3l0+yk0GcKol17Ym3 cnSYi6meE6nOM2O5YN7clUzNcz45KHTFy4k27EmWxN0zjqYaZjwHMx7bLzWkPZnMbZVaPgHX rc6n5OrBsxraJ7YC+9lZGt6gliInb1rqlEaN8YKzLHM9GMtTWamGYTm1KXexslSpB2Aws95Y UlWBWkn+DIrFb1JkGhrTVmNTq9uao8LsPXW8K1hrvLyCNa5i5aoY6nL+namgIw9IK+emuAX0 Jc79CkyiRGAPFXTysyPb5/ewfa9QZWyWKonXlyu4CKBdpdJAEDZhIPi3hPaPVPpZ5MvjOJe4 CQwrcIutSqkNAkzSI4E5gRmBsZKIVP6TmpxTtQ5Bzjai3PScBzk1EV9TiK7YVlAoGkIdGoj6 pn5OrYuocVmQ5KIyQUxMMVU+T0AF6V+iAsd3yu8HEphKcObHovCY6pZshJhk9yHALPeFTIxT QrAQctrkkt7OSUgqfFtLysWUaHUuereIFi+yv1JvpTs/31LnCpYjQUzihxR/RCVT1xGl/VfR DcFaYDEijaQ2NGpRyZQUnUo8u1RiEQ1PT4I7CWmU8KOYKiENo1fBHX8QdCZwJ0D/vBFwEFFH i3z+BylYDL71h2DNXgV4lLXcl+DNu0yI9iIVx1LT/Yh6k8AdKXknsGuq6npDIGULyLLISiLR tRtq1Cv127/JBHckKsnfhGFSWXtiyAgS/ZoTOSevQpLyI9GPxHuWQDFASVvvO38vw+w9Smvp 41tcRwRBUke8XiL8JMtoGG0lkG39nZzM8Dpj7mM0W/IXQrPxe0wgadjfCWtN3oW4jCS/k5UH 2c/0eCBzyPeChHfKSI3bSFT5LHXJ8bQ/+uSThUN4jYWNVx94Rd/+RxhPKpiyEH9RwbL9qxi5 khM6SHAkwR8SfMrXErglp7iV/NRJhhPZVfMXOFUCahIkcS1Jvh6TUXLqtN8+aqi8owxrmG1Y yxPTFILJc+zfdxVFdF0SSGBOdQllZxzj54p6iklz7/m4pwFXkte7twuMPMdVTBhE9yC0+nZO GA/5J/rwZxplwpl9RPuIphdISVX4wOfECRlLEftTKO8MgFAAv6kpipA0FssuHIqSMhU/FPk7 /4QXrjFcN0Y/q8KR3dz8Fwkdo9HLPQIA --------------nB042EuVov4JsMOIxeTCO4Iw-- From nobody Sat Apr 18 12:06:44 2026 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fyVq15j2nz6ZcCx for ; Sat, 18 Apr 2026 12:06:53 +0000 (UTC) (envelope-from david@catwhisker.org) Received: from mx.catwhisker.org (mx.catwhisker.org [107.204.234.170]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4fyVq10nBhz4KFn for ; Sat, 18 Apr 2026 12:06:52 +0000 (UTC) (envelope-from david@catwhisker.org) Authentication-Results: mx1.freebsd.org; none Received: from albert.catwhisker.org (localhost [127.0.0.1]) by albert.catwhisker.org (8.18.1/8.18.1) with ESMTP id 63IC6i2R098041; Sat, 18 Apr 2026 12:06:44 GMT (envelope-from david@albert.catwhisker.org) Received: (from david@localhost) by albert.catwhisker.org (8.18.1/8.18.1/Submit) id 63IC6iMm098040; Sat, 18 Apr 2026 05:06:44 -0700 (PDT) (envelope-from david) Date: Sat, 18 Apr 2026 05:06:44 -0700 From: David Wolfskill To: Ricardo Branco Cc: freebsd-current@freebsd.org Subject: Re: panic: assertion failed in iflib_txq_drain() Message-ID: Reply-To: current@freebsd.org Mail-Followup-To: current@freebsd.org, Ricardo Branco , freebsd-current@freebsd.org References: <9d640ae4-7133-4d4f-917f-d715ab71ee7b@suse.de> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="XxNZQSq+4VVJLDiU" Content-Disposition: inline In-Reply-To: <9d640ae4-7133-4d4f-917f-d715ab71ee7b@suse.de> X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:7018, ipnet:107.192.0.0/12, country:US] X-Rspamd-Queue-Id: 4fyVq10nBhz4KFn X-Spamd-Bar: ---- --XxNZQSq+4VVJLDiU Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sat, Apr 18, 2026 at 11:47:14AM +0200, Ricardo Branco wrote: > I'm getting this on FreeBSD-kernel-generic 16.snap20260416224424 >=20 > This is happening as soon as I try to ssh to a GMKTec NucBox G3 Plus with > Ethernet Controller I226-V. >=20 > It also happens when trying to do any TCP connection.=A0 Attached gzipped > /var/crash/core.txt >=20 > panic: Assertion mp !=3D NULL && *mp !=3D NULL failed at > /home/pkgbuild/worktrees/main/sys/net/iflib.c:3922 cpuid=3D 3 time 177650= 0574 > KDB: stack backtrace: > db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame > 0xfffff81078b7450 vpanic at vpanic+0x136/frame 0xfffffe01078b7580 > panic > at panic+0x43/frame 0xfffffe01078b75e0 > iflib_txq_drain at iflib_txq_drain+0x429/frame 0xfffffe81078b7660 > drain_ring_lockless() at drain_ring_lockless+0x8a/frame 0xfffffe01078b76b0 > ifmp_ring_enqueue() at ifmp_ring_enqueue+0x332/frame 0xfffffe81078b7700 > .... So... one of the machines on which I track head got this, as well -- my (mostly-)headless build machine. (2 laptops, updated in sync with the build machine, did not panic. One of those also uses a wired NIC.) In my case, the failure occurred after updating from=20 FreeBSD 16.0-CURRENT #547 main-n285122-3b373d484046: Fri Apr 17 13:15:23 UT= C 2026 root@freebeast.catwhisker.org:/common/S4/obj/usr/src/amd64.amd64= /sys/GENERIC amd64 1600015 1600015 to main-n285179-7e9d974bc023. (As noted, 2 other machines (so far) updated to main-n285179-7e9d974bc023 without issue.) For now, I will reboot the machine to stable/15 (so it can build packages for tomorrow's weekly update), but once that's done, I'm happy to poke at it a bit or try out a patch or three, given suitable clues. The panic appears "quite reproducible." :-} Peace, david --=20 David H. Wolfskill david@catwhisker.org See https://www.catwhisker.org/~david/publickey.gpg for my public key. --XxNZQSq+4VVJLDiU Content-Type: application/pgp-signature; name=signature.asc -----BEGIN PGP SIGNATURE----- iNUEARYKAH0WIQRCec5RsK7Enudh3yGB9MJ9AwUELQUCaeNz1F8UgAAAAAAuAChp c3N1ZXItZnByQG5vdGF0aW9ucy5vcGVucGdwLmZpZnRoaG9yc2VtYW4ubmV0NDI3 OUNFNTFCMEFFQzQ5RUU3NjFERjIxODFGNEMyN0QwMzA1MDQyRAAKCRCB9MJ9AwUE LXJFAP0SslBzqfWioUcpLzTxoSTaZAHxY1eqLFRkT+Rg+a6+bwD/QVvVvs0xAtRD bDu/T2eHn7rSrVNTarg4mH75+fFNsA4= =3zhz -----END PGP SIGNATURE----- --XxNZQSq+4VVJLDiU-- From nobody Sat Apr 18 13:53:33 2026 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fyYB943c8z6Zmt8; Sat, 18 Apr 2026 13:53:37 +0000 (UTC) (envelope-from tuexen@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R12" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4fyYB93CW1z3J02; Sat, 18 Apr 2026 13:53:37 +0000 (UTC) (envelope-from tuexen@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776520417; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=fQIfMT3bNwtCuBV+wx8v64p19rasNkuvafVvhIdIhJY=; b=LIuzFG+84OHV3OcpvovzPa/dnTfet3x9Jt75E2HNCek4HdmwyBHIgFvot7T61deChdVuTl Tbw+HoC46EpW2iEGurUN/Pp5dpDykOfRtvGJ5OCBfbycI86DEBos7ZYiMd2P/aj0ll8tb2 N/N+IDBebylgbSzO7pvE/Ge+yOcdL1O9vcBfx99exWkqmh41V2IM2jbtW2TUaJkTvj1AlD nxwFN6v6FWhMPmivbb1r4GouRo0/zzKXxJg2jPZMEcSxiLkBBV+ZFjr6wbOzlPFEJ+bUWj +9HLHaY5yrIklJ49tPQDICXIUTsS6fg7NCXNHeBmYCXoKv5GugkbZ0qJ9pXZUA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1776520417; a=rsa-sha256; cv=none; b=JthzUwJCwMJF3FKzvK/GktZXTeCLwes+30RqKvt7WSnDI07U1qs8dY5JUZ2/kUUt4JzBKd g7nwwgT+kCCeMf76qdwih+E/yUiKaacZ/qDFTI/VmqDX22/8+hodlX8zURPNhYaDRc6Zy1 OTYNOCzRrRErz94VMeorrLWxDQc3IOMHmUdX81h+eTsdUedLnvjf7ZtY7Gv8SQ9nC2P7mb 2RSM2betvoJZRn3jamE0FklzLhsw1Nq9wIuEgcASYoQC5c99LbSQP79Dug7I4159jZAovL Ij5xq6eC3KOa0oEo3Do5eM2kpIo23eXMdCRT18qsw5Q0llQxGv8vtQyWcbzgAA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776520417; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=fQIfMT3bNwtCuBV+wx8v64p19rasNkuvafVvhIdIhJY=; b=nJv/5xhtPmWX37orY2uw80IEnFzWqarMS5vqJZuTIJs+slidV8924clnZK3DLn2R1l3YyG Q7vBolHPhQIvQUnXcrrhMTWF7dEGUyITjy1OcfAuKI8OG7rsjDHJkEajNU7khYNvxIETpd Wvq4gmZg2/PN7RUceFEy6LuXzww3V2ZhZnUHTR61xibkwCg2ijkl/rmk1HQVW9aa3Vcp7r QHmOzEyP3hZW+Sdie6WCxxITPTYsTccfJLT1CWq/oPeRhubOiruRqiCAblDYaH5WZEXsTr GNRPJyw/p10pK1xIoT0YVZw85VSDZ9AshJ6mTl3U+rVO3f80lNFbyFjuLmyuJw== Received: from smtpclient.apple (unknown [IPv6:2a02:8109:1101:be00:d835:7117:6c6b:190a]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: tuexen) by smtp.freebsd.org (Postfix) with ESMTPSA id 4fyYB86CVmzBkl; Sat, 18 Apr 2026 13:53:36 +0000 (UTC) (envelope-from tuexen@FreeBSD.org) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3864.500.181\)) Subject: Re: panic: assertion failed in iflib_txq_drain() From: Michael Tuexen In-Reply-To: Date: Sat, 18 Apr 2026 15:53:33 +0200 Cc: Ricardo Branco , freebsd-current@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <9d640ae4-7133-4d4f-917f-d715ab71ee7b@suse.de> To: current@freebsd.org X-Mailer: Apple Mail (2.3864.500.181) > On 18. Apr 2026, at 14:06, David Wolfskill = wrote: >=20 > On Sat, Apr 18, 2026 at 11:47:14AM +0200, Ricardo Branco wrote: >> I'm getting this on FreeBSD-kernel-generic 16.snap20260416224424 >>=20 >> This is happening as soon as I try to ssh to a GMKTec NucBox G3 Plus = with >> Ethernet Controller I226-V. >>=20 >> It also happens when trying to do any TCP connection. Attached = gzipped >> /var/crash/core.txt >>=20 >> panic: Assertion mp !=3D NULL && *mp !=3D NULL failed at >> /home/pkgbuild/worktrees/main/sys/net/iflib.c:3922 cpuid=3D 3 time = 1776500574 >> KDB: stack backtrace: >> db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame >> 0xfffff81078b7450 vpanic at vpanic+0x136/frame 0xfffffe01078b7580 >> panic >> at panic+0x43/frame 0xfffffe01078b75e0 >> iflib_txq_drain at iflib_txq_drain+0x429/frame 0xfffffe81078b7660 >> drain_ring_lockless() at drain_ring_lockless+0x8a/frame = 0xfffffe01078b76b0 >> ifmp_ring_enqueue() at ifmp_ring_enqueue+0x332/frame = 0xfffffe81078b7700 >> .... >=20 > So... one of the machines on which I track head got this, as well -- = my > (mostly-)headless build machine. (2 laptops, updated in sync with the > build machine, did not panic. One of those also uses a wired NIC.) Do the network drivers of the machines not being affected use iflib? I do see the problem also on one of my machines and local testing shows = that = https://cgit.FreeBSD.org/src/commit/?id=3D3fade68cfdf95ee0b517b5d69b270bd8= da633404 = is the problem. At least reverting it locally resolves the problem. Can you confirm this? Best regards Michael >=20 > In my case, the failure occurred after updating from=20 >=20 > FreeBSD 16.0-CURRENT #547 main-n285122-3b373d484046: Fri Apr 17 = 13:15:23 UTC 2026 = root@freebeast.catwhisker.org:/common/S4/obj/usr/src/amd64.amd64/sys/GENER= IC amd64 1600015 1600015 >=20 > to main-n285179-7e9d974bc023. (As noted, 2 other machines (so far) > updated to main-n285179-7e9d974bc023 without issue.) >=20 > For now, I will reboot the machine to stable/15 (so it can build > packages for tomorrow's weekly update), but once that's done, I'm > happy to poke at it a bit or try out a patch or three, given suitable > clues. >=20 > The panic appears "quite reproducible." :-} >=20 > Peace, > david > --=20 > David H. Wolfskill david@catwhisker.org >=20 > See https://www.catwhisker.org/~david/publickey.gpg for my public key. From nobody Sat Apr 18 13:53:33 2026 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fyYB943c8z6Zmt8; Sat, 18 Apr 2026 13:53:37 +0000 (UTC) (envelope-from tuexen@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R12" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4fyYB93CW1z3J02; Sat, 18 Apr 2026 13:53:37 +0000 (UTC) (envelope-from tuexen@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776520417; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=fQIfMT3bNwtCuBV+wx8v64p19rasNkuvafVvhIdIhJY=; b=LIuzFG+84OHV3OcpvovzPa/dnTfet3x9Jt75E2HNCek4HdmwyBHIgFvot7T61deChdVuTl Tbw+HoC46EpW2iEGurUN/Pp5dpDykOfRtvGJ5OCBfbycI86DEBos7ZYiMd2P/aj0ll8tb2 N/N+IDBebylgbSzO7pvE/Ge+yOcdL1O9vcBfx99exWkqmh41V2IM2jbtW2TUaJkTvj1AlD nxwFN6v6FWhMPmivbb1r4GouRo0/zzKXxJg2jPZMEcSxiLkBBV+ZFjr6wbOzlPFEJ+bUWj +9HLHaY5yrIklJ49tPQDICXIUTsS6fg7NCXNHeBmYCXoKv5GugkbZ0qJ9pXZUA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1776520417; a=rsa-sha256; cv=none; b=JthzUwJCwMJF3FKzvK/GktZXTeCLwes+30RqKvt7WSnDI07U1qs8dY5JUZ2/kUUt4JzBKd g7nwwgT+kCCeMf76qdwih+E/yUiKaacZ/qDFTI/VmqDX22/8+hodlX8zURPNhYaDRc6Zy1 OTYNOCzRrRErz94VMeorrLWxDQc3IOMHmUdX81h+eTsdUedLnvjf7ZtY7Gv8SQ9nC2P7mb 2RSM2betvoJZRn3jamE0FklzLhsw1Nq9wIuEgcASYoQC5c99LbSQP79Dug7I4159jZAovL Ij5xq6eC3KOa0oEo3Do5eM2kpIo23eXMdCRT18qsw5Q0llQxGv8vtQyWcbzgAA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776520417; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=fQIfMT3bNwtCuBV+wx8v64p19rasNkuvafVvhIdIhJY=; b=nJv/5xhtPmWX37orY2uw80IEnFzWqarMS5vqJZuTIJs+slidV8924clnZK3DLn2R1l3YyG Q7vBolHPhQIvQUnXcrrhMTWF7dEGUyITjy1OcfAuKI8OG7rsjDHJkEajNU7khYNvxIETpd Wvq4gmZg2/PN7RUceFEy6LuXzww3V2ZhZnUHTR61xibkwCg2ijkl/rmk1HQVW9aa3Vcp7r QHmOzEyP3hZW+Sdie6WCxxITPTYsTccfJLT1CWq/oPeRhubOiruRqiCAblDYaH5WZEXsTr GNRPJyw/p10pK1xIoT0YVZw85VSDZ9AshJ6mTl3U+rVO3f80lNFbyFjuLmyuJw== Received: from smtpclient.apple (unknown [IPv6:2a02:8109:1101:be00:d835:7117:6c6b:190a]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: tuexen) by smtp.freebsd.org (Postfix) with ESMTPSA id 4fyYB86CVmzBkl; Sat, 18 Apr 2026 13:53:36 +0000 (UTC) (envelope-from tuexen@FreeBSD.org) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3864.500.181\)) Subject: Re: panic: assertion failed in iflib_txq_drain() From: Michael Tuexen In-Reply-To: Date: Sat, 18 Apr 2026 15:53:33 +0200 Cc: Ricardo Branco , freebsd-current@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <9d640ae4-7133-4d4f-917f-d715ab71ee7b@suse.de> To: current@freebsd.org X-Mailer: Apple Mail (2.3864.500.181) > On 18. Apr 2026, at 14:06, David Wolfskill = wrote: >=20 > On Sat, Apr 18, 2026 at 11:47:14AM +0200, Ricardo Branco wrote: >> I'm getting this on FreeBSD-kernel-generic 16.snap20260416224424 >>=20 >> This is happening as soon as I try to ssh to a GMKTec NucBox G3 Plus = with >> Ethernet Controller I226-V. >>=20 >> It also happens when trying to do any TCP connection. Attached = gzipped >> /var/crash/core.txt >>=20 >> panic: Assertion mp !=3D NULL && *mp !=3D NULL failed at >> /home/pkgbuild/worktrees/main/sys/net/iflib.c:3922 cpuid=3D 3 time = 1776500574 >> KDB: stack backtrace: >> db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame >> 0xfffff81078b7450 vpanic at vpanic+0x136/frame 0xfffffe01078b7580 >> panic >> at panic+0x43/frame 0xfffffe01078b75e0 >> iflib_txq_drain at iflib_txq_drain+0x429/frame 0xfffffe81078b7660 >> drain_ring_lockless() at drain_ring_lockless+0x8a/frame = 0xfffffe01078b76b0 >> ifmp_ring_enqueue() at ifmp_ring_enqueue+0x332/frame = 0xfffffe81078b7700 >> .... >=20 > So... one of the machines on which I track head got this, as well -- = my > (mostly-)headless build machine. (2 laptops, updated in sync with the > build machine, did not panic. One of those also uses a wired NIC.) Do the network drivers of the machines not being affected use iflib? I do see the problem also on one of my machines and local testing shows = that = https://cgit.FreeBSD.org/src/commit/?id=3D3fade68cfdf95ee0b517b5d69b270bd8= da633404 = is the problem. At least reverting it locally resolves the problem. Can you confirm this? Best regards Michael >=20 > In my case, the failure occurred after updating from=20 >=20 > FreeBSD 16.0-CURRENT #547 main-n285122-3b373d484046: Fri Apr 17 = 13:15:23 UTC 2026 = root@freebeast.catwhisker.org:/common/S4/obj/usr/src/amd64.amd64/sys/GENER= IC amd64 1600015 1600015 >=20 > to main-n285179-7e9d974bc023. (As noted, 2 other machines (so far) > updated to main-n285179-7e9d974bc023 without issue.) >=20 > For now, I will reboot the machine to stable/15 (so it can build > packages for tomorrow's weekly update), but once that's done, I'm > happy to poke at it a bit or try out a patch or three, given suitable > clues. >=20 > The panic appears "quite reproducible." :-} >=20 > Peace, > david > --=20 > David H. Wolfskill david@catwhisker.org >=20 > See https://www.catwhisker.org/~david/publickey.gpg for my public key. From nobody Sat Apr 18 17:14:32 2026 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fydf4446hz678tq; Sat, 18 Apr 2026 17:14:36 +0000 (UTC) (envelope-from david@catwhisker.org) Received: from mx.catwhisker.org (mx.catwhisker.org [107.204.234.170]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4fydf35wTjz3flG; Sat, 18 Apr 2026 17:14:35 +0000 (UTC) (envelope-from david@catwhisker.org) Authentication-Results: mx1.freebsd.org; none Received: from albert.catwhisker.org (localhost [127.0.0.1]) by albert.catwhisker.org (8.18.1/8.18.1) with ESMTP id 63IHEYv0001383; Sat, 18 Apr 2026 17:14:34 GMT (envelope-from david@albert.catwhisker.org) Received: (from david@localhost) by albert.catwhisker.org (8.18.1/8.18.1/Submit) id 63IHEWi0001382; Sat, 18 Apr 2026 10:14:32 -0700 (PDT) (envelope-from david) Date: Sat, 18 Apr 2026 10:14:32 -0700 From: David Wolfskill To: Michael Tuexen Cc: current@freebsd.org, Ricardo Branco , freebsd-current@freebsd.org Subject: Re: panic: assertion failed in iflib_txq_drain() Message-ID: Reply-To: current@freebsd.org Mail-Followup-To: current@freebsd.org, Michael Tuexen , Ricardo Branco , freebsd-current@freebsd.org References: <9d640ae4-7133-4d4f-917f-d715ab71ee7b@suse.de> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="o5AnCuK76P7/FHA+" Content-Disposition: inline In-Reply-To: X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:7018, ipnet:107.192.0.0/12, country:US] X-Rspamd-Queue-Id: 4fydf35wTjz3flG X-Spamd-Bar: ---- --o5AnCuK76P7/FHA+ Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sat, Apr 18, 2026 at 03:53:33PM +0200, Michael Tuexen wrote: > ... > > So... one of the machines on which I track head got this, as well -- my > > (mostly-)headless build machine. (2 laptops, updated in sync with the > > build machine, did not panic. One of those also uses a wired NIC.) > Do the network drivers of the machines not being affected use iflib? Apparently not -- they are em(4), iwm(4), & iwn(4), while the panicking machine uses igb(4). > I do see the problem also on one of my machines and local testing shows t= hat > https://cgit.FreeBSD.org/src/commit/?id=3D3fade68cfdf95ee0b517b5d69b270bd= 8da633404 > is the problem. At least reverting it locally resolves the problem. > Can you confirm this? I can, and do: after reverting main-n285140-3fade68cfdf9 & rebuilding, I am able to ssh in without issue; the machine reports: freebeast(16.0-C)[2] uname -aUK FreeBSD freebeast.catwhisker.org 16.0-CURRENT FreeBSD 16.0-CURRENT #549 mai= n-n285180-23a84efeb191: Sat Apr 18 17:01:25 UTC 2026 root@freebeast.cat= whisker.org:/common/S3/obj/usr/src/amd64.amd64/sys/GENERIC amd64 1600015 16= 00015 Thanks! Peace, david --=20 David H. Wolfskill david@catwhisker.org See https://www.catwhisker.org/~david/publickey.gpg for my public key. --o5AnCuK76P7/FHA+ Content-Type: application/pgp-signature; name=signature.asc -----BEGIN PGP SIGNATURE----- iNUEARYKAH0WIQRCec5RsK7Enudh3yGB9MJ9AwUELQUCaeO7+F8UgAAAAAAuAChp c3N1ZXItZnByQG5vdGF0aW9ucy5vcGVucGdwLmZpZnRoaG9yc2VtYW4ubmV0NDI3 OUNFNTFCMEFFQzQ5RUU3NjFERjIxODFGNEMyN0QwMzA1MDQyRAAKCRCB9MJ9AwUE LRW4AQDp4d0eMWEC5UhpHfZQnxLewpzLeC0HOq4WTUGGpPyUngD+JVAmXC23MOQy 9Xvmss9AU25Ir1xxmOqeJvlexL5Tkww= =HUgy -----END PGP SIGNATURE----- --o5AnCuK76P7/FHA+-- From nobody Sat Apr 18 17:14:32 2026 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fydf4446hz678tq; Sat, 18 Apr 2026 17:14:36 +0000 (UTC) (envelope-from david@catwhisker.org) Received: from mx.catwhisker.org (mx.catwhisker.org [107.204.234.170]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4fydf35wTjz3flG; Sat, 18 Apr 2026 17:14:35 +0000 (UTC) (envelope-from david@catwhisker.org) Authentication-Results: mx1.freebsd.org; none Received: from albert.catwhisker.org (localhost [127.0.0.1]) by albert.catwhisker.org (8.18.1/8.18.1) with ESMTP id 63IHEYv0001383; Sat, 18 Apr 2026 17:14:34 GMT (envelope-from david@albert.catwhisker.org) Received: (from david@localhost) by albert.catwhisker.org (8.18.1/8.18.1/Submit) id 63IHEWi0001382; Sat, 18 Apr 2026 10:14:32 -0700 (PDT) (envelope-from david) Date: Sat, 18 Apr 2026 10:14:32 -0700 From: David Wolfskill To: Michael Tuexen Cc: current@freebsd.org, Ricardo Branco , freebsd-current@freebsd.org Subject: Re: panic: assertion failed in iflib_txq_drain() Message-ID: Reply-To: current@freebsd.org Mail-Followup-To: current@freebsd.org, Michael Tuexen , Ricardo Branco , freebsd-current@freebsd.org References: <9d640ae4-7133-4d4f-917f-d715ab71ee7b@suse.de> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="o5AnCuK76P7/FHA+" Content-Disposition: inline In-Reply-To: X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:7018, ipnet:107.192.0.0/12, country:US] X-Rspamd-Queue-Id: 4fydf35wTjz3flG X-Spamd-Bar: ---- --o5AnCuK76P7/FHA+ Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sat, Apr 18, 2026 at 03:53:33PM +0200, Michael Tuexen wrote: > ... > > So... one of the machines on which I track head got this, as well -- my > > (mostly-)headless build machine. (2 laptops, updated in sync with the > > build machine, did not panic. One of those also uses a wired NIC.) > Do the network drivers of the machines not being affected use iflib? Apparently not -- they are em(4), iwm(4), & iwn(4), while the panicking machine uses igb(4). > I do see the problem also on one of my machines and local testing shows t= hat > https://cgit.FreeBSD.org/src/commit/?id=3D3fade68cfdf95ee0b517b5d69b270bd= 8da633404 > is the problem. At least reverting it locally resolves the problem. > Can you confirm this? I can, and do: after reverting main-n285140-3fade68cfdf9 & rebuilding, I am able to ssh in without issue; the machine reports: freebeast(16.0-C)[2] uname -aUK FreeBSD freebeast.catwhisker.org 16.0-CURRENT FreeBSD 16.0-CURRENT #549 mai= n-n285180-23a84efeb191: Sat Apr 18 17:01:25 UTC 2026 root@freebeast.cat= whisker.org:/common/S3/obj/usr/src/amd64.amd64/sys/GENERIC amd64 1600015 16= 00015 Thanks! Peace, david --=20 David H. Wolfskill david@catwhisker.org See https://www.catwhisker.org/~david/publickey.gpg for my public key. --o5AnCuK76P7/FHA+ Content-Type: application/pgp-signature; name=signature.asc -----BEGIN PGP SIGNATURE----- iNUEARYKAH0WIQRCec5RsK7Enudh3yGB9MJ9AwUELQUCaeO7+F8UgAAAAAAuAChp c3N1ZXItZnByQG5vdGF0aW9ucy5vcGVucGdwLmZpZnRoaG9yc2VtYW4ubmV0NDI3 OUNFNTFCMEFFQzQ5RUU3NjFERjIxODFGNEMyN0QwMzA1MDQyRAAKCRCB9MJ9AwUE LRW4AQDp4d0eMWEC5UhpHfZQnxLewpzLeC0HOq4WTUGGpPyUngD+JVAmXC23MOQy 9Xvmss9AU25Ir1xxmOqeJvlexL5Tkww= =HUgy -----END PGP SIGNATURE----- --o5AnCuK76P7/FHA+-- From nobody Sat Apr 18 17:24:50 2026 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fydsy00qmz679tL for ; Sat, 18 Apr 2026 17:24:54 +0000 (UTC) (envelope-from rbranco@suse.de) Received: from smtp-out1.suse.de (smtp-out1.suse.de [195.135.223.130]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4fydsx34LKz3lY5 for ; Sat, 18 Apr 2026 17:24:53 +0000 (UTC) (envelope-from rbranco@suse.de) Authentication-Results: mx1.freebsd.org; none Received: from imap1.dmz-prg2.suse.org (imap1.dmz-prg2.suse.org [IPv6:2a07:de40:b281:104:10:150:64:97]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by smtp-out1.suse.de (Postfix) with ESMTPS id 201156A8B2; Sat, 18 Apr 2026 17:24:51 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.de; s=susede2_rsa; t=1776533091; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc: mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=8ewOE68lBwbXrGaSZtSwSNniD5PoPA8vXHyzQGUiBhc=; b=bLRuI563pl5UOUJS01xo+5fxuaENxIAOwlM8UF27UStMnsdX6hwLaUywn8SWpkLydReB5G 2Y9n5U/A+226Z9LjVJEEUHPROrJ7i7D7k8SVBDoWYMVMTi/zLYHLoaFpL/6dcraD60oo+g 73q07PQNIVQdH/qLqmuRBGg8ehbk/M4= DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; d=suse.de; s=susede2_ed25519; t=1776533091; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc: mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=8ewOE68lBwbXrGaSZtSwSNniD5PoPA8vXHyzQGUiBhc=; b=njo/Q0NhDpnBhgQrP+WCMtGPvYeyVLtUSEPH/m/ZII3Nbep7LYCJ93xd28Q7b0KImjjNxV mgWOEiYbOu8sqFCw== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.de; s=susede2_rsa; t=1776533091; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc: mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=8ewOE68lBwbXrGaSZtSwSNniD5PoPA8vXHyzQGUiBhc=; b=bLRuI563pl5UOUJS01xo+5fxuaENxIAOwlM8UF27UStMnsdX6hwLaUywn8SWpkLydReB5G 2Y9n5U/A+226Z9LjVJEEUHPROrJ7i7D7k8SVBDoWYMVMTi/zLYHLoaFpL/6dcraD60oo+g 73q07PQNIVQdH/qLqmuRBGg8ehbk/M4= DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; d=suse.de; s=susede2_ed25519; t=1776533091; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc: mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=8ewOE68lBwbXrGaSZtSwSNniD5PoPA8vXHyzQGUiBhc=; b=njo/Q0NhDpnBhgQrP+WCMtGPvYeyVLtUSEPH/m/ZII3Nbep7LYCJ93xd28Q7b0KImjjNxV mgWOEiYbOu8sqFCw== Received: from imap1.dmz-prg2.suse.org (localhost [127.0.0.1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by imap1.dmz-prg2.suse.org (Postfix) with ESMTPS id 01F7C593A3; Sat, 18 Apr 2026 17:24:50 +0000 (UTC) Received: from dovecot-director2.suse.de ([2a07:de40:b281:106:10:150:64:167]) by imap1.dmz-prg2.suse.org with ESMTPSA id Ei6SOmK+42k3HgAAD6G6ig (envelope-from ); Sat, 18 Apr 2026 17:24:50 +0000 Message-ID: <97e69dc1-490d-4567-9443-6899255f3618@suse.de> Date: Sat, 18 Apr 2026 19:24:50 +0200 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: panic: assertion failed in iflib_txq_drain() Content-Language: en-US To: current@freebsd.org, Michael Tuexen , freebsd-current@freebsd.org References: <9d640ae4-7133-4d4f-917f-d715ab71ee7b@suse.de> From: Ricardo Branco In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Rspamd-Action: no action X-Spam-Flag: NO X-Spam-Score: -4.51 X-Spam-Level: X-Rspamd-Server: rspamd1.dmz-prg2.suse.org X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:29298, ipnet:195.135.223.0/24, country:DE] X-Rspamd-Queue-Id: 4fydsx34LKz3lY5 X-Spamd-Bar: ---- On 4/18/26 7:14 PM, David Wolfskill wrote: > On Sat, Apr 18, 2026 at 03:53:33PM +0200, Michael Tuexen wrote: > >> I do see the problem also on one of my machines and local testing shows that >> https://cgit.FreeBSD.org/src/commit/?id=3fade68cfdf95ee0b517b5d69b270bd8da633404 >> is the problem. At least reverting it locally resolves the problem. >> Can you confirm this? > I can, and do: after reverting main-n285140-3fade68cfdf9 & rebuilding, > I am able to ssh in without issue; the machine reports: This definitely does the trick. After reverting 3fade68c it works. Best, R From nobody Sat Apr 18 17:24:50 2026 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fydt2368pz67B9B for ; Sat, 18 Apr 2026 17:24:58 +0000 (UTC) (envelope-from rbranco@suse.de) Received: from smtp-out1.suse.de (smtp-out1.suse.de [195.135.223.130]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4fydt15Cnqz3lYK for ; Sat, 18 Apr 2026 17:24:57 +0000 (UTC) (envelope-from rbranco@suse.de) Authentication-Results: mx1.freebsd.org; none Received: from imap1.dmz-prg2.suse.org (imap1.dmz-prg2.suse.org [IPv6:2a07:de40:b281:104:10:150:64:97]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by smtp-out1.suse.de (Postfix) with ESMTPS id 201156A8B2; Sat, 18 Apr 2026 17:24:51 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.de; s=susede2_rsa; t=1776533091; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc: mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=8ewOE68lBwbXrGaSZtSwSNniD5PoPA8vXHyzQGUiBhc=; b=bLRuI563pl5UOUJS01xo+5fxuaENxIAOwlM8UF27UStMnsdX6hwLaUywn8SWpkLydReB5G 2Y9n5U/A+226Z9LjVJEEUHPROrJ7i7D7k8SVBDoWYMVMTi/zLYHLoaFpL/6dcraD60oo+g 73q07PQNIVQdH/qLqmuRBGg8ehbk/M4= DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; d=suse.de; s=susede2_ed25519; t=1776533091; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc: mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=8ewOE68lBwbXrGaSZtSwSNniD5PoPA8vXHyzQGUiBhc=; b=njo/Q0NhDpnBhgQrP+WCMtGPvYeyVLtUSEPH/m/ZII3Nbep7LYCJ93xd28Q7b0KImjjNxV mgWOEiYbOu8sqFCw== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.de; s=susede2_rsa; t=1776533091; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc: mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=8ewOE68lBwbXrGaSZtSwSNniD5PoPA8vXHyzQGUiBhc=; b=bLRuI563pl5UOUJS01xo+5fxuaENxIAOwlM8UF27UStMnsdX6hwLaUywn8SWpkLydReB5G 2Y9n5U/A+226Z9LjVJEEUHPROrJ7i7D7k8SVBDoWYMVMTi/zLYHLoaFpL/6dcraD60oo+g 73q07PQNIVQdH/qLqmuRBGg8ehbk/M4= DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; d=suse.de; s=susede2_ed25519; t=1776533091; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc: mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=8ewOE68lBwbXrGaSZtSwSNniD5PoPA8vXHyzQGUiBhc=; b=njo/Q0NhDpnBhgQrP+WCMtGPvYeyVLtUSEPH/m/ZII3Nbep7LYCJ93xd28Q7b0KImjjNxV mgWOEiYbOu8sqFCw== Received: from imap1.dmz-prg2.suse.org (localhost [127.0.0.1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by imap1.dmz-prg2.suse.org (Postfix) with ESMTPS id 01F7C593A3; Sat, 18 Apr 2026 17:24:50 +0000 (UTC) Received: from dovecot-director2.suse.de ([2a07:de40:b281:106:10:150:64:167]) by imap1.dmz-prg2.suse.org with ESMTPSA id Ei6SOmK+42k3HgAAD6G6ig (envelope-from ); Sat, 18 Apr 2026 17:24:50 +0000 Message-ID: <97e69dc1-490d-4567-9443-6899255f3618@suse.de> Date: Sat, 18 Apr 2026 19:24:50 +0200 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: panic: assertion failed in iflib_txq_drain() Content-Language: en-US To: current@freebsd.org, Michael Tuexen , freebsd-current@freebsd.org References: <9d640ae4-7133-4d4f-917f-d715ab71ee7b@suse.de> From: Ricardo Branco In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Rspamd-Action: no action X-Spam-Flag: NO X-Spam-Score: -4.51 X-Spam-Level: X-Rspamd-Server: rspamd1.dmz-prg2.suse.org X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:29298, ipnet:195.135.223.0/24, country:DE] X-Rspamd-Queue-Id: 4fydt15Cnqz3lYK X-Spamd-Bar: ---- On 4/18/26 7:14 PM, David Wolfskill wrote: > On Sat, Apr 18, 2026 at 03:53:33PM +0200, Michael Tuexen wrote: > >> I do see the problem also on one of my machines and local testing shows that >> https://cgit.FreeBSD.org/src/commit/?id=3fade68cfdf95ee0b517b5d69b270bd8da633404 >> is the problem. At least reverting it locally resolves the problem. >> Can you confirm this? > I can, and do: after reverting main-n285140-3fade68cfdf9 & rebuilding, > I am able to ssh in without issue; the machine reports: This definitely does the trick. After reverting 3fade68c it works. Best, R From nobody Sat Apr 18 17:38:37 2026 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fyf9r1WPxz67CFP; Sat, 18 Apr 2026 17:38:40 +0000 (UTC) (envelope-from tuexen@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R12" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4fyf9r0DJLz3png; Sat, 18 Apr 2026 17:38:40 +0000 (UTC) (envelope-from tuexen@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776533920; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=mvNBY/UDD2C7f7GZI+sPitP9GnbgXy4UC7WUgYNrI9k=; b=K4W/MzE7iGPdkB1S44Pc0VKl/5YQPb9qpCeJcVdLJnUQyDOujmtQBatjbM8Y6G7smJaCsG 3MeIWWxyx9j1rWdoAXHAoEoesDK60ZhSV0xyCJ4hFYbYrcZx+8jU7/GQYta2gJsZUwawLT 26sJznuKNZMr03eRmQOZGPrNQgvUP/Y/zmfvQTzM91MMHym6hq6DGfxIBreGRPII2VjqYh xi4gySnmuagOgUTOaOYTalUvBJesWCG57mpKC38C5K6PkvpgZ5dOVtTyLJBaeHg8Wrjrxy eKu0CLs3z46FY9zkySiM8si9uDMPpOFcxCm7DU/9RtDv/Et6MqecubKTMw29AA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1776533920; a=rsa-sha256; cv=none; b=J8rIBKiMpof9fvsbgVrJIuayVtudeOtjC0X5aPejVr0f6vEOB5tDKjmFuLhvEEKkTi9i3y HqSq/3w+kjpR44DtnXi0ijkRjQNO5OoR55Zrn4Zja0juIy4EkUckqO8pMe7ceIpQR83wxn FID//KYQWgQjZ9dDtCbvbPmG1x9mTogj7rqve1MuFxyZyBasj4VsHlF674LlAq9X4RmWo0 v7ZMnOiW6DcU8dbKz7eOmhi89OaP1Q6ePTzCv1t9dSU/s5EKSiS2cMYsl+CriXg9E83B6j NnpqYB/8MsAh5ZP4th/WlM7IjWoTcvzJ2zLH4QeWl4i8wXUWrcG/Y8pA9CloIA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776533920; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=mvNBY/UDD2C7f7GZI+sPitP9GnbgXy4UC7WUgYNrI9k=; b=NkUapJZla+rpYpOkIBo77vxgikDL4T0IBIX4Z1ChJYUuDxQAPJuGnOZfadO+sPseMiWKl6 RuojvJrfwUzIhfRcNHyz8Td7gEs+qR4j4SSYA17vAnRsoIbxx82ogG/irXJc1jnA5sf7qC ATlsUmyqy4m2Ib2auM74fcwprqheizzF4HLcALrwxSw+Uh3RajMZmDsW/v5ktTiIovjRoA XPwFtcJHDI/qhuhOTrTRnDfdqG3r+UKkV2fBy0BHhQTUh6ZSwxTxeyEDHKT4Gobmi9kH6B OEtDCALfLa2O2SZO0bc2cUhd9aUbtACQHrSYwsMRdGXG7Udong513MoLH0I5oQ== Received: from smtpclient.apple (unknown [IPv6:2a02:8109:1101:be00:d835:7117:6c6b:190a]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: tuexen) by smtp.freebsd.org (Postfix) with ESMTPSA id 4fyf9q2rSPzG88; Sat, 18 Apr 2026 17:38:39 +0000 (UTC) (envelope-from tuexen@FreeBSD.org) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3864.500.181\)) Subject: Re: panic: assertion failed in iflib_txq_drain() From: Michael Tuexen In-Reply-To: Date: Sat, 18 Apr 2026 19:38:37 +0200 Cc: Ricardo Branco , freebsd-current@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <9d640ae4-7133-4d4f-917f-d715ab71ee7b@suse.de> To: current@freebsd.org X-Mailer: Apple Mail (2.3864.500.181) > On 18. Apr 2026, at 19:14, David Wolfskill = wrote: >=20 > On Sat, Apr 18, 2026 at 03:53:33PM +0200, Michael Tuexen wrote: >> ... >>> So... one of the machines on which I track head got this, as well -- = my >>> (mostly-)headless build machine. (2 laptops, updated in sync with = the >>> build machine, did not panic. One of those also uses a wired NIC.) >> Do the network drivers of the machines not being affected use iflib? >=20 > Apparently not -- they are em(4), iwm(4), & iwn(4), while the = panicking > machine uses igb(4). >=20 >> I do see the problem also on one of my machines and local testing = shows that >> = https://cgit.FreeBSD.org/src/commit/?id=3D3fade68cfdf95ee0b517b5d69b270bd8= da633404 = >> is the problem. At least reverting it locally resolves the problem. >> Can you confirm this? >=20 > I can, and do: after reverting main-n285140-3fade68cfdf9 & = rebuilding, > I am able to ssh in without issue; the machine reports: >=20 > freebeast(16.0-C)[2] uname -aUK > FreeBSD freebeast.catwhisker.org 16.0-CURRENT FreeBSD 16.0-CURRENT = #549 main-n285180-23a84efeb191: Sat Apr 18 17:01:25 UTC 2026 = root@freebeast.catwhisker.org:/common/S3/obj/usr/src/amd64.amd64/sys/GENER= IC amd64 1600015 1600015 >=20 > Thanks! You could also disable TSO. I will put up a review for a fix soon. Best regards Michael >=20 > Peace, > david > --=20 > David H. Wolfskill david@catwhisker.org >=20 > See https://www.catwhisker.org/~david/publickey.gpg for my public key. From nobody Sat Apr 18 17:38:37 2026 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fyf9r1WPxz67CFP; Sat, 18 Apr 2026 17:38:40 +0000 (UTC) (envelope-from tuexen@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R12" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4fyf9r0DJLz3png; Sat, 18 Apr 2026 17:38:40 +0000 (UTC) (envelope-from tuexen@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776533920; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=mvNBY/UDD2C7f7GZI+sPitP9GnbgXy4UC7WUgYNrI9k=; b=K4W/MzE7iGPdkB1S44Pc0VKl/5YQPb9qpCeJcVdLJnUQyDOujmtQBatjbM8Y6G7smJaCsG 3MeIWWxyx9j1rWdoAXHAoEoesDK60ZhSV0xyCJ4hFYbYrcZx+8jU7/GQYta2gJsZUwawLT 26sJznuKNZMr03eRmQOZGPrNQgvUP/Y/zmfvQTzM91MMHym6hq6DGfxIBreGRPII2VjqYh xi4gySnmuagOgUTOaOYTalUvBJesWCG57mpKC38C5K6PkvpgZ5dOVtTyLJBaeHg8Wrjrxy eKu0CLs3z46FY9zkySiM8si9uDMPpOFcxCm7DU/9RtDv/Et6MqecubKTMw29AA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1776533920; a=rsa-sha256; cv=none; b=J8rIBKiMpof9fvsbgVrJIuayVtudeOtjC0X5aPejVr0f6vEOB5tDKjmFuLhvEEKkTi9i3y HqSq/3w+kjpR44DtnXi0ijkRjQNO5OoR55Zrn4Zja0juIy4EkUckqO8pMe7ceIpQR83wxn FID//KYQWgQjZ9dDtCbvbPmG1x9mTogj7rqve1MuFxyZyBasj4VsHlF674LlAq9X4RmWo0 v7ZMnOiW6DcU8dbKz7eOmhi89OaP1Q6ePTzCv1t9dSU/s5EKSiS2cMYsl+CriXg9E83B6j NnpqYB/8MsAh5ZP4th/WlM7IjWoTcvzJ2zLH4QeWl4i8wXUWrcG/Y8pA9CloIA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776533920; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=mvNBY/UDD2C7f7GZI+sPitP9GnbgXy4UC7WUgYNrI9k=; b=NkUapJZla+rpYpOkIBo77vxgikDL4T0IBIX4Z1ChJYUuDxQAPJuGnOZfadO+sPseMiWKl6 RuojvJrfwUzIhfRcNHyz8Td7gEs+qR4j4SSYA17vAnRsoIbxx82ogG/irXJc1jnA5sf7qC ATlsUmyqy4m2Ib2auM74fcwprqheizzF4HLcALrwxSw+Uh3RajMZmDsW/v5ktTiIovjRoA XPwFtcJHDI/qhuhOTrTRnDfdqG3r+UKkV2fBy0BHhQTUh6ZSwxTxeyEDHKT4Gobmi9kH6B OEtDCALfLa2O2SZO0bc2cUhd9aUbtACQHrSYwsMRdGXG7Udong513MoLH0I5oQ== Received: from smtpclient.apple (unknown [IPv6:2a02:8109:1101:be00:d835:7117:6c6b:190a]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: tuexen) by smtp.freebsd.org (Postfix) with ESMTPSA id 4fyf9q2rSPzG88; Sat, 18 Apr 2026 17:38:39 +0000 (UTC) (envelope-from tuexen@FreeBSD.org) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3864.500.181\)) Subject: Re: panic: assertion failed in iflib_txq_drain() From: Michael Tuexen In-Reply-To: Date: Sat, 18 Apr 2026 19:38:37 +0200 Cc: Ricardo Branco , freebsd-current@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <9d640ae4-7133-4d4f-917f-d715ab71ee7b@suse.de> To: current@freebsd.org X-Mailer: Apple Mail (2.3864.500.181) > On 18. Apr 2026, at 19:14, David Wolfskill = wrote: >=20 > On Sat, Apr 18, 2026 at 03:53:33PM +0200, Michael Tuexen wrote: >> ... >>> So... one of the machines on which I track head got this, as well -- = my >>> (mostly-)headless build machine. (2 laptops, updated in sync with = the >>> build machine, did not panic. One of those also uses a wired NIC.) >> Do the network drivers of the machines not being affected use iflib? >=20 > Apparently not -- they are em(4), iwm(4), & iwn(4), while the = panicking > machine uses igb(4). >=20 >> I do see the problem also on one of my machines and local testing = shows that >> = https://cgit.FreeBSD.org/src/commit/?id=3D3fade68cfdf95ee0b517b5d69b270bd8= da633404 = >> is the problem. At least reverting it locally resolves the problem. >> Can you confirm this? >=20 > I can, and do: after reverting main-n285140-3fade68cfdf9 & = rebuilding, > I am able to ssh in without issue; the machine reports: >=20 > freebeast(16.0-C)[2] uname -aUK > FreeBSD freebeast.catwhisker.org 16.0-CURRENT FreeBSD 16.0-CURRENT = #549 main-n285180-23a84efeb191: Sat Apr 18 17:01:25 UTC 2026 = root@freebeast.catwhisker.org:/common/S3/obj/usr/src/amd64.amd64/sys/GENER= IC amd64 1600015 1600015 >=20 > Thanks! You could also disable TSO. I will put up a review for a fix soon. Best regards Michael >=20 > Peace, > david > --=20 > David H. Wolfskill david@catwhisker.org >=20 > See https://www.catwhisker.org/~david/publickey.gpg for my public key. From nobody Sat Apr 18 19:09:42 2026 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fyhCK3k2qz6WrbY; Sat, 18 Apr 2026 19:10:05 +0000 (UTC) (envelope-from gallatin@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R12" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4fyhCK1jzXz434b; Sat, 18 Apr 2026 19:10:05 +0000 (UTC) (envelope-from gallatin@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776539405; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=ggdz+RAgVtoo/devzUDWmkFNzlwnQf1Jlgi8Z55We6s=; b=SV7X4BpIr6es5JtssWrZY6Qum5IKBBBONHxtFzVnhS9oUIKYik9Z0xR4tW1nqnKUjnIBHB ftwe+ghAHQrLQUA+ujL7U54swIpXLddxj4+oQxYJf5ur6k2bZBVDqcG7AMW5O2VR+2ArIt ttYkvEZ+A3H6vVGiVHsGnFqc8NwVD2lnhVSd7FAeN2pR5ChwEdHLkqI0D9NF1H/+q01heG rLMLfhPyJmced+0+BwsEvUZIRboOLYA6lrD2UQWLl71XCu7nyTi6U6M88uNeseg08wx/XO 5PFVf1ol4unRdiCWOoWmhclqZfFgYvTeYoa8V9nY+PASnO71FjG9Vq0dUis5nA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1776539405; a=rsa-sha256; cv=none; b=V754JeGYfKvVQNooswawFaokmuv9+Fvwvm+D30vVJCf/H417Tk/5HUUO2+1yvWbz9vMqM/ ED9Vc1WOUBeyiBuiGwpUAZWYwZUHTtX4CRcpSEMD9C7410hBDNurd4kXPY3e4HWrI8tqMM L0juS91LtRJgC9IrRzraI3YqfbKPZdS2dENM7YRuqN6kSYAjigvkmR7H5c3cP73b/Qdicg 7gJIdMpQMmD4Hfm7s/kUBkgLLMAa8dX4DZj75J+ZMy+sXCibg1FM6wLalxn3tVK/KsLSJe L3cxlMAzjYk5d8wUuuayTbt8RXMJNm1C81BHpnrCeg1iWbXL9WccMQYB4dRwZQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776539405; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=ggdz+RAgVtoo/devzUDWmkFNzlwnQf1Jlgi8Z55We6s=; b=USz5QLA9zqtm6wt3/Kz22q+N3jhqxl/vO6ipIqWNj1acmgfc51ZTCWnPtKl6ZTehydx9JC mzFd7jyWZNsRkI7Z7Wad8FeaQ2S7YXaDx5tN/Ju4pxJcNKQvtdNh4U8YLp0dKNTMBiFipD Kokd8aUX4fMRSffrB8Z7fpE5I8z029UR0+UVWjO4Dnu8MUy/+r2xQhnkUGE4NrsNnHmaJy wP3MBUNZXihxm+ez7D2KHQLdPwonbPcDerbiR3qZsOqGic1Gvw8dmm2abocGNNV2m+Lf7r fTfYDfQ37f5bRcBarcyv4TcxM4MJaHeJL4bgfa0zMbdOSRsow+LdfLJl9GKv2w== Received: from fauth-a1-smtp.messagingengine.com (fauth-a1-smtp.messagingengine.com [103.168.172.200]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: gallatin) by smtp.freebsd.org (Postfix) with ESMTPSA id 4fyhCJ6sV6zJjR; Sat, 18 Apr 2026 19:10:04 +0000 (UTC) (envelope-from gallatin@freebsd.org) Received: from phl-compute-05.internal (phl-compute-05.internal [10.202.2.45]) by mailfauth.phl.internal (Postfix) with ESMTP id 46179F4006D; Sat, 18 Apr 2026 15:10:04 -0400 (EDT) Received: from phl-imap-02 ([10.202.2.81]) by phl-compute-05.internal (MEProxy); Sat, 18 Apr 2026 15:10:04 -0400 X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeefhedrtddtgdehfeehiecutefuodetggdotefrod ftvfcurfhrohhfihhlvgemucfhrghsthforghilhdpuffrtefokffrpgfnqfghnecuuegr ihhlohhuthemuceftddtnecusecvtfgvtghiphhivghnthhsucdlqddutddtmdenucfjug hrpefoggffhffvvefkjghfufgtsegrtderreertddtnecuhfhrohhmpedfffhrvgifucfi rghllhgrthhinhdfuceoghgrlhhlrghtihhnsehfrhgvvggsshgurdhorhhgqeenucggtf frrghtthgvrhhnpeehjedvgedttdejtdegjeeiieekudeutdefgeekudekgfevtdefhfel fffggeelhfenucffohhmrghinhepfhhrvggvsghsugdrohhrghdptggrthifhhhishhkvg hrrdhorhhgnecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhho mhepghgrlhhlrghtihhnodhmvghsmhhtphgruhhthhhpvghrshhonhgrlhhithihqddufe efheelvddvudeiqddvleehtdegudekgedqghgrlhhlrghtihhnpeepfhhrvggvsghsugdr ohhrghesfhgrshhtmhgrihhlrdgtohhmpdhnsggprhgtphhtthhopeegpdhmohguvgepsh hmthhpohhuthdprhgtphhtthhopegtuhhrrhgvnhhtsehfrhgvvggsshgurdhorhhgpdhr tghpthhtohepfhhrvggvsghsugdqtghurhhrvghnthesfhhrvggvsghsugdrohhrghdprh gtphhtthhopehtuhgvgigvnhesfhhrvggvsghsugdrohhrghdprhgtphhtthhopehrsghr rghntghosehsuhhsvgdruggv X-ME-Proxy: Feedback-ID: i41414658:Fastmail Received: by mailuser.phl.internal (Postfix, from userid 501) id CFFD9700065; Sat, 18 Apr 2026 15:10:03 -0400 (EDT) X-Mailer: MessagingEngine.com Webmail Interface List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 X-ThreadId: APgOGAU08yF- Date: Sat, 18 Apr 2026 15:09:42 -0400 From: "Drew Gallatin" To: tuexen , current@freebsd.org Cc: "Ricardo Branco" , freebsd-current@freebsd.org Message-Id: <3b60c3e6-f53f-4084-a435-fe5371c56e58@app.fastmail.com> In-Reply-To: References: <9d640ae4-7133-4d4f-917f-d715ab71ee7b@suse.de> Subject: Re: panic: assertion failed in iflib_txq_drain() Content-Type: multipart/alternative; boundary=de29220a76d19c76af1d1ba6f005ef33c6782576 --de29220a76d19c76af1d1ba6f005ef33c6782576 Content-Type: text/plain Content-Transfer-Encoding: 7bit Sorry, looking into this now. I did not test this change with the mp_ring path.. i don't see how fixing the counters could cause this panic. Looking at it now.. Drew On Sat, Apr 18, 2026, at 1:38 PM, Michael Tuexen wrote: > > On 18. Apr 2026, at 19:14, David Wolfskill wrote: > > > > On Sat, Apr 18, 2026 at 03:53:33PM +0200, Michael Tuexen wrote: > >> ... > >>> So... one of the machines on which I track head got this, as well -- my > >>> (mostly-)headless build machine. (2 laptops, updated in sync with the > >>> build machine, did not panic. One of those also uses a wired NIC.) > >> Do the network drivers of the machines not being affected use iflib? > > > > Apparently not -- they are em(4), iwm(4), & iwn(4), while the panicking > > machine uses igb(4). > > > >> I do see the problem also on one of my machines and local testing shows that > >> https://cgit.FreeBSD.org/src/commit/?id=3fade68cfdf95ee0b517b5d69b270bd8da633404 > >> is the problem. At least reverting it locally resolves the problem. > >> Can you confirm this? > > > > I can, and do: after reverting main-n285140-3fade68cfdf9 & rebuilding, > > I am able to ssh in without issue; the machine reports: > > > > freebeast(16.0-C)[2] uname -aUK > > FreeBSD freebeast.catwhisker.org 16.0-CURRENT FreeBSD 16.0-CURRENT #549 main-n285180-23a84efeb191: Sat Apr 18 17:01:25 UTC 2026 root@freebeast.catwhisker.org:/common/S3/obj/usr/src/amd64.amd64/sys/GENERIC amd64 1600015 1600015 > > > > Thanks! > You could also disable TSO. I will put up a review for a fix soon. > > Best regards > Michael > > > > Peace, > > david > > -- > > David H. Wolfskill david@catwhisker.org > > > > See https://www.catwhisker.org/~david/publickey.gpg for my public key. > > > --de29220a76d19c76af1d1ba6f005ef33c6782576 Content-Type: text/html Content-Transfer-Encoding: quoted-printable
Sorry, looki= ng into this now.  I did not test this change with the mp_ring path= .. i don't see how fixing the counters could cause this panic.  &nb= sp;Looking at it now..

Drew

On Sat, Apr 18, 2026, at 1:38 PM, Michael Tuexen wrote:
> On 18. Apr 2026, at = 19:14, David Wolfskill <david= @catwhisker.org> wrote:
> 
> On Sa= t, Apr 18, 2026 at 03:53:33PM +0200, Michael Tuexen wrote:
>= ;> ...
>>> So... one of the machines on which I tr= ack head got this, as well -- my
>>> (mostly-)headles= s build machine.  (2 laptops, updated in sync with the
&g= t;>> build machine, did not panic.  One of those also uses a = wired NIC.)
>> Do the network drivers of the machines no= t being affected use iflib?
> 
> Apparent= ly not -- they are em(4), iwm(4), & iwn(4), while the panicking
> machine uses igb(4).
> 
>> = I do see the problem also on one of my machines and local testing shows = that
>> https://cgit.FreeBSD= .org/src/commit/?id=3D3fade68cfdf95ee0b517b5d69b270bd8da633404 <<= a href=3D"https://cgit.freebsd.org/src/commit/?id=3D3fade68cfdf95ee0b517= b5d69b270bd8da633404">https://cgit.freebsd.org/src/commit/?id=3D3fade68c= fdf95ee0b517b5d69b270bd8da633404>
>> is the probl= em. At least reverting it locally resolves the problem.
>&g= t; Can you confirm this?
> 
> I can, and = do:  after reverting main-n285140-3fade68cfdf9 & rebuilding,
> I am able to ssh in without issue; the machine reports:
> 
> freebeast(16.0-C)[2] uname -aUK
> FreeBSD freebea= st.catwhisker.org 16.0-CURRENT FreeBSD 16.0-CURRENT #549 main-n28518= 0-23a84efeb191: Sat Apr 18 17:01:25 UTC 2026    &nbs= p;root@freebeast.catwhi= sker.org:/common/S3/obj/usr/src/amd64.amd64/sys/GENERIC amd64 160001= 5 1600015
> 
> Thanks!
You coul= d also disable TSO. I will put up a review for a fix soon.
Best regards
Michael
> 
> Peace,
> david
> -- 
>= ; David H. Wolfskill        &nbs= p;           &nbs= p;         david@catwhisker.org
> 



=

--de29220a76d19c76af1d1ba6f005ef33c6782576-- From nobody Sat Apr 18 19:09:42 2026 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fyhCK3k2qz6WrbY; Sat, 18 Apr 2026 19:10:05 +0000 (UTC) (envelope-from gallatin@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R12" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4fyhCK1jzXz434b; Sat, 18 Apr 2026 19:10:05 +0000 (UTC) (envelope-from gallatin@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776539405; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=ggdz+RAgVtoo/devzUDWmkFNzlwnQf1Jlgi8Z55We6s=; b=SV7X4BpIr6es5JtssWrZY6Qum5IKBBBONHxtFzVnhS9oUIKYik9Z0xR4tW1nqnKUjnIBHB ftwe+ghAHQrLQUA+ujL7U54swIpXLddxj4+oQxYJf5ur6k2bZBVDqcG7AMW5O2VR+2ArIt ttYkvEZ+A3H6vVGiVHsGnFqc8NwVD2lnhVSd7FAeN2pR5ChwEdHLkqI0D9NF1H/+q01heG rLMLfhPyJmced+0+BwsEvUZIRboOLYA6lrD2UQWLl71XCu7nyTi6U6M88uNeseg08wx/XO 5PFVf1ol4unRdiCWOoWmhclqZfFgYvTeYoa8V9nY+PASnO71FjG9Vq0dUis5nA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1776539405; a=rsa-sha256; cv=none; b=V754JeGYfKvVQNooswawFaokmuv9+Fvwvm+D30vVJCf/H417Tk/5HUUO2+1yvWbz9vMqM/ ED9Vc1WOUBeyiBuiGwpUAZWYwZUHTtX4CRcpSEMD9C7410hBDNurd4kXPY3e4HWrI8tqMM L0juS91LtRJgC9IrRzraI3YqfbKPZdS2dENM7YRuqN6kSYAjigvkmR7H5c3cP73b/Qdicg 7gJIdMpQMmD4Hfm7s/kUBkgLLMAa8dX4DZj75J+ZMy+sXCibg1FM6wLalxn3tVK/KsLSJe L3cxlMAzjYk5d8wUuuayTbt8RXMJNm1C81BHpnrCeg1iWbXL9WccMQYB4dRwZQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776539405; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=ggdz+RAgVtoo/devzUDWmkFNzlwnQf1Jlgi8Z55We6s=; b=USz5QLA9zqtm6wt3/Kz22q+N3jhqxl/vO6ipIqWNj1acmgfc51ZTCWnPtKl6ZTehydx9JC mzFd7jyWZNsRkI7Z7Wad8FeaQ2S7YXaDx5tN/Ju4pxJcNKQvtdNh4U8YLp0dKNTMBiFipD Kokd8aUX4fMRSffrB8Z7fpE5I8z029UR0+UVWjO4Dnu8MUy/+r2xQhnkUGE4NrsNnHmaJy wP3MBUNZXihxm+ez7D2KHQLdPwonbPcDerbiR3qZsOqGic1Gvw8dmm2abocGNNV2m+Lf7r fTfYDfQ37f5bRcBarcyv4TcxM4MJaHeJL4bgfa0zMbdOSRsow+LdfLJl9GKv2w== Received: from fauth-a1-smtp.messagingengine.com (fauth-a1-smtp.messagingengine.com [103.168.172.200]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: gallatin) by smtp.freebsd.org (Postfix) with ESMTPSA id 4fyhCJ6sV6zJjR; Sat, 18 Apr 2026 19:10:04 +0000 (UTC) (envelope-from gallatin@freebsd.org) Received: from phl-compute-05.internal (phl-compute-05.internal [10.202.2.45]) by mailfauth.phl.internal (Postfix) with ESMTP id 46179F4006D; Sat, 18 Apr 2026 15:10:04 -0400 (EDT) Received: from phl-imap-02 ([10.202.2.81]) by phl-compute-05.internal (MEProxy); Sat, 18 Apr 2026 15:10:04 -0400 X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeefhedrtddtgdehfeehiecutefuodetggdotefrod ftvfcurfhrohhfihhlvgemucfhrghsthforghilhdpuffrtefokffrpgfnqfghnecuuegr ihhlohhuthemuceftddtnecusecvtfgvtghiphhivghnthhsucdlqddutddtmdenucfjug hrpefoggffhffvvefkjghfufgtsegrtderreertddtnecuhfhrohhmpedfffhrvgifucfi rghllhgrthhinhdfuceoghgrlhhlrghtihhnsehfrhgvvggsshgurdhorhhgqeenucggtf frrghtthgvrhhnpeehjedvgedttdejtdegjeeiieekudeutdefgeekudekgfevtdefhfel fffggeelhfenucffohhmrghinhepfhhrvggvsghsugdrohhrghdptggrthifhhhishhkvg hrrdhorhhgnecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhho mhepghgrlhhlrghtihhnodhmvghsmhhtphgruhhthhhpvghrshhonhgrlhhithihqddufe efheelvddvudeiqddvleehtdegudekgedqghgrlhhlrghtihhnpeepfhhrvggvsghsugdr ohhrghesfhgrshhtmhgrihhlrdgtohhmpdhnsggprhgtphhtthhopeegpdhmohguvgepsh hmthhpohhuthdprhgtphhtthhopegtuhhrrhgvnhhtsehfrhgvvggsshgurdhorhhgpdhr tghpthhtohepfhhrvggvsghsugdqtghurhhrvghnthesfhhrvggvsghsugdrohhrghdprh gtphhtthhopehtuhgvgigvnhesfhhrvggvsghsugdrohhrghdprhgtphhtthhopehrsghr rghntghosehsuhhsvgdruggv X-ME-Proxy: Feedback-ID: i41414658:Fastmail Received: by mailuser.phl.internal (Postfix, from userid 501) id CFFD9700065; Sat, 18 Apr 2026 15:10:03 -0400 (EDT) X-Mailer: MessagingEngine.com Webmail Interface List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 X-ThreadId: APgOGAU08yF- Date: Sat, 18 Apr 2026 15:09:42 -0400 From: "Drew Gallatin" To: tuexen , current@freebsd.org Cc: "Ricardo Branco" , freebsd-current@freebsd.org Message-Id: <3b60c3e6-f53f-4084-a435-fe5371c56e58@app.fastmail.com> In-Reply-To: References: <9d640ae4-7133-4d4f-917f-d715ab71ee7b@suse.de> Subject: Re: panic: assertion failed in iflib_txq_drain() Content-Type: multipart/alternative; boundary=de29220a76d19c76af1d1ba6f005ef33c6782576 --de29220a76d19c76af1d1ba6f005ef33c6782576 Content-Type: text/plain Content-Transfer-Encoding: 7bit Sorry, looking into this now. I did not test this change with the mp_ring path.. i don't see how fixing the counters could cause this panic. Looking at it now.. Drew On Sat, Apr 18, 2026, at 1:38 PM, Michael Tuexen wrote: > > On 18. Apr 2026, at 19:14, David Wolfskill wrote: > > > > On Sat, Apr 18, 2026 at 03:53:33PM +0200, Michael Tuexen wrote: > >> ... > >>> So... one of the machines on which I track head got this, as well -- my > >>> (mostly-)headless build machine. (2 laptops, updated in sync with the > >>> build machine, did not panic. One of those also uses a wired NIC.) > >> Do the network drivers of the machines not being affected use iflib? > > > > Apparently not -- they are em(4), iwm(4), & iwn(4), while the panicking > > machine uses igb(4). > > > >> I do see the problem also on one of my machines and local testing shows that > >> https://cgit.FreeBSD.org/src/commit/?id=3fade68cfdf95ee0b517b5d69b270bd8da633404 > >> is the problem. At least reverting it locally resolves the problem. > >> Can you confirm this? > > > > I can, and do: after reverting main-n285140-3fade68cfdf9 & rebuilding, > > I am able to ssh in without issue; the machine reports: > > > > freebeast(16.0-C)[2] uname -aUK > > FreeBSD freebeast.catwhisker.org 16.0-CURRENT FreeBSD 16.0-CURRENT #549 main-n285180-23a84efeb191: Sat Apr 18 17:01:25 UTC 2026 root@freebeast.catwhisker.org:/common/S3/obj/usr/src/amd64.amd64/sys/GENERIC amd64 1600015 1600015 > > > > Thanks! > You could also disable TSO. I will put up a review for a fix soon. > > Best regards > Michael > > > > Peace, > > david > > -- > > David H. Wolfskill david@catwhisker.org > > > > See https://www.catwhisker.org/~david/publickey.gpg for my public key. > > > --de29220a76d19c76af1d1ba6f005ef33c6782576 Content-Type: text/html Content-Transfer-Encoding: quoted-printable
Sorry, looki= ng into this now.  I did not test this change with the mp_ring path= .. i don't see how fixing the counters could cause this panic.  &nb= sp;Looking at it now..

Drew

On Sat, Apr 18, 2026, at 1:38 PM, Michael Tuexen wrote:
> On 18. Apr 2026, at = 19:14, David Wolfskill <david= @catwhisker.org> wrote:
> 
> On Sa= t, Apr 18, 2026 at 03:53:33PM +0200, Michael Tuexen wrote:
>= ;> ...
>>> So... one of the machines on which I tr= ack head got this, as well -- my
>>> (mostly-)headles= s build machine.  (2 laptops, updated in sync with the
&g= t;>> build machine, did not panic.  One of those also uses a = wired NIC.)
>> Do the network drivers of the machines no= t being affected use iflib?
> 
> Apparent= ly not -- they are em(4), iwm(4), & iwn(4), while the panicking
> machine uses igb(4).
> 
>> = I do see the problem also on one of my machines and local testing shows = that
>> https://cgit.FreeBSD= .org/src/commit/?id=3D3fade68cfdf95ee0b517b5d69b270bd8da633404 <<= a href=3D"https://cgit.freebsd.org/src/commit/?id=3D3fade68cfdf95ee0b517= b5d69b270bd8da633404">https://cgit.freebsd.org/src/commit/?id=3D3fade68c= fdf95ee0b517b5d69b270bd8da633404>
>> is the probl= em. At least reverting it locally resolves the problem.
>&g= t; Can you confirm this?
> 
> I can, and = do:  after reverting main-n285140-3fade68cfdf9 & rebuilding,
> I am able to ssh in without issue; the machine reports:
> 
> freebeast(16.0-C)[2] uname -aUK
> FreeBSD freebea= st.catwhisker.org 16.0-CURRENT FreeBSD 16.0-CURRENT #549 main-n28518= 0-23a84efeb191: Sat Apr 18 17:01:25 UTC 2026    &nbs= p;root@freebeast.catwhi= sker.org:/common/S3/obj/usr/src/amd64.amd64/sys/GENERIC amd64 160001= 5 1600015
> 
> Thanks!
You coul= d also disable TSO. I will put up a review for a fix soon.
Best regards
Michael
> 
> Peace,
> david
> -- 
>= ; David H. Wolfskill        &nbs= p;           &nbs= p;         david@catwhisker.org
> 



=

--de29220a76d19c76af1d1ba6f005ef33c6782576-- From nobody Sat Apr 18 19:12:58 2026 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fyhGj36QCz6Ws7q; Sat, 18 Apr 2026 19:13:01 +0000 (UTC) (envelope-from tuexen@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R12" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4fyhGj2G00z45bJ; Sat, 18 Apr 2026 19:13:01 +0000 (UTC) (envelope-from tuexen@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776539581; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=6q7GrvXGr/pgiPGvXtQW9h5qZuX6b3TuYrjG2aRga+I=; b=HE841skQNeR7TB0x8UbkPDvsbuVhux/pNW08HgebGQahihN7GaQTmZ6T73gTwTZ5GNj6FK /NlLTxLBz4/UppOrPgEZRFfvWh7cqGYILZHu8rBZ8Q4m6obnRJkdr/mUyf7TlDtcWQOqK+ Fp5H1moy2vuAWXm5SitthyBL16zZUR+C/x81GcxyNRIcITRZqIXcdp38IoeYT3jyfsMHAX XcjKsoXSnyzvMjgrED9SyIURKgiqr6xMMHRrOFCmlpqxz9gPLP7pT2euiyXTVSMZvO/z8p B2E6edGgd6VJTaBfkScl7nPJTz2/Ul0kIz/TD8awuZBUOaCAdbRzfD+kXWa6pw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1776539581; a=rsa-sha256; cv=none; b=IJTPa33tIhwG5uw62P758dsx0v7kFPTZ2Ybo2Hi+b/zTZv+EDX1isCNn078fnHMcbDTBQA xMBh0x7feKW735OrhUhTnJl5cI+ouf0JjV2S0+I62z5DVAyCdUogg1jXtGHujYnWtOZDCp 4JXhYe/wOxQJHV72Obt/FE2Rr9BzEXzTQhKbW0H+D/3rqtjgG4Y2RZLiBwNAzDGZyIv8rU jV4j68Sf5j3bWb6S+XLzIp8XCbzK92fhA9tVFljwFw865j4oXqb4e+AIFnRHKdJgL5IHkp y/NVOdUfy7ytQYDUU3H1WYunt18SsdfVf8xPKGynG1HdsH7WxilULPzXeAiF5g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776539581; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=6q7GrvXGr/pgiPGvXtQW9h5qZuX6b3TuYrjG2aRga+I=; b=EmFbvZmu6+Todpm+7i8tcssKp28yrWqhWXTbyysyWfmMr/5ORBnY5GrVIdq/6myNHWY/GO 4gQy/FuH0tIFZve05YxU3M5kBzksfq4k+tGxx3gZWHR15fqtN/CdAhIlccBzrMssqJZTti S5ZHqZy/j/uPTS9ObKBG0PYQU6/LFgXtbEXN+fhecP3Ze5l0MdBWQoECVeuuG/R5t9svgk vETVR8XnLBedGEAVU1R0d6IM46J+AApKmEZD1buDeOBHUCTY1u+cKTuGGnlNzw+cybHtRc 4qo4lFK0qYV3CHVgQ/oFIZT3cZ0L7Q9DDsa4wkc+ncuc5fyB1N94Ib5HriG0RQ== Received: from smtpclient.apple (unknown [IPv6:2a02:8109:1101:be00:d835:7117:6c6b:190a]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: tuexen) by smtp.freebsd.org (Postfix) with ESMTPSA id 4fyhGh4wNFzJjZ; Sat, 18 Apr 2026 19:13:00 +0000 (UTC) (envelope-from tuexen@FreeBSD.org) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3864.500.181\)) Subject: Re: panic: assertion failed in iflib_txq_drain() From: Michael Tuexen In-Reply-To: <3b60c3e6-f53f-4084-a435-fe5371c56e58@app.fastmail.com> Date: Sat, 18 Apr 2026 21:12:58 +0200 Cc: current@freebsd.org, Ricardo Branco , freebsd-current@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <9d640ae4-7133-4d4f-917f-d715ab71ee7b@suse.de> <3b60c3e6-f53f-4084-a435-fe5371c56e58@app.fastmail.com> To: Drew Gallatin X-Mailer: Apple Mail (2.3864.500.181) > On 18. Apr 2026, at 21:09, Drew Gallatin wrote: >=20 > Sorry, looking into this now. I did not test this change with the = mp_ring path.. i don't see how fixing the counters could cause this = panic. Looking at it now.. Hi Drew, I think https://reviews.freebsd.org/D56509 fixes it. Best regards Michael >=20 > Drew >=20 > On Sat, Apr 18, 2026, at 1:38 PM, Michael Tuexen wrote: >>=20 >>=20 >> > On 18. Apr 2026, at 19:14, David Wolfskill = wrote: >> >=20 >> > On Sat, Apr 18, 2026 at 03:53:33PM +0200, Michael Tuexen wrote: >> >> ... >> >>> So... one of the machines on which I track head got this, as well = -- my >> >>> (mostly-)headless build machine. (2 laptops, updated in sync = with the >> >>> build machine, did not panic. One of those also uses a wired = NIC.) >> >> Do the network drivers of the machines not being affected use = iflib? >> >=20 >> > Apparently not -- they are em(4), iwm(4), & iwn(4), while the = panicking >> > machine uses igb(4). >> >=20 >> >> I do see the problem also on one of my machines and local testing = shows that >> >> = https://cgit.FreeBSD.org/src/commit/?id=3D3fade68cfdf95ee0b517b5d69b270bd8= da633404 = >> >> is the problem. At least reverting it locally resolves the = problem. >> >> Can you confirm this? >> >=20 >> > I can, and do: after reverting main-n285140-3fade68cfdf9 & = rebuilding, >> > I am able to ssh in without issue; the machine reports: >> >=20 >> > freebeast(16.0-C)[2] uname -aUK >> > FreeBSD freebeast.catwhisker.org 16.0-CURRENT FreeBSD 16.0-CURRENT = #549 main-n285180-23a84efeb191: Sat Apr 18 17:01:25 UTC 2026 = root@freebeast.catwhisker.org:/common/S3/obj/usr/src/amd64.amd64/sys/GENER= IC amd64 1600015 1600015 >> >=20 >> > Thanks! >> You could also disable TSO. I will put up a review for a fix soon. >>=20 >> Best regards >> Michael >> >=20 >> > Peace, >> > david >> > --=20 >> > David H. Wolfskill = david@catwhisker.org >> >=20 >> > See https://www.catwhisker.org/~david/publickey.gpg for my public = key. >>=20 >>=20 >>=20 >=20 From nobody Sat Apr 18 19:12:58 2026 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fyhGj36QCz6Ws7q; Sat, 18 Apr 2026 19:13:01 +0000 (UTC) (envelope-from tuexen@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R12" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4fyhGj2G00z45bJ; Sat, 18 Apr 2026 19:13:01 +0000 (UTC) (envelope-from tuexen@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776539581; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=6q7GrvXGr/pgiPGvXtQW9h5qZuX6b3TuYrjG2aRga+I=; b=HE841skQNeR7TB0x8UbkPDvsbuVhux/pNW08HgebGQahihN7GaQTmZ6T73gTwTZ5GNj6FK /NlLTxLBz4/UppOrPgEZRFfvWh7cqGYILZHu8rBZ8Q4m6obnRJkdr/mUyf7TlDtcWQOqK+ Fp5H1moy2vuAWXm5SitthyBL16zZUR+C/x81GcxyNRIcITRZqIXcdp38IoeYT3jyfsMHAX XcjKsoXSnyzvMjgrED9SyIURKgiqr6xMMHRrOFCmlpqxz9gPLP7pT2euiyXTVSMZvO/z8p B2E6edGgd6VJTaBfkScl7nPJTz2/Ul0kIz/TD8awuZBUOaCAdbRzfD+kXWa6pw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1776539581; a=rsa-sha256; cv=none; b=IJTPa33tIhwG5uw62P758dsx0v7kFPTZ2Ybo2Hi+b/zTZv+EDX1isCNn078fnHMcbDTBQA xMBh0x7feKW735OrhUhTnJl5cI+ouf0JjV2S0+I62z5DVAyCdUogg1jXtGHujYnWtOZDCp 4JXhYe/wOxQJHV72Obt/FE2Rr9BzEXzTQhKbW0H+D/3rqtjgG4Y2RZLiBwNAzDGZyIv8rU jV4j68Sf5j3bWb6S+XLzIp8XCbzK92fhA9tVFljwFw865j4oXqb4e+AIFnRHKdJgL5IHkp y/NVOdUfy7ytQYDUU3H1WYunt18SsdfVf8xPKGynG1HdsH7WxilULPzXeAiF5g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776539581; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=6q7GrvXGr/pgiPGvXtQW9h5qZuX6b3TuYrjG2aRga+I=; b=EmFbvZmu6+Todpm+7i8tcssKp28yrWqhWXTbyysyWfmMr/5ORBnY5GrVIdq/6myNHWY/GO 4gQy/FuH0tIFZve05YxU3M5kBzksfq4k+tGxx3gZWHR15fqtN/CdAhIlccBzrMssqJZTti S5ZHqZy/j/uPTS9ObKBG0PYQU6/LFgXtbEXN+fhecP3Ze5l0MdBWQoECVeuuG/R5t9svgk vETVR8XnLBedGEAVU1R0d6IM46J+AApKmEZD1buDeOBHUCTY1u+cKTuGGnlNzw+cybHtRc 4qo4lFK0qYV3CHVgQ/oFIZT3cZ0L7Q9DDsa4wkc+ncuc5fyB1N94Ib5HriG0RQ== Received: from smtpclient.apple (unknown [IPv6:2a02:8109:1101:be00:d835:7117:6c6b:190a]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: tuexen) by smtp.freebsd.org (Postfix) with ESMTPSA id 4fyhGh4wNFzJjZ; Sat, 18 Apr 2026 19:13:00 +0000 (UTC) (envelope-from tuexen@FreeBSD.org) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3864.500.181\)) Subject: Re: panic: assertion failed in iflib_txq_drain() From: Michael Tuexen In-Reply-To: <3b60c3e6-f53f-4084-a435-fe5371c56e58@app.fastmail.com> Date: Sat, 18 Apr 2026 21:12:58 +0200 Cc: current@freebsd.org, Ricardo Branco , freebsd-current@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <9d640ae4-7133-4d4f-917f-d715ab71ee7b@suse.de> <3b60c3e6-f53f-4084-a435-fe5371c56e58@app.fastmail.com> To: Drew Gallatin X-Mailer: Apple Mail (2.3864.500.181) > On 18. Apr 2026, at 21:09, Drew Gallatin wrote: >=20 > Sorry, looking into this now. I did not test this change with the = mp_ring path.. i don't see how fixing the counters could cause this = panic. Looking at it now.. Hi Drew, I think https://reviews.freebsd.org/D56509 fixes it. Best regards Michael >=20 > Drew >=20 > On Sat, Apr 18, 2026, at 1:38 PM, Michael Tuexen wrote: >>=20 >>=20 >> > On 18. Apr 2026, at 19:14, David Wolfskill = wrote: >> >=20 >> > On Sat, Apr 18, 2026 at 03:53:33PM +0200, Michael Tuexen wrote: >> >> ... >> >>> So... one of the machines on which I track head got this, as well = -- my >> >>> (mostly-)headless build machine. (2 laptops, updated in sync = with the >> >>> build machine, did not panic. One of those also uses a wired = NIC.) >> >> Do the network drivers of the machines not being affected use = iflib? >> >=20 >> > Apparently not -- they are em(4), iwm(4), & iwn(4), while the = panicking >> > machine uses igb(4). >> >=20 >> >> I do see the problem also on one of my machines and local testing = shows that >> >> = https://cgit.FreeBSD.org/src/commit/?id=3D3fade68cfdf95ee0b517b5d69b270bd8= da633404 = >> >> is the problem. At least reverting it locally resolves the = problem. >> >> Can you confirm this? >> >=20 >> > I can, and do: after reverting main-n285140-3fade68cfdf9 & = rebuilding, >> > I am able to ssh in without issue; the machine reports: >> >=20 >> > freebeast(16.0-C)[2] uname -aUK >> > FreeBSD freebeast.catwhisker.org 16.0-CURRENT FreeBSD 16.0-CURRENT = #549 main-n285180-23a84efeb191: Sat Apr 18 17:01:25 UTC 2026 = root@freebeast.catwhisker.org:/common/S3/obj/usr/src/amd64.amd64/sys/GENER= IC amd64 1600015 1600015 >> >=20 >> > Thanks! >> You could also disable TSO. I will put up a review for a fix soon. >>=20 >> Best regards >> Michael >> >=20 >> > Peace, >> > david >> > --=20 >> > David H. Wolfskill = david@catwhisker.org >> >=20 >> > See https://www.catwhisker.org/~david/publickey.gpg for my public = key. >>=20 >>=20 >>=20 >=20 From nobody Sat Apr 18 19:25:48 2026 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fyhYt14cZz6WspG; Sat, 18 Apr 2026 19:26:10 +0000 (UTC) (envelope-from gallatin@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R12" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4fyhYs5wsPz48tr; Sat, 18 Apr 2026 19:26:09 +0000 (UTC) (envelope-from gallatin@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776540369; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=71gNs8kHE8rmkmuz9+v4P/4TEFnpRtuhxj6BhoAduv8=; b=sEBhi4Z+c06UhufUWmEoKcNlFrohJySFeB+8IrAdtkFsPgcb+rTrF3YB+FlkNrfOb/BaRN eBtBT/vCLZoV05+XB1Jgk44BmiJ4nBxHKeCHhV49LbO6yQFRrhNGVFtGo4KX4etg/pPi0P n7ahtXEY0fi2Wyaa1SBrSs2u55RT7fYmRE6aN+l8eTP3Mi3Ncv6a7V4zuYkxjpH9RM+IJ+ QopSlLzqcALAu9VtgmF7DsO5n+IYV52ltwZipe85/Vw9qs8p1M1n+qXbRcFmdkUHjOm8ca 1ABc4hz53f/KJjzxNwiHEusGBUUcXT5XGKGDzzv9J/LQ4mZrabe8MHa3KdVX7w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1776540369; a=rsa-sha256; cv=none; b=O0R2xo0gifbhXMkkYPFeMsq/wiq8GcGuSpJdrFi34Soy5RSO20yNzgsqSMgjCzsuWgGTwg 1dW+va9ehR6sMG8AIlXKQS+HQp9fQtzX40aUbU2cY/jOxfZCAc79ZIhNsJVp6KLxsuzO6p JWo/a0HMYncq7CwUadettVasDOe0fXPDxSl3Iyt3oSCYuPPPaJoxWLuYCEP1j2BrLDo02Y LdpepaFWG4GeXpQEhm+x/w8V7IllC2YCFzLCHaDVJcVBTquvqx9bY349ca/3VEKbpapDSa C+CNNf+cyZPguN4x9qLbNhue6s4im70jLMTOpNbKmALSBIfzyN5JHvDyLYAw7g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776540369; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=71gNs8kHE8rmkmuz9+v4P/4TEFnpRtuhxj6BhoAduv8=; b=l4fTEutgIRwmulIYVnWTl5fyhqlyctl9DtS5usXUo/fHtjxYLgca0UgELL3stRD1f0Z/M/ 4AQvgo+gOjYWRkknWZrbRUTfpLI7Q7yioXC59ACwTVEc/wVmJPcX0QsLgUyMnDjdmxJ7Kp X2Q5M6aAWbaMeydgpxBt//JMjois/ptUNQlg1BUcaA1GL0mEa/e73jBHWaaM0F5o8S9Q7s F+QrCQ5GWNoXfvJIIdHpNl5mjYMMRjYfRrzLpO39ybjIl+dOj/tfEFn8l1LoeJbTE5Tf6Q 4DtoA3+DsFwEwgp0Ufwnew8FBJo20xSp76Rv9xrBJKAcb3q8/vkPQu2nGQCooQ== Received: from fauth-a1-smtp.messagingengine.com (fauth-a1-smtp.messagingengine.com [103.168.172.200]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: gallatin) by smtp.freebsd.org (Postfix) with ESMTPSA id 4fyhYs4wXYzJ8D; Sat, 18 Apr 2026 19:26:09 +0000 (UTC) (envelope-from gallatin@freebsd.org) Received: from phl-compute-05.internal (phl-compute-05.internal [10.202.2.45]) by mailfauth.phl.internal (Postfix) with ESMTP id 46082F40068; Sat, 18 Apr 2026 15:26:09 -0400 (EDT) Received: from phl-imap-02 ([10.202.2.81]) by phl-compute-05.internal (MEProxy); Sat, 18 Apr 2026 15:26:09 -0400 X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeefhedrtddtgdehfeeitdcutefuodetggdotefrod ftvfcurfhrohhfihhlvgemucfhrghsthforghilhdpuffrtefokffrpgfnqfghnecuuegr ihhlohhuthemuceftddtnecusecvtfgvtghiphhivghnthhsucdlqddutddtmdenucfjug hrpefoggffhffvvefkjghfufgtsegrtderreertddtnecuhfhrohhmpedfffhrvgifucfi rghllhgrthhinhdfuceoghgrlhhlrghtihhnsehfrhgvvggsshgurdhorhhgqeenucggtf frrghtthgvrhhnpeehjedvgedttdejtdegjeeiieekudeutdefgeekudekgfevtdefhfel fffggeelhfenucffohhmrghinhepfhhrvggvsghsugdrohhrghdptggrthifhhhishhkvg hrrdhorhhgnecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhho mhepghgrlhhlrghtihhnodhmvghsmhhtphgruhhthhhpvghrshhonhgrlhhithihqddufe efheelvddvudeiqddvleehtdegudekgedqghgrlhhlrghtihhnpeepfhhrvggvsghsugdr ohhrghesfhgrshhtmhgrihhlrdgtohhmpdhnsggprhgtphhtthhopeegpdhmohguvgepsh hmthhpohhuthdprhgtphhtthhopegtuhhrrhgvnhhtsehfrhgvvggsshgurdhorhhgpdhr tghpthhtohepfhhrvggvsghsugdqtghurhhrvghnthesfhhrvggvsghsugdrohhrghdprh gtphhtthhopehtuhgvgigvnhesfhhrvggvsghsugdrohhrghdprhgtphhtthhopehrsghr rghntghosehsuhhsvgdruggv X-ME-Proxy: Feedback-ID: i41414658:Fastmail Received: by mailuser.phl.internal (Postfix, from userid 501) id 1FFB8700065; Sat, 18 Apr 2026 15:26:09 -0400 (EDT) X-Mailer: MessagingEngine.com Webmail Interface List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 X-ThreadId: APgOGAU08yF- Date: Sat, 18 Apr 2026 15:25:48 -0400 From: "Drew Gallatin" To: tuexen Cc: current@freebsd.org, "Ricardo Branco" , freebsd-current@freebsd.org Message-Id: <432c4416-4783-4c7e-8e64-4b440672a355@app.fastmail.com> In-Reply-To: References: <9d640ae4-7133-4d4f-917f-d715ab71ee7b@suse.de> <3b60c3e6-f53f-4084-a435-fe5371c56e58@app.fastmail.com> Subject: Re: panic: assertion failed in iflib_txq_drain() Content-Type: multipart/alternative; boundary=dda45f7b44245c72920294bf51ead7d7a5817a31 --dda45f7b44245c72920294bf51ead7d7a5817a31 Content-Type: text/plain Content-Transfer-Encoding: 7bit Indeed, that looks reasonable, and I see how the packet count was overloaded before. Testing it now. Drew On Sat, Apr 18, 2026, at 3:12 PM, Michael Tuexen wrote: > > On 18. Apr 2026, at 21:09, Drew Gallatin wrote: > > > > Sorry, looking into this now. I did not test this change with the mp_ring path.. i don't see how fixing the counters could cause this panic. Looking at it now.. > Hi Drew, > > I think https://reviews.freebsd.org/D56509 fixes it. > > Best regards > Michael > > > > Drew > > > > On Sat, Apr 18, 2026, at 1:38 PM, Michael Tuexen wrote: > >> > >> > >> > On 18. Apr 2026, at 19:14, David Wolfskill wrote: > >> > > >> > On Sat, Apr 18, 2026 at 03:53:33PM +0200, Michael Tuexen wrote: > >> >> ... > >> >>> So... one of the machines on which I track head got this, as well -- my > >> >>> (mostly-)headless build machine. (2 laptops, updated in sync with the > >> >>> build machine, did not panic. One of those also uses a wired NIC.) > >> >> Do the network drivers of the machines not being affected use iflib? > >> > > >> > Apparently not -- they are em(4), iwm(4), & iwn(4), while the panicking > >> > machine uses igb(4). > >> > > >> >> I do see the problem also on one of my machines and local testing shows that > >> >> https://cgit.FreeBSD.org/src/commit/?id=3fade68cfdf95ee0b517b5d69b270bd8da633404 > >> >> is the problem. At least reverting it locally resolves the problem. > >> >> Can you confirm this? > >> > > >> > I can, and do: after reverting main-n285140-3fade68cfdf9 & rebuilding, > >> > I am able to ssh in without issue; the machine reports: > >> > > >> > freebeast(16.0-C)[2] uname -aUK > >> > FreeBSD freebeast.catwhisker.org 16.0-CURRENT FreeBSD 16.0-CURRENT #549 main-n285180-23a84efeb191: Sat Apr 18 17:01:25 UTC 2026 root@freebeast.catwhisker.org:/common/S3/obj/usr/src/amd64.amd64/sys/GENERIC amd64 1600015 1600015 > >> > > >> > Thanks! > >> You could also disable TSO. I will put up a review for a fix soon. > >> > >> Best regards > >> Michael > >> > > >> > Peace, > >> > david > >> > -- > >> > David H. Wolfskill david@catwhisker.org > >> > > >> > See https://www.catwhisker.org/~david/publickey.gpg for my public key. > >> > >> > >> > > > > --dda45f7b44245c72920294bf51ead7d7a5817a31 Content-Type: text/html Content-Transfer-Encoding: quoted-printable
Indeed, that= looks reasonable, and I see how the packet count was overloaded before.=   Testing it now.

Drew

On Sat, Apr 18, 2026, at 3:12 PM, Michael Tuexen wrote:
> On 18. Apr 2026, at = 21:09, Drew Gallatin <gallati= n@freebsd.org> wrote:
> 
> Sorry, = looking into this now.  I did not test this change with the mp_ring= path.. i don't see how fixing the counters could cause this panic. = ;  Looking at it now..
Hi Drew,


Best regar= ds
Michael
> 
> Drew
= > 
> On Sat, Apr 18, 2026, at 1:38 PM, Michael Tuex= en wrote:
>> 
>> 
&g= t;> > On 18. Apr 2026, at 19:14, David Wolfskill <david@catwhisker.org> wrote:
>> > 
>> > On Sat, Apr 18, 2026 at 03:= 53:33PM +0200, Michael Tuexen wrote:
>> >> ...
>> >>> So... one of the machines on which I track = head got this, as well -- my
>> >>> (mostly-)he= adless build machine.  (2 laptops, updated in sync with the
>> >>> build machine, did not panic.  One of thos= e also uses a wired NIC.)
>> >> Do the network dri= vers of the machines not being affected use iflib?
>> &g= t; 
>> > Apparently not -- they are em(4), iwm(4= ), & iwn(4), while the panicking
>> > machine use= s igb(4).
>> > 
>> >> I do= see the problem also on one of my machines and local testing shows that=
>> >>= ; is the problem. At least reverting it locally resolves the problem.
>> >> Can you confirm this?
>> >&= nbsp;
>> > I can, and do:  after reverting main-= n285140-3fade68cfdf9 & rebuilding,
>> > I am able= to ssh in without issue; the machine reports:
>> >&n= bsp;
>> > freebeast(16.0-C)[2] uname -aUK
&= gt;> > FreeBSD fr= eebeast.catwhisker.org 16.0-CURRENT FreeBSD 16.0-CURRENT #549 main-n= 285180-23a84efeb191: Sat Apr 18 17:01:25 UTC 2026    = ; root@freebeast.c= atwhisker.org:/common/S3/obj/usr/src/amd64.amd64/sys/GENERIC amd64 1= 600015 1600015
>> > 
>> > Tha= nks!
>> You could also disable TSO. I will put up a revi= ew for a fix soon.
>> 
>> Best rega= rds
>> Michael
>> > 
&= gt;> > Peace,
>> > david
>> >= ; -- 
>> > David H. Wolfskill   &= nbsp;           &= nbsp;           &= nbsp;  david@catwhiske= r.org
>> > 
&g= t;> 
>> 
>> 
> 



--dda45f7b44245c72920294bf51ead7d7a5817a31-- From nobody Sat Apr 18 19:25:48 2026 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fyhYt14cZz6WspG; Sat, 18 Apr 2026 19:26:10 +0000 (UTC) (envelope-from gallatin@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R12" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4fyhYs5wsPz48tr; Sat, 18 Apr 2026 19:26:09 +0000 (UTC) (envelope-from gallatin@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776540369; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=71gNs8kHE8rmkmuz9+v4P/4TEFnpRtuhxj6BhoAduv8=; b=sEBhi4Z+c06UhufUWmEoKcNlFrohJySFeB+8IrAdtkFsPgcb+rTrF3YB+FlkNrfOb/BaRN eBtBT/vCLZoV05+XB1Jgk44BmiJ4nBxHKeCHhV49LbO6yQFRrhNGVFtGo4KX4etg/pPi0P n7ahtXEY0fi2Wyaa1SBrSs2u55RT7fYmRE6aN+l8eTP3Mi3Ncv6a7V4zuYkxjpH9RM+IJ+ QopSlLzqcALAu9VtgmF7DsO5n+IYV52ltwZipe85/Vw9qs8p1M1n+qXbRcFmdkUHjOm8ca 1ABc4hz53f/KJjzxNwiHEusGBUUcXT5XGKGDzzv9J/LQ4mZrabe8MHa3KdVX7w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1776540369; a=rsa-sha256; cv=none; b=O0R2xo0gifbhXMkkYPFeMsq/wiq8GcGuSpJdrFi34Soy5RSO20yNzgsqSMgjCzsuWgGTwg 1dW+va9ehR6sMG8AIlXKQS+HQp9fQtzX40aUbU2cY/jOxfZCAc79ZIhNsJVp6KLxsuzO6p JWo/a0HMYncq7CwUadettVasDOe0fXPDxSl3Iyt3oSCYuPPPaJoxWLuYCEP1j2BrLDo02Y LdpepaFWG4GeXpQEhm+x/w8V7IllC2YCFzLCHaDVJcVBTquvqx9bY349ca/3VEKbpapDSa C+CNNf+cyZPguN4x9qLbNhue6s4im70jLMTOpNbKmALSBIfzyN5JHvDyLYAw7g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776540369; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=71gNs8kHE8rmkmuz9+v4P/4TEFnpRtuhxj6BhoAduv8=; b=l4fTEutgIRwmulIYVnWTl5fyhqlyctl9DtS5usXUo/fHtjxYLgca0UgELL3stRD1f0Z/M/ 4AQvgo+gOjYWRkknWZrbRUTfpLI7Q7yioXC59ACwTVEc/wVmJPcX0QsLgUyMnDjdmxJ7Kp X2Q5M6aAWbaMeydgpxBt//JMjois/ptUNQlg1BUcaA1GL0mEa/e73jBHWaaM0F5o8S9Q7s F+QrCQ5GWNoXfvJIIdHpNl5mjYMMRjYfRrzLpO39ybjIl+dOj/tfEFn8l1LoeJbTE5Tf6Q 4DtoA3+DsFwEwgp0Ufwnew8FBJo20xSp76Rv9xrBJKAcb3q8/vkPQu2nGQCooQ== Received: from fauth-a1-smtp.messagingengine.com (fauth-a1-smtp.messagingengine.com [103.168.172.200]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: gallatin) by smtp.freebsd.org (Postfix) with ESMTPSA id 4fyhYs4wXYzJ8D; Sat, 18 Apr 2026 19:26:09 +0000 (UTC) (envelope-from gallatin@freebsd.org) Received: from phl-compute-05.internal (phl-compute-05.internal [10.202.2.45]) by mailfauth.phl.internal (Postfix) with ESMTP id 46082F40068; Sat, 18 Apr 2026 15:26:09 -0400 (EDT) Received: from phl-imap-02 ([10.202.2.81]) by phl-compute-05.internal (MEProxy); Sat, 18 Apr 2026 15:26:09 -0400 X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeefhedrtddtgdehfeeitdcutefuodetggdotefrod ftvfcurfhrohhfihhlvgemucfhrghsthforghilhdpuffrtefokffrpgfnqfghnecuuegr ihhlohhuthemuceftddtnecusecvtfgvtghiphhivghnthhsucdlqddutddtmdenucfjug hrpefoggffhffvvefkjghfufgtsegrtderreertddtnecuhfhrohhmpedfffhrvgifucfi rghllhgrthhinhdfuceoghgrlhhlrghtihhnsehfrhgvvggsshgurdhorhhgqeenucggtf frrghtthgvrhhnpeehjedvgedttdejtdegjeeiieekudeutdefgeekudekgfevtdefhfel fffggeelhfenucffohhmrghinhepfhhrvggvsghsugdrohhrghdptggrthifhhhishhkvg hrrdhorhhgnecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhho mhepghgrlhhlrghtihhnodhmvghsmhhtphgruhhthhhpvghrshhonhgrlhhithihqddufe efheelvddvudeiqddvleehtdegudekgedqghgrlhhlrghtihhnpeepfhhrvggvsghsugdr ohhrghesfhgrshhtmhgrihhlrdgtohhmpdhnsggprhgtphhtthhopeegpdhmohguvgepsh hmthhpohhuthdprhgtphhtthhopegtuhhrrhgvnhhtsehfrhgvvggsshgurdhorhhgpdhr tghpthhtohepfhhrvggvsghsugdqtghurhhrvghnthesfhhrvggvsghsugdrohhrghdprh gtphhtthhopehtuhgvgigvnhesfhhrvggvsghsugdrohhrghdprhgtphhtthhopehrsghr rghntghosehsuhhsvgdruggv X-ME-Proxy: Feedback-ID: i41414658:Fastmail Received: by mailuser.phl.internal (Postfix, from userid 501) id 1FFB8700065; Sat, 18 Apr 2026 15:26:09 -0400 (EDT) X-Mailer: MessagingEngine.com Webmail Interface List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 X-ThreadId: APgOGAU08yF- Date: Sat, 18 Apr 2026 15:25:48 -0400 From: "Drew Gallatin" To: tuexen Cc: current@freebsd.org, "Ricardo Branco" , freebsd-current@freebsd.org Message-Id: <432c4416-4783-4c7e-8e64-4b440672a355@app.fastmail.com> In-Reply-To: References: <9d640ae4-7133-4d4f-917f-d715ab71ee7b@suse.de> <3b60c3e6-f53f-4084-a435-fe5371c56e58@app.fastmail.com> Subject: Re: panic: assertion failed in iflib_txq_drain() Content-Type: multipart/alternative; boundary=dda45f7b44245c72920294bf51ead7d7a5817a31 --dda45f7b44245c72920294bf51ead7d7a5817a31 Content-Type: text/plain Content-Transfer-Encoding: 7bit Indeed, that looks reasonable, and I see how the packet count was overloaded before. Testing it now. Drew On Sat, Apr 18, 2026, at 3:12 PM, Michael Tuexen wrote: > > On 18. Apr 2026, at 21:09, Drew Gallatin wrote: > > > > Sorry, looking into this now. I did not test this change with the mp_ring path.. i don't see how fixing the counters could cause this panic. Looking at it now.. > Hi Drew, > > I think https://reviews.freebsd.org/D56509 fixes it. > > Best regards > Michael > > > > Drew > > > > On Sat, Apr 18, 2026, at 1:38 PM, Michael Tuexen wrote: > >> > >> > >> > On 18. Apr 2026, at 19:14, David Wolfskill wrote: > >> > > >> > On Sat, Apr 18, 2026 at 03:53:33PM +0200, Michael Tuexen wrote: > >> >> ... > >> >>> So... one of the machines on which I track head got this, as well -- my > >> >>> (mostly-)headless build machine. (2 laptops, updated in sync with the > >> >>> build machine, did not panic. One of those also uses a wired NIC.) > >> >> Do the network drivers of the machines not being affected use iflib? > >> > > >> > Apparently not -- they are em(4), iwm(4), & iwn(4), while the panicking > >> > machine uses igb(4). > >> > > >> >> I do see the problem also on one of my machines and local testing shows that > >> >> https://cgit.FreeBSD.org/src/commit/?id=3fade68cfdf95ee0b517b5d69b270bd8da633404 > >> >> is the problem. At least reverting it locally resolves the problem. > >> >> Can you confirm this? > >> > > >> > I can, and do: after reverting main-n285140-3fade68cfdf9 & rebuilding, > >> > I am able to ssh in without issue; the machine reports: > >> > > >> > freebeast(16.0-C)[2] uname -aUK > >> > FreeBSD freebeast.catwhisker.org 16.0-CURRENT FreeBSD 16.0-CURRENT #549 main-n285180-23a84efeb191: Sat Apr 18 17:01:25 UTC 2026 root@freebeast.catwhisker.org:/common/S3/obj/usr/src/amd64.amd64/sys/GENERIC amd64 1600015 1600015 > >> > > >> > Thanks! > >> You could also disable TSO. I will put up a review for a fix soon. > >> > >> Best regards > >> Michael > >> > > >> > Peace, > >> > david > >> > -- > >> > David H. Wolfskill david@catwhisker.org > >> > > >> > See https://www.catwhisker.org/~david/publickey.gpg for my public key. > >> > >> > >> > > > > --dda45f7b44245c72920294bf51ead7d7a5817a31 Content-Type: text/html Content-Transfer-Encoding: quoted-printable
Indeed, that= looks reasonable, and I see how the packet count was overloaded before.=   Testing it now.

Drew

On Sat, Apr 18, 2026, at 3:12 PM, Michael Tuexen wrote:
> On 18. Apr 2026, at = 21:09, Drew Gallatin <gallati= n@freebsd.org> wrote:
> 
> Sorry, = looking into this now.  I did not test this change with the mp_ring= path.. i don't see how fixing the counters could cause this panic. = ;  Looking at it now..
Hi Drew,


Best regar= ds
Michael
> 
> Drew
= > 
> On Sat, Apr 18, 2026, at 1:38 PM, Michael Tuex= en wrote:
>> 
>> 
&g= t;> > On 18. Apr 2026, at 19:14, David Wolfskill <david@catwhisker.org> wrote:
>> > 
>> > On Sat, Apr 18, 2026 at 03:= 53:33PM +0200, Michael Tuexen wrote:
>> >> ...
>> >>> So... one of the machines on which I track = head got this, as well -- my
>> >>> (mostly-)he= adless build machine.  (2 laptops, updated in sync with the
>> >>> build machine, did not panic.  One of thos= e also uses a wired NIC.)
>> >> Do the network dri= vers of the machines not being affected use iflib?
>> &g= t; 
>> > Apparently not -- they are em(4), iwm(4= ), & iwn(4), while the panicking
>> > machine use= s igb(4).
>> > 
>> >> I do= see the problem also on one of my machines and local testing shows that=
>> >>= ; is the problem. At least reverting it locally resolves the problem.
>> >> Can you confirm this?
>> >&= nbsp;
>> > I can, and do:  after reverting main-= n285140-3fade68cfdf9 & rebuilding,
>> > I am able= to ssh in without issue; the machine reports:
>> >&n= bsp;
>> > freebeast(16.0-C)[2] uname -aUK
&= gt;> > FreeBSD fr= eebeast.catwhisker.org 16.0-CURRENT FreeBSD 16.0-CURRENT #549 main-n= 285180-23a84efeb191: Sat Apr 18 17:01:25 UTC 2026    = ; root@freebeast.c= atwhisker.org:/common/S3/obj/usr/src/amd64.amd64/sys/GENERIC amd64 1= 600015 1600015
>> > 
>> > Tha= nks!
>> You could also disable TSO. I will put up a revi= ew for a fix soon.
>> 
>> Best rega= rds
>> Michael
>> > 
&= gt;> > Peace,
>> > david
>> >= ; -- 
>> > David H. Wolfskill   &= nbsp;           &= nbsp;           &= nbsp;  david@catwhiske= r.org
>> > 
&g= t;> 
>> 
>> 
> 



--dda45f7b44245c72920294bf51ead7d7a5817a31-- From nobody Sat Apr 18 19:51:58 2026 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fyj836Vvfz6WwXp; Sat, 18 Apr 2026 19:52:19 +0000 (UTC) (envelope-from gallatin@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R12" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4fyj835bZsz3GBd; Sat, 18 Apr 2026 19:52:19 +0000 (UTC) (envelope-from gallatin@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776541939; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=30FbqVMqZySiPmvpccqgo7Z8VF5YqbyyLOF61TqgX5g=; b=KRIZaFwe51XwYhUR4dlX+0Kq4SV9M+aWmTNWQsv1egOjPvqBmkGRei2lPsSSZ3b2PSD6aK lmXjcunwAVJDVmo1yAFiQZEmkCERLNn2vi5XmPpKEQQIyqwwlYIF96/eulTd25DDH6hkrx zC5K9aOiN2YlAfGHslBSoFSB4xYTUcYDBBVvTWJ8sOvlw3Z2dXhk40/frDub6ldIn56Td1 D5rw5OR1i9poix2srEg2ncdyCDZalr8cQj1VYoPYALKDD1Lxw21bFXGYPdDyZTaeVx6SSF 6Ij1QtWdf0gJXT604RGL0hI2ZTOU0CEL0mASaG48QrANlY6wZaWv6ZkhqyP57Q== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1776541939; a=rsa-sha256; cv=none; b=HTiKN7M3MYXD5qIRVFsC+m4+JYacddiMkKI/514LV6lEgWhZhPP3JcYAVNOY4wjYZCdCT5 WrsVl1TdDBOwrfm+xIMVJVWvPaLO7GRlf9PUvVyZPuein8nOSd4Nca/7OgSWBd7pm+Ii9g v11eXVfTkP9XQoVn4AeJDFMEbPNXZoulOYiClUOK0vDw8y3W+n3Yt3jtNgy+pZ6xLTaqkQ I7m0wfB1ECNZCmPvFitCF0vevnJ5YOjQnyQL8LxceHQKRDNTTAyVaXYvd0ckJc07k+ku90 /puMhWHbrT1XJ1LM0Zuh5HfgOY/TEX4IJJGWTP580ZBjD8qxH1NJcERBUstA8A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776541939; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=30FbqVMqZySiPmvpccqgo7Z8VF5YqbyyLOF61TqgX5g=; b=NJ7aWS+UbGybEYhqb+8z6g8nhVHoxKTsLIzQI0/FcQ4cEC3hNRj22McQ3Meqs6rHe/4TBE zwaWWqfb3SdbT/Y3uSywaZR1TYVIZHy+9R29JWv8WE5yat1Hizj9pRjiWus1+0l063cAae 18Vc0RBAA4OpD/6WWmag2A5sYsd2S1KvKF07FvK2BWBZHHCWntDk4Tjlx+8x7xqLKuI7m+ cNmiEAcy5bsqldDdDIJ6orQST/XfkPjQyURYLv36NoV3IeW/zbRUmLCcLSFrnm8hX3M1ke VW92G1a4hyVC/d0t3r+TtlTls6oQlXa7tDvMAz/5Q9yQ0nMeUCpFemVbC8YBGg== Received: from fauth-a1-smtp.messagingengine.com (fauth-a1-smtp.messagingengine.com [103.168.172.200]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: gallatin) by smtp.freebsd.org (Postfix) with ESMTPSA id 4fyj834wdrzHg7; Sat, 18 Apr 2026 19:52:19 +0000 (UTC) (envelope-from gallatin@freebsd.org) Received: from phl-compute-05.internal (phl-compute-05.internal [10.202.2.45]) by mailfauth.phl.internal (Postfix) with ESMTP id 8B3F0F40068; Sat, 18 Apr 2026 15:52:19 -0400 (EDT) Received: from phl-imap-02 ([10.202.2.81]) by phl-compute-05.internal (MEProxy); Sat, 18 Apr 2026 15:52:19 -0400 X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeefhedrtddtgdehfeeihecutefuodetggdotefrod ftvfcurfhrohhfihhlvgemucfhrghsthforghilhdpuffrtefokffrpgfnqfghnecuuegr ihhlohhuthemuceftddtnecusecvtfgvtghiphhivghnthhsucdlqddutddtmdenucfjug hrpefoggffhffvvefkjghfufgtsegrtderreertddtnecuhfhrohhmpedfffhrvgifucfi rghllhgrthhinhdfuceoghgrlhhlrghtihhnsehfrhgvvggsshgurdhorhhgqeenucggtf frrghtthgvrhhnpeehjedvgedttdejtdegjeeiieekudeutdefgeekudekgfevtdefhfel fffggeelhfenucffohhmrghinhepfhhrvggvsghsugdrohhrghdptggrthifhhhishhkvg hrrdhorhhgnecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhho mhepghgrlhhlrghtihhnodhmvghsmhhtphgruhhthhhpvghrshhonhgrlhhithihqddufe efheelvddvudeiqddvleehtdegudekgedqghgrlhhlrghtihhnpeepfhhrvggvsghsugdr ohhrghesfhgrshhtmhgrihhlrdgtohhmpdhnsggprhgtphhtthhopeegpdhmohguvgepsh hmthhpohhuthdprhgtphhtthhopegtuhhrrhgvnhhtsehfrhgvvggsshgurdhorhhgpdhr tghpthhtohepfhhrvggvsghsugdqtghurhhrvghnthesfhhrvggvsghsugdrohhrghdprh gtphhtthhopehtuhgvgigvnhesfhhrvggvsghsugdrohhrghdprhgtphhtthhopehrsghr rghntghosehsuhhsvgdruggv X-ME-Proxy: Feedback-ID: i41414658:Fastmail Received: by mailuser.phl.internal (Postfix, from userid 501) id 2A634700069; Sat, 18 Apr 2026 15:52:19 -0400 (EDT) X-Mailer: MessagingEngine.com Webmail Interface List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 X-ThreadId: APgOGAU08yF- Date: Sat, 18 Apr 2026 15:51:58 -0400 From: "Drew Gallatin" To: tuexen Cc: current@freebsd.org, "Ricardo Branco" , freebsd-current@freebsd.org Message-Id: In-Reply-To: References: <9d640ae4-7133-4d4f-917f-d715ab71ee7b@suse.de> <3b60c3e6-f53f-4084-a435-fe5371c56e58@app.fastmail.com> Subject: Re: panic: assertion failed in iflib_txq_drain() Content-Type: multipart/alternative; boundary=754d0919e6487d801aec91f7696bfe04c053baca --754d0919e6487d801aec91f7696bfe04c053baca Content-Type: text/plain Content-Transfer-Encoding: 7bit That is indeed the proper fix. I just reviewed & tested it. Thank you so much! Until it lands, another workaround is to use the new, cheaper, faster, simpler iflib transmit routine by setting the tunable dev.$NIC.$UNIT.iflib.simple_tx=1 Eg, dev.bnxt.0.iflib.simple_tx=1 In loader.conf I plan to deprecate the current complex transmit routine (mp_ring) in favor of the simple mechanism, and I confess that I sometimes don't test "straightforward" changes like this on mp_ring. I'll try to get better about that. Drew On Sat, Apr 18, 2026, at 3:12 PM, Michael Tuexen wrote: > > On 18. Apr 2026, at 21:09, Drew Gallatin wrote: > > > > Sorry, looking into this now. I did not test this change with the mp_ring path.. i don't see how fixing the counters could cause this panic. Looking at it now.. > Hi Drew, > > I think https://reviews.freebsd.org/D56509 fixes it. > > Best regards > Michael > > > > Drew > > > > On Sat, Apr 18, 2026, at 1:38 PM, Michael Tuexen wrote: > >> > >> > >> > On 18. Apr 2026, at 19:14, David Wolfskill wrote: > >> > > >> > On Sat, Apr 18, 2026 at 03:53:33PM +0200, Michael Tuexen wrote: > >> >> ... > >> >>> So... one of the machines on which I track head got this, as well -- my > >> >>> (mostly-)headless build machine. (2 laptops, updated in sync with the > >> >>> build machine, did not panic. One of those also uses a wired NIC.) > >> >> Do the network drivers of the machines not being affected use iflib? > >> > > >> > Apparently not -- they are em(4), iwm(4), & iwn(4), while the panicking > >> > machine uses igb(4). > >> > > >> >> I do see the problem also on one of my machines and local testing shows that > >> >> https://cgit.FreeBSD.org/src/commit/?id=3fade68cfdf95ee0b517b5d69b270bd8da633404 > >> >> is the problem. At least reverting it locally resolves the problem. > >> >> Can you confirm this? > >> > > >> > I can, and do: after reverting main-n285140-3fade68cfdf9 & rebuilding, > >> > I am able to ssh in without issue; the machine reports: > >> > > >> > freebeast(16.0-C)[2] uname -aUK > >> > FreeBSD freebeast.catwhisker.org 16.0-CURRENT FreeBSD 16.0-CURRENT #549 main-n285180-23a84efeb191: Sat Apr 18 17:01:25 UTC 2026 root@freebeast.catwhisker.org:/common/S3/obj/usr/src/amd64.amd64/sys/GENERIC amd64 1600015 1600015 > >> > > >> > Thanks! > >> You could also disable TSO. I will put up a review for a fix soon. > >> > >> Best regards > >> Michael > >> > > >> > Peace, > >> > david > >> > -- > >> > David H. Wolfskill david@catwhisker.org > >> > > >> > See https://www.catwhisker.org/~david/publickey.gpg for my public key. > >> > >> > >> > > > > --754d0919e6487d801aec91f7696bfe04c053baca Content-Type: text/html Content-Transfer-Encoding: quoted-printable

That is indeed the proper fix.   I just reviewed & test= ed it.  Thank you so much!

Until it lands,= another workaround is to use the new, cheaper, faster, simpler iflib tr= ansmit routine by setting the tunable

dev.$NIC.= $UNIT.iflib.simple_tx=3D1

Eg, dev.bnxt.0.i= flib.simple_tx=3D1

In loader.conf
I plan to deprecate the current complex transmit routine (mp= _ring) in favor of the simple mechanism, and I confess that I sometimes = don't test "straightforward" changes like this on mp_ring.  I'll tr= y to get better about that.

Drew

=
On Sat, Apr 18, 2026, at 3:12 PM, Michael Tuexen wrote:
=
> On 18. Apr 2026= , at 21:09, Drew Gallatin <ga= llatin@freebsd.org> wrote:
> 
> So= rry, looking into this now.  I did not test this change with the mp= _ring path.. i don't see how fixing the counters could cause this panic.=    Looking at it now..
Hi Drew,

=

Best = regards
Michael
> 
> Drew
=
> 
> On Sat, Apr 18, 2026, at 1:38 PM, Michael= Tuexen wrote:
>> 
>> 
>> > On 18. Apr 2026, at 19:14, David Wolfskill <david@catwhisker.org> wrote:
<= div>>> > 
>> > On Sat, Apr 18, 2026 at = 03:53:33PM +0200, Michael Tuexen wrote:
>> >> ...<= /div>
>> >>> So... one of the machines on which I tra= ck head got this, as well -- my
>> >>> (mostly-= )headless build machine.  (2 laptops, updated in sync with the
>> >>> build machine, did not panic.  One of t= hose also uses a wired NIC.)
>> >> Do the network = drivers of the machines not being affected use iflib?
>>= > 
>> > Apparently not -- they are em(4), iw= m(4), & iwn(4), while the panicking
>> > machine = uses igb(4).
>> > 
>> >> I= do see the problem also on one of my machines and local testing shows t= hat
>> >= > is the problem. At least reverting it locally resolves the problem.=
>> >> Can you confirm this?
>> &g= t; 
>> > I can, and do:  after reverting ma= in-n285140-3fade68cfdf9 & rebuilding,
>> > I am a= ble to ssh in without issue; the machine reports:
>> >= ; 
>> > freebeast(16.0-C)[2] uname -aUK
>> > FreeBSD freebeast.catwhisker.org 16.0-CURRENT FreeBSD 16.0-CURRENT #549 mai= n-n285180-23a84efeb191: Sat Apr 18 17:01:25 UTC 2026   &n= bsp; root@freebeas= t.catwhisker.org:/common/S3/obj/usr/src/amd64.amd64/sys/GENERIC amd6= 4 1600015 1600015
>> > 
>> > = Thanks!
>> You could also disable TSO. I will put up a r= eview for a fix soon.
>> 
>> Best r= egards
>> Michael
>> > 
>> > Peace,
>> > david
>> = > -- 
>> > David H. Wolfskill  &nbs= p;           &nbs= p;           &nbs= p;   david@catwhi= sker.org
>> > 
>> > See&n= bsp;https://= www.catwhisker.org/~david/publickey.gpg for my public key.
>> 
>> 
>> 
<= div>> 



=
--754d0919e6487d801aec91f7696bfe04c053baca-- From nobody Sat Apr 18 19:51:58 2026 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fyj836Vvfz6WwXp; Sat, 18 Apr 2026 19:52:19 +0000 (UTC) (envelope-from gallatin@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R12" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4fyj835bZsz3GBd; Sat, 18 Apr 2026 19:52:19 +0000 (UTC) (envelope-from gallatin@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776541939; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=30FbqVMqZySiPmvpccqgo7Z8VF5YqbyyLOF61TqgX5g=; b=KRIZaFwe51XwYhUR4dlX+0Kq4SV9M+aWmTNWQsv1egOjPvqBmkGRei2lPsSSZ3b2PSD6aK lmXjcunwAVJDVmo1yAFiQZEmkCERLNn2vi5XmPpKEQQIyqwwlYIF96/eulTd25DDH6hkrx zC5K9aOiN2YlAfGHslBSoFSB4xYTUcYDBBVvTWJ8sOvlw3Z2dXhk40/frDub6ldIn56Td1 D5rw5OR1i9poix2srEg2ncdyCDZalr8cQj1VYoPYALKDD1Lxw21bFXGYPdDyZTaeVx6SSF 6Ij1QtWdf0gJXT604RGL0hI2ZTOU0CEL0mASaG48QrANlY6wZaWv6ZkhqyP57Q== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1776541939; a=rsa-sha256; cv=none; b=HTiKN7M3MYXD5qIRVFsC+m4+JYacddiMkKI/514LV6lEgWhZhPP3JcYAVNOY4wjYZCdCT5 WrsVl1TdDBOwrfm+xIMVJVWvPaLO7GRlf9PUvVyZPuein8nOSd4Nca/7OgSWBd7pm+Ii9g v11eXVfTkP9XQoVn4AeJDFMEbPNXZoulOYiClUOK0vDw8y3W+n3Yt3jtNgy+pZ6xLTaqkQ I7m0wfB1ECNZCmPvFitCF0vevnJ5YOjQnyQL8LxceHQKRDNTTAyVaXYvd0ckJc07k+ku90 /puMhWHbrT1XJ1LM0Zuh5HfgOY/TEX4IJJGWTP580ZBjD8qxH1NJcERBUstA8A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776541939; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=30FbqVMqZySiPmvpccqgo7Z8VF5YqbyyLOF61TqgX5g=; b=NJ7aWS+UbGybEYhqb+8z6g8nhVHoxKTsLIzQI0/FcQ4cEC3hNRj22McQ3Meqs6rHe/4TBE zwaWWqfb3SdbT/Y3uSywaZR1TYVIZHy+9R29JWv8WE5yat1Hizj9pRjiWus1+0l063cAae 18Vc0RBAA4OpD/6WWmag2A5sYsd2S1KvKF07FvK2BWBZHHCWntDk4Tjlx+8x7xqLKuI7m+ cNmiEAcy5bsqldDdDIJ6orQST/XfkPjQyURYLv36NoV3IeW/zbRUmLCcLSFrnm8hX3M1ke VW92G1a4hyVC/d0t3r+TtlTls6oQlXa7tDvMAz/5Q9yQ0nMeUCpFemVbC8YBGg== Received: from fauth-a1-smtp.messagingengine.com (fauth-a1-smtp.messagingengine.com [103.168.172.200]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: gallatin) by smtp.freebsd.org (Postfix) with ESMTPSA id 4fyj834wdrzHg7; Sat, 18 Apr 2026 19:52:19 +0000 (UTC) (envelope-from gallatin@freebsd.org) Received: from phl-compute-05.internal (phl-compute-05.internal [10.202.2.45]) by mailfauth.phl.internal (Postfix) with ESMTP id 8B3F0F40068; Sat, 18 Apr 2026 15:52:19 -0400 (EDT) Received: from phl-imap-02 ([10.202.2.81]) by phl-compute-05.internal (MEProxy); Sat, 18 Apr 2026 15:52:19 -0400 X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeefhedrtddtgdehfeeihecutefuodetggdotefrod ftvfcurfhrohhfihhlvgemucfhrghsthforghilhdpuffrtefokffrpgfnqfghnecuuegr ihhlohhuthemuceftddtnecusecvtfgvtghiphhivghnthhsucdlqddutddtmdenucfjug hrpefoggffhffvvefkjghfufgtsegrtderreertddtnecuhfhrohhmpedfffhrvgifucfi rghllhgrthhinhdfuceoghgrlhhlrghtihhnsehfrhgvvggsshgurdhorhhgqeenucggtf frrghtthgvrhhnpeehjedvgedttdejtdegjeeiieekudeutdefgeekudekgfevtdefhfel fffggeelhfenucffohhmrghinhepfhhrvggvsghsugdrohhrghdptggrthifhhhishhkvg hrrdhorhhgnecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhho mhepghgrlhhlrghtihhnodhmvghsmhhtphgruhhthhhpvghrshhonhgrlhhithihqddufe efheelvddvudeiqddvleehtdegudekgedqghgrlhhlrghtihhnpeepfhhrvggvsghsugdr ohhrghesfhgrshhtmhgrihhlrdgtohhmpdhnsggprhgtphhtthhopeegpdhmohguvgepsh hmthhpohhuthdprhgtphhtthhopegtuhhrrhgvnhhtsehfrhgvvggsshgurdhorhhgpdhr tghpthhtohepfhhrvggvsghsugdqtghurhhrvghnthesfhhrvggvsghsugdrohhrghdprh gtphhtthhopehtuhgvgigvnhesfhhrvggvsghsugdrohhrghdprhgtphhtthhopehrsghr rghntghosehsuhhsvgdruggv X-ME-Proxy: Feedback-ID: i41414658:Fastmail Received: by mailuser.phl.internal (Postfix, from userid 501) id 2A634700069; Sat, 18 Apr 2026 15:52:19 -0400 (EDT) X-Mailer: MessagingEngine.com Webmail Interface List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 X-ThreadId: APgOGAU08yF- Date: Sat, 18 Apr 2026 15:51:58 -0400 From: "Drew Gallatin" To: tuexen Cc: current@freebsd.org, "Ricardo Branco" , freebsd-current@freebsd.org Message-Id: In-Reply-To: References: <9d640ae4-7133-4d4f-917f-d715ab71ee7b@suse.de> <3b60c3e6-f53f-4084-a435-fe5371c56e58@app.fastmail.com> Subject: Re: panic: assertion failed in iflib_txq_drain() Content-Type: multipart/alternative; boundary=754d0919e6487d801aec91f7696bfe04c053baca --754d0919e6487d801aec91f7696bfe04c053baca Content-Type: text/plain Content-Transfer-Encoding: 7bit That is indeed the proper fix. I just reviewed & tested it. Thank you so much! Until it lands, another workaround is to use the new, cheaper, faster, simpler iflib transmit routine by setting the tunable dev.$NIC.$UNIT.iflib.simple_tx=1 Eg, dev.bnxt.0.iflib.simple_tx=1 In loader.conf I plan to deprecate the current complex transmit routine (mp_ring) in favor of the simple mechanism, and I confess that I sometimes don't test "straightforward" changes like this on mp_ring. I'll try to get better about that. Drew On Sat, Apr 18, 2026, at 3:12 PM, Michael Tuexen wrote: > > On 18. Apr 2026, at 21:09, Drew Gallatin wrote: > > > > Sorry, looking into this now. I did not test this change with the mp_ring path.. i don't see how fixing the counters could cause this panic. Looking at it now.. > Hi Drew, > > I think https://reviews.freebsd.org/D56509 fixes it. > > Best regards > Michael > > > > Drew > > > > On Sat, Apr 18, 2026, at 1:38 PM, Michael Tuexen wrote: > >> > >> > >> > On 18. Apr 2026, at 19:14, David Wolfskill wrote: > >> > > >> > On Sat, Apr 18, 2026 at 03:53:33PM +0200, Michael Tuexen wrote: > >> >> ... > >> >>> So... one of the machines on which I track head got this, as well -- my > >> >>> (mostly-)headless build machine. (2 laptops, updated in sync with the > >> >>> build machine, did not panic. One of those also uses a wired NIC.) > >> >> Do the network drivers of the machines not being affected use iflib? > >> > > >> > Apparently not -- they are em(4), iwm(4), & iwn(4), while the panicking > >> > machine uses igb(4). > >> > > >> >> I do see the problem also on one of my machines and local testing shows that > >> >> https://cgit.FreeBSD.org/src/commit/?id=3fade68cfdf95ee0b517b5d69b270bd8da633404 > >> >> is the problem. At least reverting it locally resolves the problem. > >> >> Can you confirm this? > >> > > >> > I can, and do: after reverting main-n285140-3fade68cfdf9 & rebuilding, > >> > I am able to ssh in without issue; the machine reports: > >> > > >> > freebeast(16.0-C)[2] uname -aUK > >> > FreeBSD freebeast.catwhisker.org 16.0-CURRENT FreeBSD 16.0-CURRENT #549 main-n285180-23a84efeb191: Sat Apr 18 17:01:25 UTC 2026 root@freebeast.catwhisker.org:/common/S3/obj/usr/src/amd64.amd64/sys/GENERIC amd64 1600015 1600015 > >> > > >> > Thanks! > >> You could also disable TSO. I will put up a review for a fix soon. > >> > >> Best regards > >> Michael > >> > > >> > Peace, > >> > david > >> > -- > >> > David H. Wolfskill david@catwhisker.org > >> > > >> > See https://www.catwhisker.org/~david/publickey.gpg for my public key. > >> > >> > >> > > > > --754d0919e6487d801aec91f7696bfe04c053baca Content-Type: text/html Content-Transfer-Encoding: quoted-printable

That is indeed the proper fix.   I just reviewed & test= ed it.  Thank you so much!

Until it lands,= another workaround is to use the new, cheaper, faster, simpler iflib tr= ansmit routine by setting the tunable

dev.$NIC.= $UNIT.iflib.simple_tx=3D1

Eg, dev.bnxt.0.i= flib.simple_tx=3D1

In loader.conf
I plan to deprecate the current complex transmit routine (mp= _ring) in favor of the simple mechanism, and I confess that I sometimes = don't test "straightforward" changes like this on mp_ring.  I'll tr= y to get better about that.

Drew

=
On Sat, Apr 18, 2026, at 3:12 PM, Michael Tuexen wrote:
=
> On 18. Apr 2026= , at 21:09, Drew Gallatin <ga= llatin@freebsd.org> wrote:
> 
> So= rry, looking into this now.  I did not test this change with the mp= _ring path.. i don't see how fixing the counters could cause this panic.=    Looking at it now..
Hi Drew,

=

Best = regards
Michael
> 
> Drew
=
> 
> On Sat, Apr 18, 2026, at 1:38 PM, Michael= Tuexen wrote:
>> 
>> 
>> > On 18. Apr 2026, at 19:14, David Wolfskill <david@catwhisker.org> wrote:
<= div>>> > 
>> > On Sat, Apr 18, 2026 at = 03:53:33PM +0200, Michael Tuexen wrote:
>> >> ...<= /div>
>> >>> So... one of the machines on which I tra= ck head got this, as well -- my
>> >>> (mostly-= )headless build machine.  (2 laptops, updated in sync with the
>> >>> build machine, did not panic.  One of t= hose also uses a wired NIC.)
>> >> Do the network = drivers of the machines not being affected use iflib?
>>= > 
>> > Apparently not -- they are em(4), iw= m(4), & iwn(4), while the panicking
>> > machine = uses igb(4).
>> > 
>> >> I= do see the problem also on one of my machines and local testing shows t= hat
>> >= > is the problem. At least reverting it locally resolves the problem.=
>> >> Can you confirm this?
>> &g= t; 
>> > I can, and do:  after reverting ma= in-n285140-3fade68cfdf9 & rebuilding,
>> > I am a= ble to ssh in without issue; the machine reports:
>> >= ; 
>> > freebeast(16.0-C)[2] uname -aUK
>> > FreeBSD freebeast.catwhisker.org 16.0-CURRENT FreeBSD 16.0-CURRENT #549 mai= n-n285180-23a84efeb191: Sat Apr 18 17:01:25 UTC 2026   &n= bsp; root@freebeas= t.catwhisker.org:/common/S3/obj/usr/src/amd64.amd64/sys/GENERIC amd6= 4 1600015 1600015
>> > 
>> > = Thanks!
>> You could also disable TSO. I will put up a r= eview for a fix soon.
>> 
>> Best r= egards
>> Michael
>> > 
>> > Peace,
>> > david
>> = > -- 
>> > David H. Wolfskill  &nbs= p;           &nbs= p;           &nbs= p;   david@catwhi= sker.org
>> > 
>> > See&n= bsp;https://= www.catwhisker.org/~david/publickey.gpg for my public key.
>> 
>> 
>> 
<= div>> 



=
--754d0919e6487d801aec91f7696bfe04c053baca-- From nobody Sat Apr 18 20:06:17 2026 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fyjSD2QGGz6ZBbk; Sat, 18 Apr 2026 20:06:20 +0000 (UTC) (envelope-from tuexen@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R12" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4fyjSD1fdNz3KLX; Sat, 18 Apr 2026 20:06:20 +0000 (UTC) (envelope-from tuexen@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776542780; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=sG90c32W4vnIW2Jit9KvcUOAawZmByROHUdjW7zZraE=; b=rR2hEbcxaRkmQBa1UyJ2IYCFFbe898wdZa4ncpw604/DHSRZFOo7ND2egJBPW3tbUBTH5z 6uOK5T5/sbkXMsBzw/sS3mgiRCEK5o3TDJvJZMXa1Jo5TdP9+l/4/geBA5B9EUXliVqa7Z 0SS+w17efHtd9k67I5Xhf4tsXk9WGDSQU0gxcA+f0ILwG0zWsYF26hOnO6SuXTBxlIZeDk ocWwyP0K1tZiZxqr0oAeIBfna4QMsUhGwdGa83F9rii4K9+wsgCNKWYIWqIpHI2EwbWrkt wzha5Unoqjvx+9JUPguPZQJQraXBPW6Dz3FRGPZjOASEijSqiPEJWzrO5h0o8w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1776542780; a=rsa-sha256; cv=none; b=A7WNAhJb6Bha8B0Ek7ugPmyyB7eOUMFZXqW8S4dmmMGL/NwW/CXt/UXplftmB7qOwCj0Y4 TQs0WGhyXeA8UEuehFBv6e5yK/N0/ID+E5ECFdO0RBzw7Q462bcEDqkARp/4Z7NPnUxexp IazTEIvYEGJAYyKPJZRK+KC9uwkU2hjpQeUrYKh9XmP5ogNlVjRHe6GFxtWAii9gnewXbS f52YwOVJWvgK8XTpRkKEWQjkGTGDnew9JRztzTvzJnbbBVDbhrdgyTzwFru9Wbh4/ovHAI J0rIVwSnFX3YHPARWBAgTZQqzprsSIbgDGm3IXbFDC/OciSBqeW1etVkarKN9g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776542780; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=sG90c32W4vnIW2Jit9KvcUOAawZmByROHUdjW7zZraE=; b=BgRyyVoT/MBg+/tj5E6mn/lqu3mrV/ote50T+3//prlDQSRRTUsR24A7TzygZAXNoxYp6a Z06I8udo77o7gPzY8L1zr3FXAej78hj/nY/dxCazrQjEz8OxIfLkQdnbgFdz1p6Yhc7ggK gIOe0apDd8roB7tMt5VnSvEVHLmxX4Fk9WURNIcV6ZsnDPSS5wsLdhrlW3cVXVu19DDMhA vMSRaoDdFjWZ2v3yKtg0cIZe6NYcgtsw9RMe1lygWRXdWFAQqQQFhacABS/xR6Ld0rEcMt I9MgKeuXyk8SQ2b9cwA89xneeHL387V5+AdqTxyylK4SuLPMZsxaTKCo+sNu+Q== Received: from smtpclient.apple (unknown [IPv6:2a02:8109:1101:be00:d835:7117:6c6b:190a]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: tuexen) by smtp.freebsd.org (Postfix) with ESMTPSA id 4fyjSC4L1ZzKXx; Sat, 18 Apr 2026 20:06:19 +0000 (UTC) (envelope-from tuexen@FreeBSD.org) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3864.500.181\)) Subject: Re: panic: assertion failed in iflib_txq_drain() From: Michael Tuexen In-Reply-To: Date: Sat, 18 Apr 2026 22:06:17 +0200 Cc: current@freebsd.org, Ricardo Branco , freebsd-current@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <9d640ae4-7133-4d4f-917f-d715ab71ee7b@suse.de> <3b60c3e6-f53f-4084-a435-fe5371c56e58@app.fastmail.com> To: Drew Gallatin X-Mailer: Apple Mail (2.3864.500.181) > On 18. Apr 2026, at 21:51, Drew Gallatin wrote: >=20 >=20 > That is indeed the proper fix. I just reviewed & tested it. Thank = you so much! Thanks for the quick review. The fix is committed in: = https://cgit.FreeBSD.org/src/commit/?id=3Dcca22c36c306dfabe13b1d1de10e8d27= ef3c3bce = Best regards Michael >=20 > Until it lands, another workaround is to use the new, cheaper, faster, = simpler iflib transmit routine by setting the tunable >=20 > dev.$NIC.$UNIT.iflib.simple_tx=3D1 >=20 > Eg, dev.bnxt.0.iflib.simple_tx=3D1 >=20 > In loader.conf >=20 > I plan to deprecate the current complex transmit routine (mp_ring) in = favor of the simple mechanism, and I confess that I sometimes don't test = "straightforward" changes like this on mp_ring. I'll try to get better = about that. >=20 > Drew >=20 > On Sat, Apr 18, 2026, at 3:12 PM, Michael Tuexen wrote: >>=20 >>=20 >> > On 18. Apr 2026, at 21:09, Drew Gallatin = wrote: >> >=20 >> > Sorry, looking into this now. I did not test this change with the = mp_ring path.. i don't see how fixing the counters could cause this = panic. Looking at it now.. >> Hi Drew, >>=20 >> I think https://reviews.freebsd.org/D56509 fixes it. >>=20 >> Best regards >> Michael >> >=20 >> > Drew >> >=20 >> > On Sat, Apr 18, 2026, at 1:38 PM, Michael Tuexen wrote: >> >>=20 >> >>=20 >> >> > On 18. Apr 2026, at 19:14, David Wolfskill = wrote: >> >> >=20 >> >> > On Sat, Apr 18, 2026 at 03:53:33PM +0200, Michael Tuexen wrote: >> >> >> ... >> >> >>> So... one of the machines on which I track head got this, as = well -- my >> >> >>> (mostly-)headless build machine. (2 laptops, updated in sync = with the >> >> >>> build machine, did not panic. One of those also uses a wired = NIC.) >> >> >> Do the network drivers of the machines not being affected use = iflib? >> >> >=20 >> >> > Apparently not -- they are em(4), iwm(4), & iwn(4), while the = panicking >> >> > machine uses igb(4). >> >> >=20 >> >> >> I do see the problem also on one of my machines and local = testing shows that >> >> >> = https://cgit.FreeBSD.org/src/commit/?id=3D3fade68cfdf95ee0b517b5d69b270bd8= da633404 = >> >> >> is the problem. At least reverting it locally resolves the = problem. >> >> >> Can you confirm this? >> >> >=20 >> >> > I can, and do: after reverting main-n285140-3fade68cfdf9 & = rebuilding, >> >> > I am able to ssh in without issue; the machine reports: >> >> >=20 >> >> > freebeast(16.0-C)[2] uname -aUK >> >> > FreeBSD freebeast.catwhisker.org 16.0-CURRENT FreeBSD = 16.0-CURRENT #549 main-n285180-23a84efeb191: Sat Apr 18 17:01:25 UTC = 2026 = root@freebeast.catwhisker.org:/common/S3/obj/usr/src/amd64.amd64/sys/GENER= IC amd64 1600015 1600015 >> >> >=20 >> >> > Thanks! >> >> You could also disable TSO. I will put up a review for a fix soon. >> >>=20 >> >> Best regards >> >> Michael >> >> >=20 >> >> > Peace, >> >> > david >> >> > --=20 >> >> > David H. Wolfskill = david@catwhisker.org >> >> >=20 >> >> > See https://www.catwhisker.org/~david/publickey.gpg for my = public key. >> >>=20 >> >>=20 >> >>=20 >> >=20 >>=20 >>=20 >=20 From nobody Sat Apr 18 20:06:17 2026 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fyjSD2QGGz6ZBbk; Sat, 18 Apr 2026 20:06:20 +0000 (UTC) (envelope-from tuexen@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R12" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4fyjSD1fdNz3KLX; Sat, 18 Apr 2026 20:06:20 +0000 (UTC) (envelope-from tuexen@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776542780; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=sG90c32W4vnIW2Jit9KvcUOAawZmByROHUdjW7zZraE=; b=rR2hEbcxaRkmQBa1UyJ2IYCFFbe898wdZa4ncpw604/DHSRZFOo7ND2egJBPW3tbUBTH5z 6uOK5T5/sbkXMsBzw/sS3mgiRCEK5o3TDJvJZMXa1Jo5TdP9+l/4/geBA5B9EUXliVqa7Z 0SS+w17efHtd9k67I5Xhf4tsXk9WGDSQU0gxcA+f0ILwG0zWsYF26hOnO6SuXTBxlIZeDk ocWwyP0K1tZiZxqr0oAeIBfna4QMsUhGwdGa83F9rii4K9+wsgCNKWYIWqIpHI2EwbWrkt wzha5Unoqjvx+9JUPguPZQJQraXBPW6Dz3FRGPZjOASEijSqiPEJWzrO5h0o8w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1776542780; a=rsa-sha256; cv=none; b=A7WNAhJb6Bha8B0Ek7ugPmyyB7eOUMFZXqW8S4dmmMGL/NwW/CXt/UXplftmB7qOwCj0Y4 TQs0WGhyXeA8UEuehFBv6e5yK/N0/ID+E5ECFdO0RBzw7Q462bcEDqkARp/4Z7NPnUxexp IazTEIvYEGJAYyKPJZRK+KC9uwkU2hjpQeUrYKh9XmP5ogNlVjRHe6GFxtWAii9gnewXbS f52YwOVJWvgK8XTpRkKEWQjkGTGDnew9JRztzTvzJnbbBVDbhrdgyTzwFru9Wbh4/ovHAI J0rIVwSnFX3YHPARWBAgTZQqzprsSIbgDGm3IXbFDC/OciSBqeW1etVkarKN9g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776542780; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=sG90c32W4vnIW2Jit9KvcUOAawZmByROHUdjW7zZraE=; b=BgRyyVoT/MBg+/tj5E6mn/lqu3mrV/ote50T+3//prlDQSRRTUsR24A7TzygZAXNoxYp6a Z06I8udo77o7gPzY8L1zr3FXAej78hj/nY/dxCazrQjEz8OxIfLkQdnbgFdz1p6Yhc7ggK gIOe0apDd8roB7tMt5VnSvEVHLmxX4Fk9WURNIcV6ZsnDPSS5wsLdhrlW3cVXVu19DDMhA vMSRaoDdFjWZ2v3yKtg0cIZe6NYcgtsw9RMe1lygWRXdWFAQqQQFhacABS/xR6Ld0rEcMt I9MgKeuXyk8SQ2b9cwA89xneeHL387V5+AdqTxyylK4SuLPMZsxaTKCo+sNu+Q== Received: from smtpclient.apple (unknown [IPv6:2a02:8109:1101:be00:d835:7117:6c6b:190a]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: tuexen) by smtp.freebsd.org (Postfix) with ESMTPSA id 4fyjSC4L1ZzKXx; Sat, 18 Apr 2026 20:06:19 +0000 (UTC) (envelope-from tuexen@FreeBSD.org) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3864.500.181\)) Subject: Re: panic: assertion failed in iflib_txq_drain() From: Michael Tuexen In-Reply-To: Date: Sat, 18 Apr 2026 22:06:17 +0200 Cc: current@freebsd.org, Ricardo Branco , freebsd-current@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <9d640ae4-7133-4d4f-917f-d715ab71ee7b@suse.de> <3b60c3e6-f53f-4084-a435-fe5371c56e58@app.fastmail.com> To: Drew Gallatin X-Mailer: Apple Mail (2.3864.500.181) > On 18. Apr 2026, at 21:51, Drew Gallatin wrote: >=20 >=20 > That is indeed the proper fix. I just reviewed & tested it. Thank = you so much! Thanks for the quick review. The fix is committed in: = https://cgit.FreeBSD.org/src/commit/?id=3Dcca22c36c306dfabe13b1d1de10e8d27= ef3c3bce = Best regards Michael >=20 > Until it lands, another workaround is to use the new, cheaper, faster, = simpler iflib transmit routine by setting the tunable >=20 > dev.$NIC.$UNIT.iflib.simple_tx=3D1 >=20 > Eg, dev.bnxt.0.iflib.simple_tx=3D1 >=20 > In loader.conf >=20 > I plan to deprecate the current complex transmit routine (mp_ring) in = favor of the simple mechanism, and I confess that I sometimes don't test = "straightforward" changes like this on mp_ring. I'll try to get better = about that. >=20 > Drew >=20 > On Sat, Apr 18, 2026, at 3:12 PM, Michael Tuexen wrote: >>=20 >>=20 >> > On 18. Apr 2026, at 21:09, Drew Gallatin = wrote: >> >=20 >> > Sorry, looking into this now. I did not test this change with the = mp_ring path.. i don't see how fixing the counters could cause this = panic. Looking at it now.. >> Hi Drew, >>=20 >> I think https://reviews.freebsd.org/D56509 fixes it. >>=20 >> Best regards >> Michael >> >=20 >> > Drew >> >=20 >> > On Sat, Apr 18, 2026, at 1:38 PM, Michael Tuexen wrote: >> >>=20 >> >>=20 >> >> > On 18. Apr 2026, at 19:14, David Wolfskill = wrote: >> >> >=20 >> >> > On Sat, Apr 18, 2026 at 03:53:33PM +0200, Michael Tuexen wrote: >> >> >> ... >> >> >>> So... one of the machines on which I track head got this, as = well -- my >> >> >>> (mostly-)headless build machine. (2 laptops, updated in sync = with the >> >> >>> build machine, did not panic. One of those also uses a wired = NIC.) >> >> >> Do the network drivers of the machines not being affected use = iflib? >> >> >=20 >> >> > Apparently not -- they are em(4), iwm(4), & iwn(4), while the = panicking >> >> > machine uses igb(4). >> >> >=20 >> >> >> I do see the problem also on one of my machines and local = testing shows that >> >> >> = https://cgit.FreeBSD.org/src/commit/?id=3D3fade68cfdf95ee0b517b5d69b270bd8= da633404 = >> >> >> is the problem. At least reverting it locally resolves the = problem. >> >> >> Can you confirm this? >> >> >=20 >> >> > I can, and do: after reverting main-n285140-3fade68cfdf9 & = rebuilding, >> >> > I am able to ssh in without issue; the machine reports: >> >> >=20 >> >> > freebeast(16.0-C)[2] uname -aUK >> >> > FreeBSD freebeast.catwhisker.org 16.0-CURRENT FreeBSD = 16.0-CURRENT #549 main-n285180-23a84efeb191: Sat Apr 18 17:01:25 UTC = 2026 = root@freebeast.catwhisker.org:/common/S3/obj/usr/src/amd64.amd64/sys/GENER= IC amd64 1600015 1600015 >> >> >=20 >> >> > Thanks! >> >> You could also disable TSO. I will put up a review for a fix soon. >> >>=20 >> >> Best regards >> >> Michael >> >> >=20 >> >> > Peace, >> >> > david >> >> > --=20 >> >> > David H. Wolfskill = david@catwhisker.org >> >> >=20 >> >> > See https://www.catwhisker.org/~david/publickey.gpg for my = public key. >> >>=20 >> >>=20 >> >>=20 >> >=20 >>=20 >>=20 >=20 From nobody Sun Apr 19 15:03:56 2026 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fzBj34MlMz675JW for ; Sun, 19 Apr 2026 15:04:07 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic310-21.consmr.mail.gq1.yahoo.com (sonic310-21.consmr.mail.gq1.yahoo.com [98.137.69.147]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4fzBj274FFz42PY for ; Sun, 19 Apr 2026 15:04:06 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b="XP/dRJjs"; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.69.147 as permitted sender) smtp.mailfrom=marklmi@yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1776611039; bh=RdFW7xsnQRVAjNSuJqx5W+37/KY1Vf+gFdbcFDkTsgE=; h=Date:To:From:Subject:References:From:Subject:Reply-To; b=XP/dRJjsUTY7EIBBLYF4xW4agHiJkCgqFQ3vfg9xqNYjiqOysA3FGxJ18CmGK1aHEoPc2SU4jW4pxrAzzsb2/tRpc6caLHVZNhApjwkRlTLR2fjFm2VYksceLw2aJCfsCerwMYZw5WHUdMQSTdFylXPsy8XHZBmmN3ge35dvKk/O/CNtj4WMzR8eYJbKtppcnABZ5n1i1G7dZ+VRmJDG8rsjfAr5EUMBvNHhuuXnQA3YCVLQqNmMiirShZkVbVyExQwzBhoFUII1vfV1kzH9ha/OLHwZl/SND8o4qmizP/Tn/+9E6U6mLSXyhMmQb7WVABOhFEE2B4rQHsQSAEaSNg== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1776611039; bh=7zNsUHcpb1baQ/vyveiVnvu45rq+SlYnJV/TcZNLmZb=; h=X-Sonic-MF:Date:To:From:Subject:From:Subject; b=PqQjwxK1FO3gawH92aWs+/alO3fVKWCCv3op7+bcoITr7Mjp6gdBK50RqTB8n/0gPFhflub1q2GV8PbzcF0Q82sCq1JInLUrMnnojqmhBdNIveXqMATWWsEmdhQASacXTEtlQPSo5lNe78j+FIldCe6QqRAI95isrNtjqA851WXBOW0tdV4u8hDVpXct7sk5dD0dwMFJ8OIOL7ihmTHGj3SGkttbgV5yMcLIRC/JNJ/W6lx4FX41eT1BzxGGUuMqr5jON8M4ZJtaFA4kubSlsRkKguWeJtW1pfT2FEA0xjyhxwn0l/EMgYqCMHx8AIWtvPT30XFBk7ygiiUwAEq8ig== X-YMail-OSG: 8ZOeiNgVM1kubLq13B1PkwCPtzyuclyUg3VjHs.GVhZowh6iNOiB03Yo8N2et8q WOBMmtCF_cI2.ekL5w49YqUCtBm61ANRdKEpMJVkwVjpQAbjIXQGsNlwGACanGF.I4Joh3z9sZjj 69gxwifwkjP91LPSwMGVQvb.CZCnbalN3_RIe_zlpkWunhV3PjLSQuKIXGa7zFsObsbtI716dJnG 4EvZscuE0jp9bjWvJz7FgYNYXyzT8yX68hzSu8MOB7sbKhReCd7Pd2hOW6zMIipPHzt6dWlWeytf f6fb9Q.LYzQEvMmS6oluf6JyndAaFRoXLTmZ8EU0RGavOQkUshkl3qdBaZO3Wq8DUeorGckmDRiq 8BhAFdVoq9zrxAXgwTvgESmEM2P2lqtFc3N3ZPZ.B3E4dSWXOUVw2OvCcM.BFyHL1dw0InxBiccP zVs4NEEeaED8shhsa0JS2iWuE2B9lw7uwJY6K9byJg0RIdAgYPcv12nC2ROyvK4_PE4Oh.b9qLP4 Mr4X5dih8ML1DvBjt7QNxbsQAo2cm3uy7mNOlB85UYufSUaglgojWUJNyULRW78Agm1hee8VDUxU P78LmDXCTLjHj_GhsEP21hSyXeiSIWV3ARnmjY5jef975k907UbIjJ1FhyrN4vDPwW.NtdGvUXHp ldVHZitHvPJ2iY5Y4qixLIz225e_OyOB52B31zL55RoCyLHJp0uxqpe47rDRF3dlMd30YRZS7KfG ZO5BWjy.xYogL__Klkq5MjaGt8KTf1ljZzTDRuyCrlZ3j97pqtPXeBM0yFo34GJBC81.NEcjgOYA ZMl26GHgtsDoUibMdK1hE._l0CgjwQIHToM3rW08lTHQp_TCtW_ge42kRQtxUpt1Ubq00YLHWtXV qlacTj.FbDraPOd4b_TQkKjFe2qGgtpTq9lJL68PcEAjayDNmDIoYUsCXVFDNXZJLVzTuarstV.p hST9qaW2jSUx8Tk3RhqlvCmvOy._H5HxgsrGHBPVu91.T0w7Y0itQkg7usxDRUCYzwdp1_XrmAgQ gxbY6Z9TbM1gdQx9D_A0H.5bAjS50NaE0JzwSSm9fH1UEAHfh3psTaahNy_QP2sxyUa0poUiMSn0 s1by.fdA_RKkMrnszdfuZsKLpmhHQ74LH4rAA4Ms4mdkHbbCl35c5IpNOnWZJfTkiIntrvv5S5Dm FR7zVZWnoqvkcDdVzAwzi_r_Ef7xXpME3WTKivtmr0BDr8hgzX7l4ZxG6JmMNtY3oyV9wR81G3C0 SXHk5QjU28Zoq_zWNvQLpz.dxB6n2oDPG04v0BUap2kBFztvMHc7LQUw4dUIm7FdjYUZJNrFA0yv gV7l0SUAB50IDZRzSbwCysKQ47IoQWYzikRjNVqZVoburjLM.CW9QYHmEEAN05nfOZOfpk8f84yj viFPflZxm6sDekYYrm1JWFO4JcvOimCSt4ema_vdP.a4dXvnI4Sz2aEs98RLKKyo0T.d4D.oNMSV jnMPifOswAJF7twQFDyjrpQQxe9vPn93uURMOE8XnZxx2zirDN1Yqoe4.vIWgqTLsAJ.oD1qb5e3 uy3v8r8YJcmkV7RX2mhVWXIVMR97wY5Ih_ghOqxBruPpdSzqEdT.4MZbfHE5SRWb4D687AnKsC7k VS2uJwNiukN1N3nt.d4ykzLPZjkhEmAc77973mxw7ySFNWA6X79IXkUreeAPm_0QBC2vWQwsFSTv Lx6UI73dL8V6O_fzP.3phVZqp98I6U4pPTsn52wPNQysKvVoW.ri0s5m6aBp1dRhY9N9MxS5zRwD 70Ku26xXOeqgQJSy_umWc0Joz0iydyJ3NJimiY5q9Tw6u8jJqrBAAbbl7QNMjjoWOq3r_zx8Uyn0 y7E32B_S8x8YB68H82cQ6tBQism0gtncK6szRlW3mq_iWrBxPs.Kggvx58NBI54ovliVuSOlmH3G rF5wSvrFY8JgKiYeceRsIixbOECNRffMS1MPb.FUcZcS0FRMrlKXkJARgjSxPalCnlhXws5OaWYT aBmmPNWQu_buV3nsJF_iGS4RIrS0FDEmQfSUc_ODQPTJU7MEO0UGomzj.mQof_l.e_NPlAnIy52q WaioBZ5_iViP6FT.CqU5IqpINLAoSbc7kqgrCUY2D3EO1QppMSU7jOBKeaG2nSTr_ZK85WXShFIw E7Ja1bXdHgDPkus7h8BVTSxopx4ahybRu2oFKbRvBh4.KXNO5V8oEviAvekSP1yKxSEwjc1NIlSk fiR2wC.IVmoDvj9cQKAogtDI9BthuCNiXICZW1hhWk5RKLWoEinB0yu2O99h4cjboBXOtZFzMtC_ vtziYhyyJChOs7PGm3p7unQtbdO2J7OM5odQHByxYL4EzmJM- X-Sonic-MF: X-Sonic-ID: 33be6ed0-e97c-4e22-9731-054092ae3e54 Received: from sonic.gate.mail.ne1.yahoo.com by sonic310.consmr.mail.gq1.yahoo.com with HTTP; Sun, 19 Apr 2026 15:03:59 +0000 Received: by hermes--production-gq1-6dfcf9f8b-82g65 (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 45ee9871cfc28efeff1566a3ed810fa8; Sun, 19 Apr 2026 15:03:56 +0000 (UTC) Message-ID: Date: Sun, 19 Apr 2026 08:03:56 -0700 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Content-Language: en-US To: "freebsd-stable@FreeBSD.org" , freebsd-current From: Mark Millard Subject: 14.3-RELEASE gpart show output (?.?T) vs. 14.4 and 15.0 and main: why do 14.4 and 15.0 and main have some single significant digit (?T) size figures? Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit References: X-Mailer: WebService/1.1.25559 mail.backend.jedi.jws.acl:role.jedi.acl.token.atz.jws.hermes.yahoo X-Spamd-Result: default: False [-3.00 / 15.00]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; ARC_NA(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; TO_DN_EQ_ADDR_SOME(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; TO_DN_SOME(0.00)[]; FROM_HAS_DN(0.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.69.147:from]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.69.147:from] X-Rspamd-Queue-Id: 4fzBj274FFz42PY X-Spamd-Bar: -- 14.3-RELEASE (more useful): => 40 1875384928 da1 GPT (894G) => 40 2930277095 nda1 GPT (1.4T) => 34 2930277101 da0 GPT (1.4T) => 34 3907029101 nda0 GPT (1.8T) => 34 4000797293 nda3 GPT (1.9T) 14.4-RELEASE and 15.0-RELEASE and main (less useful): => 40 1875384928 da1 GPT (894G) => 40 2930277095 nda1 GPT (1T) => 34 2930277101 da0 GPT (1T) => 34 3907029101 nda0 GPT (2T) => 34 4000797293 nda3 GPT (2T) -- === Mark Millard marklmi at yahoo.com From nobody Sun Apr 19 16:22:28 2026 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fzDRg59G1z6WkWn for ; Sun, 19 Apr 2026 16:22:39 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic304-24.consmr.mail.gq1.yahoo.com (sonic304-24.consmr.mail.gq1.yahoo.com [98.137.68.205]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4fzDRg1nFYz3Jj7 for ; Sun, 19 Apr 2026 16:22:39 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1776615752; bh=D9MZH54Tk7TGXhdhn+485lJhR6ridIkqlm2raGKZ4r0=; h=Date:Subject:To:Cc:References:From:In-Reply-To:From:Subject:Reply-To; b=XXD1ps2UVIbU+JbFcKt0mpH0KkTIyeqB50HOHs9ay1sBV7d/W9mogpbeMqswMj55YZmPY52uTx39K/NxurbIWeJp/IPmMJR3xVSdiJR0I6exbgX0IGIEnyRPsYnlKwsm3U+NtTD6h/cN4xIhOm2wKkGdtO1p/+/vH3dVAR2PLJCW/6i5iC0yg1kZGsntsvAgIY8Kz2hgdIYAitulcuFHtF5yg492svUHtiU/LAjmCnSNoE+4uYn6QLiPNhuhoi87/b0QOGNQIE83b//SE2iwJ3NZmrk5OYZYa7rFMYkOlC6I2i2JsW9daGW9hXDwfz1tKcKbPuOD38BydKqzjtwsYQ== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1776615752; bh=7Sa01YUEsHmzHHttWmsVAiTCWjx/9OAjWe80ILPhImX=; h=X-Sonic-MF:Date:Subject:To:From:From:Subject; b=c7aq7en8yZzGh4i2OxVtbMbIxDcdLAFAbqNgetuA28AfUBKifE+KbVVSRG8cJ7BSyUR5647og8myCT0psXYqH7I4gHzuRcB67RHALjC3lkPpxobULcEC/X9bdWm7SrYpVURgT/XCSk/oVJwdButtTVi5OQ9825xhvVy9FDOwKe6dVurdHfWIV69MoNwpfiw3o19CuUdhMcs2uqEmBYY8P+ve6pyODGN15jg+gAWioIgYETpl1lpf+bqgmnMhU/zerCvSbu8DKU812zrp07lf0G9hAnuXeqjEgeV6DtnAT/KAklbsu3inZ4eGTT8fsS6R6SonwuFhGvyvpWgKnrLP4Q== X-YMail-OSG: uxp1v7QVM1n_1xJoF0PwyVOsADoYnnW22EczQq27IJCSZ_KQENA0276VaBn_RHl WU02yUFUBA3DJ5XcKPkvZrYISr_UkLmLKUU_kts1HEatWeWDnyhCfx.sb7MeHaIzYm3WsQNYoqT3 osYUexVXMG8BWMecc8daW7oEgQRWPFC4M6k5FNjK7_3Zj0DLltMdhRDRaUUY5WZkMKpkmbZ2fcvl vY_0KpLlRJK2eEeswdNr8ylBkJRdO.lnOuDxNiTqVbyFuIHFQjcY0qFY9SRxWYo.i68ThaN.lUXJ HaQduo8F5_vCD88YZIWr_gbi7Ce7aXhf9HHYdoWA1eXlLrPIQZdhdY5PJdI6zMbZyvXFkOrocxsS KudOrswIvhKmqff.3kmCrYskbitVcTb9DKIOogFMxfeNyEnh.dfOYHaN3lfRlQhl3BktU6mxbU7Z AWcIjo5uvFzcXrYGt31a0p9AyUKQ_JnwUwWhpHzwMBwnZncMUQD2MoLquDePV933PtTgU8FZgjz. bIXr44aO4l0UYF6s22V6msSuWYWRKIOux0tgcKOMXwWkoqDa5PQEz.E3f5lhYWV8Z1KlM4I_dEYA ddRwFsQ.yDGE3P3WycM48YNRm_bCFXIkdXX8gyG70vkOnMCc.TyjPwsEaxrZ1OagKxDp0YzMzf_q y3nm2bMlSCzwayiDLOTxxn8_VcfNTwvBr7oNjJdlCSqreycL_g5gq1Khdbilma.N4FLCa6zROG1H 3AogVveqhL69iBHrn2nJtZ9IJqXW7ZCGC3qM6hSqKfe2r1Ol1ouigWCuNrxFklO6kGbn1Vc.8l5w 8IUqDXP33RJvhPTdPGiQ8WDmcI49M9BhPnqikDeN4eV2u_UGoQaigaPwjI8BcCWlCVveaC66cq6M IfV3Gjq11oXkt5y88gGSl.DHPLTGJ0rdUvozkdTP1wP42bU5jIWys720RahHjdC_AxREORFkgPfQ gMN32HetdjGVB8u0Svs8HILMtSHTTTymQRNKuM3hrFArZJWsD8UINu2bx4zzwSlBu6I3hejKBPfW 52861Q1wMcgvVuAyCPw_D8mgwoYHER5eSijpVnNeJqYNi.i1tHwutJB.q2ajRpTt8WlrrTGOIsAq VDOK4Gn5IAWOiCYgafgu_7NpyrxWa_ng7FVomkvWdk5GOdYkxyIruAPPGONICRroXVzVm4DgkzWb buYiN70jtjliUPWZ2tuZL65jPKlEAx43QK7U_EB4Ojg0rj5JEbZVtrfflzVQKwiV7Ro03YXDJ7yQ Ba7fs8VmJg.LQp26GuYVuU8Dm1b34VRzoNW9QDpBea7viHcySydum52AIJsf6BZnCW64pIcJZp9v wqyriSgQmB4eNd30IOTnSSs3zFoLLCqXpqtBOuy3hIt7qy9O4K1k50ZcDTsnmsvkmRKGJNtT4O_1 Y8nhF6FmieyNZtyuKXgmRvX72wWS8ReCpQyB8qn23viDSIiRxDWgxXLSN.BdIAuLqngGcXVayHNt IbhniRd5gOTS0nPRMfqwG2t6Tw423BRvDAml3B.xGXn5gjzfM0yD5vv9Txqn_YcX1Eiwd.RabXy_ yhZVmIesBHwsgkccbitUMNbo5aHIFnIKagBMfqvrupVURJwc9flZkyH.sO.2z2Cy_OOLU2.QsVh7 TMgiV2aA_tptUTmrb1ldF5vsPuqEibSIKGW4FjKBfG672UobsiK4du8tnHzaXXlMdBpSrTFdL7H7 it6L8Qec6HOKjKFjBe66K2.mTDkLvILRk.Cjl4uKRTddiBLRlomCMXdbr15vie9Dch.4NCmSBqx6 LgYH3Jw4YFREgdAHmykeFrqJk2tm4jzb092AhLmBVEI.ZYUzbv8zmzzegOz8lGPVxbo4hm23LSDk T5_NTrS8mhvCgApv7VHkmX.kRiAbgQbm.QeXjTPl6zr8lJQz8gbe7AY7TCDqCTNsDmyLa1vR.JId Lm30dRu8JWFpNti1r_Ut1A36Lohv4C98LJrCy92E14RtFM5DD7Y_QnzpHeDKaK1dVmHaR5P41zzv 85Vj8yP6gmwT7SSg8ypNcHCLw54fQn2esjTxovFTAJIIBL8y7d5UUmsxCKhU.Oa22LxPdN3AwtHR PnXoP.rFeZcT2AcAIoo_2UvXlGRMSM8V54eboHtPF8X3LXmX3SFiQo4LqbApAU_ns9EpA6F3P.JB pmxAM5B15.udcgVfxvfZb.76HbJY0U4evil75o9i7QZHfsjk_wxz0t.9X7.9pUPmM0UWEbGBGPw8 NDaIPmWUq3c5joqAO7yG37Ck6DwSc7pHruozK4R4lHUGXh19h2WEdrEFRKb.0NCX7CovhWzbHwPc 86_W8Tyh.DUzw5lfbhjNcnYg70pN5QDms_A3.KQMighk7Tsw- X-Sonic-MF: X-Sonic-ID: 1247c472-79b1-4d86-b5ea-f007d082237a Received: from sonic.gate.mail.ne1.yahoo.com by sonic304.consmr.mail.gq1.yahoo.com with HTTP; Sun, 19 Apr 2026 16:22:32 +0000 Received: by hermes--production-gq1-6dfcf9f8b-h78wr (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 7efb2591469c4c1aca06109589aceb66; Sun, 19 Apr 2026 16:22:29 +0000 (UTC) Message-ID: <48c423a9-5e09-4acc-9f00-0e3832a78fc9@yahoo.com> Date: Sun, 19 Apr 2026 09:22:28 -0700 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: FYI, build times for 15.0-RELEASE and 14.4-RELEASE poudriere jail worlds vs. 14.3-RELEASE poudriere jail worlds: an example To: Helge Oldach Cc: freebsd-stable@freebsd.org, freebsd-current References: <80c07af1-56a6-4dad-bf30-5e6c479ace0c@yahoo.com> <202604190815.63J8FFbT007947@mp80.oldach.net> Content-Language: en-US From: Mark Millard In-Reply-To: <202604190815.63J8FFbT007947@mp80.oldach.net> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Mailer: WebService/1.1.25559 mail.backend.jedi.jws.acl:role.jedi.acl.token.atz.jws.hermes.yahoo X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Rspamd-Queue-Id: 4fzDRg1nFYz3Jj7 X-Spamd-Bar: ---- On 4/19/26 01:15, Helge Oldach wrote: > Mark Millard wrote on Sat, 18 Apr 2026 21:26:10 +0200 (CEST): >> There have been reports of rather large time differences for >> 14.4-RELEASE vs. 14.3-RELEASE --as well as prior reports referencing >> 14.3-RELEASE vs. 15.0-RELEASE. > > PR 287447 perhaps? > > 14.3's cc is statically linked against libllvm etc, while 14.4 and 15.0 have private shared libraries - boils down to 2e47f35be5dc. My Windows Dev Kit 2023 test does not as well fit with that being the explanation of most everything in that context: it got a noticeably more significant difference between 15.0 and 14.4 for the time ratios vs. 14.3 compared to the 7950X3D figures: 7950X3D 15.0 and 14.4 vs. 14.3 ratios: 15.0: 02:29:18/02:04:06 approx.= 1.20 14.4: 02:24:11/02:04:05 approx.= 1.16 WinDevKit2023 15.0 and 14.4 vs. 14.3 ratios: 15.0: 09:58:30/08:10:58 approx.= 1.22 14.4: 09:11:36/08:10:58 approx.= 1.12 (So: not as close.) Of course, since I built a notably smaller subset of the port-packages on the WinDevKit2023 in order to avoid much longer build time frames, the workload change could be significantly contributing. I do not have an analysis of the workload differences to use to make judgments with for that. More interesting will be when future from-scratch official port-package builds on ampere4 and ampere5 (aarch64 contexts that closely match) are also available for comparison to the 14.3 and 15.0 overall times on those machines. > > Running on a system with WITH_LLVM_LINK_STATIC_LIBRARIES has significantly reduced build times for me. My personal builds of other chroots/poudriere-devel jails use that --but for WinDevKit2023 I also build the FreeBSD versions as targeted to Cortext-A76 (WindDevKit2023 and RPi5 compatible). I also build personal kernels that I can boot that are targeted to Cortext-A76. I use the same upstream pkgbase boot world no matter which boot kernel is in use. I have yet to update my personal builds of such to do tests with. > > Kind regards > Helge > > -- === Mark Millard marklmi at yahoo.com From nobody Sun Apr 19 17:11:25 2026 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fzFXF2HD6z6Wpd0; Sun, 19 Apr 2026 17:11:41 +0000 (UTC) (envelope-from zlei@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R12" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4fzFXD5jvrz3TFb; Sun, 19 Apr 2026 17:11:40 +0000 (UTC) (envelope-from zlei@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776618700; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=HNfeLKUQp/rcK34PWMxj14Bskuowc7nS2cdMd5XJilw=; b=IdrWG2pYx678isQW4T7UhJ1ADeKUm2+4WUFatrqcrA0qVUzYECQKqfjhqC25CGxSaQL6CI FlC8JnFPiM28ATogKzkxp/kyJwcgxPhT4H7oNX6etw8t8Gx1y8Ddjce9gQR5GOu8R4qsfp FZEoCzUdLbiM/27YD96YxpEdeb3jzW4GocVExDYtZoNMuS7tLRQjd4wdT5CmvCMsD+YFMr fsismSnn9s41yD4wSO7lEdtlez1YFnQ6DEU1xSFBnh8u1WqKUHiT5pfvXErRvQKTrmfOpZ 7J8OuV8grS3i5B5bEbtq9vG7LcoVgekZ8aGShSZFf1+J5MPsC5RuFferl/v36Q== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1776618700; a=rsa-sha256; cv=none; b=RfRdenyIK+Wuo/VyZRJxT3aT0xmMU5w0Jedp7stB+dz6pjtRH86zHirLCZyo7RC4TfBU07 hX7zUeFDnU2oWl7Rao4KETThvioQUpRT6+OAa7iuGuZ1JIp9DqY9itbUxcDj/mlw89LQ0p xQcM8fCWIu5FOpYX9G5PvamTClABgJDcA8qZrZDyvAeSWSQKEfkAQ+0GJ+6o2yzpVfcHj6 k7yNjjfgZ5hb5F8PGVcXNZG1cImR11ADn+2TkTFig+RhxlvHJSvsRHCtWaSwI2+krz2IvL YsBgs0bxyJawW9ld/CDC1nwJenbHVJDMlNV6rFUXUoSsivSGrFbVhDBuODNCgQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776618700; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=HNfeLKUQp/rcK34PWMxj14Bskuowc7nS2cdMd5XJilw=; b=dP8olcD0TSMLLLUCun8DCGYzYPgXKPAI+5L89QMGveFExg4EihcArlu2fDSqMieccF5UzH I699vQJdHIFKjtK1e/VAdC7RhzHNBkAc8aqWOQIfkCQV3pH9f7Z5WaWg+2cUNA484IImYi h23GhADhqlCFp34kBzzQSUnfiDxjzGQVnnaBHzi2t6VRc5OISEs6uKNPxyqrwwXHp2hGDo kuOd+BJyYpB/p8UMhGD+4NfKGD8os4GsdRAUIYI/+1a+h4AxvV6f8LA15CTPcmGkoE37zX 9pUWTe923BKAnlGpAA3EIE5qfcT1yVeEHCERCU0hgN4ptsnGfWIk2Q7DgWTWOg== Received: from smtpclient.apple (ns1.oxydns.net [45.32.91.63]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: zlei/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 4fzFXC27glz13QZ; Sun, 19 Apr 2026 17:11:38 +0000 (UTC) (envelope-from zlei@FreeBSD.org) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3696.120.41.1.10\)) Subject: Re: 14.3-RELEASE gpart show output (?.?T) vs. 14.4 and 15.0 and main: why do 14.4 and 15.0 and main have some single significant digit (?T) size figures? From: Zhenlei Huang In-Reply-To: Date: Mon, 20 Apr 2026 01:11:25 +0800 Cc: "freebsd-stable@FreeBSD.org" , freebsd-current Content-Transfer-Encoding: quoted-printable Message-Id: <68D25BCF-6B36-426D-B593-8391D6A5D5B1@FreeBSD.org> References: To: Mark Millard X-Mailer: Apple Mail (2.3696.120.41.1.10) > On Apr 19, 2026, at 11:03 PM, Mark Millard wrote: >=20 > 14.3-RELEASE (more useful): >=20 > =3D> 40 1875384928 da1 GPT (894G) > =3D> 40 2930277095 nda1 GPT (1.4T) > =3D> 34 2930277101 da0 GPT (1.4T) > =3D> 34 3907029101 nda0 GPT (1.8T) > =3D> 34 4000797293 nda3 GPT (1.9T) >=20 >=20 > 14.4-RELEASE and 15.0-RELEASE and main (less useful): >=20 > =3D> 40 1875384928 da1 GPT (894G) > =3D> 40 2930277095 nda1 GPT (1T) > =3D> 34 2930277101 da0 GPT (1T) > =3D> 34 3907029101 nda0 GPT (2T) > =3D> 34 4000797293 nda3 GPT (2T) >=20 It appears to be caused by 4f809ffec69c (gpart: add libxo support for = "show" subcommand + man page updates) . Prior to the change the size was formatted to human friendly format by = `fmtsize(pp->lg_mediasize))` which in turn calls=20 ``` humanize_number(buf, sizeof(buf), rawsz, "", HN_AUTOSCALE, HN_B | HN_NOSPACE | HN_DECIMAL); ```, now it is formatted with=20 ``` xo_emit(" ({h:size/%jd})\n", (intmax_t)pp->lg_mediasize); ``` It appears that libxo does not handle well with numbers those exceed = 10^12, ( 1 Terabyte in this case ). >=20 > --=20 > =3D=3D=3D > Mark Millard > marklmi at yahoo.com >=20 >=20 Best regards, Zhenlei From nobody Sun Apr 19 17:40:48 2026 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fzGBC73fXz6Ws3q; Sun, 19 Apr 2026 17:41:07 +0000 (UTC) (envelope-from zlei@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R12" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4fzGBC6RPQz3YFF; Sun, 19 Apr 2026 17:41:07 +0000 (UTC) (envelope-from zlei@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776620467; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=ZvwFNSUK6lEO9AFLhSks/UAhiGEw520wOueeSPogLs4=; b=b3AqL4dHjYCyHVSQiEh82GiocVCZS5UosSg0P8q2WPbClKBpt3AlLYqdBatf+dc0rN2X4R +zb+ZqDdQDPINJEu2P9vmwIWF2MHeKt6tZqlzCUElnU1A5KFembrIscTGZ6WHq/dWEBcIT LHCyZyGJNHpUOA6hbbGMjRsNJBikE020wgqf0b5HouxwH+sjqMzkOAj+evyKSQk6JMFSWV UV/8Tvg/pOSXAVly3keToKGj/xNeeukaXLENLSRZF1xSfnzy4xIQzV1nq6S0w0XMGsysHx 5lsDm+x1ZWnLiO9jDJ1qzz0KzjoSA8UqD61J1nfy09gHxTsB6pMAG4cOVb8vbQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1776620467; a=rsa-sha256; cv=none; b=oH1x9AeVFZH1qqRmun+p6TbgogyDEXdqDJMdNTaVMZ2Wlt/A0DuEjpfTGrqr35uw+INv2a VfeLaC7ruwgo4UivVDLHIk9/Z0W+/yIGfB5cJoMbhedDELq6VK/R46Y3Jp5nVams8df7Fz VKJhVocsKB4Z59E0d8Dak8HrmCizWl0hOeV9irrajagIFKEbBDpWNco+AaBBk47WUTQuKS ioSnsqj6YRrj9jBVQ6K5b+MQwKXShrFNwuo0a36w7lYYfrgaciG76W04pmvFd7td/U/ETH 4CJiz96Unlu6CRIYa3Bw5bnK1jwJzki3UZEEi7N0p2iicJdbJGCLjwT4w/RDpQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776620467; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=ZvwFNSUK6lEO9AFLhSks/UAhiGEw520wOueeSPogLs4=; b=gBUTWKMZNx6AaZEfPV4DiQsn7okGvBIdlGHLkYdkvgJBz3t5OgfZNvP3a9KgKfTUgSiMb3 1Xxs/Ok9O2pOTqlD5/y5/5kFvJinl7PWLOKC0qWPPyHM9i69Pqcw9MRIyFWvOgXxGtt+Fb V/JJZ1QEZWxyRtXuQmoGAX5095JF/yZZCQ76X61410FKegvMMeFuuya9Oumf04Hm0wC7AL vSbVZZ9VXsJ7WWkjvWD8XMhk5NU6PtJBEGJfN+fMajSsF+G6ztfNkrQ4sy97kMUYRBmB9g WCrmvJjKnHpimf2LCUUdRXqVjBU2w5wPuaSRtcVxmiVwN8b0nTC6+pH8hupx/A== Received: from smtpclient.apple (ns1.oxydns.net [45.32.91.63]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: zlei/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 4fzGB65dTjz13kM; Sun, 19 Apr 2026 17:41:02 +0000 (UTC) (envelope-from zlei@FreeBSD.org) From: Zhenlei Huang Message-Id: Content-Type: multipart/alternative; boundary="Apple-Mail=_AA6AD6FF-B7B5-4292-BC9A-108377E2ACF7" List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3696.120.41.1.10\)) Subject: Re: 14.3-RELEASE gpart show output (?.?T) vs. 14.4 and 15.0 and main: why do 14.4 and 15.0 and main have some single significant digit (?T) size figures? Date: Mon, 20 Apr 2026 01:40:48 +0800 In-Reply-To: <68D25BCF-6B36-426D-B593-8391D6A5D5B1@FreeBSD.org> Cc: "freebsd-stable@FreeBSD.org" , freebsd-current To: Mark Millard References: <68D25BCF-6B36-426D-B593-8391D6A5D5B1@FreeBSD.org> X-Mailer: Apple Mail (2.3696.120.41.1.10) --Apple-Mail=_AA6AD6FF-B7B5-4292-BC9A-108377E2ACF7 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii > On Apr 20, 2026, at 1:11 AM, Zhenlei Huang wrote: >=20 >=20 >=20 >> On Apr 19, 2026, at 11:03 PM, Mark Millard wrote: >>=20 >> 14.3-RELEASE (more useful): >>=20 >> =3D> 40 1875384928 da1 GPT (894G) >> =3D> 40 2930277095 nda1 GPT (1.4T) >> =3D> 34 2930277101 da0 GPT (1.4T) >> =3D> 34 3907029101 nda0 GPT (1.8T) >> =3D> 34 4000797293 nda3 GPT (1.9T) >>=20 >>=20 >> 14.4-RELEASE and 15.0-RELEASE and main (less useful): >>=20 >> =3D> 40 1875384928 da1 GPT (894G) >> =3D> 40 2930277095 nda1 GPT (1T) >> =3D> 34 2930277101 da0 GPT (1T) >> =3D> 34 3907029101 nda0 GPT (2T) >> =3D> 34 4000797293 nda3 GPT (2T) >>=20 >=20 > It appears to be caused by 4f809ffec69c (gpart: add libxo support for = "show" subcommand + man page updates) . >=20 > Prior to the change the size was formatted to human friendly format by = `fmtsize(pp->lg_mediasize))` which in turn calls=20 > ``` > humanize_number(buf, sizeof(buf), rawsz, "", HN_AUTOSCALE, > HN_B | HN_NOSPACE | HN_DECIMAL); > ```, >=20 > now it is formatted with=20 > ``` > xo_emit(" ({h:size/%jd})\n", (intmax_t)pp->lg_mediasize); > ``` >=20 > It appears that libxo does not handle well with numbers those exceed = 10^12, ( 1 Terabyte in this case ). Try this patch please, not a full fix for all the "size" column, ``` Author: Zhenlei Huang Date: Mon Apr 20 01:38:21 2026 +0800 geom_part: Fix the format of size diff --git a/lib/geom/part/geom_part.c b/lib/geom/part/geom_part.c index 852eec2d790a..ca3c5f2c27c3 100644 --- a/lib/geom/part/geom_part.c +++ b/lib/geom/part/geom_part.c @@ -723,7 +723,7 @@ gpart_show_geom(struct ggeom *gp, const char = *element, int show_providers) } if (idx) xo_emit("]"); - xo_emit(" ({h:size/%jd})\n", = (intmax_t)pp->lg_mediasize); + xo_emit(" ({h,hn-decimal:size/%jd})\n", = (intmax_t)pp->lg_mediasize); xo_close_instance(s); first =3D end + 1; } ``` >=20 >>=20 >> --=20 >> =3D=3D=3D >> Mark Millard >> marklmi at yahoo.com >>=20 >>=20 >=20 > Best regards, > Zhenlei Best regards, Zhenlei --Apple-Mail=_AA6AD6FF-B7B5-4292-BC9A-108377E2ACF7 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=us-ascii

On Apr 20, 2026, at 1:11 AM, Zhenlei Huang <zlei@FreeBSD.org> = wrote:



On Apr 19, 2026, at 11:03 PM, Mark = Millard <marklmi@yahoo.com> wrote:

14.3-RELEASE (more useful):

=3D>= ;        40  1875384928 =    da1  GPT  (894G)
=3D> =        40  2930277095 =    nda1  GPT  (1.4T)
=3D> =        34  2930277101 =    da0  GPT  (1.4T)
=3D> =        34  3907029101 =    nda0  GPT  (1.8T)
=3D> =        34  4000797293 =    nda3  GPT  (1.9T)


14.4-RELEASE and 15.0-RELEASE and main (less = useful):

=3D> =        40  1875384928 =    da1  GPT  (894G)
=3D> =        40  2930277095 =    nda1  GPT  (1T)
=3D> =        34  2930277101 =    da0  GPT  (1T)
=3D> =        34  3907029101 =    nda0  GPT  (2T)
=3D> =        34  4000797293 =    nda3  GPT  (2T)


It appears to be caused by 4f809ffec69c (gpart: add libxo = support for "show" subcommand + man page updates) .

Prior to the = change the size was formatted to human friendly format by = `fmtsize(pp->lg_mediasize))` which in turn calls 
```
humanize_number(buf, sizeof(buf), rawsz, "", = HN_AUTOSCALE,
          &nb= sp;HN_B | HN_NOSPACE | HN_DECIMAL);
```,

now it is formatted with 
```
xo_emit(" =  ({h:size/%jd})\n", (intmax_t)pp->lg_mediasize);
```

It appears = that libxo does not handle well with numbers those exceed 10^12, ( 1 = Terabyte in this case ).

Try this patch please, not a full fix for all the = "size" column,

```
Author: Zhenlei Huang <zlei@FreeBSD.org>
Date:   Mon Apr 20 = 01:38:21 2026 +0800

    = geom_part: Fix the format of size

diff= --git a/lib/geom/part/geom_part.c = b/lib/geom/part/geom_part.c
index 852eec2d790a..ca3c5f2c27c3 = 100644
--- a/lib/geom/part/geom_part.c
+++ = b/lib/geom/part/geom_part.c
@@ -723,7 +723,7 @@ = gpart_show_geom(struct ggeom *gp, const char *element, int = show_providers)
            =     }
            =     if (idx)
          =               = xo_emit("]");
-             =   xo_emit("  ({h:size/%jd})\n", = (intmax_t)pp->lg_mediasize);
+         =       xo_emit("  ({h,hn-decimal:size/%jd})\n", = (intmax_t)pp->lg_mediasize);
        =         xo_close_instance(s);
  =               first =3D end + = 1;
        }
```



-- 
=3D=3D=3D
Mark Millard
marklmi = at yahoo.com



Best regards,
Zhenlei

Best regards,
Zhenlei

= --Apple-Mail=_AA6AD6FF-B7B5-4292-BC9A-108377E2ACF7-- From nobody Sun Apr 19 17:58:16 2026 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fzGZG2S62z6WvNS for ; Sun, 19 Apr 2026 17:58:30 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic317-20.consmr.mail.gq1.yahoo.com (sonic317-20.consmr.mail.gq1.yahoo.com [98.137.66.146]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4fzGZF6Srxz3dvZ for ; Sun, 19 Apr 2026 17:58:29 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1776621502; bh=gZVsmqAShpFni3ZAji8qEWUN1WhF31aqoX1B+A9lNm0=; h=Date:Subject:To:Cc:References:From:In-Reply-To:From:Subject:Reply-To; b=NHvQW0VU4BcNLVrfrQgHfGzMBldGseX7k7v3sDN/QZ0vlgd+GoZW+T+md4q4JxrZoa40+nEFcgYEE4MEYgEVICyxEOMKfQeqZpP0SZ+TUjrJCUHqIGSGUf0M03VZBsVMRUb0802h22AAZk6UHGdk+6IgNMYmYiScQYMKGMm8CgcGqhaIF9IGIb2MzaqDyAp1uyt8PVDOLCZJAKNSQ2dty6QBcChxl2IyEPgo6jSGP79tNv3yhht1oY4v97ZJRewPtgESYjkgKEjFGvuBl3pmCjISYX62zDnqqqM/nJDMZuiS4pMOFWQ91lZdHQIoG8KT0wBGpibZbohTEK07ze25BQ== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1776621502; bh=XEpZYkJqR5FhFUVJyIvqh1fH52ztUeBLYsmnkS+apO8=; h=X-Sonic-MF:Date:Subject:To:From:From:Subject; b=TSl1IFGb71QCVFBPG949qEdDRRSSX3wy2pgtRE7bFUhxgv04SwfbkKfQbWlnMPTubEIiX90rpAsFixIsTPGVClZtkDKMXEqrZpLWdo8lF/V1FBd8NUFqc/q2wwHVkv0AxLsaKBvEAKA80Cm29Aw1gAFBvQKcamodPjy4mTnm3wID0JBdZf0zXq5fHn3vUsf6ObuZks4tsRrh2G3X5JLGPoRaLFyfB+VaWFJChQVk6lhjrzwhvEyHawth7H4dzQ9193gCBCsMm4MsikCEp33Ta1UnEYEnxZqlYfeyUo71DDdPmSikIBcIjA8hcnRaKhq/mDFXpQgrgtKWILhAGrWyog== X-YMail-OSG: zNDyTCoVM1kAaey8r6BOIjlLCNKm5N5qBeWvtUzTLTFPAaPSwkxKbPuV8aSQJWy gV5akUMJfh4g6knMfNFCJBBf4NpB7oNENDi4IqMH4WPpySdtZVFpv1gkLwGhZmsEdSxG9JeKbBc2 kwpiRQox7Boi1E5S2diLM7RCPaq.uoJSTgcD7EWvJijCFCtHK81i6UEg4TwG_1sy1WU_HWh9IoLt Bpw51R4_8aOggS7m3Wy5pkKuZnigEx5aXhFmxWHyPOm2J5EO8TSg4FeWpiKtl4oqf4NAWecJyvv5 Zq0lPfqve6SLgAe6uSPmGSptdx7HThxXzmlS4j00RcefWb_G.JGh3UrIRu_VSC0_NZ0l9vj3GLAz Xdyy8GSoa4vDtJjhXQAHOhus6GtRYvkJjhiL..WMtEvvn85WiPHB.uNovic4LhW6pc5qpvbjmZjz R3HimiCAMUDJHjMDf0mzCyCp3HZnHoigfyTBXVaGWeO6eS4phKfX_b3Pnz9OnvqI.vo6CmJkoAoR 6qWyP9tDH50K.GXFvzx6YaNHYGvhkLsqvrlpZSsHLxekzOW94CkJuGv2f6oCIe4l4YPfUCOvs3Y7 wsr6EpYFW899TvpUczZTR27KNWZkUg0ziJ69qNGYRgIx8blX0uHdKS7btkZcvUj_ejHcIFbVqe_x 6E6iKAqG8COO7MruJxkoGMngQ2uh71seNmH_S8imiSmbHxTdIq6iAb3OH4xnOhZ2FA7.4YsysF1A fwVYVn7Wcx9U44aOcmdcNct0sclE_RZp6C88UCWqUHkICvmjK7u4Mit.Oaa_1uA_O4oE1jypHCYv DgEYILGuBVcaGOBJdlt5C8UBEiXZdQyWdSztjqDie2bH74hsfD4sb_bHsE.z1_P3fKy5UcDcw0eq l4gAc844Hr.1huaeNIw.xJQk5AnrUpe5D6zF80o9migt1NUd..jIWmeH2IhkX2lSqg5XKQDsNegR FqevbxU7_aEKYH6hCLLmGnpsBIFohlkfsChqO8QT72K807pAhnUMNKaTYul.DCFRLuu8OFnQjcmS MOq7qE_fHubKnQEjGXT2XxFylXD3hj8.qdeD5NnuD2xJwkfm9RRr4n2WNfe12FOFOoMaWrSlO.Uz Uv2W9_qtz.AmtTy1lB0hh5vC363Wdm8cW_nPt1brDQ2N_tVpSJ9.3rg8xYj2PlonwJnT9d2Za3XJ nseuki.6RmkcTD_8OZ482xHwQrB8d6jWmhy9Ki07j.79sFqIl6e3kBv.BNv.sJWIWDV.wKk5Xx7J q56AWZduOzpVJOT66cb7VspCK.6zSJcu_kCMhiRQPuB488q7qlVsk9fFMFt8Q8KHliWb7Pplm0ZI cpDm0ijeoDAd08UBTW5xX724dRPhB8u0x0KqPPa4QkU__cLPPyr_Gt1.09_InO0VwgFN_b0n8sFu V6f3xektdEvalsP59BOJ0CfeFLdN9.CJQ2g6rbJxB9rbTAzX3dCbAZDdtnxdANY0v8tPwfunM2ig seDEzbxWud6wbnCLWO9AMdJQpjpcNKAXvC_JnC_5iIS7AunNXWDmC1D9N7WpRYB7JTb.vMyV5YBi 7XqdK1HhXtJnud9_VmWg5oXAbkn9jr.B8PLn6D42j2KXEBkvxHEN96OhgO.NBb9A6D9pFfhdUB5B VjqgDpNd4Thj3kwdrWY9Qx700RKXXn.XkTQsk0CdeK_cNNHX1uBA5oIFwkoDQgztfAk9Erf9Bjm8 FA8lxQLiDym_mxqPmq02iceRjXXKzQXHVGi72gF2BFyRwS70ePZyifCkXLYhG4bOUrMnMxIqOcQz hR7zRPm5SfTl1PucmCJbarhDI_FclEaNDflCzG6rHJUIfplTs9Coniu7u9092GhjQS5ADducUPwm TO7_5J.Tkfxg.7LEYqYQ8aGHeJVEiVF2F3pzwpWT3knZnYQsCILqw5acg1kPlWGD05eKsFiL1Ccj lgQFxKjNSI6Qirvs8536DHaF3n2RiZHJmUe_Rv237fCWEWtXdckQ4FsY5DSjW5Z3aqRu9W3z5uDu hZe0xqFcUwXUgv4WI0LBDKVHUdaYd_ao8N4PSRVFjgu4DX_wSeK02M2DwvkpzKYzmAvABOhZwWEX _5_pqXZSqilJTB5dNSsOQEzL9A_iMj2WCzwu0PBMRcaWWK4HiMFvl4MF6euoXsJN2Y4MA4ZtG3mq sOm8u_fIkutlPlWx0GRjRdjOFH41d5dDysEecowExhoHhFMexX2aGZJX83HqmRei4H0bS0v93b_L oSBZAiWfbBpQ2FuP3dSJ65dfSAOsBirmBgbQTTRYhTpKZUjNp_RdwTAmlVCGLUVAlFXwZx8e407a YqnT36ZeKLSImPvpaK9ALcd8zgculIYYe01c2yEXzyKpmWJMdws8- X-Sonic-MF: X-Sonic-ID: ba606602-f259-4719-b7ca-7c0059e5373b Received: from sonic.gate.mail.ne1.yahoo.com by sonic317.consmr.mail.gq1.yahoo.com with HTTP; Sun, 19 Apr 2026 17:58:22 +0000 Received: by hermes--production-gq1-6dfcf9f8b-lcghq (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID d138ffb868a28c2b7f18fc7cd14e7fa5; Sun, 19 Apr 2026 17:58:17 +0000 (UTC) Message-ID: Date: Sun, 19 Apr 2026 10:58:16 -0700 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: 14.3-RELEASE gpart show output (?.?T) vs. 14.4 and 15.0 and main: why do 14.4 and 15.0 and main have some single significant digit (?T) size figures? To: Zhenlei Huang Cc: "freebsd-stable@FreeBSD.org" , freebsd-current References: <68D25BCF-6B36-426D-B593-8391D6A5D5B1@FreeBSD.org> Content-Language: en-US From: Mark Millard In-Reply-To: <68D25BCF-6B36-426D-B593-8391D6A5D5B1@FreeBSD.org> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Mailer: WebService/1.1.25559 mail.backend.jedi.jws.acl:role.jedi.acl.token.atz.jws.hermes.yahoo X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Rspamd-Queue-Id: 4fzGZF6Srxz3dvZ X-Spamd-Bar: ---- On 4/19/26 10:11, Zhenlei Huang wrote: > > >> On Apr 19, 2026, at 11:03 PM, Mark Millard wrote: >> >> 14.3-RELEASE (more useful): >> >> => 40 1875384928 da1 GPT (894G) >> => 40 2930277095 nda1 GPT (1.4T) >> => 34 2930277101 da0 GPT (1.4T) >> => 34 3907029101 nda0 GPT (1.8T) >> => 34 4000797293 nda3 GPT (1.9T) >> >> >> 14.4-RELEASE and 15.0-RELEASE and main (less useful): >> >> => 40 1875384928 da1 GPT (894G) >> => 40 2930277095 nda1 GPT (1T) >> => 34 2930277101 da0 GPT (1T) >> => 34 3907029101 nda0 GPT (2T) >> => 34 4000797293 nda3 GPT (2T) >> > > It appears to be caused by 4f809ffec69c (gpart: add libxo support for "show" subcommand + man page updates) . > > Prior to the change the size was formatted to human friendly format by `fmtsize(pp->lg_mediasize))` which in turn calls > ``` > humanize_number(buf, sizeof(buf), rawsz, "", HN_AUTOSCALE, > HN_B | HN_NOSPACE | HN_DECIMAL); > ```, > > now it is formatted with > ``` > xo_emit(" ({h:size/%jd})\n", (intmax_t)pp->lg_mediasize); > ``` > > It appears that libxo does not handle well with numbers those exceed 10^12, ( 1 Terabyte in this case ). My guess is that a size in the Range 1.0G .. 1.4G or so would now display (1G) and that in the range 1.5G .. 2.4G or so would display 2G --and so on until 9.5G .. 99.4G or so shows 2 digits before the G. In other words: it picks the G (or whatever) first without considering the significant digits issue that results from its handling (given no fractional part in the formatting). But I've not tested such. A better pick for 1.0G .. 9.4G or so would be M . One would image using M for 1.0G .. 99.4G or so but G for 99.5G .. 999.4G or so. The notation does not need to use fractional notation to get 2 to 3 significant digits generally, if it picks the likes of M vs. G units appropriately to having the significant digits as well. (I've avoided being explicit about 1000 vs. 1024 being used for M vs. G here.) > >> >> -- >> === >> Mark Millard >> marklmi at yahoo.com >> >> > > Best regards, > Zhenlei > > > -- === Mark Millard marklmi at yahoo.com From nobody Sun Apr 19 18:03:47 2026 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fzGhW2WGsz6WvxR for ; Sun, 19 Apr 2026 18:03:55 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic313-20.consmr.mail.gq1.yahoo.com (sonic313-20.consmr.mail.gq1.yahoo.com [98.137.65.83]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4fzGhV3fdjz3l5x for ; Sun, 19 Apr 2026 18:03:54 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1776621831; bh=alAJR1u28AaN1aM9TsCdloK0hGqtlI8C9Ium5uT5S8E=; h=Date:Subject:To:Cc:References:From:In-Reply-To:From:Subject:Reply-To; b=P2k6wmE5rl5xJq3J38ckfKTBpjx0U2RzQvACftkdrH0BO+tBkRWJwmA26CRVEUaqHtARDZTf/21gCZFVwIvAMRJob2q2wwpvphlQVdwWDHnO+XF3cm8RBqlJtI3SJkT3Q2lGnlaJJioGSCdESJbI3jszDMGG6fQhDQ1tdd1gz9zglb4zMmQTB5qOIOcWOoZsiH4I3Ey7qRUF7TFyqTh+29PRAucy0mmodBd26YD4/5bFrpCv1pi4uAqOD8pIf58IkFHUrW4bwckkQC/RmTUHiM7agFg/CYeOCXEzVn+YrJQqFmeoiZNV0HD/gFKHZM1Mdp4gLq+ff9RDRAMN/HI2bw== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1776621831; bh=zV0iEGKMj0jCv8lZbMnaIQwB4pEP1FHYU3LY1HnuUhi=; h=X-Sonic-MF:Date:Subject:To:From:From:Subject; b=ggPTZY2rzoTpCuHZ6hadmiMqOJ0ol+50v0agwi9v95rRUdBkG+wNPGYaVdxbVJnc0WSdkQE2vujJt1Ttc2jyr1Hf8qtTtWEhsUxsDSaGMaATRozPe4mb45NytAIA97fHIsaK9Cun8h9MuDgh4gJpgXdO5Dr9kfwPOip0a9XExWXH/AQjfA/KOCbiqVsjiHTRtb+q3ObeNvA7ibQE8TWTcfqDdoDFYXo273npzrqzfav4s0/v/wkk7tjHwWMv+gLbFz1bx5cvrS8r5HMFR9/ZZy4E3/UMNYHjw1p8n1x6kDGxL4X8zqbFMguH8xzxTBc0K3weGd2+Aiy5FAGe7+fDfA== X-YMail-OSG: q4g7IZUVM1mEagSrJAyCqalEJWz8wX13TemGxQdngiPTN2h_YJpWWSmfJTkjGWM kgSBgcc.mxxroA1F4SkWLYYkxb.18KBU7Zor3PC5NhaLqliDTxSdr07xrOVpiEncLtHDo7DZgFp7 h9R.xku1w8.o_tr4KgPyxs1634DSsp0J8u.BBaSCoD98s0xSY1BK0Nxdcm8pZqsA8SL8pS0Z6rtu WD5ltbyokIVba3BxfScdgLvq9OtD37XmnvddC.flhN8qI0G8Q_hs0_vNL34hI54jNE01kDeWazAa fldzLvkG9ztY1oubkF03PJoTi2tXrfeEaYWcsoi78.ICNpU8eaMLAzs5OI.iZAg6RMYWTcqj2lN9 idzCic8ebubBKU4r12RngxnExL5pYF29YPGkB0AGJt1tEdpDggf5eS3KWOlsUGVq1KhWrrcemrTD e85jFgMXIS3_xrKeeMi449MwpZXUS7G.M98BJdqJLr0Rqp3dYc3eLBja2Px_Adq1Z9hzzvBltZ3Q 0AoQ0j.bmfwZQOFqk43AtjaNL4cmazu2GjMPsqyW4x_rddx7qq3J1vIXboYq1l3oc0kjfDXqr3y1 cGXPqqwwh4MApndNNIXJRNt1zfH5K67RlrOQ.dV0oZ.TAP7xz4j9.fvjdDzzA48BiW7I2UbHt2aW kLRcHxG9aaNVLodQPntKgM7EC5Vwas8W9dHQIsESaOGz6cIWTscardYGnzzyOq3uJxX6T8PrKGTO UCwTj3DVYbKG1MSO0zCEC6Y.qc_IKcfj_IugG4TcMjVWCfveWVZFqvymmvfybsfM46MyQuJDJ_FE zItYBdrvJRyf7v__KcvDe_UcNg_jmT1laow6Wv6hmXoP4mBbxvZbIK5CqzX2o_xECpLPAiqiCuk8 sCW1HDvIAx2jLwI2l0Vi6t0ncdX5n.MxkNtkLZFN0VGWk4fjguQ7iLscotWITutjWu6ha.A8zSWy yzElxwcqN1ROrOtHr4.KcE3U6SAmlnVQXfQ.bzFgY0EbLAnjKoa8zF.SDe0m.4.c_jx.yXAhER3Q X1FspCm_DtnxjWL9jDuKQ.Klmec8cBxzkZyPZSSrj9yO6O0KyQJ0jOuNoKi.WA1JQrImuqQj98Nv lLph3UhKsaCo9udzfAd3jI.CdfyqxzXvPq4sbZz4DiFenBTRbiboosJ9geKxxCPU7ONjVIcg5Uue Cy5GTy31fDYhFWALKaWrQkkAWBcxeP51JHc4AIkyHL.FHnai01zecVEHya1dsnzyYkuXc6D419kw jDlNP.615T1v6aKpHeZDDRCKmZJ.SMN24Liygp5z7mGXVBBVoYrLrBTaPzL16NIy9zI7vK5iEP9R cTGMQUksn.lo1rcVinS08JpN.CQ6my0nur5d0JY21txc2K5k6aofeP7rRZOQva8ro_tvXFVhJuez HeUwk0J_2vxAyqR8kF.aCm4TleRWUk7b2CU.LwHefJDznGLEBBMVBqPnxiV1_TmHsiZn_m0EJoAd NKDH9TTcS6j.kg01YdO5IC6bAadYfm4NrnEOZFg46hsVySC_X74il7kyi2Iq7ZNECg.cu2ATv0ix iT0CWVTF9VtWM9rn1WD71uxle5Zh_0lftKmVnNX6IRdY8B8Ui27RfcaoTSHBSzm2dT_W48ca3cXQ oUUCRJtBIcKOo6CWQfoexGVf7teGUpCfbIsblBRHEC1q9F4cDNaj3hftszNyBLjSC2p1IBVcNOCQ juzc0jHPlI.ZgA4WQ9Zcc38n6hKjs.6XLDWaydSP1Ux5LFJPq5AWkozyLS9xFrHMm8jtIf9uD5Pr 17nuxulwdUGN5jplB7JotbZb193Lor5D6h56M8tb3ElKW4x0Kx2u.qK1D86Tqp5s6kudJ2vclx00 hNnbFzbpcLT4DSEJzLFmHc7lqUvPfnlHCZ90kp2yNSRR9Row.lJN.VDNzZULEy2dNqYk0BSagKbc kuiyLVsQlhiuU3yE2UFQIaWgR_AcKlLf6UO_gXW..LO.lvZADDH91NjfBZUjXx78GKV_NXlzi1R1 pQkXu.aB5m08U8Vu6OaMqCoIvvqdo5jog6FP5gb0sQ1Mr3hDa8WkVNDMGC3XoUKvu9TQ2AFaMBKg JWEr0WotU_cdGiua4xr8j8andGZLRnCQqNcJtlaH7ed1b.871ySJV4MT0w5hylXUpOIDG3TpMZ4w oELrtWI.9cz2Wx2aRGRDRNn_wcn7jUAeqEPIt2wqAHx5HJZH2YLPkvnibKvYHVrTeUqgLHTbeGH3 VdmQtYODe_nd9uhfgFZukeXopb_5PDJt2vLkyhuG842v79zjjp1lqiKNFSPciKretlq771YepC_F ZA1O86vkqvbE9qu6EBsCD.s8ybyYMooMux7ESOdQPDzdSYz5KLII- X-Sonic-MF: X-Sonic-ID: a9a5352c-1373-491a-824a-856c8d316e3c Received: from sonic.gate.mail.ne1.yahoo.com by sonic313.consmr.mail.gq1.yahoo.com with HTTP; Sun, 19 Apr 2026 18:03:51 +0000 Received: by hermes--production-gq1-6dfcf9f8b-tpk9z (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 4190bce50b67f14631ccda6a4e1b897f; Sun, 19 Apr 2026 18:03:48 +0000 (UTC) Message-ID: <41752629-5c40-4dd6-9b98-429f0a706250@yahoo.com> Date: Sun, 19 Apr 2026 11:03:47 -0700 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: 14.3-RELEASE gpart show output (?.?T) vs. 14.4 and 15.0 and main: why do 14.4 and 15.0 and main have some single significant digit (?T) size figures? To: Zhenlei Huang Cc: "freebsd-stable@FreeBSD.org" , freebsd-current References: <68D25BCF-6B36-426D-B593-8391D6A5D5B1@FreeBSD.org> Content-Language: en-US From: Mark Millard In-Reply-To: Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-Mailer: WebService/1.1.25559 mail.backend.jedi.jws.acl:role.jedi.acl.token.atz.jws.hermes.yahoo X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Rspamd-Queue-Id: 4fzGhV3fdjz3l5x X-Spamd-Bar: ---- On 4/19/26 10:40, Zhenlei Huang wrote: > > >> On Apr 20, 2026, at 1:11 AM, Zhenlei Huang > > wrote: >> >> >> >>> On Apr 19, 2026, at 11:03 PM, Mark Millard >> > wrote: >>> >>> 14.3-RELEASE (more useful): >>> >>> =>        40  1875384928    da1  GPT  (894G) >>> =>        40  2930277095    nda1  GPT  (1.4T) >>> =>        34  2930277101    da0  GPT  (1.4T) >>> =>        34  3907029101    nda0  GPT  (1.8T) >>> =>        34  4000797293    nda3  GPT  (1.9T) >>> >>> >>> 14.4-RELEASE and 15.0-RELEASE and main (less useful): >>> >>> =>        40  1875384928    da1  GPT  (894G) >>> =>        40  2930277095    nda1  GPT  (1T) >>> =>        34  2930277101    da0  GPT  (1T) >>> =>        34  3907029101    nda0  GPT  (2T) >>> =>        34  4000797293    nda3  GPT  (2T) >>> >> >> It appears to be caused by 4f809ffec69c (gpart: add libxo support for >> "show" subcommand + man page updates) . >> >> Prior to the change the size was formatted to human friendly format by >> `fmtsize(pp->lg_mediasize))` which in turn calls  >> ``` >> humanize_number(buf, sizeof(buf), rawsz, "", HN_AUTOSCALE, >>            HN_B | HN_NOSPACE | HN_DECIMAL); >> ```, >> >> now it is formatted with  >> ``` >> xo_emit("  ({h:size/%jd})\n", (intmax_t)pp->lg_mediasize); >> ``` >> >> It appears that libxo does not handle well with numbers those exceed >> 10^12, ( 1 Terabyte in this case ). > > Try this patch please, not a full fix for all the "size" column, > > ``` > Author: Zhenlei Huang > > Date:   Mon Apr 20 01:38:21 2026 +0800 > >     geom_part: Fix the format of size > > diff --git a/lib/geom/part/geom_part.c b/lib/geom/part/geom_part.c > index 852eec2d790a..ca3c5f2c27c3 100644 > --- a/lib/geom/part/geom_part.c > +++ b/lib/geom/part/geom_part.c > @@ -723,7 +723,7 @@ gpart_show_geom(struct ggeom *gp, const char > *element, int show_providers) >                 } >                 if (idx) >                         xo_emit("]"); > -               xo_emit("  ({h:size/%jd})\n", (intmax_t)pp->lg_mediasize); > +               xo_emit("  ({h,hn-decimal:size/%jd})\n", (intmax_t)pp- >>lg_mediasize); >                 xo_close_instance(s); >                 first = end + 1; >         } > ``` > >> >>> >>> --  >>> === >>> Mark Millard >>> marklmi at yahoo.com >>> >>> >> >> Best regards, >> Zhenlei > > Best regards, > Zhenlei > I'm in the middle of other building-port-packages timing tests on the systems. So I'll wait on doing the above. -- === Mark Millard marklmi at yahoo.com From nobody Sun Apr 19 18:48:55 2026 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fzHhk0cpXz6ZDf1; Sun, 19 Apr 2026 18:49:10 +0000 (UTC) (envelope-from zlei@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R12" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4fzHhj6gWQz3svH; Sun, 19 Apr 2026 18:49:09 +0000 (UTC) (envelope-from zlei@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776624550; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=gDjTyCnBdfPcwoNmtlUebGQDNA1Hn6NczExzQeLl1oQ=; b=oCA9/qmGnflht9YXNvEQPfWFvbx0gX+vfCDDT65gvyUPlKQw1kTEnqp2PwRJj92jRu8PC9 W7hBuJAuvZmaBVcm2FOF0dayZTkezpHmSKoH2fE8ov4vBQ6nUcwMLjoZYcafKWJfltVauo 1tAlbnaPWNB95ShEE/aZ4bZ+ohUPwIAwCC7pH8L+uNs4mUWrz8rAyPNz9ZWAgDWLohC37L ZMLrIlkbFxtdqzDdsT0UzHBWQvy3y9CynNFafdkjjjL0C2OS3rth8fvPfaK/drqW3LbyQ7 7EQR+2G6UsOcbzhx+ebcyGXPslIrgyWrSJfTuAjfebRkjlFwr+fTkQTPySVYag== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1776624550; a=rsa-sha256; cv=none; b=PUx8Iq/r9pmzRdX04devXmql9vwIv6vAOaXo5AbQneGWZt4Iz5dopkaQmT5Mnt6bPciVkT MUg2WyAUy9fM1pEDhBVoH3DYJ1BoxWYzsr/vbJl+3T9NHoaA7pEJ30Fd88qcITkA3EFKFI xgAb3tSskAK7PMfQtP8AoMePg3i7AW+2WDfWaNTbdoLEo62bgyzsDt4ZRVdk5bNQhxqOUi MWm0cP1Rum2IXVqpxlvb6ZwPOH7ArOi2FhSeO4s5wEgLKelHjKcV/HWlTwX1wQvniKE/jQ +KuCUFPOHT6VI4dOZ9nFWf6vpgM+juyBfTpVwR3nl4dA0cSJBnoQLB5tak0p4g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776624550; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=gDjTyCnBdfPcwoNmtlUebGQDNA1Hn6NczExzQeLl1oQ=; b=aUTlbRKb5URYDAXydL7cWDQ3k8burfBhtQczNEKUPwsQojm14cPlcC7L2xKHEgncTtnZSk jyGkPChQr+r6r3uhkb5bk9q97C8QujY8XsIe+zYjYA0OMArcPfiCV08aQpg5iURreJTxlU CSt0hvFE2IMP4dLPTOkcaM2bIPMuaINk+dPufvzodvOl+4NTBW4QrIbO/2KsWDc61uVoBU T5A2Gm/BO/kayY4w3WENkQg3owXMA0zkgO25oTJZhTW/1Up4JEN5Usc07lHkOMRHEbSZxo 64pqM7hR6Afuxy/y9kVYrRQF9c+SGBxrb+GbWJkIMxL0mZ4obH36CPGoABkriQ== Received: from smtpclient.apple (ns1.oxydns.net [45.32.91.63]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: zlei/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 4fzHhf6KdTz15Ny; Sun, 19 Apr 2026 18:49:06 +0000 (UTC) (envelope-from zlei@FreeBSD.org) From: Zhenlei Huang Message-Id: <9441867F-E7A7-446A-ACE2-67287A7544D7@FreeBSD.org> Content-Type: multipart/alternative; boundary="Apple-Mail=_B532C114-99B5-4F1B-8F2F-4C0AA796E366" List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3696.120.41.1.10\)) Subject: Re: 14.3-RELEASE gpart show output (?.?T) vs. 14.4 and 15.0 and main: why do 14.4 and 15.0 and main have some single significant digit (?T) size figures? Date: Mon, 20 Apr 2026 02:48:55 +0800 In-Reply-To: <41752629-5c40-4dd6-9b98-429f0a706250@yahoo.com> Cc: "freebsd-stable@FreeBSD.org" , freebsd-current To: Mark Millard References: <68D25BCF-6B36-426D-B593-8391D6A5D5B1@FreeBSD.org> <41752629-5c40-4dd6-9b98-429f0a706250@yahoo.com> X-Mailer: Apple Mail (2.3696.120.41.1.10) --Apple-Mail=_B532C114-99B5-4F1B-8F2F-4C0AA796E366 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii > On Apr 20, 2026, at 2:03 AM, Mark Millard wrote: >=20 > On 4/19/26 10:40, Zhenlei Huang wrote: >>=20 >>=20 >>> On Apr 20, 2026, at 1:11 AM, Zhenlei Huang >> > wrote: >>>=20 >>>=20 >>>=20 >>>> On Apr 19, 2026, at 11:03 PM, Mark Millard >>> > wrote: >>>>=20 >>>> 14.3-RELEASE (more useful): >>>>=20 >>>> =3D> 40 1875384928 da1 GPT (894G) >>>> =3D> 40 2930277095 nda1 GPT (1.4T) >>>> =3D> 34 2930277101 da0 GPT (1.4T) >>>> =3D> 34 3907029101 nda0 GPT (1.8T) >>>> =3D> 34 4000797293 nda3 GPT (1.9T) >>>>=20 >>>>=20 >>>> 14.4-RELEASE and 15.0-RELEASE and main (less useful): >>>>=20 >>>> =3D> 40 1875384928 da1 GPT (894G) >>>> =3D> 40 2930277095 nda1 GPT (1T) >>>> =3D> 34 2930277101 da0 GPT (1T) >>>> =3D> 34 3907029101 nda0 GPT (2T) >>>> =3D> 34 4000797293 nda3 GPT (2T) >>>>=20 >>>=20 >>> It appears to be caused by 4f809ffec69c (gpart: add libxo support = for >>> "show" subcommand + man page updates) . >>>=20 >>> Prior to the change the size was formatted to human friendly format = by >>> `fmtsize(pp->lg_mediasize))` which in turn calls=20 >>> ``` >>> humanize_number(buf, sizeof(buf), rawsz, "", HN_AUTOSCALE, >>> HN_B | HN_NOSPACE | HN_DECIMAL); >>> ```, >>>=20 >>> now it is formatted with=20 >>> ``` >>> xo_emit(" ({h:size/%jd})\n", (intmax_t)pp->lg_mediasize); >>> ``` >>>=20 >>> It appears that libxo does not handle well with numbers those exceed >>> 10^12, ( 1 Terabyte in this case ). >>=20 >> Try this patch please, not a full fix for all the "size" column, >>=20 >> ``` >> Author: Zhenlei Huang > >> Date: Mon Apr 20 01:38:21 2026 +0800 >>=20 >> geom_part: Fix the format of size >>=20 >> diff --git a/lib/geom/part/geom_part.c b/lib/geom/part/geom_part.c >> index 852eec2d790a..ca3c5f2c27c3 100644 >> --- a/lib/geom/part/geom_part.c >> +++ b/lib/geom/part/geom_part.c >> @@ -723,7 +723,7 @@ gpart_show_geom(struct ggeom *gp, const char >> *element, int show_providers) >> } >> if (idx) >> xo_emit("]"); >> - xo_emit(" ({h:size/%jd})\n", = (intmax_t)pp->lg_mediasize); >> + xo_emit(" ({h,hn-decimal:size/%jd})\n", = (intmax_t)pp- >>> lg_mediasize); >> xo_close_instance(s); >> first =3D end + 1; >> } >> ``` >>=20 >>>=20 >>>>=20 >>>> --=20 >>>> =3D=3D=3D >>>> Mark Millard >>>> marklmi at yahoo.com >>>>=20 >>>>=20 >>>=20 >>> Best regards, >>> Zhenlei >>=20 >> Best regards, >> Zhenlei >>=20 >=20 > I'm in the middle of other building-port-packages timing tests on the > systems. So I'll wait on doing the above. See https://reviews.freebsd.org/D56514 = for the full patch. >=20 >=20 > --=20 > =3D=3D=3D > Mark Millard > marklmi at yahoo.com Best regards, Zhenlei --Apple-Mail=_B532C114-99B5-4F1B-8F2F-4C0AA796E366 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=us-ascii

On Apr 20, 2026, at 2:03 AM, Mark Millard <marklmi@yahoo.com> = wrote:

On 4/19/26 10:40, Zhenlei Huang wrote:


On Apr 20, 2026, at 1:11 = AM, Zhenlei Huang <zlei@FreeBSD.org
<mailto:zlei@FreeBSD.org>> wrote:



On Apr 19, 2026, at 11:03 PM, Mark Millard <marklmi@yahoo.com
<mailto:marklmi@yahoo.com>> wrote:

14.3-RELEASE (more useful):

=3D>= ;        40  1875384928 =    da1  GPT  (894G)
=3D> =        40  2930277095 =    nda1  GPT  (1.4T)
=3D> =        34  2930277101 =    da0  GPT  (1.4T)
=3D> =        34  3907029101 =    nda0  GPT  (1.8T)
=3D> =        34  4000797293 =    nda3  GPT  (1.9T)


14.4-RELEASE and 15.0-RELEASE and main (less = useful):

=3D> =        40  1875384928 =    da1  GPT  (894G)
=3D> =        40  2930277095 =    nda1  GPT  (1T)
=3D> =        34  2930277101 =    da0  GPT  (1T)
=3D> =        34  3907029101 =    nda0  GPT  (2T)
=3D> =        34  4000797293 =    nda3  GPT  (2T)


It appears to be caused by = 4f809ffec69c (gpart: add libxo support for
"show" = subcommand + man page updates) .

Prior to = the change the size was formatted to human friendly format by
`fmtsize(pp->lg_mediasize))` which in turn calls 
```
humanize_number(buf, sizeof(buf), rawsz, = "", HN_AUTOSCALE,
          &nb= sp;HN_B | HN_NOSPACE | HN_DECIMAL);
```,

now it is formatted with 
```
xo_emit("  ({h:size/%jd})\n", = (intmax_t)pp->lg_mediasize);
```

It appears that libxo does not handle well with numbers those = exceed
10^12, ( 1 Terabyte in this case ).

Try this patch please, not a full = fix for all the "size" column,

```
Author: Zhenlei Huang <zlei@FreeBSD.org <mailto:zlei@FreeBSD.org>>
Date: =   Mon Apr 20 01:38:21 2026 +0800

  =   geom_part: Fix the format of size

diff= --git a/lib/geom/part/geom_part.c b/lib/geom/part/geom_part.c
index 852eec2d790a..ca3c5f2c27c3 100644
--- = a/lib/geom/part/geom_part.c
+++ = b/lib/geom/part/geom_part.c
@@ -723,7 +723,7 @@ = gpart_show_geom(struct ggeom *gp, const char
*element, int = show_providers)
            =     }
            =     if (idx)
          =               xo_emit("]");
-               xo_emit(" =  ({h:size/%jd})\n", (intmax_t)pp->lg_mediasize);
+ =               xo_emit(" =  ({h,hn-decimal:size/%jd})\n", (intmax_t)pp-
lg_mediasize);
              =   xo_close_instance(s);
        =         first =3D end + 1;
  =       }
```



-- 
=3D=3D=3D<= br class=3D"">Mark Millard
marklmi at yahoo.com <http://yahoo.com/>



Best = regards,
Zhenlei

Best regards,
Zhenlei


I'm in the middle of other = building-port-packages timing tests on the
systems. So = I'll wait on doing the above.

See = https://reviews.freebsd.org/D56514 for the full = patch.



--
=3D=3D=3D
Mark Millard
marklmi at = yahoo.com

Best regards,
Zhenlei

= --Apple-Mail=_B532C114-99B5-4F1B-8F2F-4C0AA796E366--