From nobody Sat Apr 18 19:51:58 2026 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fyj836Vvfz6WwXp; Sat, 18 Apr 2026 19:52:19 +0000 (UTC) (envelope-from gallatin@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R12" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4fyj835bZsz3GBd; Sat, 18 Apr 2026 19:52:19 +0000 (UTC) (envelope-from gallatin@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776541939; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=30FbqVMqZySiPmvpccqgo7Z8VF5YqbyyLOF61TqgX5g=; b=KRIZaFwe51XwYhUR4dlX+0Kq4SV9M+aWmTNWQsv1egOjPvqBmkGRei2lPsSSZ3b2PSD6aK lmXjcunwAVJDVmo1yAFiQZEmkCERLNn2vi5XmPpKEQQIyqwwlYIF96/eulTd25DDH6hkrx zC5K9aOiN2YlAfGHslBSoFSB4xYTUcYDBBVvTWJ8sOvlw3Z2dXhk40/frDub6ldIn56Td1 D5rw5OR1i9poix2srEg2ncdyCDZalr8cQj1VYoPYALKDD1Lxw21bFXGYPdDyZTaeVx6SSF 6Ij1QtWdf0gJXT604RGL0hI2ZTOU0CEL0mASaG48QrANlY6wZaWv6ZkhqyP57Q== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1776541939; a=rsa-sha256; cv=none; b=HTiKN7M3MYXD5qIRVFsC+m4+JYacddiMkKI/514LV6lEgWhZhPP3JcYAVNOY4wjYZCdCT5 WrsVl1TdDBOwrfm+xIMVJVWvPaLO7GRlf9PUvVyZPuein8nOSd4Nca/7OgSWBd7pm+Ii9g v11eXVfTkP9XQoVn4AeJDFMEbPNXZoulOYiClUOK0vDw8y3W+n3Yt3jtNgy+pZ6xLTaqkQ I7m0wfB1ECNZCmPvFitCF0vevnJ5YOjQnyQL8LxceHQKRDNTTAyVaXYvd0ckJc07k+ku90 /puMhWHbrT1XJ1LM0Zuh5HfgOY/TEX4IJJGWTP580ZBjD8qxH1NJcERBUstA8A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1776541939; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=30FbqVMqZySiPmvpccqgo7Z8VF5YqbyyLOF61TqgX5g=; b=NJ7aWS+UbGybEYhqb+8z6g8nhVHoxKTsLIzQI0/FcQ4cEC3hNRj22McQ3Meqs6rHe/4TBE zwaWWqfb3SdbT/Y3uSywaZR1TYVIZHy+9R29JWv8WE5yat1Hizj9pRjiWus1+0l063cAae 18Vc0RBAA4OpD/6WWmag2A5sYsd2S1KvKF07FvK2BWBZHHCWntDk4Tjlx+8x7xqLKuI7m+ cNmiEAcy5bsqldDdDIJ6orQST/XfkPjQyURYLv36NoV3IeW/zbRUmLCcLSFrnm8hX3M1ke VW92G1a4hyVC/d0t3r+TtlTls6oQlXa7tDvMAz/5Q9yQ0nMeUCpFemVbC8YBGg== Received: from fauth-a1-smtp.messagingengine.com (fauth-a1-smtp.messagingengine.com [103.168.172.200]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: gallatin) by smtp.freebsd.org (Postfix) with ESMTPSA id 4fyj834wdrzHg7; Sat, 18 Apr 2026 19:52:19 +0000 (UTC) (envelope-from gallatin@freebsd.org) Received: from phl-compute-05.internal (phl-compute-05.internal [10.202.2.45]) by mailfauth.phl.internal (Postfix) with ESMTP id 8B3F0F40068; Sat, 18 Apr 2026 15:52:19 -0400 (EDT) Received: from phl-imap-02 ([10.202.2.81]) by phl-compute-05.internal (MEProxy); Sat, 18 Apr 2026 15:52:19 -0400 X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeefhedrtddtgdehfeeihecutefuodetggdotefrod ftvfcurfhrohhfihhlvgemucfhrghsthforghilhdpuffrtefokffrpgfnqfghnecuuegr ihhlohhuthemuceftddtnecusecvtfgvtghiphhivghnthhsucdlqddutddtmdenucfjug hrpefoggffhffvvefkjghfufgtsegrtderreertddtnecuhfhrohhmpedfffhrvgifucfi rghllhgrthhinhdfuceoghgrlhhlrghtihhnsehfrhgvvggsshgurdhorhhgqeenucggtf frrghtthgvrhhnpeehjedvgedttdejtdegjeeiieekudeutdefgeekudekgfevtdefhfel fffggeelhfenucffohhmrghinhepfhhrvggvsghsugdrohhrghdptggrthifhhhishhkvg hrrdhorhhgnecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhho mhepghgrlhhlrghtihhnodhmvghsmhhtphgruhhthhhpvghrshhonhgrlhhithihqddufe efheelvddvudeiqddvleehtdegudekgedqghgrlhhlrghtihhnpeepfhhrvggvsghsugdr ohhrghesfhgrshhtmhgrihhlrdgtohhmpdhnsggprhgtphhtthhopeegpdhmohguvgepsh hmthhpohhuthdprhgtphhtthhopegtuhhrrhgvnhhtsehfrhgvvggsshgurdhorhhgpdhr tghpthhtohepfhhrvggvsghsugdqtghurhhrvghnthesfhhrvggvsghsugdrohhrghdprh gtphhtthhopehtuhgvgigvnhesfhhrvggvsghsugdrohhrghdprhgtphhtthhopehrsghr rghntghosehsuhhsvgdruggv X-ME-Proxy: Feedback-ID: i41414658:Fastmail Received: by mailuser.phl.internal (Postfix, from userid 501) id 2A634700069; Sat, 18 Apr 2026 15:52:19 -0400 (EDT) X-Mailer: MessagingEngine.com Webmail Interface List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 X-ThreadId: APgOGAU08yF- Date: Sat, 18 Apr 2026 15:51:58 -0400 From: "Drew Gallatin" To: tuexen Cc: current@freebsd.org, "Ricardo Branco" , freebsd-current@freebsd.org Message-Id: In-Reply-To: References: <9d640ae4-7133-4d4f-917f-d715ab71ee7b@suse.de> <3b60c3e6-f53f-4084-a435-fe5371c56e58@app.fastmail.com> Subject: Re: panic: assertion failed in iflib_txq_drain() Content-Type: multipart/alternative; boundary=754d0919e6487d801aec91f7696bfe04c053baca --754d0919e6487d801aec91f7696bfe04c053baca Content-Type: text/plain Content-Transfer-Encoding: 7bit That is indeed the proper fix. I just reviewed & tested it. Thank you so much! Until it lands, another workaround is to use the new, cheaper, faster, simpler iflib transmit routine by setting the tunable dev.$NIC.$UNIT.iflib.simple_tx=1 Eg, dev.bnxt.0.iflib.simple_tx=1 In loader.conf I plan to deprecate the current complex transmit routine (mp_ring) in favor of the simple mechanism, and I confess that I sometimes don't test "straightforward" changes like this on mp_ring. I'll try to get better about that. Drew On Sat, Apr 18, 2026, at 3:12 PM, Michael Tuexen wrote: > > On 18. Apr 2026, at 21:09, Drew Gallatin wrote: > > > > Sorry, looking into this now. I did not test this change with the mp_ring path.. i don't see how fixing the counters could cause this panic. Looking at it now.. > Hi Drew, > > I think https://reviews.freebsd.org/D56509 fixes it. > > Best regards > Michael > > > > Drew > > > > On Sat, Apr 18, 2026, at 1:38 PM, Michael Tuexen wrote: > >> > >> > >> > On 18. Apr 2026, at 19:14, David Wolfskill wrote: > >> > > >> > On Sat, Apr 18, 2026 at 03:53:33PM +0200, Michael Tuexen wrote: > >> >> ... > >> >>> So... one of the machines on which I track head got this, as well -- my > >> >>> (mostly-)headless build machine. (2 laptops, updated in sync with the > >> >>> build machine, did not panic. One of those also uses a wired NIC.) > >> >> Do the network drivers of the machines not being affected use iflib? > >> > > >> > Apparently not -- they are em(4), iwm(4), & iwn(4), while the panicking > >> > machine uses igb(4). > >> > > >> >> I do see the problem also on one of my machines and local testing shows that > >> >> https://cgit.FreeBSD.org/src/commit/?id=3fade68cfdf95ee0b517b5d69b270bd8da633404 > >> >> is the problem. At least reverting it locally resolves the problem. > >> >> Can you confirm this? > >> > > >> > I can, and do: after reverting main-n285140-3fade68cfdf9 & rebuilding, > >> > I am able to ssh in without issue; the machine reports: > >> > > >> > freebeast(16.0-C)[2] uname -aUK > >> > FreeBSD freebeast.catwhisker.org 16.0-CURRENT FreeBSD 16.0-CURRENT #549 main-n285180-23a84efeb191: Sat Apr 18 17:01:25 UTC 2026 root@freebeast.catwhisker.org:/common/S3/obj/usr/src/amd64.amd64/sys/GENERIC amd64 1600015 1600015 > >> > > >> > Thanks! > >> You could also disable TSO. I will put up a review for a fix soon. > >> > >> Best regards > >> Michael > >> > > >> > Peace, > >> > david > >> > -- > >> > David H. Wolfskill david@catwhisker.org > >> > > >> > See https://www.catwhisker.org/~david/publickey.gpg for my public key. > >> > >> > >> > > > > --754d0919e6487d801aec91f7696bfe04c053baca Content-Type: text/html Content-Transfer-Encoding: quoted-printable

That is indeed the proper fix.   I just reviewed & test= ed it.  Thank you so much!

Until it lands,= another workaround is to use the new, cheaper, faster, simpler iflib tr= ansmit routine by setting the tunable

dev.$NIC.= $UNIT.iflib.simple_tx=3D1

Eg, dev.bnxt.0.i= flib.simple_tx=3D1

In loader.conf
I plan to deprecate the current complex transmit routine (mp= _ring) in favor of the simple mechanism, and I confess that I sometimes = don't test "straightforward" changes like this on mp_ring.  I'll tr= y to get better about that.

Drew

=
On Sat, Apr 18, 2026, at 3:12 PM, Michael Tuexen wrote:
=
> On 18. Apr 2026= , at 21:09, Drew Gallatin <ga= llatin@freebsd.org> wrote:
> So= rry, looking into this now.  I did not test this change with the mp= _ring path.. i don't see how fixing the counters could cause this panic.=    Looking at it now..
Hi Drew,

=

Best = regards
Michael
> Drew
=
> On Sat, Apr 18, 2026, at 1:38 PM, Michael= Tuexen wrote:
>> 
>> 
>> > On 18. Apr 2026, at 19:14, David Wolfskill <david@catwhisker.org> wrote:<= div>>> > 
>> > On Sat, Apr 18, 2026 at = 03:53:33PM +0200, Michael Tuexen wrote:
>> >> ...<= /div>
>> >>> So... one of the machines on which I tra= ck head got this, as well -- my
>> >>> (mostly-= )headless build machine.  (2 laptops, updated in sync with the
>> >>> build machine, did not panic.  One of t= hose also uses a wired NIC.)
>> >> Do the network = drivers of the machines not being affected use iflib?
>>= > 
>> > Apparently not -- they are em(4), iw= m(4), & iwn(4), while the panicking
>> > machine = uses igb(4).
>> > 
>> >> I= do see the problem also on one of my machines and local testing shows t= hat
>> >= > is the problem. At least reverting it locally resolves the problem.=
>> >> Can you confirm this?
>> &g= t; 
>> > I can, and do:  after reverting ma= in-n285140-3fade68cfdf9 & rebuilding,
>> > I am a= ble to ssh in without issue; the machine reports:
>> >= ; 
>> > freebeast(16.0-C)[2] uname -aUK
>> > FreeBSD freebeast.catwhisker.org 16.0-CURRENT FreeBSD 16.0-CURRENT #549 mai= n-n285180-23a84efeb191: Sat Apr 18 17:01:25 UTC 2026   &n= bsp; root@freebeas= t.catwhisker.org:/common/S3/obj/usr/src/amd64.amd64/sys/GENERIC amd6= 4 1600015 1600015
>> > 
>> > = Thanks!
>> You could also disable TSO. I will put up a r= eview for a fix soon.
>> 
>> Best r= egards
>> Michael
>> > 
>> > Peace,
>> > david
>> = > -- 
>> > David H. Wolfskill  &nbs= p;           &nbs= p;           &nbs= p;   david@catwhi= sker.org
>> > 
>> > See&n= bsp;https://= www.catwhisker.org/~david/publickey.gpg for my public key.
>> 
>> 
>> 
<= div>> 



=
--754d0919e6487d801aec91f7696bfe04c053baca--