Skip site navigation (1)Skip section navigation (2)
Date:      Wed, 09 Feb 2022 22:08:59 -0600
From:      Larry Rosenman <ler@lerctr.org>
To:        Freebsd current <freebsd-current@freebsd.org>, Mark Johnston <markj@freebsd.org>
Subject:   Re: Panic, CURRENT, yesterday
Message-ID:  <53727be0434c4c58ae66b8e979aee4f3@lerctr.org>
In-Reply-To: <1ae8c6664f33959f69be4d61a8c545f3@lerctr.org>
References:  <1ae8c6664f33959f69be4d61a8c545f3@lerctr.org>

next in thread | previous in thread | raw e-mail | index | archive | help
On 02/08/2022 1:51 pm, Larry Rosenman wrote:
> I got the following last night while doing a poudriere run as well as
> a full bacula backup:
> 
> borg.lerctr.org dumped core - see /var/crash/vmcore.0
> 
> Mon Feb  7 23:05:48 CST 2022
> 
> FreeBSD borg.lerctr.org 14.0-CURRENT FreeBSD 14.0-CURRENT #54
> ler/freebsd-main-changes-n252969-5e5fd0c788c: Sat Feb  5 14:48:30 CST
> 2022
> root@borg.lerctr.org:/usr/obj/usr/src/amd64.amd64/sys/LER-MINIMAL
> amd64
> 
> panic: ng_snd_item: 42 != 290
> 
Another one today:
❯ more /var/crash/core.txt.1
borg.lerctr.org dumped core - see /var/crash/vmcore.1

Wed Feb  9 19:30:43 CST 2022

FreeBSD borg.lerctr.org 14.0-CURRENT FreeBSD 14.0-CURRENT #54 
ler/freebsd-main-changes-n252969-5e5fd0c788c: Sat Feb  5 14:48:30 CST 
2022     
root@borg.lerctr.org:/usr/obj/usr/src/amd64.amd64/sys/LER-MINIMAL  amd64

panic: ng_snd_item: 42 != 1414

GNU gdb (GDB) 11.2 [GDB v11.2 for FreeBSD]
Copyright (C) 2022 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later 
<http://gnu.org/licenses/gpl.html>;
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
Type "show copying" and "show warranty" for details.
This GDB was configured as "x86_64-portbld-freebsd14.0".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
<https://www.gnu.org/software/gdb/bugs/>.
Find the GDB manual and other documentation resources online at:
     <http://www.gnu.org/software/gdb/documentation/>.

For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from /boot/kernel/kernel...
Reading symbols from /usr/lib/debug//boot/kernel/kernel.debug...

Unread portion of the kernel message buffer:
panic: ng_snd_item: 42 != 1414
cpuid = 0
time = 1644455454
KDB: stack backtrace:
#0 0xffffffff80515fc5 at kdb_backtrace+0x65
#1 0xffffffff804cbaef at vpanic+0x17f
#2 0xffffffff804cb8c3 at panic+0x43
#3 0xffffffff82c765b7 at ng_snd_item+0x587
#4 0xffffffff82c8f263 at ng_ether_output+0xb3
#5 0xffffffff805e0c1d at ether_output+0x6cd
#6 0xffffffff805f6251 at arpintr+0xd71
#7 0xffffffff805e5587 at netisr_dispatch_src+0x97
#8 0xffffffff805e0f1e at ether_demux+0x14e
#9 0xffffffff82c8f89c at ng_ether_rcv_upper+0x12c
#10 0xffffffff82c76dab at ng_apply_item+0x7eb
#11 0xffffffff82c7638d at ng_snd_item+0x35d
#12 0xffffffff82c76dab at ng_apply_item+0x7eb
#13 0xffffffff82c7638d at ng_snd_item+0x35d
#14 0xffffffff82c8f33f at ng_ether_input+0x9f
#15 0xffffffff805e21d7 at ether_nh_input+0x217
#16 0xffffffff805e5587 at netisr_dispatch_src+0x97
#17 0xffffffff805e138d at ether_input+0x5d
Uptime: 1d20h10m31s
Dumping 28528 out of 131023 
MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91%

__curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55
55              __asm("movq %%gs:%P1,%0" : "=r" (td) : "n" 
(offsetof(struct pcpu,
(kgdb) #0  __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55
#1  doadump (textdump=<optimized out>)
     at /usr/src/sys/kern/kern_shutdown.c:399
#2  0xffffffff804cb6ff in kern_reboot (howto=260)
     at /usr/src/sys/kern/kern_shutdown.c:487
#3  0xffffffff804cbb5e in vpanic (fmt=0xffffffff82c7fd98 "%s: %d != %d",
     ap=<optimized out>) at /usr/src/sys/kern/kern_shutdown.c:920
#4  0xffffffff804cb8c3 in panic (fmt=<unavailable>)
     at /usr/src/sys/kern/kern_shutdown.c:844
#5  0xffffffff82c765b7 in ng_snd_item (item=0xfffff8132d74f880, flags=0)
     at /usr/src/sys/netgraph/ng_base.c:2256
#6  0xffffffff82c8f263 in ng_ether_output (ifp=<optimized out>,
     ifp@entry=<error reading variable: value is not available>,
     mp=0xfffffe02ba63f868,
     mp@entry=<error reading variable: value is not available>)
     at /usr/src/sys/netgraph/ng_ether.c:294
#7  0xffffffff805e0c1d in ether_output (ifp=0xfffff80114a43000,
     m=0xfffff81f8203e600, dst=<optimized out>, ro=<optimized out>)
     at /usr/src/sys/net/if_ethersubr.c:427
#8  0xffffffff805f6251 in in_arpinput (m=0xfffff81f8203e600)
     at /usr/src/sys/netinet/if_ether.c:1129
#9  arpintr (m=0xfffff81f8203e600,
     m@entry=<error reading variable: value is not available>)
     at /usr/src/sys/netinet/if_ether.c:739
#10 0xffffffff805e5587 in netisr_dispatch_src (proto=4,
     source=source@entry=0, m=0xfffff81f8203e600)
     at /usr/src/sys/net/netisr.c:1153
#11 0xffffffff805e58df in netisr_dispatch (proto=<unavailable>,
     m=<unavailable>) at /usr/src/sys/net/netisr.c:1244
#12 0xffffffff805e0f1e in ether_demux (ifp=ifp@entry=0xfffff80114a43000,
     m=<unavailable>, m@entry=0xfffff81f8203e600)
     at /usr/src/sys/net/if_ethersubr.c:926
#13 0xffffffff82c8f89c in ng_ether_rcv_upper (hook=<optimized out>,
     hook@entry=<error reading variable: value is not available>,
     item=0xfffff8132d74f880,
     item@entry=<error reading variable: value is not available>)
     at /usr/src/sys/netgraph/ng_ether.c:742
#14 0xffffffff82c76dab in ng_apply_item 
(node=node@entry=0xfffff812992fe600,
     item=item@entry=0xfffff8132d74f880, rw=0)
     at /usr/src/sys/netgraph/ng_base.c:2406
#15 0xffffffff82c7638d in ng_snd_item (item=0xfffff8132d74f880,
     item@entry=<error reading variable: value is not available>, 
flags=0,
     flags@entry=<error reading variable: value is not available>)
     at /usr/src/sys/netgraph/ng_base.c:2323
#16 0xffffffff82c76dab in ng_apply_item 
(node=node@entry=0xfffff8040b1eda00,
     item=item@entry=0xfffff8132d74f880, rw=0)
     at /usr/src/sys/netgraph/ng_base.c:2406
#17 0xffffffff82c7638d in ng_snd_item 
(item=item@entry=0xfffff8132d74f880,
     flags=flags@entry=0) at /usr/src/sys/netgraph/ng_base.c:2323
#18 0xffffffff82c8f33f in ng_ether_input (ifp=<optimized out>,
     ifp@entry=<error reading variable: value is not available>,
     mp=0xfffffe02ba63fcf8,
     mp@entry=<error reading variable: value is not available>)
     at /usr/src/sys/netgraph/ng_ether.c:255
#19 0xffffffff805e21d7 in ether_input_internal (ifp=0xfffff80114a43000,
     m=0xfffff81f8203e600) at /usr/src/sys/net/if_ethersubr.c:661
#20 ether_nh_input (m=<optimized out>,
     m@entry=<error reading variable: value is not available>)
     at /usr/src/sys/net/if_ethersubr.c:742
#21 0xffffffff805e5587 in netisr_dispatch_src (proto=proto@entry=5,
     source=source@entry=0, m=m@entry=0xfffff81f8203e600)
     at /usr/src/sys/net/netisr.c:1153
#22 0xffffffff805e58df in netisr_dispatch (proto=<unavailable>,
     proto@entry=5, m=<unavailable>, m@entry=0xfffff81f8203e600)
     at /usr/src/sys/net/netisr.c:1244
#23 0xffffffff805e138d in ether_input (ifp=0xfffff80114a43000,
     m=0xfffff81f8203e600) at /usr/src/sys/net/if_ethersubr.c:833
#24 0xffffffff821a934d in bce_rx_intr (sc=0xfffffe02adda0000)
     at /usr/src/sys/dev/bce/if_bce.c:6721
#25 bce_intr (xsc=<optimized out>) at /usr/src/sys/dev/bce/if_bce.c:7870
#26 0xffffffff80490929 in intr_event_execute_handlers 
(ie=0xfffff80106acf400,
     p=<optimized out>) at /usr/src/sys/kern/kern_intr.c:1205
#27 ithread_execute_handlers (ie=0xfffff80106acf400, p=<optimized out>)
     at /usr/src/sys/kern/kern_intr.c:1218
#28 ithread_loop (arg=<optimized out>, arg@entry=0xfffff801269d4ec0)
     at /usr/src/sys/kern/kern_intr.c:1306
#29 0xffffffff8048d3a0 in fork_exit (
     callout=0xffffffff804906d0 <ithread_loop>, arg=0xfffff801269d4ec0,
     frame=0xfffffe02ba63ff40) at /usr/src/sys/kern/kern_fork.c:1102
#30 <signal handler called>
(kgdb)

> 
> core is available, and I can give access and/or send the core and
> kernel/debug stuff.

True for this one too.

-- 
Larry Rosenman                     http://www.lerctr.org/~ler
Phone: +1 214-642-9640                 E-Mail: ler@lerctr.org
US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?53727be0434c4c58ae66b8e979aee4f3>