From owner-freebsd-net@freebsd.org Mon Jun 24 18:32:02 2019 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 98EDD15D5D3D; Mon, 24 Jun 2019 18:32:02 +0000 (UTC) (envelope-from ler@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3F6CE82784; Mon, 24 Jun 2019 18:32:02 +0000 (UTC) (envelope-from ler@FreeBSD.org) Received: from ler-imac.local (unknown [IPv6:2600:1700:210:b180:4c24:fd26:d30c:ae75]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: ler/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id DDEB9942C; Mon, 24 Jun 2019 18:32:01 +0000 (UTC) (envelope-from ler@FreeBSD.org) Date: Mon, 24 Jun 2019 13:32:00 -0500 From: Larry Rosenman To: "freebsd-current@freebsd.org" Cc: freebsd-net@FreeBSD.org Subject: ng_snd_item: Panic? Message-ID: <20190624183200.hu4vzocjsopjsnnz@ler-imac.local> Mail-Followup-To: "freebsd-current@freebsd.org" , freebsd-net@FreeBSD.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="gcaxozx2unc7yqgi" Content-Disposition: inline User-Agent: NeoMutt/20180716 X-Rspamd-Queue-Id: 3F6CE82784 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-2.98 / 15.00]; local_wl_from(0.00)[FreeBSD.org]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; NEURAL_HAM_SHORT(-0.99)[-0.985,0]; ASN(0.00)[asn:11403, ipnet:2610:1c1:1::/48, country:US]; NEURAL_HAM_LONG(-1.00)[-1.000,0] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 24 Jun 2019 18:32:02 -0000 --gcaxozx2unc7yqgi Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Got 2 of these today, and I have cores.... Ideas? r349200. borg.lerctr.org dumped core - see /var/crash/vmcore.10 Mon Jun 24 08:36:45 CDT 2019 FreeBSD borg.lerctr.org 13.0-CURRENT FreeBSD 13.0-CURRENT r349200 LER-MINIM= AL amd64 panic: ng_snd_item: 42 !=3D 1414 GNU gdb (GDB) 8.3 [GDB v8.3 for FreeBSD] Copyright (C) 2019 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-portbld-freebsd13.0". Type "show configuration" for configuration details. For bug reporting instructions, please see: . Find the GDB manual and other documentation resources online at: . For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from /boot/kernel/kernel... Reading symbols from /usr/lib/debug//boot/kernel/kernel.debug... Unread portion of the kernel message buffer: panic: ng_snd_item: 42 !=3D 1414 cpuid =3D 10 time =3D 1561382494 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe012628d= 400 vpanic() at vpanic+0x19d/frame 0xfffffe012628d450 panic() at panic+0x43/frame 0xfffffe012628d4b0 ng_snd_item() at ng_snd_item+0x477/frame 0xfffffe012628d4f0 ng_ether_output() at ng_ether_output+0x5e/frame 0xfffffe012628d520 ether_output() at ether_output+0x473/frame 0xfffffe012628d5c0 arpintr() at arpintr+0xfe3/frame 0xfffffe012628d780 netisr_dispatch_src() at netisr_dispatch_src+0x89/frame 0xfffffe012628d7f0 ether_demux() at ether_demux+0x137/frame 0xfffffe012628d820 ng_ether_rcv_upper() at ng_ether_rcv_upper+0x95/frame 0xfffffe012628d840 ng_apply_item() at ng_apply_item+0xf1/frame 0xfffffe012628d8c0 ng_snd_item() at ng_snd_item+0x2ab/frame 0xfffffe012628d900 ng_apply_item() at ng_apply_item+0xf1/frame 0xfffffe012628d980 ng_snd_item() at ng_snd_item+0x2ab/frame 0xfffffe012628d9c0 ng_ether_input() at ng_ether_input+0x4c/frame 0xfffffe012628d9f0 ether_nh_input() at ether_nh_input+0x2cd/frame 0xfffffe012628da40 netisr_dispatch_src() at netisr_dispatch_src+0x89/frame 0xfffffe012628dab0 ether_input() at ether_input+0x48/frame 0xfffffe012628dad0 bce_intr() at bce_intr+0x697/frame 0xfffffe012628db50 ithread_loop() at ithread_loop+0x187/frame 0xfffffe012628dbb0 fork_exit() at fork_exit+0x84/frame 0xfffffe012628dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe012628dbf0 --- trap 0, rip =3D 0, rsp =3D 0, rbp =3D 0 --- Uptime: 4d18h45m34s Dumping 24921 out of 131026 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%= =2E.91% __curthread () at /usr/src/sys/amd64/include/pcpu.h:246 246 __asm("movq %%gs:%P1,%0" : "=3Dr" (td) : "n" (OFFSETOF_CURTHREAD)); (kgdb) #0 __curthread () at /usr/src/sys/amd64/include/pcpu.h:246 #1 doadump (textdump=3D1) at /usr/src/sys/kern/kern_shutdown.c:392 #2 0xffffffff804b41e0 in kern_reboot (howto=3D260) at /usr/src/sys/kern/kern_shutdown.c:479 #3 0xffffffff804b4659 in vpanic (fmt=3D, ap=3D) at /usr/src/sys/kern/kern_shutdown.c:905 #4 0xffffffff804b4393 in panic (fmt=3D) at /usr/src/sys/kern/kern_shutdown.c:832 #5 0xffffffff828ee5b7 in ng_snd_item (item=3D0xfffff8021e3b4d80, flags=3D0) at /usr/src/sys/netgraph/ng_base.c:2252 #6 0xffffffff82900c2e in ng_ether_output (ifp=3D,=20 mp=3D0xfffffe012628d578) at /usr/src/sys/netgraph/ng_ether.c:294 #7 0xffffffff805b1e43 in ether_output (ifp=3D,=20 m=3D0xfffff81f59eefb00, dst=3D0xfffffe012628d740, ro=3D) at /usr/src/sys/net/if_ethersubr.c:430 #8 0xffffffff805cb3e3 in in_arpinput (m=3D) at /usr/src/sys/netinet/if_ether.c:1152 #9 arpintr (m=3D0xfffff81f59eefb00) at /usr/src/sys/netinet/if_ether.c:749 #10 0xffffffff805bcf89 in netisr_dispatch_src (proto=3D4,=20 source=3D, m=3D) at /usr/src/sys/net/netisr= =2Ec:1123 #11 0xffffffff805b22d7 in ether_demux (ifp=3D0xfffff8012c902000,=20 m=3D) at /usr/src/sys/net/if_ethersubr.c:913 #12 0xffffffff82901045 in ng_ether_rcv_upper (hook=3D,=20 item=3D) at /usr/src/sys/netgraph/ng_ether.c:741 #13 0xffffffff828ee6e1 in ng_apply_item (node=3D0xfffff81054f43400,=20 item=3D0xfffff8021e3b4d80, rw=3D0) at /usr/src/sys/netgraph/ng_base.c:2= 403 #14 0xffffffff828ee3eb in ng_snd_item (item=3D0xfffff8021e3b4d80, flags=3D0) at /usr/src/sys/netgraph/ng_base.c:2320 #15 0xffffffff828ee6e1 in ng_apply_item (node=3D0xfffff8012c2d3e00,=20 item=3D0xfffff8021e3b4d80, rw=3D0) at /usr/src/sys/netgraph/ng_base.c:2= 403 #16 0xffffffff828ee3eb in ng_snd_item (item=3D0xfffff8021e3b4d80, flags=3D0) at /usr/src/sys/netgraph/ng_base.c:2320 #17 0xffffffff82900cbc in ng_ether_input (ifp=3D,=20 mp=3D0xfffffe012628da18) at /usr/src/sys/netgraph/ng_ether.c:255 #18 0xffffffff805b34fd in ether_input_internal (ifp=3D0xfffff8012c902000,= =20 m=3D0xfffff81f59eefb00) at /usr/src/sys/net/if_ethersubr.c:654 #19 ether_nh_input (m=3D) at /usr/src/sys/net/if_ethersubr.c= :735 #20 0xffffffff805bcf89 in netisr_dispatch_src (proto=3D5,=20 source=3D, m=3D) at /usr/src/sys/net/netisr= =2Ec:1123 #21 0xffffffff805b26f8 in ether_input (ifp=3D0xfffff8012c902000, m=3D0x0) at /usr/src/sys/net/if_ethersubr.c:823 #22 0xffffffff8273c7f7 in bce_rx_intr (sc=3D) at /usr/src/sys/dev/bce/if_bce.c:6848 #23 bce_intr (xsc=3D0xfffffe01665c2000) at /usr/src/sys/dev/bce/if_bce.c:80= 17 #24 0xffffffff8047e0e7 in intr_event_execute_handlers (p=3D,= =20 ie=3D) at /usr/src/sys/kern/kern_intr.c:1148 #25 ithread_execute_handlers (p=3D, ie=3D) at /usr/src/sys/kern/kern_intr.c:1161 #26 ithread_loop (arg=3D) at /usr/src/sys/kern/kern_intr.c:1= 241 #27 0xffffffff8047ac74 in fork_exit ( callout=3D0xffffffff8047df60 , arg=3D0xfffff8012c883100,= =20 frame=3D0xfffffe012628dc00) at /usr/src/sys/kern/kern_fork.c:1056 #28 (kgdb)=20 --=20 Larry Rosenman https://people.FreeBSD.org/~ler/ Phone: +1 214-642-9640 E-Mail: ler@FreeBSD.org US Mail: 5708 Sabbia Drive, Round Rock, TX 78665-2106 --gcaxozx2unc7yqgi Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQHBBAABCgCrFiEEHjgknedhWzvJgwVzaXyZsatIp30FAl0RFyAtFIAAAAAAFQAP cGthLWFkZHJlc3NAZ251cGcub3JnbGVyQEZyZWVCU0Qub3JnXxSAAAAAAC4AKGlz c3Vlci1mcHJAbm90YXRpb25zLm9wZW5wZ3AuZmlmdGhob3JzZW1hbi5uZXQxRTM4 MjQ5REU3NjE1QjNCQzk4MzA1NzM2OTdDOTlCMUFCNDhBNzdEAAoJEGl8mbGrSKd9 PgUH/0GaHIrfcg0OHFey8JC/dZXpR4Zi1L9HErhGrMDf7fWzAuhcpSS0EgKr97X+ ClpCCqZaef8DD8A3R4Ptuw/aASe6UT0AHCuufeCWEctKWIcijh898yybkj4nDkGk 8L6f++8mneWgImNbsDus5dKfNUloyrVZPNkMYbiMvM6t7kxgRDuNEGgkOrsl1dTV PUXfkAO+60ILoAufQBQJH25KLhRN+4SJbd8W1ECMvu5ouvFvmQp46MlWRVIa2FQl tQ1jm0PLGiQguEbvWPd4xQD7Q7t6PWuEeY8hhWo9rrqW7epSvo6zXj+uB9s8bDTJ 5yg79gXPJrbDpGAXyhJGvOPNAfE= =2HZZ -----END PGP SIGNATURE----- --gcaxozx2unc7yqgi--