From nobody Sat Feb 19 20:20:58 2022 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 6CA4419C0B1F for ; Sat, 19 Feb 2022 20:21:13 +0000 (UTC) (envelope-from ler@lerctr.org) Received: from thebighonker.lerctr.org (thebighonker.lerctr.org [192.147.25.65]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "*.lerctr.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4K1KhS0phkz3qDP; Sat, 19 Feb 2022 20:21:12 +0000 (UTC) (envelope-from ler@lerctr.org) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lerctr.org; s=ler2019; h=Content-Transfer-Encoding:Content-Type:Message-ID:References: In-Reply-To:Subject:To:From:Date:MIME-Version:Sender:Reply-To:Cc:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:List-Id:List-Help:List-Unsubscribe:List-Subscribe: List-Post:List-Owner:List-Archive; bh=kOBKfar3BtaZVrC4OsmVnT6vCBO6qth7itily/iG/yQ=; b=Roxn5tRkk5MJlDo2uR+cdV/z6Z 9mfZ0dD6P1aFsYTupwZVxmmRWbXdZTjW4T8wyz2HcxfWhGQyK9A34q55u5Duosvt1zRl9/dAUAkvL h+DoXpAdCGGeJO37kavFwdsBFFmyz1oRIQXIVg/Y+FVn8TSaNFYwU1naIG+lqZPjLCiRKWT2hzzZE 1y/rL6JKl4HiMyMzeUOxlTHUoe70IV3jQm8JOP8Dl/eKPezvMivRrt9IkUXiC90IMwv6s/s/NTN/J 0qg0j46nPL9BA7FQkrUWNGtK8CfURUXl5i0wuLLXMTjRtx0KkdDf4WUUojw2DxD9ip25iGiddEkNx uoOzoiRw==; Received-SPF: pass (thebighonker.lerctr.org: domain of lerctr.org designates 2001:470:1f0f:3ad:bb:dcff:fe50:d900 as permitted sender) client-ip=2001:470:1f0f:3ad:bb:dcff:fe50:d900; envelope-from=ler@lerctr.org; helo=webmail.lerctr.org; Received: from thebighonker.lerctr.org ([2001:470:1f0f:3ad:bb:dcff:fe50:d900]:61180 helo=webmail.lerctr.org) by thebighonker.lerctr.org with esmtpsa (TLS1.3) tls TLS_AES_256_GCM_SHA384 (Exim 4.95 (FreeBSD)) (envelope-from ) id 1nLWDy-00056a-Qm; Sat, 19 Feb 2022 14:20:58 -0600 Received: from 2600:1700:210:b18f:c546:ed3:6648:c04e by webmail.lerctr.org with HTTP (HTTP/1.1 POST); Sat, 19 Feb 2022 14:20:58 -0600 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Date: Sat, 19 Feb 2022 14:20:58 -0600 From: Larry Rosenman To: Freebsd current , Mark Johnston Subject: Re: Panic, CURRENT, yesterday In-Reply-To: <53727be0434c4c58ae66b8e979aee4f3@lerctr.org> References: <1ae8c6664f33959f69be4d61a8c545f3@lerctr.org> <53727be0434c4c58ae66b8e979aee4f3@lerctr.org> Message-ID: <1fb31da3589a7f96e9bdad33b38934c8@lerctr.org> X-Sender: ler@lerctr.org Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4K1KhS0phkz3qDP X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=lerctr.org header.s=ler2019 header.b=Roxn5tRk; dmarc=pass (policy=none) header.from=lerctr.org; spf=pass (mx1.freebsd.org: domain of ler@lerctr.org designates 192.147.25.65 as permitted sender) smtp.mailfrom=ler@lerctr.org X-Spamd-Result: default: False [-4.00 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[lerctr.org:s=ler2019]; FREEFALL_USER(0.00)[ler]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCVD_COUNT_THREE(0.00)[3]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[lerctr.org:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[lerctr.org,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; MLMMJ_DEST(0.00)[freebsd-current]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:8166, ipnet:192.147.25.0/24, country:US]; MID_RHS_MATCH_FROM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N On 02/09/2022 10:08 pm, Larry Rosenman wrote: > Another one today: > ❯ more /var/crash/core.txt.1 > borg.lerctr.org dumped core - see /var/crash/vmcore.1 > > Wed Feb 9 19:30:43 CST 2022 > >> >> core is available, and I can give access and/or send the core and >> kernel/debug stuff. > > True for this one too. Yet another one: ❯ more core.txt.3 borg.lerctr.org dumped core - see /var/crash/vmcore.3 Sat Feb 19 00:42:59 CST 2022 FreeBSD borg.lerctr.org 14.0-CURRENT FreeBSD 14.0-CURRENT #56 ler/freebsd-main-changes-n253181-c140933ef40: Tue Feb 15 12:26:23 CST 2022 root@borg.lerctr.org:/usr/obj/usr/src/amd64.amd64/sys/LER-MINIMAL amd64 panic: ng_snd_item: 42 != 173 GNU gdb (GDB) 11.2 [GDB v11.2 for FreeBSD] Copyright (C) 2022 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-portbld-freebsd14.0". Type "show configuration" for configuration details. For bug reporting instructions, please see: . Find the GDB manual and other documentation resources online at: . For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from /boot/kernel/kernel... Reading symbols from /usr/lib/debug//boot/kernel/kernel.debug... Unread portion of the kernel message buffer: panic: ng_snd_item: 42 != 173 cpuid = 0 time = 1645251876 KDB: stack backtrace: #0 0xffffffff80516005 at kdb_backtrace+0x65 #1 0xffffffff804cba7f at vpanic+0x17f #2 0xffffffff804cb853 at panic+0x43 #3 0xffffffff82c755b7 at ng_snd_item+0x587 #4 0xffffffff82c8e263 at ng_ether_output+0xb3 #5 0xffffffff805e0e2d at ether_output+0x6cd #6 0xffffffff805f6461 at arpintr+0xd71 #7 0xffffffff805e5797 at netisr_dispatch_src+0x97 #8 0xffffffff805e112e at ether_demux+0x14e #9 0xffffffff82c8e89c at ng_ether_rcv_upper+0x12c #10 0xffffffff82c75dab at ng_apply_item+0x7eb #11 0xffffffff82c7538d at ng_snd_item+0x35d #12 0xffffffff82c75dab at ng_apply_item+0x7eb #13 0xffffffff82c7538d at ng_snd_item+0x35d #14 0xffffffff82c8e33f at ng_ether_input+0x9f #15 0xffffffff805e23e7 at ether_nh_input+0x217 #16 0xffffffff805e5797 at netisr_dispatch_src+0x97 #17 0xffffffff805e159d at ether_input+0x5d Uptime: 2d6h42m17s Dumping 29172 out of 131023 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 55 __asm("movq %%gs:%P1,%0" : "=r" (td) : "n" (offsetof(struct pcpu, (kgdb) #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 #1 doadump (textdump=) at /usr/src/sys/kern/kern_shutdown.c:399 #2 0xffffffff804cb68f in kern_reboot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:487 #3 0xffffffff804cbaee in vpanic (fmt=0xffffffff82c7ed98 "%s: %d != %d", ap=) at /usr/src/sys/kern/kern_shutdown.c:920 #4 0xffffffff804cb853 in panic (fmt=) at /usr/src/sys/kern/kern_shutdown.c:844 #5 0xffffffff82c755b7 in ng_snd_item (item=0xfffff8131de0bd80, flags=0) at /usr/src/sys/netgraph/ng_base.c:2256 #6 0xffffffff82c8e263 in ng_ether_output (ifp=, ifp@entry=, mp=0xfffffe025a044868, mp@entry=) at /usr/src/sys/netgraph/ng_ether.c:294 #7 0xffffffff805e0e2d in ether_output (ifp=0xfffff8010cfe0800, m=0xfffff81d2e92b000, dst=, ro=) at /usr/src/sys/net/if_ethersubr.c:427 #8 0xffffffff805f6461 in in_arpinput (m=0xfffff81d2e92b000) at /usr/src/sys/netinet/if_ether.c:1129 #9 arpintr (m=0xfffff81d2e92b000, m@entry=) at /usr/src/sys/netinet/if_ether.c:739 #10 0xffffffff805e5797 in netisr_dispatch_src (proto=4, source=source@entry=0, m=0xfffff81d2e92b000) at /usr/src/sys/net/netisr.c:1153 #11 0xffffffff805e5aef in netisr_dispatch (proto=, m=) at /usr/src/sys/net/netisr.c:1244 #12 0xffffffff805e112e in ether_demux (ifp=ifp@entry=0xfffff8010cfe0800, m=, m@entry=0xfffff81d2e92b000) at /usr/src/sys/net/if_ethersubr.c:926 #13 0xffffffff82c8e89c in ng_ether_rcv_upper (hook=, hook@entry=, item=0xfffff8131de0bd80, item@entry=) at /usr/src/sys/netgraph/ng_ether.c:742 #14 0xffffffff82c75dab in ng_apply_item (node=node@entry=0xfffff81365630b00, item=item@entry=0xfffff8131de0bd80, rw=0) at /usr/src/sys/netgraph/ng_base.c:2406 #15 0xffffffff82c7538d in ng_snd_item (item=0xfffff8131de0bd80, item@entry=, flags=0, flags@entry=) at /usr/src/sys/netgraph/ng_base.c:2323 #16 0xffffffff82c75dab in ng_apply_item (node=node@entry=0xfffff813660f8500, item=item@entry=0xfffff8131de0bd80, rw=0) at /usr/src/sys/netgraph/ng_base.c:2406 #17 0xffffffff82c7538d in ng_snd_item (item=item@entry=0xfffff8131de0bd80, flags=flags@entry=0) at /usr/src/sys/netgraph/ng_base.c:2323 #18 0xffffffff82c8e33f in ng_ether_input (ifp=, ifp@entry=, mp=0xfffffe025a044cf8, mp@entry=) at /usr/src/sys/netgraph/ng_ether.c:255 #19 0xffffffff805e23e7 in ether_input_internal (ifp=0xfffff8010cfe0800, m=0xfffff81d2e92b000) at /usr/src/sys/net/if_ethersubr.c:661 #20 ether_nh_input (m=, m@entry=) at /usr/src/sys/net/if_ethersubr.c:742 #21 0xffffffff805e5797 in netisr_dispatch_src (proto=proto@entry=5, source=source@entry=0, m=m@entry=0xfffff81d2e92b000) at /usr/src/sys/net/netisr.c:1153 #22 0xffffffff805e5aef in netisr_dispatch (proto=, proto@entry=5, m=, m@entry=0xfffff81d2e92b000) at /usr/src/sys/net/netisr.c:1244 #23 0xffffffff805e159d in ether_input (ifp=0xfffff8010cfe0800, m=0xfffff81d2e92b000) at /usr/src/sys/net/if_ethersubr.c:833 #24 0xffffffff821a734d in bce_rx_intr (sc=0xfffffe02a3690000) at /usr/src/sys/dev/bce/if_bce.c:6721 #25 bce_intr (xsc=) at /usr/src/sys/dev/bce/if_bce.c:7870 #26 0xffffffff80490729 in intr_event_execute_handlers (ie=0xfffff80101b05900, p=) at /usr/src/sys/kern/kern_intr.c:1205 #27 ithread_execute_handlers (ie=0xfffff80101b05900, p=) at /usr/src/sys/kern/kern_intr.c:1218 #28 ithread_loop (arg=, arg@entry=0xfffff8012e073a80) at /usr/src/sys/kern/kern_intr.c:1306 #29 0xffffffff8048d1a0 in fork_exit ( callout=0xffffffff804904d0 , arg=0xfffff8012e073a80, frame=0xfffffe025a044f40) at /usr/src/sys/kern/kern_fork.c:1102 #30 #31 0x0000284dcd80544a in ?? () Backtrace stopped: Cannot access memory at address 0x284dd4baff48 (kgdb) Core/kernel/debug/access available on request. -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 E-Mail: ler@lerctr.org US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106