Date: Mon, 21 Feb 2022 23:42:28 +0000 From: Michael Jung <mikej@paymentallianceintl.com> To: Hans Petter Selasky <hps@selasky.org>, freebsd-current <freebsd-current@freebsd.org> Subject: RE: New panic in main-n253273-a52d8d4a6c6: Message-ID: <924c13764ce342cf968ef9a93699be9a@MAIL-HUB.pai.local> References: <b7ca5b5e7a9a4df3951a2cb2f1d63552@MAIL-HUB.pai.local> <d04c0d93-8168-f53a-a5fd-865a1f6d2486@selasky.org> <6fcc161dd23b4f7ebe7cc789f11c017e@MAIL-HUB.pai.local> <dbd20a4d-b5a3-390e-a231-8ccca4f64c70@selasky.org>
next in thread | previous in thread | raw e-mail | index | archive | help
--MCBoundary=_12202211842315431
Content-Language: en-US
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: base64
SGk6DQoNCkkgd2FzIHRyeWluZyB0byByZW1lbWJlciB3aGF0IEkgZGlkIHRoYXQgd2FzIG9kZCB3
aGVuIHRoaXMgY3Jhc2ggb2NjdXJyZWQgdGhlbiBpdA0KaGl0IG1lLiAgWW91IGNhbiByZXBlYXQg
dGhpcyBwYW5pYyBieSBkb2luZzoNCg0KIyB3YXRjaCAtSSAtVyBwdHMvMA0KDQpIZXJlIGlzIGFu
b3RoZXIgcGFuaWMgdGhhdCBoYXBwZW5lZCB3cml0ZSBhZnRlciBpc3N1aW5nICJ3YXRjaCIgZm9y
IGNvbXBhcmlzb24uDQoNCmh0dHA6Ly9tYWlsLm1pa2VqLmNvbS9jb3JlLnR4dC4xDQoNCmh0dHA6
Ly9tYWlsLm1pa2VqLmNvbS9pbmZvLjENCg0KaHR0cDovL21haWwubWlrZWouY29tL3ZtY29yZS4x
DQoNCi0tbWlrZWoNCg0KLS0tLS1PcmlnaW5hbCBNZXNzYWdlLS0tLS0NCkZyb206IE1pY2hhZWwg
SnVuZw0KU2VudDogTW9uZGF5LCBGZWJydWFyeSAyMSwgMjAyMiA2OjIyIFBNDQpUbzogJ0hhbnMg
UGV0dGVyIFNlbGFza3knIDxocHNAc2VsYXNreS5vcmc+OyBmcmVlYnNkLWN1cnJlbnQgPGZyZWVi
c2QtY3VycmVudEBmcmVlYnNkLm9yZz4NClN1YmplY3Q6IFJFOiBOZXcgcGFuaWMgaW4gbWFpbi1u
MjUzMjczLWE1MmQ4ZDRhNmM2Og0KDQoNCg0KLS0tLS1PcmlnaW5hbCBNZXNzYWdlLS0tLS0NCkZy
b206IEhhbnMgUGV0dGVyIFNlbGFza3kgW21haWx0bzpocHNAc2VsYXNreS5vcmddDQpTZW50OiBN
b25kYXksIEZlYnJ1YXJ5IDIxLCAyMDIyIDg6NTMgQU0NClRvOiBNaWNoYWVsIEp1bmcgPG1pa2Vq
QHBheW1lbnRhbGxpYW5jZWludGwuY29tPjsgZnJlZWJzZC1jdXJyZW50IDxmcmVlYnNkLWN1cnJl
bnRAZnJlZWJzZC5vcmc+DQpTdWJqZWN0OiBSZTogTmV3IHBhbmljIGluIG1haW4tbjI1MzI3My1h
NTJkOGQ0YTZjNjoNCg0KT24gMi8yMS8yMiAxNDowNywgTWljaGFlbCBKdW5nIHdyb3RlOg0KPiAo
a2dkYikgZnJhbSAxNg0KPiAjMTYgMHhmZmZmZmZmZjgwYmFkNTg3IGluIGNsb3NlZnBfaW1wbCAo
ZmRwPTB4ZmZmZmZlMDEyYjdjMDQzMCwgZmQ9NCwgZnA9MHhmZmZmZjgwMWNjMTE5MjgwLCB0ZD0w
eGZmZmZmZTAwZGY4ZDA1NjAsIGF1ZGl0PXRydWUpIGF0IC91c3Ivc3JjL3N5cy9rZXJuL2tlcm5f
ZGVzY3JpcC5jOjEzMDANCj4gMTMwMCAgICAgICAgICAgIGVycm9yID0gY2xvc2VmKGZwLCB0ZCk7
DQo+DQo+IChrZ2RiKSBwcmludCAveCAqZmRwDQo+ICQxID0ge2ZkX2ZpbGVzID0gMHhmZmZmZmUw
MGRmNmQ5MDAwLCBmZF9tYXAgPSAweGZmZmZmODAwMDFiYjE4MDAsIGZkX2ZyZWVmaWxlID0gMHg0
LCBmZF9yZWZjbnQgPSAweDEsIGZkX2hvbGRjbnQgPSAweDEsIGZkX3N4ID0ge2xvY2tfb2JqZWN0
ID0ge2xvX25hbWUgPSAweGZmZmZmZmZmODEyNGY2YTksIGxvX2ZsYWdzID0gMHgyMzMwMDAwLCBs
b19kYXRhID0gMHgwLA0KPiAgICAgICAgbG9fd2l0bmVzcyA9IDB4ZmZmZmY4MDQxZWI5NDAwMH0s
IHN4X2xvY2sgPSAweDF9LCBmZF9rcWxpc3QgPQ0KPiB7dHFoX2ZpcnN0ID0gMHgwLCB0cWhfbGFz
dCA9IDB4MH0sIGZkX2hvbGRsZWFkZXJzY291bnQgPSAweDAsDQo+IGZkX2hvbGRsZWFkZXJzd2Fr
ZXVwID0gMHgwfQ0KPiAoa2dkYikNCg0KQ2FuIHlvdSBhbHNvOg0KDQpwcmludCAveCAqZnANCg0K
aW4gdGhlIHNhbWUgZnJhbWU/DQoNCi0tSFBTDQoNCg0KDQpVbnJlYWQgcG9ydGlvbiBvZiB0aGUg
a2VybmVsIG1lc3NhZ2UgYnVmZmVyOg0KcGFuaWM6IHJlZmNvdW50IDB4ZmZmZmY4MDFjYzExOTI4
NCB3cmFwYXJvdW5kIGNwdWlkID0gNyB0aW1lID0gMTY0NTM4MjU3NQ0KS0RCOiBzdGFjayBiYWNr
dHJhY2U6DQpkYl90cmFjZV9zZWxmX3dyYXBwZXIoKSBhdCBkYl90cmFjZV9zZWxmX3dyYXBwZXIr
MHgyYi9mcmFtZSAweGZmZmZmZTAxMTlhODNjODANCnZwYW5pYygpIGF0IHZwYW5pYysweDE3Zi9m
cmFtZSAweGZmZmZmZTAxMTlhODNjZDANCnBhbmljKCkgYXQgcGFuaWMrMHg0My9mcmFtZSAweGZm
ZmZmZTAxMTlhODNkMzANCmZkY2xvc2UoKSBhdCBmZGNsb3NlL2ZyYW1lIDB4ZmZmZmZlMDExOWE4
M2RjMA0KY2xvc2VmcF9pbXBsKCkgYXQgY2xvc2VmcF9pbXBsKzB4NzcvZnJhbWUgMHhmZmZmZmUw
MTE5YTgzZTAwDQphbWQ2NF9zeXNjYWxsKCkgYXQgYW1kNjRfc3lzY2FsbCsweDEyZS9mcmFtZSAw
eGZmZmZmZTAxMTlhODNmMzANCmZhc3Rfc3lzY2FsbF9jb21tb24oKSBhdCBmYXN0X3N5c2NhbGxf
Y29tbW9uKzB4ZjgvZnJhbWUgMHhmZmZmZmUwMTE5YTgzZjMwDQotLS0gc3lzY2FsbCAoNiwgRnJl
ZUJTRCBFTEY2NCwgc3lzX2Nsb3NlKSwgcmlwID0gMHgzMzA5YTUzMWI2MmEsIHJzcCA9IDB4MzMw
OWEyODAyYmM4LCByYnAgPSAweDMzMDlhMjgwMzAwMCAtLS0NCktEQjogZW50ZXI6IHBhbmljDQoN
Cl9fY3VydGhyZWFkICgpIGF0IC91c3Ivc3JjL3N5cy9hbWQ2NC9pbmNsdWRlL3BjcHVfYXV4Lmg6
NTUNCjU1ICAgICAgICAgICAgICBfX2FzbSgibW92cSAlJWdzOiVQMSwlMCIgOiAiPXIiICh0ZCkg
OiAibiIgKG9mZnNldG9mKHN0cnVjdCBwY3B1LA0KDQoNCihrZ2RiKSBmcmFtZSAxNg0KIzE2IDB4
ZmZmZmZmZmY4MGJhZDU4NyBpbiBjbG9zZWZwX2ltcGwgKGZkcD0weGZmZmZmZTAxMmI3YzA0MzAs
IGZkPTQsIGZwPTB4ZmZmZmY4MDFjYzExOTI4MCwgdGQ9MHhmZmZmZmUwMGRmOGQwNTYwLCBhdWRp
dD10cnVlKSBhdCAvdXNyL3NyYy9zeXMva2Vybi9rZXJuX2Rlc2NyaXAuYzoxMzAwDQoxMzAwICAg
ICAgICAgICAgZXJyb3IgPSBjbG9zZWYoZnAsIHRkKTsNCg0KDQooa2dkYikgcHJpbnQgL3ggKmZw
DQokMSA9IHtmX2ZsYWcgPSAweDUsIGZfY291bnQgPSAweGZmZmZmZmZmLCBmX2RhdGEgPSAweGZm
ZmZmODAwMTU4YjA0MDAsIGZfb3BzID0gMHhmZmZmZmZmZjgxYjA1MmQwLCBmX3Zub2RlID0gMHhm
ZmZmZjgwMGQ5MTU2MDAwLCBmX2NyZWQgPSAweGZmZmZmODAxZDgxYmU0MDAsIGZfdHlwZSA9IDB4
MSwgZl92bnJlYWRfZmxhZ3MgPSAweDAsIHtmX3NlcWNvdW50ID0gezB4MCwNCiAgICAgIDB4MH0s
IGZfcGlwZWdlbiA9IDB4MH0sIGZfbmV4dG9mZiA9IHsweDAsIDB4MH0sIGZfdm51biA9IHtmdm5f
Y2RldnByaXYgPSAweDAsIGZ2bl9hZHZpY2UgPSAweDB9LCBmX29mZnNldCA9IDB4MH0NCihrZ2Ri
KQ0KDQoNCg0KDQpDT05GSURFTlRJQUxJVFkgTk9URTogVGhpcyBtZXNzYWdlIGlzIGludGVuZGVk
IG9ubHkgZm9yIHRoZSB1c2UNCm9mIHRoZSBpbmRpdmlkdWFsIG9yIGVudGl0eSB0byB3aG9tIGl0
IGlzIGFkZHJlc3NlZCBhbmQgbWF5DQpjb250YWluIGluZm9ybWF0aW9uIHRoYXQgaXMgcHJpdmls
ZWdlZCwgY29uZmlkZW50aWFsLCBhbmQNCmV4ZW1wdCBmcm9tIGRpc2Nsb3N1cmUgdW5kZXIgYXBw
bGljYWJsZSBsYXcuIElmIHRoZSByZWFkZXINCm9mIHRoaXMgbWVzc2FnZSBpcyBub3QgdGhlIGlu
dGVuZGVkIHJlY2lwaWVudCwgeW91IGFyZSBoZXJlYnkNCm5vdGlmaWVkIHRoYXQgYW55IGRpc3Nl
bWluYXRpb24sIGRpc3RyaWJ1dGlvbiBvciBjb3B5aW5nDQpvZiB0aGlzIGNvbW11bmljYXRpb24g
aXMgc3RyaWN0bHkgcHJvaGliaXRlZC4gSWYgeW91IGhhdmUNCnJlY2VpdmVkIHRoaXMgdHJhbnNt
aXNzaW9uIGluIGVycm9yLCBwbGVhc2Ugbm90aWZ5IHVzIGJ5DQp0ZWxlcGhvbmUgYXQgKDUwMikg
MjEyLTQwMDAgb3Igbm90aWZ5IHVzIGF0IFBBSSwgRGVwdC4gOTksDQoyMTAxIEhpZ2ggV2lja2hh
bSBQbGFjZSwgU3VpdGUgMTAxLCBMb3Vpc3ZpbGxlLCBLWSA0MDI0NQ0KDQpEaXNjbGFpbWVyDQoN
ClRoZSBpbmZvcm1hdGlvbiBjb250YWluZWQgaW4gdGhpcyBjb21tdW5pY2F0aW9uIGZyb20gdGhl
IHNlbmRlciBpcyBjb25maWRlbnRpYWwuIEl0IGlzIGludGVuZGVkIHNvbGVseSBmb3IgdXNlIGJ5
IHRoZSByZWNpcGllbnQgYW5kIG90aGVycyBhdXRob3JpemVkIHRvIHJlY2VpdmUgaXQuIElmIHlv
dSBhcmUgbm90IHRoZSByZWNpcGllbnQsIHlvdSBhcmUgaGVyZWJ5IG5vdGlmaWVkIHRoYXQgYW55
IGRpc2Nsb3N1cmUsIGNvcHlpbmcsIGRpc3RyaWJ1dGlvbiBvciB0YWtpbmcgYWN0aW9uIGluIHJl
bGF0aW9uIG9mIHRoZSBjb250ZW50cyBvZiB0aGlzIGluZm9ybWF0aW9uIGlzIHN0cmljdGx5IHBy
b2hpYml0ZWQgYW5kIG1heSBiZSB1bmxhd2Z1bC4NCg0KVGhpcyBlbWFpbCBoYXMgYmVlbiBzY2Fu
bmVkIGZvciB2aXJ1c2VzIGFuZCBtYWx3YXJlLCBhbmQgbWF5IGhhdmUgYmVlbiBhdXRvbWF0aWNh
bGx5IGFyY2hpdmVkIGJ5IE1pbWVjYXN0LCBhIGxlYWRlciBpbiBlbWFpbCBzZWN1cml0eSBhbmQg
Y3liZXIgcmVzaWxpZW5jZS4gTWltZWNhc3QgaW50ZWdyYXRlcyBlbWFpbCBkZWZlbnNlcyB3aXRo
IGJyYW5kIHByb3RlY3Rpb24sIHNlY3VyaXR5IGF3YXJlbmVzcyB0cmFpbmluZywgd2ViIHNlY3Vy
aXR5LCBjb21wbGlhbmNlIGFuZCBvdGhlciBlc3NlbnRpYWwgY2FwYWJpbGl0aWVzLiBNaW1lY2Fz
dCBoZWxwcyBwcm90ZWN0IGxhcmdlIGFuZCBzbWFsbCBvcmdhbml6YXRpb25zIGZyb20gbWFsaWNp
b3VzIGFjdGl2aXR5LCBodW1hbiBlcnJvciBhbmQgdGVjaG5vbG9neSBmYWlsdXJlOyBhbmQgdG8g
bGVhZCB0aGUgbW92ZW1lbnQgdG93YXJkIGJ1aWxkaW5nIGEgbW9yZSByZXNpbGllbnQgd29ybGQu
IFRvIGZpbmQgb3V0IG1vcmUsIHZpc2l0IG91ciB3ZWJzaXRlLg0K
--MCBoundary=_12202211842315431
Content-Transfer-Encoding: quoted-printable
Content-Type: text/html; charset=UTF-8
<html><head><style type=3D"text/css">.style1 {font-family: "Times New Roman=
";}</style></head><body>Hi:<BR>
<BR>
I was trying to remember what I did that was odd when this crash occurred t=
hen it<BR>
hit me. You can repeat this panic by doing:<BR>
<BR>
# watch -I -W pts/0<BR>
<BR>
Here is another panic that happened write after issuing "watch" f=
or comparison.<BR>
<BR>
<a href=3D"http://mail.mikej.com/core.txt.1" target=3D"_blank">http://mail.=
mikej.com/core.txt.1</a><BR>
<BR>
<a href=3D"http://mail.mikej.com/info.1" target=3D"_blank">http://mail.mike=
j.com/info.1</a><BR>
<BR>
<a href=3D"http://mail.mikej.com/vmcore.1" target=3D"_blank">http://mail.mi=
kej.com/vmcore.1</a><BR>
<BR>
--mikej<BR>
<BR>
-----Original Message-----<BR>
From: Michael Jung<BR>
Sent: Monday, February 21, 2022 6:22 PM<BR>
To: 'Hans Petter Selasky' <hps@selasky.org>; freebsd-current <free=
bsd-current@freebsd.org><BR>
Subject: RE: New panic in main-n253273-a52d8d4a6c6:<BR>
<BR>
<BR>
<BR>
-----Original Message-----<BR>
From: Hans Petter Selasky [mailto:hps@selasky.org]<BR>
Sent: Monday, February 21, 2022 8:53 AM<BR>
To: Michael Jung <mikej@paymentallianceintl.com>; freebsd-current <=
;freebsd-current@freebsd.org><BR>
Subject: Re: New panic in main-n253273-a52d8d4a6c6:<BR>
<BR>
On 2/21/22 14:07, Michael Jung wrote:<BR>
> (kgdb) fram 16<BR>
> #16 0xffffffff80bad587 in closefp_impl (fdp=3D0xfffffe012b7c0430, fd=
=3D4, fp=3D0xfffff801cc119280, td=3D0xfffffe00df8d0560, audit=3Dtrue) at /u=
sr/src/sys/kern/kern_descrip.c:1300<BR>
> 1300 error =3D closef(fp, td);<BR>
><BR>
> (kgdb) print /x *fdp<BR>
> $1 =3D {fd_files =3D 0xfffffe00df6d9000, fd_map =3D 0xfffff80001bb1800=
, fd_freefile =3D 0x4, fd_refcnt =3D 0x1, fd_holdcnt =3D 0x1, fd_sx =3D {lo=
ck_object =3D {lo_name =3D 0xffffffff8124f6a9, lo_flags =3D 0x2330000, lo_d=
ata =3D 0x0,<BR>
> lo_witness =3D 0xfffff8041eb94000}, sx_lock =3D 0x1}, fd_kqlist=
=3D<BR>
> {tqh_first =3D 0x0, tqh_last =3D 0x0}, fd_holdleaderscount =3D 0x0,<BR=
>
> fd_holdleaderswakeup =3D 0x0}<BR>
> (kgdb)<BR>
<BR>
Can you also:<BR>
<BR>
print /x *fp<BR>
<BR>
in the same frame?<BR>
<BR>
--HPS<BR>
<BR>
<BR>
<BR>
Unread portion of the kernel message buffer:<BR>
panic: refcount 0xfffff801cc119284 wraparound cpuid =3D 7 time =3D 16453825=
75<BR>
KDB: stack backtrace:<BR>
db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0119a83=
c80<BR>
vpanic() at vpanic+0x17f/frame 0xfffffe0119a83cd0<BR>
panic() at panic+0x43/frame 0xfffffe0119a83d30<BR>
fdclose() at fdclose/frame 0xfffffe0119a83dc0<BR>
closefp_impl() at closefp_impl+0x77/frame 0xfffffe0119a83e00<BR>
amd64_syscall() at amd64_syscall+0x12e/frame 0xfffffe0119a83f30<BR>
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0119a83f30<=
BR>
--- syscall (6, FreeBSD ELF64, sys_close), rip =3D 0x3309a531b62a, rsp =3D =
0x3309a2802bc8, rbp =3D 0x3309a2803000 ---<BR>
KDB: enter: panic<BR>
<BR>
__curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55<BR>
55 __asm("movq %%gs:%P1,%0" : "=3Dr" (td) =
: "n" (offsetof(struct pcpu,<BR>
<BR>
<BR>
(kgdb) frame 16<BR>
#16 0xffffffff80bad587 in closefp_impl (fdp=3D0xfffffe012b7c0430, fd=3D4, f=
p=3D0xfffff801cc119280, td=3D0xfffffe00df8d0560, audit=3Dtrue) at /usr/src/=
sys/kern/kern_descrip.c:1300<BR>
1300 error =3D closef(fp, td);<BR>
<BR>
<BR>
(kgdb) print /x *fp<BR>
$1 =3D {f_flag =3D 0x5, f_count =3D 0xffffffff, f_data =3D 0xfffff800158b04=
00, f_ops =3D 0xffffffff81b052d0, f_vnode =3D 0xfffff800d9156000, f_cred =
=3D 0xfffff801d81be400, f_type =3D 0x1, f_vnread_flags =3D 0x0, {f_seqcount=
=3D {0x0,<BR>
0x0}, f_pipegen =3D 0x0}, f_nextoff =3D {0x0, 0x0}, f_vnun =3D {fvn_c=
devpriv =3D 0x0, fvn_advice =3D 0x0}, f_offset =3D 0x0}<BR>
(kgdb)<BR>
<BR>
<BR>
<BR>
<BR>
CONFIDENTIALITY NOTE: This message is intended only for the use<BR>
of the individual or entity to whom it is addressed and may<BR>
contain information that is privileged, confidential, and<BR>
exempt from disclosure under applicable law. If the reader<BR>
of this message is not the intended recipient, you are hereby<BR>
notified that any dissemination, distribution or copying<BR>
of this communication is strictly prohibited. If you have<BR>
received this transmission in error, please notify us by<BR>
telephone at (502) 212-4000 or notify us at PAI, Dept. 99,<BR>
2101 High Wickham Place, Suite 101, Louisville, KY 40245<BR>
<br><br><p style=3D"font-family: Verdana; font-size:10pt; color:#666666;"><=
b>Disclaimer</b></p><p style=3D"font-family: Verdana; font-size:8pt; color:=
#666666;">The information contained in this communication from the sender i=
s confidential. It is intended solely for use by the recipient and others a=
uthorized to receive it. If you are not the recipient, you are hereby notif=
ied that any disclosure, copying, distribution or taking action in relation=
of the contents of this information is strictly prohibited and may be unla=
wful.<br><br>This email has been scanned for viruses and malware, and may h=
ave been automatically archived by Mimecast, a leader in email security and=
cyber resilience. Mimecast integrates email defenses with brand protection=
, security awareness training, web security, compliance and other essential=
capabilities. Mimecast helps protect large and small organizations from ma=
licious activity, human error and technology failure; and to lead the movem=
ent toward building a more resilient world. To find out more, visit our web=
site.</p></body></html>
--MCBoundary=_12202211842315431--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?924c13764ce342cf968ef9a93699be9a>