Date: Mon, 2 Jan 2023 17:14:51 +0000 From: Michael Jung <mikej@paymentallianceintl.com> To: freebsd-current <freebsd-current@freebsd.org> Subject: witness_lock_list_get: witness exhausted Message-ID: <f71d0696b7304ff9af48721997e581a3@paymentallianceintl.com>
next in thread | raw e-mail | index | archive | help
--MCBoundary=_12301021214530581
Content-Language: en-US
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: base64
Rmlyc3Qgc2hhbWUgb24gbWUgYXMgSSBvYnZpb3VzbHkgbWlzc2VkIHRoZSByZXBseSB0byBteSBm
b3JtZXIgcmVwb3J0IGFuZCBkaWQgbm90DQpyZXBvcnQgYmFjayBvbiBhIHByb3Bvc2VkIHBhdGNo
Lg0KDQpodHRwczovL2xpc3RzLmZyZWVic2Qub3JnL3BpcGVybWFpbC9mcmVlYnNkLWN1cnJlbnQv
MjAxOC1KYW51YXJ5LzA2ODEzNi5odG1sDQoNCkkgYW0gc3RpbGwgcnVubmluZyBjdXJyZW50IOKA
kyB0aGUgZ3Vlc3QgaGFzIDE2MEdCIFJhbSBhbmQgNjQgdkNQVeKAmXMgYXNzaWduZWQgdW5kZXIg
RVNYaQ0Kd2hpY2ggbWFpbmx5IHJ1bnMgcG91ZHJpZXJlIGZvciBhbWQ2NCthcm0gYnVpbGRzIGFu
ZCBJIGFnYWluIG5vdGljZWQNCiJ3aXRuZXNzX2xvY2tfbGlzdF9nZXQ6IHdpdG5lc3MgZXhoYXVz
dGVkIiBvbiB0aGUgY29uc29sZSAod2hpY2ggSSBkb24ndCBwYXkgbXVjaCBhdHRlbnRpb24gdG8p
Lg0KDQpVTkFNRTogRnJlZUJTRCBwb3VkcmllcmUuZ29wYWkuY29tIDE0LjAtQ1VSUkVOVCBGcmVl
QlNEIDE0LjAtQ1VSUkVOVCAjMCBtYWluLW4yNTk4NzItZjk0OGNiNzE3ZjUwOiBXZWQgRGVjIDI4
IDEzOjEzOjQzIEVTVCAyMDIyICAgICBtaWtlakBwb3VkcmllcmUuZ29wYWkuY29tOi91c3Ivb2Jq
L3Vzci9zcmMvYW1kNjQuYW1kNjQvc3lzL0dFTkVSSUMgYW1kNjQNCg0KSXQgc2VlbXMgdGhhdCBM
T0NLX05DSElMRFJFTiBhbmQgTE9DS19DSElMRENPVU5UIG5ldmVyIGdvdCBpbmNyZW1lbnRlZCBk
dWUgdG8gbXkgbGFjayBvZiByZXBvcnRpbmcgaW4NCi91c3Ivc3JjL3N5cy9rZXJuL3N1YnJfd2l0
bmVzcy5jDQoNCklmIGl0J3MganVzdCBhIG1hdHRlciBvZiBpbmNyZW1lbnRpbmcgTE9DS19DSElE
Q09VTlQgNDA5NiBhbmQgTE9DS19OQ0hJTERSRU4gMjAgd2l0aG91dCBhZGRpbmcgdGhlDQpzeXNj
dGwga25vYnMgSSBkbyB0aGF0IGFsc28gLSBJIGFtIG5vdCBrZXJuZWwgc2F2dnkuDQoNCkkgd2ls
bCBtYWtlIHN1cmUgYW5kIHRlc3QgYW4gdXBkYXRlZCBwYXRjaCBzaG91bGQgb25lIGJlIG1hZGUg
YXZhaWxhYmxlIG9yIGFkdmlzZSB3aGV0aGVyIHRvIGluY3JlbWVudCB0aGVzZSB2YWx1ZXMNCm9y
IGlnbm9yZSB0aGUgd2FybmluZ3MuDQoNClJlZ2FyZHMsDQoNCk1pY2hhZWwgSnVuZw0KDQoNCg0K
DQoNCkNPTkZJREVOVElBTElUWSBOT1RFOiBUaGlzIG1lc3NhZ2UgaXMgaW50ZW5kZWQgb25seSBm
b3IgdGhlIHVzZQ0Kb2YgdGhlIGluZGl2aWR1YWwgb3IgZW50aXR5IHRvIHdob20gaXQgaXMgYWRk
cmVzc2VkIGFuZCBtYXkNCmNvbnRhaW4gaW5mb3JtYXRpb24gdGhhdCBpcyBwcml2aWxlZ2VkLCBj
b25maWRlbnRpYWwsIGFuZA0KZXhlbXB0IGZyb20gZGlzY2xvc3VyZSB1bmRlciBhcHBsaWNhYmxl
IGxhdy4gSWYgdGhlIHJlYWRlcg0Kb2YgdGhpcyBtZXNzYWdlIGlzIG5vdCB0aGUgaW50ZW5kZWQg
cmVjaXBpZW50LCB5b3UgYXJlIGhlcmVieQ0Kbm90aWZpZWQgdGhhdCBhbnkgZGlzc2VtaW5hdGlv
biwgZGlzdHJpYnV0aW9uIG9yIGNvcHlpbmcNCm9mIHRoaXMgY29tbXVuaWNhdGlvbiBpcyBzdHJp
Y3RseSBwcm9oaWJpdGVkLiBJZiB5b3UgaGF2ZQ0KcmVjZWl2ZWQgdGhpcyB0cmFuc21pc3Npb24g
aW4gZXJyb3IsIHBsZWFzZSBub3RpZnkgdXMgYnkNCnRlbGVwaG9uZSBhdCAoNTAyKSAyMTItNDAw
MCBvciBub3RpZnkgdXMgYXQgUEFJLCBEZXB0LiA5OSwNCjIxMDEgSGlnaCBXaWNraGFtIFBsYWNl
LCBTdWl0ZSAxMDEsIExvdWlzdmlsbGUsIEtZIDQwMjQ1DQoNCkRpc2NsYWltZXINCg0KVGhlIGlu
Zm9ybWF0aW9uIGNvbnRhaW5lZCBpbiB0aGlzIGNvbW11bmljYXRpb24gZnJvbSB0aGUgc2VuZGVy
IGlzIGNvbmZpZGVudGlhbC4gSXQgaXMgaW50ZW5kZWQgc29sZWx5IGZvciB1c2UgYnkgdGhlIHJl
Y2lwaWVudCBhbmQgb3RoZXJzIGF1dGhvcml6ZWQgdG8gcmVjZWl2ZSBpdC4gSWYgeW91IGFyZSBu
b3QgdGhlIHJlY2lwaWVudCwgeW91IGFyZSBoZXJlYnkgbm90aWZpZWQgdGhhdCBhbnkgZGlzY2xv
c3VyZSwgY29weWluZywgZGlzdHJpYnV0aW9uIG9yIHRha2luZyBhY3Rpb24gaW4gcmVsYXRpb24g
b2YgdGhlIGNvbnRlbnRzIG9mIHRoaXMgaW5mb3JtYXRpb24gaXMgc3RyaWN0bHkgcHJvaGliaXRl
ZCBhbmQgbWF5IGJlIHVubGF3ZnVsLg0KDQpUaGlzIGVtYWlsIGhhcyBiZWVuIHNjYW5uZWQgZm9y
IHZpcnVzZXMgYW5kIG1hbHdhcmUsIGFuZCBtYXkgaGF2ZSBiZWVuIGF1dG9tYXRpY2FsbHkgYXJj
aGl2ZWQgYnkgTWltZWNhc3QsIGEgbGVhZGVyIGluIGVtYWlsIHNlY3VyaXR5IGFuZCBjeWJlciBy
ZXNpbGllbmNlLiBNaW1lY2FzdCBpbnRlZ3JhdGVzIGVtYWlsIGRlZmVuc2VzIHdpdGggYnJhbmQg
cHJvdGVjdGlvbiwgc2VjdXJpdHkgYXdhcmVuZXNzIHRyYWluaW5nLCB3ZWIgc2VjdXJpdHksIGNv
bXBsaWFuY2UgYW5kIG90aGVyIGVzc2VudGlhbCBjYXBhYmlsaXRpZXMuIE1pbWVjYXN0IGhlbHBz
IHByb3RlY3QgbGFyZ2UgYW5kIHNtYWxsIG9yZ2FuaXphdGlvbnMgZnJvbSBtYWxpY2lvdXMgYWN0
aXZpdHksIGh1bWFuIGVycm9yIGFuZCB0ZWNobm9sb2d5IGZhaWx1cmU7IGFuZCB0byBsZWFkIHRo
ZSBtb3ZlbWVudCB0b3dhcmQgYnVpbGRpbmcgYSBtb3JlIHJlc2lsaWVudCB3b3JsZC4gVG8gZmlu
ZCBvdXQgbW9yZSwgdmlzaXQgb3VyIHdlYnNpdGUuDQo=
--MCBoundary=_12301021214530581
Content-Transfer-Encoding: quoted-printable
Content-Type: text/html; charset=UTF-8
<html><head><style type=3D"text/css">.style1 {font-family: "Times New Roman=
";}</style></head><body>First shame on me as I obviously missed the reply t=
o my former report and did not<BR>
report back on a proposed patch.<BR>
<BR>
<a href=3D"https://lists.freebsd.org/pipermail/freebsd-current/2018-January=
/068136.html" target=3D"_blank">https://lists.freebsd.org/pipermail/freebsd=
-current/2018-January/068136.html</a><BR>
<BR>
I am still running current =E2=80=93 the guest has 160GB Ram and 64 vCPU=E2=
=80=99s assigned under ESXi<BR>
which mainly runs poudriere for amd64+arm builds and I again noticed<BR>
"witness_lock_list_get: witness exhausted" on the console (which =
I don't pay much attention to).<BR>
<BR>
UNAME: FreeBSD poudriere.gopai.com 14.0-CURRENT FreeBSD 14.0-CURRENT #0 mai=
n-n259872-f948cb717f50: Wed Dec 28 13:13:43 EST 2022 mikej@poudriere.go=
pai.com:/usr/obj/usr/src/amd64.amd64/sys/GENERIC amd64<BR>
<BR>
It seems that LOCK_NCHILDREN and LOCK_CHILDCOUNT never got incremented due =
to my lack of reporting in<BR>
/usr/src/sys/kern/subr_witness.c<BR>
<BR>
If it's just a matter of incrementing LOCK_CHIDCOUNT 4096 and LOCK_NCHILDRE=
N 20 without adding the<BR>
sysctl knobs I do that also - I am not kernel savvy.<BR>
<BR>
I will make sure and test an updated patch should one be made available or =
advise whether to increment these values<BR>
or ignore the warnings.<BR>
<BR>
Regards,<BR>
<BR>
Michael Jung<BR>
<BR>
<BR>
<BR>
<BR>
<BR>
CONFIDENTIALITY NOTE: This message is intended only for the use<BR>
of the individual or entity to whom it is addressed and may<BR>
contain information that is privileged, confidential, and<BR>
exempt from disclosure under applicable law. If the reader<BR>
of this message is not the intended recipient, you are hereby<BR>
notified that any dissemination, distribution or copying<BR>
of this communication is strictly prohibited. If you have<BR>
received this transmission in error, please notify us by<BR>
telephone at (502) 212-4000 or notify us at PAI, Dept. 99,<BR>
2101 High Wickham Place, Suite 101, Louisville, KY 40245<BR>
<br><br><p style=3D"font-family: Verdana; font-size:10pt; color:#666666;"><=
b>Disclaimer</b></p><p style=3D"font-family: Verdana; font-size:8pt; color:=
#666666;">The information contained in this communication from the sender i=
s confidential. It is intended solely for use by the recipient and others a=
uthorized to receive it. If you are not the recipient, you are hereby notif=
ied that any disclosure, copying, distribution or taking action in relation=
of the contents of this information is strictly prohibited and may be unla=
wful.<br><br>This email has been scanned for viruses and malware, and may h=
ave been automatically archived by Mimecast, a leader in email security and=
cyber resilience. Mimecast integrates email defenses with brand protection=
, security awareness training, web security, compliance and other essential=
capabilities. Mimecast helps protect large and small organizations from ma=
licious activity, human error and technology failure; and to lead the movem=
ent toward building a more resilient world. To find out more, visit our web=
site.</p></body></html>
--MCBoundary=_12301021214530581--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?f71d0696b7304ff9af48721997e581a3>