Skip site navigation (1)Skip section navigation (2) 
Date:      Mon, 9 Oct 2023 22:21:05 +0530
From:      Arun Varghese <arunodhayam89@gmail.com>
To:        freebsd-current@freebsd.org
Subject:   LOR seen on 13.x kernel
Message-ID:  <CALgcKFZLRztf8G-ayYLjojoswvR-5orEqj-8K_3nUq7x%2Bwc=Wg@mail.gmail.com>
next in thread | raw e-mail | index | archive | help 
--00000000000087fb2f06074b67b8
Content-Type: text/plain; charset="UTF-8"

Hi All,
Seeing the below LOR in the 13.x kernel, is this a known issue ?
Could this cause vnode to max out and slow down the system.
Is there a patch available?(or can we ignore this ?)

kernel: Waiting (max 60 seconds) for system process `vnlru' to stop...done

kernel: Waiting (max 60 seconds) for system process `bufdaemon' to
stop...done

kernel: Waiting (max 60 seconds) for system process `syncer' to stop...

kernel: Syncing disks, vnodes remaining...114 lock order reversal:

kernel: 1st 0xfffff80003b26068 syncer (syncer) @ kern/vfs_subr.c:1853

kernel: 2nd 0xfffff800038902d8 devfs (devfs) @ ufs/ffs/ffs_vfsops.c:1632

kernel: KDB: stack backtrace:

kernel: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0x
fffffe022f899630

kernel: witness_checkorder() at witness_checkorder+0xc87/frame 0x
fffffe022f8996c0

kernel: __lockmgr_args() at __lockmgr_args+0x745/frame 0xfffffe022f8997f0

kernel: vop_stdlock() at vop_stdlock+0x3c/frame 0xfffffe022f899810

kernel: VOP_LOCK1_APV() at VOP_LOCK1_APV+0xab/frame 0xfffffe022f899840

kernel: _vn_lock() at _vn_lock+0x43/frame 0xfffffe022f8998a0

kernel: ffs_sync() at ffs_sync+0x2f9/frame 0xfffffe022f899970

kernel: sync_fsync() at sync_fsync+0xfa/frame 0xfffffe022f8999b0

kernel: VOP_FSYNC_APV() at VOP_FSYNC_APV+0xc4/frame 0xfffffe022f8999e0

kernel: sched_sync() at sched_sync+0x338/frame 0xfffffe022f899a70

kernel: fork_exit() at fork_exit+0x71/frame 0xfffffe022f899ab0

kernel: fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe022f899ab0

Regards
Arun

--00000000000087fb2f06074b67b8
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div class=3D"gmail-adn gmail-ads"><div class=3D"gmail-gs"=
><div class=3D"gmail-"><div id=3D"gmail-:1av" class=3D"gmail-ii gmail-gt"><=
div id=3D"gmail-:1au" class=3D"gmail-a3s gmail-aiL"><div dir=3D"ltr"><div>H=
i All,<br></div><div>Seeing the below LOR in the 13.x kernel, is this a kno=
wn issue ?</div><div>Could this cause vnode to max out and slow down the sy=
stem.<br>Is there a patch available?(or can we ignore this ?)<br></div><br>=
<div style=3D"color:rgb(204,204,204);background-color:rgb(31,31,31);font-fa=
mily:Menlo,Monaco,&quot;Courier New&quot;,monospace;font-weight:normal;font=
-size:12px;line-height:18px;white-space:pre-wrap"><div><span style=3D"color=
:rgb(156,220,254)">kernel</span><span style=3D"color:rgb(204,204,204)">: Wa=
iting (</span><span style=3D"color:rgb(220,220,170)">max</span><span style=
=3D"color:rgb(204,204,204)"> </span><span style=3D"color:rgb(181,206,168)">=
60</span><span style=3D"color:rgb(204,204,204)"> seconds) </span><span styl=
e=3D"color:rgb(197,134,192)">for</span><span style=3D"color:rgb(204,204,204=
)"> system process </span><span style=3D"color:rgb(244,71,71)">`vnlru</span=
><span style=3D"color:rgb(206,145,120)">&#39; to stop...done </span></div><=
br><div><span style=3D"color:rgb(156,220,254)">kernel</span><span style=3D"=
color:rgb(204,204,204)">: Waiting (</span><span style=3D"color:rgb(220,220,=
170)">max</span><span style=3D"color:rgb(204,204,204)"> </span><span style=
=3D"color:rgb(181,206,168)">60</span><span style=3D"color:rgb(204,204,204)"=
> seconds) </span><span style=3D"color:rgb(197,134,192)">for</span><span st=
yle=3D"color:rgb(204,204,204)"> system process </span><span style=3D"color:=
rgb(244,71,71)">`bufdaemon</span><span style=3D"color:rgb(206,145,120)">&#3=
9; to stop...done </span></div><br><div><span style=3D"color:rgb(156,220,25=
4)">kernel</span><span style=3D"color:rgb(204,204,204)">: Waiting (</span><=
span style=3D"color:rgb(220,220,170)">max</span><span style=3D"color:rgb(20=
4,204,204)"> </span><span style=3D"color:rgb(181,206,168)">60</span><span s=
tyle=3D"color:rgb(204,204,204)"> seconds) </span><span style=3D"color:rgb(1=
97,134,192)">for</span><span style=3D"color:rgb(204,204,204)"> system proce=
ss </span><span style=3D"color:rgb(244,71,71)">`syncer</span><span style=3D=
"color:rgb(206,145,120)">&#39; to stop... </span></div><br><div><span style=
=3D"color:rgb(156,220,254)">kernel</span><span style=3D"color:rgb(204,204,2=
04)">: Syncing disks, vnodes remaining...</span><span style=3D"color:rgb(24=
4,71,71)">114</span><span style=3D"color:rgb(204,204,204)"> lock order </sp=
an><span style=3D"color:rgb(156,220,254)">reversal</span><span style=3D"col=
or:rgb(204,204,204)">: </span></div><br><div><span style=3D"color:rgb(156,2=
20,254)">kernel</span><span style=3D"color:rgb(204,204,204)">: </span><span=
 style=3D"color:rgb(244,71,71)">1st</span><span style=3D"color:rgb(204,204,=
204)"> </span><span style=3D"color:rgb(86,156,214)">0x</span><span style=3D=
"color:rgb(181,206,168)">fffff80003b26068</span><span style=3D"color:rgb(20=
4,204,204)"> syncer (syncer) </span><span style=3D"color:rgb(212,212,212)">=
@</span><span style=3D"color:rgb(204,204,204)"> kern</span><span style=3D"c=
olor:rgb(212,212,212)">/</span><span style=3D"color:rgb(204,204,204)">vfs_s=
ubr.c:</span><span style=3D"color:rgb(181,206,168)">1853</span><span style=
=3D"color:rgb(204,204,204)"> </span></div><br><div><span style=3D"color:rgb=
(156,220,254)">kernel</span><span style=3D"color:rgb(204,204,204)">: </span=
><span style=3D"color:rgb(244,71,71)">2nd</span><span style=3D"color:rgb(20=
4,204,204)"> </span><span style=3D"color:rgb(86,156,214)">0x</span><span st=
yle=3D"color:rgb(181,206,168)">fffff800038902d8</span><span style=3D"color:=
rgb(204,204,204)"> devfs (devfs) </span><span style=3D"color:rgb(212,212,21=
2)">@</span><span style=3D"color:rgb(204,204,204)"> ufs</span><span style=
=3D"color:rgb(212,212,212)">/</span><span style=3D"color:rgb(204,204,204)">=
ffs</span><span style=3D"color:rgb(212,212,212)">/</span><span style=3D"col=
or:rgb(204,204,204)">ffs_vfsops.c:</span><span style=3D"color:rgb(181,206,1=
68)">1632</span><span style=3D"color:rgb(204,204,204)"> </span></div><br><d=
iv><span style=3D"color:rgb(156,220,254)">kernel</span><span style=3D"color=
:rgb(204,204,204)">: KDB: stack backtrace: </span></div><br><div><span styl=
e=3D"color:rgb(156,220,254)">kernel</span><span style=3D"color:rgb(204,204,=
204)">: db_trace_self_wrapper() at db_trace_self_wrapper</span><span style=
=3D"color:rgb(212,212,212)">+</span><span style=3D"color:rgb(86,156,214)">0=
x</span><span style=3D"color:rgb(181,206,168)">2b</span><span style=3D"colo=
r:rgb(212,212,212)">/</span><span style=3D"color:rgb(204,204,204)">frame </=
span><span style=3D"color:rgb(86,156,214)">0x</span><span style=3D"color:rg=
b(181,206,168)">fffffe022f899630</span><span style=3D"color:rgb(204,204,204=
)"> </span></div><br><div><span style=3D"color:rgb(156,220,254)">kernel</sp=
an><span style=3D"color:rgb(204,204,204)">: witness_checkorder() at witness=
_checkorder</span><span style=3D"color:rgb(212,212,212)">+</span><span styl=
e=3D"color:rgb(86,156,214)">0x</span><span style=3D"color:rgb(181,206,168)"=
>c87</span><span style=3D"color:rgb(212,212,212)">/</span><span style=3D"co=
lor:rgb(204,204,204)">frame </span><span style=3D"color:rgb(86,156,214)">0x=
</span><span style=3D"color:rgb(181,206,168)">fffffe022f8996c0</span><span =
style=3D"color:rgb(204,204,204)"> </span></div><br><div><span style=3D"colo=
r:rgb(156,220,254)">kernel</span><span style=3D"color:rgb(204,204,204)">: _=
_lockmgr_args() at __lockmgr_args</span><span style=3D"color:rgb(212,212,21=
2)">+</span><span style=3D"color:rgb(86,156,214)">0x</span><span style=3D"c=
olor:rgb(181,206,168)">745</span><span style=3D"color:rgb(212,212,212)">/</=
span><span style=3D"color:rgb(204,204,204)">frame </span><span style=3D"col=
or:rgb(86,156,214)">0x</span><span style=3D"color:rgb(181,206,168)">fffffe0=
22f8997f0</span><span style=3D"color:rgb(204,204,204)"> </span></div><br><d=
iv><span style=3D"color:rgb(156,220,254)">kernel</span><span style=3D"color=
:rgb(204,204,204)">: vop_stdlock() at vop_stdlock</span><span style=3D"colo=
r:rgb(212,212,212)">+</span><span style=3D"color:rgb(86,156,214)">0x</span>=
<span style=3D"color:rgb(181,206,168)">3c</span><span style=3D"color:rgb(21=
2,212,212)">/</span><span style=3D"color:rgb(204,204,204)">frame </span><sp=
an style=3D"color:rgb(86,156,214)">0x</span><span style=3D"color:rgb(181,20=
6,168)">fffffe022f899810</span><span style=3D"color:rgb(204,204,204)"> </sp=
an></div><br><div><span style=3D"color:rgb(156,220,254)">kernel</span><span=
 style=3D"color:rgb(204,204,204)">: VOP_LOCK1_APV() at VOP_LOCK1_APV</span>=
<span style=3D"color:rgb(212,212,212)">+</span><span style=3D"color:rgb(86,=
156,214)">0x</span><span style=3D"color:rgb(181,206,168)">ab</span><span st=
yle=3D"color:rgb(212,212,212)">/</span><span style=3D"color:rgb(204,204,204=
)">frame </span><span style=3D"color:rgb(86,156,214)">0x</span><span style=
=3D"color:rgb(181,206,168)">fffffe022f899840</span><span style=3D"color:rgb=
(204,204,204)"> </span></div><br><div><span style=3D"color:rgb(156,220,254)=
">kernel</span><span style=3D"color:rgb(204,204,204)">: _vn_lock() at _vn_l=
ock</span><span style=3D"color:rgb(212,212,212)">+</span><span style=3D"col=
or:rgb(86,156,214)">0x</span><span style=3D"color:rgb(181,206,168)">43</spa=
n><span style=3D"color:rgb(212,212,212)">/</span><span style=3D"color:rgb(2=
04,204,204)">frame </span><span style=3D"color:rgb(86,156,214)">0x</span><s=
pan style=3D"color:rgb(181,206,168)">fffffe022f8998a0</span><span style=3D"=
color:rgb(204,204,204)"> </span></div><br><div><span style=3D"color:rgb(156=
,220,254)">kernel</span><span style=3D"color:rgb(204,204,204)">: ffs_sync()=
 at ffs_sync</span><span style=3D"color:rgb(212,212,212)">+</span><span sty=
le=3D"color:rgb(86,156,214)">0x</span><span style=3D"color:rgb(181,206,168)=
">2f9</span><span style=3D"color:rgb(212,212,212)">/</span><span style=3D"c=
olor:rgb(204,204,204)">frame </span><span style=3D"color:rgb(86,156,214)">0=
x</span><span style=3D"color:rgb(181,206,168)">fffffe022f899970</span><span=
 style=3D"color:rgb(204,204,204)"> </span></div><br><div><span style=3D"col=
or:rgb(156,220,254)">kernel</span><span style=3D"color:rgb(204,204,204)">: =
sync_fsync() at sync_fsync</span><span style=3D"color:rgb(212,212,212)">+</=
span><span style=3D"color:rgb(86,156,214)">0x</span><span style=3D"color:rg=
b(181,206,168)">fa</span><span style=3D"color:rgb(212,212,212)">/</span><sp=
an style=3D"color:rgb(204,204,204)">frame </span><span style=3D"color:rgb(8=
6,156,214)">0x</span><span style=3D"color:rgb(181,206,168)">fffffe022f8999b=
0</span><span style=3D"color:rgb(204,204,204)"> </span></div><br><div><span=
 style=3D"color:rgb(156,220,254)">kernel</span><span style=3D"color:rgb(204=
,204,204)">: VOP_FSYNC_APV() at VOP_FSYNC_APV</span><span style=3D"color:rg=
b(212,212,212)">+</span><span style=3D"color:rgb(86,156,214)">0x</span><spa=
n style=3D"color:rgb(181,206,168)">c4</span><span style=3D"color:rgb(212,21=
2,212)">/</span><span style=3D"color:rgb(204,204,204)">frame </span><span s=
tyle=3D"color:rgb(86,156,214)">0x</span><span style=3D"color:rgb(181,206,16=
8)">fffffe022f8999e0</span><span style=3D"color:rgb(204,204,204)"> </span><=
/div><br><div><span style=3D"color:rgb(156,220,254)">kernel</span><span sty=
le=3D"color:rgb(204,204,204)">: sched_sync() at sched_sync</span><span styl=
e=3D"color:rgb(212,212,212)">+</span><span style=3D"color:rgb(86,156,214)">=
0x</span><span style=3D"color:rgb(181,206,168)">338</span><span style=3D"co=
lor:rgb(212,212,212)">/</span><span style=3D"color:rgb(204,204,204)">frame =
</span><span style=3D"color:rgb(86,156,214)">0x</span><span style=3D"color:=
rgb(181,206,168)">fffffe022f899a70</span><span style=3D"color:rgb(204,204,2=
04)"> </span></div><br><div><span style=3D"color:rgb(156,220,254)">kernel</=
span><span style=3D"color:rgb(204,204,204)">: fork_exit() at fork_exit</spa=
n><span style=3D"color:rgb(212,212,212)">+</span><span style=3D"color:rgb(8=
6,156,214)">0x</span><span style=3D"color:rgb(181,206,168)">71</span><span =
style=3D"color:rgb(212,212,212)">/</span><span style=3D"color:rgb(204,204,2=
04)">frame </span><span style=3D"color:rgb(86,156,214)">0x</span><span styl=
e=3D"color:rgb(181,206,168)">fffffe022f899ab0</span><span style=3D"color:rg=
b(204,204,204)"> </span></div><br><div><span style=3D"color:rgb(156,220,254=
)">kernel</span><span style=3D"color:rgb(204,204,204)">: fork_trampoline() =
at fork_trampoline</span><span style=3D"color:rgb(212,212,212)">+</span><sp=
an style=3D"color:rgb(86,156,214)">0x</span><span style=3D"color:rgb(181,20=
6,168)">e</span><span style=3D"color:rgb(212,212,212)">/</span><span style=
=3D"color:rgb(204,204,204)">frame </span><span style=3D"color:rgb(86,156,21=
4)">0x</span><span style=3D"color:rgb(181,206,168)">fffffe022f899ab0</span>=
<div class=3D"gmail-yj6qo"></div><div class=3D"gmail-adL"><span style=3D"co=
lor:rgb(204,204,204)"> </span></div></div></div></div><div class=3D"gmail-a=
dL">
</div></div></div><div class=3D"gmail-hi"></div><div class=3D"gmail-WhmR8e"=
></div></div></div><div class=3D"gmail-ajx"></div></div><div class=3D"gmail=
-gA gmail-gt gmail-acV"><div class=3D"gmail-gB gmail-xu"><div class=3D"gmai=
l-ip gmail-iq"><div id=3D"gmail-:1aw"><table class=3D"gmail-cf gmail-wS" ro=
le=3D"presentation"><tbody><tr><td class=3D"gmail-amq"><br>Regards<br>Arun<=
br></td><td class=3D"gmail-amr"><br></td></tr></tbody></table></div></div><=
/div></div></div>

--00000000000087fb2f06074b67b8--

Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CALgcKFZLRztf8G-ayYLjojoswvR-5orEqj-8K_3nUq7x%2Bwc=Wg>