Skip site navigation (1)Skip section navigation (2) 
Date:      Mon, 9 Oct 2023 22:21:05 +0530
From:      Arun Varghese <arunodhayam89@gmail.com>
To:        freebsd-current@freebsd.org
Subject:   LOR seen on 13.x kernel
Message-ID:  <CALgcKFZLRztf8G-ayYLjojoswvR-5orEqj-8K_3nUq7x%2Bwc=Wg@mail.gmail.com>
index | next in thread | raw e-mail 

[-- Attachment #1 --]
Hi All,
Seeing the below LOR in the 13.x kernel, is this a known issue ?
Could this cause vnode to max out and slow down the system.
Is there a patch available?(or can we ignore this ?)

kernel: Waiting (max 60 seconds) for system process `vnlru' to stop...done

kernel: Waiting (max 60 seconds) for system process `bufdaemon' to
stop...done

kernel: Waiting (max 60 seconds) for system process `syncer' to stop...

kernel: Syncing disks, vnodes remaining...114 lock order reversal:

kernel: 1st 0xfffff80003b26068 syncer (syncer) @ kern/vfs_subr.c:1853

kernel: 2nd 0xfffff800038902d8 devfs (devfs) @ ufs/ffs/ffs_vfsops.c:1632

kernel: KDB: stack backtrace:

kernel: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0x
fffffe022f899630

kernel: witness_checkorder() at witness_checkorder+0xc87/frame 0x
fffffe022f8996c0

kernel: __lockmgr_args() at __lockmgr_args+0x745/frame 0xfffffe022f8997f0

kernel: vop_stdlock() at vop_stdlock+0x3c/frame 0xfffffe022f899810

kernel: VOP_LOCK1_APV() at VOP_LOCK1_APV+0xab/frame 0xfffffe022f899840

kernel: _vn_lock() at _vn_lock+0x43/frame 0xfffffe022f8998a0

kernel: ffs_sync() at ffs_sync+0x2f9/frame 0xfffffe022f899970

kernel: sync_fsync() at sync_fsync+0xfa/frame 0xfffffe022f8999b0

kernel: VOP_FSYNC_APV() at VOP_FSYNC_APV+0xc4/frame 0xfffffe022f8999e0

kernel: sched_sync() at sched_sync+0x338/frame 0xfffffe022f899a70

kernel: fork_exit() at fork_exit+0x71/frame 0xfffffe022f899ab0

kernel: fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe022f899ab0

Regards
Arun

[-- Attachment #2 --]
<div dir="ltr"><div class="gmail-adn gmail-ads"><div class="gmail-gs"><div class="gmail-"><div id="gmail-:1av" class="gmail-ii gmail-gt"><div id="gmail-:1au" class="gmail-a3s gmail-aiL"><div dir="ltr"><div>Hi All,<br></div><div>Seeing the below LOR in the 13.x kernel, is this a known issue ?</div><div>Could this cause vnode to max out and slow down the system.<br>Is there a patch available?(or can we ignore this ?)<br></div><br><div style="color:rgb(204,204,204);background-color:rgb(31,31,31);font-family:Menlo,Monaco,&quot;Courier New&quot;,monospace;font-weight:normal;font-size:12px;line-height:18px;white-space:pre-wrap"><div><span style="color:rgb(156,220,254)">kernel</span><span style="color:rgb(204,204,204)">: Waiting (</span><span style="color:rgb(220,220,170)">max</span><span style="color:rgb(204,204,204)"> </span><span style="color:rgb(181,206,168)">60</span><span style="color:rgb(204,204,204)"> seconds) </span><span style="color:rgb(197,134,192)">for</span><span style="color:rgb(204,204,204)"> system process </span><span style="color:rgb(244,71,71)">`vnlru</span><span style="color:rgb(206,145,120)">&#39; to stop...done </span></div><br><div><span style="color:rgb(156,220,254)">kernel</span><span style="color:rgb(204,204,204)">: Waiting (</span><span style="color:rgb(220,220,170)">max</span><span style="color:rgb(204,204,204)"> </span><span style="color:rgb(181,206,168)">60</span><span style="color:rgb(204,204,204)"> seconds) </span><span style="color:rgb(197,134,192)">for</span><span style="color:rgb(204,204,204)"> system process </span><span style="color:rgb(244,71,71)">`bufdaemon</span><span style="color:rgb(206,145,120)">&#39; to stop...done </span></div><br><div><span style="color:rgb(156,220,254)">kernel</span><span style="color:rgb(204,204,204)">: Waiting (</span><span style="color:rgb(220,220,170)">max</span><span style="color:rgb(204,204,204)"> </span><span style="color:rgb(181,206,168)">60</span><span style="color:rgb(204,204,204)"> seconds) </span><span style="color:rgb(197,134,192)">for</span><span style="color:rgb(204,204,204)"> system process </span><span style="color:rgb(244,71,71)">`syncer</span><span style="color:rgb(206,145,120)">&#39; to stop... </span></div><br><div><span style="color:rgb(156,220,254)">kernel</span><span style="color:rgb(204,204,204)">: Syncing disks, vnodes remaining...</span><span style="color:rgb(244,71,71)">114</span><span style="color:rgb(204,204,204)"> lock order </span><span style="color:rgb(156,220,254)">reversal</span><span style="color:rgb(204,204,204)">: </span></div><br><div><span style="color:rgb(156,220,254)">kernel</span><span style="color:rgb(204,204,204)">: </span><span style="color:rgb(244,71,71)">1st</span><span style="color:rgb(204,204,204)"> </span><span style="color:rgb(86,156,214)">0x</span><span style="color:rgb(181,206,168)">fffff80003b26068</span><span style="color:rgb(204,204,204)"> syncer (syncer) </span><span style="color:rgb(212,212,212)">@</span><span style="color:rgb(204,204,204)"> kern</span><span style="color:rgb(212,212,212)">/</span><span style="color:rgb(204,204,204)">vfs_subr.c:</span><span style="color:rgb(181,206,168)">1853</span><span style="color:rgb(204,204,204)"> </span></div><br><div><span style="color:rgb(156,220,254)">kernel</span><span style="color:rgb(204,204,204)">: </span><span style="color:rgb(244,71,71)">2nd</span><span style="color:rgb(204,204,204)"> </span><span style="color:rgb(86,156,214)">0x</span><span style="color:rgb(181,206,168)">fffff800038902d8</span><span style="color:rgb(204,204,204)"> devfs (devfs) </span><span style="color:rgb(212,212,212)">@</span><span style="color:rgb(204,204,204)"> ufs</span><span style="color:rgb(212,212,212)">/</span><span style="color:rgb(204,204,204)">ffs</span><span style="color:rgb(212,212,212)">/</span><span style="color:rgb(204,204,204)">ffs_vfsops.c:</span><span style="color:rgb(181,206,168)">1632</span><span style="color:rgb(204,204,204)"> </span></div><br><div><span style="color:rgb(156,220,254)">kernel</span><span style="color:rgb(204,204,204)">: KDB: stack backtrace: </span></div><br><div><span style="color:rgb(156,220,254)">kernel</span><span style="color:rgb(204,204,204)">: db_trace_self_wrapper() at db_trace_self_wrapper</span><span style="color:rgb(212,212,212)">+</span><span style="color:rgb(86,156,214)">0x</span><span style="color:rgb(181,206,168)">2b</span><span style="color:rgb(212,212,212)">/</span><span style="color:rgb(204,204,204)">frame </span><span style="color:rgb(86,156,214)">0x</span><span style="color:rgb(181,206,168)">fffffe022f899630</span><span style="color:rgb(204,204,204)"> </span></div><br><div><span style="color:rgb(156,220,254)">kernel</span><span style="color:rgb(204,204,204)">: witness_checkorder() at witness_checkorder</span><span style="color:rgb(212,212,212)">+</span><span style="color:rgb(86,156,214)">0x</span><span style="color:rgb(181,206,168)">c87</span><span style="color:rgb(212,212,212)">/</span><span style="color:rgb(204,204,204)">frame </span><span style="color:rgb(86,156,214)">0x</span><span style="color:rgb(181,206,168)">fffffe022f8996c0</span><span style="color:rgb(204,204,204)"> </span></div><br><div><span style="color:rgb(156,220,254)">kernel</span><span style="color:rgb(204,204,204)">: __lockmgr_args() at __lockmgr_args</span><span style="color:rgb(212,212,212)">+</span><span style="color:rgb(86,156,214)">0x</span><span style="color:rgb(181,206,168)">745</span><span style="color:rgb(212,212,212)">/</span><span style="color:rgb(204,204,204)">frame </span><span style="color:rgb(86,156,214)">0x</span><span style="color:rgb(181,206,168)">fffffe022f8997f0</span><span style="color:rgb(204,204,204)"> </span></div><br><div><span style="color:rgb(156,220,254)">kernel</span><span style="color:rgb(204,204,204)">: vop_stdlock() at vop_stdlock</span><span style="color:rgb(212,212,212)">+</span><span style="color:rgb(86,156,214)">0x</span><span style="color:rgb(181,206,168)">3c</span><span style="color:rgb(212,212,212)">/</span><span style="color:rgb(204,204,204)">frame </span><span style="color:rgb(86,156,214)">0x</span><span style="color:rgb(181,206,168)">fffffe022f899810</span><span style="color:rgb(204,204,204)"> </span></div><br><div><span style="color:rgb(156,220,254)">kernel</span><span style="color:rgb(204,204,204)">: VOP_LOCK1_APV() at VOP_LOCK1_APV</span><span style="color:rgb(212,212,212)">+</span><span style="color:rgb(86,156,214)">0x</span><span style="color:rgb(181,206,168)">ab</span><span style="color:rgb(212,212,212)">/</span><span style="color:rgb(204,204,204)">frame </span><span style="color:rgb(86,156,214)">0x</span><span style="color:rgb(181,206,168)">fffffe022f899840</span><span style="color:rgb(204,204,204)"> </span></div><br><div><span style="color:rgb(156,220,254)">kernel</span><span style="color:rgb(204,204,204)">: _vn_lock() at _vn_lock</span><span style="color:rgb(212,212,212)">+</span><span style="color:rgb(86,156,214)">0x</span><span style="color:rgb(181,206,168)">43</span><span style="color:rgb(212,212,212)">/</span><span style="color:rgb(204,204,204)">frame </span><span style="color:rgb(86,156,214)">0x</span><span style="color:rgb(181,206,168)">fffffe022f8998a0</span><span style="color:rgb(204,204,204)"> </span></div><br><div><span style="color:rgb(156,220,254)">kernel</span><span style="color:rgb(204,204,204)">: ffs_sync() at ffs_sync</span><span style="color:rgb(212,212,212)">+</span><span style="color:rgb(86,156,214)">0x</span><span style="color:rgb(181,206,168)">2f9</span><span style="color:rgb(212,212,212)">/</span><span style="color:rgb(204,204,204)">frame </span><span style="color:rgb(86,156,214)">0x</span><span style="color:rgb(181,206,168)">fffffe022f899970</span><span style="color:rgb(204,204,204)"> </span></div><br><div><span style="color:rgb(156,220,254)">kernel</span><span style="color:rgb(204,204,204)">: sync_fsync() at sync_fsync</span><span style="color:rgb(212,212,212)">+</span><span style="color:rgb(86,156,214)">0x</span><span style="color:rgb(181,206,168)">fa</span><span style="color:rgb(212,212,212)">/</span><span style="color:rgb(204,204,204)">frame </span><span style="color:rgb(86,156,214)">0x</span><span style="color:rgb(181,206,168)">fffffe022f8999b0</span><span style="color:rgb(204,204,204)"> </span></div><br><div><span style="color:rgb(156,220,254)">kernel</span><span style="color:rgb(204,204,204)">: VOP_FSYNC_APV() at VOP_FSYNC_APV</span><span style="color:rgb(212,212,212)">+</span><span style="color:rgb(86,156,214)">0x</span><span style="color:rgb(181,206,168)">c4</span><span style="color:rgb(212,212,212)">/</span><span style="color:rgb(204,204,204)">frame </span><span style="color:rgb(86,156,214)">0x</span><span style="color:rgb(181,206,168)">fffffe022f8999e0</span><span style="color:rgb(204,204,204)"> </span></div><br><div><span style="color:rgb(156,220,254)">kernel</span><span style="color:rgb(204,204,204)">: sched_sync() at sched_sync</span><span style="color:rgb(212,212,212)">+</span><span style="color:rgb(86,156,214)">0x</span><span style="color:rgb(181,206,168)">338</span><span style="color:rgb(212,212,212)">/</span><span style="color:rgb(204,204,204)">frame </span><span style="color:rgb(86,156,214)">0x</span><span style="color:rgb(181,206,168)">fffffe022f899a70</span><span style="color:rgb(204,204,204)"> </span></div><br><div><span style="color:rgb(156,220,254)">kernel</span><span style="color:rgb(204,204,204)">: fork_exit() at fork_exit</span><span style="color:rgb(212,212,212)">+</span><span style="color:rgb(86,156,214)">0x</span><span style="color:rgb(181,206,168)">71</span><span style="color:rgb(212,212,212)">/</span><span style="color:rgb(204,204,204)">frame </span><span style="color:rgb(86,156,214)">0x</span><span style="color:rgb(181,206,168)">fffffe022f899ab0</span><span style="color:rgb(204,204,204)"> </span></div><br><div><span style="color:rgb(156,220,254)">kernel</span><span style="color:rgb(204,204,204)">: fork_trampoline() at fork_trampoline</span><span style="color:rgb(212,212,212)">+</span><span style="color:rgb(86,156,214)">0x</span><span style="color:rgb(181,206,168)">e</span><span style="color:rgb(212,212,212)">/</span><span style="color:rgb(204,204,204)">frame </span><span style="color:rgb(86,156,214)">0x</span><span style="color:rgb(181,206,168)">fffffe022f899ab0</span><div class="gmail-yj6qo"></div><div class="gmail-adL"><span style="color:rgb(204,204,204)"> </span></div></div></div></div><div class="gmail-adL">
</div></div></div><div class="gmail-hi"></div><div class="gmail-WhmR8e"></div></div></div><div class="gmail-ajx"></div></div><div class="gmail-gA gmail-gt gmail-acV"><div class="gmail-gB gmail-xu"><div class="gmail-ip gmail-iq"><div id="gmail-:1aw"><table class="gmail-cf gmail-wS" role="presentation"><tbody><tr><td class="gmail-amq"><br>Regards<br>Arun<br></td><td class="gmail-amr"><br></td></tr></tbody></table></div></div></div></div></div>
help

Want to link to this message? Use this
URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CALgcKFZLRztf8G-ayYLjojoswvR-5orEqj-8K_3nUq7x%2Bwc=Wg>