Date: Fri, 27 Oct 2023 14:09:45 +0100 From: void <void@f-m.fm> To: freebsd-stable@freebsd.org Subject: Re: periodic daily takes a very long time to run (14-stable) Message-ID: <ZTu2ma6lkHVz7dCI@int21h> In-Reply-To: <2146377145.5323.1698410799235@localhost> References: <ZTuNvVMW_XG3mZKU@int21h> <1122335317.4913.1698407124469@localhost> <ZTutTkjadP3da0wa@int21h> <2146377145.5323.1698410799235@localhost>
next in thread | previous in thread | raw e-mail | index | archive | help
On Fri, Oct 27, 2023 at 02:46:39PM +0200, Ronald Klop wrote: >Mmm. Your pool has a lot of space left. So that is good. > >About gstat / iostat, yes during the daily scan would be nice. The numbers outside of the daily scan can also help as a reference. > >NB: There were talks on the ML about vnode re-use problems. But I think that was under a much higher load on the FS. Like 20 find processes in parallel on millions of files. Like this: https://cgit.freebsd.org/src/commit/?id=054f45e026d898bdc8f974d33dd748937dee1d6b and https://cgit.freebsd.org/src/log/?qt=grep&q=vnode&showmsg=1 >These improvements also ended up in 14. OK. This is on stable/14-n265566-4533fa42ad91 arm64 built on Oct 21st and I've verified vfs_subr.o was built on that date. Nothing jumps out at me from sysctl output, but I hardly know a thing about this in particular. What do you think? # sysctl -a | grep vnode kern.maxvnodes: 212370 kern.ipc.umtx_vnode_persistent: 0 vm.vnode_pbufs: 256 vm.stats.vm.v_vnodepgsout: 1825669 vm.stats.vm.v_vnodepgsin: 8165147 vm.stats.vm.v_vnodeout: 59017 vm.stats.vm.v_vnodein: 795355 vfs.wantfreevnodes: 53092 vfs.freevnodes: 95043 vfs.vnodes_created: 40292208 vfs.numvnodes: 102660 vfs.vnode.vnlru.uma_reclaim_calls: 0 vfs.vnode.vnlru.kicks: 0 vfs.vnode.vnlru.max_free_per_call: 10000 vfs.vnode.vnlru.failed_runs: 0 vfs.vnode.vnlru.direct_recycles_free: 12193254 vfs.vnode.vnlru.recycles_free: 13211571 vfs.vnode.vnlru.recycles: 0 vfs.vnode.stats.alloc_sleeps: 0 vfs.vnode.stats.free: 95043 vfs.vnode.stats.skipped_requeues: 1769431 vfs.vnode.stats.created: 40292208 vfs.vnode.stats.count: 102660 vfs.vnode.param.wantfree: 53092 vfs.vnode.param.limit: 212370 vfs.cache.debug.vnodes_cel_3_failures: 0 vfs.cache.stats.heldvnodes: 6383 debug.vnode_domainset: <NULL> debug.sizeof.vnode: 448 debug.fail_point.status_fill_kinfo_vnode__random_path: off debug.fail_point.fill_kinfo_vnode__random_path: off I let iostat run a while and the following seems representative: device r/s w/s kr/s kw/s ms/r ms/w ms/o ms/t qlen %b da0 100 1 401.4 4.0 70 126 0 70 10 97 pass0 0 0 0.0 0.0 0 0 0 0 0 0 kw/s gets to 700, kr/s 500. Very bursty --
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?ZTu2ma6lkHVz7dCI>