Skip site navigation (1)Skip section navigation (2)
Date:      Fri, 27 Oct 2023 14:09:45 +0100
From:      void <void@f-m.fm>
To:        freebsd-stable@freebsd.org
Subject:   Re: periodic daily takes a very long time to run (14-stable)
Message-ID:  <ZTu2ma6lkHVz7dCI@int21h>
In-Reply-To: <2146377145.5323.1698410799235@localhost>
References:  <ZTuNvVMW_XG3mZKU@int21h> <1122335317.4913.1698407124469@localhost> <ZTutTkjadP3da0wa@int21h> <2146377145.5323.1698410799235@localhost>

next in thread | previous in thread | raw e-mail | index | archive | help
On Fri, Oct 27, 2023 at 02:46:39PM +0200, Ronald Klop wrote:

>Mmm. Your pool has a lot of space left. So that is good.
>
>About gstat / iostat, yes during the daily scan would be nice. The numbers outside of the daily scan can also help as a reference.
>
>NB: There were talks on the ML about vnode re-use problems. But I think that was under a much higher load on the FS. Like 20 find processes in parallel on millions of files. Like this: https://cgit.freebsd.org/src/commit/?id=054f45e026d898bdc8f974d33dd748937dee1d6b and https://cgit.freebsd.org/src/log/?qt=grep&q=vnode&showmsg=1
>These improvements also ended up in 14.

OK. This is on stable/14-n265566-4533fa42ad91 arm64 built on Oct 21st and 
I've verified vfs_subr.o was built on that date.

Nothing jumps out at me from sysctl output, but I hardly know a thing about
this in particular. What do you think?

# sysctl -a | grep vnode
kern.maxvnodes: 212370
kern.ipc.umtx_vnode_persistent: 0
vm.vnode_pbufs: 256
vm.stats.vm.v_vnodepgsout: 1825669
vm.stats.vm.v_vnodepgsin: 8165147
vm.stats.vm.v_vnodeout: 59017
vm.stats.vm.v_vnodein: 795355
vfs.wantfreevnodes: 53092
vfs.freevnodes: 95043
vfs.vnodes_created: 40292208
vfs.numvnodes: 102660
vfs.vnode.vnlru.uma_reclaim_calls: 0
vfs.vnode.vnlru.kicks: 0
vfs.vnode.vnlru.max_free_per_call: 10000
vfs.vnode.vnlru.failed_runs: 0
vfs.vnode.vnlru.direct_recycles_free: 12193254
vfs.vnode.vnlru.recycles_free: 13211571
vfs.vnode.vnlru.recycles: 0
vfs.vnode.stats.alloc_sleeps: 0
vfs.vnode.stats.free: 95043
vfs.vnode.stats.skipped_requeues: 1769431
vfs.vnode.stats.created: 40292208
vfs.vnode.stats.count: 102660
vfs.vnode.param.wantfree: 53092
vfs.vnode.param.limit: 212370
vfs.cache.debug.vnodes_cel_3_failures: 0
vfs.cache.stats.heldvnodes: 6383
debug.vnode_domainset: <NULL>
debug.sizeof.vnode: 448
debug.fail_point.status_fill_kinfo_vnode__random_path: off
debug.fail_point.fill_kinfo_vnode__random_path: off

I let iostat run a while and the following seems representative:

device       r/s     w/s     kr/s     kw/s  ms/r  ms/w  ms/o  ms/t qlen  %b  
da0          100       1    401.4      4.0    70   126     0    70   10  97 
pass0          0       0      0.0      0.0     0     0     0     0    0   0 

kw/s gets to 700, kr/s 500. Very bursty

-- 



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?ZTu2ma6lkHVz7dCI>