Date: Sat, 1 Jan 2011 18:46:49 +0200 From: Kostik Belousov <kostikbel@gmail.com> To: Beat G?tzi <beat@chruetertee.ch> Cc: Alexander Best <arundel@freebsd.org>, current@freebsd.org Subject: Re: Suddenly slow lstat syscalls on CURRENT from Juli Message-ID: <20110101164649.GY90883@deviant.kiev.zoral.com.ua> In-Reply-To: <4D1F5992.8030309@chruetertee.ch> References: <4D1F1AE8.5040704@chruetertee.ch> <20110101151008.GA7762@freebsd.org> <4D1F4A48.6080604@chruetertee.ch> <20110101154537.GW90883@deviant.kiev.zoral.com.ua> <4D1F4FB8.3030303@chruetertee.ch> <20110101161254.GX90883@deviant.kiev.zoral.com.ua> <4D1F5992.8030309@chruetertee.ch>
next in thread | previous in thread | raw e-mail | index | archive | help
--wmVhWgj1OZ04es6B Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sat, Jan 01, 2011 at 05:42:58PM +0100, Beat G?tzi wrote: > On 01.01.2011 17:12, Kostik Belousov wrote: > > On Sat, Jan 01, 2011 at 05:00:56PM +0100, Beat G?tzi wrote: > >> On 01.01.2011 16:45, Kostik Belousov wrote: > >>> Check the output of sysctl kern.maxvnodes and vfs.numvnodes. I suspect > >>> they are quite close or equial. If yes, consider increasing maxvnodes. > >>> Another workaround, if you have huge nested directories hierarhy, is > >>> to set vfs.vlru_allow_cache_src to 1. > >> > >> Thanks for the hint. kern.maxvnodes and vfs.numvnodes were equal: > >> # sysctl kern.maxvnodes vfs.numvnodes > >> kern.maxvnodes: 100000 > >> vfs.numvnodes: 100765 > >> > >> I've increased kern.maxvnodes and the problem was gone until > >> vfs.numvnodes reached the value of kern.maxvnodes again: > >> # sysctl kern.maxvnodes vfs.numvnodes > >> kern.maxvnodes: 150000 > >> vfs.numvnodes: 150109 > > The processes should be stuck in "vlruwk" state, that can be > > checked with ps or '^T' on the terminal. >=20 > Yes, there are various processes in "vlruwk" state, >=20 > >> As the directory structure is quite huge on this server I've set > >> vfs.vlru_allow_cache_src to one now. > > Did it helped ? >=20 > No, it doesn't looks like setting vfs.vlru_allow_cache_src helped. The > problem was gone when I increased kern.maxvnodes until vfs.numvnodes > reached that level. I've stopped all running deamons but numvnodes > doesn't decrease. Stopping the daemons would not decrease the count of cached vnodes. What you can do is to call unmount on the filesystems. Supposedly, the filesystems are busy and unmount shall fail, but it will force freed the vnodes that are unused by any process. --wmVhWgj1OZ04es6B Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (FreeBSD) iEYEARECAAYFAk0fWnkACgkQC3+MBN1Mb4hnfQCeKuWmedxT+a+27Ez1rmgU8/zh wRgAnA6F8LmqaCJdSDHjoqp+eha/Cfth =ikth -----END PGP SIGNATURE----- --wmVhWgj1OZ04es6B--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20110101164649.GY90883>