Date: Wed, 15 Sep 2010 03:46:35 -0700 From: Jeremy Chadwick <freebsd@jdc.parodius.com> To: Steven Hartland <killing@multiplay.co.uk> Cc: freebsd-fs@freebsd.org, jhell <jhell@DataIX.net>, Pawel Jakub Dawidek <pjd@freebsd.org>, Andriy Gapon <avg@freebsd.org> Subject: Re: zfs very poor performance compared to ufs due to lack of cache? Message-ID: <20100915104635.GA59871@icarus.home.lan> In-Reply-To: <D79F15FEB5794315BD8668E40B414BF0@multiplay.co.uk> References: <20100908084855.GF2465@deviant.kiev.zoral.com.ua> <4C874F00.3050605@freebsd.org> <A6D7E134B24F42E395C30A375A6B50AF@multiplay.co.uk> <4C8D087B.5040404@freebsd.org> <03537796FAB54E02959E2D64FC83004F@multiplay.co.uk> <4C8D280F.3040803@freebsd.org> <3FBF66BF11AA4CBBA6124CA435A4A31B@multiplay.co.uk> <4C8E4212.30000@freebsd.org> <B98EBECBD399417CA5390C20627384B1@multiplay.co.uk> <D79F15FEB5794315BD8668E40B414BF0@multiplay.co.uk>
next in thread | previous in thread | raw e-mail | index | archive | help
On Wed, Sep 15, 2010 at 11:32:18AM +0100, Steven Hartland wrote: > Ok the results are in, the conclusions I can see from the data, others may see > more, are:- > > === Common === > * arc size on boot is ~180M with a target size of 6.5G > > === sendfile on === > * arc size increases on demand but peaks the min value > * The difference between min and max arc is taken up by inactive pages > * vm page daemon wakeups sit at a constant level once the machine has > filled memory and never fully empties swap. > > === sendfile off === > * arc size increases on demand all the way up the the max value > * vm cache count stays at almost zero all the time > > === conclusion === > The interaction of zfs and sendfile is causing large amounts of memory > to end up in the inactive pool and only the use of a hard min arc limit is > ensuring that zfs forces the vm to release said memory so that it can be > used by zfs arc. > > The source data, xls's and exported graphs can be found here:- > http://www.multiplaygameservers.com/dropzone/zfs-sendfile-results.zip Looks like Andriy just committed something to HEAD/CURRENT which might address this: http://www.freebsd.org/cgi/query-pr.cgi?pr=kern/141305 Commit: Author: avg Date: Wed Sep 15 10:31:27 2010 New Revision: 212650 URL: http://svn.freebsd.org/changeset/base/212650 -- | Jeremy Chadwick jdc@parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB |
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20100915104635.GA59871>