Skip site navigation (1)Skip section navigation (2)
Date:      Wed, 15 Sep 2010 03:46:35 -0700
From:      Jeremy Chadwick <freebsd@jdc.parodius.com>
To:        Steven Hartland <killing@multiplay.co.uk>
Cc:        freebsd-fs@freebsd.org, jhell <jhell@DataIX.net>, Pawel Jakub Dawidek <pjd@freebsd.org>, Andriy Gapon <avg@freebsd.org>
Subject:   Re: zfs very poor performance compared to ufs due to lack of cache?
Message-ID:  <20100915104635.GA59871@icarus.home.lan>
In-Reply-To: <D79F15FEB5794315BD8668E40B414BF0@multiplay.co.uk>
References:  <20100908084855.GF2465@deviant.kiev.zoral.com.ua> <4C874F00.3050605@freebsd.org> <A6D7E134B24F42E395C30A375A6B50AF@multiplay.co.uk> <4C8D087B.5040404@freebsd.org> <03537796FAB54E02959E2D64FC83004F@multiplay.co.uk> <4C8D280F.3040803@freebsd.org> <3FBF66BF11AA4CBBA6124CA435A4A31B@multiplay.co.uk> <4C8E4212.30000@freebsd.org> <B98EBECBD399417CA5390C20627384B1@multiplay.co.uk> <D79F15FEB5794315BD8668E40B414BF0@multiplay.co.uk>

next in thread | previous in thread | raw e-mail | index | archive | help
On Wed, Sep 15, 2010 at 11:32:18AM +0100, Steven Hartland wrote:
> Ok the results are in, the conclusions I can see from the data, others may see
> more, are:-
> 
> === Common ===
> * arc size on boot is ~180M with a target size of 6.5G
> 
> === sendfile on ===
> * arc size increases on demand but peaks the min value
> * The difference between min and max arc is taken up by inactive pages
> * vm page daemon wakeups sit at a constant level once the machine has
>  filled memory and never fully empties swap.
> 
> === sendfile off ===
> * arc size increases on demand all the way up the the max value
> * vm cache count stays at almost zero all the time
> 
> === conclusion ===
> The interaction of zfs and sendfile is causing large amounts of memory
> to end up in the inactive pool and only the use of a hard min arc limit is
> ensuring that zfs forces the vm to release said memory so that it can be
> used by zfs arc.
> 
> The source data, xls's and exported graphs can be found here:-
> http://www.multiplaygameservers.com/dropzone/zfs-sendfile-results.zip

Looks like Andriy just committed something to HEAD/CURRENT which might
address this:
http://www.freebsd.org/cgi/query-pr.cgi?pr=kern/141305

Commit:

 Author: avg
 Date: Wed Sep 15 10:31:27 2010
 New Revision: 212650
 URL: http://svn.freebsd.org/changeset/base/212650

-- 
| Jeremy Chadwick                                   jdc@parodius.com |
| Parodius Networking                       http://www.parodius.com/ |
| UNIX Systems Administrator                  Mountain View, CA, USA |
| Making life hard for others since 1977.              PGP: 4BD6C0CB |




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20100915104635.GA59871>