From owner-freebsd-stable@FreeBSD.ORG Sun Jan 2 16:59:19 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 972C6106566B for ; Sun, 2 Jan 2011 16:59:19 +0000 (UTC) (envelope-from prvs=19835cea4b=killing@multiplay.co.uk) Received: from mail1.multiplay.co.uk (mail1.multiplay.co.uk [85.236.96.23]) by mx1.freebsd.org (Postfix) with ESMTP id 1FD5B8FC18 for ; Sun, 2 Jan 2011 16:59:18 +0000 (UTC) X-MDAV-Processed: mail1.multiplay.co.uk, Sun, 02 Jan 2011 16:48:15 +0000 X-Spam-Processed: mail1.multiplay.co.uk, Sun, 02 Jan 2011 16:48:15 +0000 X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on mail1.multiplay.co.uk X-Spam-Level: X-Spam-Status: No, score=-5.0 required=6.0 tests=USER_IN_WHITELIST shortcircuit=ham autolearn=disabled version=3.2.5 Received: from r2d2 ([188.220.16.49]) by mail1.multiplay.co.uk (mail1.multiplay.co.uk [85.236.96.23]) (MDaemon PRO v10.0.4) with ESMTP id md50011911713.msg for ; Sun, 02 Jan 2011 16:48:14 +0000 X-MDRemoteIP: 188.220.16.49 X-Return-Path: prvs=19835cea4b=killing@multiplay.co.uk X-Envelope-From: killing@multiplay.co.uk X-MDaemon-Deliver-To: freebsd-stable@freebsd.org Message-ID: <9C43FB11DF5143A5BA72AF7F79DB49AB@multiplay.co.uk> From: "Steven Hartland" To: "Jeremy Chadwick" , "Peter Jeremy" References: <4D1AF388.3080107@infracaninophile.co.uk><4D1B7431.7070808@infracaninophile.co.uk><4D1BD8D0.5010402@langille.org><4D1C4A2D.4020206@infracaninophile.co.uk><4D1C7929.3040809@langille.org><20101231233343.GB48579@server.vk2pj.dyndns.org> <20101231234747.GA8171@icarus.home.lan> Date: Sun, 2 Jan 2011 16:48:15 -0000 MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset="iso-8859-1"; reply-type=original Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2900.5931 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.5994 Cc: freebsd-stable@freebsd.org, Dan Langille Subject: Re: slow ZFS on FreeBSD 8.1 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 02 Jan 2011 16:59:19 -0000 ----- Original Message ----- From: "Jeremy Chadwick" >> Based on my experiences at home, I converted my desktop at work to >> pure ZFS. The only issues I've run into have been programs that >> extensively use mmap(2) - which is a known issue with ZFS. > > Is your ZFS root filesystem associated with a pool that's mirrored or > using raidzX? What about mismatched /boot content (ZFS vs. UFS)? What > about booting into single-user mode? > > http://wiki.freebsd.org/ZFSOnRoot indirectly hints at these problems but > doesn't outright admit them (yet should), so I'm curious to know how > people have solved them. Remembering manual "one-offs" for a system > configured this way is not acceptable (read: highly prone to > error/mistake). Is it worth the risk? Most administrators don't have > the tolerance for stuff like that in the middle of a system upgrade or > what not; they should be able to follow exactly what's in the handbook, > to a tee. > > There's a link to www.dan.me.uk at the bottom of the above Wiki page > that outlines "the madness" that's required to configure the setup, all > of which has to be done by hand. I don't know many administrators who > are going to tolerate this when deploying numerous machines, especially > when compounded by the complexities mentioned above. With regards installing machines with a root zfs we now use mfsBSD which makes the process as simple as pie, so for those that haven't used it give it a wirl:- http://mfsbsd.vx.sk/ > The mmap(2) and sendfile(2) complexities will bite an junior or > mid-level SA in the butt too -- they won't know why software starts > failing or behaving oddly (FreeBSD ftpd is a good example). It just so > happens that Apache, out-of-the-box, comes with mmap and sendfile use > disabled. This is the same with nginx which is rapidly taking over from apache due to its ability to scale much much better than apache does. Proper mmap and sendfile integration are the only major issue we have with moving all our machines to ZFS thanks to great work by everyone. I really hope sendfile support in particular is fixed in the near future but as I understanding it, that's not going to be simple at all :( Regards Steve ================================================ This e.mail is private and confidential between Multiplay (UK) Ltd. and the person or entity to whom it is addressed. In the event of misdirection, the recipient is prohibited from using, copying, printing or otherwise disseminating it or any information contained in it. In the event of misdirection, illegible or incomplete transmission please telephone +44 845 868 1337 or return the E.mail to postmaster@multiplay.co.uk.