From owner-freebsd-stable@FreeBSD.ORG Thu Apr 28 21:20:38 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 12A78106566B for ; Thu, 28 Apr 2011 21:20:38 +0000 (UTC) (envelope-from cscotts@gmail.com) Received: from mail-qy0-f175.google.com (mail-qy0-f175.google.com [209.85.216.175]) by mx1.freebsd.org (Postfix) with ESMTP id B78F68FC1B for ; Thu, 28 Apr 2011 21:20:37 +0000 (UTC) Received: by qyk35 with SMTP id 35so2911158qyk.13 for ; Thu, 28 Apr 2011 14:20:37 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:subject:mime-version:content-type:from :in-reply-to:date:cc:content-transfer-encoding:message-id:references :to:x-mailer; bh=DgPLQtO6BPCdqY10a88De0bDradjaxCOvlipaJj16iw=; b=RN+CVriKUuxC4Gk/tMlO1H6xbJE3QgEyJhJd+iOdF3jqxrSrko5Oh0lIoRqF9MlU10 WY2BqwE4hHX8f15wObVg968p5/ctmFMbGCatyty2DfJSNhcNMORVk+yPcxLoJYt9NYgu bLbGS58Ar2LPThxxj3AUIe7BQUfX1Yo+wz000= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=subject:mime-version:content-type:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to:x-mailer; b=utMKhuoyr3SBBIhhJz6nmq4lUOytOciPOjNQIxtPX7lEiraKlT3QSncf/nSZZGkNhz FgKnjh/+V95mrM+GVPiCwhC6+XW+HuIoKp7snClvmiqEJwAPwP0+RpLGOZFxejyWou7f f7mA/z0V6XyPxkTUP6YFeNH1P//wuf9n/6Pro= Received: by 10.224.100.200 with SMTP id z8mr1025763qan.159.1304023987781; Thu, 28 Apr 2011 13:53:07 -0700 (PDT) Received: from sahibkuran.cap-press.com (dsl093-240-245.ral1.dsl.speakeasy.net [66.93.240.245]) by mx.google.com with ESMTPS id t17sm1554743qcs.35.2011.04.28.13.53.06 (version=TLSv1/SSLv3 cipher=OTHER); Thu, 28 Apr 2011 13:53:06 -0700 (PDT) Mime-Version: 1.0 (Apple Message framework v1084) Content-Type: text/plain; charset=us-ascii From: Scott Sipe In-Reply-To: <20110428195601.GA31807@icarus.home.lan> Date: Thu, 28 Apr 2011 16:53:03 -0400 Content-Transfer-Encoding: quoted-printable Message-Id: References: <537A8F4F-A302-40F9-92DF-403388D99B4B@gsoft.com.au> <20110428195601.GA31807@icarus.home.lan> To: Jeremy Chadwick X-Mailer: Apple Mail (2.1084) Cc: freebsd-stable List Subject: Re: ZFS vs OSX Time Machine X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Apr 2011 21:20:38 -0000 On Apr 28, 2011, at 3:56 PM, Jeremy Chadwick wrote: > On Thu, Apr 28, 2011 at 11:33:22PM +0930, Daniel O'Connor wrote: >> Does anyone else use ZFS to store TM backups? >>=20 >> I find that whenever my laptop (over wifi!) starts a TM the ZFS = machine it's backing up to grinds to a halt.. Other systems streaming = stuff over NFS from it also tend to stall.. >>=20 >> I presume that TM is doing something which causes ZFS some issues but = I'm not sure how to find out what the real problem is let alone how to = fix it.. >>=20 >> I am running FreeBSD midget.dons.net.au 8.2-PRERELEASE FreeBSD = 8.2-PRERELEASE #8 r217094M: Sat Jan 8 11:15:07 CST 2011 = darius@midget.dons.net.au:/usr/obj/usr/src/sys/MIDGET amd64 >>=20 >> It is a 5 disk RAIDZ1 with 1.29Tb free using WD10EADS drives. >>=20 >> I don't see any SMART errors or ZFS warnings. >>=20 >> I have the following ZFS related tunables >>=20 >> vfs.zfs.arc_max=3D"3072M" >> vfs.zfs.prefetch_disable=3D"1"=20 >> vfs.zfs.txg.timeout=3D5 >> vfs.zfs.cache_flush_disable=3D1 >=20 > Are the last two actually *working* in /boot/loader.conf? Can you > verify by looking at them via sysctl? AFAIK they shouldn't work, = since > they lack double-quotes around the values. Parsing errors are = supposed > to throw you back to the loader prompt. See loader.conf(5) for the > syntax. In my /boot/loader.conf I have: vfs.zfs.arc_max=3D6200000000 vfs.zfs.vdev.min_pending=3D4 vfs.zfs.vdev.max_pending=3D8 vfs.zfs.txg.timeout=3D5 vfs.zfs.prefetch_disable=3D1 And they all are properly reflected in sysctl values (no parse errors = seen). > Next, you COULD try using Samba/CIFS on the FreeBSD box to see if you > can narrow the issue down to bad NFS performance. Please see this = post > of mine about tuning Samba on FreeBSD (backed by ZFS) to get extremely > good performance. Many people responded and said their performance > drastically improved (you can see the thread yourself). The trick is > AIO. You can ignore the part about setting vm.kmem_size in = loader.conf; > that advice is now old/deprecated (does not pertain to you given the > date of your kernel), and vfs.zfs.txg.write_limit_override is = something > you shouldn't mess with unless absolutely needed to leave it default: >=20 > = http://lists.freebsd.org/pipermail/freebsd-stable/2011-February/061642.htm= l Just wanted to note that we were having a terrible time with ZFS = performance. Copying just a single large file over the network would = bring interactive system usage to an absolute crawl (system is 2x xeons, = 12gb ram). Thanks to your optimizations we have great ZFS + Samba = performance. We also use Netatalk for afpd file sharing (though I have = not tried Netatalk as a Time Machine target) and our performance is = quite good there as well. Scott