From owner-freebsd-current@FreeBSD.ORG Wed Nov 9 08:47:09 2011 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 3BB87106566C for ; Wed, 9 Nov 2011 08:47:09 +0000 (UTC) (envelope-from ktouet@gmail.com) Received: from mail-wy0-f182.google.com (mail-wy0-f182.google.com [74.125.82.182]) by mx1.freebsd.org (Postfix) with ESMTP id 835F38FC17 for ; Wed, 9 Nov 2011 08:47:08 +0000 (UTC) Received: by wyg36 with SMTP id 36so1877466wyg.13 for ; Wed, 09 Nov 2011 00:47:07 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; bh=yMAq5txK1SgY7y98MxD4o6loSvfztUd/khEPGzHfygQ=; b=gjZK2OzobvXU3aGyiRQA7F2N9V6Jpd2S+/5S7JV2oMyG65d8jD31AU9Cnvn6HANPYG oYsiFtKdhBgJKy9At0zHOnoj2blBOzzyd1lGrnP3Q2u61hByEG8Vxz4nbR+p/RKXsLwW M21thRXP3nAejSv7K6Za/gFAT7h3plrFPn2d0= MIME-Version: 1.0 Received: by 10.216.136.6 with SMTP id v6mr5121615wei.78.1320828426837; Wed, 09 Nov 2011 00:47:06 -0800 (PST) Received: by 10.216.37.19 with HTTP; Wed, 9 Nov 2011 00:47:06 -0800 (PST) In-Reply-To: <82C85C01-62C4-4E75-B3F2-59D703CA5D78@gsoft.com.au> References: <82C85C01-62C4-4E75-B3F2-59D703CA5D78@gsoft.com.au> Date: Wed, 9 Nov 2011 02:47:06 -0600 Message-ID: From: Kurt Touet To: "Daniel O'Connor" Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable Cc: Garrett Cooper , freebsd-current@freebsd.org, Dan The Man Subject: Re: samba+zfs X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 09 Nov 2011 08:47:09 -0000 On Wed, Nov 9, 2011 at 1:07 AM, Daniel O'Connor wro= te: > > On 09/11/2011, at 17:32, Garrett Cooper wrote >>> dd's of large files (spooled backups going to tape) to /dev/null are as= slow as Samba. >> >> =A0 =A0- Dedupe? > > Nope. > >> =A0 =A0- Compression? > > On the mail spool & ports, but not on the tape spool. > >> =A0 =A0- How much RAM? > > 8GB. > >> =A0 =A0- What debug options do you have enabled in the kernel? > > It is 8.2-GENERIC so.. no WITNESS (for example) > >> =A0 =A0I've been noticing a slowdown in some respects with NFS/SMB, but = I >> suspected it was because I have an re(4) based NIC. ZFS has also wired >> down a lot of my system memory for the L2ARC=85 > > > re isn't great but I wouldn't expect it to slow down over time.. Unless b= ounce buffers got used more and more or something. > > I have an em0 card in this system - but in any case it is slow locally (i= .e. dd a large file with 64k block size). > > -- > Daniel O'Connor software and network engineer > for Genesis Software - http://www.gsoft.com.au > "The nice thing about standards is that there > are so many of them to choose from." > =A0-- Andrew Tanenbaum > GPG Fingerprint - 5596 B766 97C0 0E94 4347 295E E593 DC20 7B3F CE8C > > Right now (while experience slow writes via samba+zfs) this is general read speed off a 4 x 1.5TB sata2 raidz1: # dd if=3Dtest.file of=3D/dev/null 13753502+1 records in 13753502+1 records out 7041793036 bytes transferred in 100.020897 secs (70403218 bytes/sec) That's not in the same ball park of slow writes, but it is below what I expect for reads. My setup is a little odd: 4x1.5tb raidz sata2 on mobo + 2 x 2tb mirror on sata1 pci controller, zfs v28, stable/9 r227357, amd x4 810 2.6ghz, 4gb ram, no dedupe, no compression, daily snapshots saved for 7 days The above file read was stored before the 2 x 2tb mirror addition, so it was a solely read off the sata2 mobo ports. Reading off of something more recent (and split amongst both raidz1 and mirror vdevs): # dd if=3Dtest2.file of=3D/dev/null 9154715+1 records in 9154715+1 records out 4687214153 bytes transferred in 82.963181 secs (56497522 bytes/sec) This is, again, seems slower than usual, but not as terrible as the write speeds that I've been seeing via samba.