From owner-freebsd-current@FreeBSD.ORG Sat Nov 12 10:55:42 2011 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 88CFE106566B for ; Sat, 12 Nov 2011 10:55:42 +0000 (UTC) (envelope-from dan@sunsaturn.com) Received: from sunsaturn.com (mail1.sunsaturn.com [IPv6:2001:49f0:4004::2]) by mx1.freebsd.org (Postfix) with ESMTP id 46F9A8FC0A for ; Sat, 12 Nov 2011 10:55:42 +0000 (UTC) Received: by sunsaturn.com (Postfix, from userid 1001) id 6B0CF119C75; Sat, 12 Nov 2011 04:55:41 -0600 (CST) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=sunsaturn.com; s=gamma; t=1321095341; bh=ZAh4W6dFedrziNzefn8jhv/QIO+Kwx4ih3bENZZhS74=; h=Date:From:To:cc:Subject:In-Reply-To:Message-ID:References: MIME-Version:Content-Type; b=DynGVa3PkTvCEPuFkB16K+xYIqcWlEhFjom8o+B4t5pinpymU/NLX2aH8XlhBJoVE bW+pLXbqS23sIdxkw7iHlzufj/0mGZSjGKoVo49AG3trZ036ykb9O0DFWFD1L+g3Yj ST1dnhMTV8ynyREPMyZ3ASuIO/fv4LV0Owk+UuaA= Received: from localhost (localhost [127.0.0.1]) by sunsaturn.com (Postfix) with ESMTP id 654B7119C6C; Sat, 12 Nov 2011 04:55:41 -0600 (CST) Date: Sat, 12 Nov 2011 04:55:41 -0600 (CST) From: Dan The Man To: Kurt Touet In-Reply-To: Message-ID: References: <82C85C01-62C4-4E75-B3F2-59D703CA5D78@gsoft.com.au> User-Agent: Alpine 2.00 (BSF 1167 2008-08-23) MIME-Version: 1.0 Content-Type: MULTIPART/MIXED; BOUNDARY="2338054437-460234558-1321095341=:65294" Cc: Garrett Cooper , freebsd-current@freebsd.org Subject: Re: samba+zfs X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 12 Nov 2011 10:55:42 -0000 This message is in MIME format. The first part should be readable text, while the remaining parts are likely unreadable without MIME-aware tools. --2338054437-460234558-1321095341=:65294 Content-Type: TEXT/PLAIN; charset=windows-1252; format=flowed Content-Transfer-Encoding: 8BIT Well been running a week now and problems again. 3 3 terrabyte drives are @85% with compression enabled, i have to wonder if that is part of the problem. Dan. -- Dan The Man CTO/ Senior System Administrator Websites, Domains and Everything else http://www.SunSaturn.com Email: Dan@SunSaturn.com On Wed, 9 Nov 2011, Kurt Touet wrote: > On Wed, Nov 9, 2011 at 1:07 AM, Daniel O'Connor wrote: >> >> On 09/11/2011, at 17:32, Garrett Cooper wrote >>>> dd's of large files (spooled backups going to tape) to /dev/null are as slow as Samba. >>> >>>    - Dedupe? >> >> Nope. >> >>>    - Compression? >> >> On the mail spool & ports, but not on the tape spool. >> >>>    - How much RAM? >> >> 8GB. >> >>>    - What debug options do you have enabled in the kernel? >> >> It is 8.2-GENERIC so.. no WITNESS (for example) >> >>>    I've been noticing a slowdown in some respects with NFS/SMB, but I >>> suspected it was because I have an re(4) based NIC. ZFS has also wired >>> down a lot of my system memory for the L2ARC… >> >> >> re isn't great but I wouldn't expect it to slow down over time.. Unless bounce buffers got used more and more or something. >> >> I have an em0 card in this system - but in any case it is slow locally (i.e. dd a large file with 64k block size). >> >> -- >> Daniel O'Connor software and network engineer >> for Genesis Software - http://www.gsoft.com.au >> "The nice thing about standards is that there >> are so many of them to choose from." >>  -- Andrew Tanenbaum >> GPG Fingerprint - 5596 B766 97C0 0E94 4347 295E E593 DC20 7B3F CE8C >> >> > > Right now (while experience slow writes via samba+zfs) this is general > read speed off a 4 x 1.5TB sata2 raidz1: > > # dd if=test.file of=/dev/null > 13753502+1 records in > 13753502+1 records out > 7041793036 bytes transferred in 100.020897 secs (70403218 bytes/sec) > > That's not in the same ball park of slow writes, but it is below what > I expect for reads. > > My setup is a little odd: 4x1.5tb raidz sata2 on mobo + 2 x 2tb > mirror on sata1 pci controller, zfs v28, stable/9 r227357, amd x4 810 > 2.6ghz, 4gb ram, no dedupe, no compression, daily snapshots saved for > 7 days > > The above file read was stored before the 2 x 2tb mirror addition, so > it was a solely read off the sata2 mobo ports. Reading off of > something more recent (and split amongst both raidz1 and mirror > vdevs): > > # dd if=test2.file of=/dev/null > 9154715+1 records in > 9154715+1 records out > 4687214153 bytes transferred in 82.963181 secs (56497522 bytes/sec) > > This is, again, seems slower than usual, but not as terrible as the > write speeds that I've been seeing via samba. > --2338054437-460234558-1321095341=:65294--