From owner-freebsd-current@FreeBSD.ORG Mon Nov 14 08:56:21 2011 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 54AC8106564A for ; Mon, 14 Nov 2011 08:56:21 +0000 (UTC) (envelope-from dan@sunsaturn.com) Received: from sunsaturn.com (mail1.sunsaturn.com [IPv6:2001:49f0:4004::2]) by mx1.freebsd.org (Postfix) with ESMTP id 1F83D8FC08 for ; Mon, 14 Nov 2011 08:56:21 +0000 (UTC) Received: by sunsaturn.com (Postfix, from userid 1001) id B4CA1119C6C; Mon, 14 Nov 2011 02:56:20 -0600 (CST) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=sunsaturn.com; s=gamma; t=1321260980; bh=UwlQBJIciMDfKCb34/1udFR7vmiCBVnjXrtQ9BJU8Pc=; h=Date:From:To:cc:Subject:In-Reply-To:Message-ID:References: MIME-Version:Content-Type; b=nLaz1k0Ht094yN045lKb0+AsHm52o+ItoCh6nrNmD6S3DKk4ci+LI3DdRZ1qyfyMK bQzc3rELwPvbOZIRZTCv+9lPpZH/01ihD19P/36xN2NdnPVYHlt1+gmTy+yA0vnjfn T07A4j1fxWQWrxp8r+0gGxI/7PAbDNlQ3lf3t4eU= Received: from localhost (localhost [127.0.0.1]) by sunsaturn.com (Postfix) with ESMTP id AEE15119C6B; Mon, 14 Nov 2011 02:56:20 -0600 (CST) Date: Mon, 14 Nov 2011 02:56:20 -0600 (CST) From: Dan The Man To: Kurt Touet In-Reply-To: Message-ID: References: <82C85C01-62C4-4E75-B3F2-59D703CA5D78@gsoft.com.au> User-Agent: Alpine 2.00 (BSF 1167 2008-08-23) MIME-Version: 1.0 Content-Type: MULTIPART/MIXED; BOUNDARY="2338054437-1620793793-1321260980=:1814" Cc: Garrett Cooper , freebsd-current@freebsd.org Subject: Re: samba+zfs X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Nov 2011 08:56:21 -0000 This message is in MIME format. The first part should be readable text, while the remaining parts are likely unreadable without MIME-aware tools. --2338054437-1620793793-1321260980=:1814 Content-Type: TEXT/PLAIN; charset=windows-1252; format=flowed Content-Transfer-Encoding: 8BIT Running tcpdump to trace what samba is doing so maybe someone can give some insight, lan interface is sk0. 02:52:34.347357 IP (tos 0x0, ttl 64, id 56121, offset 0, flags [none], proto TCP (6), length 1500) asterisk.microsoft-ds > desktop.58858: Flags [.], cksum 0x5e3f (correct), seq 105687574:105689034, ack 63894978, win 256, length 1460SMB-over-TCP packet:(raw data or continuation?) 02:52:34.347361 IP (tos 0x0, ttl 64, id 56122, offset 0, flags [none], proto TCP (6), length 1500) asterisk.microsoft-ds > desktop.58858: Flags [.], cksum 0xbe99 (correct), seq 105689034:105690494, ack 63894978, win 256, length 1460SMB-over-TCP packet:(raw data or continuation?) 02:52:34.347365 IP (tos 0x0, ttl 64, id 56123, offset 0, flags [none], proto TCP (6), length 1500) asterisk.microsoft-ds > desktop.58858: Flags [.], cksum 0x0b31 (correct), seq 105690494:105691954, ack 63894978, win 256, length 1460SMB-over-TCP packet:(raw data or continuation?) 02:52:34.347369 IP (tos 0x0, ttl 64, id 56124, offset 0, flags [none], proto TCP (6), length 1500) asterisk.microsoft-ds > desktop.58858: Flags [.], cksum 0xaee6 (correct), seq 105691954:105693414, ack 63894978, win 256, length 1460SMB-over-TCP packet:(raw data or continuation?) 02:52:34.347372 IP (tos 0x0, ttl 64, id 56125, offset 0, flags [none], proto TCP (6), length 1500) asterisk.microsoft-ds > desktop.58858: Flags [.], cksum 0xcff5 (correct), seq 105693414:105694874, ack 63894978, win 256, length 1460SMB-over-TCP packet:(raw data or continuation?) 02:52:34.347376 IP (tos 0x0, ttl 64, id 56126, offset 0, flags [none], proto TCP (6), length 1500) asterisk.microsoft-ds > desktop.58858: Flags [.], cksum 0xd893 (correct), seq 105694874:105696334, ack 63894978, win 256, length 1460SMB-over-TCP packet:(raw data or continuation?) We get a ton of these, my mapped samba drive on Z: becomes nearly unresponsive after i start transferring things through it, yet I can jump on Y: drive which is NFS mount to same interface on machine and everything is fine and responsive.... Dan. -- Dan The Man CTO/ Senior System Administrator Websites, Domains and Everything else http://www.SunSaturn.com Email: Dan@SunSaturn.com On Sat, 12 Nov 2011, Dan The Man wrote: > > > Well been running a week now and problems again. 3 3 terrabyte drives are > @85% with compression enabled, i have to wonder if that is part of the > problem. > > > > Dan. > > > > -- > Dan The Man > CTO/ Senior System Administrator > Websites, Domains and Everything else > http://www.SunSaturn.com > Email: Dan@SunSaturn.com > > On Wed, 9 Nov 2011, Kurt Touet wrote: > >> On Wed, Nov 9, 2011 at 1:07 AM, Daniel O'Connor >> wrote: >>> >>> On 09/11/2011, at 17:32, Garrett Cooper wrote >>>>> dd's of large files (spooled backups going to tape) to /dev/null are as >>>>> slow as Samba. >>>> >>>>    - Dedupe? >>> >>> Nope. >>> >>>>    - Compression? >>> >>> On the mail spool & ports, but not on the tape spool. >>> >>>>    - How much RAM? >>> >>> 8GB. >>> >>>>    - What debug options do you have enabled in the kernel? >>> >>> It is 8.2-GENERIC so.. no WITNESS (for example) >>> >>>>    I've been noticing a slowdown in some respects with NFS/SMB, but I >>>> suspected it was because I have an re(4) based NIC. ZFS has also wired >>>> down a lot of my system memory for the L2ARC… >>> >>> >>> re isn't great but I wouldn't expect it to slow down over time.. Unless >>> bounce buffers got used more and more or something. >>> >>> I have an em0 card in this system - but in any case it is slow locally >>> (i.e. dd a large file with 64k block size). >>> >>> -- >>> Daniel O'Connor software and network engineer >>> for Genesis Software - http://www.gsoft.com.au >>> "The nice thing about standards is that there >>> are so many of them to choose from." >>>  -- Andrew Tanenbaum >>> GPG Fingerprint - 5596 B766 97C0 0E94 4347 295E E593 DC20 7B3F CE8C >>> >>> >> >> Right now (while experience slow writes via samba+zfs) this is general >> read speed off a 4 x 1.5TB sata2 raidz1: >> >> # dd if=test.file of=/dev/null >> 13753502+1 records in >> 13753502+1 records out >> 7041793036 bytes transferred in 100.020897 secs (70403218 bytes/sec) >> >> That's not in the same ball park of slow writes, but it is below what >> I expect for reads. >> >> My setup is a little odd: 4x1.5tb raidz sata2 on mobo + 2 x 2tb >> mirror on sata1 pci controller, zfs v28, stable/9 r227357, amd x4 810 >> 2.6ghz, 4gb ram, no dedupe, no compression, daily snapshots saved for >> 7 days >> >> The above file read was stored before the 2 x 2tb mirror addition, so >> it was a solely read off the sata2 mobo ports. Reading off of >> something more recent (and split amongst both raidz1 and mirror >> vdevs): >> >> # dd if=test2.file of=/dev/null >> 9154715+1 records in >> 9154715+1 records out >> 4687214153 bytes transferred in 82.963181 secs (56497522 bytes/sec) >> >> This is, again, seems slower than usual, but not as terrible as the >> write speeds that I've been seeing via samba. > --2338054437-1620793793-1321260980=:1814--