From owner-freebsd-fs@FreeBSD.ORG Thu Jan 26 17:24:25 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id AB5C0106566C for ; Thu, 26 Jan 2012 17:24:25 +0000 (UTC) (envelope-from wjw@digiware.nl) Received: from mail.digiware.nl (mail.ip6.digiware.nl [IPv6:2001:4cb8:1:106::2]) by mx1.freebsd.org (Postfix) with ESMTP id 3F18A8FC16 for ; Thu, 26 Jan 2012 17:24:25 +0000 (UTC) Received: from rack1.digiware.nl (localhost.digiware.nl [127.0.0.1]) by mail.digiware.nl (Postfix) with ESMTP id 1D78115343A; Thu, 26 Jan 2012 18:24:24 +0100 (CET) X-Virus-Scanned: amavisd-new at digiware.nl Received: from mail.digiware.nl ([127.0.0.1]) by rack1.digiware.nl (rack1.digiware.nl [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id bfPdOCd9D_qz; Thu, 26 Jan 2012 18:24:23 +0100 (CET) Received: from [192.168.10.67] (opteron [192.168.10.67]) by mail.digiware.nl (Postfix) with ESMTP id 6D192153433; Thu, 26 Jan 2012 18:24:23 +0100 (CET) Message-ID: <4F218C49.9050905@digiware.nl> Date: Thu, 26 Jan 2012 18:24:25 +0100 From: Willem Jan Withagen User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:9.0) Gecko/20111222 Thunderbird/9.0.1 MIME-Version: 1.0 To: Peter Maloney References: <4F193D90.9020703@digiware.nl> <20120121162906.0000518c@unknown> <4F1B0177.8080909@digiware.nl> <20120121230616.00006267@unknown> <4F1BC493.10304@brockmann-consult.de> <4F1C3597.4040009@digiware.nl> In-Reply-To: <4F1C3597.4040009@digiware.nl> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: freebsd-fs@freebsd.org Subject: Re: Question about ZFS with log and cache on SSD with GPT X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 26 Jan 2012 17:24:25 -0000 On 2012-01-22 17:13, Willem Jan Withagen wrote: > On 22-1-2012 9:10, Peter Maloney wrote: >> Am 21.01.2012 23:06, schrieb Alexander Leidinger: >> Here is an example from our FreeBSD forum: >> http://forums.freebsd.org/showthread.php?t=19093 > > Thanx for this thread, there is a lot of usefull info there. > pithy thing is to blow 66Mb, but then again on 40 or 120 Gb SSDs it is > only marginal. (Guess it stems from the time that HDs where 5Mb :) ) > > I'm still not really shure that that is needed it the bios has nothing > to do with these disks, as in our case: SSDs are only used as caches > under ZFS. > > Especially the testing methods are useful. They are of course valid for > any type partinioning... > So getting things right on this level is the first required. > >>> I create the first partition at the usual 63 sectors offset from the >>> start of the disk (track 1) which is /unaligned/ with the SSD erase >>> block. The second partition is set to start at sector 21030912 >>> (10767826944 bytes) which is /aligned/ with the SSD erase block. I did have some testing time last night... So I removed the SSD's from the pool. En then first filled them up with atleas 40G of garbage to make shure the SSDs logic considered them full. Then I created the partitions without alignment gpart create -s GPT ada2 gpart add -s 512M -t freebsd-zfs ada2 gpart add -t freebsd-zfs ada2 (Not shure if this would TRIM the SSD?) On both partitions I got no more that 110Mb/s write speed, whatever I tried. (writing 512Mb or 10Gb of data) Then I recreated the partitions as suggested in the above article: gpart create -s GPT ada2 gpart add -b 129024 -s 512M -t freebsd-zfs ada2 gpart add -t freebsd-zfs ada2 Lo and behold: the write speed was 220Mb/s. So it does really, really really matter. And testing is relatively simple. I was not able to trash the zpool itself, so it still runds under ashift=9. And if that given akward SSD access, that is still around. But the lowest layer should now atleast perform. I'll get more testing time on the box next week when others are done testing. And then I'll rebuild the pool to get ashift=12. Regards, --WjW