From owner-freebsd-fs@FreeBSD.ORG Sun Aug 26 21:39:49 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 29310106564A for ; Sun, 26 Aug 2012 21:39:49 +0000 (UTC) (envelope-from mailinglists@nobaq.net) Received: from mail.nobaq.net (mail.nobaq.net [IPv6:2001:7b8:3cd:3::172]) by mx1.freebsd.org (Postfix) with ESMTP id D36648FC08 for ; Sun, 26 Aug 2012 21:39:47 +0000 (UTC) Received: from localhost ([127.0.0.1] helo=mail.nobaq.net) by mail.nobaq.net with esmtp (Exim 4.72) (envelope-from ) id 1T5kYS-0007oC-DH; Sun, 26 Aug 2012 23:39:36 +0200 DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=nobaq.net; h=message-id :date:from:mime-version:to:cc:references:in-reply-to :content-type:content-transfer-encoding:subject; s=n200908; bh=H QDVJX7iMMNPxYNxuscSl1Eerwk=; b=0IhM4prC6wXNHOxNO9vmulB7cOqKd6eib HtzUlWUj02Xrbe6yULQJq/XGLX5n/U3x1HYErN8I64Tsp4z/15QJX5vfmkGBxNW5 XlGGJjuQWPBVru1rWtz7hALZqyh6kTJjIs6uTgEz+4ls55ha9EUTXUEqTgy6KWFj VnSJ1yXhDw= DomainKey-Signature: a=rsa-sha1; c=nofws; d=nobaq.net; h=message-id:date :from:mime-version:to:cc:references:in-reply-to:content-type :content-transfer-encoding:subject; q=dns; s=n200908; b=qroZWyzq MgXT8fYwMCghzy4AY/GYO6j4SIG9z/03plr2QrRcHqefSO8QDa372QJeMy6ZHjqj nekQbBVm9LJrINk5I4mEcOdxBg4wU/UHIS/zVQDmE6NezUrfVfViGi6735EVnvKS i/7D7IFYDGQlGCq5zAKp5AJtbPZDWWTI+6Q= Received: from 1360029737.d-dsl.at ([81.16.104.41] helo=[10.69.11.203]) by mail.nobaq.net with esmtpsa (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.72) (envelope-from ) id 1T5kXw-0007o7-Kt; Sun, 26 Aug 2012 23:39:36 +0200 Message-ID: <503A9773.2000604@nobaq.net> Date: Sun, 26 Aug 2012 23:38:59 +0200 From: Niki Hammler User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.1.24) Gecko/20100228 Thunderbird/2.0.0.24 Mnenhy/0.7.5.0 MIME-Version: 1.0 To: Freddie Cash References: <503A6F9F.7070801@nobaq.net> In-Reply-To: Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on mail.nobaq.net X-Spam-Level: X-Spam-Status: No, score=-0.6 required=5.0 tests=ALL_TRUSTED,AWL,BAYES_50 autolearn=ham version=3.3.1 X-SA-Exim-Connect-IP: 127.0.0.1 X-SA-Exim-Mail-From: mailinglists@nobaq.net X-SA-Exim-Scanned: No (on mail.nobaq.net); SAEximRunCond expanded to false Cc: freebsd-fs@freebsd.org Subject: Re: zvol + raidz issue? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Aug 2012 21:39:49 -0000 Hi Freddie, Thank you for the reply. Am 26.08.2012 22:13, schrieb Freddie Cash: > Please show the command-line used to create the zvol. Nothing special: zfs create -V 500g plvl1i0/zvtest1 > Especially the recordsize option. I guess you mean the '-b' option? Because recordsize is only valid for datasets, not for zvols. > When using zvols, you have to make sure to match the > recordsize of the zvol to that of the filesystem used above it. With above, you mean the pool containg it or the file system which will be created inside the zvol? For the first case: This should match if no blocksize is explicitely given: [root@zetta] ~# zfs get volblocksize plvl1i0/zvtest NAME PROPERTY VALUE SOURCE plvl1i0/zvtest volblocksize 8K - [root@zetta] ~# zfs get recordsize plvl1i0 NAME PROPERTY VALUE SOURCE plvl1i0 recordsize 128K default 128K MOD 8K = 0, furthermore, 16 zvol blocks reside within one record of the zpool. For the second case: I access the zvol directly via /dev/zvol/plvl1i0/zvtest (dd benchmark) so there is not yet a file system on top. Furthermore, I use bs=2048k with dd which is again divisible by volblocksize of the zvol and by recordsize of the pool. > Otherwise, performance will be atrocious. I understand. But still: What is the difference to a zpool with a single drive or to a mirror? I do not have the problem there ... Thank you. Regards, Niki > On Aug 26, 2012 11:50 AM, "Niki Hammler" > wrote: > > Hi, > > Given: new HP Proliant Microserver N40L (4 GB RAM) and 3x2TB SATA drives > (SAMSUNG HD204UI, ST32000542AS, WDC WD20EARX-00PASB0). > > Goal: RAIDz1 containg datasets and zvols to be exported via iSCSI. > > Issue: When I create a zvol on a RAIDz1 I get horrible performance (few > MB/s or less). > > First test: 500G zvol on a mirror (freshly created): > > # zpool list > NAME SIZE USED AVAIL CAP HEALTH ALTROOT > plvl1i0 1.81T 1.97G 1.81T 0% ONLINE /mnt > # zfs list > NAME USED AVAIL REFER MOUNTPOINT > plvl1i0 500G 1.30T 112K /mnt/plvl1i0 > plvl1i0/zvtest 500G 1.78T 1.97G - > # dd if=/dev/zero of=/dev/zvol/plvl1i0/zvtest bs=2048k count=1000 > 1000+0 records in > 1000+0 records out > 2097152000 bytes transferred in 17.318348 secs (121094230 bytes/sec) > # > > Corresponds to 115,48 MB/s which is good (similar results for a single > drive). > > Second test: 500G zvol on the 3x2TB raidz1 (freshly created): > > # dd if=/dev/zero of=/dev/zvol/plvl5i0/zvtest bs=2048k count=1000 > > 1000+0 records in > 1000+0 records out > 2097152000 bytes transferred in 700.126725 secs (2995389 bytes/sec) > # > > which is only 2,85 MB/s. > > Remark: Both pools are created with the force 4096 alignment option > (since I have 512 and 4096 drives mixed). > > Now is the point where you might say the problem is related to the > raidz1. But it is not: I created a 500G dataset in the same RAIDz pool > and copied about 100G data onto it with rsync+ssh. Result: about 28MB/s > end2end performance which is reasonable. > > Are there any issues with zvol + raidz1? Google resulted in empty result > set. > > I run a minimal FreeBSD 8.2 (FreeNAS): > > # uname -a > FreeBSD zetta 8.2-RELEASE-p9 FreeBSD 8.2-RELEASE-p9 #0: Thu Jul 19 > 12:39:10 PDT 2012 > root@build.ixsystems.com:/build/home/jpaetzel/8.2.0/os-base/amd64/build/home/jpaetzel/8.2.0/FreeBSD/src/sys/FREENAS.amd64 > amd64 > > Regards, > Niki > > > PS: This is also posted on > http://forums.freenas.org/showthread.php?p=35590 > _______________________________________________ > freebsd-fs@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org > " >