From owner-freebsd-fs@FreeBSD.ORG Sun Aug 26 18:49:51 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id CBADF106564A for ; Sun, 26 Aug 2012 18:49:51 +0000 (UTC) (envelope-from mailinglists@nobaq.net) Received: from mail.nobaq.net (mail.nobaq.net [IPv6:2001:7b8:3cd:3::172]) by mx1.freebsd.org (Postfix) with ESMTP id 24A148FC16 for ; Sun, 26 Aug 2012 18:49:48 +0000 (UTC) Received: from localhost ([127.0.0.1] helo=mail.nobaq.net) by mail.nobaq.net with esmtp (Exim 4.72) (envelope-from ) id 1T5htz-0007U7-LK for freebsd-fs@freebsd.org; Sun, 26 Aug 2012 20:49:39 +0200 DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=nobaq.net; h=message-id :date:from:mime-version:to:content-type :content-transfer-encoding:subject; s=n200908; bh=2KpaQ0a0/IVy8s Zb9dxXhIHJbq4=; b=WTBF9Q/zDuSvkQMIomOseaRdpN/t9YB5mbEv3t3RCId5Ut 1J9LloFGrIHtl8qAS4UD7q50LmxijMireYgyOhHeVgGlxeSD/p7O6JtqkbuMPvUK 3cU9Je3yE1xxAgrPr8trZ/vXMEgZxoRxpNdRKRHG4OyWgyL0+J57ZO83S9p1E= DomainKey-Signature: a=rsa-sha1; c=nofws; d=nobaq.net; h=message-id:date :from:mime-version:to:content-type:content-transfer-encoding :subject; q=dns; s=n200908; b=NIhm1m8QTowmiSA3Ocuj031oLNw1PNoIB7 hpyj53dT4O8vG2p4TbmFqr2yB0GRBaReAbaBYPzObuP6kP5T3IEET6l7BHiLYujz HL6UGC1A9eShhshSj5zG0qOAErBgwutUmovhHEmBjkKfidORPf6RFsiW6LZr5N5c 6/dm4oOmQ= Received: from 1360029737.d-dsl.at ([81.16.104.41] helo=[10.69.11.215]) by mail.nobaq.net with esmtpsa (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.72) (envelope-from ) id 1T5htS-0007U0-MB for freebsd-fs@freebsd.org; Sun, 26 Aug 2012 20:49:39 +0200 Message-ID: <503A6F9F.7070801@nobaq.net> Date: Sun, 26 Aug 2012 20:49:03 +0200 From: Niki Hammler User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.1.24) Gecko/20100228 Thunderbird/2.0.0.24 Mnenhy/0.7.5.0 MIME-Version: 1.0 To: freebsd-fs@freebsd.org Content-Type: text/plain; charset=ISO-8859-15 Content-Transfer-Encoding: 7bit X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on mail.nobaq.net X-Spam-Level: X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED autolearn=unavailable version=3.3.1 X-SA-Exim-Connect-IP: 127.0.0.1 X-SA-Exim-Mail-From: mailinglists@nobaq.net X-SA-Exim-Scanned: No (on mail.nobaq.net); SAEximRunCond expanded to false Subject: zvol + raidz issue? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Aug 2012 18:49:52 -0000 Hi, Given: new HP Proliant Microserver N40L (4 GB RAM) and 3x2TB SATA drives (SAMSUNG HD204UI, ST32000542AS, WDC WD20EARX-00PASB0). Goal: RAIDz1 containg datasets and zvols to be exported via iSCSI. Issue: When I create a zvol on a RAIDz1 I get horrible performance (few MB/s or less). First test: 500G zvol on a mirror (freshly created): # zpool list NAME SIZE USED AVAIL CAP HEALTH ALTROOT plvl1i0 1.81T 1.97G 1.81T 0% ONLINE /mnt # zfs list NAME USED AVAIL REFER MOUNTPOINT plvl1i0 500G 1.30T 112K /mnt/plvl1i0 plvl1i0/zvtest 500G 1.78T 1.97G - # dd if=/dev/zero of=/dev/zvol/plvl1i0/zvtest bs=2048k count=1000 1000+0 records in 1000+0 records out 2097152000 bytes transferred in 17.318348 secs (121094230 bytes/sec) # Corresponds to 115,48 MB/s which is good (similar results for a single drive). Second test: 500G zvol on the 3x2TB raidz1 (freshly created): # dd if=/dev/zero of=/dev/zvol/plvl5i0/zvtest bs=2048k count=1000 1000+0 records in 1000+0 records out 2097152000 bytes transferred in 700.126725 secs (2995389 bytes/sec) # which is only 2,85 MB/s. Remark: Both pools are created with the force 4096 alignment option (since I have 512 and 4096 drives mixed). Now is the point where you might say the problem is related to the raidz1. But it is not: I created a 500G dataset in the same RAIDz pool and copied about 100G data onto it with rsync+ssh. Result: about 28MB/s end2end performance which is reasonable. Are there any issues with zvol + raidz1? Google resulted in empty result set. I run a minimal FreeBSD 8.2 (FreeNAS): # uname -a FreeBSD zetta 8.2-RELEASE-p9 FreeBSD 8.2-RELEASE-p9 #0: Thu Jul 19 12:39:10 PDT 2012 root@build.ixsystems.com:/build/home/jpaetzel/8.2.0/os-base/amd64/build/home/jpaetzel/8.2.0/FreeBSD/src/sys/FREENAS.amd64 amd64 Regards, Niki PS: This is also posted on http://forums.freenas.org/showthread.php?p=35590