From owner-freebsd-stable@FreeBSD.ORG Wed Aug 6 09:54:30 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 15D761065677 for ; Wed, 6 Aug 2008 09:54:30 +0000 (UTC) (envelope-from kometen@gmail.com) Received: from fg-out-1718.google.com (fg-out-1718.google.com [72.14.220.157]) by mx1.freebsd.org (Postfix) with ESMTP id 110638FC1B for ; Wed, 6 Aug 2008 09:54:28 +0000 (UTC) (envelope-from kometen@gmail.com) Received: by fg-out-1718.google.com with SMTP id l26so3989790fgb.35 for ; Wed, 06 Aug 2008 02:54:26 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references; bh=9/P9eAuSTv7vLUfTNBQ74+ALynDEowdCt4kDv3cBjl0=; b=BhOxTeGttJ4s2KGX30+YYy/7sXJqqyn7iYhyTznrAz0Khw1IdSFNY9k7XB8z+x5LM9 8853Tehc78F8ihcjoYzGlr1kqAvk2Dhqjx24ld7X44UV8XmumcjZgxrS8viRxj5GURfb WR8cPFno9EUGEX7dj+HcJVDgU4eaJ9OGe7Rcg= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references; b=rFtam9MUWIb7WyIj2lWIBGpXFCxgMadwQhk6jNdz06FpbOjNV7NWQi1u/KvG2cvBEt F/sdSdZzSZpPWiIRC3j1mrxI+2ccCdOwJcFWt9bx+9cDIxH0eWpSO4VOJ+xUhN2k7sU7 dyz5wbUn1wgkmwMfFaDXhgVsgtF4HKLXVH47o= Received: by 10.86.66.11 with SMTP id o11mr643179fga.69.1218016466485; Wed, 06 Aug 2008 02:54:26 -0700 (PDT) Received: by 10.86.35.9 with HTTP; Wed, 6 Aug 2008 02:54:26 -0700 (PDT) Message-ID: Date: Wed, 6 Aug 2008 11:54:26 +0200 From: "Claus Guttesen" To: "FreeBSD Stable" In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: Subject: Re: zfs, raidz, spare and jbod X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 Aug 2008 09:54:30 -0000 > I installed FreeBSD 7 a few days ago and upgraded to the latest stable > release using GENERIC kernel. I also added these entries to > /boot/loader.conf: > > vm.kmem_size="1536M" > vm.kmem_size_max="1536M" > vfs.zfs.prefetch_disable=1 > > Initially prefetch was enabled and I would experience hangs but after > disabling prefetch copying large amounts of data would go along > without problems. To see if FreeBSD 8 (current) had better (copy) > performance I upgraded to current as of yesterday. After upgrading and > rebooting the server responded fine. > > The server is a supermicro with a quad-core harpertown e5405 with two > internal sata-drives and 8 GB of ram. I installed an areca arc-1680 > sas-controller and configured it in jbod-mode. I attached an external > sas-cabinet with 16 sas-disks at 1 TB (931 binary GB). > Replying to my own mail! :-) I believe I have found at least a work-around to alleviate this issue. First of all I upgraded to zfs ver. 11 by using Pawels patch. The upgrade itself does not solve any issue. Then I upgraded the firmware as advised by Areca-support. The firmware-upgrade has minor changes related to disk-temperature-reading and will probably not change anything either. I changed the configuration on each disk on the areca arc-1680-controller to passthrough-mode and rebooted. After re-creating the zpool I have not had any errors while copying 718 GB of small files from my solaris-nfs-server. I'm performing a local copy atm. and have 'zpool offline'd one disk and 'zpool replace'd with the spare. While the replace is in progress write-performance naturally takes a hit but the resilver-progress is progressing steadily and will use approx. 2 hours and 45 minutes in total to complete. -- regards Claus When lenity and cruelty play for a kingdom, the gentlest gamester is the soonest winner. Shakespeare