From owner-freebsd-stable@FreeBSD.ORG Fri Jul 25 09:24:49 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id ED9B91065675 for ; Fri, 25 Jul 2008 09:24:49 +0000 (UTC) (envelope-from kometen@gmail.com) Received: from fg-out-1718.google.com (fg-out-1718.google.com [72.14.220.154]) by mx1.freebsd.org (Postfix) with ESMTP id 6CB4E8FC0A for ; Fri, 25 Jul 2008 09:24:49 +0000 (UTC) (envelope-from kometen@gmail.com) Received: by fg-out-1718.google.com with SMTP id l26so2422073fgb.35 for ; Fri, 25 Jul 2008 02:24:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:cc:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references; bh=qtGC4cbMMy/sSeT6hmm0Ihz8fSPxZLbt+1zQmQYb+14=; b=Nc4KUBNiAxvQ66BKhAQ1GCJw3i78uRJnpBWRFfGoME6Tbijlhqib0qP7P+XvMR8A5P 3ozg0ZLz1kzO4Dgm4MzVJQAesz6pMg3ncpXFzyGBtrGLBE+zyh5G0o5yfyXBODMAuiuY rljdCJVX/l5jzTBqk9kmnXCc00SrMs546dVyQ= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references; b=eZyF8uZAI6Mhj7reCqFXUO+Vqtl72TDrpUwzN+ppQ+vY3L6m39KiT9F92nJrfK7YgE +bbuPv6Lrw9HchuC9sp1bPe1l+uetRwy3+brb+t8wsGhagE8Eq3hpFUd60aa9abwVZmJ BrsR50/BWRE45xhfurujdWQ0oLAMvPG0xIkBw= Received: by 10.86.51.10 with SMTP id y10mr1800221fgy.6.1216977888030; Fri, 25 Jul 2008 02:24:48 -0700 (PDT) Received: by 10.86.79.5 with HTTP; Fri, 25 Jul 2008 02:24:47 -0700 (PDT) Message-ID: Date: Fri, 25 Jul 2008 11:24:47 +0200 From: "Claus Guttesen" To: "Kris Kennaway" In-Reply-To: <48899A71.4040508@FreeBSD.org> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <48899A71.4040508@FreeBSD.org> Cc: FreeBSD Stable Subject: Re: zfs, raidz, spare and jbod X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 25 Jul 2008 09:24:50 -0000 >> >> I installed FreeBSD 7 a few days ago and upgraded to the latest stable >> release using GENERIC kernel. I also added these entries to >> /boot/loader.conf: >> >> vm.kmem_size="1536M" >> vm.kmem_size_max="1536M" >> vfs.zfs.prefetch_disable=1 >> >> Initially prefetch was enabled and I would experience hangs but after >> disabling prefetch copying large amounts of data would go along >> without problems. To see if FreeBSD 8 (current) had better (copy) >> performance I upgraded to current as of yesterday. After upgrading and >> rebooting the server responded fine. >> >> The server is a supermicro with a quad-core harpertown e5405 with two >> internal sata-drives and 8 GB of ram. I installed an areca arc-1680 >> sas-controller and configured it in jbod-mode. I attached an external >> sas-cabinet with 16 sas-disks at 1 TB (931 binary GB). >> >> I created a raidz2 pool with 10 disks and added one spare. I copied >> approx. 1 TB of small files (each approx. 1 MB) and during the copy I >> simulated a disk-crash by pulling one of the disks out of the cabinet. >> Zfs did not activate the spare and the copying stopped until I >> rebooted after 5-10 minutes. When I performed a 'zpool status' the >> command would not complete. I did not see any messages in >> /var/log/message. State in top showed 'ufs-'. > > That means that it was UFS that hung, not ZFS. What was the process > backtrace, and what role does UFS play on this system? Arghh.. Typo, I meant 'zfs-'. Pardon. My boot-disk is plain ufs2 but the disk I pulled out was in the raidz2-pool. -- regards Claus When lenity and cruelty play for a kingdom, the gentlest gamester is the soonest winner. Shakespeare