From owner-freebsd-stable@FreeBSD.ORG Fri Jul 25 07:46:37 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id AA5501065674 for ; Fri, 25 Jul 2008 07:46:36 +0000 (UTC) (envelope-from kometen@gmail.com) Received: from fg-out-1718.google.com (fg-out-1718.google.com [72.14.220.155]) by mx1.freebsd.org (Postfix) with ESMTP id 2BF028FC1D for ; Fri, 25 Jul 2008 07:46:35 +0000 (UTC) (envelope-from kometen@gmail.com) Received: by fg-out-1718.google.com with SMTP id l26so2388089fgb.35 for ; Fri, 25 Jul 2008 00:46:34 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:mime-version:content-type:content-transfer-encoding :content-disposition; bh=/S2A1ihMJ2F6KH3NBQGlDaDx0FC6A2NRYnClAgg8ySI=; b=GHSfAH5mfRAOdAV4vHgnlmJHWCxe36fubshyBriPGIKRjCTUnhRrW0u6gOOczfjoGz ebIiOKdIR0FaZ69bIrQO55WH8igjYADBISKqYIPPBBC5ZcMM1kOHJRvRFNB52NGRBRP2 Sl0BRuvLxrwwzo7DqGCgXdwyHQ1f9csYccJzU= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:mime-version:content-type :content-transfer-encoding:content-disposition; b=Q+MZmRRRJjFKqjqKfunJl2SbMNszLeaZp0Ox6PMrqM4Prs0afSPTGXey8x99+4f8cO FqeADPicgqavDbzV4K9mel5/iBseOngNFO1HK1m/fk1Y2PVv0osC1gSN3nYurNgRyGrU P+x1vVMNpQD1GUyNo8EQ6TUFOwL7zKq57fPOE= Received: by 10.86.4.14 with SMTP id 14mr1715781fgd.20.1216971994147; Fri, 25 Jul 2008 00:46:34 -0700 (PDT) Received: by 10.86.79.5 with HTTP; Fri, 25 Jul 2008 00:46:34 -0700 (PDT) Message-ID: Date: Fri, 25 Jul 2008 09:46:34 +0200 From: "Claus Guttesen" To: "FreeBSD Stable" MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline Subject: zfs, raidz, spare and jbod X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 25 Jul 2008 07:46:37 -0000 Hi. I installed FreeBSD 7 a few days ago and upgraded to the latest stable release using GENERIC kernel. I also added these entries to /boot/loader.conf: vm.kmem_size="1536M" vm.kmem_size_max="1536M" vfs.zfs.prefetch_disable=1 Initially prefetch was enabled and I would experience hangs but after disabling prefetch copying large amounts of data would go along without problems. To see if FreeBSD 8 (current) had better (copy) performance I upgraded to current as of yesterday. After upgrading and rebooting the server responded fine. The server is a supermicro with a quad-core harpertown e5405 with two internal sata-drives and 8 GB of ram. I installed an areca arc-1680 sas-controller and configured it in jbod-mode. I attached an external sas-cabinet with 16 sas-disks at 1 TB (931 binary GB). I created a raidz2 pool with 10 disks and added one spare. I copied approx. 1 TB of small files (each approx. 1 MB) and during the copy I simulated a disk-crash by pulling one of the disks out of the cabinet. Zfs did not activate the spare and the copying stopped until I rebooted after 5-10 minutes. When I performed a 'zpool status' the command would not complete. I did not see any messages in /var/log/message. State in top showed 'ufs-'. A similar test on solaris express developer edition b79 activated the spare after zfs tried to write to the missing disk enough times and then marked it as faulted. Has any one else tried to simulate a disk-crash in raidz(2) and succeeded? -- regards Claus When lenity and cruelty play for a kingdom, the gentlest gamester is the soonest winner. Shakespeare