From owner-freebsd-current@FreeBSD.ORG Mon May 25 16:36:06 2009 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 3CC6A106564A for ; Mon, 25 May 2009 16:36:06 +0000 (UTC) (envelope-from serenity@exscape.org) Received: from ch-smtp01.sth.basefarm.net (ch-smtp01.sth.basefarm.net [80.76.149.212]) by mx1.freebsd.org (Postfix) with ESMTP id BEAB68FC1F for ; Mon, 25 May 2009 16:36:03 +0000 (UTC) (envelope-from serenity@exscape.org) Received: from c83-253-252-234.bredband.comhem.se ([83.253.252.234]:46751 helo=mx.exscape.org) by ch-smtp01.sth.basefarm.net with esmtp (Exim 4.69) (envelope-from ) id 1M8d9c-0000gH-41; Mon, 25 May 2009 18:36:02 +0200 Received: from [192.168.1.5] (macbookpro [192.168.1.5]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by mx.exscape.org (Postfix) with ESMTPSA id 2A00EEECD4; Mon, 25 May 2009 18:35:59 +0200 (CEST) Message-Id: <45674300-D57D-4CD4-BF69-90744F9C90A0@exscape.org> From: Thomas Backman To: Freddie Cash In-Reply-To: Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v935.3) Date: Mon, 25 May 2009 18:35:59 +0200 References: <4E6E325D-BB18-4478-BCFD-633D6F4CFD88@exscape.org> X-Mailer: Apple Mail (2.935.3) X-Originating-IP: 83.253.252.234 X-Scan-Result: No virus found in message 1M8d9c-0000gH-41. X-Scan-Signature: ch-smtp01.sth.basefarm.net 1M8d9c-0000gH-41 5dd4e294809b3c4cf59cba528b89cff7 Cc: freebsd-current@freebsd.org Subject: Re: ZFS panic under extreme circumstances (2/3 disks corrupted) X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 25 May 2009 16:36:06 -0000 On May 25, 2009, at 06:19 PM, Freddie Cash wrote: > On Mon, May 25, 2009 at 9:12 AM, Thomas Backman > wrote: >> On May 25, 2009, at 05:39 PM, Freddie Cash wrote: >> Was this on FreeBSD? > > 64-bit FreeBSD 7.1 using ZFS v6. SATA drives connected to 3Ware RAID > controllers, but configured as "Single Drive" arrays not using > hardware RAID in any way. > >> I have another unfortunate thing to note regarding this: after a >> reboot, >> it's even impossible to tell *which disk* has gone bad, even if the >> pool is >> "uncleared" but otherwise "healed". It simply says that a device >> has failed, >> with no clue as to which one, since they're all "ONLINE"! > > Even when using -v? zpool status -v Yup, unfortunately. [root@clone ~]# zpool status -v test pool: test state: ONLINE status: One or more devices has experienced an error resulting in data corruption. Applications may be affected. action: Restore the file in question if possible. Otherwise restore the entire pool from backup. see: http://www.sun.com/msg/ZFS-8000-8A scrub: scrub completed after 0h0m with 372 errors on Mon May 25 12:57:46 2009 config: NAME STATE READ WRITE CKSUM test ONLINE 0 0 373 raidz1 ONLINE 0 0 747 da1 ONLINE 0 0 0 9K repaired da2 ONLINE 0 0 171 119K repaired da3 ONLINE 0 0 0 9K repaired raidz1 ONLINE 0 0 2 ad0 ONLINE 0 0 0 ad1 ONLINE 0 0 315 ad3 ONLINE 0 0 318 errors: Permanent errors have been detected in the following files: /test/testfile [root@clone ~]# reboot [root@clone ~]# zpool status -xv pool: test state: ONLINE status: One or more devices has experienced an error resulting in data corruption. Applications may be affected. action: Restore the file in question if possible. Otherwise restore the entire pool from backup. see: http://www.sun.com/msg/ZFS-8000-8A scrub: none requested config: NAME STATE READ WRITE CKSUM test ONLINE 0 0 0 raidz1 ONLINE 0 0 0 da1 ONLINE 0 0 0 da2 ONLINE 0 0 0 da3 ONLINE 0 0 0 raidz1 ONLINE 0 0 0 ad0 ONLINE 0 0 0 ad1 ONLINE 0 0 0 ad3 ONLINE 0 0 0 errors: Permanent errors have been detected in the following files: /test/testfile