From owner-freebsd-bugs@FreeBSD.ORG Mon Aug 27 09:50:02 2007 Return-Path: Delivered-To: freebsd-bugs@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 325A616A420 for ; Mon, 27 Aug 2007 09:50:02 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id 1148613C46C for ; Mon, 27 Aug 2007 09:50:02 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (gnats@localhost [127.0.0.1]) by freefall.freebsd.org (8.14.1/8.14.1) with ESMTP id l7R9o19W014731 for ; Mon, 27 Aug 2007 09:50:01 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.1/8.14.1/Submit) id l7R9o1SD014730; Mon, 27 Aug 2007 09:50:01 GMT (envelope-from gnats) Resent-Date: Mon, 27 Aug 2007 09:50:01 GMT Resent-Message-Id: <200708270950.l7R9o1SD014730@freefall.freebsd.org> Resent-From: FreeBSD-gnats-submit@FreeBSD.org (GNATS Filer) Resent-To: freebsd-bugs@FreeBSD.org Resent-Reply-To: FreeBSD-gnats-submit@FreeBSD.org, Troy Ablan Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C2DE516A418 for ; Mon, 27 Aug 2007 09:41:44 +0000 (UTC) (envelope-from nobody@FreeBSD.org) Received: from www.freebsd.org (www.freebsd.org [IPv6:2001:4f8:fff6::21]) by mx1.freebsd.org (Postfix) with ESMTP id A6E0B13C428 for ; Mon, 27 Aug 2007 09:41:44 +0000 (UTC) (envelope-from nobody@FreeBSD.org) Received: from www.freebsd.org (localhost [127.0.0.1]) by www.freebsd.org (8.14.1/8.14.1) with ESMTP id l7R9fiBq050781 for ; Mon, 27 Aug 2007 09:41:44 GMT (envelope-from nobody@www.freebsd.org) Received: (from nobody@localhost) by www.freebsd.org (8.14.1/8.14.1/Submit) id l7R9fiwu050780; Mon, 27 Aug 2007 09:41:44 GMT (envelope-from nobody) Message-Id: <200708270941.l7R9fiwu050780@www.freebsd.org> Date: Mon, 27 Aug 2007 09:41:44 GMT From: Troy Ablan To: freebsd-gnats-submit@FreeBSD.org X-Send-Pr-Version: www-3.1 Cc: Subject: kern/115856: ZFS thought it was degraded when it should have been faulted X-BeenThere: freebsd-bugs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Bug reports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Aug 2007 09:50:02 -0000 >Number: 115856 >Category: kern >Synopsis: ZFS thought it was degraded when it should have been faulted >Confidential: no >Severity: serious >Priority: medium >Responsible: freebsd-bugs >State: open >Quarter: >Keywords: >Date-Required: >Class: sw-bug >Submitter-Id: current-users >Arrival-Date: Mon Aug 27 09:50:01 GMT 2007 >Closed-Date: >Last-Modified: >Originator: Troy Ablan >Release: 7.0-CURRENT-200708 >Organization: >Environment: >Description: For some reason, zfs thought a zpool was degraded when it should have been faulted. The kernel panicked at this point. The devs are geli-encrypted. I was bringing them online one-by-one. There was a double failure during a replace of one of the devices on the previous boot. [root@fbsd ~]# zpool status pool: whomp state: FAULTED status: One or more devices could not be opened. There are insufficient replicas for the pool to continue functioning. action: Attach the missing device and online it using 'zpool online'. see: http://www.sun.com/msg/ZFS-8000-D3 scrub: none requested config: NAME STATE READ WRITE CKSUM whomp FAULTED 6 0 0 corrupted data raidz2 DEGRADED 6 0 0 ad0s2.eli ONLINE 0 0 0 ad1s2 UNAVAIL 0 0 0 corrupted data ad2s2 UNAVAIL 0 0 0 corrupted data ad3s2 UNAVAIL 0 0 0 corrupted data ad12s2.eli UNAVAIL 0 0 0 cannot open replacing UNAVAIL 0 0 0 insufficient replicas ad13s2.eli/old UNAVAIL 0 0 0 cannot open ad13s2.eli UNAVAIL 0 0 0 cannot open ad14s2 UNAVAIL 0 0 0 corrupted data ad15s2 UNAVAIL 0 0 0 corrupted data [root@fbsd ~]# zpool status pool: whomp state: DEGRADED status: One or more devices could not be opened. Sufficient replicas exist for the pool to continue functioning in a degraded state. action: Attach the missing device and online it using 'zpool online'. see: http://www.sun.com/msg/ZFS-8000-D3 scrub: none requested config: NAME STATE READ WRITE CKSUM whomp DEGRADED 0 0 0 raidz2 DEGRADED 0 0 0 ad0s2.eli ONLINE 0 0 0 ad1s2.eli ONLINE 0 0 0 ad2s2.eli ONLINE 0 0 0 ad3s2.eli ONLINE 0 0 0 ad12s2.eli UNAVAIL 0 0 0 cannot open replacing UNAVAIL 0 0 0 insufficient replicas ad13s2.eli/old UNAVAIL 0 0 0 cannot open ad13s2.eli UNAVAIL 0 0 0 cannot open ad14s2.eli ONLINE 0 0 0 ad15s2 UNAVAIL 0 0 0 corrupted data errors: No known data errors >How-To-Repeat: create a raidz2 of 8 geli devices (or devices that wouldn't be available at boot) geli attach them one by one offline one of the devices, and zpool replace it (in place) hard-reboot before the replace finishes geli attach the devices one by one, doing a zpool status in between each one. zfs will think the pool is degraded while it's still missing three. >Fix: >Release-Note: >Audit-Trail: >Unformatted: