From owner-freebsd-fs@FreeBSD.ORG Fri Nov 23 18:35:01 2007 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id AFED716A418 for ; Fri, 23 Nov 2007 18:35:01 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.freebsd.org (Postfix) with ESMTP id 9686A13C469 for ; Fri, 23 Nov 2007 18:34:59 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id BCE2945F5E; Fri, 23 Nov 2007 19:34:56 +0100 (CET) Received: from localhost (154.81.datacomsa.pl [195.34.81.154]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id AFD9045F63; Fri, 23 Nov 2007 19:34:48 +0100 (CET) Date: Fri, 23 Nov 2007 19:34:20 +0100 From: Pawel Jakub Dawidek To: Attila Nagy Message-ID: <20071123183420.GA12811@garage.freebsd.pl> References: <474546F5.2000007@fsn.hu> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="17pEHd4RhPHOinZp" Content-Disposition: inline In-Reply-To: <474546F5.2000007@fsn.hu> User-Agent: Mutt/1.4.2.3i X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-2.6 required=3.0 tests=BAYES_00 autolearn=ham version=3.0.4 Cc: freebsd-fs@FreeBSD.org Subject: Re: ZFS and FAULTED devices (corrupted data), can't make the pool ONLINE again X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Nov 2007 18:35:01 -0000 --17pEHd4RhPHOinZp Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Nov 22, 2007 at 10:08:05AM +0100, Attila Nagy wrote: > Hello, >=20 > FreeBSD RELENG_7, x86, a terrible disk array, called Promise RM-8000=20 > with 8 disks on an ahc. > The pool is a RAIDZ2. > Tomorrow the array went crazy (its firmware is a total crap), so I had=20 > to reboot both the machine and the disk array. >=20 > The effect: > pool: people > state: DEGRADED > status: One or more devices could not be used because the label is=20 > missing or > invalid. Sufficient replicas exist for the pool to continue > functioning in a degraded state. > action: Replace the device using 'zpool replace'. > see: http://www.sun.com/msg/ZFS-8000-4J > scrub: resilver completed with 0 errors on Thu Nov 22 10:45:27 2007 > config: >=20 > NAME STATE READ WRITE CKSUM > people DEGRADED 0 0 0 > raidz2 DEGRADED 0 0 0 > da8 ONLINE 0 0 0 > da3 FAULTED 0 0 0 corrupted data > da5 ONLINE 0 0 0 > da6 ONLINE 0 0 0 > da7 ONLINE 0 0 0 > da9 ONLINE 0 0 0 > da10 ONLINE 0 0 0 > da4 FAULTED 0 0 0 corrupted data >=20 > errors: No known data errors >=20 > I've tried everything I could think of: > zpool replace people da3 > invalid vdev specification > use '-f' to override the following errors: > da3 is in use (r1w1e1) >=20 > zpool replace -f people da3 > invalid vdev specification > the following errors must be manually repaired: > da3 is in use (r1w1e1) >=20 > zpool offline people da3 > cannot offline da3: no valid replicas >=20 > zpool online people da3 > Bringing device da3 online > (nothing has changed, the device is still FAULTED) >=20 > Hmm. Is this this bug?=20 > http://www.opensolaris.org/jive/thread.jspa?messageID=3D161812 You should use: # zpool replace people da3 da3 but to do it, you need this patch, which was not yet MFCed: http://www.freebsd.org/cgi/cvsweb.cgi/src/sys/contrib/opensolaris/uts/comm= on/fs/zfs/vdev.c.diff?r1=3D1.3;r2=3D1.4 --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --17pEHd4RhPHOinZp Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4 (FreeBSD) iD8DBQFHRx0sForvXbEpPzQRAp6rAKDJ5/UvzZprPJxoHvljqCXBA0nTFgCg7CKf PYNl9QjpHM6ig1wUrsNCbLg= =y6ss -----END PGP SIGNATURE----- --17pEHd4RhPHOinZp--