From owner-freebsd-fs@FreeBSD.ORG Fri May 28 18:51:23 2010 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9C68C106574C for ; Fri, 28 May 2010 18:51:23 +0000 (UTC) (envelope-from morganw@chemikals.org) Received: from warped.bluecherry.net (unknown [IPv6:2001:440:eeee:fffb::2]) by mx1.freebsd.org (Postfix) with ESMTP id 33D348FC08 for ; Fri, 28 May 2010 18:51:23 +0000 (UTC) Received: from volatile.chemikals.org (adsl-67-123-29.shv.bellsouth.net [98.67.123.29]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by warped.bluecherry.net (Postfix) with ESMTPSA id 15F89879023E; Fri, 28 May 2010 13:51:21 -0500 (CDT) Received: from localhost (morganw@localhost [127.0.0.1]) by volatile.chemikals.org (8.14.4/8.14.4) with ESMTP id o4SIpITu029351; Fri, 28 May 2010 13:51:18 -0500 (CDT) (envelope-from morganw@chemikals.org) Date: Fri, 28 May 2010 13:51:17 -0500 (CDT) From: Wes Morgan X-X-Sender: morganw@volatile To: "James R. Van Artsdalen" In-Reply-To: <4BFFF08F.3060103@jrv.org> Message-ID: References: <4BFFC6E6.2070505@jrv.org> <20100528134926.GB75411@icarus.home.lan> <4BFFF08F.3060103@jrv.org> User-Agent: Alpine 2.00 (BSF 1167 2008-08-23) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII X-Virus-Scanned: clamav-milter 0.95.3 at warped X-Virus-Status: Clean Cc: freebsd-fs Subject: Re: ZFS: how to replace a dead disk? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 28 May 2010 18:51:23 -0000 On Fri, 28 May 2010, James R. Van Artsdalen wrote: > Jeremy Chadwick wrote: > > On Fri, May 28, 2010 at 08:36:38AM -0500, James R. Van Artsdalen wrote: > >> What's the right way to replace a dead disk under ZFS? > >> > >> replacing DEGRADED 0 0 0 > >> ada1/old UNAVAIL 0 256K 0 cannot open > >> ada1 ONLINE 0 0 0 1.47T resilvered > >> --- > >> > >> It says "replacing" and that the device, vdev and pool are degraded, yet > >> the "resilver" finished hours ago. I cannot detach the ada1/old entry. > >> > >> Is there some other command I should have used to remove the dead ada1 > >> device? > > > > What version of FreeBSD? Please provide uname -a output and not "8.0" > > or something equally as terse. > > > > Some clarification: you didn't remove the device, you simply told ZFS to > > assuming that the device had been replaced. > > > > What did you do (both physically and software/command-line-wise) *prior* > > to issuing "zpool replace jwrc ada1"? > > > Sorry: my original note contained version information but that isn't in > your reply? > > FreeBSD cyclone 9.0-CURRENT FreeBSD 9.0-CURRENT #2 r206111: Fri Apr 2 > 13:47:20 CDT 2010 > root@cyclone.housenet.jrv:/usr/obj/usr/src/sys/GENERIC amd64 > > The original disk is no longer usable by FreeBSD in any way: it returned > a stream of errors & noise on its port in a way that left the system > unable to boot. I physically replaced that disk with a new disk before > attempting the "zpool replace" > > No actions were taken prior to replacing the disk. I went to the site > to see why the server was unresponsive, saw that one drive was > problematic by watching the activity LEDs, physically replaced that > disk, booted, and logically replaced that disk with "zpool replace jwrc > ada1" Is it possible your array had some errors on other devices prior to the ada1 disk failing? When was the last scrub?