From owner-freebsd-fs@FreeBSD.ORG Mon Jul 12 01:02:48 2010 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id CDBAD106566C for ; Mon, 12 Jul 2010 01:02:48 +0000 (UTC) (envelope-from stevenschlansker@gmail.com) Received: from mail-pw0-f54.google.com (mail-pw0-f54.google.com [209.85.160.54]) by mx1.freebsd.org (Postfix) with ESMTP id 9E0338FC15 for ; Mon, 12 Jul 2010 01:02:45 +0000 (UTC) Received: by pwj9 with SMTP id 9so1760499pwj.13 for ; Sun, 11 Jul 2010 18:02:45 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:subject:mime-version :content-type:from:in-reply-to:date:cc:content-transfer-encoding :message-id:references:to:x-mailer; bh=TNpqvWPLXCcNv/WXPgDxOhhdi4RrLyZzvPBaqvvMN/s=; b=PuNqMGtr0tFrBlIGNBh+Tc5Km+SFEZBGz0a20mEXezRZcOq5lDshb79t9mYYV60gSe DpHaj6RN8waR7Tj5fVWpNCzD5cHM0UGJwiFOaPI2jj9l96CcxHmozQyZqvLfjPIf7gPo XZ4sWIVagLlxjceHJOJ1pJ3mspOQ2KydaQcAA= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=subject:mime-version:content-type:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to:x-mailer; b=n73GMGnyspkNhfrGZrG6sYj9OGWP4qgpYcbvCKgB7YaPdsA4fmLcGUMVUPtdTeD7Js C1EBK3rGcVluHuuzNvpGdAycN3TqQjARV/eF4WgAVfS8X0LXE4B7YpKlEFW7Bcdb4bkx HSQXsrDFhpGxA3szPYlASvNjU3Pt20KQDemBA= Received: by 10.114.81.11 with SMTP id e11mr15178895wab.140.1278896565609; Sun, 11 Jul 2010 18:02:45 -0700 (PDT) Received: from 70-7-74-157.pools.spcsdns.net (70-7-74-157.pools.spcsdns.net [70.7.74.157]) by mx.google.com with ESMTPS id s5sm59131394wak.12.2010.07.11.18.02.42 (version=TLSv1/SSLv3 cipher=RC4-MD5); Sun, 11 Jul 2010 18:02:44 -0700 (PDT) Mime-Version: 1.0 (Apple Message framework v1078) Content-Type: text/plain; charset=us-ascii From: Steven Schlansker In-Reply-To: Date: Sun, 11 Jul 2010 18:02:44 -0700 Content-Transfer-Encoding: quoted-printable Message-Id: <40EB15F2-5479-4884-AFE4-3D26BAF2C4A7@gmail.com> References: To: S M X-Mailer: Apple Mail (2.1078) Cc: freebsd-fs@freebsd.org Subject: Re: ZFS - Unable to replace replacing drive X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 12 Jul 2010 01:02:48 -0000 It's a total pain that it doesn't work as you expect. Last time this happened to me, I fixed it by dd'ing a zfs label from one = of the failed drives (only needed to grab a few KB, which it managed to = do even though it was broken) onto a new drive and then letting it = finish the resilver process. If your dead drives are still alive enough to grab the metadata from, = that could solve your problem. On Jul 11, 2010, at 3:38 PM, S M wrote: >=20 > Hi all, >=20 > Can anyone help with a ZFS problem I've been having? I have a single = ZFS pool as shown below: >=20 > # zpool status > pool: vault > state: DEGRADED > scrub: resilver completed after 0h8m with 0 errors on Sun Jul 11 = 22:18:27 2010 > config: >=20 > NAME STATE READ WRITE CKSUM > vault DEGRADED 0 0 0 > mirror ONLINE 0 0 0 > da0.eli ONLINE 0 0 0 > da8.eli ONLINE 0 0 0 > ad4.eli ONLINE 0 0 0 > mirror DEGRADED 0 0 0 > da1.eli ONLINE 0 0 0 10.0M = resilvered > replacing UNAVAIL 0 7.42K 0 = insufficient replicas > 176228571956779269 UNAVAIL 0 7.79K 0 was = /dev/ad6.eli > 1650754158582652028 UNAVAIL 0 7.81K 0 was = /dev/da99.eli > da9.eli ONLINE 0 0 0 10.0M = resilvered >=20 > errors: No known data errors >=20 > However I can't seem to get rid of the replacing drives. What happened = was that I tried to replace /dev/ad6.eli with /dev/da99.eli (because = ad6.eli broke) and da99.eli was also faulty and so failed the replace. >=20 > How do I get rid of them? The array is otherwise healthy.... >=20 > # zpool offline vault 176228571956779269 > cannot offline 176228571956779269: no valid replicas > # zpool offline vault 1650754158582652028 > cannot offline 1650754158582652028: no valid replicas > # zpool detach vault 1650754158582652028 > cannot detach 1650754158582652028: no valid replicas > # zpool detach vault 176228571956779269 > cannot detach 176228571956779269: no valid replicas >=20 > replace doeesn't work either. >=20 > ZDB returns: >=20 > vault > version=3D14 > name=3D'vault' > state=3D0 > txg=3D173963 > pool_guid=3D14228437791114878229 > hostid=3D4269824854 > hostname=3D'vault.internal' > vdev_tree > type=3D'root' > id=3D0 > guid=3D14228437791114878229 > children[0] > type=3D'mirror' > id=3D0 > guid=3D15203813302661836458 > metaslab_array=3D23 > metaslab_shift=3D34 > ashift=3D12 > asize=3D2000394125312 > is_log=3D0 > children[0] > type=3D'disk' > id=3D0 > guid=3D7238937831460639650 > path=3D'/dev/da0.eli' > whole_disk=3D0 > DTL=3D51 > children[1] > type=3D'disk' > id=3D1 > guid=3D14125934351009663627 > path=3D'/dev/da8.eli' > whole_disk=3D0 > DTL=3D53 > children[2] > type=3D'disk' > id=3D2 > guid=3D8553277371515810839 > path=3D'/dev/ad4.eli' > whole_disk=3D0 > DTL=3D169 > children[1] > type=3D'mirror' > id=3D1 > guid=3D14672070090293526603 > metaslab_array=3D118 > metaslab_shift=3D34 > ashift=3D12 > asize=3D2000394125312 > is_log=3D0 > children[0] > type=3D'disk' > id=3D0 > guid=3D4020825290461516758 > path=3D'/dev/da1.eli' > whole_disk=3D0 > DTL=3D123 > children[1] > type=3D'replacing' > id=3D1 > guid=3D496235429895718168 > whole_disk=3D0 > children[0] > type=3D'disk' > id=3D0 > guid=3D176228571956779269 > path=3D'/dev/ad6.eli' > whole_disk=3D0 > not_present=3D1 > DTL=3D54 > children[1] > type=3D'disk' > id=3D1 > guid=3D1650754158582652028 > path=3D'/dev/da99.eli' > whole_disk=3D0 > not_present=3D1 > DTL=3D168 > children[2] > type=3D'disk' > id=3D2 > guid=3D5694121814811722857 > path=3D'/dev/da9.eli' > whole_disk=3D0 > DTL=3D120 >=20 >=20 > uname -a: FreeBSD vault.internal 8.1-PRERELEASE FreeBSD 8.1-PRERELEASE = #4: Thu Jul 1 09:47:23 UTC 2010 = sm@vault.internal:/usr/obj/usr/src/sys/vault amd64 >=20 > How do I fix this? ZFS says that the array is degraded but it isn't = really, I just can't get rid of this. > =20 > _________________________________________________________________ > http://clk.atdmt.com/UKM/go/197222280/direct/01/ > We want to hear all your funny, exciting and crazy Hotmail stories. = Tell us now_______________________________________________ > freebsd-fs@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org"