Skip site navigation (1)Skip section navigation (2)
Date:      Sun, 11 Jul 2010 18:02:44 -0700
From:      Steven Schlansker <stevenschlansker@gmail.com>
To:        S M <zw_uk@hotmail.com>
Cc:        freebsd-fs@freebsd.org
Subject:   Re: ZFS - Unable to replace replacing drive
Message-ID:  <40EB15F2-5479-4884-AFE4-3D26BAF2C4A7@gmail.com>
In-Reply-To: <BAY150-w475AD5722011332919C15783B70@phx.gbl>
References:  <BAY150-w475AD5722011332919C15783B70@phx.gbl>

next in thread | previous in thread | raw e-mail | index | archive | help
It's a total pain that it doesn't work as you expect.
Last time this happened to me, I fixed it by dd'ing a zfs label from one =
of the failed drives (only needed to grab a few KB, which it managed to =
do even though it was broken) onto a new drive and then letting it =
finish the resilver process.
If your dead drives are still alive enough to grab the metadata from, =
that could solve your problem.

On Jul 11, 2010, at 3:38 PM, S M wrote:

>=20
> Hi all,
>=20
> Can anyone help with a ZFS problem I've been having? I have a single =
ZFS pool as shown below:
>=20
> # zpool status
>  pool: vault
> state: DEGRADED
> scrub: resilver completed after 0h8m with 0 errors on Sun Jul 11 =
22:18:27 2010
> config:
>=20
>        NAME                       STATE     READ WRITE CKSUM
>        vault                      DEGRADED     0     0     0
>          mirror                   ONLINE       0     0     0
>            da0.eli                ONLINE       0     0     0
>            da8.eli                ONLINE       0     0     0
>            ad4.eli                ONLINE       0     0     0
>          mirror                   DEGRADED     0     0     0
>            da1.eli                ONLINE       0     0     0  10.0M =
resilvered
>            replacing              UNAVAIL      0 7.42K     0  =
insufficient replicas
>              176228571956779269   UNAVAIL      0 7.79K     0  was =
/dev/ad6.eli
>              1650754158582652028  UNAVAIL      0 7.81K     0  was =
/dev/da99.eli
>            da9.eli                ONLINE       0     0     0  10.0M =
resilvered
>=20
> errors: No known data errors
>=20
> However I can't seem to get rid of the replacing drives. What happened =
was that I tried to replace /dev/ad6.eli with /dev/da99.eli (because =
ad6.eli broke) and da99.eli was also faulty and so failed the replace.
>=20
> How do I get rid of them? The array is otherwise healthy....
>=20
> # zpool offline vault 176228571956779269
> cannot offline 176228571956779269: no valid replicas
> # zpool offline vault 1650754158582652028
> cannot offline 1650754158582652028: no valid replicas
> # zpool detach vault 1650754158582652028
> cannot detach 1650754158582652028: no valid replicas
> # zpool detach vault 176228571956779269
> cannot detach 176228571956779269: no valid replicas
>=20
> replace doeesn't work either.
>=20
> ZDB returns:
>=20
> vault
>    version=3D14
>    name=3D'vault'
>    state=3D0
>    txg=3D173963
>    pool_guid=3D14228437791114878229
>    hostid=3D4269824854
>    hostname=3D'vault.internal'
>    vdev_tree
>        type=3D'root'
>        id=3D0
>        guid=3D14228437791114878229
>        children[0]
>                type=3D'mirror'
>                id=3D0
>                guid=3D15203813302661836458
>                metaslab_array=3D23
>                metaslab_shift=3D34
>                ashift=3D12
>                asize=3D2000394125312
>                is_log=3D0
>                children[0]
>                        type=3D'disk'
>                        id=3D0
>                        guid=3D7238937831460639650
>                        path=3D'/dev/da0.eli'
>                        whole_disk=3D0
>                        DTL=3D51
>                children[1]
>                        type=3D'disk'
>                        id=3D1
>                        guid=3D14125934351009663627
>                        path=3D'/dev/da8.eli'
>                        whole_disk=3D0
>                        DTL=3D53
>                children[2]
>                        type=3D'disk'
>                        id=3D2
>                        guid=3D8553277371515810839
>                        path=3D'/dev/ad4.eli'
>                        whole_disk=3D0
>                        DTL=3D169
>        children[1]
>                type=3D'mirror'
>                id=3D1
>                guid=3D14672070090293526603
>                metaslab_array=3D118
>                metaslab_shift=3D34
>                ashift=3D12
>                asize=3D2000394125312
>                is_log=3D0
>                children[0]
>                        type=3D'disk'
>                        id=3D0
>                        guid=3D4020825290461516758
>                        path=3D'/dev/da1.eli'
>                        whole_disk=3D0
>                        DTL=3D123
>                children[1]
>                        type=3D'replacing'
>                        id=3D1
>                        guid=3D496235429895718168
>                        whole_disk=3D0
>                        children[0]
>                                type=3D'disk'
>                                id=3D0
>                                guid=3D176228571956779269
>                                path=3D'/dev/ad6.eli'
>                                whole_disk=3D0
>                                not_present=3D1
>                                DTL=3D54
>                        children[1]
>                                type=3D'disk'
>                                id=3D1
>                                guid=3D1650754158582652028
>                                path=3D'/dev/da99.eli'
>                                whole_disk=3D0
>                                not_present=3D1
>                                DTL=3D168
>                children[2]
>                        type=3D'disk'
>                        id=3D2
>                        guid=3D5694121814811722857
>                        path=3D'/dev/da9.eli'
>                        whole_disk=3D0
>                        DTL=3D120
>=20
>=20
> uname -a: FreeBSD vault.internal 8.1-PRERELEASE FreeBSD 8.1-PRERELEASE =
#4: Thu Jul  1 09:47:23 UTC 2010     =
sm@vault.internal:/usr/obj/usr/src/sys/vault  amd64
>=20
> How do I fix this? ZFS says that the array is degraded but it isn't =
really, I just can't get rid of this.
> 		 	   		 =20
> _________________________________________________________________
> http://clk.atdmt.com/UKM/go/197222280/direct/01/
> We want to hear all your funny, exciting and crazy Hotmail stories. =
Tell us now_______________________________________________
> freebsd-fs@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-fs
> To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org"




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?40EB15F2-5479-4884-AFE4-3D26BAF2C4A7>