Date: Tue, 28 Feb 2012 16:24:47 +0000 From: Matthew Seaman <m.seaman@infracaninophile.co.uk> To: freebsd-questions@freebsd.org Subject: Re: zpool not grabbing hot spare Message-ID: <4F4CFFCF.4010207@infracaninophile.co.uk> In-Reply-To: <alpine.BSF.2.00.1202281021000.90975@tdream.lly.earlham.edu> References: <alpine.BSF.2.00.1202281021000.90975@tdream.lly.earlham.edu>
next in thread | previous in thread | raw e-mail | index | archive | help
This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig9636C0BEA83528452C3E439A Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable On 28/02/2012 15:21, Randy Schultz wrote: > Got a zpool that lost a drive: > Feb 24 20:46:01 booto kernel: (da30:mpt3:0:6:0): lost device > Feb 24 20:46:41 booto kernel: (da30:mpt3:0:6:0): Synchronize cache > failed, status =3D=3D 0xa, scsi status =3D=3D > 0x0 > Feb 24 20:46:41 booto kernel: (da30:mpt3:0:6:0): removing device ent= ry >=20 > however the spare never came online: > zpool status -v > pool: data > state: DEGRADED > status: One or more devices has been removed by the administrator. > Sufficient replicas exist for the pool to continue > functioning in a > degraded state. > action: Online the device using 'zpool online' or replace the device= > with > 'zpool replace'. > scan: resilvered 0 in 0h2m with 0 errors on Tue Oct 25 13:40:59 201= 1 > config: >=20 > NAME STATE READ WRITE CKSUM > data DEGRADED 0 0 0 > raidz2-0 DEGRADED 0 0 0 > da2 ONLINE 0 0 0 > da3 ONLINE 0 0 0 > da4 ONLINE 0 0 0 > da5 ONLINE 0 0 0 > da6 ONLINE 0 0 0 > da7 ONLINE 0 0 0 > da9 ONLINE 0 0 0 > da10 ONLINE 0 0 0 > da11 ONLINE 0 0 0 > da12 ONLINE 0 0 0 > da13 ONLINE 0 0 0 > da14 ONLINE 0 0 0 > da15 ONLINE 0 0 0 > da17 ONLINE 0 0 0 > da18 ONLINE 0 0 0 > da19 ONLINE 0 0 0 > da20 ONLINE 0 0 0 > da21 ONLINE 0 0 0 > da22 ONLINE 0 0 0 > da23 ONLINE 0 0 0 > da25 ONLINE 0 0 0 > da26 ONLINE 0 0 0 > da27 ONLINE 0 0 0 > da28 ONLINE 0 0 0 > da29 ONLINE 0 0 0 > da30 REMOVED 0 0 0 > da31 ONLINE 0 0 0 > da32 ONLINE 0 0 0 > da33 ONLINE 0 0 0 > da34 ONLINE 0 0 0 > da35 ONLINE 0 0 0 > da36 ONLINE 0 0 0 > da37 ONLINE 0 0 0 > da38 ONLINE 0 0 0 > da39 ONLINE 0 0 0 > da40 ONLINE 0 0 0 > da41 ONLINE 0 0 0 > da42 ONLINE 0 0 0 > da43 ONLINE 0 0 0 > da44 ONLINE 0 0 0 > da45 ONLINE 0 0 0 > da46 ONLINE 0 0 0 > da47 ONLINE 0 0 0 > logs > mirror-1 ONLINE 0 0 0 > da24 ONLINE 0 0 0 > da16 ONLINE 0 0 0 > spares > da1 AVAIL >=20 > I thought the spare was supposed to come online and be resilvered > automatically. Did I miss some config thing > or did I just misunderstand how the hot spare bit works? Yes. That's the generally accepted meaning of the concept of a 'hot spare.' The fact that the spare hasn't been automatically bought on-line in this case is a bug. There's an open PR on the subject: http://www.freebsd.org/cgi/query-pr.cgi?pr=3Dkern/134491 That seems to suggest the problem was known to be solved at some point in 2011, but it was not necessarily propagated to all stable branches. However, given your experience perhaps that is not the case. You should be able to use zfs commands manually to sub-in the spare drive and get it resilvered. As an aside -- you've got a pretty odd setup there: 41 drives all in one big RAIDZ2 vdev? Standard practice would be to create something like 5 RAIDZ2 vdevs of 8 drives each (Or maybe 6 vdevs of 7 drives apiece: 6--9 drives is about the sweet spot for a RAIDZ2) and then stripe those vdevs together to create your zpool. Cheers, Matthew --=20 Dr Matthew J Seaman MA, D.Phil. 7 Priory Courtyard Flat 3 PGP: http://www.infracaninophile.co.uk/pgpkey Ramsgate JID: matthew@infracaninophile.co.uk Kent, CT11 9PW --------------enig9636C0BEA83528452C3E439A Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG/MacGPG2 v2.0.16 (Darwin) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk9M/9cACgkQ8Mjk52CukIy29gCggNSAKQKVQHhivn5+wrFhnVHw tekAmgOKrqqXUstaHU5HrIJF95l0L7OD =VJVh -----END PGP SIGNATURE----- --------------enig9636C0BEA83528452C3E439A--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?4F4CFFCF.4010207>