From owner-freebsd-fs@FreeBSD.ORG Tue Jan 3 14:53:12 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E9B10106564A for ; Tue, 3 Jan 2012 14:53:11 +0000 (UTC) (envelope-from mattblists@icritical.com) Received: from mail1.icritical.com (mail1.icritical.com [93.95.13.41]) by mx1.freebsd.org (Postfix) with SMTP id 4B1478FC17 for ; Tue, 3 Jan 2012 14:53:10 +0000 (UTC) Received: (qmail 3111 invoked from network); 3 Jan 2012 14:53:08 -0000 Received: from localhost (127.0.0.1) by mail1.icritical.com with SMTP; 3 Jan 2012 14:53:08 -0000 Received: (qmail 3100 invoked by uid 599); 3 Jan 2012 14:53:08 -0000 Received: from unknown (HELO icritical.com) (212.57.254.146) by mail1.icritical.com (qpsmtpd/0.28) with ESMTP; Tue, 03 Jan 2012 14:53:08 +0000 Message-ID: <4F031654.1080200@icritical.com> Date: Tue, 03 Jan 2012 14:53:08 +0000 From: Matt Burke User-Agent: Mozilla/5.0 (X11; U; FreeBSD amd64; en-US; rv:1.9.2.15) Gecko/20110403 Thunderbird/3.1.9 MIME-Version: 1.0 To: freebsd-fs@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-OriginalArrivalTime: 03 Jan 2012 14:53:08.0040 (UTC) FILETIME=[67C4FC80:01CCCA27] X-Virus-Scanned: by iCritical at mail1.icritical.com Subject: ZFS v28 on -STABLE not using hot spare X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Jan 2012 14:53:12 -0000 Over the holidays one of the disks on a server has failed, but despite configuring a hot spare, ZFS hasn't used it for some reason. Can anyone shed some light on what I might have mis-configured to break the hot-spare functionality? [root@x ~]# uname -a FreeBSD x 8.2-STABLE FreeBSD 8.2-STABLE #4: Mon Dec 5 12:43:58 GMT 2011 root@x:/usr/obj/usr/src/sys/x amd64 [root@x ~]# more /usr/src/sys/amd64/conf/x include GENERIC ident x options GEOM_STRIPE options ROUTETABLES=4 [root@x ~]# zpool status -v pool: data state: DEGRADED status: One or more devices are faulted in response to persistent errors. Sufficient replicas exist for the pool to continue functioning in a degraded state. action: Replace the faulted device, or use 'zpool clear' to mark the device repaired. scan: none requested config: NAME STATE READ WRITE CKSUM data DEGRADED 0 0 0 mirror-0 ONLINE 0 0 0 mfid0 ONLINE 0 0 0 mfid14 ONLINE 0 0 0 mirror-1 ONLINE 0 0 0 mfid1 ONLINE 0 0 0 mfid15 ONLINE 0 0 0 mirror-2 DEGRADED 0 0 0 mfid2 ONLINE 0 0 0 mfid16 FAULTED 0 931 0 too many errors mirror-3 ONLINE 0 0 0 mfid3 ONLINE 0 0 0 mfid17 ONLINE 0 0 0 mirror-4 ONLINE 0 0 0 mfid4 ONLINE 0 0 0 mfid18 ONLINE 0 0 0 mirror-5 ONLINE 0 0 0 mfid5 ONLINE 0 0 0 mfid19 ONLINE 0 0 0 mirror-6 ONLINE 0 0 0 mfid6 ONLINE 0 0 0 mfid20 ONLINE 0 0 0 mirror-7 ONLINE 0 0 0 mfid7 ONLINE 0 0 0 mfid21 ONLINE 0 0 0 mirror-8 ONLINE 0 0 0 mfid8 ONLINE 0 0 0 mfid22 ONLINE 0 0 0 mirror-9 ONLINE 0 0 0 mfid9 ONLINE 0 0 0 mfid23 ONLINE 0 0 0 mirror-10 ONLINE 0 0 0 mfid10 ONLINE 0 0 0 mfid24 ONLINE 0 0 0 logs mirror-11 ONLINE 0 0 0 mfid13 ONLINE 0 0 0 mfid26 ONLINE 0 0 0 cache mfid12 ONLINE 0 0 0 mfid25 ONLINE 0 0 0 spares mfid11 AVAIL errors: No known data errors The logs show loads of mfi1 and mfid16 errors for a few minutes, and then (presumably when ZFS dropped the disk) nothing relevant after that. ZFS hasn't logged anything, not even that it's failed a disk. I've manually done a 'zpool replace data mfid16 mfid11' which has brought the spare in without problems, but I'm eager to learn what I did (or didn't do?) to cause the spare to not be used automatically. Thanks in advance, -- The information contained in this message is confidential and is intended for the addressee only. If you have received this message in error or there are any problems please notify the originator immediately. The unauthorised use, disclosure, copying or alteration of this message is strictly forbidden. Critical Software Ltd. reserves the right to monitor and record e-mail messages sent to and from this address for the purposes of investigating or detecting any unauthorised use of its system and ensuring its effective operation. Critical Software Ltd. registered in England, 04909220. Registered Office: IC2, Keele Science Park, Keele, Staffordshire, ST5 5NH. ------------------------------------------------------------ This message has been scanned for security threats by iCritical. For further information, please visit www.icritical.com ------------------------------------------------------------