From owner-freebsd-hackers@FreeBSD.ORG Wed Dec 14 15:34:43 2011 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 26936106564A for ; Wed, 14 Dec 2011 15:34:43 +0000 (UTC) (envelope-from borjam@sarenet.es) Received: from proxypop03.sare.net (proxypop03.sare.net [194.30.0.207]) by mx1.freebsd.org (Postfix) with ESMTP id DB4E98FC0A for ; Wed, 14 Dec 2011 15:34:42 +0000 (UTC) Received: from [172.16.2.2] (izaro.sarenet.es [192.148.167.11]) by proxypop03.sare.net (Postfix) with ESMTPSA id 051349DC67C; Wed, 14 Dec 2011 16:16:19 +0100 (CET) Mime-Version: 1.0 (Apple Message framework v1084) Content-Type: text/plain; charset=us-ascii From: Borja Marcos In-Reply-To: <4EE8A005.5030607@barafranca.com> Date: Wed, 14 Dec 2011 16:16:19 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: <9317551F-CBE0-4368-B798-498E58E240B2@sarenet.es> References: <4EE8A005.5030607@barafranca.com> To: Hugo Silva X-Mailer: Apple Mail (2.1084) Cc: freebsd-hackers@freebsd.org Subject: Re: mfi (Dell H700) + hot swapping doesn't appear to work with RC1 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 14 Dec 2011 15:34:43 -0000 On Dec 14, 2011, at 2:09 PM, Hugo Silva wrote: > Hello, >=20 > First of all apologies if this has been fixed in RC3. I set this = server > up with mfsbsd, which is RC1, and didn't get to update the system yet. >=20 > This box has 6 hdds, a 2-mirror zpool was set up as the root pool, = with > 2 spares. >=20 > While testing hot swapping I noticed that while the controller detects > disk removal/insertion, the zpool will never recover. The problem = seems > to be deeper than ZFS, as disklabel/fdisk/etc also fail on the > removed-and-reinserted disk. >=20 > At the ZFS level, doing a zpool clear yields more errors on the = removed > disk; rebooting becomes the only option to make the pool healthy = again. >=20 >=20 > Is this normal? Did I miss any step? I assume that you have tried to use the H700 as a "JBOD" card, defining = logical volume for each hard disk. The problem is: that gorgeous, fantastic, masterful, Nobel award = candidate card, has a wonderful behavior in that case. If you extract = one of the disks, the logical volume associated to it is invalidated. = So, you insert a replacement disk, and the card refuses to recognize the = volume. What is even worse, in order to recover it's mandatory to reboot = the complete system *AND* go through the RAID configuration utility. That's the problem. The card refuses to work as a simple disk = controller without frills, and the frills get in the way. To summarize: it isn't FreeBSD's fault, no matter which version you use. = It's a "feature" coming directly from the geniuses who designed the = card. Borja.