From owner-freebsd-stable@FreeBSD.ORG Mon Jul 19 16:32:39 2010 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E59CA106564A for ; Mon, 19 Jul 2010 16:32:39 +0000 (UTC) (envelope-from garrettmoore@gmail.com) Received: from mail-gw0-f54.google.com (mail-gw0-f54.google.com [74.125.83.54]) by mx1.freebsd.org (Postfix) with ESMTP id 8D4AE8FC0C for ; Mon, 19 Jul 2010 16:32:39 +0000 (UTC) Received: by gwb19 with SMTP id 19so2081993gwb.13 for ; Mon, 19 Jul 2010 09:32:38 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:received:in-reply-to :references:date:message-id:subject:from:to:cc:content-type; bh=81Gxybw6gMchH2i18yVtkt7qx1QwB+522zWlt15HcM0=; b=JhLeR9CcngFjKCiLmMCIqa7BCTXvqWRq4qaSy/oO3PFm4AX/rv6IoLxPWqsFNOuvdW cGE05lHVQWSeMbzZ5kZQtw7CXV6JgGAQASoxCBAV3CyCruX5PbajewMCvRX9j2fqj5N9 eRTjZ6yG/9Es58nV0sv+g5uG0sxk1bq4IuyAo= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; b=skJEGvbL2M2VbeJyXAd4lZZ8AxaIaDprIc+PKlTZyo2qWqTzjV1UIBrtbxVUsrnsaE 5Bd0tKlITZxEkH3DXAgZ9zNDyW1m21h0vX1HHIw8ksHet/e5vyxIL3EirwLOysJNELWO 0IiheWzjmO3g5De4r1BTI8rySGbwypYRz762g= MIME-Version: 1.0 Received: by 10.100.212.7 with SMTP id k7mr5060739ang.45.1279557158522; Mon, 19 Jul 2010 09:32:38 -0700 (PDT) Received: by 10.231.117.72 with HTTP; Mon, 19 Jul 2010 09:32:38 -0700 (PDT) In-Reply-To: References: Date: Mon, 19 Jul 2010 12:32:38 -0400 Message-ID: From: Garrett Moore To: Adam Vande More Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-stable Subject: Re: Problems replacing failing drive in ZFS pool X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Jul 2010 16:32:40 -0000 The data on the disks is not irreplaceable so if I lose the array it isn't the end of the world but I would prefer not to lose it as it would be a pain to get all of the data again. Freddie's explanation is reasonable, but any ideas why it didn't happen when I replaced my first dead drive (da5)? That replacement was completely painless. The system is in a Supermicro case with a hotswap backplane: http://www.supermicro.com/products/chassis/4U/743/SC743TQ-865.cfm The backplane ports are connected to a Supermicro AOC-USASLP-L8I LSI 1068E 8-PORT RAID 0/1/10 Uio SATA/SAS Controller. By the way, Freddie, in your instructions in the 'reboot' step I assume that is when I will be switching the physical drives, correct? On Mon, Jul 19, 2010 at 12:18 PM, Adam Vande More wrote: > On Mon, Jul 19, 2010 at 10:56 AM, Garrett Moore wrote: > >> So you think it's because when I switch from the old disk to the new disk, >> ZFS doesn't realize the disk has changed, and thinks the data is just >> corrupt now? Even if that happens, shouldn't the pool still be available, >> since it's RAIDZ1 and only one disk has gone away? >> >> I don't have / on ZFS; I'm only using it as a 'data' partition, so I >> should >> be able to try your suggestion. My only concern: is there any risk of >> trashing my pool if I try your instructions? Everything I've done so far, >> even when told "insufficient replicas / corrupt data", has not cost me any >> data as long as I switch back to the original (dying) drive. If I mix in >> export/import statements which might 'touch' the pool, is there a chance >> it >> will choke and trash my data? >> > > I'm not sure what's going on in your case, but I have cron'd a zpool scrub > for my pool on weekly basis to avoid this. I run a / zfs mirror and one day > I could no longer boot and saw the dread 'insufficient replicas'. I > eventually got it when disk started to work again briefly then did a > snapshot/send offsite, redid system with new install & disk then restored > data. The export/import shouldn't hurt, I used that when booting off an > MFSBSD cd and imported the zpool to send from there. Perhaps you might want > to consider RAIDZ2 with all those disks. > > -- > Adam Vande More >