From owner-freebsd-questions@FreeBSD.ORG Fri Apr 24 20:52:35 2009 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 249A11065670 for ; Fri, 24 Apr 2009 20:52:35 +0000 (UTC) (envelope-from psteele@maxiscale.com) Received: from exprod7og108.obsmtp.com (exprod7og108.obsmtp.com [64.18.2.169]) by mx1.freebsd.org (Postfix) with SMTP id C74128FC17 for ; Fri, 24 Apr 2009 20:52:34 +0000 (UTC) (envelope-from psteele@maxiscale.com) Received: from source ([209.85.198.230]) by exprod7ob108.postini.com ([64.18.6.12]) with SMTP ID DSNKSfImktxPOEdpwZ0EtYeoltBNveebS6RL@postini.com; Fri, 24 Apr 2009 13:52:34 PDT Received: by rv-out-0506.google.com with SMTP id k40so1256495rvb.25 for ; Fri, 24 Apr 2009 13:52:34 -0700 (PDT) Received: by 10.143.159.11 with SMTP id l11mr850329wfo.187.1240606354078; Fri, 24 Apr 2009 13:52:34 -0700 (PDT) Received: from localhost ([76.231.178.131]) by mx.google.com with ESMTPS id 29sm4107348wfg.35.2009.04.24.13.52.32 (version=SSLv3 cipher=RC4-MD5); Fri, 24 Apr 2009 13:52:33 -0700 (PDT) Date: Fri, 24 Apr 2009 13:52:29 -0700 (PDT) From: Peter Steele To: Ivan Voras Message-ID: <29655217.2961240606345404.JavaMail.HALO$@halo> In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-questions@freebsd.org Subject: Re: Unexpected gmirror behavior: Is this a bug? X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 24 Apr 2009 20:52:35 -0000 > This definitely looks like a bug. Try asking again on the freebsd-geom@ > list. Provide output of "gmirror list". I'll try that list... >So, your steps were: >1. ad4, ad6, ad8 and ad10 in a 4-way mirror >2. ad4 fails. At this point did you do a "gmirror list"? I.e. did >gmirror detect it failing? If I read it correctly, the GenID field >should have been increased in this case. >3. The system continues to be used >4. You power it down, take out and reinsert ad4 >5. On boot, ad4 is detected, inserted in the mirror but as a "known >good" copy, not a stale one. > >Correct? Yes, that's basically the sequence that occurred. I can easily recreate the condition though. I shut my box down, took out ad4 and then rebooted. The system complained about ad4 being missing and proceeded with a mirror using 3/4 of the drives. I then created a file on the system, shutdown again, and then reinserted ad4. On reboot as the system was starting up the gmirror driver, it detected ad4 but instead of reinserting in in the most recent mirror made up of the other drives, it became the active drive and kicked out its old partners, When the old drives were reinserted manually into that mirror they were of course synced with the data from ad4, destroying their more recent data. This does not happen if I do the same thing with a drive other than ad4. >What version of FreeBSD are you using? 7.0-p10 or so.