From owner-freebsd-questions@FreeBSD.ORG  Fri Apr 24 20:59:01 2009
Return-Path: <owner-freebsd-questions@FreeBSD.ORG>
Delivered-To: freebsd-questions@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id 6D8C31065688
	for <freebsd-questions@freebsd.org>;
	Fri, 24 Apr 2009 20:59:01 +0000 (UTC)
	(envelope-from psteele@maxiscale.com)
Received: from exprod7og106.obsmtp.com (exprod7og106.obsmtp.com [64.18.2.165])
	by mx1.freebsd.org (Postfix) with SMTP id 281928FC1E
	for <freebsd-questions@freebsd.org>;
	Fri, 24 Apr 2009 20:59:00 +0000 (UTC)
	(envelope-from psteele@maxiscale.com)
Received: from source ([209.85.146.183]) by exprod7ob106.postini.com
	([64.18.6.12]) with SMTP
	ID DSNKSfIoFBXbtauCOUk+H/oVd6umhSsbEofF@postini.com;
	Fri, 24 Apr 2009 13:59:01 PDT
Received: by wa-out-1112.google.com with SMTP id n4so551961wag.0
	for <freebsd-questions@freebsd.org>;
	Fri, 24 Apr 2009 13:59:00 -0700 (PDT)
Received: by 10.115.22.1 with SMTP id z1mr1574411wai.202.1240606740525;
	Fri, 24 Apr 2009 13:59:00 -0700 (PDT)
Received: from localhost ([76.231.178.131])
	by mx.google.com with ESMTPS id f20sm2293296waf.34.2009.04.24.13.58.59
	(version=SSLv3 cipher=RC4-MD5); Fri, 24 Apr 2009 13:58:59 -0700 (PDT)
Date: Fri, 24 Apr 2009 13:58:56 -0700 (PDT)
From: Peter Steele <psteele@maxiscale.com>
To: Wojciech Puchar <wojtek@wojtek.tensor.gdynia.pl>
Message-ID: <10460020.3001240606733585.JavaMail.HALO$@halo>
In-Reply-To: <alpine.BSF.2.00.0904242234140.2486@wojtek.tensor.gdynia.pl>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-Content-Filtered-By: Mailman/MimeDel 2.1.5
Cc: #freebsd-questions <freebsd-questions@freebsd.org>
Subject: Re: Unexpected gmirror behavior: Is this a bug?
X-BeenThere: freebsd-questions@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: User questions <freebsd-questions.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-questions>, 
	<mailto:freebsd-questions-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-questions>
List-Post: <mailto:freebsd-questions@freebsd.org>
List-Help: <mailto:freebsd-questions-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-questions>, 
	<mailto:freebsd-questions-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Fri, 24 Apr 2009 20:59:01 -0000

> This only happens with ad4. If ad6 for example goes offline in the same way, when it is reinserted 
> it does not become the dominant drive and resync its data with the other drives. Rather its data 
> is overwritten with the data from the 3 member mirror, as you'd expect. 
> looks like very strange bug. many times i got drives disconnected and 
> always gmirror resynced 

If I just pull ad4 and then reinsert it without doing a reboot, everything works fine. The problem occurs when ad4 is pulled and then reinserted after the system is shutdown. When the system comes up, it doesn't get added back to the existing mirror but rather becomes the principal member of the mirror, using its old data. Not good.