From owner-freebsd-geom@FreeBSD.ORG  Tue Oct 20 15:39:44 2009
Return-Path: <owner-freebsd-geom@FreeBSD.ORG>
Delivered-To: freebsd-geom@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id 5A4F1106566B
	for <freebsd-geom@freebsd.org>; Tue, 20 Oct 2009 15:39:44 +0000 (UTC)
	(envelope-from petefrench@ticketswitch.com)
Received: from constantine.ticketswitch.com (constantine.ticketswitch.com
	[IPv6:2002:57e0:1d4e:1::3])
	by mx1.freebsd.org (Postfix) with ESMTP id 1F5C18FC1A
	for <freebsd-geom@freebsd.org>; Tue, 20 Oct 2009 15:39:43 +0000 (UTC)
Received: from dilbert.rattatosk ([10.64.50.6] helo=dilbert.ticketswitch.com)
	by constantine.ticketswitch.com with esmtps (TLSv1:AES256-SHA:256)
	(Exim 4.69 (FreeBSD)) (envelope-from <petefrench@ticketswitch.com>)
	id 1N0GoC-000OD1-6V
	for freebsd-geom@freebsd.org; Tue, 20 Oct 2009 16:39:36 +0100
Received: from petefrench by dilbert.ticketswitch.com with local (Exim 4.69
	(FreeBSD)) (envelope-from <petefrench@ticketswitch.com>)
	id 1N0GoC-0004dc-5m
	for freebsd-geom@freebsd.org; Tue, 20 Oct 2009 16:39:36 +0100
To: freebsd-geom@freebsd.org
Message-Id: <E1N0GoC-0004dc-5m@dilbert.ticketswitch.com>
From: Pete French <petefrench@ticketswitch.com>
Date: Tue, 20 Oct 2009 16:39:36 +0100
Subject: problems with gmirror on ggate over slow link
X-BeenThere: freebsd-geom@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: GEOM-specific discussions and implementations
	<freebsd-geom.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-geom>,
	<mailto:freebsd-geom-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-geom>
List-Post: <mailto:freebsd-geom@freebsd.org>
List-Help: <mailto:freebsd-geom-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-geom>,
	<mailto:freebsd-geom-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Tue, 20 Oct 2009 15:39:44 -0000

I am using 7.1-STABLE from a few days ago on all amchines, but this
has been going on a while. Very simply I am mirroring together a pair
of discs, one local, one remote. The remote disc is accessed using ggate.

If the remote diisc is actually on a very close machine - e.g. a server
plugged into the same ether net - then all works fine. If I make
the remote disc somewhere actually substantially further away on the
nbetwork, however, then when I attach the disc it starts to rebuild the
mirror but then fails a fraction of a second later thus:

GEOM_MIRROR: Device mysql0: rebuilding provider ggate1a.
GEOM_MIRROR: Synchronization request failed (error=5). ggate1a[WRITE(offset=1310720, length=131072)]
GEOM_MIRROR: Device mysql0: provider ggate1a disconnected.
GEOM_MIRROR: Device mysql0: rebuilding provider ggate1a stopped.

The interesting this is that the problem is only with gmirror, not with
the underlying ggate disc which remains attached and accessible. I tested
this by adding a second partition (ggate1b in the example above) and
mounting a UFS filesystem on that.

My conjecture would be that a buffer somewhere is filling up, and
instead of gmirror waiting for it, instead it just fails the write.

Any ideas ? Is this actually a bug ?

-pete.