From owner-freebsd-hackers@FreeBSD.ORG Mon Apr 11 16:05:08 2005 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 69DA316A4CF for ; Mon, 11 Apr 2005 16:05:08 +0000 (GMT) Received: from darkness.comp.waw.pl (darkness.comp.waw.pl [195.117.238.136]) by mx1.FreeBSD.org (Postfix) with ESMTP id C1DA843D41 for ; Mon, 11 Apr 2005 16:05:07 +0000 (GMT) (envelope-from pjd@darkness.comp.waw.pl) Received: by darkness.comp.waw.pl (Postfix, from userid 1009) id C8667AC976; Mon, 11 Apr 2005 18:05:05 +0200 (CEST) Date: Mon, 11 Apr 2005 18:05:05 +0200 From: Pawel Jakub Dawidek To: David Gilbert Message-ID: <20050411160505.GO837@darkness.comp.waw.pl> References: <16984.18159.732608.234243@canoe.dclg.ca> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="YW2MF9I5J49Ey/EG" Content-Disposition: inline In-Reply-To: <16984.18159.732608.234243@canoe.dclg.ca> User-Agent: Mutt/1.4.2i X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 5.2.1-RC2 i386 cc: freebsd-hackers@freebsd.org Subject: Re: ggate failures. X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 11 Apr 2005 16:05:08 -0000 --YW2MF9I5J49Ey/EG Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sat, Apr 09, 2005 at 05:19:43PM -0400, David Gilbert wrote: +> I have two systems, each with 4 300 gig SATA disks. Let's call them +> m0 and m1. M1 exports it's disks with ggated ... on two private GigE +> networks. M0, on those same two GigE networks, imports them with +> ggatec. M0, then does the following: +>=20 +> Mirror Disks +> =3D=3D=3D=3D=3D=3D =3D=3D=3D=3D=3D +> s0 ggate0 da0s1g +> s1 ggate1 da1s1g +> s2 ggate2 da2s1g +> s3 ggate3 da3s1g +>=20 +> And then: +>=20 +> concat Disks +> =3D=3D=3D=3D=3D=3D =3D=3D=3D=3D=3D +> v0 s0 s1 s2 s3 +>=20 +> (so v0 is a concatination of 4 mirrors that consist of a local and +> remote disk, each) +>=20 +> Now... This all works, and we create a filesystem on v0. The problem +> arises that whenever a lot of activity occurs on v0 (untaring a copy +> of /usr is sufficient), the ggate links break down. An example +> message from the dmesg: +>=20 +> GEOM_MIRROR: Request failed (error=3D5). ggate2[WRITE(offset=3D259891840= 000, length=3D8192)] +>=20 +> Now... I don't know a lot about ggate, but this appears trivial to +> trigger. Has anyone tried similar configurations and is there any +> wisdom about ggate configurations? Set kern.geom.gate.debug to 1 and send output which is generated on failures. I've much improved ggate in perforce, but it needs some polishing still... --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --YW2MF9I5J49Ey/EG Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.4 (FreeBSD) iD8DBQFCWqAxForvXbEpPzQRAmSaAKDCLVncaD9NBnmSWtRPlKd6knNVjgCbB8Hp oyOWhkYK2dqchAG9IHmOE6k= =mJyS -----END PGP SIGNATURE----- --YW2MF9I5J49Ey/EG--