From owner-freebsd-stable@FreeBSD.ORG Tue Jul 25 13:54:06 2006 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 52E1516A4DA for ; Tue, 25 Jul 2006 13:54:06 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.FreeBSD.org (Postfix) with ESMTP id 255C843D45 for ; Tue, 25 Jul 2006 13:54:03 +0000 (GMT) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 06A935138C; Tue, 25 Jul 2006 15:53:59 +0200 (CEST) Received: from localhost (pjd.wheel.pl [10.0.1.1]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id D1F945138A; Tue, 25 Jul 2006 15:53:52 +0200 (CEST) Date: Tue, 25 Jul 2006 15:53:32 +0200 From: Pawel Jakub Dawidek To: Anton Nikiforov Message-ID: <20060725135332.GC44939@garage.freebsd.pl> References: <44C0D388.3040205@nikiforov.ru> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="mvpLiMfbWzRoNl4x" Content-Disposition: inline In-Reply-To: <44C0D388.3040205@nikiforov.ru> X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng/devel-r804 (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-5.9 required=3.0 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.0.4 Cc: freebsd-stable@freebsd.org Subject: Re: gmirror problems X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 25 Jul 2006 13:54:06 -0000 --mvpLiMfbWzRoNl4x Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Jul 21, 2006 at 05:15:52PM +0400, Anton Nikiforov wrote: > Dear All, > I have the following gmirror configuration: > server1 > ggated > ggatec create -u 10 -o rw 192.168.100.110 /dev/da1s1d > gmirror label -v -b split -s 2048 geom1 /dev/da1s1d /dev/ggate10d > ggatec create -u 11 -o rw 192.168.100.110 /dev/da1s1e > gmirror label -v -b split -s 2048 geom2 /dev/da1s1e /dev/ggate11 > ggatec create -u 12 -o rw 192.168.100.110 /dev/da1s1f > gmirror label -v -b split -s 2048 geom3 /dev/da1s1f /dev/ggate12 > ggatec create -u 13 -o rw 192.168.100.110 /dev/da1s1g > gmirror label -v -b split -s 2048 geom4 /dev/da1s1g /dev/ggate13 > ggatec create -u 14 -o rw 192.168.100.110 /dev/da1s1h > gmirror label -v -b split -s 2048 geom5 /dev/da1s1h /dev/ggate14 >=20 > server 2 > ggated >=20 > When I'm starting from scratch. (currently by manually running all comman= ds/daemons) > Everything is fine, until I'm trying to mount gmirrored device from serve= r2. What I'm doing listed below > 1. Unmounting all file systems > 2. stooping all devices (all, but i need only one to start it on another = host) > 3. stopping daemons > 4. Starting daemon on server1 > 5. Trying to create ggatec device on server2 with the same command, but w= ith IP of server1 > getting error: ggatec: ggatec: ioctl(/dev/ggctl): Invalid argument. > ggatec: Exiting. > 6. looking into gmirror status device list i have all devices in DEGRADED= state on server 2 (there was no devices in the list while everything was u= p) > 7. longing into gmirror status device list i have all devices in COMPLETE= state and next time gmirror hangs forever. >=20 > Could you please help me or direct to the right manual? > I have found a lot of sources of how to setup (and I'm done with this). B= ut what should i do with failure? How to mount disk on another node or star= t it after failure? You cannot open any GEOM provider for writting twice. If you try to start ggatec on one server, ggated on the other server tries to open given partition, but it fails when it is already open on this server. Bascially, if you call: # ggatec create -u 10 -o rw 192.168.100.110 /dev/da1s1d You must be sure /dev/da1s1d on server 192.168.100.110 is not opened for writting already. > And one more question: is there any way to get gmirror to re mirror devic= es before carp interfaces become up? I want to get data mirrored before mov= ing services from backup=20 > firewall to main one (in case main was failed) Not sure if I understand this... > And one more thing..... after some manipulations with gmirror devices i h= ave server crushed while booting kernel. At the moment it initialize GEOM_M= IRROR device - kernel=20 > panics. > When i remove the disk that was containing gmirror devices - server just = booted normally. But insertion of that disk back and running camcontol resc= an all - bring it back=20 > to panic... so, i cannot use this disk anymore (i know, that i can rewrit= e it's last sector on machine without GEOM compiled into the kernel) I you want me to help with this one, you need to provide more info, especially what's going on on the console, panic message, backtrace, anything. --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --mvpLiMfbWzRoNl4x Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.4 (FreeBSD) iD8DBQFExiJcForvXbEpPzQRAkN9AJ9YUjvUSUNndO67VGiAkRexQaAMiwCfeK0O eFBvnNYKjl6HrLwaZh2nTHY= =Q3qW -----END PGP SIGNATURE----- --mvpLiMfbWzRoNl4x--