Skip site navigation (1)Skip section navigation (2)
Date:      Tue, 25 Jul 2006 15:53:32 +0200
From:      Pawel Jakub Dawidek <pjd@FreeBSD.org>
To:        Anton Nikiforov <anton@nikiforov.ru>
Cc:        freebsd-stable@freebsd.org
Subject:   Re: gmirror problems
Message-ID:  <20060725135332.GC44939@garage.freebsd.pl>
In-Reply-To: <44C0D388.3040205@nikiforov.ru>
References:  <44C0D388.3040205@nikiforov.ru>

next in thread | previous in thread | raw e-mail | index | archive | help

--mvpLiMfbWzRoNl4x
Content-Type: text/plain; charset=iso-8859-2
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable

On Fri, Jul 21, 2006 at 05:15:52PM +0400, Anton Nikiforov wrote:
> Dear All,
> I have the following gmirror configuration:
> server1
> ggated
> ggatec create -u 10 -o rw 192.168.100.110 /dev/da1s1d
> gmirror label -v -b split -s 2048 geom1 /dev/da1s1d /dev/ggate10d
> ggatec create -u 11 -o rw 192.168.100.110 /dev/da1s1e
> gmirror label -v -b split -s 2048 geom2 /dev/da1s1e /dev/ggate11
> ggatec create -u 12 -o rw 192.168.100.110 /dev/da1s1f
> gmirror label -v -b split -s 2048 geom3 /dev/da1s1f /dev/ggate12
> ggatec create -u 13 -o rw 192.168.100.110 /dev/da1s1g
> gmirror label -v -b split -s 2048 geom4 /dev/da1s1g /dev/ggate13
> ggatec create -u 14 -o rw 192.168.100.110 /dev/da1s1h
> gmirror label -v -b split -s 2048 geom5 /dev/da1s1h /dev/ggate14
>=20
> server 2
> ggated
>=20
> When I'm starting from scratch. (currently by manually running all comman=
ds/daemons)
> Everything is fine, until I'm trying to mount gmirrored device from serve=
r2. What I'm doing listed below
> 1. Unmounting all file systems
> 2. stooping all devices (all, but i need only one to start it on another =
host)
> 3. stopping daemons
> 4. Starting daemon on server1
> 5. Trying to create ggatec device on server2 with the same command, but w=
ith IP of server1
>    getting error: ggatec: ggatec: ioctl(/dev/ggctl): Invalid argument.
>                ggatec: Exiting.
> 6. looking into gmirror status device list i have all devices in DEGRADED=
 state on server 2 (there was no devices in the list while everything was u=
p)
> 7. longing into gmirror status device list i have all devices in COMPLETE=
 state and next time gmirror hangs forever.
>=20
> Could you please help me or direct to the right manual?
> I have found a lot of sources of how to setup (and I'm done with this). B=
ut what should i do with failure? How to mount disk on another node or star=
t it after failure?

You cannot open any GEOM provider for writting twice.
If you try to start ggatec on one server, ggated on the other server
tries to open given partition, but it fails when it is already open on
this server. Bascially, if you call:

	# ggatec create -u 10 -o rw 192.168.100.110 /dev/da1s1d

You must be sure /dev/da1s1d on server 192.168.100.110 is not opened for
writting already.

> And one more question: is there any way to get gmirror to re mirror devic=
es before carp interfaces become up? I want to get data mirrored before mov=
ing services from backup=20
> firewall to main one (in case main was failed)

Not sure if I understand this...

> And one more thing..... after some manipulations with gmirror devices i h=
ave server crushed while booting kernel. At the moment it initialize GEOM_M=
IRROR device - kernel=20
> panics.
> When i remove the disk that was containing gmirror devices - server just =
booted normally. But insertion of that disk back and running camcontol resc=
an all - bring it back=20
> to panic... so, i cannot use this disk anymore (i know, that i can rewrit=
e it's last sector on machine without GEOM compiled into the kernel)

I you want me to help with this one, you need to provide more info,
especially what's going on on the console, panic message, backtrace,
anything.

--=20
Pawel Jakub Dawidek                       http://www.wheel.pl
pjd@FreeBSD.org                           http://www.FreeBSD.org
FreeBSD committer                         Am I Evil? Yes, I Am!

--mvpLiMfbWzRoNl4x
Content-Type: application/pgp-signature
Content-Disposition: inline

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.4 (FreeBSD)

iD8DBQFExiJcForvXbEpPzQRAkN9AJ9YUjvUSUNndO67VGiAkRexQaAMiwCfeK0O
eFBvnNYKjl6HrLwaZh2nTHY=
=Q3qW
-----END PGP SIGNATURE-----

--mvpLiMfbWzRoNl4x--



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20060725135332.GC44939>