From owner-freebsd-geom@FreeBSD.ORG Sun Jan 16 08:34:01 2005 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 398B316A4CE for ; Sun, 16 Jan 2005 08:34:01 +0000 (GMT) Received: from darkness.comp.waw.pl (darkness.comp.waw.pl [195.117.238.136]) by mx1.FreeBSD.org (Postfix) with ESMTP id 7B1BD43D2D for ; Sun, 16 Jan 2005 08:34:00 +0000 (GMT) (envelope-from pjd@darkness.comp.waw.pl) Received: by darkness.comp.waw.pl (Postfix, from userid 1009) id BEF6CACB34; Sun, 16 Jan 2005 09:33:56 +0100 (CET) Date: Sun, 16 Jan 2005 09:33:56 +0100 From: Pawel Jakub Dawidek To: Brian McCann Message-ID: <20050116083356.GZ795@darkness.comp.waw.pl> References: <2b5f066d05011408521a06e380@mail.gmail.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="fU5tsrXreH0/dVH0" Content-Disposition: inline In-Reply-To: <2b5f066d05011408521a06e380@mail.gmail.com> User-Agent: Mutt/1.4.2i X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 5.2.1-RC2 i386 cc: freebsd-geom@freebsd.org Subject: Re: ggatec/ggated cache or buffer? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 16 Jan 2005 08:34:01 -0000 --fU5tsrXreH0/dVH0 Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Jan 14, 2005 at 11:52:22AM -0500, Brian McCann wrote: +> Hi all...I posted this in -stable and wanted to post in here as well +> to see if anyone else can help me out. I'm playing around with ggatec +> and ggated, and +> would like to eventually be able to mirror a partition over the +> network...but for now I've just exported /dev/da1s1d as RO, created +> the ggate device on the client as RO, mounted it as RO (and tried +> using async as well), and when I make change on the server, I NEVER +> see it on the client without unmounting and remounting the client. You cannot change device under file system. You have to possibilities: mount ggate device RW only on one machine or mount ggate device RO on many machines. --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --fU5tsrXreH0/dVH0 Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.4 (FreeBSD) iD8DBQFB6ib0ForvXbEpPzQRAlAFAJ40L6vyhJV2Lrh+FZOsZHTOdrEGbQCfWYyT EslFGpIMIejwqhw8CGUOQco= =nXHM -----END PGP SIGNATURE----- --fU5tsrXreH0/dVH0-- From owner-freebsd-geom@FreeBSD.ORG Mon Jan 17 14:46:15 2005 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 7A14816A4CE for ; Mon, 17 Jan 2005 14:46:15 +0000 (GMT) Received: from ms-smtp-02-eri0.texas.rr.com (ms-smtp-02.texas.rr.com [24.93.47.41]) by mx1.FreeBSD.org (Postfix) with ESMTP id 1F66B43D5A for ; Mon, 17 Jan 2005 14:46:12 +0000 (GMT) (envelope-from freebsd@zepeda.ws) Received: from [10.255.255.1] (cs662573-29.satx.rr.com [66.25.73.29]) j0HEk78H014382 for ; Mon, 17 Jan 2005 08:46:07 -0600 (CST) Message-ID: <41EBCFAF.2010309@zepeda.ws> Date: Mon, 17 Jan 2005 08:46:07 -0600 From: "Daniel P. Zepeda" User-Agent: Mozilla Thunderbird 0.9 (X11/20041127) X-Accept-Language: en-us, en MIME-Version: 1.0 To: freebsd-geom@freebsd.org Content-Type: multipart/mixed; boundary="------------090300070707010306090601" X-Virus-Scanned: Symantec AntiVirus Scan Engine Subject: configuration/performance question X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Jan 2005 14:46:15 -0000 This is a multi-part message in MIME format. --------------090300070707010306090601 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Hello, My original problem was that I was having the problem where my mirror comes up DEGRADED when I reboot the machine. Now, I wrote up this long post to describe the situation and appeal for help from those folks more intimate with all this than I, and, on going to subscribe to the list to post this, I found the solution on digging further in the archive. I've left the whole thing intact here, but I found the solution to my problem here; http://lists.freebsd.org/pipermail/freebsd-geom/2004-September/000259.html But what I uncovered while having my problem is that if I shut down one consumer, the newer one I configured that I wanted to work, namely da1 on gm0, that an older mirror that I first configured, namely gm0s1, starts up, with consumers that I originally set up as da1s1* !! My question now is, I have some idea of how GEOM works from the manpage, it seems to say that the disk data flows through a set of geoms to/from the kernel/disks. Will the "ghost" mirror and slices provide extra steps, and therefore a performance slowdown, or am I totally off base with the way GEOM works? (Which is likely since I was only introduced to it last week). That is, is the way it is set up now on my box Ok? It works Ok, and I can reboot now with a COMPLETE array, but is it messed up internally? I haven't done any performance tests yet, so I don't know. Can anyone enlighten me on this? Here is the text of the original message. I'm leaving it here because it provides a lot of detail on my set up to back up my question above, although the problem I outlined below is SOLVED and my question is above. Thanks, DZ ****************************************************************************************** I've completely turned off swap for now, but I still swapoff="YES" in my /etc/rc.conf, and I've consistently used shutdown since I learned about the swap consequences. I'm running: FreeBSD localhost 5.3-RELEASE-p4 FreeBSD 5.3-RELEASE-p4 #6: Fri Jan 14 06:42:28 CST 2005 toor@localhost:/usr/obj/usr/src/sys/MYKERNEL i386 freshly CVSup'd on a Dell PowerEdge 2850 with this patch: http://lists.freebsd.org/pipermail/freebsd-geom/2004-October/000338.html with the delay set to 10 as the poster originally stated. I originally started with the approach #2, mirror-on-a-slice, but encountered problems because on bootup GEOM couldn't update the metadata on da0. So I went with Approach #1 in the article, and I no longer see the problem with writing metadata, but now it seems that it comes up DEGRADED because there is other information left over from the original setup. When I remove da1 from the mirror the old gm0s1 mirror starts up, although I've tried every way I can think of to get rid of it. When I remove the old mirror that is starting up, gm0s1, then kern.geom.conftx shows da1s1 MBR's and partitions. How do I get rid them? I've tried very many methods, even going back to scratch, removing gmirror and just booting of the /dev/da* devices, and doing it all over again. I've even tried zeroing each disk with dd and reconnecting them, but to no avail. I'm thinking that this is part of the problem preventing my mirror from coming up complete after a reboot. I've been through the freebsd-GEOM archives, but I honestly don't know what has been folded into what I'm running now, and what other patches to try, if that is even the problem. I've prepared a complete log of how it looks COMPLETE, and then after the reboot and rebuild. I've really wasted a good bit of time on this, I would appreciate any help, the final goal is to have a COMPLETE mirror through reboots. ***************************************************************************************** Here we go, Here after a rebuild, the mirror is complete and happy. ***************************************************************************************** gmirror list Geom name: gm0 State: COMPLETE Components: 2 Balance: round-robin Slice: 4096 Flags: NONE SyncID: 2 ID: 2505058140 Providers: 1. Name: mirror/gm0 Mediasize: 36420074496 (34G) Sectorsize: 512 Mode: r1w1e2 Consumers: 1. Name: da0 Mediasize: 36420075008 (34G) Sectorsize: 512 Mode: r1w1e3 State: ACTIVE Priority: 0 Flags: DIRTY SyncID: 2 ID: 4003588011 2. Name: da1 Mediasize: 36420075008 (34G) Sectorsize: 512 Mode: r1w1e3 State: ACTIVE Priority: 0 Flags: DIRTY SyncID: 2 ID: 3220781586 Geom name: gm0.sync ***************************************************************************************** ********** REBOOT Now we're logged in again, we see the mirror in DEGRADED mode, rebuilding, Here's a listing: ***************************************************************************************** root@localhost:/root# gmirror list Geom name: gm0 State: DEGRADED Components: 2 Balance: round-robin Slice: 4096 Flags: NONE SyncID: 3 ID: 2505058140 Providers: 1. Name: mirror/gm0 Mediasize: 36420074496 (34G) Sectorsize: 512 Mode: r2w1e2 Consumers: 1. Name: da0 Mediasize: 36420075008 (34G) Sectorsize: 512 Mode: r2w1e3 State: ACTIVE Priority: 0 Flags: DIRTY SyncID: 3 ID: 4003588011 2. Name: da1 Mediasize: 36420075008 (34G) Sectorsize: 512 Mode: r0w1e1 State: SYNCHRONIZING Priority: 0 Flags: DIRTY, SYNCHRONIZING SyncID: 3 Synchronized: 17% ID: 3220781586 Geom name: gm0.sync Consumers: 1. Name: mirror/gm0 Mediasize: 36420074496 (34G) Sectorsize: 512 Mode: r1w0e0 ***************************************************************************************** ************* ****** What kern.geom.conftx during the rebuild ******** ***************************************************************************************** # sysctl -b kern.geom.conftx 0 DISK da1 36420075008 512 hd 255 sc 63 1 MIRROR mirror/gm0 36420074496 512 2 MBR mirror/gm0s1 36413282304 512 i 0 o 32256 ty 165 3 BSD mirror/gm0s1c 36413282304 512 i 2 o 0 ty 0 3 BSD mirror/gm0s1b 1073733632 512 i 1 o 35339548672 ty 1 3 BSD mirror/gm0s1a 35339540480 512 i 0 o 8192 ty 7 0 DISK da0 36420075008 512 hd 255 sc 63 1 MIRROR mirror/gm0 36420074496 512 2 MBR mirror/gm0s1 36413282304 512 i 0 o 32256 ty 165 3 BSD mirror/gm0s1c 36413282304 512 i 2 o 0 ty 0 3 BSD mirror/gm0s1b 1073733632 512 i 1 o 35339548672 ty 1 3 BSD mirror/gm0s1a 35339540480 512 i 0 o 8192 ty 7 ***************************************************************************************** ******************* ******* And here's /var/log/messages from bootup, until this point ****************** ***************************************************************************************** Jan 17 06:43:55 localhost kernel: da0 at mpt0 bus 0 target 0 lun 0 Jan 17 06:43:55 localhost kernel: da0: Fixed Direct Access SCSI-3 device Jan 17 06:43:55 localhost kernel: da0: 320.000MB/s transfers (160.000MHz, offset 63, 16bit), Tagged Queueing Enabled Jan 17 06:43:55 localhost kernel: da0: 34732MB (71132959 512 byte sectors: 255H 63S/T 4427C) Jan 17 06:43:55 localhost kernel: da1 at mpt0 bus 0 target 1 lun 0 Jan 17 06:43:55 localhost kernel: da1: Fixed Direct Access SCSI-3 device Jan 17 06:43:55 localhost kernel: da1: 320.000MB/s transfers (160.000MHz, offset 63, 16bit), Tagged Queueing Enabled Jan 17 06:43:55 localhost kernel: da1: 34732MB (71132959 512 byte sectors: 255H 63S/T 4427C) Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Tasting da0. Jan 17 06:43:55 localhost kernel: magic: GEOM::MIRROR Jan 17 06:43:55 localhost kernel: version: 1 Jan 17 06:43:55 localhost kernel: name: gm0 Jan 17 06:43:55 localhost kernel: mid: 2505058140 Jan 17 06:43:55 localhost kernel: did: 4003588011 Jan 17 06:43:55 localhost kernel: all: 2 Jan 17 06:43:55 localhost kernel: syncid: 2 Jan 17 06:43:55 localhost kernel: priority: 0 Jan 17 06:43:55 localhost kernel: slice: 4096 Jan 17 06:43:55 localhost kernel: balance: round-robin Jan 17 06:43:55 localhost kernel: mediasize: 36420074496 Jan 17 06:43:55 localhost kernel: sectorsize: 512 Jan 17 06:43:55 localhost kernel: syncoffset: 0 Jan 17 06:43:55 localhost kernel: mflags: NONE Jan 17 06:43:55 localhost kernel: dflags: NONE Jan 17 06:43:55 localhost kernel: hcprovider: Jan 17 06:43:55 localhost kernel: MD5 hash: 05b629f9060ab32a0d273902be366a37 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[1]: Creating device gm0 (id=2505058140). Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[0]: Device gm0 created (id=2505058140). Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[1]: Adding disk da0 to gm0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Adding disk da0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Disk da0 connected. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[1]: Disk da0 state changed from NONE to NEW (device gm0). Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[0]: Device gm0: provider da0 detected. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Tasting da1. Jan 17 06:43:55 localhost kernel: magic: GEOM::MIRROR Jan 17 06:43:55 localhost kernel: version: 1 Jan 17 06:43:55 localhost kernel: name: gm0 Jan 17 06:43:55 localhost kernel: mid: 2505058140 Jan 17 06:43:55 localhost kernel: did: 3220781586 Jan 17 06:43:55 localhost kernel: all: 2 Jan 17 06:43:55 localhost kernel: syncid: 2 Jan 17 06:43:55 localhost kernel: priority: 0 Jan 17 06:43:55 localhost kernel: slice: 4096 Jan 17 06:43:55 localhost kernel: balance: round-robin Jan 17 06:43:55 localhost kernel: mediasize: 36420074496 Jan 17 06:43:55 localhost kernel: sectorsize: 512 Jan 17 06:43:55 localhost kernel: syncoffset: 0 Jan 17 06:43:55 localhost kernel: mflags: NONE Jan 17 06:43:55 localhost kernel: dflags: NONE Jan 17 06:43:55 localhost kernel: hcprovider: Jan 17 06:43:55 localhost kernel: MD5 hash: b4ab3313a1ead3ed591d0b3f4deed554 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[1]: Adding disk da1 to gm0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Adding disk da1. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Disk da1 connected. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[1]: Disk da1 state changed from NONE to NEW (device gm0). Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[0]: Device gm0: provider da1 detected. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[1]: Device gm0 state changed from STARTING to RUNNING. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[1]: Disk da1 state changed from NEW to ACTIVE (device gm0). Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r0w1e1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r0w-1e-1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Metadata on da1 updated. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[0]: Device gm0: provider da1 activated. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[1]: Disk da0 state changed from NEW to ACTIVE (device gm0). Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r0w1e1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Tasting da0s1. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Tasting da1s1. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r0w-1e-1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Metadata on da0 updated. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[0]: Device gm0: provider da0 activated. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[0]: Device gm0: provider mirror/gm0 launched. Jan 17 06:43:55 localhost kernel: magic: GEOM::MIRROR Jan 17 06:43:55 localhost kernel: version: 1 Jan 17 06:43:55 localhost kernel: name: gm0s1 Jan 17 06:43:55 localhost kernel: mid: 3061091415 Jan 17 06:43:55 localhost kernel: did: 3644757297 Jan 17 06:43:55 localhost kernel: all: 2 Jan 17 06:43:55 localhost kernel: syncid: 17 Jan 17 06:43:55 localhost kernel: priority: 0 Jan 17 06:43:55 localhost kernel: slice: 4096 Jan 17 06:43:55 localhost kernel: balance: round-robin Jan 17 06:43:55 localhost kernel: mediasize: 36413281792 Jan 17 06:43:55 localhost kernel: sectorsize: 512 Jan 17 06:43:55 localhost kernel: syncoffset: 0 Jan 17 06:43:55 localhost kernel: mflags: NONE Jan 17 06:43:55 localhost kernel: dflags: NONE Jan 17 06:43:55 localhost kernel: hcprovider: da1s1 Jan 17 06:43:55 localhost kernel: MD5 hash: a3fe1554ce5cb9364934713102300b18 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[1]: Creating device gm0s1 (id=3061091415). Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[0]: Device gm0s1 created (id=3061091415). Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[1]: Adding disk da1s1 to gm0s1. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Adding disk da1s1. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Disk da1s1 connected. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[1]: Disk da1s1 state changed from NONE to NEW (device gm0s1). Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[0]: Device gm0s1: provider da1s1 detected. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r1w0e1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r-1w0e-1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e-1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Tasting mirror/gm0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r1w0e1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r-1w0e-1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e-1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r1w0e1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r-1w0e-1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e-1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r1w0e1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r-1w0e-1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e-1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Tasting da1s1a. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Tasting da1s1b. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Tasting da1s1c. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e1. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r1w0e2 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e2 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e-1. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r-1w0e-2 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e-2 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Tasting mirror/gm0s1. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e1. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r1w0e2 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e2 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e-1. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r-1w0e-2 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e-2 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e1. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r1w0e2 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e2 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e-1. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r-1w0e-2 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e-2 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e1. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r1w0e2 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e2 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e-1. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r-1w0e-2 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e-2 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e1. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r1w0e2 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e2 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e-1. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r-1w0e-2 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e-2 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e-2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Tasting mirror/gm0s1a. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e-2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e-2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e-2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e-2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Tasting mirror/gm0s1b. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e-2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e-2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e-2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e-2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Tasting mirror/gm0s1c. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e-2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e-2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e-2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[0]: Force device gm0s1 start due to timeout. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[1]: Device gm0s1 state changed from STARTING to RUNNING. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[1]: Disk da1s1 state changed from NEW to ACTIVE (device gm0s1). Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r0w1e1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[1]: Disk da1 state changed from ACTIVE to DISCONNECTED (device gm0). Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[0]: Device gm0: provider da1 disconnected. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Disk da1 disconnected. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Consumer da1 destroyed. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[1]: Device gm0: syncid bumped to 3. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r0w1e1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r0w-1e-1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Metadata on da1s1 updated. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[0]: Device gm0s1: provider da1s1 activated. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[0]: Device gm0s1: provider mirror/gm0s1 launched. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r0w-1e-1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Metadata on da0 updated. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Tasting da1. Jan 17 06:43:55 localhost kernel: magic: GEOM::MIRROR Jan 17 06:43:55 localhost kernel: version: 1 Jan 17 06:43:55 localhost kernel: name: gm0 Jan 17 06:43:55 localhost kernel: mid: 2505058140 Jan 17 06:43:55 localhost kernel: did: 3220781586 Jan 17 06:43:55 localhost kernel: all: 2 Jan 17 06:43:55 localhost kernel: syncid: 2 Jan 17 06:43:55 localhost kernel: priority: 0 Jan 17 06:43:55 localhost kernel: slice: 4096 Jan 17 06:43:55 localhost kernel: balance: round-robin Jan 17 06:43:55 localhost kernel: mediasize: 36420074496 Jan 17 06:43:55 localhost kernel: sectorsize: 512 Jan 17 06:43:55 localhost kernel: syncoffset: 0 Jan 17 06:43:55 localhost kernel: mflags: NONE Jan 17 06:43:55 localhost kernel: dflags: NONE Jan 17 06:43:55 localhost kernel: hcprovider: Jan 17 06:43:55 localhost kernel: MD5 hash: 7a64c716e9497f74a61b8dc8be0dad3f Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[1]: Adding disk da1 to gm0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Adding disk da1. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Disk da1 connected. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[1]: Disk da1 state changed from NONE to NEW (device gm0). Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[0]: Device gm0: provider da1 detected. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[1]: Disk da1 state changed from NEW to SYNCHRONIZING (device gm0). Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[0]: Device gm0: rebuilding provider da1. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r0w1e1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Metadata on da1 updated. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r1w0e0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r1w0e1 = 6 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Tasting mirror/gm0s1. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r1w0e0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r1w0e1 = 6 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r1w0e0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r1w0e1 = 6 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r1w0e0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r1w0e1 = 6 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[1]: Disk da1s1 state changed from ACTIVE to DISCONNECTED (device gm0s1). Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[0]: Device gm0s1: provider da1s1 disconnected. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Disk da1s1 disconnected. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Consumer da1s1 destroyed. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: No I/O requests for gm0s1, it can be destroyed. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[0]: Device gm0s1: provider mirror/gm0s1 destroyed. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[0]: Device gm0s1 destroyed. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Tasting da0s1. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Tasting da0s1a. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Tasting da0s1b. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Tasting da0s1c. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w1e2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w1e2 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[1]: Disk da0 (device gm0) marked as dirty. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Metadata on da0 updated. Jan 17 06:43:55 localhost kernel: Mounted root from ufs:/dev/mirror/gm0s1a. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Metadata on da1 updated. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e0 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e0 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e0 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r0w1e0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r0w1e0 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e0 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r0w-1e0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r0w-1e0 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Metadata on da1 updated. Jan 17 06:45:09 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e0. Jan 17 06:45:09 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e0 = 0 Jan 17 06:45:09 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e0. Jan 17 06:45:09 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e0 = 0 Jan 17 06:45:10 localhost kernel: GEOM_MIRROR[2]: Metadata on da1 updated. Jan 17 06:53:07 localhost last message repeated 26 times ***************************************************************************************** ******************** ***** Now I disconnect da1 from gm0 I originally did this because I wanted to just zero /dev/da1 with dd and start over (or so I thought). But when I ran a list, I was surprised to see gm0s1 starting up: ************************ ***************************************************************************************** root@localhost:/root# gmirror deactivate gm0 da1 root@localhost:/root# gmirror list Geom name: gm0 State: DEGRADED Components: 2 Balance: round-robin Slice: 4096 Flags: NONE SyncID: 4 ID: 2505058140 Providers: 1. Name: mirror/gm0 Mediasize: 36420074496 (34G) Sectorsize: 512 Mode: r1w1e2 Consumers: 1. Name: da0 Mediasize: 36420075008 (34G) Sectorsize: 512 Mode: r1w1e3 State: ACTIVE Priority: 0 Flags: DIRTY SyncID: 4 ID: 4003588011 Geom name: gm0.sync Geom name: gm0s1 State: DEGRADED Components: 2 Balance: round-robin Slice: 4096 Flags: NONE SyncID: 17 ID: 3061091415 Providers: 1. Name: mirror/gm0s1 Mediasize: 36413281792 (34G) Sectorsize: 512 Mode: r0w0e0 Consumers: 1. Name: da1s1 Mediasize: 36413282304 (34G) Sectorsize: 512 Mode: r0w0e0 State: ACTIVE Priority: 0 Flags: HARDCODED SyncID: 17 ID: 3644757297 Geom name: gm0s1.sync ***************************************************************************************** ********************************** **** Now kern.geom.conftx looked like this ***************************************************************************************** ************************* # sysctl -b kern.geom.conftx 0 DISK da1 36420075008 512 hd 255 sc 63 1 MBR da1s1 36413282304 512 i 0 o 32256 ty 165 2 BSD da1s1c 36413282304 512 i 2 o 0 ty 0 2 BSD da1s1b 1073733632 512 i 1 o 35339548672 ty 1 2 BSD da1s1a 35339540480 512 i 0 o 8192 ty 7 2 MIRROR mirror/gm0s1 36413281792 512 3 BSD mirror/gm0s1c 36413282304 512 i 2 o 0 ty 0 3 BSD mirror/gm0s1b 1073733632 512 i 1 o 35339548672 ty 1 3 BSD mirror/gm0s1a 35339540480 512 i 0 o 8192 ty 7 0 DISK da0 36420075008 512 hd 255 sc 63 1 MIRROR mirror/gm0 36420074496 512 2 MBR mirror/gm0s1 36413282304 512 i 0 o 32256 ty 165 3 BSD mirror/gm0s1c 36413282304 512 i 2 o 0 ty 0 3 BSD mirror/gm0s1b 1073733632 512 i 1 o 35339548672 ty 1 3 BSD mirror/gm0s1a 35339540480 512 i 0 o 8192 ty 7 ***************************************************************************************** *********************************** **** /var/log/messages for this event: ********************************** ***************************************************************************************** Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[1]: Disk da1 state changed from SYNCHRONIZING to DISCONNECTED (device gm0). Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[0]: Device gm0: provider da1 disconnected. Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[0]: Device gm0: rebuilding provider da1 stopped. Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e0. Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e0 = 0 Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[2]: Consumer mirror/gm0 destroyed. Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[2]: Access da1 r0w-1e-1 = 0 Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[2]: Disk da1 disconnected. Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[2]: I/O requests for da1 in queue, can't destroy it now. Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[2]: Consumer da1 destroyed. Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[2]: Tasting da1. Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[0]: Device gm0: provider da1 marked as inactive, skipping. Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[2]: Tasting da1s1. Jan 17 06:53:07 localhost kernel: magic: GEOM::MIRROR Jan 17 06:53:07 localhost kernel: version: 1 Jan 17 06:53:07 localhost kernel: name: gm0s1 Jan 17 06:53:07 localhost kernel: mid: 3061091415 Jan 17 06:53:07 localhost kernel: did: 3644757297 Jan 17 06:53:07 localhost kernel: all: 2 Jan 17 06:53:07 localhost kernel: syncid: 17 Jan 17 06:53:07 localhost kernel: priority: 0 Jan 17 06:53:07 localhost kernel: slice: 4096 Jan 17 06:53:07 localhost kernel: balance: round-robin Jan 17 06:53:07 localhost kernel: mediasize: 36413281792 Jan 17 06:53:07 localhost kernel: sectorsize: 512 Jan 17 06:53:07 localhost kernel: syncoffset: 0 Jan 17 06:53:07 localhost kernel: mflags: NONE Jan 17 06:53:07 localhost kernel: dflags: NONE Jan 17 06:53:07 localhost kernel: hcprovider: da1s1 Jan 17 06:53:07 localhost kernel: MD5 hash: 67a736074371d7996a699af47c6fb79c Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[1]: Creating device gm0s1 (id=3061091415). Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[0]: Device gm0s1 created (id=3061091415). Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[1]: Adding disk da1s1 to gm0s1. Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[2]: Adding disk da1s1. Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[2]: Disk da1s1 connected. Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[1]: Disk da1s1 state changed from NONE to NEW (device gm0s1). Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[0]: Device gm0s1: provider da1s1 detected. Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[2]: Tasting da1s1a. Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[1]: Device gm0: syncid bumped to 4. Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[2]: Metadata on da0 updated. Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[2]: Tasting da1s1b. Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[2]: Tasting da1s1c. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[0]: Force device gm0s1 start due to timeout. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[1]: Device gm0s1 state changed from STARTING to RUNNING. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[1]: Disk da1s1 state changed from NEW to ACTIVE (device gm0s1). Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r0w1e1 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r0w-1e-1 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Metadata on da1s1 updated. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[0]: Device gm0s1: provider da1s1 activated. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[0]: Device gm0s1: provider mirror/gm0s1 launched. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Tasting da1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[0]: Device gm0: provider da1 marked as inactive, skipping. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r1w0e0. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r1w0e1 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r-1w0e0. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r-1w0e-1 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Tasting mirror/gm0s1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r1w0e0. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r1w0e1 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r-1w0e0. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r-1w0e-1 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r1w0e0. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r1w0e1 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r-1w0e0. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r-1w0e-1 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r1w0e0. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r1w0e1 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r-1w0e0. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r-1w0e-1 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Tasting da1s1a. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Tasting da1s1b. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Tasting da1s1c. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r1w0e1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r1w0e2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r-1w0e-1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r-1w0e-2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Tasting mirror/gm0s1a. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r1w0e1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r1w0e2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r-1w0e-1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r-1w0e-2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r1w0e1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r1w0e2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r-1w0e-1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r-1w0e-2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r1w0e1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r1w0e2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r-1w0e-1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r-1w0e-2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r1w0e1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r1w0e2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r-1w0e-1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r-1w0e-2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Tasting mirror/gm0s1b. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r1w0e1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r1w0e2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r-1w0e-1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r-1w0e-2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r1w0e1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r1w0e2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r-1w0e-1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r-1w0e-2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r1w0e1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r1w0e2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r-1w0e-1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r-1w0e-2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r1w0e1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r1w0e2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r-1w0e-1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r-1w0e-2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Tasting mirror/gm0s1c. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r1w0e1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r1w0e2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r-1w0e-1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r-1w0e-2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r1w0e1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r1w0e2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r-1w0e-1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r-1w0e-2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r1w0e1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r1w0e2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r-1w0e-1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r-1w0e-2 = 0 ***************************************************************************************** ************************* ********* forgetting on gm0s1 so I can remove it ************************** ***************************************************************************************** root@localhost:/root# gmirror forget gm0s1 root@localhost:/root# gmirror list Geom name: gm0 State: DEGRADED Components: 2 Balance: round-robin Slice: 4096 Flags: NONE SyncID: 4 ID: 2505058140 Providers: 1. Name: mirror/gm0 Mediasize: 36420074496 (34G) Sectorsize: 512 Mode: r1w1e2 Consumers: 1. Name: da0 Mediasize: 36420075008 (34G) Sectorsize: 512 Mode: r1w1e3 State: ACTIVE Priority: 0 Flags: DIRTY SyncID: 4 ID: 4003588011 Geom name: gm0.sync Geom name: gm0s1 State: COMPLETE Components: 1 Balance: round-robin Slice: 4096 Flags: NONE SyncID: 17 ID: 3061091415 Providers: 1. Name: mirror/gm0s1 Mediasize: 36413281792 (34G) Sectorsize: 512 Mode: r0w0e0 Consumers: 1. Name: da1s1 Mediasize: 36413282304 (34G) Sectorsize: 512 Mode: r0w0e0 State: ACTIVE Priority: 0 Flags: HARDCODED SyncID: 17 ID: 3644757297 Geom name: gm0s1.sync ***************************************************************************************** *********************** ********** So, now I want to remove gm0s1, but I can't because it always ********** comes back, I need to manually destroy it each time and then add da1 to gm0 ***************************************************************************************** ************************** root@localhost:/root# gmirror remove gm0s1 da1s1 ************************* 0 DISK da1 36420075008 512 hd 255 sc 63 1 MBR da1s1 36413282304 512 i 0 o 32256 ty 165 2 MIRROR mirror/gm0s1 36413281792 512 3 BSD mirror/gm0s1c 36413282304 512 i 2 o 0 ty 0 3 BSD mirror/gm0s1b 1073733632 512 i 1 o 35339548672 ty 1 3 BSD mirror/gm0s1a 35339540480 512 i 0 o 8192 ty 7 0 DISK da0 36420075008 512 hd 255 sc 63 1 MIRROR mirror/gm0 36420074496 512 2 MBR mirror/gm0s1 36413282304 512 i 0 o 32256 ty 165 3 BSD mirror/gm0s1c 36413282304 512 i 2 o 0 ty 0 3 BSD mirror/gm0s1b 1073733632 512 i 1 o 35339548672 ty 1 3 BSD mirror/gm0s1a 35339540480 512 i 0 o 8192 ty 7 ***************************************************************************************** ********************** ********** Removing da1s1 from gm0s1 reveals the da1s1 MBR and the partitions ********** on da1 Huh? ************************* ***************************************************************************************** root@localhost:/root# gmirror remove gm0s1 da1s1 root@localhost:/root# gmirror list Geom name: gm0 State: DEGRADED Components: 2 Balance: round-robin Slice: 4096 Flags: NONE SyncID: 4 ID: 2505058140 Providers: 1. Name: mirror/gm0 Mediasize: 36420074496 (34G) Sectorsize: 512 Mode: r1w1e2 Consumers: 1. Name: da0 Mediasize: 36420075008 (34G) Sectorsize: 512 Mode: r1w1e3 State: ACTIVE Priority: 0 Flags: DIRTY SyncID: 4 ID: 4003588011 Geom name: gm0.sync 0 DISK da1 36420075008 512 hd 255 sc 63 1 MBR da1s1 36413282304 512 i 0 o 32256 ty 165 2 BSD da1s1c 36413282304 512 i 2 o 0 ty 0 2 BSD da1s1b 1073733632 512 i 1 o 35339548672 ty 1 2 BSD da1s1a 35339540480 512 i 0 o 8192 ty 7 0 DISK da0 36420075008 512 hd 255 sc 63 1 MIRROR mirror/gm0 36420074496 512 2 MBR mirror/gm0s1 36413282304 512 i 0 o 32256 ty 165 3 BSD mirror/gm0s1c 36413282304 512 i 2 o 0 ty 0 3 BSD mirror/gm0s1b 1073733632 512 i 1 o 35339548672 ty 1 3 BSD mirror/gm0s1a 35339540480 512 i 0 o 8192 ty 7 ***************************************************************************************** So I forget on gm0 so I can work on it, insert da1 and I'm back in business, kern.geom.conftx looks ok now? ***************************************************************************************** root@localhost:/root# gmirror list Geom name: gm0 State: COMPLETE Components: 1 Balance: round-robin Slice: 4096 Flags: NONE SyncID: 4 ID: 2505058140 Providers: 1. Name: mirror/gm0 Mediasize: 36420074496 (34G) Sectorsize: 512 Mode: r1w1e2 Consumers: 1. Name: da0 Mediasize: 36420075008 (34G) Sectorsize: 512 Mode: r1w1e3 State: ACTIVE Priority: 0 Flags: DIRTY SyncID: 4 ID: 4003588011 Geom name: gm0.sync root@localhost:/root# gmirror insert gm0 da1 root@localhost:/root# gmirror list Geom name: gm0 State: DEGRADED Components: 2 Balance: round-robin Slice: 4096 Flags: NONE SyncID: 4 ID: 2505058140 Providers: 1. Name: mirror/gm0 Mediasize: 36420074496 (34G) Sectorsize: 512 Mode: r2w1e2 Consumers: 1. Name: da0 Mediasize: 36420075008 (34G) Sectorsize: 512 Mode: r2w1e3 State: ACTIVE Priority: 0 Flags: DIRTY SyncID: 4 ID: 4003588011 2. Name: da1 Mediasize: 36420075008 (34G) Sectorsize: 512 Mode: r0w1e1 State: SYNCHRONIZING Priority: 0 Flags: DIRTY, SYNCHRONIZING SyncID: 4 Synchronized: 0% ID: 3782877908 Geom name: gm0.sync Consumers: 1. Name: mirror/gm0 Mediasize: 36420074496 (34G) Sectorsize: 512 Mode: r1w0e0 0 DISK da1 36420075008 512 hd 255 sc 63 1 MIRROR mirror/gm0 36420074496 512 2 MBR mirror/gm0s1 36413282304 512 i 0 o 32256 ty 165 3 BSD mirror/gm0s1c 36413282304 512 i 2 o 0 ty 0 3 BSD mirror/gm0s1b 1073733632 512 i 1 o 35339548672 ty 1 3 BSD mirror/gm0s1a 35339540480 512 i 0 o 8192 ty 7 0 DISK da0 36420075008 512 hd 255 sc 63 1 MIRROR mirror/gm0 36420074496 512 2 MBR mirror/gm0s1 36413282304 512 i 0 o 32256 ty 165 3 BSD mirror/gm0s1c 36413282304 512 i 2 o 0 ty 0 3 BSD mirror/gm0s1b 1073733632 512 i 1 o 35339548672 ty 1 3 BSD mirror/gm0s1a 35339540480 512 i 0 o 8192 ty 7 ***************************************************************************************** And the rest of the log entries for all of this; ***************************************************************************************** Jan 17 06:54:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r0w1e1 = 0 Jan 17 06:54:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r0w-1e-1 = 0 Jan 17 06:54:11 localhost kernel: GEOM_MIRROR[2]: Metadata on da1s1 updated. Jan 17 06:54:11 localhost kernel: GEOM_MIRROR[2]: Tasting da1. Jan 17 06:54:11 localhost kernel: GEOM_MIRROR[0]: Device gm0: provider da1 marked as inactive, skipping. Jan 17 06:55:18 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r0w1e1 = 0 Jan 17 06:55:18 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r0w-1e-1 = 0 Jan 17 06:55:18 localhost kernel: GEOM_MIRROR[2]: Metadata on da1s1 cleared. Jan 17 06:55:18 localhost kernel: GEOM_MIRROR[1]: Disk da1s1 state changed from ACTIVE to DESTROY (device gm0s1). Jan 17 06:55:18 localhost kernel: GEOM_MIRROR[0]: Device gm0s1: provider da1s1 destroyed. Jan 17 06:55:18 localhost kernel: GEOM_MIRROR[2]: Disk da1s1 disconnected. Jan 17 06:55:18 localhost kernel: GEOM_MIRROR[2]: Consumer da1s1 destroyed. Jan 17 06:55:18 localhost kernel: GEOM_MIRROR[2]: No I/O requests for gm0s1, it can be destroyed. Jan 17 06:55:18 localhost kernel: GEOM_MIRROR[0]: Device gm0s1: provider mirror/gm0s1 destroyed. Jan 17 06:55:18 localhost kernel: GEOM_MIRROR[0]: Device gm0s1 destroyed. Jan 17 06:55:18 localhost kernel: GEOM_MIRROR[2]: Tasting da1. Jan 17 06:55:18 localhost kernel: GEOM_MIRROR[0]: Device gm0: provider da1 marked as inactive, skipping. Jan 17 06:55:18 localhost kernel: GEOM_MIRROR[2]: Tasting da1s1. Jan 17 06:55:18 localhost kernel: GEOM_MIRROR[2]: Tasting da1s1a. Jan 17 06:55:19 localhost kernel: GEOM_MIRROR[2]: Tasting da1s1b. Jan 17 06:55:19 localhost kernel: GEOM_MIRROR[2]: Tasting da1s1c. Jan 17 06:56:05 localhost kernel: GEOM_MIRROR[2]: Metadata on da0 updated. Jan 17 06:56:22 localhost kernel: GEOM_MIRROR[2]: Metadata on da0 updated. Jan 17 06:56:22 localhost kernel: GEOM_MIRROR[2]: Tasting da1. Jan 17 06:56:22 localhost kernel: magic: GEOM::MIRROR Jan 17 06:56:22 localhost kernel: version: 1 Jan 17 06:56:22 localhost kernel: name: gm0 Jan 17 06:56:22 localhost kernel: mid: 2505058140 Jan 17 06:56:22 localhost kernel: did: 3782877908 Jan 17 06:56:22 localhost kernel: all: 2 Jan 17 06:56:22 localhost kernel: syncid: 0 Jan 17 06:56:22 localhost kernel: priority: 0 Jan 17 06:56:22 localhost kernel: slice: 4096 Jan 17 06:56:22 localhost kernel: balance: round-robin Jan 17 06:56:22 localhost kernel: mediasize: 36420074496 Jan 17 06:56:22 localhost kernel: sectorsize: 512 Jan 17 06:56:22 localhost kernel: syncoffset: 0 Jan 17 06:56:22 localhost kernel: mflags: NONE Jan 17 06:56:22 localhost kernel: dflags: NONE Jan 17 06:56:22 localhost kernel: hcprovider: Jan 17 06:56:22 localhost kernel: MD5 hash: c8505c5e0fcf859952eaab3439f1b7a5 Jan 17 06:56:22 localhost kernel: GEOM_MIRROR[1]: Adding disk da1 to gm0. Jan 17 06:56:22 localhost kernel: GEOM_MIRROR[2]: Adding disk da1. Jan 17 06:56:22 localhost kernel: GEOM_MIRROR[2]: Disk da1 connected. Jan 17 06:56:22 localhost kernel: GEOM_MIRROR[1]: Disk da1 state changed from NONE to NEW (device gm0). Jan 17 06:56:22 localhost kernel: GEOM_MIRROR[0]: Device gm0: provider da1 detected. Jan 17 06:56:22 localhost kernel: GEOM_MIRROR[1]: Disk da1 state changed from NEW to SYNCHRONIZING (device gm0). Jan 17 06:56:22 localhost kernel: GEOM_MIRROR[0]: Device gm0: rebuilding provider da1. Jan 17 06:56:22 localhost kernel: GEOM_MIRROR[2]: Access da1 r0w1e1 = 0 Jan 17 06:56:22 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e0. Jan 17 06:56:22 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e0 = 0 Jan 17 06:56:22 localhost kernel: GEOM_MIRROR[2]: Metadata on da1 updated. Jan 17 06:56:51 localhost last message repeated 28 times Jan 17 06:56:51 localhost ntpd[452]: kernel time sync enabled 2001 Jan 17 06:56:52 localhost kernel: GEOM_MIRROR[2]: Metadata on da1 updated. Jan 17 06:57:23 localhost last message repeated 30 times ***************************************************************************************** Just in case, here is the contents of /dev, filtered for da*: ***************************************************************************************** crw-r----- 1 root operator 4, 12 Jan 17 06:43 /dev/da0 crw-r----- 1 root operator 4, 13 Jan 17 06:43 /dev/da1 I've been banging my head on this one for awhile. Any help would be appreciated. Thanks, DZ --------------090300070707010306090601 Content-Type: text/plain; name="bigiron0.gmirror_problem.txt" Content-Transfer-Encoding: 7bit Content-Disposition: inline; filename="bigiron0.gmirror_problem.txt" Hello, My original problem was that I was having the problem where my mirror comes up DEGRADED when I reboot the machine. Now, I wrote up this long post to describe the situation and appeal for help from those folks more intimate with all this than I, and on going to subscribe to the list to post this, I found the solution on digging further in the archive. I've left the whole thing intact here, but I found the solution to my problem here; http://lists.freebsd.org/pipermail/freebsd-geom/2004-September/000259.html But what I uncovered while having my problem is that if I shut down one consumer, the newer one I configured that I wanted to work, namely da1 on gm0, that an older mirror that I first configured, namely gm0s1, starts up, with consumers that I originally set up da1s1* My question now is, I have some idea of how GEOM works from the manpage, it seems to say that the disk data flows through a set of geoms to/from the kernel/disks. Will the "ghost" mirror and slices provide extra steps, and therefore a performance slowdown, or am I totally off base with the way GEOM works? (Which is likely since I was only introduced to it last week). That is, is the way it is set up now on my box Ok? It works Ok, and I can reboot now with a COMPLETE array, but is it messed up internally? I haven't done any performance tests yet, so I don't know. Can anyone enlighten me on this? Here is the text of the original message. I'm leaving it here because it provides a lot of detail on my set up to back up my question above, although the problem I outlined below is SOLVED and my question is above. Thanks, DZ ****************************************************************************************** I've completely turned off swap for now, but I still swapoff="YES" in my /etc/rc.conf, and I've consistently used shutdown since I learned about the swap consequences. I'm running: FreeBSD localhost 5.3-RELEASE-p4 FreeBSD 5.3-RELEASE-p4 #6: Fri Jan 14 06:42:28 CST 2005 toor@localhost:/usr/obj/usr/src/sys/MYKERNEL i386 freshly CVSup'd on a Dell PowerEdge 2850 with this patch: http://lists.freebsd.org/pipermail/freebsd-geom/2004-October/000338.html with the delay set to 10 as the poster originally stated. I originally started with the approach #2, mirror-on-a-slice, but encountered problems because on bootup GEOM couldn't update the metadata on da0. So I went with Approach #1 in the article, and I no longer see the problem with writing metadata, but now it seems that it comes up DEGRADED because there is other information left over from the original setup. When I remove da1 from the mirror the old gm0s1 mirror starts up, although I've tried every way I can think of to get rid of it. When I remove the old mirror that is starting up, gm0s1, then kern.geom.conftx shows da1s1 MBR's and partitions. How do I get rid them? I've tried very many methods, even going back to scratch, removing gmirror and just booting of the /dev/da* devices, and doing it all over again. I've even tried zeroing each disk with dd and reconnecting them, but to no avail. I'm thinking that this is part of the problem preventing my mirror from coming up complete after a reboot. I've been through the freebsd-GEOM archives, but I honestly don't know what has been folded into what I'm running now, and what other patches to try, if that is even the problem. I've prepared a complete log of how it looks COMPLETE, and then after the reboot and rebuild. I've really wasted a good bit of time on this, I would appreciate any help, the final goal is to have a COMPLETE mirror through reboots. ***************************************************************************************** Here we go, Here after a rebuild, the mirror is complete and happy. ***************************************************************************************** gmirror list Geom name: gm0 State: COMPLETE Components: 2 Balance: round-robin Slice: 4096 Flags: NONE SyncID: 2 ID: 2505058140 Providers: 1. Name: mirror/gm0 Mediasize: 36420074496 (34G) Sectorsize: 512 Mode: r1w1e2 Consumers: 1. Name: da0 Mediasize: 36420075008 (34G) Sectorsize: 512 Mode: r1w1e3 State: ACTIVE Priority: 0 Flags: DIRTY SyncID: 2 ID: 4003588011 2. Name: da1 Mediasize: 36420075008 (34G) Sectorsize: 512 Mode: r1w1e3 State: ACTIVE Priority: 0 Flags: DIRTY SyncID: 2 ID: 3220781586 Geom name: gm0.sync ***************************************************************************************** ********** REBOOT Now we're logged in again, we see the mirror in DEGRADED mode, rebuilding, Here's a listing: ***************************************************************************************** root@localhost:/root# gmirror list Geom name: gm0 State: DEGRADED Components: 2 Balance: round-robin Slice: 4096 Flags: NONE SyncID: 3 ID: 2505058140 Providers: 1. Name: mirror/gm0 Mediasize: 36420074496 (34G) Sectorsize: 512 Mode: r2w1e2 Consumers: 1. Name: da0 Mediasize: 36420075008 (34G) Sectorsize: 512 Mode: r2w1e3 State: ACTIVE Priority: 0 Flags: DIRTY SyncID: 3 ID: 4003588011 2. Name: da1 Mediasize: 36420075008 (34G) Sectorsize: 512 Mode: r0w1e1 State: SYNCHRONIZING Priority: 0 Flags: DIRTY, SYNCHRONIZING SyncID: 3 Synchronized: 17% ID: 3220781586 Geom name: gm0.sync Consumers: 1. Name: mirror/gm0 Mediasize: 36420074496 (34G) Sectorsize: 512 Mode: r1w0e0 ***************************************************************************************** ************* ****** What kern.geom.conftx during the rebuild ******** ***************************************************************************************** # sysctl -b kern.geom.conftx 0 DISK da1 36420075008 512 hd 255 sc 63 1 MIRROR mirror/gm0 36420074496 512 2 MBR mirror/gm0s1 36413282304 512 i 0 o 32256 ty 165 3 BSD mirror/gm0s1c 36413282304 512 i 2 o 0 ty 0 3 BSD mirror/gm0s1b 1073733632 512 i 1 o 35339548672 ty 1 3 BSD mirror/gm0s1a 35339540480 512 i 0 o 8192 ty 7 0 DISK da0 36420075008 512 hd 255 sc 63 1 MIRROR mirror/gm0 36420074496 512 2 MBR mirror/gm0s1 36413282304 512 i 0 o 32256 ty 165 3 BSD mirror/gm0s1c 36413282304 512 i 2 o 0 ty 0 3 BSD mirror/gm0s1b 1073733632 512 i 1 o 35339548672 ty 1 3 BSD mirror/gm0s1a 35339540480 512 i 0 o 8192 ty 7 ***************************************************************************************** ******************* ******* And here's /var/log/messages from bootup, until this point ****************** ***************************************************************************************** Jan 17 06:43:55 localhost kernel: da0 at mpt0 bus 0 target 0 lun 0 Jan 17 06:43:55 localhost kernel: da0: Fixed Direct Access SCSI-3 device Jan 17 06:43:55 localhost kernel: da0: 320.000MB/s transfers (160.000MHz, offset 63, 16bit), Tagged Queueing Enabled Jan 17 06:43:55 localhost kernel: da0: 34732MB (71132959 512 byte sectors: 255H 63S/T 4427C) Jan 17 06:43:55 localhost kernel: da1 at mpt0 bus 0 target 1 lun 0 Jan 17 06:43:55 localhost kernel: da1: Fixed Direct Access SCSI-3 device Jan 17 06:43:55 localhost kernel: da1: 320.000MB/s transfers (160.000MHz, offset 63, 16bit), Tagged Queueing Enabled Jan 17 06:43:55 localhost kernel: da1: 34732MB (71132959 512 byte sectors: 255H 63S/T 4427C) Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Tasting da0. Jan 17 06:43:55 localhost kernel: magic: GEOM::MIRROR Jan 17 06:43:55 localhost kernel: version: 1 Jan 17 06:43:55 localhost kernel: name: gm0 Jan 17 06:43:55 localhost kernel: mid: 2505058140 Jan 17 06:43:55 localhost kernel: did: 4003588011 Jan 17 06:43:55 localhost kernel: all: 2 Jan 17 06:43:55 localhost kernel: syncid: 2 Jan 17 06:43:55 localhost kernel: priority: 0 Jan 17 06:43:55 localhost kernel: slice: 4096 Jan 17 06:43:55 localhost kernel: balance: round-robin Jan 17 06:43:55 localhost kernel: mediasize: 36420074496 Jan 17 06:43:55 localhost kernel: sectorsize: 512 Jan 17 06:43:55 localhost kernel: syncoffset: 0 Jan 17 06:43:55 localhost kernel: mflags: NONE Jan 17 06:43:55 localhost kernel: dflags: NONE Jan 17 06:43:55 localhost kernel: hcprovider: Jan 17 06:43:55 localhost kernel: MD5 hash: 05b629f9060ab32a0d273902be366a37 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[1]: Creating device gm0 (id=2505058140). Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[0]: Device gm0 created (id=2505058140). Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[1]: Adding disk da0 to gm0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Adding disk da0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Disk da0 connected. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[1]: Disk da0 state changed from NONE to NEW (device gm0). Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[0]: Device gm0: provider da0 detected. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Tasting da1. Jan 17 06:43:55 localhost kernel: magic: GEOM::MIRROR Jan 17 06:43:55 localhost kernel: version: 1 Jan 17 06:43:55 localhost kernel: name: gm0 Jan 17 06:43:55 localhost kernel: mid: 2505058140 Jan 17 06:43:55 localhost kernel: did: 3220781586 Jan 17 06:43:55 localhost kernel: all: 2 Jan 17 06:43:55 localhost kernel: syncid: 2 Jan 17 06:43:55 localhost kernel: priority: 0 Jan 17 06:43:55 localhost kernel: slice: 4096 Jan 17 06:43:55 localhost kernel: balance: round-robin Jan 17 06:43:55 localhost kernel: mediasize: 36420074496 Jan 17 06:43:55 localhost kernel: sectorsize: 512 Jan 17 06:43:55 localhost kernel: syncoffset: 0 Jan 17 06:43:55 localhost kernel: mflags: NONE Jan 17 06:43:55 localhost kernel: dflags: NONE Jan 17 06:43:55 localhost kernel: hcprovider: Jan 17 06:43:55 localhost kernel: MD5 hash: b4ab3313a1ead3ed591d0b3f4deed554 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[1]: Adding disk da1 to gm0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Adding disk da1. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Disk da1 connected. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[1]: Disk da1 state changed from NONE to NEW (device gm0). Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[0]: Device gm0: provider da1 detected. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[1]: Device gm0 state changed from STARTING to RUNNING. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[1]: Disk da1 state changed from NEW to ACTIVE (device gm0). Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r0w1e1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r0w-1e-1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Metadata on da1 updated. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[0]: Device gm0: provider da1 activated. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[1]: Disk da0 state changed from NEW to ACTIVE (device gm0). Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r0w1e1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Tasting da0s1. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Tasting da1s1. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r0w-1e-1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Metadata on da0 updated. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[0]: Device gm0: provider da0 activated. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[0]: Device gm0: provider mirror/gm0 launched. Jan 17 06:43:55 localhost kernel: magic: GEOM::MIRROR Jan 17 06:43:55 localhost kernel: version: 1 Jan 17 06:43:55 localhost kernel: name: gm0s1 Jan 17 06:43:55 localhost kernel: mid: 3061091415 Jan 17 06:43:55 localhost kernel: did: 3644757297 Jan 17 06:43:55 localhost kernel: all: 2 Jan 17 06:43:55 localhost kernel: syncid: 17 Jan 17 06:43:55 localhost kernel: priority: 0 Jan 17 06:43:55 localhost kernel: slice: 4096 Jan 17 06:43:55 localhost kernel: balance: round-robin Jan 17 06:43:55 localhost kernel: mediasize: 36413281792 Jan 17 06:43:55 localhost kernel: sectorsize: 512 Jan 17 06:43:55 localhost kernel: syncoffset: 0 Jan 17 06:43:55 localhost kernel: mflags: NONE Jan 17 06:43:55 localhost kernel: dflags: NONE Jan 17 06:43:55 localhost kernel: hcprovider: da1s1 Jan 17 06:43:55 localhost kernel: MD5 hash: a3fe1554ce5cb9364934713102300b18 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[1]: Creating device gm0s1 (id=3061091415). Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[0]: Device gm0s1 created (id=3061091415). Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[1]: Adding disk da1s1 to gm0s1. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Adding disk da1s1. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Disk da1s1 connected. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[1]: Disk da1s1 state changed from NONE to NEW (device gm0s1). Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[0]: Device gm0s1: provider da1s1 detected. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r1w0e1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r-1w0e-1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e-1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Tasting mirror/gm0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r1w0e1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r-1w0e-1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e-1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r1w0e1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r-1w0e-1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e-1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r1w0e1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r-1w0e-1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e-1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Tasting da1s1a. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Tasting da1s1b. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Tasting da1s1c. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e1. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r1w0e2 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e2 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e-1. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r-1w0e-2 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e-2 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Tasting mirror/gm0s1. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e1. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r1w0e2 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e2 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e-1. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r-1w0e-2 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e-2 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e1. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r1w0e2 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e2 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e-1. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r-1w0e-2 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e-2 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e1. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r1w0e2 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e2 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e-1. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r-1w0e-2 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e-2 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e1. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r1w0e2 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e2 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e-1. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r-1w0e-2 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e-2 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e-2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Tasting mirror/gm0s1a. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e-2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e-2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e-2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e-2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Tasting mirror/gm0s1b. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e-2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e-2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e-2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e-2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Tasting mirror/gm0s1c. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e-2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e-2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e-2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e-3 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[0]: Force device gm0s1 start due to timeout. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[1]: Device gm0s1 state changed from STARTING to RUNNING. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[1]: Disk da1s1 state changed from NEW to ACTIVE (device gm0s1). Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r0w1e1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[1]: Disk da1 state changed from ACTIVE to DISCONNECTED (device gm0). Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[0]: Device gm0: provider da1 disconnected. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Disk da1 disconnected. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Consumer da1 destroyed. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[1]: Device gm0: syncid bumped to 3. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r0w1e1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r0w-1e-1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Metadata on da1s1 updated. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[0]: Device gm0s1: provider da1s1 activated. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[0]: Device gm0s1: provider mirror/gm0s1 launched. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r0w-1e-1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Metadata on da0 updated. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Tasting da1. Jan 17 06:43:55 localhost kernel: magic: GEOM::MIRROR Jan 17 06:43:55 localhost kernel: version: 1 Jan 17 06:43:55 localhost kernel: name: gm0 Jan 17 06:43:55 localhost kernel: mid: 2505058140 Jan 17 06:43:55 localhost kernel: did: 3220781586 Jan 17 06:43:55 localhost kernel: all: 2 Jan 17 06:43:55 localhost kernel: syncid: 2 Jan 17 06:43:55 localhost kernel: priority: 0 Jan 17 06:43:55 localhost kernel: slice: 4096 Jan 17 06:43:55 localhost kernel: balance: round-robin Jan 17 06:43:55 localhost kernel: mediasize: 36420074496 Jan 17 06:43:55 localhost kernel: sectorsize: 512 Jan 17 06:43:55 localhost kernel: syncoffset: 0 Jan 17 06:43:55 localhost kernel: mflags: NONE Jan 17 06:43:55 localhost kernel: dflags: NONE Jan 17 06:43:55 localhost kernel: hcprovider: Jan 17 06:43:55 localhost kernel: MD5 hash: 7a64c716e9497f74a61b8dc8be0dad3f Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[1]: Adding disk da1 to gm0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Adding disk da1. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Disk da1 connected. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[1]: Disk da1 state changed from NONE to NEW (device gm0). Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[0]: Device gm0: provider da1 detected. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[1]: Disk da1 state changed from NEW to SYNCHRONIZING (device gm0). Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[0]: Device gm0: rebuilding provider da1. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1 r0w1e1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e1 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Metadata on da1 updated. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r1w0e0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r1w0e1 = 6 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Tasting mirror/gm0s1. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r1w0e0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r1w0e1 = 6 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r1w0e0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r1w0e1 = 6 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r1w0e0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r1w0e1 = 6 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[1]: Disk da1s1 state changed from ACTIVE to DISCONNECTED (device gm0s1). Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[0]: Device gm0s1: provider da1s1 disconnected. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Disk da1s1 disconnected. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Consumer da1s1 destroyed. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: No I/O requests for gm0s1, it can be destroyed. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[0]: Device gm0s1: provider mirror/gm0s1 destroyed. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[0]: Device gm0s1 destroyed. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Tasting da0s1. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Tasting da0s1a. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Tasting da0s1b. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Tasting da0s1c. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w1e2. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w1e2 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[1]: Disk da0 (device gm0) marked as dirty. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Metadata on da0 updated. Jan 17 06:43:55 localhost kernel: Mounted root from ufs:/dev/mirror/gm0s1a. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Metadata on da1 updated. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e0 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e0 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e0 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r0w1e0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r0w1e0 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e0 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r0w-1e0. Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Access da0 r0w-1e0 = 0 Jan 17 06:43:55 localhost kernel: GEOM_MIRROR[2]: Metadata on da1 updated. Jan 17 06:45:09 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e0. Jan 17 06:45:09 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e0 = 0 Jan 17 06:45:09 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e0. Jan 17 06:45:09 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e0 = 0 Jan 17 06:45:10 localhost kernel: GEOM_MIRROR[2]: Metadata on da1 updated. Jan 17 06:53:07 localhost last message repeated 26 times ***************************************************************************************** ******************** ***** Now I disconnect da1 from gm0 I originally did this because I wanted to just zero /dev/da1 with dd and start over (or so I thought). But when I ran a list, I was surprised to see gm0s1 starting up: ************************ ***************************************************************************************** root@localhost:/root# gmirror deactivate gm0 da1 root@localhost:/root# gmirror list Geom name: gm0 State: DEGRADED Components: 2 Balance: round-robin Slice: 4096 Flags: NONE SyncID: 4 ID: 2505058140 Providers: 1. Name: mirror/gm0 Mediasize: 36420074496 (34G) Sectorsize: 512 Mode: r1w1e2 Consumers: 1. Name: da0 Mediasize: 36420075008 (34G) Sectorsize: 512 Mode: r1w1e3 State: ACTIVE Priority: 0 Flags: DIRTY SyncID: 4 ID: 4003588011 Geom name: gm0.sync Geom name: gm0s1 State: DEGRADED Components: 2 Balance: round-robin Slice: 4096 Flags: NONE SyncID: 17 ID: 3061091415 Providers: 1. Name: mirror/gm0s1 Mediasize: 36413281792 (34G) Sectorsize: 512 Mode: r0w0e0 Consumers: 1. Name: da1s1 Mediasize: 36413282304 (34G) Sectorsize: 512 Mode: r0w0e0 State: ACTIVE Priority: 0 Flags: HARDCODED SyncID: 17 ID: 3644757297 Geom name: gm0s1.sync ***************************************************************************************** ********************************** **** Now kern.geom.conftx looked like this ***************************************************************************************** ************************* # sysctl -b kern.geom.conftx 0 DISK da1 36420075008 512 hd 255 sc 63 1 MBR da1s1 36413282304 512 i 0 o 32256 ty 165 2 BSD da1s1c 36413282304 512 i 2 o 0 ty 0 2 BSD da1s1b 1073733632 512 i 1 o 35339548672 ty 1 2 BSD da1s1a 35339540480 512 i 0 o 8192 ty 7 2 MIRROR mirror/gm0s1 36413281792 512 3 BSD mirror/gm0s1c 36413282304 512 i 2 o 0 ty 0 3 BSD mirror/gm0s1b 1073733632 512 i 1 o 35339548672 ty 1 3 BSD mirror/gm0s1a 35339540480 512 i 0 o 8192 ty 7 0 DISK da0 36420075008 512 hd 255 sc 63 1 MIRROR mirror/gm0 36420074496 512 2 MBR mirror/gm0s1 36413282304 512 i 0 o 32256 ty 165 3 BSD mirror/gm0s1c 36413282304 512 i 2 o 0 ty 0 3 BSD mirror/gm0s1b 1073733632 512 i 1 o 35339548672 ty 1 3 BSD mirror/gm0s1a 35339540480 512 i 0 o 8192 ty 7 ***************************************************************************************** *********************************** **** /var/log/messages for this event: ********************************** ***************************************************************************************** Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[1]: Disk da1 state changed from SYNCHRONIZING to DISCONNECTED (device gm0). Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[0]: Device gm0: provider da1 disconnected. Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[0]: Device gm0: rebuilding provider da1 stopped. Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r-1w0e0. Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[2]: Access da0 r-1w0e0 = 0 Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[2]: Consumer mirror/gm0 destroyed. Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[2]: Access da1 r0w-1e-1 = 0 Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[2]: Disk da1 disconnected. Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[2]: I/O requests for da1 in queue, can't destroy it now. Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[2]: Consumer da1 destroyed. Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[2]: Tasting da1. Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[0]: Device gm0: provider da1 marked as inactive, skipping. Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[2]: Tasting da1s1. Jan 17 06:53:07 localhost kernel: magic: GEOM::MIRROR Jan 17 06:53:07 localhost kernel: version: 1 Jan 17 06:53:07 localhost kernel: name: gm0s1 Jan 17 06:53:07 localhost kernel: mid: 3061091415 Jan 17 06:53:07 localhost kernel: did: 3644757297 Jan 17 06:53:07 localhost kernel: all: 2 Jan 17 06:53:07 localhost kernel: syncid: 17 Jan 17 06:53:07 localhost kernel: priority: 0 Jan 17 06:53:07 localhost kernel: slice: 4096 Jan 17 06:53:07 localhost kernel: balance: round-robin Jan 17 06:53:07 localhost kernel: mediasize: 36413281792 Jan 17 06:53:07 localhost kernel: sectorsize: 512 Jan 17 06:53:07 localhost kernel: syncoffset: 0 Jan 17 06:53:07 localhost kernel: mflags: NONE Jan 17 06:53:07 localhost kernel: dflags: NONE Jan 17 06:53:07 localhost kernel: hcprovider: da1s1 Jan 17 06:53:07 localhost kernel: MD5 hash: 67a736074371d7996a699af47c6fb79c Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[1]: Creating device gm0s1 (id=3061091415). Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[0]: Device gm0s1 created (id=3061091415). Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[1]: Adding disk da1s1 to gm0s1. Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[2]: Adding disk da1s1. Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[2]: Disk da1s1 connected. Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[1]: Disk da1s1 state changed from NONE to NEW (device gm0s1). Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[0]: Device gm0s1: provider da1s1 detected. Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[2]: Tasting da1s1a. Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[1]: Device gm0: syncid bumped to 4. Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[2]: Metadata on da0 updated. Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[2]: Tasting da1s1b. Jan 17 06:53:07 localhost kernel: GEOM_MIRROR[2]: Tasting da1s1c. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[0]: Force device gm0s1 start due to timeout. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[1]: Device gm0s1 state changed from STARTING to RUNNING. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[1]: Disk da1s1 state changed from NEW to ACTIVE (device gm0s1). Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r0w1e1 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r0w-1e-1 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Metadata on da1s1 updated. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[0]: Device gm0s1: provider da1s1 activated. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[0]: Device gm0s1: provider mirror/gm0s1 launched. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Tasting da1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[0]: Device gm0: provider da1 marked as inactive, skipping. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r1w0e0. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r1w0e1 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r-1w0e0. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r-1w0e-1 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Tasting mirror/gm0s1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r1w0e0. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r1w0e1 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r-1w0e0. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r-1w0e-1 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r1w0e0. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r1w0e1 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r-1w0e0. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r-1w0e-1 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r1w0e0. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r1w0e1 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r-1w0e0. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r-1w0e-1 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Tasting da1s1a. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Tasting da1s1b. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Tasting da1s1c. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r1w0e1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r1w0e2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r-1w0e-1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r-1w0e-2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Tasting mirror/gm0s1a. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r1w0e1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r1w0e2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r-1w0e-1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r-1w0e-2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r1w0e1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r1w0e2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r-1w0e-1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r-1w0e-2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r1w0e1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r1w0e2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r-1w0e-1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r-1w0e-2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r1w0e1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r1w0e2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r-1w0e-1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r-1w0e-2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Tasting mirror/gm0s1b. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r1w0e1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r1w0e2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r-1w0e-1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r-1w0e-2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r1w0e1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r1w0e2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r-1w0e-1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r-1w0e-2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r1w0e1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r1w0e2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r-1w0e-1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r-1w0e-2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r1w0e1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r1w0e2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r-1w0e-1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r-1w0e-2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Tasting mirror/gm0s1c. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r1w0e1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r1w0e2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r-1w0e-1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r-1w0e-2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r1w0e1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r1w0e2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r-1w0e-1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r-1w0e-2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r1w0e1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r1w0e2 = 0 Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0s1: r-1w0e-1. Jan 17 06:53:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r-1w0e-2 = 0 ***************************************************************************************** ************************* ********* forgetting on gm0s1 so I can remove it ************************** ***************************************************************************************** root@localhost:/root# gmirror forget gm0s1 root@localhost:/root# gmirror list Geom name: gm0 State: DEGRADED Components: 2 Balance: round-robin Slice: 4096 Flags: NONE SyncID: 4 ID: 2505058140 Providers: 1. Name: mirror/gm0 Mediasize: 36420074496 (34G) Sectorsize: 512 Mode: r1w1e2 Consumers: 1. Name: da0 Mediasize: 36420075008 (34G) Sectorsize: 512 Mode: r1w1e3 State: ACTIVE Priority: 0 Flags: DIRTY SyncID: 4 ID: 4003588011 Geom name: gm0.sync Geom name: gm0s1 State: COMPLETE Components: 1 Balance: round-robin Slice: 4096 Flags: NONE SyncID: 17 ID: 3061091415 Providers: 1. Name: mirror/gm0s1 Mediasize: 36413281792 (34G) Sectorsize: 512 Mode: r0w0e0 Consumers: 1. Name: da1s1 Mediasize: 36413282304 (34G) Sectorsize: 512 Mode: r0w0e0 State: ACTIVE Priority: 0 Flags: HARDCODED SyncID: 17 ID: 3644757297 Geom name: gm0s1.sync ***************************************************************************************** *********************** ********** So, now I want to remove gm0s1, but I can't because it always ********** comes back, I need to manually destroy it each time and then add da1 to gm0 ***************************************************************************************** ************************** root@localhost:/root# gmirror remove gm0s1 da1s1 ************************* 0 DISK da1 36420075008 512 hd 255 sc 63 1 MBR da1s1 36413282304 512 i 0 o 32256 ty 165 2 MIRROR mirror/gm0s1 36413281792 512 3 BSD mirror/gm0s1c 36413282304 512 i 2 o 0 ty 0 3 BSD mirror/gm0s1b 1073733632 512 i 1 o 35339548672 ty 1 3 BSD mirror/gm0s1a 35339540480 512 i 0 o 8192 ty 7 0 DISK da0 36420075008 512 hd 255 sc 63 1 MIRROR mirror/gm0 36420074496 512 2 MBR mirror/gm0s1 36413282304 512 i 0 o 32256 ty 165 3 BSD mirror/gm0s1c 36413282304 512 i 2 o 0 ty 0 3 BSD mirror/gm0s1b 1073733632 512 i 1 o 35339548672 ty 1 3 BSD mirror/gm0s1a 35339540480 512 i 0 o 8192 ty 7 ***************************************************************************************** ********************** ********** Removing da1s1 from gm0s1 reveals the da1s1 MBR and the partitions ********** on da1 Huh? ************************* ***************************************************************************************** root@localhost:/root# gmirror remove gm0s1 da1s1 root@localhost:/root# gmirror list Geom name: gm0 State: DEGRADED Components: 2 Balance: round-robin Slice: 4096 Flags: NONE SyncID: 4 ID: 2505058140 Providers: 1. Name: mirror/gm0 Mediasize: 36420074496 (34G) Sectorsize: 512 Mode: r1w1e2 Consumers: 1. Name: da0 Mediasize: 36420075008 (34G) Sectorsize: 512 Mode: r1w1e3 State: ACTIVE Priority: 0 Flags: DIRTY SyncID: 4 ID: 4003588011 Geom name: gm0.sync 0 DISK da1 36420075008 512 hd 255 sc 63 1 MBR da1s1 36413282304 512 i 0 o 32256 ty 165 2 BSD da1s1c 36413282304 512 i 2 o 0 ty 0 2 BSD da1s1b 1073733632 512 i 1 o 35339548672 ty 1 2 BSD da1s1a 35339540480 512 i 0 o 8192 ty 7 0 DISK da0 36420075008 512 hd 255 sc 63 1 MIRROR mirror/gm0 36420074496 512 2 MBR mirror/gm0s1 36413282304 512 i 0 o 32256 ty 165 3 BSD mirror/gm0s1c 36413282304 512 i 2 o 0 ty 0 3 BSD mirror/gm0s1b 1073733632 512 i 1 o 35339548672 ty 1 3 BSD mirror/gm0s1a 35339540480 512 i 0 o 8192 ty 7 ***************************************************************************************** So I forget on gm0 so I can work on it, insert da1 and I'm back in business, kern.geom.conftx looks ok now? ***************************************************************************************** root@localhost:/root# gmirror list Geom name: gm0 State: COMPLETE Components: 1 Balance: round-robin Slice: 4096 Flags: NONE SyncID: 4 ID: 2505058140 Providers: 1. Name: mirror/gm0 Mediasize: 36420074496 (34G) Sectorsize: 512 Mode: r1w1e2 Consumers: 1. Name: da0 Mediasize: 36420075008 (34G) Sectorsize: 512 Mode: r1w1e3 State: ACTIVE Priority: 0 Flags: DIRTY SyncID: 4 ID: 4003588011 Geom name: gm0.sync root@localhost:/root# gmirror insert gm0 da1 root@localhost:/root# gmirror list Geom name: gm0 State: DEGRADED Components: 2 Balance: round-robin Slice: 4096 Flags: NONE SyncID: 4 ID: 2505058140 Providers: 1. Name: mirror/gm0 Mediasize: 36420074496 (34G) Sectorsize: 512 Mode: r2w1e2 Consumers: 1. Name: da0 Mediasize: 36420075008 (34G) Sectorsize: 512 Mode: r2w1e3 State: ACTIVE Priority: 0 Flags: DIRTY SyncID: 4 ID: 4003588011 2. Name: da1 Mediasize: 36420075008 (34G) Sectorsize: 512 Mode: r0w1e1 State: SYNCHRONIZING Priority: 0 Flags: DIRTY, SYNCHRONIZING SyncID: 4 Synchronized: 0% ID: 3782877908 Geom name: gm0.sync Consumers: 1. Name: mirror/gm0 Mediasize: 36420074496 (34G) Sectorsize: 512 Mode: r1w0e0 0 DISK da1 36420075008 512 hd 255 sc 63 1 MIRROR mirror/gm0 36420074496 512 2 MBR mirror/gm0s1 36413282304 512 i 0 o 32256 ty 165 3 BSD mirror/gm0s1c 36413282304 512 i 2 o 0 ty 0 3 BSD mirror/gm0s1b 1073733632 512 i 1 o 35339548672 ty 1 3 BSD mirror/gm0s1a 35339540480 512 i 0 o 8192 ty 7 0 DISK da0 36420075008 512 hd 255 sc 63 1 MIRROR mirror/gm0 36420074496 512 2 MBR mirror/gm0s1 36413282304 512 i 0 o 32256 ty 165 3 BSD mirror/gm0s1c 36413282304 512 i 2 o 0 ty 0 3 BSD mirror/gm0s1b 1073733632 512 i 1 o 35339548672 ty 1 3 BSD mirror/gm0s1a 35339540480 512 i 0 o 8192 ty 7 ***************************************************************************************** And the rest of the log entries for all of this; ***************************************************************************************** Jan 17 06:54:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r0w1e1 = 0 Jan 17 06:54:11 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r0w-1e-1 = 0 Jan 17 06:54:11 localhost kernel: GEOM_MIRROR[2]: Metadata on da1s1 updated. Jan 17 06:54:11 localhost kernel: GEOM_MIRROR[2]: Tasting da1. Jan 17 06:54:11 localhost kernel: GEOM_MIRROR[0]: Device gm0: provider da1 marked as inactive, skipping. Jan 17 06:55:18 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r0w1e1 = 0 Jan 17 06:55:18 localhost kernel: GEOM_MIRROR[2]: Access da1s1 r0w-1e-1 = 0 Jan 17 06:55:18 localhost kernel: GEOM_MIRROR[2]: Metadata on da1s1 cleared. Jan 17 06:55:18 localhost kernel: GEOM_MIRROR[1]: Disk da1s1 state changed from ACTIVE to DESTROY (device gm0s1). Jan 17 06:55:18 localhost kernel: GEOM_MIRROR[0]: Device gm0s1: provider da1s1 destroyed. Jan 17 06:55:18 localhost kernel: GEOM_MIRROR[2]: Disk da1s1 disconnected. Jan 17 06:55:18 localhost kernel: GEOM_MIRROR[2]: Consumer da1s1 destroyed. Jan 17 06:55:18 localhost kernel: GEOM_MIRROR[2]: No I/O requests for gm0s1, it can be destroyed. Jan 17 06:55:18 localhost kernel: GEOM_MIRROR[0]: Device gm0s1: provider mirror/gm0s1 destroyed. Jan 17 06:55:18 localhost kernel: GEOM_MIRROR[0]: Device gm0s1 destroyed. Jan 17 06:55:18 localhost kernel: GEOM_MIRROR[2]: Tasting da1. Jan 17 06:55:18 localhost kernel: GEOM_MIRROR[0]: Device gm0: provider da1 marked as inactive, skipping. Jan 17 06:55:18 localhost kernel: GEOM_MIRROR[2]: Tasting da1s1. Jan 17 06:55:18 localhost kernel: GEOM_MIRROR[2]: Tasting da1s1a. Jan 17 06:55:19 localhost kernel: GEOM_MIRROR[2]: Tasting da1s1b. Jan 17 06:55:19 localhost kernel: GEOM_MIRROR[2]: Tasting da1s1c. Jan 17 06:56:05 localhost kernel: GEOM_MIRROR[2]: Metadata on da0 updated. Jan 17 06:56:22 localhost kernel: GEOM_MIRROR[2]: Metadata on da0 updated. Jan 17 06:56:22 localhost kernel: GEOM_MIRROR[2]: Tasting da1. Jan 17 06:56:22 localhost kernel: magic: GEOM::MIRROR Jan 17 06:56:22 localhost kernel: version: 1 Jan 17 06:56:22 localhost kernel: name: gm0 Jan 17 06:56:22 localhost kernel: mid: 2505058140 Jan 17 06:56:22 localhost kernel: did: 3782877908 Jan 17 06:56:22 localhost kernel: all: 2 Jan 17 06:56:22 localhost kernel: syncid: 0 Jan 17 06:56:22 localhost kernel: priority: 0 Jan 17 06:56:22 localhost kernel: slice: 4096 Jan 17 06:56:22 localhost kernel: balance: round-robin Jan 17 06:56:22 localhost kernel: mediasize: 36420074496 Jan 17 06:56:22 localhost kernel: sectorsize: 512 Jan 17 06:56:22 localhost kernel: syncoffset: 0 Jan 17 06:56:22 localhost kernel: mflags: NONE Jan 17 06:56:22 localhost kernel: dflags: NONE Jan 17 06:56:22 localhost kernel: hcprovider: Jan 17 06:56:22 localhost kernel: MD5 hash: c8505c5e0fcf859952eaab3439f1b7a5 Jan 17 06:56:22 localhost kernel: GEOM_MIRROR[1]: Adding disk da1 to gm0. Jan 17 06:56:22 localhost kernel: GEOM_MIRROR[2]: Adding disk da1. Jan 17 06:56:22 localhost kernel: GEOM_MIRROR[2]: Disk da1 connected. Jan 17 06:56:22 localhost kernel: GEOM_MIRROR[1]: Disk da1 state changed from NONE to NEW (device gm0). Jan 17 06:56:22 localhost kernel: GEOM_MIRROR[0]: Device gm0: provider da1 detected. Jan 17 06:56:22 localhost kernel: GEOM_MIRROR[1]: Disk da1 state changed from NEW to SYNCHRONIZING (device gm0). Jan 17 06:56:22 localhost kernel: GEOM_MIRROR[0]: Device gm0: rebuilding provider da1. Jan 17 06:56:22 localhost kernel: GEOM_MIRROR[2]: Access da1 r0w1e1 = 0 Jan 17 06:56:22 localhost kernel: GEOM_MIRROR[2]: Access request for mirror/gm0: r1w0e0. Jan 17 06:56:22 localhost kernel: GEOM_MIRROR[2]: Access da0 r1w0e0 = 0 Jan 17 06:56:22 localhost kernel: GEOM_MIRROR[2]: Metadata on da1 updated. Jan 17 06:56:51 localhost last message repeated 28 times Jan 17 06:56:51 localhost ntpd[452]: kernel time sync enabled 2001 Jan 17 06:56:52 localhost kernel: GEOM_MIRROR[2]: Metadata on da1 updated. Jan 17 06:57:23 localhost last message repeated 30 times ***************************************************************************************** Just in case, here is the contents of /dev, filtered for da*: ***************************************************************************************** crw-r----- 1 root operator 4, 12 Jan 17 06:43 /dev/da0 crw-r----- 1 root operator 4, 13 Jan 17 06:43 /dev/da1 I've been banging my head on this one for awhile. Any help would be appreciated. Thanks, DZ --------------090300070707010306090601-- From owner-freebsd-geom@FreeBSD.ORG Mon Jan 17 15:38:33 2005 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 5555016A4CE for ; Mon, 17 Jan 2005 15:38:33 +0000 (GMT) Received: from ms-smtp-01-eri0.texas.rr.com (ms-smtp-01.texas.rr.com [24.93.47.40]) by mx1.FreeBSD.org (Postfix) with ESMTP id EC55443D46 for ; Mon, 17 Jan 2005 15:38:32 +0000 (GMT) (envelope-from freebsd@zepeda.ws) Received: from [10.255.255.1] (cs662573-29.satx.rr.com [66.25.73.29]) j0HFcTYm023661 for ; Mon, 17 Jan 2005 09:38:30 -0600 (CST) Message-ID: <41EBDBF5.5030609@zepeda.ws> Date: Mon, 17 Jan 2005 09:38:29 -0600 From: "Daniel P. Zepeda" User-Agent: Mozilla Thunderbird 0.9 (X11/20041127) X-Accept-Language: en-us, en MIME-Version: 1.0 To: freebsd-geom@freebsd.org References: <41EBCFAF.2010309@zepeda.ws> In-Reply-To: <41EBCFAF.2010309@zepeda.ws> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: Symantec AntiVirus Scan Engine Subject: Re: configuration/performance question X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Jan 2005 15:38:33 -0000 Daniel P. Zepeda wrote: > Hello, > > My original problem was that I was having the problem where my mirror > comes > up DEGRADED when I reboot the machine. Now, I wrote up this long post to > describe the situation and appeal for help from those folks more > intimate with > all this than I, and, on going to subscribe to the list to post this, > I found > the solution on digging further in the archive. I've left the whole thing > intact here, but I found the solution to my problem here; > > http://lists.freebsd.org/pipermail/freebsd-geom/2004-September/000259.html > > > But what I uncovered while having my problem is that if I shut down one > consumer, the newer one I configured that I wanted to work, namely da1 > on gm0, > that an older mirror that I first configured, namely gm0s1, starts up, > with > consumers that I originally set up as da1s1* !! > > My question now is, I have some idea of how GEOM works from the > manpage, it > seems to say that the disk data flows through a set of geoms to/from the > kernel/disks. Will the "ghost" mirror and slices provide extra steps, and > therefore a performance slowdown, or am I totally off base with the > way GEOM > works? (Which is likely since I was only introduced to it last week). > That is, > is the way it is set up now on my box Ok? It works Ok, and I can > reboot now > with a COMPLETE array, but is it messed up internally? I haven't done any > performance tests yet, so I don't know. > > Can anyone enlighten me on this? > > Here is the text of the original message. I'm leaving it here because it > provides a lot of detail on my set up to back up my question above, > although > the problem I outlined below is SOLVED and my question is above. > > Thanks, > DZ > > ****************************************************************************************** > > > Oh dear, after all that I forgot to mention that the "approaches" I mentioned are detailed here; http://people.freebsd.org/~rse/mirror/ AND turn off HTML email for this account. Sorry. From owner-freebsd-geom@FreeBSD.ORG Mon Jan 17 16:17:04 2005 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id B7D2C16A4EA for ; Mon, 17 Jan 2005 16:17:04 +0000 (GMT) Received: from freenix.no (atreides.freenix.no [212.33.142.6]) by mx1.FreeBSD.org (Postfix) with ESMTP id 70CB743D46 for ; Mon, 17 Jan 2005 16:17:03 +0000 (GMT) (envelope-from shamz@atreides.freenix.no) Received: from atreides.freenix.no (localhost [127.0.0.1]) by freenix.no (8.12.11/8.12.11) with ESMTP id j0HGGvrW073770; Mon, 17 Jan 2005 17:17:01 +0100 (CET) (envelope-from shamz@atreides.freenix.no) Received: (from shamz@localhost) by atreides.freenix.no (8.12.11/8.12.11/Submit) id j0HGGlp4073767; Mon, 17 Jan 2005 17:16:47 +0100 (CET) (envelope-from shamz) Date: Mon, 17 Jan 2005 17:16:47 +0100 From: Shaun Jurrens To: Brooks Davis Message-ID: <20050117161647.GD75478@atreides.freenix.no> References: <20050111110012.GB75478@atreides.freenix.no> <20050111161324.GA8528@odin.ac.hmc.edu> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20050111161324.GA8528@odin.ac.hmc.edu> User-Agent: Mutt/1.4.2.1i X-Operating-System: FreeBSD 4.10-RELEASE-p2 X-Philosophy: If you can read this, you're too close. X-Virus-Scanned: ClamAV 0.80/571/Wed Nov 3 01:15:45 2004 clamav-milter version 0.80j on atreides.freenix.no X-Virus-Status: Clean cc: freebsd-geom@freebsd.org Subject: Re: partitioning and labeling geom devices X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Jan 2005 16:17:05 -0000 On Tue, Jan 11, 2005 at 08:13:24AM -0800, Brooks Davis wrote: #> On Tue, Jan 11, 2005 at 12:00:12PM +0100, Shaun Jurrens wrote: #> > Now I have /dev/stripe/stripe0 and i want to subdivide this into two slices #> > (aka. DOS partitions) and then partition the slices into various FreeBSD #> > partitions, (so the a-h thingies, for those catching up). This is sort of #> > where the concept goes to hell. #> > [....] #> #> > Do you want to change our idea of what BIOS thinks ? #> > #> > (I have no clue what to answer here, so 'no' is the answer because I #> > couldn't tell you the acceptable values for this if you beat me senseless) #> #> You probalby need to answer yes yere. You don't care what the BIOS #> might think, you care what freebsd thinks. If I answer yes, it requires that I supply the parameters myself. I already wrote that I do not know what acceptable parameters would be. #> #> > Strangely enough the values from previous fdisk runs are still there when I #> > continue... I've 'cleared' the plexes and stripes twice now... And if the #> > partition/slice confusion isn't complete enough, fdisk tells you about #> > partitions when the rest of your life in FreeBSD, you'll call them #> > 'slices'... #> > [...] #> > #> > with a date from a week ago! Really, the box is sync'd with ntpd... There's #> > probably an explanation somewhere. #> #> Times in /dev are irrelevent, ignore them. I suspect the problem is #> that you have an entierly bogus MBR partion table on the disk and #> now you've modified it, possiably exposing a bogus bsdlabel. Before #> attempting to label a disk, it's generally best to do something like: #> #> dd if=/dev/zero of=/dev/ count=64 #> #> That way you've nuked the MBR partition table and any bsdlabel labels in #> the first slice. #> #> You might take a look at the sysutils/diskprep port. It's a config file #> driven disk labeler. I gave diskprep a go... I still have not gotten the desired result... paracles:/root#> diskprep -config diskprep.array.cf stripe/stripe0 ===> Initalizing slices ------> Hog slice is 2. ******* Working on device /dev/stripe/stripe0 ******* fdisk: WARNING: adjusting size of partition 1 from 10485760 to 10474317 to end on a cylinder boundary fdisk: WARNING: adjusting start offset of partition 2 from 10485823 to 10485846, to fall on a head boundary fdisk: WARNING: adjusting size of partition 2 from 42576872 to 42576849 to end on a cylinder boundary ===> Getting adjusting sizes ------> slice 1 is 10474317 sectors ------> slice 2 is 42576849 sectors ===> initializing slice 1 ------> Hog partition is 'a' Argument "*" isn't numeric in subtraction (-) at /usr/local/sbin/diskprep line 232. disklabel: /dev/stripe/stripe0s1: No such file or directory ===> initializing slice 2 ------> Hog partition is 'c' disklabel: /dev/stripe/stripe0s2: No such file or directory newfs: /dev/stripe/stripe0s1a: could not find special device newfs: /dev/stripe/stripe0s1d: could not find special device newfs: /dev/stripe/stripe0s1e: could not find special device The config file is simple enough: $slices{1}{type} = $fbsd_type; $slices{1}{size} = 5120*1024*2; $slices{1}{'d'}{size} = 768*1024*2; $slices{1}{'d'}{type} = "4.2BSD"; $slices{1}{'e'}{size} = "*"; $slices{1}{'e'}{type} = "4.2BSD"; #$hog_slice = 2; $slices{2}{size} = "*"; $slices{2}{type} = $fbsd_type; $slices{2}{'c'}{type} = "4.2BSD"; $slices{2}{'c'}{size} = "*"; So I could still use some suggestions... I'm not getting any wiser here. I have no "slice" devices or partitions. Is this devd's fault or geom's ? #> #> -- Brooks #> #> -- #> Any statement of the form "X is the one, true Y" is FALSE. #> PGP fingerprint 655D 519C 26A7 82E7 2529 9BF0 5D8E 8BE9 F238 1AD4 -- Yours truly, Shaun D. Jurrens shaun@shamz.net shamz@freenix.no Blomsterkroken 44B 1344 Haslum Norway Tel. Mobil: +47 9268 0049 From owner-freebsd-geom@FreeBSD.ORG Mon Jan 17 18:38:18 2005 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id E289D16A4CE for ; Mon, 17 Jan 2005 18:38:18 +0000 (GMT) Received: from odin.ac.hmc.edu (Odin.AC.HMC.Edu [134.173.32.75]) by mx1.FreeBSD.org (Postfix) with ESMTP id 9EDC043D3F for ; Mon, 17 Jan 2005 18:38:18 +0000 (GMT) (envelope-from brdavis@odin.ac.hmc.edu) Received: from odin.ac.hmc.edu (localhost.localdomain [127.0.0.1]) by odin.ac.hmc.edu (8.13.0/8.13.0) with ESMTP id j0HIgDAx018451; Mon, 17 Jan 2005 10:42:13 -0800 Received: (from brdavis@localhost) by odin.ac.hmc.edu (8.13.0/8.13.0/Submit) id j0HIgCns018420; Mon, 17 Jan 2005 10:42:12 -0800 Date: Mon, 17 Jan 2005 10:42:12 -0800 From: Brooks Davis To: Shaun Jurrens Message-ID: <20050117184212.GB7538@odin.ac.hmc.edu> References: <20050111110012.GB75478@atreides.freenix.no> <20050111161324.GA8528@odin.ac.hmc.edu> <20050117161647.GD75478@atreides.freenix.no> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="Fba/0zbH8Xs+Fj9o" Content-Disposition: inline In-Reply-To: <20050117161647.GD75478@atreides.freenix.no> User-Agent: Mutt/1.4.1i X-Virus-Scanned: by amavisd-new X-Spam-Status: No, hits=0.0 required=8.0 tests=none autolearn=no version=2.63 X-Spam-Checker-Version: SpamAssassin 2.63 (2004-01-11) on odin.ac.hmc.edu cc: Brooks Davis cc: freebsd-geom@freebsd.org Subject: Re: partitioning and labeling geom devices X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Jan 2005 18:38:19 -0000 --Fba/0zbH8Xs+Fj9o Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Jan 17, 2005 at 05:16:47PM +0100, Shaun Jurrens wrote: > On Tue, Jan 11, 2005 at 08:13:24AM -0800, Brooks Davis wrote: > #> On Tue, Jan 11, 2005 at 12:00:12PM +0100, Shaun Jurrens wrote: > #> > Now I have /dev/stripe/stripe0 and i want to subdivide this into two= slices > #> > (aka. DOS partitions) and then partition the slices into various Fre= eBSD > #> > partitions, (so the a-h thingies, for those catching up). This is s= ort of > #> > where the concept goes to hell. > #> >=20 > [....] > #>=20 > #> > Do you want to change our idea of what BIOS thinks ? > #> >=20 > #> > (I have no clue what to answer here, so 'no' is the answer because I > #> > couldn't tell you the acceptable values for this if you beat me sens= eless) > #>=20 > #> You probalby need to answer yes yere. You don't care what the BIOS > #> might think, you care what freebsd thinks. >=20 > If I answer yes, it requires that I supply the parameters myself. I > already wrote that I do not know what acceptable parameters would be. > #>=20 > #> > Strangely enough the values from previous fdisk runs are still there= when I > #> > continue... I've 'cleared' the plexes and stripes twice now... And i= f the > #> > partition/slice confusion isn't complete enough, fdisk tells you abo= ut > #> > partitions when the rest of your life in FreeBSD, you'll call them > #> > 'slices'... > #> >=20 > [...] > #> >=20 > #> > with a date from a week ago! Really, the box is sync'd with ntpd... = There's > #> > probably an explanation somewhere. > #>=20 > #> Times in /dev are irrelevent, ignore them. I suspect the problem is > #> that you have an entierly bogus MBR partion table on the disk and > #> now you've modified it, possiably exposing a bogus bsdlabel. Before > #> attempting to label a disk, it's generally best to do something like: > #>=20 > #> dd if=3D/dev/zero of=3D/dev/ count=3D64 > #>=20 > #> That way you've nuked the MBR partition table and any bsdlabel labels = in > #> the first slice. > #>=20 > #> You might take a look at the sysutils/diskprep port. It's a config fi= le > #> driven disk labeler. >=20 > I gave diskprep a go... I still have not gotten the desired result... >=20 > paracles:/root#> diskprep -config diskprep.array.cf stripe/stripe0 > =3D=3D=3D> Initalizing slices > ------> Hog slice is 2. > ******* Working on device /dev/stripe/stripe0 ******* > fdisk: WARNING: adjusting size of partition 1 from 10485760 to 10474317 > to end on a cylinder boundary > fdisk: WARNING: adjusting start offset of partition 2 > from 10485823 to 10485846, to fall on a head boundary > fdisk: WARNING: adjusting size of partition 2 from 42576872 to 42576849 > to end on a cylinder boundary > =3D=3D=3D> Getting adjusting sizes > ------> slice 1 is 10474317 sectors > ------> slice 2 is 42576849 sectors > =3D=3D=3D> initializing slice 1 > ------> Hog partition is 'a' > Argument "*" isn't numeric in subtraction (-) at /usr/local/sbin/diskprep > line 232. > disklabel: /dev/stripe/stripe0s1: No such file or directory > =3D=3D=3D> initializing slice 2 > ------> Hog partition is 'c' > disklabel: /dev/stripe/stripe0s2: No such file or directory > newfs: /dev/stripe/stripe0s1a: could not find special device > newfs: /dev/stripe/stripe0s1d: could not find special device > newfs: /dev/stripe/stripe0s1e: could not find special device >=20 >=20 > The config file is simple enough: >=20 > $slices{1}{type} =3D $fbsd_type; > $slices{1}{size} =3D 5120*1024*2; > $slices{1}{'d'}{size} =3D 768*1024*2; > $slices{1}{'d'}{type} =3D "4.2BSD"; > $slices{1}{'e'}{size} =3D "*"; > $slices{1}{'e'}{type} =3D "4.2BSD"; >=20 > #$hog_slice =3D 2; > $slices{2}{size} =3D "*"; > $slices{2}{type} =3D $fbsd_type; > $slices{2}{'c'}{type} =3D "4.2BSD"; > $slices{2}{'c'}{size} =3D "*"; >=20 > =09 > So I could still use some suggestions... I'm not getting any wiser > here. I have no "slice" devices or partitions. Is this devd's fault > or geom's ? I'd guess from the errors that diskprep has a bug in the case that your device is in a directory in /dev, but there could be a config bug. I don't have time or resouces to figure out which. Rather then trying your rather complicated config first, try a minimal config and see if you can get that working. You can also read the source of diskprep and try to do what it is attempting to do by hand to see where things work and where things don't. -- Brooks --=20 Any statement of the form "X is the one, true Y" is FALSE. PGP fingerprint 655D 519C 26A7 82E7 2529 9BF0 5D8E 8BE9 F238 1AD4 --Fba/0zbH8Xs+Fj9o Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.1 (GNU/Linux) iD8DBQFB7AcEXY6L6fI4GtQRAtdqAKCetsqlKNx+F9buWfUvdSZlSLqmAACgzJOz jRJeYyrP0h1xudV6U6khiL0= =LmcH -----END PGP SIGNATURE----- --Fba/0zbH8Xs+Fj9o-- From owner-freebsd-geom@FreeBSD.ORG Mon Jan 17 20:33:17 2005 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id AB11616A4CE for ; Mon, 17 Jan 2005 20:33:17 +0000 (GMT) Received: from darkness.comp.waw.pl (darkness.comp.waw.pl [195.117.238.136]) by mx1.FreeBSD.org (Postfix) with ESMTP id 4592B43D31 for ; Mon, 17 Jan 2005 20:33:17 +0000 (GMT) (envelope-from pjd@darkness.comp.waw.pl) Received: by darkness.comp.waw.pl (Postfix, from userid 1009) id D5B74AE693; Mon, 17 Jan 2005 21:33:14 +0100 (CET) Date: Mon, 17 Jan 2005 21:33:14 +0100 From: Pawel Jakub Dawidek To: Brooks Davis Message-ID: <20050117203314.GA795@darkness.comp.waw.pl> References: <20050111110012.GB75478@atreides.freenix.no> <20050111161324.GA8528@odin.ac.hmc.edu> <20050117161647.GD75478@atreides.freenix.no> <20050117184212.GB7538@odin.ac.hmc.edu> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="ERHfpFOxJvIsVBXy" Content-Disposition: inline In-Reply-To: <20050117184212.GB7538@odin.ac.hmc.edu> User-Agent: Mutt/1.4.2i X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 5.2.1-RC2 i386 cc: Shaun Jurrens cc: freebsd-geom@freebsd.org Subject: Re: partitioning and labeling geom devices X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Jan 2005 20:33:17 -0000 --ERHfpFOxJvIsVBXy Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Jan 17, 2005 at 10:42:12AM -0800, Brooks Davis wrote: +> > Argument "*" isn't numeric in subtraction (-) at /usr/local/sbin/disk= prep +> > line 232. +> > disklabel: /dev/stripe/stripe0s1: No such file or directory This could be problem with bsdlabel(8) which was fixed some time ago. +> > So I could still use some suggestions... I'm not getting any wiser +> > here. I have no "slice" devices or partitions. Is this devd's fault +> > or geom's ? +>=20 +> I'd guess from the errors that diskprep has a bug in the case that your +> device is in a directory in /dev, but there could be a config bug. I +> don't have time or resouces to figure out which. Rather then trying +> your rather complicated config first, try a minimal config and see if +> you can get that working. You can also read the source of diskprep and +> try to do what it is attempting to do by hand to see where things work +> and where things don't. +>=20 +> -- Brooks --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --ERHfpFOxJvIsVBXy Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.4 (FreeBSD) iD8DBQFB7CEKForvXbEpPzQRAj2vAKDyC9ffwYfCwcBmWbfDfRpLCdL7DACfcsZC KSc0mUpjwuWWh9UsO+9Fq+I= =xEOk -----END PGP SIGNATURE----- --ERHfpFOxJvIsVBXy-- From owner-freebsd-geom@FreeBSD.ORG Mon Jan 17 21:14:21 2005 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 75E9116A4CE; Mon, 17 Jan 2005 21:14:21 +0000 (GMT) Received: from koyukuk.teamcool.net (koyukuk.teamcool.net [208.39.216.43]) by mx1.FreeBSD.org (Postfix) with ESMTP id 0516E43D3F; Mon, 17 Jan 2005 21:14:21 +0000 (GMT) (envelope-from kgunders@teamcool.net) Received: from localhost (localhost [127.0.0.1]) by localhost.teamcool.net (TeamCool Rocks) with SMTP id 2EFB611E66; Mon, 17 Jan 2005 14:14:20 -0700 (MST) Received: from [192.168.1.112] (unknown [192.168.1.112]) by koyukuk.teamcool.net (TeamCool Rocks) with ESMTP id B262D11E64; Mon, 17 Jan 2005 14:14:19 -0700 (MST) Message-ID: <41EC2AB3.2050704@teamcool.net> Date: Mon, 17 Jan 2005 14:14:27 -0700 From: Ken Gunderson User-Agent: Mozilla Thunderbird 1.0 (Windows/20041206) X-Accept-Language: en-us, en MIME-Version: 1.0 To: Pawel Jakub Dawidek References: <20050111110012.GB75478@atreides.freenix.no> <20050111161324.GA8528@odin.ac.hmc.edu> <20050117161647.GD75478@atreides.freenix.no> <20050117184212.GB7538@odin.ac.hmc.edu> <20050117203314.GA795@darkness.comp.waw.pl> In-Reply-To: <20050117203314.GA795@darkness.comp.waw.pl> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit cc: Brooks Davis cc: Shaun Jurrens cc: freebsd-geom@freebsd.org Subject: Re: partitioning and labeling geom devices X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Jan 2005 21:14:21 -0000 Pawel Jakub Dawidek wrote: > On Mon, Jan 17, 2005 at 10:42:12AM -0800, Brooks Davis wrote: > +> > Argument "*" isn't numeric in subtraction (-) at /usr/local/sbin/diskprep > +> > line 232. > +> > disklabel: /dev/stripe/stripe0s1: No such file or directory > > This could be problem with bsdlabel(8) which was fixed some time ago. Are you referencing prefixing vs. not prefixing with /dev here? And if so, is this fixed in just 5.3-stable, or 5.3-p4 as well? I think just the former, but am not 100% certain. TIA-- kg From owner-freebsd-geom@FreeBSD.ORG Mon Jan 17 21:49:10 2005 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 96AA416A4CE for ; Mon, 17 Jan 2005 21:49:10 +0000 (GMT) Received: from darkness.comp.waw.pl (darkness.comp.waw.pl [195.117.238.136]) by mx1.FreeBSD.org (Postfix) with ESMTP id 0F78E43D46 for ; Mon, 17 Jan 2005 21:49:10 +0000 (GMT) (envelope-from pjd@darkness.comp.waw.pl) Received: by darkness.comp.waw.pl (Postfix, from userid 1009) id 8A223ACC47; Mon, 17 Jan 2005 22:49:07 +0100 (CET) Date: Mon, 17 Jan 2005 22:49:07 +0100 From: Pawel Jakub Dawidek To: Ken Gunderson Message-ID: <20050117214907.GD795@darkness.comp.waw.pl> References: <20050111110012.GB75478@atreides.freenix.no> <20050111161324.GA8528@odin.ac.hmc.edu> <20050117161647.GD75478@atreides.freenix.no> <20050117184212.GB7538@odin.ac.hmc.edu> <20050117203314.GA795@darkness.comp.waw.pl> <41EC2AB3.2050704@teamcool.net> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="kb0TSCuX821Ar6UT" Content-Disposition: inline In-Reply-To: <41EC2AB3.2050704@teamcool.net> User-Agent: Mutt/1.4.2i X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 5.2.1-RC2 i386 cc: Brooks Davis cc: Shaun Jurrens cc: freebsd-geom@freebsd.org Subject: Re: partitioning and labeling geom devices X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Jan 2005 21:49:10 -0000 --kb0TSCuX821Ar6UT Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Jan 17, 2005 at 02:14:27PM -0700, Ken Gunderson wrote: +> Pawel Jakub Dawidek wrote: +> >On Mon, Jan 17, 2005 at 10:42:12AM -0800, Brooks Davis wrote: +> >+> > Argument "*" isn't numeric in subtraction (-) at=20 +> >/usr/local/sbin/diskprep +> >+> > line 232. +> >+> > disklabel: /dev/stripe/stripe0s1: No such file or directory +> > +> >This could be problem with bsdlabel(8) which was fixed some time ago. +>=20 +> Are you referencing prefixing vs. not prefixing with /dev here? And if= =20 +> so, is this fixed in just 5.3-stable, or 5.3-p4 as well? I think just= =20 +> the former, but am not 100% certain. Yes, the fix was MFCed to the RELENG_5. --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --kb0TSCuX821Ar6UT Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.4 (FreeBSD) iD8DBQFB7DLTForvXbEpPzQRAstlAKDiRdBiYarSA68icbMqssqGw+N/wgCdFs0k 1hXn1nPVAYy67VJ4q8LlRxw= =7CgH -----END PGP SIGNATURE----- --kb0TSCuX821Ar6UT-- From owner-freebsd-geom@FreeBSD.ORG Mon Jan 17 22:16:47 2005 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 031C516A4CE; Mon, 17 Jan 2005 22:16:47 +0000 (GMT) Received: from koyukuk.teamcool.net (koyukuk.teamcool.net [208.39.216.43]) by mx1.FreeBSD.org (Postfix) with ESMTP id 792FF43D31; Mon, 17 Jan 2005 22:16:46 +0000 (GMT) (envelope-from kgunders@teamcool.net) Received: from localhost (localhost [127.0.0.1]) by localhost.teamcool.net (TeamCool Rocks) with SMTP id D78FC11E6A; Mon, 17 Jan 2005 15:16:45 -0700 (MST) Received: from [192.168.1.112] (unknown [192.168.1.112]) by koyukuk.teamcool.net (TeamCool Rocks) with ESMTP id 986B711E68; Mon, 17 Jan 2005 15:16:45 -0700 (MST) Message-ID: <41EC395A.8010805@teamcool.net> Date: Mon, 17 Jan 2005 15:16:58 -0700 From: Ken Gunderson User-Agent: Mozilla Thunderbird 1.0 (Windows/20041206) X-Accept-Language: en-us, en MIME-Version: 1.0 To: Pawel Jakub Dawidek References: <20050111110012.GB75478@atreides.freenix.no> <20050111161324.GA8528@odin.ac.hmc.edu> <20050117161647.GD75478@atreides.freenix.no> <20050117184212.GB7538@odin.ac.hmc.edu> <20050117203314.GA795@darkness.comp.waw.pl> <41EC2AB3.2050704@teamcool.net> <20050117214907.GD795@darkness.comp.waw.pl> In-Reply-To: <20050117214907.GD795@darkness.comp.waw.pl> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit cc: Brooks Davis cc: Shaun Jurrens cc: freebsd-geom@freebsd.org Subject: Re: partitioning and labeling geom devices X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Jan 2005 22:16:47 -0000 Pawel Jakub Dawidek wrote: > On Mon, Jan 17, 2005 at 02:14:27PM -0700, Ken Gunderson wrote: > +> Pawel Jakub Dawidek wrote: > +> >On Mon, Jan 17, 2005 at 10:42:12AM -0800, Brooks Davis wrote: > +> >+> > Argument "*" isn't numeric in subtraction (-) at > +> >/usr/local/sbin/diskprep > +> >+> > line 232. > +> >+> > disklabel: /dev/stripe/stripe0s1: No such file or directory > +> > > +> >This could be problem with bsdlabel(8) which was fixed some time ago. > +> > +> Are you referencing prefixing vs. not prefixing with /dev here? And if > +> so, is this fixed in just 5.3-stable, or 5.3-p4 as well? I think just > +> the former, but am not 100% certain. > > Yes, the fix was MFCed to the RELENG_5. > But not RELENG_5_4... Thanks for clarifying that up. For those of us who track 5_4, I assume we are otherwise fine as long as we drop the /dev when bsdlabeling? Ciao--kg From owner-freebsd-geom@FreeBSD.ORG Tue Jan 18 02:33:43 2005 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id AD2DD16A4CE for ; Tue, 18 Jan 2005 02:33:43 +0000 (GMT) Received: from hollin.esperi.net (hollin.esperi.net [194.153.168.44]) by mx1.FreeBSD.org (Postfix) with ESMTP id 2D64F43D2F for ; Tue, 18 Jan 2005 02:33:43 +0000 (GMT) (envelope-from nicolai@hollin.esperi.net) Received: from localhost ([127.0.0.1] helo=hollin.esperi.net) by hollin.esperi.net with esmtp (Exim 4.10) id 1CqjBd-0003IG-00 for freebsd-geom@freebsd.org; Tue, 18 Jan 2005 02:33:41 +0000 Received: (from nicolai@localhost) by hollin.esperi.net (8.12.3/8.12.3/Submit) id j0I2XfmU012661; Tue, 18 Jan 2005 02:33:41 GMT MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Message-ID: <16876.30085.273846.833564@hollin.esperi.net> Date: Tue, 18 Jan 2005 02:33:41 +0000 From: Nicolai E M Plum To: freebsd-geom@freebsd.org X-Mailer: VM 7.07 under Emacs 21.3.1 Subject: geom_mirror panic with pair of firewire disc X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Jan 2005 02:33:43 -0000 Hi Using FreeBSD 5-STABLE as of about 2 days ago and these discs: # dmesg | grep da[56] da5 at sbp1 bus 0 target 1 lun 0 da5: Fixed Simplified Direct Access SCSI-4 device da5: 50.000MB/s transfers da5: 57259MB (117266688 512 byte sectors: 255H 63S/T 7299C) da6 at sbp1 bus 0 target 1 lun 1 da6: Fixed Simplified Direct Access SCSI-4 device da6: 50.000MB/s transfers da6: 57259MB (117266688 512 byte sectors: 255H 63S/T 7299C) with this partitioning: # fdisk /dev/da5 ******* Working on device /dev/da5 ******* parameters extracted from in-core disklabel are: cylinders=7299 heads=255 sectors/track=63 (16065 blks/cyl) Figures below won't work with BIOS for partitions not in cyl 1 parameters to be used for BIOS calculations are: cylinders=7299 heads=255 sectors/track=63 (16065 blks/cyl) Media sector size is 512 Warning: BIOS sector numbering starts with sector 1 Information from DOS bootblock is: The data for partition 1 is: sysid 165 (0xa5),(FreeBSD/NetBSD/386BSD) start 63, size 116728227 (56996 Meg), flag 80 (active) beg: cyl 0/ head 1/ sector 1; end: cyl 1023/ head 254/ sector 63 The data for partition 2 is: The data for partition 3 is: The data for partition 4 is: # fdisk /dev/da6 ******* Working on device /dev/da6 ******* parameters extracted from in-core disklabel are: cylinders=7299 heads=255 sectors/track=63 (16065 blks/cyl) Figures below won't work with BIOS for partitions not in cyl 1 parameters to be used for BIOS calculations are: cylinders=7299 heads=255 sectors/track=63 (16065 blks/cyl) Media sector size is 512 Warning: BIOS sector numbering starts with sector 1 Information from DOS bootblock is: The data for partition 1 is: sysid 165 (0xa5),(FreeBSD/NetBSD/386BSD) start 63, size 116728227 (56996 Meg), flag 80 (active) beg: cyl 0/ head 1/ sector 1; end: cyl 1023/ head 254/ sector 63 The data for partition 2 is: The data for partition 3 is: The data for partition 4 is: and this command to create a mirrored pair: # gmirror label m1 /dev/da5s1 /dev/da6s1 I immediately get this result: (syslog) ---- Jan 16 23:19:13 nurn kernel: GEOM_MIRROR: Device m1 created (id=2113314100). Jan 16 23:19:13 nurn kernel: GEOM_MIRROR: Device m1: provider da5s1 detected. Jan 16 23:19:13 nurn kernel: GEOM_MIRROR: Cannot add disk da5s1c to m1 (error=17). Jan 16 23:19:14 nurn kernel: GEOM_MIRROR: Device m1: provider da6s1 detected. Jan 16 23:19:14 nurn kernel: GEOM_MIRROR: Device m1: provider da6s1 activated. Jan 16 23:19:14 nurn kernel: GEOM_MIRROR: Device m1: provider da5s1 activated. Jan 16 23:19:14 nurn kernel: GEOM_MIRROR: Device m1: provider mirror/m1 launched. Jan 16 23:19:14 nurn kernel: WARNING: Expected rawoffset 0, found 63 ---- and on the console: Fatal double fault: eip = 0xc07a4acd esp = 0xd4226000 ebp = 0xd4226014 panic: double fault Uptime: 2h45m29s In fact, this happens now if I run "gmirror load", I get the same immediate panic. I don't think is supposed to happen. Has anyone seen it before? My intent is to mirror these two slices which I have created to be slightly smaller than the entire disc. This is so that if I have to replace a disc with another type that is slightly smaller I don't have a problem. (I know that I can just get a bigger disc than 60GB, but this is a test setup; in production I want to use the largest discs that are economically reasonable so I cannot rely on always replacing a failed disc with a larger one). Nicolai From owner-freebsd-geom@FreeBSD.ORG Tue Jan 18 07:29:28 2005 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id B392E16A4CE for ; Tue, 18 Jan 2005 07:29:28 +0000 (GMT) Received: from darkness.comp.waw.pl (darkness.comp.waw.pl [195.117.238.136]) by mx1.FreeBSD.org (Postfix) with ESMTP id 584CD43D45 for ; Tue, 18 Jan 2005 07:29:28 +0000 (GMT) (envelope-from pjd@darkness.comp.waw.pl) Received: by darkness.comp.waw.pl (Postfix, from userid 1009) id 90383AE693; Tue, 18 Jan 2005 08:29:26 +0100 (CET) Date: Tue, 18 Jan 2005 08:29:26 +0100 From: Pawel Jakub Dawidek To: Nicolai E M Plum Message-ID: <20050118072926.GE795@darkness.comp.waw.pl> References: <16876.30085.273846.833564@hollin.esperi.net> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="gJgGjUUWrnN4mpen" Content-Disposition: inline In-Reply-To: <16876.30085.273846.833564@hollin.esperi.net> User-Agent: Mutt/1.4.2i X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 5.2.1-RC2 i386 cc: freebsd-geom@freebsd.org Subject: Re: geom_mirror panic with pair of firewire disc X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Jan 2005 07:29:28 -0000 --gJgGjUUWrnN4mpen Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Jan 18, 2005 at 02:33:41AM +0000, Nicolai E M Plum wrote: +> and on the console: +>=20 +> Fatal double fault: +> eip =3D 0xc07a4acd +> esp =3D 0xd4226000 +> ebp =3D 0xd4226014 +> panic: double fault +> Uptime: 2h45m29s Could you get for me output of: # objdump -d -l `find /usr/obj/ -type f -name kernel.debug` | grep -5 ^c07= a4acd: --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --gJgGjUUWrnN4mpen Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.4 (FreeBSD) iD8DBQFB7LrWForvXbEpPzQRAl11AJ9JUZRccD8CgC3EtcTsRswWMzmSPwCgubjS Ok3flk3BBzBC2bRI6zzIB0w= =gMz3 -----END PGP SIGNATURE----- --gJgGjUUWrnN4mpen-- From owner-freebsd-geom@FreeBSD.ORG Tue Jan 18 09:06:26 2005 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id E726A16A4CE; Tue, 18 Jan 2005 09:06:25 +0000 (GMT) Received: from freenix.no (atreides.freenix.no [212.33.142.6]) by mx1.FreeBSD.org (Postfix) with ESMTP id AB2C243D3F; Tue, 18 Jan 2005 09:06:24 +0000 (GMT) (envelope-from shamz@atreides.freenix.no) Received: from atreides.freenix.no (localhost [127.0.0.1]) by freenix.no (8.12.11/8.12.11) with ESMTP id j0I96M86085754; Tue, 18 Jan 2005 10:06:23 +0100 (CET) (envelope-from shamz@atreides.freenix.no) Received: (from shamz@localhost) by atreides.freenix.no (8.12.11/8.12.11/Submit) id j0I96Gnl085753; Tue, 18 Jan 2005 10:06:16 +0100 (CET) (envelope-from shamz) Date: Tue, 18 Jan 2005 10:06:16 +0100 From: Shaun Jurrens To: Pawel Jakub Dawidek Message-ID: <20050118090616.GE75478@atreides.freenix.no> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20050117203314.GA795@darkness.comp.waw.pl> User-Agent: Mutt/1.4.2.1i X-Operating-System: FreeBSD 4.10-RELEASE-p2 X-Philosophy: If you can read this, you're too close. X-Virus-Scanned: ClamAV 0.80/571/Wed Nov 3 01:15:45 2004 clamav-milter version 0.80j on atreides.freenix.no X-Virus-Status: Clean cc: Brooks Davis cc: freebsd-geom@FreeBSD.org Subject: Re: partitioning and labeling geom devices X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Jan 2005 09:06:26 -0000 On Mon, Jan 17, 2005 at 09:33:14PM +0100, Pawel Jakub Dawidek wrote: #> On Mon, Jan 17, 2005 at 10:42:12AM -0800, Brooks Davis wrote: #> +> > Argument "*" isn't numeric in subtraction (-) at /usr/local/sbin/diskprep #> +> > line 232. #> +> > disklabel: /dev/stripe/stripe0s1: No such file or directory #> #> This could be problem with bsdlabel(8) which was fixed some time ago. FreeBSD paracles 5.3-STABLE FreeBSD 5.3-STABLE #2: Tue Jan 11 11:48:08 CET 2005 root@paracles:/usr/obj/usr/src/sys/PARACLES i386 paracles:/root#> disklabel stripe/stripe0s1 disklabel: /dev/stripe/stripe0s1: No such file or directory paracles:/root#> ll /dev/stripe/. total 0 crw-r----- 1 root operator 4, 40 Jan 17 17:55 stripe0 There just isn't anything there to label. There's something here after fdisk that is missing (at least in the traditional sense) and that is the slices. There are however slices created on the underlying mirror, at least one of them: paracles:/root#> ll /dev/mirror/. total 0 crw-r----- 1 root operator 4, 37 Jan 17 17:47 plex0 crw-r----- 1 root operator 4, 42 Jan 17 17:47 plex0s1 crw-r----- 1 root operator 4, 43 Jan 17 17:47 plex0s2 crw-r----- 1 root operator 4, 36 Jan 17 17:47 plex1 crw-r----- 1 root operator 4, 35 Jan 17 17:47 plex2 So as long as we're guessing, I'm guessing a bug in geom. Somehow it's not presenting what bsdlabel needs, or it's writing labels where it shouldn't be. It could also be that it is telling whatever system magic that created the two mirror slices, to create device nodes in the wrong place or wrong abstraction level. Guess it'd be great to be able to dig a little deeper here... Guessing isn't getting me very far... #> #> +> > So I could still use some suggestions... I'm not getting any wiser #> +> > here. I have no "slice" devices or partitions. Is this devd's fault #> +> > or geom's ? #> +> #> +> I'd guess from the errors that diskprep has a bug in the case that your #> +> device is in a directory in /dev, but there could be a config bug. I #> +> don't have time or resouces to figure out which. Rather then trying #> +> your rather complicated config first, try a minimal config and see if #> +> you can get that working. You can also read the source of diskprep and #> +> try to do what it is attempting to do by hand to see where things work #> +> and where things don't. Been there, done that, same results. Stacking geom systems doesn't seem to work. #> +> #> +> -- Brooks #> #> -- #> Pawel Jakub Dawidek http://www.wheel.pl #> pjd@FreeBSD.org http://www.FreeBSD.org #> FreeBSD committer Am I Evil? Yes, I Am! -- Yours truly, Shaun D. Jurrens shaun@shamz.net shamz@freenix.no From owner-freebsd-geom@FreeBSD.ORG Tue Jan 18 11:01:25 2005 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9D97A16A51D for ; Tue, 18 Jan 2005 11:01:24 +0000 (GMT) Received: from darkness.comp.waw.pl (darkness.comp.waw.pl [195.117.238.136]) by mx1.FreeBSD.org (Postfix) with ESMTP id 810B943D68 for ; Tue, 18 Jan 2005 11:01:19 +0000 (GMT) (envelope-from pjd@darkness.comp.waw.pl) Received: by darkness.comp.waw.pl (Postfix, from userid 1009) id C9071ACBD6; Tue, 18 Jan 2005 12:01:15 +0100 (CET) Date: Tue, 18 Jan 2005 12:01:15 +0100 From: Pawel Jakub Dawidek To: Shaun Jurrens Message-ID: <20050118110115.GF795@darkness.comp.waw.pl> References: <20050117203314.GA795@darkness.comp.waw.pl> <20050118090616.GE75478@atreides.freenix.no> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="nCRcqX7cEx7rr7Pe" Content-Disposition: inline In-Reply-To: <20050118090616.GE75478@atreides.freenix.no> User-Agent: Mutt/1.4.2i X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 5.2.1-RC2 i386 cc: Brooks Davis cc: freebsd-geom@FreeBSD.org Subject: Re: partitioning and labeling geom devices X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Jan 2005 11:01:25 -0000 --nCRcqX7cEx7rr7Pe Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Jan 18, 2005 at 10:06:16AM +0100, Shaun Jurrens wrote: +> On Mon, Jan 17, 2005 at 09:33:14PM +0100, Pawel Jakub Dawidek wrote: +> #> On Mon, Jan 17, 2005 at 10:42:12AM -0800, Brooks Davis wrote: +> #> +> > Argument "*" isn't numeric in subtraction (-) at /usr/local/sbi= n/diskprep +> #> +> > line 232. +> #> +> > disklabel: /dev/stripe/stripe0s1: No such file or directory +> #>=20 +> #> This could be problem with bsdlabel(8) which was fixed some time ago. +>=20 +> FreeBSD paracles 5.3-STABLE FreeBSD 5.3-STABLE #2: Tue Jan 11 11:48:08 +> CET 2005 root@paracles:/usr/obj/usr/src/sys/PARACLES i386 +>=20 +> paracles:/root#> disklabel stripe/stripe0s1 +> disklabel: /dev/stripe/stripe0s1: No such file or directory +>=20 +> paracles:/root#> ll /dev/stripe/. +> total 0 +> crw-r----- 1 root operator 4, 40 Jan 17 17:55 stripe0 +>=20 +> There just isn't anything there to label. There's something here +> after fdisk that is missing (at least in the traditional sense) and that= is +> the slices. [...] Simply calling: fdisk -I /dev/stripe/stripe0 doesn't create provider /dev/stripe/stripe0s1? --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --nCRcqX7cEx7rr7Pe Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.4 (FreeBSD) iD8DBQFB7Ox7ForvXbEpPzQRAiF1AJ9JKdv+DmSi7Ru9Z6ZJSbtWLtYnxwCeOpYH 8o1BLKkMU/z6LwtDIpAQG+U= =YF+k -----END PGP SIGNATURE----- --nCRcqX7cEx7rr7Pe-- From owner-freebsd-geom@FreeBSD.ORG Tue Jan 18 13:19:41 2005 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 86EB816A4CE; Tue, 18 Jan 2005 13:19:41 +0000 (GMT) Received: from freenix.no (atreides.freenix.no [212.33.142.6]) by mx1.FreeBSD.org (Postfix) with ESMTP id 82AE143D5F; Tue, 18 Jan 2005 13:19:40 +0000 (GMT) (envelope-from shamz@atreides.freenix.no) Received: from atreides.freenix.no (localhost [127.0.0.1]) by freenix.no (8.12.11/8.12.11) with ESMTP id j0IDJcRt088590; Tue, 18 Jan 2005 14:19:39 +0100 (CET) (envelope-from shamz@atreides.freenix.no) Received: (from shamz@localhost) by atreides.freenix.no (8.12.11/8.12.11/Submit) id j0IDJPpo088589; Tue, 18 Jan 2005 14:19:25 +0100 (CET) (envelope-from shamz) Date: Tue, 18 Jan 2005 14:19:25 +0100 From: Shaun Jurrens To: Pawel Jakub Dawidek Message-ID: <20050118131925.GF75478@atreides.freenix.no> References: <20050117203314.GA795@darkness.comp.waw.pl> <20050118090616.GE75478@atreides.freenix.no> <20050118110115.GF795@darkness.comp.waw.pl> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20050118110115.GF795@darkness.comp.waw.pl> User-Agent: Mutt/1.4.2.1i X-Operating-System: FreeBSD 4.10-RELEASE-p2 X-Philosophy: If you can read this, you're too close. X-Virus-Scanned: ClamAV 0.80/571/Wed Nov 3 01:15:45 2004 clamav-milter version 0.80j on atreides.freenix.no X-Virus-Status: Clean cc: Brooks Davis cc: freebsd-geom@FreeBSD.org Subject: Re: partitioning and labeling geom devices X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Jan 2005 13:19:41 -0000 On Tue, Jan 18, 2005 at 12:01:15PM +0100, Pawel Jakub Dawidek wrote: #> On Tue, Jan 18, 2005 at 10:06:16AM +0100, Shaun Jurrens wrote: #> +> On Mon, Jan 17, 2005 at 09:33:14PM +0100, Pawel Jakub Dawidek wrote: #> +> #> On Mon, Jan 17, 2005 at 10:42:12AM -0800, Brooks Davis wrote: #> +> #> +> > Argument "*" isn't numeric in subtraction (-) at /usr/local/sbin/diskprep #> +> #> +> > line 232. #> +> #> +> > disklabel: /dev/stripe/stripe0s1: No such file or directory #> +> #> #> +> #> This could be problem with bsdlabel(8) which was fixed some time ago. #> +> #> +> FreeBSD paracles 5.3-STABLE FreeBSD 5.3-STABLE #2: Tue Jan 11 11:48:08 #> +> CET 2005 root@paracles:/usr/obj/usr/src/sys/PARACLES i386 #> +> #> +> paracles:/root#> disklabel stripe/stripe0s1 #> +> disklabel: /dev/stripe/stripe0s1: No such file or directory #> +> #> +> paracles:/root#> ll /dev/stripe/. #> +> total 0 #> +> crw-r----- 1 root operator 4, 40 Jan 17 17:55 stripe0 #> +> #> +> There just isn't anything there to label. There's something here #> +> after fdisk that is missing (at least in the traditional sense) and that is #> +> the slices. [...] #> #> Simply calling: fdisk -I /dev/stripe/stripe0 doesn't create #> provider /dev/stripe/stripe0s1? Nope. paracles:/root#> fdisk -I /dev/stripe/stripe0 ******* Working on device /dev/stripe/stripe0 ******* paracles:/root#> ll /dev/stripe/. total 0 crw-r----- 1 root operator 4, 40 Jan 18 15:21 stripe0 But I suddenly lose a slice in /dev/mirror (plex0s2) paracles:/root#> ll /dev/mirror/. total 0 crw-r----- 1 root operator 4, 37 Jan 17 17:47 plex0 crw-r----- 1 root operator 4, 44 Jan 17 17:47 plex0s1 crw-r----- 1 root operator 4, 36 Jan 17 17:47 plex1 crw-r----- 1 root operator 4, 35 Jan 17 17:47 plex2 #> #> -- #> Pawel Jakub Dawidek http://www.wheel.pl #> pjd@FreeBSD.org http://www.FreeBSD.org #> FreeBSD committer Am I Evil? Yes, I Am! -- Yours truly, Shaun D. Jurrens shaun@shamz.net shamz@freenix.no From owner-freebsd-geom@FreeBSD.ORG Tue Jan 18 13:24:36 2005 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id BE97D16A4CE for ; Tue, 18 Jan 2005 13:24:36 +0000 (GMT) Received: from darkness.comp.waw.pl (darkness.comp.waw.pl [195.117.238.136]) by mx1.FreeBSD.org (Postfix) with ESMTP id 1AD1443D53 for ; Tue, 18 Jan 2005 13:24:36 +0000 (GMT) (envelope-from pjd@darkness.comp.waw.pl) Received: by darkness.comp.waw.pl (Postfix, from userid 1009) id 65E33ACC59; Tue, 18 Jan 2005 14:24:33 +0100 (CET) Date: Tue, 18 Jan 2005 14:24:33 +0100 From: Pawel Jakub Dawidek To: Shaun Jurrens Message-ID: <20050118132433.GH795@darkness.comp.waw.pl> References: <20050117203314.GA795@darkness.comp.waw.pl> <20050118090616.GE75478@atreides.freenix.no> <20050118110115.GF795@darkness.comp.waw.pl> <20050118131925.GF75478@atreides.freenix.no> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="QFO1zB2dwAkGraMW" Content-Disposition: inline In-Reply-To: <20050118131925.GF75478@atreides.freenix.no> User-Agent: Mutt/1.4.2i X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 5.2.1-RC2 i386 cc: Brooks Davis cc: freebsd-geom@FreeBSD.org Subject: Re: partitioning and labeling geom devices X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Jan 2005 13:24:36 -0000 --QFO1zB2dwAkGraMW Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Jan 18, 2005 at 02:19:25PM +0100, Shaun Jurrens wrote: +> #> Simply calling: fdisk -I /dev/stripe/stripe0 doesn't create +> #> provider /dev/stripe/stripe0s1? +>=20 +> Nope. +>=20 +> paracles:/root#> fdisk -I /dev/stripe/stripe0 +> ******* Working on device /dev/stripe/stripe0 ******* +> paracles:/root#> ll /dev/stripe/. +> total 0 +> crw-r----- 1 root operator 4, 40 Jan 18 15:21 stripe0 +>=20 +> But I suddenly lose a slice in /dev/mirror (plex0s2) +>=20 +> paracles:/root#> ll /dev/mirror/. +> total 0 +> crw-r----- 1 root operator 4, 37 Jan 17 17:47 plex0 +> crw-r----- 1 root operator 4, 44 Jan 17 17:47 plex0s1 +> crw-r----- 1 root operator 4, 36 Jan 17 17:47 plex1 +> crw-r----- 1 root operator 4, 35 Jan 17 17:47 plex2 Could you send me the output of: # sysctl -b kern.geom.confxml --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --QFO1zB2dwAkGraMW Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.4 (FreeBSD) iD8DBQFB7Q4RForvXbEpPzQRApJwAJ9F2wF4LL/60o8vXPZ0PSu1NEVQ3wCg7154 RqAR/LLhlNsO8DRWNN/Wz1M= =lI+d -----END PGP SIGNATURE----- --QFO1zB2dwAkGraMW-- From owner-freebsd-geom@FreeBSD.ORG Wed Jan 19 14:28:30 2005 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id F269116A4CE; Wed, 19 Jan 2005 14:28:29 +0000 (GMT) Received: from gromit.dlib.vt.edu (gromit.dlib.vt.edu [128.173.49.29]) by mx1.FreeBSD.org (Postfix) with ESMTP id 97BE643D5D; Wed, 19 Jan 2005 14:28:29 +0000 (GMT) (envelope-from paul@gromit.dlib.vt.edu) Received: from zappa.Chelsea-Ct.Org (pool-151-199-113-125.roa.east.verizon.net [151.199.113.125]) by gromit.dlib.vt.edu (8.13.1/8.13.1) with ESMTP id j0JESSsr076058 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK); Wed, 19 Jan 2005 09:28:28 -0500 (EST) (envelope-from paul@gromit.dlib.vt.edu) Received: from zappa.Chelsea-Ct.Org (localhost.Chelsea-Ct.Org [127.0.0.1]) by zappa.Chelsea-Ct.Org (8.13.1/8.13.1) with ESMTP id j0JESMSY062074 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK); Wed, 19 Jan 2005 09:28:22 -0500 (EST) (envelope-from paul@gromit.dlib.vt.edu) Received: (from paul@localhost) by zappa.Chelsea-Ct.Org (8.13.1/8.13.1/Submit) id j0JESM3R062073; Wed, 19 Jan 2005 09:28:22 -0500 (EST) (envelope-from paul@gromit.dlib.vt.edu) X-Authentication-Warning: zappa.Chelsea-Ct.Org: paul set sender to paul@gromit.dlib.vt.edu using -f From: Paul Mather To: "Ralf S. Engelschall" In-Reply-To: <20050110163634.GA47526@engelschall.com> References: <20050110163634.GA47526@engelschall.com> Content-Type: text/plain Content-Transfer-Encoding: 7bit Date: Wed, 19 Jan 2005 09:28:21 -0500 Message-Id: <1106144901.40972.11.camel@zappa.Chelsea-Ct.Org> Mime-Version: 1.0 X-Mailer: Evolution 2.0.3 FreeBSD GNOME Team Port cc: freebsd-geom@freebsd.org Subject: Re: [HOWTO] FreeBSD system disk mirroring with GEOM X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Jan 2005 14:28:30 -0000 On Mon, 2005-01-10 at 17:36 +0100, Ralf S. Engelschall wrote: > FYI: I've prepared a detailed step-by-step command list on how to > establish a RAID-1 (mirror) for the system partitions with GEOM and > gmirror(8). You can find the resulting HOWTO document under > http://people.freebsd.org/~rse/mirror/ Congratulations on a useful and comprehensive HOWTO! I have only one question: in the first approach ("Whole Disk, Acceptable, Less Flexible"), why do you create a slice if you are using the whole disk anyway? Is this simply because it's good form to put a valid partition table on a bootable PC disk? The reason I ask is because when I set up my bootable gmirror (using a technique similar to the one you describe) I omitted the fdisk step and used bsdlabel on (my equivalent of) /dev/mirror/gm0 (not gm0s1). I've not had any problems booting the mirror, nor in using it. It also means one less GEOM layer to go through, right? Cheers, Paul. -- e-mail: paul@gromit.dlib.vt.edu "Without music to decorate it, time is just a bunch of boring production deadlines or dates by which bills must be paid." --- Frank Vincent Zappa From owner-freebsd-geom@FreeBSD.ORG Wed Jan 19 18:05:23 2005 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 0173516A4CE for ; Wed, 19 Jan 2005 18:05:23 +0000 (GMT) Received: from wproxy.gmail.com (wproxy.gmail.com [64.233.184.196]) by mx1.FreeBSD.org (Postfix) with ESMTP id 8612743D54 for ; Wed, 19 Jan 2005 18:05:22 +0000 (GMT) (envelope-from bjmccann@gmail.com) Received: by wproxy.gmail.com with SMTP id 69so6775wra for ; Wed, 19 Jan 2005 10:05:22 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:reply-to:to:subject:mime-version:content-type:content-transfer-encoding; b=qugnUgaYv3GoxA75uNjfwv28cVNCY6NlfMXFt434yTkiZXOk/TCftGD/GoKl2tvKBhOwHEV7j8iwTiwx6WpG/SC9/5jiT8WCJNQA7XQ7pUgLbxZQtr1Xk94BpUwMp17RNF2u5Rn9WThusoW7pWZCbrXTJYhNpvVfaOg61DNvBKQ= Received: by 10.54.22.53 with SMTP id 53mr29868wrv; Wed, 19 Jan 2005 10:05:22 -0800 (PST) Received: by 10.54.33.61 with HTTP; Wed, 19 Jan 2005 10:05:22 -0800 (PST) Message-ID: <2b5f066d05011910056e7a69e1@mail.gmail.com> Date: Wed, 19 Jan 2005 13:05:22 -0500 From: Brian McCann To: freebsd-geom@freebsd.org Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Subject: ggatec reporting false info / not exiting correct? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: Brian McCann List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Jan 2005 18:05:23 -0000 Hi all. I'm working on getting gmirror to work over ggate connections..and it's working well...just trying to break it and make recovery situations. However, I've discovered what I believe to be a flaw in ggatec. I had PC1 running ggatec and PC2 running ggated. PC2 was exporting /dev/da1s1d. I had gmirror on PC1 setup with /dev/da1s1d and /dev/ggate0d. Was working great. I then simulated a failure in the network by killing ggated on PC2. gmirror saw the problem, marked the array accordingly. I then bought ggated back up on PC2. To my disappointment, ggatec had apparantly closed once there was a failure (thought it may have tried to reconnect at a given interval or something like NFS). However, when I ran "ggatec list", it showed "ggate0", and an ls of /dev showed a ggate0 as well....but no ggatec process was running. It's like when ggatec could not talk to ggated anymore it just gave up and quit, not cleaning up after itself at all...this can't be right...at least....I wouldn't think it to be right. Is it supposed to work like this (not cleaning up)? If so, I'm curious as to why. On a side note, it would be awesome if ggatec COULD have a background option...where if it can't contact the ggated host to wait and try again after a certain time. Thanks, --Brian From owner-freebsd-geom@FreeBSD.ORG Wed Jan 19 18:26:44 2005 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id E8FF716A4CE for ; Wed, 19 Jan 2005 18:26:44 +0000 (GMT) Received: from darkness.comp.waw.pl (darkness.comp.waw.pl [195.117.238.136]) by mx1.FreeBSD.org (Postfix) with ESMTP id 6C9C643D5F for ; Wed, 19 Jan 2005 18:26:44 +0000 (GMT) (envelope-from pjd@darkness.comp.waw.pl) Received: by darkness.comp.waw.pl (Postfix, from userid 1009) id B3BD6ACB34; Wed, 19 Jan 2005 19:26:41 +0100 (CET) Date: Wed, 19 Jan 2005 19:26:41 +0100 From: Pawel Jakub Dawidek To: Brian McCann Message-ID: <20050119182641.GO795@darkness.comp.waw.pl> References: <2b5f066d05011910056e7a69e1@mail.gmail.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="Q6K/XF9FZiHksLwH" Content-Disposition: inline In-Reply-To: <2b5f066d05011910056e7a69e1@mail.gmail.com> User-Agent: Mutt/1.4.2i X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 5.2.1-RC2 i386 cc: freebsd-geom@freebsd.org Subject: Re: ggatec reporting false info / not exiting correct? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Jan 2005 18:26:45 -0000 --Q6K/XF9FZiHksLwH Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Jan 19, 2005 at 01:05:22PM -0500, Brian McCann wrote: +> Hi all. I'm working on getting gmirror to work over ggate +> connections..and it's working well...just trying to break it and make +> recovery situations. However, I've discovered what I believe to be a +> flaw in ggatec. I had PC1 running ggatec and PC2 running ggated. PC2 +> was exporting /dev/da1s1d. I had gmirror on PC1 setup with +> /dev/da1s1d and /dev/ggate0d. Was working great. I then simulated a +> failure in the network by killing ggated on PC2. gmirror saw the +> problem, marked the array accordingly. I then bought ggated back up +> on PC2. To my disappointment, ggatec had apparantly closed once there +> was a failure (thought it may have tried to reconnect at a given +> interval or something like NFS). However, when I ran "ggatec list", +> it showed "ggate0", and an ls of /dev showed a ggate0 as well....but +> no ggatec process was running. It's like when ggatec could not talk +> to ggated anymore it just gave up and quit, not cleaning up after +> itself at all...this can't be right...at least....I wouldn't think it +> to be right. Is it supposed to work like this (not cleaning up)? If +> so, I'm curious as to why. On a side note, it would be awesome if +> ggatec COULD have a background option...where if it can't contact the +> ggated host to wait and try again after a certain time. And if you run: # ggatec attach -u 0 ... Does it work again? It should. --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --Q6K/XF9FZiHksLwH Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.4 (FreeBSD) iD8DBQFB7qZhForvXbEpPzQRAkk9AKCb0NnnsLEOsfhKb+z4WyTc1HYMiQCffkwT 0LIyNtgkA28CbRHPQMNEVLU= =5aqC -----END PGP SIGNATURE----- --Q6K/XF9FZiHksLwH-- From owner-freebsd-geom@FreeBSD.ORG Wed Jan 19 18:51:39 2005 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id BE4C816A4CE; Wed, 19 Jan 2005 18:51:39 +0000 (GMT) Received: from odin.ac.hmc.edu (Odin.AC.HMC.Edu [134.173.32.75]) by mx1.FreeBSD.org (Postfix) with ESMTP id 8E69F43D45; Wed, 19 Jan 2005 18:51:39 +0000 (GMT) (envelope-from brdavis@odin.ac.hmc.edu) Received: from odin.ac.hmc.edu (localhost.localdomain [127.0.0.1]) by odin.ac.hmc.edu (8.13.0/8.13.0) with ESMTP id j0JItvKI027994; Wed, 19 Jan 2005 10:55:57 -0800 Received: (from brdavis@localhost) by odin.ac.hmc.edu (8.13.0/8.13.0/Submit) id j0JItvDG027993; Wed, 19 Jan 2005 10:55:57 -0800 Date: Wed, 19 Jan 2005 10:55:57 -0800 From: Brooks Davis To: Paul Mather Message-ID: <20050119185557.GA25555@odin.ac.hmc.edu> References: <20050110163634.GA47526@engelschall.com> <1106144901.40972.11.camel@zappa.Chelsea-Ct.Org> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="X1bOJ3K7DJ5YkBrT" Content-Disposition: inline In-Reply-To: <1106144901.40972.11.camel@zappa.Chelsea-Ct.Org> User-Agent: Mutt/1.4.1i X-Virus-Scanned: by amavisd-new X-Spam-Status: No, hits=0.0 required=8.0 tests=none autolearn=no version=2.63 X-Spam-Checker-Version: SpamAssassin 2.63 (2004-01-11) on odin.ac.hmc.edu cc: "Ralf S. Engelschall" cc: freebsd-geom@freebsd.org Subject: Re: [HOWTO] FreeBSD system disk mirroring with GEOM X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Jan 2005 18:51:39 -0000 --X1bOJ3K7DJ5YkBrT Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Jan 19, 2005 at 09:28:21AM -0500, Paul Mather wrote: > On Mon, 2005-01-10 at 17:36 +0100, Ralf S. Engelschall wrote: > > FYI: I've prepared a detailed step-by-step command list on how to > > establish a RAID-1 (mirror) for the system partitions with GEOM and > > gmirror(8). You can find the resulting HOWTO document under > > http://people.freebsd.org/~rse/mirror/ >=20 > Congratulations on a useful and comprehensive HOWTO! I have only one > question: in the first approach ("Whole Disk, Acceptable, Less > Flexible"), why do you create a slice if you are using the whole disk > anyway? Is this simply because it's good form to put a valid partition > table on a bootable PC disk? >=20 > The reason I ask is because when I set up my bootable gmirror (using a > technique similar to the one you describe) I omitted the fdisk step and > used bsdlabel on (my equivalent of) /dev/mirror/gm0 (not gm0s1). I've > not had any problems booting the mirror, nor in using it. It also means > one less GEOM layer to go through, right? Since most RAID systems store their configuration infomration at the back of the disk, this is probalby OK since most BIOS's are OK with MRB partition tables that specify a geometry smaller then the disk. Given the generally broken state of BIOS implementations, I'm sure there's a least one out there that freaks out, but you appear not to have it. :-) -- Brooks --=20 Any statement of the form "X is the one, true Y" is FALSE. PGP fingerprint 655D 519C 26A7 82E7 2529 9BF0 5D8E 8BE9 F238 1AD4 --X1bOJ3K7DJ5YkBrT Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.1 (GNU/Linux) iD8DBQFB7q08XY6L6fI4GtQRAgNdAJ4ldFiQtinYFmCAnWJkAvclBeLJigCdFq4A F9rL7o0oYsTY3Lg7FSfPk/w= =5D4o -----END PGP SIGNATURE----- --X1bOJ3K7DJ5YkBrT-- From owner-freebsd-geom@FreeBSD.ORG Wed Jan 19 18:57:58 2005 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 420D016A4CE for ; Wed, 19 Jan 2005 18:57:58 +0000 (GMT) Received: from wproxy.gmail.com (wproxy.gmail.com [64.233.184.194]) by mx1.FreeBSD.org (Postfix) with ESMTP id A9A3543D2D for ; Wed, 19 Jan 2005 18:57:57 +0000 (GMT) (envelope-from bjmccann@gmail.com) Received: by wproxy.gmail.com with SMTP id 70so15778wra for ; Wed, 19 Jan 2005 10:57:57 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:references; b=ThH/gUfUA2Fk/gPiQkY+WZ3XW3sF6pop/iAZPEDX5ZGb/bywcrEv6RyXgVirgkNSt2kOhcXUPNzMNQMV1WM5n5nAwUDjjgMwyxked35nG5fq2U4EHMZcgOJ7Gf9X9ZmxSRGg+Hb1uuwdGoQ63Cq68RiqPGcojJ2WBc4qCusTyqM= Received: by 10.54.50.73 with SMTP id x73mr201176wrx; Wed, 19 Jan 2005 10:57:56 -0800 (PST) Received: by 10.54.33.61 with HTTP; Wed, 19 Jan 2005 10:57:56 -0800 (PST) Message-ID: <2b5f066d0501191057549101c0@mail.gmail.com> Date: Wed, 19 Jan 2005 13:57:56 -0500 From: Brian McCann To: Pawel Jakub Dawidek In-Reply-To: <20050119182641.GO795@darkness.comp.waw.pl> Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit References: <2b5f066d05011910056e7a69e1@mail.gmail.com> <20050119182641.GO795@darkness.comp.waw.pl> cc: freebsd-geom@freebsd.org Subject: Re: ggatec reporting false info / not exiting correct? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: Brian McCann List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Jan 2005 18:57:58 -0000 Yes...it did. Didn't quite understand what attach did. :) Thanks! --Brian P.S.: ggate is really awesome...thanks again! On Wed, 19 Jan 2005 19:26:41 +0100, Pawel Jakub Dawidek wrote: > On Wed, Jan 19, 2005 at 01:05:22PM -0500, Brian McCann wrote: > +> Hi all. I'm working on getting gmirror to work over ggate > +> connections..and it's working well...just trying to break it and make > +> recovery situations. However, I've discovered what I believe to be a > +> flaw in ggatec. I had PC1 running ggatec and PC2 running ggated. PC2 > +> was exporting /dev/da1s1d. I had gmirror on PC1 setup with > +> /dev/da1s1d and /dev/ggate0d. Was working great. I then simulated a > +> failure in the network by killing ggated on PC2. gmirror saw the > +> problem, marked the array accordingly. I then bought ggated back up > +> on PC2. To my disappointment, ggatec had apparantly closed once there > +> was a failure (thought it may have tried to reconnect at a given > +> interval or something like NFS). However, when I ran "ggatec list", > +> it showed "ggate0", and an ls of /dev showed a ggate0 as well....but > +> no ggatec process was running. It's like when ggatec could not talk > +> to ggated anymore it just gave up and quit, not cleaning up after > +> itself at all...this can't be right...at least....I wouldn't think it > +> to be right. Is it supposed to work like this (not cleaning up)? If > +> so, I'm curious as to why. On a side note, it would be awesome if > +> ggatec COULD have a background option...where if it can't contact the > +> ggated host to wait and try again after a certain time. > > And if you run: > > # ggatec attach -u 0 ... > > Does it work again? It should. > > -- > Pawel Jakub Dawidek http://www.wheel.pl > pjd@FreeBSD.org http://www.FreeBSD.org > FreeBSD committer Am I Evil? Yes, I Am! > > > From owner-freebsd-geom@FreeBSD.ORG Thu Jan 20 21:34:21 2005 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 98DD816A4CE for ; Thu, 20 Jan 2005 21:34:21 +0000 (GMT) Received: from darkness.comp.waw.pl (darkness.comp.waw.pl [195.117.238.136]) by mx1.FreeBSD.org (Postfix) with ESMTP id 2AC9543D1F for ; Thu, 20 Jan 2005 21:34:21 +0000 (GMT) (envelope-from pjd@darkness.comp.waw.pl) Received: by darkness.comp.waw.pl (Postfix, from userid 1009) id C6E33ACBD6; Thu, 20 Jan 2005 22:34:18 +0100 (CET) Date: Thu, 20 Jan 2005 22:34:18 +0100 From: Pawel Jakub Dawidek To: freebsd-geom@freebsd.org Message-ID: <20050120213418.GT795@darkness.comp.waw.pl> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="f3bMXCeKxSopGW1v" Content-Disposition: inline User-Agent: Mutt/1.4.2i X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 5.2.1-RC2 i386 Subject: GEOM_MBR patch for review. X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Jan 2005 21:34:21 -0000 --f3bMXCeKxSopGW1v Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hello. Patch below allows to protect against recursive slices creation in simlar way as BSD class does this, ie. by calculating md5 sum of the first sector and checking if provider below us is using metadata from the same sector. http://people.freebsd.org/~pjd/patches/geom_mbr.c.2.patch It allows to remove hack for geoms with rank !=3D 1. Comments? --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --f3bMXCeKxSopGW1v Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.4 (FreeBSD) iD8DBQFB8CPaForvXbEpPzQRAjYoAJ9VLxhommmfDXoHStecDQlLjeR6tACfZW1f G1HnzqwXW7+OgwgS8Y7e+4Q= =SCKh -----END PGP SIGNATURE----- --f3bMXCeKxSopGW1v-- From owner-freebsd-geom@FreeBSD.ORG Thu Jan 20 21:40:42 2005 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 1911A16A4CE; Thu, 20 Jan 2005 21:40:42 +0000 (GMT) Received: from critter.freebsd.dk (f170.freebsd.dk [212.242.86.170]) by mx1.FreeBSD.org (Postfix) with ESMTP id 627EF43D4C; Thu, 20 Jan 2005 21:40:41 +0000 (GMT) (envelope-from phk@critter.freebsd.dk) Received: from critter.freebsd.dk (localhost [127.0.0.1]) by critter.freebsd.dk (8.13.1/8.13.1) with ESMTP id j0KLeeCc007280; Thu, 20 Jan 2005 22:40:40 +0100 (CET) (envelope-from phk@critter.freebsd.dk) To: Pawel Jakub Dawidek From: "Poul-Henning Kamp" In-Reply-To: Your message of "Thu, 20 Jan 2005 22:34:18 +0100." <20050120213418.GT795@darkness.comp.waw.pl> Date: Thu, 20 Jan 2005 22:40:40 +0100 Message-ID: <7279.1106257240@critter.freebsd.dk> Sender: phk@critter.freebsd.dk cc: freebsd-geom@freebsd.org Subject: Re: GEOM_MBR patch for review. X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Jan 2005 21:40:42 -0000 Go for it! In message <20050120213418.GT795@darkness.comp.waw.pl>, Pawel Jakub Dawidek wri tes: > >--f3bMXCeKxSopGW1v >Content-Type: text/plain; charset=iso-8859-2 >Content-Disposition: inline >Content-Transfer-Encoding: quoted-printable > >Hello. > >Patch below allows to protect against recursive slices creation in simlar >way as BSD class does this, ie. by calculating md5 sum of the first sector >and checking if provider below us is using metadata from the same sector. > > http://people.freebsd.org/~pjd/patches/geom_mbr.c.2.patch > >It allows to remove hack for geoms with rank !=3D 1. >Comments? > >--=20 >Pawel Jakub Dawidek http://www.wheel.pl >pjd@FreeBSD.org http://www.FreeBSD.org >FreeBSD committer Am I Evil? Yes, I Am! > >--f3bMXCeKxSopGW1v >Content-Type: application/pgp-signature >Content-Disposition: inline > >-----BEGIN PGP SIGNATURE----- >Version: GnuPG v1.2.4 (FreeBSD) > >iD8DBQFB8CPaForvXbEpPzQRAjYoAJ9VLxhommmfDXoHStecDQlLjeR6tACfZW1f >G1HnzqwXW7+OgwgS8Y7e+4Q= >=SCKh >-----END PGP SIGNATURE----- > >--f3bMXCeKxSopGW1v-- > -- Poul-Henning Kamp | UNIX since Zilog Zeus 3.20 phk@FreeBSD.ORG | TCP/IP since RFC 956 FreeBSD committer | BSD since 4.3-tahoe Never attribute to malice what can adequately be explained by incompetence.