From owner-freebsd-geom@FreeBSD.ORG Mon Oct 4 08:44:49 2004 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 2A38A16A4CE for ; Mon, 4 Oct 2004 08:44:49 +0000 (GMT) Received: from clueful.shagged.org (clueful.shagged.org [212.13.201.101]) by mx1.FreeBSD.org (Postfix) with ESMTP id C625943D48 for ; Mon, 4 Oct 2004 08:44:48 +0000 (GMT) (envelope-from chris@clueful.shagged.org) Received: from chris by clueful.shagged.org with local (Exim 4.40 (FreeBSD)) id 1CEOSY-000H60-Hb for freebsd-geom@freebsd.org; Mon, 04 Oct 2004 09:44:42 +0100 Date: Mon, 4 Oct 2004 09:44:42 +0100 From: Chris Elsworth To: freebsd-geom@freebsd.org Message-ID: <20041004084442.GA65504@shagged.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.5.6i Sender: Chris Elsworth X-Shagged-MailScanner-Information: See www.mailscanner.info for information X-Shagged-MailScanner: Found to be clean X-MailScanner-From: chris@clueful.shagged.org Subject: SCSI disk getting disconnected on boot X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 04 Oct 2004 08:44:49 -0000 Hello, After having a two-way gmirror happily working for a few days, upon rebooting both machines, they both seem to have lost half the mirror. Here's the debug output from bootup on one of them: Waiting 5 seconds for SCSI devices to settle GEOM_MIRROR[2]: Tasting acd0. da0 at ahc0 bus 0 target 0 lun 0 da0: Fixed Direct Access SCSI-3 device da0: 160.000MB/s transfers (80.000MHz, offset 127, 16bit), Tagged Queueing Enabd da0: 34732MB (71132959 512 byte sectors: 255H 63S/T 4427C) da1 at ahc0 bus 0 target 1 lun 0 da1: Fixed Direct Access SCSI-3 device da1: 160.000MB/s transfers (80.000MHz, offset 127, 16bit), Tagged Queueing Enabd da1: 34732MB (71132959 512 byte sectors: 255H 63S/T 4427C) GEOM_MIRROR[2]: Tasting da0. SMP: AP CPU #1 Launched! magic: GEOM::MIRROR version: 1 name: gm mid: 1573691141 did: 1965364196 all: 2 syncid: 3 priority: 0 slice: 4096 balance: split mediasize: 36420074496 sectorsize: 512 syncoffset: 12766412800 mflags: NONE dflags: DIRTY SYNCHRONIZING hcprovider: da0 MD5 hash: ad3dd443dde332bde5d63b262571dcc9 GEOM_MIRROR[1]: Creating device gm (id=1573691141). GEOM_MIRROR[0]: Device gm created (id=1573691141). GEOM_MIRROR[1]: Adding disk da0 to gm. GEOM_MIRROR[2]: Adding disk da0. GEOM_MIRROR[2]: Disk da0 connected. GEOM_MIRROR[1]: Disk da0 state changed from NONE to NEW (device gm). GEOM_MIRROR[0]: Device gm: provider da0 detected. GEOM_MIRROR[2]: Tasting da1. magic: GEOM::MIRROR version: 1 name: gm mid: 1573691141 did: 4008348218 all: 2 syncid: 3 priority: 0 slice: 4096 balance: split mediasize: 36420074496 sectorsize: 512 syncoffset: 0 mflags: NONE dflags: NONE hcprovider: da1 MD5 hash: e6584ea109907134ce7285853c7bbcb1 GEOM_MIRROR[1]: Adding disk da1 to gm. GEOM_MIRROR[2]: Adding disk da1. GEOM_MIRROR[2]: Disk da1 connected. GEOM_MIRROR[1]: Disk da1 state changed from NONE to NEW (device gm). GEOM_MIRROR[0]: Device gm: provider da1 detected. GEOM_MIRROR[1]: Device gm state changed from STARTING to RUNNING. GEOM_MIRROR[1]: Disk da1 state changed from NEW to ACTIVE (device gm). GEOM_MIRROR[2]: Access da1 r0w1e1 = 0 GEOM_MIRROR[2]: Tasting da0a. GEOM_MIRROR[2]: Access da1 r0w-1e-1 = 0 GEOM_MIRROR[2]: Metadata on da1 updated. GEOM_MIRROR[0]: Device gm: provider da1 activated. GEOM_MIRROR[1]: Disk da0 state changed from NEW to SYNCHRONIZING (device gm). GEOM_MIRROR[0]: Device gm: provider mirror/gm launched. GEOM_MIRROR[0]: Device gm: rebuilding provider da0. GEOM_MIRROR[2]: Access da0 r0w1e1 = 1 GEOM_MIRROR[1]: Disk da0 state changed from SYNCHRONIZING to DISCONNECTED (devi. GEOM_MIRROR[0]: Device gm: provider da0 disconnected. GEOM_MIRROR[2]: Disk da0 disconnected. GEOM_MIRROR[2]: Consumer da0 destroyed. GEOM_MIRROR[2]: Tasting da0b. GEOM_MIRROR[2]: Tasting da0c. GEOM_MIRROR[2]: Tasting da0d. GEOM_MIRROR[2]: Tasting da0e. GEOM_MIRROR[2]: Tasting da0f. GEOM_MIRROR[2]: Tasting da0g. GEOM_MIRROR[2]: Tasting da1a. GEOM_MIRROR[2]: Tasting da1b. GEOM_MIRROR[2]: Tasting da1c. GEOM_MIRROR[2]: Tasting da1d. GEOM_MIRROR[2]: Tasting da1e. GEOM_MIRROR[2]: Tasting da1f. GEOM_MIRROR[2]: Tasting da1g. GEOM_MIRROR[2]: Tasting mirror/gm. GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e0. GEOM_MIRROR[2]: Access da1 r1w0e1 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e0. GEOM_MIRROR[2]: Access da1 r-1w0e-1 = 0 ... After this there's lots of access requests for various da1 partitions, all of which succeed. The system boots normally from here, using the gmirror device with just one provider left. I have to activate da0 in order to get it to resync. You'll notice that in this particular case, da0 was still resyncing when I rebooted the machine, but this is reproducible even if both halves of the mirror are synced. I'd expected that even in the case of rebooting during a resync, the resync should restart after a boot, not disconnect the drive. The only explanation I could think of - da0 is the boot device; is this locking the metadata against being updated somehow? Would using mirror devices of da0s1 and da1s1 get round this? Appreciate any input :) -- Chris From owner-freebsd-geom@FreeBSD.ORG Mon Oct 4 09:02:30 2004 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 4E95D16A4CE for ; Mon, 4 Oct 2004 09:02:30 +0000 (GMT) Received: from darkness.comp.waw.pl (darkness.comp.waw.pl [195.117.238.136]) by mx1.FreeBSD.org (Postfix) with ESMTP id E53DD43D2D for ; Mon, 4 Oct 2004 09:02:29 +0000 (GMT) (envelope-from pjd@darkness.comp.waw.pl) Received: by darkness.comp.waw.pl (Postfix, from userid 1009) id C93B5ACC62; Mon, 4 Oct 2004 11:02:27 +0200 (CEST) Date: Mon, 4 Oct 2004 11:02:27 +0200 From: Pawel Jakub Dawidek To: Chris Elsworth Message-ID: <20041004090227.GB73767@darkness.comp.waw.pl> References: <20041004084442.GA65504@shagged.org> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="H+4ONPRPur6+Ovig" Content-Disposition: inline In-Reply-To: <20041004084442.GA65504@shagged.org> User-Agent: Mutt/1.4.2i X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 5.2.1-RC2 i386 cc: freebsd-geom@freebsd.org Subject: Re: SCSI disk getting disconnected on boot X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 04 Oct 2004 09:02:30 -0000 --H+4ONPRPur6+Ovig Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Oct 04, 2004 at 09:44:42AM +0100, Chris Elsworth wrote: +> GEOM_MIRROR[0]: Device gm: provider da1 activated. +> GEOM_MIRROR[1]: Disk da0 state changed from NEW to SYNCHRONIZING (device= gm). +> GEOM_MIRROR[0]: Device gm: provider mirror/gm launched. +> GEOM_MIRROR[0]: Device gm: rebuilding provider da0. +> GEOM_MIRROR[2]: Access da0 r0w1e1 =3D 1 +> GEOM_MIRROR[1]: Disk da0 state changed from SYNCHRONIZING to DISCONNECTE= D (devi. +> GEOM_MIRROR[0]: Device gm: provider da0 disconnected. +> GEOM_MIRROR[2]: Disk da0 disconnected. [...] +> The only explanation I could think of - da0 is the boot device; [...] I don't understand. You mirror da0 and da1 and still have da0 in your /etc/fstab? Could you provide your /etc/fstab? +> [...] Would using +> mirror devices of da0s1 and da1s1 get round this? If you open some partitions on da0 for writing, it will be disconnected from the mirror. In that case using daXs1 should help, but the truth is, that you shouldn't use da0 anymore (use /dev/mirror/gm instead). --=20 Pawel Jakub Dawidek http://www.FreeBSD.org pjd@FreeBSD.org http://garage.freebsd.pl FreeBSD committer Am I Evil? Yes, I Am! --H+4ONPRPur6+Ovig Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.4 (FreeBSD) iD8DBQFBYRGjForvXbEpPzQRAmYcAJ4nRST1F/9k9fd+gaT+pSfMPg+AZgCgzR5j q3HZb8YWrNkNxpcr9qaukJ4= =ZMSY -----END PGP SIGNATURE----- --H+4ONPRPur6+Ovig-- From owner-freebsd-geom@FreeBSD.ORG Mon Oct 4 09:15:17 2004 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id AA23A16A4CF; Mon, 4 Oct 2004 09:15:17 +0000 (GMT) Received: from clueful.shagged.org (clueful.shagged.org [212.13.201.101]) by mx1.FreeBSD.org (Postfix) with ESMTP id 019F243D1F; Mon, 4 Oct 2004 09:15:17 +0000 (GMT) (envelope-from chris@clueful.shagged.org) Received: from chris by clueful.shagged.org with local (Exim 4.40 (FreeBSD)) id 1CEOw1-000HZZ-Bg; Mon, 04 Oct 2004 10:15:09 +0100 Date: Mon, 4 Oct 2004 10:15:09 +0100 From: Chris Elsworth To: Pawel Jakub Dawidek Message-ID: <20041004091509.GB65504@shagged.org> References: <20041004084442.GA65504@shagged.org> <20041004090227.GB73767@darkness.comp.waw.pl> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20041004090227.GB73767@darkness.comp.waw.pl> User-Agent: Mutt/1.5.6i Sender: Chris Elsworth X-Shagged-MailScanner-Information: See www.mailscanner.info for information X-Shagged-MailScanner: Found to be clean X-MailScanner-From: chris@clueful.shagged.org cc: freebsd-geom@freebsd.org Subject: Re: SCSI disk getting disconnected on boot X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 04 Oct 2004 09:15:17 -0000 On Mon, Oct 04, 2004 at 11:02:27AM +0200, Pawel Jakub Dawidek wrote: > On Mon, Oct 04, 2004 at 09:44:42AM +0100, Chris Elsworth wrote: > +> GEOM_MIRROR[0]: Device gm: provider da1 activated. > +> GEOM_MIRROR[1]: Disk da0 state changed from NEW to SYNCHRONIZING (device gm). > +> GEOM_MIRROR[0]: Device gm: provider mirror/gm launched. > +> GEOM_MIRROR[0]: Device gm: rebuilding provider da0. > +> GEOM_MIRROR[2]: Access da0 r0w1e1 = 1 > +> GEOM_MIRROR[1]: Disk da0 state changed from SYNCHRONIZING to DISCONNECTED (devi. > +> GEOM_MIRROR[0]: Device gm: provider da0 disconnected. > +> GEOM_MIRROR[2]: Disk da0 disconnected. > [...] > +> The only explanation I could think of - da0 is the boot device; [...] > > I don't understand. You mirror da0 and da1 and still have da0 > in your /etc/fstab? Could you provide your /etc/fstab? No, I don't have da0 in fstab.. here it is: # cat /etc/fstab # Device Mountpoint FStype Options Dump Pass# /dev/mirror/gmb none swap sw 0 0 /dev/mirror/gma / ufs rw 1 1 /dev/mirror/gmd /tmp ufs rw 2 2 /dev/mirror/gme /var ufs rw 2 2 /dev/mirror/gmf /usr ufs rw 2 2 /dev/mirror/gmg /jail ufs rw 2 2 /dev/mirror/gmh /dump ufs rw 2 2 /dev/acd0 /cdrom cd9660 ro,noauto 0 0 When I say da0 is the boot device, I mean that's the device that the SCSI card is presenting to the BIOS to boot off. So loader and kernel get booted off da0, then control is passed to gmirror to mount root and so forth. > > +> [...] Would using > +> mirror devices of da0s1 and da1s1 get round this? > > If you open some partitions on da0 for writing, it will be disconnected > from the mirror. In that case using daXs1 should help, but the truth is, > that you shouldn't use da0 anymore (use /dev/mirror/gm instead). Understood, but no, I'm not doing that. I have debug output from a fully syncronized mirror now; after reboot, again, da0 disconnected itself from the mirror: GEOM_MIRROR[2]: Tasting da0. magic: GEOM::MIRROR version: 1 name: gm mid: 2253826535 did: 2995324107 all: 2 syncid: 3 priority: 0 slice: 4096 balance: split mediasize: 36420074496 sectorsize: 512 syncoffset: 0 mflags: NONE dflags: NONE hcprovider: MD5 hash: 0d65c18a4da4cb103c3e16965f2416c8 GEOM_MIRROR[1]: Creating device gm (id=2253826535). GEOM_MIRROR[0]: Device gm created (id=2253826535). GEOM_MIRROR[1]: Adding disk da0 to gm. GEOM_MIRROR[2]: Adding disk da0. GEOM_MIRROR[2]: Disk da0 connected. GEOM_MIRROR[1]: Disk da0 state changed from NONE to NEW (device gm). GEOM_MIRROR[0]: Device gm: provider da0 detected. GEOM_MIRROR[2]: Tasting da1. magic: GEOM::MIRROR version: 1 name: gm mid: 2253826535 did: 1391052059 all: 2 syncid: 3 priority: 0 slice: 4096 balance: split mediasize: 36420074496 sectorsize: 512 syncoffset: 0 mflags: NONE dflags: NONE hcprovider: MD5 hash: 32c605033e8e4c80676fd51cca81f5ae GEOM_MIRROR[1]: Adding disk da1 to gm. GEOM_MIRROR[2]: Adding disk da1. GEOM_MIRROR[2]: Disk da1 connected. GEOM_MIRROR[1]: Disk da1 state changed from NONE to NEW (device gm). GEOM_MIRROR[0]: Device gm: provider da1 detected. GEOM_MIRROR[1]: Device gm state changed from STARTING to RUNNING. GEOM_MIRROR[1]: Disk da1 state changed from NEW to ACTIVE (device gm). GEOM_MIRROR[2]: Access da1 r0w1e1 = 0 GEOM_MIRROR[2]: Tasting da0a. GEOM_MIRROR[2]: Access da1 r0w-1e-1 = 0 GEOM_MIRROR[2]: Metadata on da1 updated. GEOM_MIRROR[0]: Device gm: provider da1 activated. GEOM_MIRROR[1]: Disk da0 state changed from NEW to ACTIVE (device gm). GEOM_MIRROR[2]: Access da0 r0w1e1 = 1 GEOM_MIRROR[0]: Cannot update metadata on disk da0 (error=1). GEOM_MIRROR[0]: Device gm: provider da0 activated. GEOM_MIRROR[0]: Device gm: provider mirror/gm launched. GEOM_MIRROR[1]: Device gm: syncid bumped to 4. GEOM_MIRROR[2]: Access da1 r0w1e1 = 0 GEOM_MIRROR[2]: Tasting da0b. GEOM_MIRROR[2]: Access da1 r0w-1e-1 = 0 GEOM_MIRROR[2]: Metadata on da1 updated. GEOM_MIRROR[2]: Access da0 r0w1e1 = 1 GEOM_MIRROR[0]: Cannot update metadata on disk da0 (error=1). GEOM_MIRROR[1]: Disk da0 state changed from ACTIVE to DISCONNECTED (device gm). GEOM_MIRROR[0]: Device gm: provider da0 disconnected. GEOM_MIRROR[2]: Disk da0 disconnected. GEOM_MIRROR[2]: Consumer da0 destroyed. GEOM_MIRROR[1]: Device gm: syncid bumped to 5. GEOM_MIRROR[2]: Access da1 r0w1e1 = 0 GEOM_MIRROR[2]: Tasting da0c. GEOM_MIRROR[2]: Access da1 r0w-1e-1 = 0 GEOM_MIRROR[2]: Metadata on da1 updated. GEOM_MIRROR[2]: Tasting da0d. GEOM_MIRROR[2]: Tasting da0e. GEOM_MIRROR[2]: Tasting da0f. GEOM_MIRROR[2]: Tasting da0g. GEOM_MIRROR[2]: Tasting da0h. GEOM_MIRROR[2]: Tasting da1a. GEOM_MIRROR[2]: Tasting da1b. GEOM_MIRROR[2]: Tasting da1c. GEOM_MIRROR[2]: Tasting da1d. GEOM_MIRROR[2]: Tasting da1e. GEOM_MIRROR[2]: Tasting da1f. GEOM_MIRROR[2]: Tasting da1g. GEOM_MIRROR[2]: Tasting da1h. GEOM_MIRROR[2]: Tasting mirror/gm. GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e0. GEOM_MIRROR[2]: Access da1 r1w0e1 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e0. GEOM_MIRROR[2]: Access da1 r-1w0e-1 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e0. GEOM_MIRROR[2]: Access da1 r1w0e1 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e0. GEOM_MIRROR[2]: Access da1 r-1w0e-1 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e0. GEOM_MIRROR[2]: Access da1 r1w0e1 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e0. GEOM_MIRROR[2]: Access da1 r-1w0e-1 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e0. GEOM_MIRROR[2]: Access da1 r1w0e1 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e0. GEOM_MIRROR[2]: Access da1 r-1w0e-1 = 0 GEOM_MIRROR[2]: Tasting mirror/gma. GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e1. GEOM_MIRROR[2]: Access da1 r1w0e2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e-1. GEOM_MIRROR[2]: Access da1 r-1w0e-2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e1. GEOM_MIRROR[2]: Access da1 r1w0e2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e-1. GEOM_MIRROR[2]: Access da1 r-1w0e-2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e1. GEOM_MIRROR[2]: Access da1 r1w0e2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e-1. GEOM_MIRROR[2]: Access da1 r-1w0e-2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e1. GEOM_MIRROR[2]: Access da1 r1w0e2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e-1. GEOM_MIRROR[2]: Access da1 r-1w0e-2 = 0 GEOM_MIRROR[2]: Tasting mirror/gmb. GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e1. GEOM_MIRROR[2]: Access da1 r1w0e2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e-1. GEOM_MIRROR[2]: Access da1 r-1w0e-2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e1. GEOM_MIRROR[2]: Access da1 r1w0e2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e-1. GEOM_MIRROR[2]: Access da1 r-1w0e-2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e1. GEOM_MIRROR[2]: Access da1 r1w0e2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e-1. GEOM_MIRROR[2]: Access da1 r-1w0e-2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e1. GEOM_MIRROR[2]: Access da1 r1w0e2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e-1. GEOM_MIRROR[2]: Access da1 r-1w0e-2 = 0 GEOM_MIRROR[2]: Tasting mirror/gmc. GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e1. GEOM_MIRROR[2]: Access da1 r1w0e2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e-1. GEOM_MIRROR[2]: Access da1 r-1w0e-2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e1. GEOM_MIRROR[2]: Access da1 r1w0e2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e-1. GEOM_MIRROR[2]: Access da1 r-1w0e-2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e1. GEOM_MIRROR[2]: Access da1 r1w0e2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e-1. GEOM_MIRROR[2]: Access da1 r-1w0e-2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e1. GEOM_MIRROR[2]: Access da1 r1w0e2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e-1. GEOM_MIRROR[2]: Access da1 r-1w0e-2 = 0 GEOM_MIRROR[2]: Tasting mirror/gmd. GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e1. GEOM_MIRROR[2]: Access da1 r1w0e2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e-1. GEOM_MIRROR[2]: Access da1 r-1w0e-2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e1. GEOM_MIRROR[2]: Access da1 r1w0e2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e-1. GEOM_MIRROR[2]: Access da1 r-1w0e-2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e1. GEOM_MIRROR[2]: Access da1 r1w0e2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e-1. GEOM_MIRROR[2]: Access da1 r-1w0e-2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e1. GEOM_MIRROR[2]: Access da1 r1w0e2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e-1. GEOM_MIRROR[2]: Access da1 r-1w0e-2 = 0 GEOM_MIRROR[2]: Tasting mirror/gme. GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e1. GEOM_MIRROR[2]: Access da1 r1w0e2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e-1. GEOM_MIRROR[2]: Access da1 r-1w0e-2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e1. GEOM_MIRROR[2]: Access da1 r1w0e2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e-1. GEOM_MIRROR[2]: Access da1 r-1w0e-2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e1. GEOM_MIRROR[2]: Access da1 r1w0e2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e-1. GEOM_MIRROR[2]: Access da1 r-1w0e-2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e1. GEOM_MIRROR[2]: Access da1 r1w0e2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e-1. GEOM_MIRROR[2]: Access da1 r-1w0e-2 = 0 GEOM_MIRROR[2]: Tasting mirror/gmf. GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e1. GEOM_MIRROR[2]: Access da1 r1w0e2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e-1. GEOM_MIRROR[2]: Access da1 r-1w0e-2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e1. GEOM_MIRROR[2]: Access da1 r1w0e2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e-1. GEOM_MIRROR[2]: Access da1 r-1w0e-2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e1. GEOM_MIRROR[2]: Access da1 r1w0e2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e-1. GEOM_MIRROR[2]: Access da1 r-1w0e-2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e1. GEOM_MIRROR[2]: Access da1 r1w0e2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e-1. GEOM_MIRROR[2]: Access da1 r-1w0e-2 = 0 GEOM_MIRROR[2]: Tasting mirror/gmg. GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e1. GEOM_MIRROR[2]: Access da1 r1w0e2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e-1. GEOM_MIRROR[2]: Access da1 r-1w0e-2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e1. GEOM_MIRROR[2]: Access da1 r1w0e2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e-1. GEOM_MIRROR[2]: Access da1 r-1w0e-2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e1. GEOM_MIRROR[2]: Access da1 r1w0e2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e-1. GEOM_MIRROR[2]: Access da1 r-1w0e-2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e1. GEOM_MIRROR[2]: Access da1 r1w0e2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e-1. GEOM_MIRROR[2]: Access da1 r-1w0e-2 = 0 GEOM_MIRROR[2]: Tasting mirror/gmh. GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e1. GEOM_MIRROR[2]: Access da1 r1w0e2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e-1. GEOM_MIRROR[2]: Access da1 r-1w0e-2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e1. GEOM_MIRROR[2]: Access da1 r1w0e2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e-1. GEOM_MIRROR[2]: Access da1 r-1w0e-2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e1. GEOM_MIRROR[2]: Access da1 r1w0e2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e-1. GEOM_MIRROR[2]: Access da1 r-1w0e-2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e1. GEOM_MIRROR[2]: Access da1 r1w0e2 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e-1. GEOM_MIRROR[2]: Access da1 r-1w0e-2 = 0 Mounting root from ufs:/dev/mirror/gma GEOM_MIRROR[2]: Access request for mirror/gm: r1w1e1. GEOM_MIRROR[2]: Access da1 r1w1e2 = 0 GEOM_MIRROR[1]: Disk da1 (device gm) marked as dirty. GEOM_MIRROR[2]: Metadata on da1 updated. GEOM_MIRROR[2]: Access request for mirror/gm: r1w1e0. GEOM_MIRROR[2]: Access da1 r1w1e0 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e0. GEOM_MIRROR[2]: Access da1 r1w0e0 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e0. GEOM_MIRROR[2]: Access da1 r-1w0e0 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e0. GEOM_MIRROR[2]: Access da1 r1w0e0 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r0w1e0. GEOM_MIRROR[2]: Access da1 r0w1e0 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e0. GEOM_MIRROR[2]: Access da1 r-1w0e0 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r0w-1e0. GEOM_MIRROR[2]: Access da1 r0w-1e0 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e0. GEOM_MIRROR[2]: Access da1 r1w0e0 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e0. GEOM_MIRROR[2]: Access da1 r-1w0e0 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e0. GEOM_MIRROR[2]: Access da1 r1w0e0 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e0. GEOM_MIRROR[2]: Access da1 r-1w0e0 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e0. GEOM_MIRROR[2]: Access da1 r1w0e0 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e0. GEOM_MIRROR[2]: Access da1 r-1w0e0 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e0. GEOM_MIRROR[2]: Access da1 r1w0e0 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e0. GEOM_MIRROR[2]: Access da1 r-1w0e0 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e0. GEOM_MIRROR[2]: Access da1 r1w0e0 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e0. GEOM_MIRROR[2]: Access da1 r-1w0e0 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e0. GEOM_MIRROR[2]: Access da1 r1w0e0 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e0. GEOM_MIRROR[2]: Access da1 r1w0e0 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r0w1e0. GEOM_MIRROR[2]: Access da1 r0w1e0 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r0w1e0. GEOM_MIRROR[2]: Access da1 r0w1e0 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e0. GEOM_MIRROR[2]: Access da1 r1w0e0 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e0. GEOM_MIRROR[2]: Access da1 r-1w0e0 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r0w-1e0. GEOM_MIRROR[2]: Access da1 r0w-1e0 = 0 GEOM_MIRROR[2]: Tasting mirror/gmf. GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e0. GEOM_MIRROR[2]: Access da1 r1w0e0 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e0. GEOM_MIRROR[2]: Access da1 r-1w0e0 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e0. GEOM_MIRROR[2]: Access da1 r-1w0e0 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e0. GEOM_MIRROR[2]: Access da1 r1w0e0 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e0. GEOM_MIRROR[2]: Access da1 r-1w0e0 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e0. GEOM_MIRROR[2]: Access da1 r1w0e0 = 0 GEOM_MIRROR[2]: Access da1 r-1w0e0 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e0. GEOM_MIRROR[2]: Access da1 r1w0e0 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e0. GEOM_MIRROR[2]: Access da1 r-1w0e0 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r0w-1e0. GEOM_MIRROR[2]: Access da1 r0w-1e0 = 0 GEOM_MIRROR[2]: Tasting mirror/gmd. GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e0. GEOM_MIRROR[2]: Access da1 r1w0e0 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r0w1e0. GEOM_MIRROR[2]: Access da1 r0w1e0 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e0. GEOM_MIRROR[2]: Access da1 r-1w0e0 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e0. GEOM_MIRROR[2]: Access da1 r1w0e0 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e0. GEOM_MIRROR[2]: Access da1 r-1w0e0 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e0. GEOM_MIRROR[2]: Access da1 r1w0e0 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e0. GEOM_MIRROR[2]: Access da1 r-1w0e0 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e0. GEOM_MIRROR[2]: Access da1 r1w0e0 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r-1w0e0. GEOM_MIRROR[2]: Access da1 r-1w0e0 = 0 GEOM_MIRROR[2]: Access request for mirror/gm: r1w0e0. [snip, I think you get the idea] It however has no problems re-activating the mirror immediately after boot when I ask it to. It doesn't seem to be related to the order of devices in the mirror either; the first device was da1, the second da0, this time. -- Chris From owner-freebsd-geom@FreeBSD.ORG Mon Oct 4 10:24:15 2004 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 0022F16A4CE for ; Mon, 4 Oct 2004 10:24:14 +0000 (GMT) Received: from darkness.comp.waw.pl (darkness.comp.waw.pl [195.117.238.136]) by mx1.FreeBSD.org (Postfix) with ESMTP id 7232043D1D for ; Mon, 4 Oct 2004 10:24:14 +0000 (GMT) (envelope-from pjd@darkness.comp.waw.pl) Received: by darkness.comp.waw.pl (Postfix, from userid 1009) id B3DF0AC977; Mon, 4 Oct 2004 12:24:11 +0200 (CEST) Date: Mon, 4 Oct 2004 12:24:11 +0200 From: Pawel Jakub Dawidek To: Chris Elsworth Message-ID: <20041004102411.GC73767@darkness.comp.waw.pl> References: <20041004084442.GA65504@shagged.org> <20041004090227.GB73767@darkness.comp.waw.pl> <20041004091509.GB65504@shagged.org> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="f+W+jCU1fRNres8c" Content-Disposition: inline In-Reply-To: <20041004091509.GB65504@shagged.org> User-Agent: Mutt/1.4.2i X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 5.2.1-RC2 i386 cc: freebsd-geom@freebsd.org Subject: Re: SCSI disk getting disconnected on boot X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 04 Oct 2004 10:24:15 -0000 --f+W+jCU1fRNres8c Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Oct 04, 2004 at 10:15:09AM +0100, Chris Elsworth wrote: +> GEOM_MIRROR[1]: Disk da0 state changed from NEW to ACTIVE (device gm). +> GEOM_MIRROR[2]: Access da0 r0w1e1 =3D 1 +> GEOM_MIRROR[0]: Cannot update metadata on disk da0 (error=3D1). I haven't seen this error before. Simlar race was reported earlier. Could you try this patch: http://people.freebsd.org/~pjd/patches/gmirror.patch (You need to recompile you kernel and geom_mirror.ko module.) --=20 Pawel Jakub Dawidek http://www.FreeBSD.org pjd@FreeBSD.org http://garage.freebsd.pl FreeBSD committer Am I Evil? Yes, I Am! --f+W+jCU1fRNres8c Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.4 (FreeBSD) iD8DBQFBYSTLForvXbEpPzQRAihYAKCoR6UKvDQT505nnw+AAJLavSxSOwCgg8XP /ZsjbLsL/pKlJDcJz3ZBAOY= =c3SU -----END PGP SIGNATURE----- --f+W+jCU1fRNres8c-- From owner-freebsd-geom@FreeBSD.ORG Mon Oct 4 11:06:42 2004 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id A2BAB16A4CF; Mon, 4 Oct 2004 11:06:42 +0000 (GMT) Received: from clueful.shagged.org (clueful.shagged.org [212.13.201.101]) by mx1.FreeBSD.org (Postfix) with ESMTP id 4096843D49; Mon, 4 Oct 2004 11:06:42 +0000 (GMT) (envelope-from chris@clueful.shagged.org) Received: from chris by clueful.shagged.org with local (Exim 4.40 (FreeBSD)) id 1CEQft-000J2W-Hg; Mon, 04 Oct 2004 12:06:37 +0100 Date: Mon, 4 Oct 2004 12:06:37 +0100 From: Chris Elsworth To: Pawel Jakub Dawidek Message-ID: <20041004110637.GA72685@shagged.org> References: <20041004084442.GA65504@shagged.org> <20041004090227.GB73767@darkness.comp.waw.pl> <20041004091509.GB65504@shagged.org> <20041004102411.GC73767@darkness.comp.waw.pl> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20041004102411.GC73767@darkness.comp.waw.pl> User-Agent: Mutt/1.5.6i Sender: Chris Elsworth X-Shagged-MailScanner-Information: See www.mailscanner.info for information X-Shagged-MailScanner: Found to be clean X-MailScanner-From: chris@clueful.shagged.org cc: freebsd-geom@freebsd.org Subject: Re: SCSI disk getting disconnected on boot X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 04 Oct 2004 11:06:42 -0000 On Mon, Oct 04, 2004 at 12:24:11PM +0200, Pawel Jakub Dawidek wrote: > On Mon, Oct 04, 2004 at 10:15:09AM +0100, Chris Elsworth wrote: > +> GEOM_MIRROR[1]: Disk da0 state changed from NEW to ACTIVE (device gm). > +> GEOM_MIRROR[2]: Access da0 r0w1e1 = 1 > +> GEOM_MIRROR[0]: Cannot update metadata on disk da0 (error=1). > > I haven't seen this error before. > Simlar race was reported earlier. Could you try this patch: > > http://people.freebsd.org/~pjd/patches/gmirror.patch > > (You need to recompile you kernel and geom_mirror.ko module.) Hello Pawel, Oh dear - this seems to have made it worse :( My boot procedure is now as follows (started from the first GEOM_MIRROR output) GEOM_MIRROR[2]: Tasting fd0. acd0: CDROM at ata0-master PIO4 Waiting 5 seconds for SCSI devices to settle GEOM_MIRROR[2]: Tasting acd0. da0 at ahc0 bus 0 target 0 lun 0 da0: Fixed Direct Access SCSI-3 device da0: 160.000MB/s transfers (80.000MHz, offset 127, 16bit), Tagged Queueing Enabd da0: 34732MB (71132959 512 byte sectors: 255H 63S/T 4427C) da1 at ahc0 bus 0 target 1 lun 0 da1: Fixed Direct Access SCSI-3 device da1: 160.000MB/s transfers (80.000MHz, offset 127, 16bit), Tagged Queueing Enabd da1: 34732MB (71132959 512 byte sectors: 255H 63S/T 4427C) GEOM_MIRROR[2]: Tasting da0. SMP: AP CPU #1 Launched! magic: GEOM::MIRROR version: 1 name: gm mid: 2253826535 did: 2995324107 all: 2 syncid: 5 priority: 0 slice: 4096 balance: split mediasize: 36420074496 sectorsize: 512 syncoffset: 0 mflags: NONE dflags: NONE hcprovider: MD5 hash: 0cc1a692117f8e6afef48b4c45452382 GEOM_MIRROR[1]: Creating device gm (id=2253826535). GEOM_MIRROR[0]: Device gm created (id=2253826535). GEOM_MIRROR[1]: Adding disk da0 to gm. GEOM_MIRROR[2]: Adding disk da0. GEOM_MIRROR[2]: Disk da0 connected. GEOM_MIRROR[1]: Disk da0 state changed from NONE to NEW (device gm). GEOM_MIRROR[0]: Device gm: provider da0 detected. GEOM_MIRROR[2]: Tasting da1. magic: GEOM::MIRROR version: 1 name: gm mid: 2253826535 did: 1391052059 all: 2 syncid: 6 priority: 0 slice: 4096 balance: split mediasize: 36420074496 sectorsize: 512 syncoffset: 0 mflags: NONE dflags: NONE hcprovider: MD5 hash: 30f8adf515872347230b383c5af68b4f GEOM_MIRROR[1]: Adding disk da1 to gm. GEOM_MIRROR[2]: Adding disk da1. GEOM_MIRROR[2]: Disk da1 connected. GEOM_MIRROR[1]: Disk da1 state changed from NONE to NEW (device gm). GEOM_MIRROR[0]: Device gm: provider da1 detected. GEOM_MIRROR[1]: Device gm state changed from STARTING to RUNNING. GEOM_MIRROR[1]: Disk da1 state changed from NEW to ACTIVE (device gm). GEOM_MIRROR[2]: Tasting da0a. GEOM_MIRROR[2]: Tasting da0b. GEOM_MIRROR[2]: Tasting da0c. GEOM_MIRROR[2]: Tasting da0d. GEOM_MIRROR[2]: Tasting da0e. GEOM_MIRROR[2]: Tasting da0f. GEOM_MIRROR[2]: Tasting da0g. GEOM_MIRROR[2]: Tasting da0h. GEOM_MIRROR[2]: Tasting da1a. GEOM_MIRROR[2]: Tasting da1b. GEOM_MIRROR[2]: Tasting da1c. GEOM_MIRROR[2]: Tasting da1d. GEOM_MIRROR[2]: Tasting da1e. GEOM_MIRROR[2]: Tasting da1f. GEOM_MIRROR[2]: Tasting da1g. GEOM_MIRROR[2]: Tasting da1h. Mounting root from ufs:/dev/mirror/gma setrootbyname failed ffs_mountroot: can't find rootvp Root mount failed: 6 Mounting root from ufs:mirror/gma setrootbyname failed ffs_mountroot: can't find rootvp Root mount failed: 6 Manual root filesystem specification: : Mount using filesystem eg. ufs:da0s1a ? List valid disk boot devices Abort manual input mountroot> ? List of GEOM managed disk devices: da1h da1g da1f da1e da1d da1c da1b da1a da0h da0g da0f da0e da0d da0c da0b da0 .. So, at this point, it's not actually started the mirror? If I choose one of the underlying drives just to try and get it booted: .. mountroot> ufs:da0a Mounting root from ufs:da0a GEOM_MIRROR[2]: Access da1 r0w1e1 = 0 GEOM_MIRROR[2]: Access da1 r0w-1e-1 = 0 GEOM_MIRROR[2]: Metadata on da1 updated. GEOM_MIRROR[0]: Device gm: provider da1 activated. GEOM_MIRROR[1]: Device gm: syncid bumped to 7. GEOM_MIRROR[2]: Tasting da1a. GEOM_MIRROR[2]: Tasting da1b. GEOM_MIRROR[2]: Tasting da1c. GEOM_MIRROR[2]: Tasting da1d. GEOM_MIRROR[2]: Tasting da1e. GEOM_MIRROR[2]: Tasting da1f. GEOM_MIRROR[2]: Tasting da1g. GEOM_MIRROR[2]: Tasting da1h. GEOM_MIRROR[2]: Access da1 r0w1e1 = 0 GEOM_MIRROR[2]: Access da1 r0w-1e-1 = 0 GEOM_MIRROR[2]: Metadata on da1 updated. GEOM_MIRROR[1]: Disk da0 state changed from NEW to SYNCHRONIZING (device gm). GEOM_MIRROR[0]: Device gm: provider mirror/gm launched. GEOM_MIRROR[0]: Device gm: rebuilding provider da0. GEOM_MIRROR[2]: Access da0 r0w1e1 = 1 GEOM_MIRROR[1]: Disk da0 state changed from SYNCHRONIZING to DISCONNECTED (devi. GEOM_MIRROR[0]: Device gm: provider da0 disconnected. GEOM_MIRROR[2]: Disk da0 disconnected. GEOM_MIRROR[2]: Consumer da0 destroyed. .. and from here it boots. But it looks like the mirror/gm provider isn't launched until after I chose a root device to mount. df after this boot looks like: # df -k Filesystem 1K-blocks Used Avail Capacity Mounted on /dev/da0a 126702 50226 66340 43% / devfs 1 1 0 100% /dev /dev/mirror/gmd 1012974 6 931932 0% /tmp /dev/mirror/gme 1012974 24622 907316 3% /var /dev/mirror/gmf 8122126 1801154 5671202 24% /usr /dev/mirror/gmg 2026030 4 1863944 0% /jail /dev/mirror/gmh 18066100 4 16620808 0% /dump So the mirror is still working, using da1 as it's only disk. A gmirror list just for the record.. # gmirror list Geom name: gm State: DEGRADED Components: 2 Balance: split Slice: 4096 Flags: NONE SyncID: 7 ID: 2253826535 Providers: 1. Name: mirror/gm Mediasize: 36420074496 (34G) Sectorsize: 512 Mode: r6w6e1 Consumers: 1. Name: da1 Mediasize: 36420075008 (34G) Sectorsize: 512 Mode: r6w6e2 State: ACTIVE Priority: 0 Flags: DIRTY SyncID: 7 ID: 1391052059 Geom name: gm.sync If I shut it down and boot with old kernel now, it comes up fine, although in the process, disconnecting da0 again: GEOM_MIRROR[1]: Adding disk da1 to gm. GEOM_MIRROR[2]: Adding disk da1. GEOM_MIRROR[2]: Disk da1 connected. GEOM_MIRROR[1]: Disk da1 state changed from NONE to NEW (device gm). GEOM_MIRROR[0]: Device gm: provider da1 detected. GEOM_MIRROR[1]: Device gm state changed from STARTING to RUNNING. GEOM_MIRROR[1]: Disk da1 state changed from NEW to ACTIVE (device gm). GEOM_MIRROR[2]: Access da1 r0w1e1 = 0 GEOM_MIRROR[2]: Tasting da0a. GEOM_MIRROR[2]: Access da1 r0w-1e-1 = 0 GEOM_MIRROR[2]: Metadata on da1 updated. GEOM_MIRROR[0]: Device gm: provider da1 activated. GEOM_MIRROR[1]: Disk da0 state changed from NEW to SYNCHRONIZING (device gm). GEOM_MIRROR[0]: Device gm: provider mirror/gm launched. GEOM_MIRROR[0]: Device gm: rebuilding provider da0. GEOM_MIRROR[2]: Access da0 r0w1e1 = 1 GEOM_MIRROR[1]: Disk da0 state changed from SYNCHRONIZING to DISCONNECTED (devi. GEOM_MIRROR[0]: Device gm: provider da0 disconnected. GEOM_MIRROR[2]: Disk da0 disconnected. GEOM_MIRROR[2]: Consumer da0 destroyed. -- Chris From owner-freebsd-geom@FreeBSD.ORG Mon Oct 4 13:12:28 2004 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 7939216A4CE; Mon, 4 Oct 2004 13:12:28 +0000 (GMT) Received: from clueful.shagged.org (clueful.shagged.org [212.13.201.101]) by mx1.FreeBSD.org (Postfix) with ESMTP id 41CD043D53; Mon, 4 Oct 2004 13:12:28 +0000 (GMT) (envelope-from chris@clueful.shagged.org) Received: from chris by clueful.shagged.org with local (Exim 4.40 (FreeBSD)) id 1CESda-000KuA-SC; Mon, 04 Oct 2004 14:12:22 +0100 Date: Mon, 4 Oct 2004 14:12:22 +0100 From: Chris Elsworth To: Pawel Jakub Dawidek Message-ID: <20041004131222.GA80231@shagged.org> References: <20041004084442.GA65504@shagged.org> <20041004090227.GB73767@darkness.comp.waw.pl> <20041004091509.GB65504@shagged.org> <20041004102411.GC73767@darkness.comp.waw.pl> <20041004110637.GA72685@shagged.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20041004110637.GA72685@shagged.org> User-Agent: Mutt/1.5.6i Sender: Chris Elsworth X-Shagged-MailScanner-Information: See www.mailscanner.info for information X-Shagged-MailScanner: Found to be clean X-MailScanner-From: chris@clueful.shagged.org cc: freebsd-geom@freebsd.org Subject: Re: SCSI disk getting disconnected on boot X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 04 Oct 2004 13:12:28 -0000 On Mon, Oct 04, 2004 at 12:06:37PM +0100, Chris Elsworth wrote: > On Mon, Oct 04, 2004 at 12:24:11PM +0200, Pawel Jakub Dawidek wrote: > > On Mon, Oct 04, 2004 at 10:15:09AM +0100, Chris Elsworth wrote: > > +> GEOM_MIRROR[1]: Disk da0 state changed from NEW to ACTIVE (device gm). > > +> GEOM_MIRROR[2]: Access da0 r0w1e1 = 1 > > +> GEOM_MIRROR[0]: Cannot update metadata on disk da0 (error=1). > > > > I haven't seen this error before. > > Simlar race was reported earlier. Could you try this patch: > > > > http://people.freebsd.org/~pjd/patches/gmirror.patch > > > > (You need to recompile you kernel and geom_mirror.ko module.) > > Hello Pawel, > > Oh dear - this seems to have made it worse :( Replying to myself, but I've managed to get it working. I've applied http://people.freebsd.org/~pjd/patches/root_mount.patch and set mount_root_delay="10" and it has now booted three times without disconnecting da0 :) So I look forward to the merging of both those patches :) -- Chris From owner-freebsd-geom@FreeBSD.ORG Mon Oct 4 13:30:03 2004 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 99F1716A4CE for ; Mon, 4 Oct 2004 13:30:03 +0000 (GMT) Received: from darkness.comp.waw.pl (darkness.comp.waw.pl [195.117.238.136]) by mx1.FreeBSD.org (Postfix) with ESMTP id 31FE243D3F for ; Mon, 4 Oct 2004 13:30:03 +0000 (GMT) (envelope-from pjd@darkness.comp.waw.pl) Received: by darkness.comp.waw.pl (Postfix, from userid 1009) id 2C804ACBCF; Mon, 4 Oct 2004 15:30:01 +0200 (CEST) Date: Mon, 4 Oct 2004 15:30:01 +0200 From: Pawel Jakub Dawidek To: Chris Elsworth Message-ID: <20041004133001.GE73767@darkness.comp.waw.pl> References: <20041004084442.GA65504@shagged.org> <20041004090227.GB73767@darkness.comp.waw.pl> <20041004091509.GB65504@shagged.org> <20041004102411.GC73767@darkness.comp.waw.pl> <20041004110637.GA72685@shagged.org> <20041004131222.GA80231@shagged.org> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="tMbDGjvJuJijemkf" Content-Disposition: inline In-Reply-To: <20041004131222.GA80231@shagged.org> User-Agent: Mutt/1.4.2i X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 5.2.1-RC2 i386 cc: freebsd-geom@freebsd.org Subject: Re: SCSI disk getting disconnected on boot X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 04 Oct 2004 13:30:03 -0000 --tMbDGjvJuJijemkf Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Oct 04, 2004 at 02:12:22PM +0100, Chris Elsworth wrote: +> Replying to myself, but I've managed to get it working. I've applied=20 +> http://people.freebsd.org/~pjd/patches/root_mount.patch +>=20 +> and set +> mount_root_delay=3D"10" +> and it has now booted three times without disconnecting da0 :) +>=20 +> So I look forward to the merging of both those patches :) Ah, you were using RELENG_5, ok. Does it work without gmirror.patch? --=20 Pawel Jakub Dawidek http://www.FreeBSD.org pjd@FreeBSD.org http://garage.freebsd.pl FreeBSD committer Am I Evil? Yes, I Am! --tMbDGjvJuJijemkf Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.4 (FreeBSD) iD8DBQFBYVBZForvXbEpPzQRAmpoAJ0RoV+DTEUDaz7RVzKXavsU7vFjHQCaAwSJ u6Xw4Z9k0V28k4o4SBRBdh8= =zUAI -----END PGP SIGNATURE----- --tMbDGjvJuJijemkf-- From owner-freebsd-geom@FreeBSD.ORG Mon Oct 4 14:09:11 2004 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 0E24016A4CE; Mon, 4 Oct 2004 14:09:11 +0000 (GMT) Received: from clueful.shagged.org (clueful.shagged.org [212.13.201.101]) by mx1.FreeBSD.org (Postfix) with ESMTP id C483F43D54; Mon, 4 Oct 2004 14:09:08 +0000 (GMT) (envelope-from chris@clueful.shagged.org) Received: from chris by clueful.shagged.org with local (Exim 4.40 (FreeBSD)) id 1CETWN-000MXp-CF; Mon, 04 Oct 2004 15:08:59 +0100 Date: Mon, 4 Oct 2004 15:08:59 +0100 From: Chris Elsworth To: Pawel Jakub Dawidek Message-ID: <20041004140859.GA84681@shagged.org> References: <20041004084442.GA65504@shagged.org> <20041004090227.GB73767@darkness.comp.waw.pl> <20041004091509.GB65504@shagged.org> <20041004102411.GC73767@darkness.comp.waw.pl> <20041004110637.GA72685@shagged.org> <20041004131222.GA80231@shagged.org> <20041004133001.GE73767@darkness.comp.waw.pl> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20041004133001.GE73767@darkness.comp.waw.pl> User-Agent: Mutt/1.5.6i Sender: Chris Elsworth X-Shagged-MailScanner-Information: See www.mailscanner.info for information X-Shagged-MailScanner: Found to be clean X-MailScanner-From: chris@clueful.shagged.org cc: freebsd-geom@freebsd.org Subject: Re: SCSI disk getting disconnected on boot X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 04 Oct 2004 14:09:11 -0000 On Mon, Oct 04, 2004 at 03:30:01PM +0200, Pawel Jakub Dawidek wrote: > On Mon, Oct 04, 2004 at 02:12:22PM +0100, Chris Elsworth wrote: > +> Replying to myself, but I've managed to get it working. I've applied > +> http://people.freebsd.org/~pjd/patches/root_mount.patch > +> > +> and set > +> mount_root_delay="10" > +> and it has now booted three times without disconnecting da0 :) > +> > +> So I look forward to the merging of both those patches :) > > Ah, you were using RELENG_5, ok. Oh, yes, sorry. I thought I'd said. It was 5.3-BETA6 as of October 2nd. > Does it work without gmirror.patch? I supped the source tree to BETA7 to clean out the old patches, then re-applied root_mount.patch - and yes, it still works! Up until now I'd only ever booted a mirror device with one half, and that was working fine with 5.3 tree and no additional patches. It seems you need root_mount.patch to boot with more than one device. -- Chris From owner-freebsd-geom@FreeBSD.ORG Wed Oct 6 13:48:32 2004 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 7E9C416A4CE for ; Wed, 6 Oct 2004 13:48:32 +0000 (GMT) Received: from freebee.digiware.nl (dsl439.iae.nl [212.61.63.187]) by mx1.FreeBSD.org (Postfix) with ESMTP id 21D8643D2F for ; Wed, 6 Oct 2004 13:48:31 +0000 (GMT) (envelope-from wjw@withagen.nl) Received: from [212.61.27.71] (dual [212.61.27.71]) by freebee.digiware.nl (8.12.10/8.12.10) with ESMTP id i96DmO9S038291 for ; Wed, 6 Oct 2004 15:48:29 +0200 (CEST) (envelope-from wjw@withagen.nl) Message-ID: <4163F7A8.9030702@withagen.nl> Date: Wed, 06 Oct 2004 15:48:24 +0200 From: Willem Jan Withagen User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.7.2) Gecko/20040804 Netscape/7.2 (ax) X-Accept-Language: en-us, en MIME-Version: 1.0 To: freebsd-geom@freebsd.org Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Subject: switching gmirror on upon boot X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 Oct 2004 13:48:32 -0000 Hi, Must be mentioned somewhere, but can't seem to find it. grepped just about all configfiles, .... How do I get gmirror to autoload when booting the system. Currently doing things manually, but that's not really the way. :( Thanx, --WjW From owner-freebsd-geom@FreeBSD.ORG Wed Oct 6 13:49:41 2004 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id CBFEB16A4CE for ; Wed, 6 Oct 2004 13:49:41 +0000 (GMT) Received: from darkness.comp.waw.pl (darkness.comp.waw.pl [195.117.238.136]) by mx1.FreeBSD.org (Postfix) with ESMTP id 7E38043D4C for ; Wed, 6 Oct 2004 13:49:41 +0000 (GMT) (envelope-from pjd@darkness.comp.waw.pl) Received: by darkness.comp.waw.pl (Postfix, from userid 1009) id 8FDF8ACABF; Wed, 6 Oct 2004 15:49:39 +0200 (CEST) Date: Wed, 6 Oct 2004 15:49:39 +0200 From: Pawel Jakub Dawidek To: Willem Jan Withagen Message-ID: <20041006134939.GO73767@darkness.comp.waw.pl> References: <4163F7A8.9030702@withagen.nl> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="7fwXp2o0gOrkU5lS" Content-Disposition: inline In-Reply-To: <4163F7A8.9030702@withagen.nl> User-Agent: Mutt/1.4.2i X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 5.2.1-RC2 i386 cc: freebsd-geom@freebsd.org Subject: Re: switching gmirror on upon boot X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 Oct 2004 13:49:41 -0000 --7fwXp2o0gOrkU5lS Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Oct 06, 2004 at 03:48:24PM +0200, Willem Jan Withagen wrote: +> Hi, +>=20 +> Must be mentioned somewhere, but can't seem to find it. +> grepped just about all configfiles, .... +>=20 +> How do I get gmirror to autoload when booting the system. +> Currently doing things manually, but that's not really the way. :( Put: geom_mirror_load=3D"YES" into your /boot/loader.conf. --=20 Pawel Jakub Dawidek http://www.FreeBSD.org pjd@FreeBSD.org http://garage.freebsd.pl FreeBSD committer Am I Evil? Yes, I Am! --7fwXp2o0gOrkU5lS Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.4 (FreeBSD) iD8DBQFBY/fzForvXbEpPzQRAmvZAKCh/pmSpvcAxfjFq+8Vh/2w0FZXxQCfbCXA URJAIEiTt+NR82A3TBChGuM= =ogh2 -----END PGP SIGNATURE----- --7fwXp2o0gOrkU5lS-- From owner-freebsd-geom@FreeBSD.ORG Wed Oct 6 13:58:33 2004 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id BFD0716A4CE; Wed, 6 Oct 2004 13:58:33 +0000 (GMT) Received: from freebee.digiware.nl (dsl439.iae.nl [212.61.63.187]) by mx1.FreeBSD.org (Postfix) with ESMTP id 0BBEC43D45; Wed, 6 Oct 2004 13:58:33 +0000 (GMT) (envelope-from wjw@withagen.nl) Received: from [212.61.27.71] (dual [212.61.27.71]) by freebee.digiware.nl (8.12.10/8.12.10) with ESMTP id i96DwV9S038694; Wed, 6 Oct 2004 15:58:32 +0200 (CEST) (envelope-from wjw@withagen.nl) Message-ID: <4163FA08.9060609@withagen.nl> Date: Wed, 06 Oct 2004 15:58:32 +0200 From: Willem Jan Withagen User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.7.2) Gecko/20040804 Netscape/7.2 (ax) X-Accept-Language: en-us, en MIME-Version: 1.0 To: Pawel Jakub Dawidek References: <4163F7A8.9030702@withagen.nl> <20041006134939.GO73767@darkness.comp.waw.pl> In-Reply-To: <20041006134939.GO73767@darkness.comp.waw.pl> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit cc: freebsd-geom@FreeBSD.org Subject: Re: switching gmirror on upon boot X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 Oct 2004 13:58:33 -0000 Pawel Jakub Dawidek wrote: >On Wed, Oct 06, 2004 at 03:48:24PM +0200, Willem Jan Withagen wrote: >+> Hi, >+> >+> Must be mentioned somewhere, but can't seem to find it. >+> grepped just about all configfiles, .... >+> >+> How do I get gmirror to autoload when booting the system. >+> Currently doing things manually, but that's not really the way. :( > >Put: > > geom_mirror_load="YES" > >into your /boot/loader.conf. > > make me wonder why my 'grep mirror /boot/* /boot/*/*' did not return anything. But it'll be pilot error. Thanx, --WjW From owner-freebsd-geom@FreeBSD.ORG Thu Oct 7 05:04:08 2004 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 6999D16A4CE for ; Thu, 7 Oct 2004 05:04:08 +0000 (GMT) Received: from mail5.speakeasy.net (mail5.speakeasy.net [216.254.0.205]) by mx1.FreeBSD.org (Postfix) with ESMTP id 3637F43D1D for ; Thu, 7 Oct 2004 05:04:08 +0000 (GMT) (envelope-from jmg@hydrogen.funkthat.com) Received: (qmail 6557 invoked from network); 7 Oct 2004 05:04:07 -0000 Received: from gate.funkthat.com (HELO hydrogen.funkthat.com) ([69.17.45.168]) (envelope-sender ) by mail5.speakeasy.net (qmail-ldap-1.03) with SMTP for ; 7 Oct 2004 05:04:07 -0000 Received: from hydrogen.funkthat.com (ohwnsp@localhost.funkthat.com [127.0.0.1])i97546lb063677; Wed, 6 Oct 2004 22:04:06 -0700 (PDT) (envelope-from jmg@hydrogen.funkthat.com) Received: (from jmg@localhost) by hydrogen.funkthat.com (8.12.10/8.12.10/Submit) id i97545wT063676; Wed, 6 Oct 2004 22:04:05 -0700 (PDT) Date: Wed, 6 Oct 2004 22:04:05 -0700 From: John-Mark Gurney To: Sam Message-ID: <20041007050405.GP22681@funkthat.com> Mail-Followup-To: Sam , freebsd-arch@freebsd.org, freebsd-geom@freebsd.org References: Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4.1i X-Operating-System: FreeBSD 4.2-RELEASE i386 X-PGP-Fingerprint: B7 EC EF F8 AE ED A7 31 96 7A 22 B3 D8 56 36 F4 X-Files: The truth is out there X-URL: http://resnet.uoregon.edu/~gurney_j/ X-Resume: http://resnet.uoregon.edu/~gurney_j/resume.html cc: freebsd-geom@freebsd.org cc: freebsd-arch@freebsd.org Subject: Re: fdisk/geom, AoE 5.2.1 X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: John-Mark Gurney List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 07 Oct 2004 05:04:08 -0000 Sam wrote this message on Wed, Oct 06, 2004 at 23:34 -0500: > I've got the AoE driver ported and running on > 5.2.1. Much faster than I anticipated; the geom > interface is delightful. > > I can read and write to the disk. I cannot, > however, partition it and I'm soliciting the > list for ideas as to why. > > If I fdisk -u an AoE device, fdisk claims all > was successful, but in reality nothing gets written. > Further calls to fdisk support this. > > I'm probably not tickling something right. Is it > possible I need to grease the path for the disk > partition table in geom? I didn't see anything of > the like. Maybe it's a tasting issue? On last close (from fdisk hopefully), the provider will be passed back for tasting since the meta data could possibly have changed.. Have you verified that the writes are hitting the disk? and that the fdisk table can be seen from another machine? Verified that you can read what you write to the disk? /me notes that these questions should probably end up on -geom and so cc'd it. -- John-Mark Gurney Voice: +1 415 225 5579 "All that I will do, has been done, All that I have, has not." From owner-freebsd-geom@FreeBSD.ORG Thu Oct 7 09:40:00 2004 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 76F0216A4CE; Thu, 7 Oct 2004 09:40:00 +0000 (GMT) Received: from darkness.comp.waw.pl (darkness.comp.waw.pl [195.117.238.136]) by mx1.FreeBSD.org (Postfix) with ESMTP id F0D0543D1F; Thu, 7 Oct 2004 09:39:59 +0000 (GMT) (envelope-from pjd@darkness.comp.waw.pl) Received: by darkness.comp.waw.pl (Postfix, from userid 1009) id 33321ACABF; Thu, 7 Oct 2004 11:39:52 +0200 (CEST) Date: Thu, 7 Oct 2004 11:39:52 +0200 From: Pawel Jakub Dawidek To: Sam Message-ID: <20041007093952.GZ73767@darkness.comp.waw.pl> References: Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="utG8zEvBNE7w4yrA" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4.2i X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 5.2.1-RC2 i386 cc: freebsd-geom@freebsd.org cc: freebsd-arch@freebsd.org Subject: Re: fdisk/geom, AoE 5.2.1 X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 07 Oct 2004 09:40:00 -0000 --utG8zEvBNE7w4yrA Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Oct 06, 2004 at 11:34:05PM -0500, Sam wrote: +> I can read and write to the disk. I cannot, +> however, partition it and I'm soliciting the +> list for ideas as to why. You can set kern.geom.debugflags to 5 and see what's going on there. +> I'm probably not tickling something right. Is it +> possible I need to grease the path for the disk +> partition table in geom? I didn't see anything of +> the like. Maybe it's a tasting issue? Show me the source!:) +> BTB - Is the geom(4) manpage finished in 5.3? Nope, but for developing GEOM classes there are many useful (I hope) manual pages: DECLARE_GEOM_CLASS(9) g_access(9) g_attach(9) g_bio(9) g_consumer(9) g_data(9) g_event(9) g_geom(9) g_provider(9) g_provider_by_name(9) g_wither_geom(9) --=20 Pawel Jakub Dawidek http://www.FreeBSD.org pjd@FreeBSD.org http://garage.freebsd.pl FreeBSD committer Am I Evil? Yes, I Am! --utG8zEvBNE7w4yrA Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.4 (FreeBSD) iD8DBQFBZQ7oForvXbEpPzQRAjJ/AJ9EivbqZMqgIu17W0fliFsWqRNGFACgiFKv 7xUvq/s5Zcr/IcpPIiHOins= =s+yo -----END PGP SIGNATURE----- --utG8zEvBNE7w4yrA-- From owner-freebsd-geom@FreeBSD.ORG Thu Oct 7 13:56:44 2004 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 422FE16A4CE; Thu, 7 Oct 2004 13:56:44 +0000 (GMT) Received: from athena.softcardsystems.com (mail.softcardsystems.com [12.34.136.114]) by mx1.FreeBSD.org (Postfix) with ESMTP id DDD5943D5F; Thu, 7 Oct 2004 13:56:43 +0000 (GMT) (envelope-from sah@softcardsystems.com) Received: from athena (athena [12.34.136.114])i97EtPKP025964; Thu, 7 Oct 2004 09:55:25 -0500 Date: Thu, 7 Oct 2004 09:55:25 -0500 (EST) From: Sam X-X-Sender: sah@athena To: John-Mark Gurney In-Reply-To: <20041007050405.GP22681@funkthat.com> Message-ID: References: <20041007050405.GP22681@funkthat.com> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed cc: freebsd-geom@freebsd.org cc: freebsd-arch@freebsd.org Subject: Re: fdisk/geom, AoE 5.2.1 X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 07 Oct 2004 13:56:44 -0000 > Sam wrote this message on Wed, Oct 06, 2004 at 23:34 -0500: >> I've got the AoE driver ported and running on >> 5.2.1. Much faster than I anticipated; the geom >> interface is delightful. >> >> I can read and write to the disk. I cannot, >> however, partition it and I'm soliciting the >> list for ideas as to why. >> >> If I fdisk -u an AoE device, fdisk claims all >> was successful, but in reality nothing gets written. >> Further calls to fdisk support this. >> >> I'm probably not tickling something right. Is it >> possible I need to grease the path for the disk >> partition table in geom? I didn't see anything of >> the like. Maybe it's a tasting issue? > > On last close (from fdisk hopefully), the provider will be passed > back for tasting since the meta data could possibly have changed.. > > Have you verified that the writes are hitting the disk? and that the > fdisk table can be seen from another machine? Verified that you can > read what you write to the disk? Arg. My goof. I wrote zeros, read zeros and assumed i could write to the disk. In fact I could - even when I wanted to read. I won't go into the details, but suffice it to say you can't do: if (bp->bio_flags & BIO_READ) // do read else // do write and expect the correct behaviour. :) Thanks - Sam From owner-freebsd-geom@FreeBSD.ORG Thu Oct 7 14:25:17 2004 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9D00F16A4CE; Thu, 7 Oct 2004 14:25:17 +0000 (GMT) Received: from critter.freebsd.dk (critter.freebsd.dk [212.242.86.163]) by mx1.FreeBSD.org (Postfix) with ESMTP id F2EC043D39; Thu, 7 Oct 2004 14:25:16 +0000 (GMT) (envelope-from phk@critter.freebsd.dk) Received: from critter.freebsd.dk (localhost [127.0.0.1]) by critter.freebsd.dk (8.13.1/8.13.1) with ESMTP id i97EP4Bg024465; Thu, 7 Oct 2004 16:25:09 +0200 (CEST) (envelope-from phk@critter.freebsd.dk) To: Sam From: "Poul-Henning Kamp" In-Reply-To: Your message of "Thu, 07 Oct 2004 09:55:25 CDT." Date: Thu, 07 Oct 2004 16:25:04 +0200 Message-ID: <24464.1097159104@critter.freebsd.dk> Sender: phk@critter.freebsd.dk cc: John-Mark Gurney cc: freebsd-arch@freebsd.org cc: freebsd-geom@freebsd.org Subject: Re: fdisk/geom, AoE 5.2.1 X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 07 Oct 2004 14:25:17 -0000 In message , Sam writes: >Arg. My goof. I wrote zeros, read zeros and assumed i could >write to the disk. In fact I could - even when I wanted to >read. I won't go into the details, but suffice it to say you >can't do: > >if (bp->bio_flags & BIO_READ) > // do read >else > // do write > >and expect the correct behaviour. :) Please be aware that we have _three_ I/O operations under 5.x and later: BIO_READ, BIO_WRITE and BIO_DELETE. Just return EOPNOTSUPP for BIO_DELETE. -- Poul-Henning Kamp | UNIX since Zilog Zeus 3.20 phk@FreeBSD.ORG | TCP/IP since RFC 956 FreeBSD committer | BSD since 4.3-tahoe Never attribute to malice what can adequately be explained by incompetence. From owner-freebsd-geom@FreeBSD.ORG Thu Oct 7 14:32:37 2004 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id C3F0F16A4CE; Thu, 7 Oct 2004 14:32:37 +0000 (GMT) Received: from athena.softcardsystems.com (mail.softcardsystems.com [12.34.136.114]) by mx1.FreeBSD.org (Postfix) with ESMTP id 6CF3043D55; Thu, 7 Oct 2004 14:32:37 +0000 (GMT) (envelope-from sah@softcardsystems.com) Received: from athena (athena [12.34.136.114])i97FVJ7o026196; Thu, 7 Oct 2004 10:31:19 -0500 Date: Thu, 7 Oct 2004 10:31:19 -0500 (EST) From: Sam X-X-Sender: sah@athena To: Poul-Henning Kamp In-Reply-To: <24464.1097159104@critter.freebsd.dk> Message-ID: References: <24464.1097159104@critter.freebsd.dk> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed cc: John-Mark Gurney cc: freebsd-geom@freebsd.org cc: freebsd-arch@freebsd.org Subject: Re: fdisk/geom, AoE 5.2.1 X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 07 Oct 2004 14:32:38 -0000 > Please be aware that we have _three_ I/O operations under 5.x and > later: BIO_READ, BIO_WRITE and BIO_DELETE. Just return EOPNOTSUPP > for BIO_DELETE. I was filtering out anything but R/W before I got there. Thanks for the tip on EOPNOTSUPP, though. I was returning EIO. Sam From owner-freebsd-geom@FreeBSD.ORG Sat Oct 9 18:22:22 2004 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 765D116A4CE; Sat, 9 Oct 2004 18:22:22 +0000 (GMT) Received: from clueful.shagged.org (clueful.shagged.org [212.13.201.101]) by mx1.FreeBSD.org (Postfix) with ESMTP id 2E8F543D48; Sat, 9 Oct 2004 18:22:22 +0000 (GMT) (envelope-from chris@clueful.shagged.org) Received: from chris by clueful.shagged.org with local (Exim 4.40 (FreeBSD)) id 1CGLrD-000BLl-K3; Sat, 09 Oct 2004 19:22:15 +0100 Date: Sat, 9 Oct 2004 19:22:15 +0100 From: Chris Elsworth To: Pawel Jakub Dawidek Message-ID: <20041009182215.GA43124@shagged.org> References: <20041004084442.GA65504@shagged.org> <20041004090227.GB73767@darkness.comp.waw.pl> <20041004091509.GB65504@shagged.org> <20041004102411.GC73767@darkness.comp.waw.pl> <20041004110637.GA72685@shagged.org> <20041004131222.GA80231@shagged.org> <20041004133001.GE73767@darkness.comp.waw.pl> <20041004140859.GA84681@shagged.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20041004140859.GA84681@shagged.org> User-Agent: Mutt/1.5.6i Sender: Chris Elsworth X-Shagged-MailScanner-Information: See www.mailscanner.info for information X-Shagged-MailScanner: Found to be clean X-MailScanner-From: chris@clueful.shagged.org cc: freebsd-geom@freebsd.org Subject: Re: SCSI disk getting disconnected on boot X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 09 Oct 2004 18:22:22 -0000 Pawel, Should the commit of v1.34 of src/sys/geom/mirror/g_mirror.c negate the need for root_mount.patch? I've just tried pulling out the latest version of g_mirror.c on HEAD (1.37) and applying it to an otherwise unpatched up to date RELENG_5 tree, but I still see that da0 is disconnected when booting with the resultant kernel and geom_mirror module. Or are we still waiting for a commit to replace root_mount.patch? -- Chris