From owner-freebsd-geom@FreeBSD.ORG Thu Nov 18 16:51:19 2010 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 125421065674 for ; Thu, 18 Nov 2010 16:51:19 +0000 (UTC) (envelope-from guido@gvr.org) Received: from gvr.gvr.org (gvr-gw.gvr.org [82.95.154.195]) by mx1.freebsd.org (Postfix) with ESMTP id 824BD8FC12 for ; Thu, 18 Nov 2010 16:51:18 +0000 (UTC) Received: by gvr.gvr.org (Postfix, from userid 657) id 002896D419; Thu, 18 Nov 2010 17:33:23 +0100 (CET) Date: Thu, 18 Nov 2010 17:33:23 +0100 From: Guido van Rooij To: freebsd-geom@freebsd.org Message-ID: <20101118163323.GA2524@gvr.gvr.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Subject: Booting from a gmirror always leads to a broken gmirror X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Nov 2010 16:51:19 -0000 Hi, I am running 8.1-RELEASE with the folloing mirror setup: Geom name: gm0 State: DEGRADED Components: 2 Balance: round-robin Slice: 4096 Flags: NONE GenID: 3 SyncID: 2 ID: 2610005691 Providers: 1. Name: mirror/gm0 Mediasize: 500107861504 (466G) Sectorsize: 512 Mode: r3w2e5 Consumers: 1. Name: da1 Mediasize: 500107862016 (466G) Sectorsize: 512 Mode: r1w1e1 State: ACTIVE Priority: 0 Flags: DIRTY GenID: 3 SyncID: 2 ID: 3263791510 2. Name: da0 Mediasize: 500107862016 (466G) Sectorsize: 512 Mode: r1w1e1 State: SYNCHRONIZING Priority: 0 Flags: DIRTY, SYNCHRONIZING GenID: 3 SyncID: 2 Synchronized: 15% ID: 4162979509 I have a dedicated slice to boot from and one GELI slice, both on the mirror. Now when I reboot this system (at a time when the mirror is 100% fine, unlike above), the following happens: Nov 18 15:36:01 gvr kernel: Root mount waiting for: usbus4 Nov 18 15:36:01 gvr kernel: ugen4.2: at usbus4 Nov 18 15:36:01 gvr kernel: umass0: on usbus4 Nov 18 15:36:01 gvr kernel: ugen1.2: at usbus1 Nov 18 15:36:01 gvr kernel: uhub6: on usbus1 Nov 18 15:36:01 gvr kernel: uhub5: 4 ports with 1 removable, self powered Nov 18 15:36:01 gvr kernel: Root mount waiting for: usbus4 Nov 18 15:36:01 gvr kernel: uhub6: 3 ports with 2 removable, bus powered Nov 18 15:36:01 gvr kernel: da0 at umass-sim0 bus 0 scbus0 target 0 lun 0 Nov 18 15:36:01 gvr kernel: da0: Fixed Direct Access SCSI-4 device Nov 18 15:36:01 gvr kernel: da0: 40.000MB/s transfers Nov 18 15:36:01 gvr kernel: da0: 476940MB (976773168 512 byte sectors: 255H 63S/ T 60801C) Nov 18 15:36:01 gvr kernel: ugen1.3: at usbus1 Nov 18 15:36:01 gvr kernel: ugen4.3: at usbus4 Nov 18 15:36:01 gvr kernel: umass1: on usbus4 Nov 18 15:36:01 gvr kernel: da1 at umass-sim1 bus 1 scbus1 target 0 lun 0 Nov 18 15:36:01 gvr kernel: da1: Fixed Direct Access SCSI-4 device Nov 18 15:36:01 gvr kernel: da1: 40.000MB/s transfers Nov 18 15:36:01 gvr kernel: da1: 476940MB (976773168 512 byte sectors: 255H 63S/ T 60801C) Nov 18 15:36:01 gvr kernel: GEOM_MIRROR: Component da0 (device gm0) broken, skipping. Nov 18 15:36:01 gvr kernel: GEOM_MIRROR: Device mirror/gm0 launched (1/2). Nov 18 15:36:01 gvr kernel: Enter passphrase for da0s2: Now, the passphrase the geli asks, is for the so-called broken disk. But it is not broken. I can always rebuild it fine when I rebooted and re-insert da0. My question: why does gmirror mark da0 as broken? -Guido