From owner-freebsd-geom@FreeBSD.ORG Mon Oct 30 11:08:20 2006 Return-Path: X-Original-To: freebsd-geom@FreeBSD.org Delivered-To: freebsd-geom@FreeBSD.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 6CC7C16A563 for ; Mon, 30 Oct 2006 11:08:20 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [216.136.204.21]) by mx1.FreeBSD.org (Postfix) with ESMTP id A320D43D76 for ; Mon, 30 Oct 2006 11:08:19 +0000 (GMT) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (linimon@localhost [127.0.0.1]) by freefall.freebsd.org (8.13.4/8.13.4) with ESMTP id k9UB8JP7085850 for ; Mon, 30 Oct 2006 11:08:19 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from linimon@localhost) by freefall.freebsd.org (8.13.4/8.13.4/Submit) id k9UB8Imn085846 for freebsd-geom@FreeBSD.org; Mon, 30 Oct 2006 11:08:18 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 30 Oct 2006 11:08:18 GMT Message-Id: <200610301108.k9UB8Imn085846@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: linimon set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-geom@FreeBSD.org Cc: Subject: Current problem reports assigned to you X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 30 Oct 2006 11:08:20 -0000 Current FreeBSD problem reports Critical problems Serious problems S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/73177 geom kldload geom_* causes panic due to memory exhaustion o kern/76538 geom [gbde] nfs-write on gbde partition stalls and continue o kern/83464 geom [geom] [patch] Unhandled malloc failures within libgeo o kern/84556 geom [geom] GBDE-encrypted swap causes panic at shutdown o kern/87544 geom [gbde] mmaping large files on a gbde filesystem deadlo o kern/89102 geom [geom_vfs] [panic] panic when forced unmount FS from u o bin/90093 geom fdisk(8) incapable of altering in-core geometry o kern/90582 geom [geom_mirror] [panic] Restore cause panic string (ffs_ o kern/98034 geom [geom] dereference of NULL pointer in acd_geom_detach o kern/104389 geom [geom] [patch] sys/geom/geom_dump.c doesn't encode XML 10 problems total. Non-critical problems S Tracker Resp. Description -------------------------------------------------------------------------------- o bin/78131 geom gbde "destroy" not working. o kern/79251 geom [2TB] newfs fails on 2.6TB gbde device o kern/94632 geom [geom] Kernel output resets input while GELI asks for 3 problems total. From owner-freebsd-geom@FreeBSD.ORG Tue Oct 31 19:54:49 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 3834016A40F for ; Tue, 31 Oct 2006 19:54:49 +0000 (UTC) (envelope-from rick@kiwi-computer.com) Received: from kiwi-computer.com (megan.kiwi-computer.com [63.224.10.3]) by mx1.FreeBSD.org (Postfix) with SMTP id 0576043D7B for ; Tue, 31 Oct 2006 19:54:43 +0000 (GMT) (envelope-from rick@kiwi-computer.com) Received: (qmail 55526 invoked by uid 2001); 31 Oct 2006 19:54:42 -0000 Date: Tue, 31 Oct 2006 13:54:42 -0600 From: "Rick C. Petty" To: freebsd-geom@freebsd.org Message-ID: <20061031195442.GA55478@keira.kiwi-computer.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.4.2.1i Subject: burnt again by gmirror X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 31 Oct 2006 19:54:49 -0000 A few days ago, one of my machines rebooted (6.2-PRERELEASE). It's using gmirror, two SATA disks of equal model/size: ad4 & ad8. Today I noticed ad4 was loaded and ad8 said 0% (using systat). I tried: # gmirror status Name Status Components mirror/gm0 DEGRADED ad4 # gmirror list Geom name: gm0 State: DEGRADED Components: 2 Balance: round-robin Slice: 4096 Flags: NONE GenID: 1 SyncID: 4 ID: 793566958 Providers: 1. Name: mirror/gm0 Mediasize: 320072932864 (298G) Sectorsize: 512 Mode: r7w6e8 Consumers: 1. Name: ad4 Mediasize: 320072933376 (298G) Sectorsize: 512 Mode: r1w1e1 State: ACTIVE Priority: 0 Flags: DIRTY GenID: 1 SyncID: 4 ID: 3554825454 and noticed ad8 is not listed. Wonderful. A quick check that ad8 is indeed present: # atacontrol list ATA channel 0: Master: no device present Slave: no device present ATA channel 1: Master: acd0 <16X8 DVD DUAL/A070> ATA/ATAPI revision 5 Slave: no device present ATA channel 2: Master: ad4 Serial ATA II Slave: no device present ATA channel 3: Master: no device present Slave: no device present ATA channel 4: Master: ad8 Serial ATA II Slave: no device present ATA channel 5: Master: no device present Slave: no device present # atacontrol reinit ata4 Master: ad8 Serial ATA II Slave: no device present As expected, but reiniting the channel doesn't attach ad8 to the mirror, because the disk is already there. So I tried detach/attach of ata4 and noticed this in dmesg: kernel: subdisk8: detached kernel: ad8: detached kernel: ad8: 305245MB at ata4-master SATA300 GEOM_MIRROR: Component ad8 (device gm0) broken, skipping. GEOM_MIRROR: Cannot add disk ad8 to gm0 (error=22). I tried a few more things: # gmirror rebuild gm0 ad8 No such provider: ad8. # gmirror insert gm0 ad8 Not all disks connected. # gmirror activate gm0 ad8 (in dmesg, the same GEOM_MIRROR errors showed up). What is going on here? This was working just fine until my last reboot. /var/run/dmesg.boot was empty, presumably because the msg buffer overran itself. The error messages are misleading (assuming they are even remotely correct) and quite unhelpful. Why didn't gmirror pick up the ad8 provider on startup? Why does it think there's another, unconnected disk (which makes sense) but doesn't allow it to be re-attached? Is there any way to have gmirror consume the ad8 provider? -- Rick C. Petty From owner-freebsd-geom@FreeBSD.ORG Tue Oct 31 20:00:14 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 04FC316A40F for ; Tue, 31 Oct 2006 20:00:13 +0000 (UTC) (envelope-from rick@kiwi-computer.com) Received: from kiwi-computer.com (megan.kiwi-computer.com [63.224.10.3]) by mx1.FreeBSD.org (Postfix) with SMTP id 32B1743D76 for ; Tue, 31 Oct 2006 20:00:02 +0000 (GMT) (envelope-from rick@kiwi-computer.com) Received: (qmail 55773 invoked by uid 2001); 31 Oct 2006 20:00:02 -0000 Date: Tue, 31 Oct 2006 14:00:02 -0600 From: "Rick C. Petty" To: freebsd-geom@freebsd.org Message-ID: <20061031200002.GA55693@keira.kiwi-computer.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.4.2.1i Subject: burnt again by gmirror X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: rick-freebsd@kiwi-computer.com List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 31 Oct 2006 20:00:14 -0000 [please ignore any duplicate message-- it was sent from wrong email] A few days ago, one of my machines rebooted (6.2-PRERELEASE). It's using gmirror, two SATA disks of equal model/size: ad4 & ad8. Today I noticed ad4 was loaded and ad8 said 0% (using systat). I tried: # gmirror status Name Status Components mirror/gm0 DEGRADED ad4 # gmirror list Geom name: gm0 State: DEGRADED Components: 2 Balance: round-robin Slice: 4096 Flags: NONE GenID: 1 SyncID: 4 ID: 793566958 Providers: 1. Name: mirror/gm0 Mediasize: 320072932864 (298G) Sectorsize: 512 Mode: r7w6e8 Consumers: 1. Name: ad4 Mediasize: 320072933376 (298G) Sectorsize: 512 Mode: r1w1e1 State: ACTIVE Priority: 0 Flags: DIRTY GenID: 1 SyncID: 4 ID: 3554825454 and noticed ad8 is not listed. Wonderful. A quick check that ad8 is indeed present: # atacontrol list ATA channel 0: Master: no device present Slave: no device present ATA channel 1: Master: acd0 <16X8 DVD DUAL/A070> ATA/ATAPI revision 5 Slave: no device present ATA channel 2: Master: ad4 Serial ATA II Slave: no device present ATA channel 3: Master: no device present Slave: no device present ATA channel 4: Master: ad8 Serial ATA II Slave: no device present ATA channel 5: Master: no device present Slave: no device present # atacontrol reinit ata4 Master: ad8 Serial ATA II Slave: no device present As expected, but reiniting the channel doesn't attach ad8 to the mirror, because the disk is already there. So I tried detach/attach of ata4 and noticed this in dmesg: kernel: subdisk8: detached kernel: ad8: detached kernel: ad8: 305245MB at ata4-master SATA300 GEOM_MIRROR: Component ad8 (device gm0) broken, skipping. GEOM_MIRROR: Cannot add disk ad8 to gm0 (error=22). I tried a few more things: # gmirror rebuild gm0 ad8 No such provider: ad8. # gmirror insert gm0 ad8 Not all disks connected. # gmirror activate gm0 ad8 (in dmesg, the same GEOM_MIRROR errors showed up). What is going on here? This was working just fine until my last reboot. /var/run/dmesg.boot was empty, presumably because the msg buffer overran itself. The error messages are misleading (assuming they are even remotely correct) and quite unhelpful. Why didn't gmirror pick up the ad8 provider on startup? Why does it think there's another, unconnected disk (which makes sense) but doesn't allow it to be re-attached? Is there any way to have gmirror consume the ad8 provider? -- Rick C. Petty From owner-freebsd-geom@FreeBSD.ORG Tue Oct 31 20:10:03 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id A65F316A417 for ; Tue, 31 Oct 2006 20:10:03 +0000 (UTC) (envelope-from anderson@centtech.com) Received: from mh1.centtech.com (moat3.centtech.com [64.129.166.50]) by mx1.FreeBSD.org (Postfix) with ESMTP id 49E2943D66 for ; Tue, 31 Oct 2006 20:10:03 +0000 (GMT) (envelope-from anderson@centtech.com) Received: from [10.177.171.220] (neutrino.centtech.com [10.177.171.220]) by mh1.centtech.com (8.13.8/8.13.8) with ESMTP id k9VKA0bO028069; Tue, 31 Oct 2006 14:10:00 -0600 (CST) (envelope-from anderson@centtech.com) Message-ID: <4547AD9B.5050503@centtech.com> Date: Tue, 31 Oct 2006 14:10:03 -0600 From: Eric Anderson User-Agent: Thunderbird 1.5.0.7 (X11/20061015) MIME-Version: 1.0 To: "Rick C. Petty" References: <20061031195442.GA55478@keira.kiwi-computer.com> In-Reply-To: <20061031195442.GA55478@keira.kiwi-computer.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV 0.88.4/2133/Tue Oct 31 04:42:29 2006 on mh1.centtech.com X-Virus-Status: Clean X-Spam-Status: No, score=-2.5 required=8.0 tests=AWL,BAYES_00 autolearn=ham version=3.1.6 X-Spam-Checker-Version: SpamAssassin 3.1.6 (2006-10-03) on mh1.centtech.com Cc: freebsd-geom@freebsd.org Subject: Re: burnt again by gmirror X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 31 Oct 2006 20:10:03 -0000 On 10/31/06 13:54, Rick C. Petty wrote: > A few days ago, one of my machines rebooted (6.2-PRERELEASE). It's using > gmirror, two SATA disks of equal model/size: ad4 & ad8. Today I noticed > ad4 was loaded and ad8 said 0% (using systat). I tried: > > # gmirror status > Name Status Components > mirror/gm0 DEGRADED ad4 > > # gmirror list > Geom name: gm0 > State: DEGRADED > Components: 2 > Balance: round-robin > Slice: 4096 > Flags: NONE > GenID: 1 > SyncID: 4 > ID: 793566958 > Providers: > 1. Name: mirror/gm0 > Mediasize: 320072932864 (298G) > Sectorsize: 512 > Mode: r7w6e8 > Consumers: > 1. Name: ad4 > Mediasize: 320072933376 (298G) > Sectorsize: 512 > Mode: r1w1e1 > State: ACTIVE > Priority: 0 > Flags: DIRTY > GenID: 1 > SyncID: 4 > ID: 3554825454 > > and noticed ad8 is not listed. Wonderful. A quick check that ad8 is > indeed present: > > # atacontrol list > ATA channel 0: > Master: no device present > Slave: no device present > ATA channel 1: > Master: acd0 <16X8 DVD DUAL/A070> ATA/ATAPI revision 5 > Slave: no device present > ATA channel 2: > Master: ad4 Serial ATA II > Slave: no device present > ATA channel 3: > Master: no device present > Slave: no device present > ATA channel 4: > Master: ad8 Serial ATA II > Slave: no device present > ATA channel 5: > Master: no device present > Slave: no device present > > # atacontrol reinit ata4 > Master: ad8 Serial ATA II > Slave: no device present > > As expected, but reiniting the channel doesn't attach ad8 to the mirror, > because the disk is already there. So I tried detach/attach of ata4 and > noticed this in dmesg: > > kernel: subdisk8: detached > kernel: ad8: detached > kernel: ad8: 305245MB at ata4-master SATA300 > GEOM_MIRROR: Component ad8 (device gm0) broken, skipping. > GEOM_MIRROR: Cannot add disk ad8 to gm0 (error=22). > > I tried a few more things: > > # gmirror rebuild gm0 ad8 > No such provider: ad8. > > # gmirror insert gm0 ad8 > Not all disks connected. > > # gmirror activate gm0 ad8 > > (in dmesg, the same GEOM_MIRROR errors showed up). What is going on here? > This was working just fine until my last reboot. /var/run/dmesg.boot was > empty, presumably because the msg buffer overran itself. The error > messages are misleading (assuming they are even remotely correct) and quite > unhelpful. Why didn't gmirror pick up the ad8 provider on startup? Why > does it think there's another, unconnected disk (which makes sense) but > doesn't allow it to be re-attached? Is there any way to have gmirror > consume the ad8 provider? You probably need to do a gmirror forget, then a gmirror remove (on ad8), then re-insert it. gmirror probably kicked it out because of errors? Eric -- ------------------------------------------------------------------------ Eric Anderson Sr. Systems Administrator Centaur Technology Anything that works is better than anything that doesn't. ------------------------------------------------------------------------ From owner-freebsd-geom@FreeBSD.ORG Tue Oct 31 20:48:37 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 82F6516A494 for ; Tue, 31 Oct 2006 20:48:37 +0000 (UTC) (envelope-from rick@kiwi-computer.com) Received: from kiwi-computer.com (megan.kiwi-computer.com [63.224.10.3]) by mx1.FreeBSD.org (Postfix) with SMTP id 5F80E43D8A for ; Tue, 31 Oct 2006 20:48:09 +0000 (GMT) (envelope-from rick@kiwi-computer.com) Received: (qmail 56916 invoked by uid 2001); 31 Oct 2006 20:46:59 -0000 Date: Tue, 31 Oct 2006 14:46:59 -0600 From: "Rick C. Petty" To: freebsd-geom@freebsd.org Message-ID: <20061031204659.GA56766@keira.kiwi-computer.com> References: <20061031195442.GA55478@keira.kiwi-computer.com> <4547AD9B.5050503@centtech.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <4547AD9B.5050503@centtech.com> User-Agent: Mutt/1.4.2.1i Subject: Re: burnt again by gmirror X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: rick-freebsd@kiwi-computer.com List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 31 Oct 2006 20:48:37 -0000 On Tue, Oct 31, 2006 at 02:10:03PM -0600, Eric Anderson wrote: > You probably need to do a gmirror forget, then a gmirror remove (on > ad8), then re-insert it. The forget seemed to fix it. FYI: # gmirror remove gm0 ad8 No such provider: ad8. I'm not sure if that step was even necessary. At least now both ad4 and ad8 are listed and are of the same size. I was worried gmirror would try to allocate its metadata on ad8 twice. I don't know why I thought that, because gmirror would treat the ad8 as a provider and overwrite any previous metadata when doing a "gmirror insert". > gmirror probably kicked it out because of errors? I guess that's what my question was really trying to get at. What caused the error, what was the error, and why did gmirror both not recognize ad8 and also think there was a missing disk. I guess if it was expecting a specific ID and ad8 no longer had that ID (it got wiped for some odd reason?) it would behave as such. That explains the last question. The first two are hard to diagnose w/o dmesg. :( Still, I'm curious why/how ad8's metadata could have been clobbered. gmirror is the only one who would write to it, the filesystem is mounted from gm0* -- kinda scary. I guess the lesson here is to use simple gmirror configurations in case the metadata gets clobbered. -- Rick C. Petty From owner-freebsd-geom@FreeBSD.ORG Tue Oct 31 20:59:20 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id F36E216A492 for ; Tue, 31 Oct 2006 20:59:19 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.FreeBSD.org (Postfix) with ESMTP id 450A443D53 for ; Tue, 31 Oct 2006 20:59:12 +0000 (GMT) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 5D43A45685; Tue, 31 Oct 2006 21:59:10 +0100 (CET) Received: from localhost (dkm191.neoplus.adsl.tpnet.pl [83.24.16.191]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id 5DBBF45681; Tue, 31 Oct 2006 21:58:57 +0100 (CET) Date: Tue, 31 Oct 2006 21:58:57 +0100 From: Pawel Jakub Dawidek To: "Rick C. Petty" Message-ID: <20061031205857.GA15861@garage.freebsd.pl> References: <20061031195442.GA55478@keira.kiwi-computer.com> <4547AD9B.5050503@centtech.com> <20061031204659.GA56766@keira.kiwi-computer.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="zhXaljGHf11kAtnf" Content-Disposition: inline In-Reply-To: <20061031204659.GA56766@keira.kiwi-computer.com> X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng/devel-r804 (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-0.5 required=3.0 tests=BAYES_00,RCVD_IN_NJABL_DUL, RCVD_IN_SORBS_DUL autolearn=no version=3.0.4 Cc: freebsd-geom@freebsd.org Subject: Re: burnt again by gmirror X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 31 Oct 2006 20:59:20 -0000 --zhXaljGHf11kAtnf Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Oct 31, 2006 at 02:46:59PM -0600, Rick C. Petty wrote: > On Tue, Oct 31, 2006 at 02:10:03PM -0600, Eric Anderson wrote: >=20 > > You probably need to do a gmirror forget, then a gmirror remove (on > > ad8), then re-insert it. >=20 > The forget seemed to fix it. FYI: >=20 > # gmirror remove gm0 ad8 > No such provider: ad8. >=20 > I'm not sure if that step was even necessary. At least now both ad4 and = =20 > ad8 are listed and are of the same size. I was worried gmirror would try= =20 > to allocate its metadata on ad8 twice. I don't know why I thought that, = =20 > because gmirror would treat the ad8 as a provider and overwrite any=20 > previous metadata when doing a "gmirror insert". >=20 > > gmirror probably kicked it out because of errors? >=20 > I guess that's what my question was really trying to get at. What caused= =20 > the error, what was the error, and why did gmirror both not recognize ad8= =20 > and also think there was a missing disk. I guess if it was expecting a = =20 > specific ID and ad8 no longer had that ID (it got wiped for some odd=20 > reason?) it would behave as such. That explains the last question. The = =20 > first two are hard to diagnose w/o dmesg. :( >=20 > Still, I'm curious why/how ad8's metadata could have been clobbered. > gmirror is the only one who would write to it, the filesystem is mounted > from gm0* -- kinda scary. I guess the lesson here is to use simple gmirr= or > configurations in case the metadata gets clobbered. gmirror told you that it think ad8 is broken and skipped it. If an error is discovered on mirror's component it is marked as broken and disconnected so it doesn't case further problems. For example disk problem is that it doesn't complete I/O requests and gmirror need to wait for ATA timeouts, which will make the whole system unresponsive. If component was disconnected it means something was wrong with it and it needs manual intervention and investigation. I'm sure your logs would tell you. --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --zhXaljGHf11kAtnf Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.4 (FreeBSD) iD8DBQFFR7kRForvXbEpPzQRAusvAJ9v6CsmkSIyRgQ32qhZuzUK7gnfswCgwkQA pm0ib8oCrjw9rQAkBJ/Frto= =EGuW -----END PGP SIGNATURE----- --zhXaljGHf11kAtnf-- From owner-freebsd-geom@FreeBSD.ORG Tue Oct 31 21:00:51 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 4590316A558 for ; Tue, 31 Oct 2006 21:00:51 +0000 (UTC) (envelope-from anderson@centtech.com) Received: from mh1.centtech.com (moat3.centtech.com [64.129.166.50]) by mx1.FreeBSD.org (Postfix) with ESMTP id 9990243D53 for ; Tue, 31 Oct 2006 21:00:50 +0000 (GMT) (envelope-from anderson@centtech.com) Received: from [10.177.171.220] (neutrino.centtech.com [10.177.171.220]) by mh1.centtech.com (8.13.8/8.13.8) with ESMTP id k9VL0ms7036825; Tue, 31 Oct 2006 15:00:48 -0600 (CST) (envelope-from anderson@centtech.com) Message-ID: <4547B983.4020802@centtech.com> Date: Tue, 31 Oct 2006 15:00:51 -0600 From: Eric Anderson User-Agent: Thunderbird 1.5.0.7 (X11/20061015) MIME-Version: 1.0 To: rick-freebsd@kiwi-computer.com References: <20061031195442.GA55478@keira.kiwi-computer.com> <4547AD9B.5050503@centtech.com> <20061031204659.GA56766@keira.kiwi-computer.com> In-Reply-To: <20061031204659.GA56766@keira.kiwi-computer.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV 0.88.4/2134/Tue Oct 31 14:10:21 2006 on mh1.centtech.com X-Virus-Status: Clean X-Spam-Status: No, score=-2.5 required=8.0 tests=AWL,BAYES_00 autolearn=ham version=3.1.6 X-Spam-Checker-Version: SpamAssassin 3.1.6 (2006-10-03) on mh1.centtech.com Cc: freebsd-geom@freebsd.org Subject: Re: burnt again by gmirror X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 31 Oct 2006 21:00:51 -0000 On 10/31/06 14:46, Rick C. Petty wrote: > On Tue, Oct 31, 2006 at 02:10:03PM -0600, Eric Anderson wrote: > >> You probably need to do a gmirror forget, then a gmirror remove (on >> ad8), then re-insert it. > > The forget seemed to fix it. FYI: > > # gmirror remove gm0 ad8 > No such provider: ad8. > > I'm not sure if that step was even necessary. At least now both ad4 and > ad8 are listed and are of the same size. I was worried gmirror would try > to allocate its metadata on ad8 twice. I don't know why I thought that, > because gmirror would treat the ad8 as a provider and overwrite any > previous metadata when doing a "gmirror insert". > >> gmirror probably kicked it out because of errors? > > I guess that's what my question was really trying to get at. What caused > the error, what was the error, and why did gmirror both not recognize ad8 > and also think there was a missing disk. I guess if it was expecting a > specific ID and ad8 no longer had that ID (it got wiped for some odd > reason?) it would behave as such. That explains the last question. The > first two are hard to diagnose w/o dmesg. :( If the disk has enough trouble, gmirror will kick it out of the mirror and mark it as such. It won't re-add the disk to the mirror (it still thinks it's a bad drive) unless you manually force it to (which you did with the forget). It wouldn't let you insert it, because it was already known to the mirror. > Still, I'm curious why/how ad8's metadata could have been clobbered. > gmirror is the only one who would write to it, the filesystem is mounted > from gm0* -- kinda scary. I guess the lesson here is to use simple gmirror > configurations in case the metadata gets clobbered. I don't think it did get clobbered. I think things went exactly as it should have actually. Eric -- ------------------------------------------------------------------------ Eric Anderson Sr. Systems Administrator Centaur Technology Anything that works is better than anything that doesn't. ------------------------------------------------------------------------ From owner-freebsd-geom@FreeBSD.ORG Tue Oct 31 21:17:30 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 5F5BF16A5CB for ; Tue, 31 Oct 2006 21:17:30 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.FreeBSD.org (Postfix) with ESMTP id 3EB0043D55 for ; Tue, 31 Oct 2006 21:17:29 +0000 (GMT) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id D705448801; Tue, 31 Oct 2006 22:17:27 +0100 (CET) Received: from localhost (dkm191.neoplus.adsl.tpnet.pl [83.24.16.191]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id 55C8F45683; Tue, 31 Oct 2006 22:17:18 +0100 (CET) Date: Tue, 31 Oct 2006 22:17:18 +0100 From: Pawel Jakub Dawidek To: Eric Anderson Message-ID: <20061031211718.GB15861@garage.freebsd.pl> References: <20061031195442.GA55478@keira.kiwi-computer.com> <4547AD9B.5050503@centtech.com> <20061031204659.GA56766@keira.kiwi-computer.com> <4547B983.4020802@centtech.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="IiVenqGWf+H9Y6IX" Content-Disposition: inline In-Reply-To: <4547B983.4020802@centtech.com> X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng/devel-r804 (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-0.5 required=3.0 tests=BAYES_00,RCVD_IN_NJABL_DUL, RCVD_IN_SORBS_DUL autolearn=no version=3.0.4 Cc: rick-freebsd@kiwi-computer.com, freebsd-geom@freebsd.org Subject: Re: burnt again by gmirror X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 31 Oct 2006 21:17:30 -0000 --IiVenqGWf+H9Y6IX Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Oct 31, 2006 at 03:00:51PM -0600, Eric Anderson wrote: > On 10/31/06 14:46, Rick C. Petty wrote: > >On Tue, Oct 31, 2006 at 02:10:03PM -0600, Eric Anderson wrote: > >>You probably need to do a gmirror forget, then a gmirror remove (on > >>ad8), then re-insert it. > >The forget seemed to fix it. FYI: > ># gmirror remove gm0 ad8 > >No such provider: ad8. > >I'm not sure if that step was even necessary. At least now both ad4 and= ad8 are listed and are of the same size. I was worried gmirror would tr= y to allocate its=20 > >metadata on ad8 twice. I don't know why I thought that, because gmirr= or would treat the ad8 as a provider and overwrite any previous metadata wh= en doing a "gmirror=20 > >insert". > >>gmirror probably kicked it out because of errors? > >I guess that's what my question was really trying to get at. What cause= d the error, what was the error, and why did gmirror both not recognize ad= 8 and also think there=20 > >was a missing disk. I guess if it was expecting a specific ID and ad= 8 no longer had that ID (it got wiped for some odd reason?) it would behave= as such. That explains=20 > >the last question. The first two are hard to diagnose w/o dmesg. :( >=20 > If the disk has enough trouble, gmirror will kick it out of the mirror an= d mark it as such. It won't re-add the disk to the mirror (it still thinks= it's a bad drive)=20 > unless you manually force it to (which you did with the forget). It woul= dn't let you insert it, because it was already known to the mirror. It wasn't exactly known to the mirror... Imagine a situation where you have a mirror out of 2 components. One of them is not on-line, but you want to create 3-way mirror by adding yet another component. gmirror won't allow for this, because it has to store information about the total number of components in all components metadata. That's why you cannot insert a new component when device is in degraded mode. Running 'gmirror forget' tells gmirror to forget about not connected components, because they won't reappear. I should probably implement an alias for 'forget+insert' called 'replace', but it's quite risky. --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --IiVenqGWf+H9Y6IX Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.4 (FreeBSD) iD8DBQFFR71eForvXbEpPzQRAj/YAJ0Ts/fJ+GTJTL3CPt9zNV6WHjLpmgCfS/Oh 8JziUyZledPPYy1CvJqPzK0= =cs83 -----END PGP SIGNATURE----- --IiVenqGWf+H9Y6IX-- From owner-freebsd-geom@FreeBSD.ORG Tue Oct 31 21:53:12 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id C6E9116A504 for ; Tue, 31 Oct 2006 21:53:12 +0000 (UTC) (envelope-from rick@kiwi-computer.com) Received: from kiwi-computer.com (megan.kiwi-computer.com [63.224.10.3]) by mx1.FreeBSD.org (Postfix) with SMTP id EBA5043DED for ; Tue, 31 Oct 2006 21:52:49 +0000 (GMT) (envelope-from rick@kiwi-computer.com) Received: (qmail 58434 invoked by uid 2001); 31 Oct 2006 21:52:41 -0000 Date: Tue, 31 Oct 2006 15:52:41 -0600 From: "Rick C. Petty" Cc: freebsd-geom@freebsd.org Message-ID: <20061031215241.GA57997@keira.kiwi-computer.com> References: <20061031195442.GA55478@keira.kiwi-computer.com> <4547AD9B.5050503@centtech.com> <20061031204659.GA56766@keira.kiwi-computer.com> <20061031205857.GA15861@garage.freebsd.pl> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20061031205857.GA15861@garage.freebsd.pl> User-Agent: Mutt/1.4.2.1i Subject: Re: burnt again by gmirror X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: rick-freebsd@kiwi-computer.com List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 31 Oct 2006 21:53:13 -0000 On Tue, Oct 31, 2006 at 09:58:57PM +0100, Pawel Jakub Dawidek wrote: > On Tue, Oct 31, 2006 at 02:46:59PM -0600, Rick C. Petty wrote: > > > > Still, I'm curious why/how ad8's metadata could have been clobbered. > > gmirror is the only one who would write to it, the filesystem is mounted > > from gm0* -- kinda scary. I guess the lesson here is to use simple gmirror > > configurations in case the metadata gets clobbered. > > gmirror told you that it think ad8 is broken and skipped it. If it's marked as broken/disconnected/whatever, why is it removed from the list ("gmirror list")? Surely it would be useful to state which pieces are broken. I'm thinking: printing "State: BROKEN" or something similar would do the trick. At least some of this data is available to gmirror, as stored on the other providers.. perhaps the provider name isn't, because it couldn't find the provider (for whatever reason), is that why it's not listed? If so, I still think it should be, perhaps with "Name: UNKNOWN". As it is, there is no way of knowing what's missing, or at least providing clues to what could be missing. > If an error is discovered on mirror's component it is marked as broken > and disconnected so it doesn't case further problems. For example disk > problem is that it doesn't complete I/O requests and gmirror need to > wait for ATA timeouts, which will make the whole system unresponsive. > If component was disconnected it means something was wrong with it and > it needs manual intervention and investigation. Or something just went horribly wrong with gmirror? The disks are fine, relatively new (5600 hours runtime), tested under load pretty thoroughly, and smartctl is showing no errors or other anomalies. > I'm sure your logs would tell you. Perhaps you didn't read in my original post where I stated that /var/run/dmesg.boot was empty: # ls -la /var/run/dmesg.boot -rw-r--r-- 1 root wheel 0 Oct 25 14:42 /var/run/dmesg.boot and that the message buffer had overflowed (quite visible from /var/log/messages)-- due to overwhelming fsck errors. I would love to know the wonderful error message which was printed, to give me an idea why gmirror dropped the disk for seemingly no good reason. I wish either fsck was less noisy or that the kernel would take a snapshot of the msgbuf right before starting init, so only the kernel messages would get copied into /var/run/ when the rc scripts do their thing... -- Rick C. Petty From owner-freebsd-geom@FreeBSD.ORG Wed Nov 1 01:19:59 2006 Return-Path: X-Original-To: freebsd-geom@FreeBSD.org Delivered-To: freebsd-geom@FreeBSD.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id F156416A417; Wed, 1 Nov 2006 01:19:59 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.FreeBSD.org (Postfix) with ESMTP id 4524143D58; Wed, 1 Nov 2006 01:19:58 +0000 (GMT) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 45907487F0; Wed, 1 Nov 2006 02:19:57 +0100 (CET) Received: from localhost (dkm191.neoplus.adsl.tpnet.pl [83.24.16.191]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id 5A54748804; Wed, 1 Nov 2006 02:19:51 +0100 (CET) Date: Wed, 1 Nov 2006 02:19:50 +0100 From: Pawel Jakub Dawidek To: Fluffles Message-ID: <20061101011950.GH15861@garage.freebsd.pl> References: <20061024152308.GG75746@garage.freebsd.pl> <4541FAC1.1000601@fluffles.net> <454208D6.7000006@fluffles.net> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="/GPgYEyhnw15BExa" Content-Disposition: inline In-Reply-To: <454208D6.7000006@fluffles.net> X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng/devel-r804 (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-0.5 required=3.0 tests=BAYES_00,RCVD_IN_NJABL_DUL, RCVD_IN_SORBS_DUL autolearn=no version=3.0.4 Cc: freebsd-fs@FreeBSD.org, freebsd-geom@FreeBSD.org Subject: Re: Updated gjournal patches [20061024]. X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 01 Nov 2006 01:20:00 -0000 --/GPgYEyhnw15BExa Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Oct 27, 2006 at 03:25:42PM +0200, Fluffles wrote: > Addendum: i tried gjournal on a single disk now without any GEOM layers > on it, but it still crashes with the same error. It was bug in debug code I accidentally left in the patch. --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --/GPgYEyhnw15BExa Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.4 (FreeBSD) iD8DBQFFR/Y2ForvXbEpPzQRAijHAJ99nyBOIbCoYv0T6TRZaLrii1ONVACgg2dq TaHswg5ovj7V465adF/iCUw= =ux+Q -----END PGP SIGNATURE----- --/GPgYEyhnw15BExa-- From owner-freebsd-geom@FreeBSD.ORG Wed Nov 1 18:29:08 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id BA1D616A412 for ; Wed, 1 Nov 2006 18:29:08 +0000 (UTC) (envelope-from jmg@hydrogen.funkthat.com) Received: from hydrogen.funkthat.com (gate.funkthat.com [69.17.45.168]) by mx1.FreeBSD.org (Postfix) with ESMTP id DCCDA43D7E for ; Wed, 1 Nov 2006 18:29:01 +0000 (GMT) (envelope-from jmg@hydrogen.funkthat.com) Received: from hydrogen.funkthat.com (3bjjjhv2m1i4xq2c@localhost.funkthat.com [127.0.0.1]) by hydrogen.funkthat.com (8.13.6/8.13.3) with ESMTP id kA1IT0mv092368; Wed, 1 Nov 2006 10:29:00 -0800 (PST) (envelope-from jmg@hydrogen.funkthat.com) Received: (from jmg@localhost) by hydrogen.funkthat.com (8.13.6/8.13.3/Submit) id kA1IT0xK092367; Wed, 1 Nov 2006 10:29:00 -0800 (PST) (envelope-from jmg) Date: Wed, 1 Nov 2006 10:29:00 -0800 From: John-Mark Gurney To: "Rick C. Petty" Message-ID: <20061101182859.GH25511@funkthat.com> Mail-Followup-To: "Rick C. Petty" , freebsd-geom@freebsd.org References: <20061031195442.GA55478@keira.kiwi-computer.com> <4547AD9B.5050503@centtech.com> <20061031204659.GA56766@keira.kiwi-computer.com> <20061031205857.GA15861@garage.freebsd.pl> <20061031215241.GA57997@keira.kiwi-computer.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20061031215241.GA57997@keira.kiwi-computer.com> User-Agent: Mutt/1.4.2.1i X-Operating-System: FreeBSD 5.4-RELEASE-p6 i386 X-PGP-Fingerprint: B7 EC EF F8 AE ED A7 31 96 7A 22 B3 D8 56 36 F4 X-Files: The truth is out there X-URL: http://resnet.uoregon.edu/~gurney_j/ X-Resume: http://resnet.uoregon.edu/~gurney_j/resume.html Cc: freebsd-geom@freebsd.org Subject: Re: burnt again by gmirror X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: John-Mark Gurney List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 01 Nov 2006 18:29:08 -0000 Rick C. Petty wrote this message on Tue, Oct 31, 2006 at 15:52 -0600: > I wish either fsck was less noisy or that the kernel would take a > snapshot of the msgbuf right before starting init, so only the kernel > messages would get copied into /var/run/ when the rc scripts do their > thing... This is a bug IMO that console messages get added to the dmesg buffer.. This was changed in 4.3. dmesg sees what messages are console messages and skips over them. If you provide the -a option to dmesg, you get what was dumped to the console: -a Show all data in the message buffer. This includes any syslog records and /dev/console output. W/o this bug/feature, we'd never have to worry about /dev/console messages overflowing the kernel messages, which is a lot more common than kernel messages overflowing before rc scripts run and hit saving dmesg. In 6.2 and HEAD, I've doubled the kernel message buffer to 64k for i386, so it's less likely to overflow. -- John-Mark Gurney Voice: +1 415 225 5579 "All that I will do, has been done, All that I have, has not." From owner-freebsd-geom@FreeBSD.ORG Thu Nov 2 14:39:17 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id BAF8A16A407 for ; Thu, 2 Nov 2006 14:39:17 +0000 (UTC) (envelope-from vanhu@zeninc.net) Received: from smtp.zeninc.net (reverse-25.fdn.fr [80.67.176.25]) by mx1.FreeBSD.org (Postfix) with ESMTP id 4054243D79 for ; Thu, 2 Nov 2006 14:39:17 +0000 (GMT) (envelope-from vanhu@zeninc.net) Received: by smtp.zeninc.net (smtpd, from userid 1000) id 6A5143F17; Thu, 2 Nov 2006 15:39:15 +0100 (CET) Date: Thu, 2 Nov 2006 15:39:15 +0100 From: VANHULLEBUS Yvan To: freebsd-geom@freebsd.org Message-ID: <20061102143915.GA26008@zen.inc> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: All mail clients suck. This one just sucks less. Subject: FSCKing a RO partition X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 02 Nov 2006 14:39:17 -0000 Hi all. (problem reported first to FreeBSD-hackers, where people told me "GEOM"....). [background] When the system starts up, root partition is already monted RO, and fsck works, without any problems, without any warning. [my problem] Very early in the startup (in a custom init to be exact), I need to remount ROOT R/W, do some write operations, then I want to remount it RO to let the normal rc process continue. Under FreeBSD 4.11, it works. But under FreeBSD6 (and I guess 5, but I don't have a running FreeBSD5 host), fsck says "NO WRITE ACCESS", then starts its stuff (but I fear what will happen if it detect problems on the filesystem....). The RO remount is done by a call to mount(2), with MNT_RDONLY|MNT_UPDATE flags and MNT_EXRDONLY ex_flags. I also tried with the mount command and -u -r options with the same result. Can someone explain me why it works like that, and, most important for me, give me a way to remount the root partition exactly as it was mounted when init started ? Thanks, Yvan. From owner-freebsd-geom@FreeBSD.ORG Fri Nov 3 16:26:10 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id A7FCC16A47E; Fri, 3 Nov 2006 16:26:10 +0000 (UTC) (envelope-from mark@gaiahost.coop) Received: from biodiesel.gaiahost.coop (biodiesel.gaiahost.coop [64.95.78.120]) by mx1.FreeBSD.org (Postfix) with ESMTP id 40F9C43D46; Fri, 3 Nov 2006 16:26:10 +0000 (GMT) (envelope-from mark@gaiahost.coop) Received: from gaiahost.coop (host-64-65-195-19.spr.choiceone.net [::ffff:64.65.195.19]) (AUTH: LOGIN mark@hubcapconsulting.com) by biodiesel.gaiahost.coop with esmtp; Fri, 03 Nov 2006 11:26:08 -0500 id 0024C1A1.454B6DA0.00006B7F Received: by gaiahost.coop (sSMTP sendmail emulation); Fri, 3 Nov 2006 11:26:12 -0500 Date: Fri, 3 Nov 2006 11:26:11 -0500 From: Mark Bucciarelli To: Pawel Jakub Dawidek Message-ID: <20061103162611.GS2276@rabbit> Mail-Followup-To: Pawel Jakub Dawidek , freebsd-geom@FreeBSD.org References: <20060213155454.GM2248@rabbit> <20060213180744.GB18369@garage.freebsd.pl> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Content-Disposition: inline In-Reply-To: <20060213180744.GB18369@garage.freebsd.pl> User-Agent: Mutt/1.4.2.1i Cc: freebsd-geom@FreeBSD.org Subject: Re: Replacing Failed Drive X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 03 Nov 2006 16:26:10 -0000 On Mon, Feb 13, 2006 at 07:07:45PM +0100, Pawel Jakub Dawidek wrote: > On Mon, Feb 13, 2006 at 10:54:54AM -0500, Mark Bucciarelli wrote: > +> I have a dead drive that I will replace tonight. > +> > +> $ gmirror status > +> Name Status Components > +> mirror/gm0 DEGRADED da1 > +> $ > +> > +> As I read the man page, I should do this: > +> > +> (1) gmirror forget gm0 > +> (2) power down > +> (3) replace drive > +> (4) power up > +> (5) gmirror insert gm0 da0 > +> > +> Is this the correct sequence? > > Yes. Ok, now I need to replace a good disk that I think has a bad block (getting a bunch of soft SCSI errors). Is this OK: (1) gmirror remove gm0 da1 (2) power down (3) replace drive (4) power up (5) gmirror insert gm0 da1 or do I need to run forget after the remove command? Thanks, m From owner-freebsd-geom@FreeBSD.ORG Fri Nov 3 20:35:04 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 7852916A403 for ; Fri, 3 Nov 2006 20:35:04 +0000 (UTC) (envelope-from rick@kiwi-computer.com) Received: from kiwi-computer.com (megan.kiwi-computer.com [63.224.10.3]) by mx1.FreeBSD.org (Postfix) with SMTP id D710D43D6D for ; Fri, 3 Nov 2006 20:35:03 +0000 (GMT) (envelope-from rick@kiwi-computer.com) Received: (qmail 66964 invoked by uid 2001); 3 Nov 2006 20:35:02 -0000 Date: Fri, 3 Nov 2006 14:35:02 -0600 From: "Rick C. Petty" To: VANHULLEBUS Yvan Message-ID: <20061103203502.GA66465@keira.kiwi-computer.com> References: <20061102143915.GA26008@zen.inc> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20061102143915.GA26008@zen.inc> User-Agent: Mutt/1.4.2.1i Cc: freebsd-geom@freebsd.org Subject: Re: FSCKing a RO partition X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: rick-freebsd@kiwi-computer.com List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 03 Nov 2006 20:35:04 -0000 On Thu, Nov 02, 2006 at 03:39:15PM +0100, VANHULLEBUS Yvan wrote: > > (problem reported first to FreeBSD-hackers, where people told me > "GEOM"....). > > [background] > When the system starts up, root partition is already monted RO, and > fsck works, without any problems, without any warning. As explained on -hackers, this is a bug, introduced at the same time as UFS2, soft updates, background fsck, and GEOM.. that is: 5.x. I hope someone here in -geom can look into it. Maybe filing a PR might help? > But under FreeBSD6 (and I guess 5, but I don't have a running FreeBSD5 > host), fsck says "NO WRITE ACCESS", then starts its stuff (but I fear > what will happen if it detect problems on the filesystem....). It won't be able to fix the problems, because writing has been disabled. This is definately a regression. I started looking into it, but never had the time to produce a patch. -- Rick C. Petty From owner-freebsd-geom@FreeBSD.ORG Sat Nov 4 18:48:16 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id B19AA16A49E for ; Sat, 4 Nov 2006 18:48:16 +0000 (UTC) (envelope-from eesumter@dsiweb.net) Received: from dsiweb.net (218-168-196-3.dynamic.hinet.net [218.168.196.3]) by mx1.FreeBSD.org (Postfix) with SMTP id 5DC0343D9F for ; Sat, 4 Nov 2006 18:47:49 +0000 (GMT) (envelope-from eesumter@dsiweb.net) Message-ID: <09c701c6ff07$3dff43f0$0287d2d0@woffertoryg> From: "Alvin Rochan" To: Date: Sun, 05 Nov 2006 02:47:35 +0800 MIME-Version: 1.0 X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2900.2869 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.2962 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: Take A Look At This Company zz X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Alvin Rochan List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 04 Nov 2006 18:48:16 -0000 LISTEN UP This advisory is based on exclusive insiders/agents information. (NHVP.PK) NHVP has provided investors with 1000% + gains during the real estate boom, and now with the sector at its bottom, is ready to provide with results yet again.. OCT 13th: Northeast Development Corp. to Receive Funding from European Investment Firm. Preliminary discussions suggest figures of -3 million with a combination of real estate and equity collateralization. GET IN ON MONDAY NOV 6th: at 08 cents its a STEAL - Volume: 8,000 - Volume: + 100% - Price: +100% The key to any tade is buying low and selling high, WELL the REAL ESTATE market has bottomed out and time to get in is now. We specialise in calling market bottom and when it comes to REAL ESTATE THIS IS THE BOTTOM, SO GET IN FOLKS EARLY RETIREMENT IS CALLING EARLY RETIREMENT IS CALLING Authorities were trying to determine whether Oyler has any links to at least 40 fires in the area since May, according to an official involved in the investigation who spoke on condition of anonymity because the case is continuing. Democrats say they are ahead in many races because of the public's growing dissatisfaction with the war in Iraq. And polls show that a clear majority of Americans see the war as a mistake and far fewer support the president's handling of it. Oyler was charged with five counts of murder, 11 counts of arson and 10 counts of use of an incendiary device. The charges include seven fires in June, one in July, one in September and two in October. "President Bush has never had a plan to win in Iraq, and now that Democrats and Republicans are all calling for change, he's desperately clinging to his stay the course," said Adrianne Marsh, a spokeswoman for McCaskill who was finishing a four-day statewide tour and plans to begin a 24-hour campaign blitz in St. Louis on Friday evening. "It's unfortunate that Talent is one of the only Republicans who agrees." From owner-freebsd-geom@FreeBSD.ORG Sat Nov 4 18:48:49 2006 Return-Path: X-Original-To: geom@freebsd.org Delivered-To: freebsd-geom@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 4F31416A935 for ; Sat, 4 Nov 2006 18:48:49 +0000 (UTC) (envelope-from olderro@dsiweb.net) Received: from dsiweb.net (218-168-196-3.dynamic.hinet.net [218.168.196.3]) by mx1.FreeBSD.org (Postfix) with SMTP id 1A81F43D8B for ; Sat, 4 Nov 2006 18:48:35 +0000 (GMT) (envelope-from olderro@dsiweb.net) Message-ID: <09c701c6ff73$3dde39d0$7579d1d0@eboothu> From: "Kerri PAlba" To: Date: Sun, 05 Nov 2006 02:48:27 +0800 MIME-Version: 1.0 X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2900.2869 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.2962 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: Subject: Stock Opportunities on Wall Street ut X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Kerri PAlba List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 04 Nov 2006 18:48:49 -0000 THIS IS NOT SPECULATION BUT REAL INFORMATION This advisory is based on exclusive insiders/agents information. (NHVP.PK) NHVP has provided investors with 1000% + gains during the real estate boom, and now with the sector at its bottom, is ready to provide with results yet again.. OCT 13th: Northeast Development Corp. to Receive Funding from European Investment Firm. Preliminary discussions suggest figures of -3 million with a combination of real estate and equity collateralization. GET IN ON MONDAY NOV 6th: at 08 cents its a STEAL - Volume: 8,000 - Volume: + 100% - Price: +100% The key to any tade is buying low and selling high, WELL the REAL ESTATE market has bottomed out and time to get in is now. We specialise in calling market bottom and when it comes to REAL ESTATE THIS IS THE BOTTOM, SO GET IN FOLKS INSIDER ALERT INSIDER ALERT "Nine days ago, one of the worst tragedies in the 100-year history of the Forest Service took the lives of five heroes," U.S. Forest Service Chaplain Steve Seltzner said as the service began. "It has shaken this agency and the men and women of the San Benardino National Forest to its very core and shocked the entire world." A light wind was cited by federal investigators Friday for blowing a small airplane carrying Yankees pitcher Cory Lidle off course and into a New York City high-rise on October 11. The NTSB's update outlined factual information about the crash, but did not conclude what the probable cause of the crash was. The full board will likely vote on a ruling at a later date. The report issued Friday said the airplane was flying along the East River between Manhattan and Queens when it attempted a U-turn with only 1,300 feet of room for the turn. To make a successful turn, the aircraft would have had to bank so steeply that it might have stalled, the NTSB said in an update on the crash. From owner-freebsd-geom@FreeBSD.ORG Sat Nov 4 22:09:19 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id EC72C16A4A7 for ; Sat, 4 Nov 2006 22:09:19 +0000 (UTC) (envelope-from don_oles@able.com.ua) Received: from able.com.ua (able.com.ua [80.91.162.66]) by mx1.FreeBSD.org (Postfix) with ESMTP id CE8B743D60 for ; Sat, 4 Nov 2006 22:09:17 +0000 (GMT) (envelope-from don_oles@able.com.ua) Received: from able.com.ua (localhost [127.0.0.1]) by able.com.ua (Postfix) with ESMTP id 3908644C2D for ; Sun, 5 Nov 2006 00:09:10 +0200 (EET) Received: from vanta.oles.net (ip.85.202.111.30.dyn.sub-1.broadband.voliacable.com [85.202.111.30]) (using TLSv1 with cipher AES256-SHA (256/256 bits)) (No client certificate requested) by able.com.ua (Postfix) with ESMTP id D1F1644C29 for ; Sun, 5 Nov 2006 00:09:09 +0200 (EET) Date: Sun, 5 Nov 2006 00:09:19 +0200 From: Oles Hnatkevych X-Mailer: The Bat! (v3.71.01) Professional X-Priority: 3 (Normal) Message-ID: <961295086.20061105000919@able.com.ua> To: freebsd-geom@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV using ClamSMTP at ABLE Subject: geom stripe perfomance question X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Oles Hnatkevych List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 04 Nov 2006 22:09:20 -0000 Hello all! I wonder why geom stripe works much worse than the separate disks that constitute stripe. I have a stripe from two disks. Disks are on separate ATA channels. root# gstripe list Geom name: bigdata State: UP Status: Total=2, Online=2 Type: AUTOMATIC Stripesize: 262144 ID: 4233231544 Providers: 1. Name: stripe/bigdata Mediasize: 500118323200 (466G) Sectorsize: 512 Mode: r1w1e1 Consumers: 1. Name: ad1 Mediasize: 250059350016 (233G) Sectorsize: 512 Mode: r1w1e2 Number: 0 2. Name: ad2 Mediasize: 250059350016 (233G) Sectorsize: 512 Mode: r1w1e2 Number: 1 Now let's read one of them and stripe. root# dd if=/dev/ad1 of=/dev/null bs=1m count=1000 1000+0 records in 1000+0 records out 1048576000 bytes transferred in 14.579483 secs (71921343 bytes/sec) root# dd if=/dev/stripe/bigdata of=/dev/null bs=1m count=1000 1000+0 records in 1000+0 records out 1048576000 bytes transferred in 15.882796 secs (66019610 bytes/sec) What I would expect is doubling the speed of transfer, not slowing down. Am I wrong? Or is geom_stripe inefficient? I tried to do the same with gvinum/stripe - the read speed was degraded too. And with gmirror depending on slice size speed was degraded differently. I am running 6.2-PRERELEASE on Celeron 800. -- Oles Hnatkevych mailto:don_oles@able.com.ua