From owner-freebsd-geom@FreeBSD.ORG Mon Apr 11 12:24:52 2005 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 14E6816A4CE for ; Mon, 11 Apr 2005 12:24:52 +0000 (GMT) Received: from spork.qfe3.net (spork.qfe3.net [212.13.207.101]) by mx1.FreeBSD.org (Postfix) with ESMTP id 9330E43D1F for ; Mon, 11 Apr 2005 12:24:51 +0000 (GMT) (envelope-from chris@qfe3.net) Received: from chris by spork.qfe3.net with local (Exim 4.50) id 1DKxyE-00070X-E5 for freebsd-geom@freebsd.org; Mon, 11 Apr 2005 13:24:50 +0100 Date: Mon, 11 Apr 2005 13:24:50 +0100 From: Chris Elsworth To: freebsd-geom@freebsd.org Message-ID: <20050411122450.GA26898@spork.qfe3.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.5.6i Sender: Chris Elsworth Subject: gmirror & sparc64 oddness X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 11 Apr 2005 12:24:52 -0000 Hello, I'm trying FreeBSD 5.4 on a sparc64 (T1/AC200) ; it's a RELENG_5_4 checkout as of last night, so RC2. After I create a gmirror and make some partitions in it, I'm not seeing any entries for the partitions in /dev/mirror, so I can't do anything with them. Here's results from sunlabel for the mirror (gm0) and it's one underlying provider, da4: t1# sunlabel mirror/gm0 # /dev/mirror/gm0: text: SUN9.0G cyl 4924 alt 2 hd 27 sec 133 bytes/sectors: 512 sectors/cylinder: 3591 sectors/unit: 17682084 8 partitions: # # Size is in sectors. # Offset is in cylinders. # size offset tag flag # ---------- ---------- ---------- ---- a: 265734 0 root wu c: 17682084 0 backup wu t1# sunlabel da4 # /dev/da4: text: SUN9.0G cyl 4924 alt 2 hd 27 sec 133 bytes/sectors: 512 sectors/cylinder: 3591 sectors/unit: 17682084 8 partitions: # # Size is in sectors. # Offset is in cylinders. # size offset tag flag # ---------- ---------- ---------- ---- a: 265734 0 root wu c: 17682084 0 backup wu t1# ls /dev/mirror gm0 t1# ls /dev/da4* /dev/da4 But if I remove the mirror the partitions appear in da4: t1# gmirror remove gm0 da4 t1# ls /dev/da4* /dev/da4 /dev/da4a /dev/da4c I found a reference to this also asked previously over in freebsd-sparc64: http://lists.freebsd.org/pipermail/freebsd-sparc64/2005-March/002834.html But there was no response. Is this a known problem or something we both did wrong? Cheers, -- Chris From owner-freebsd-geom@FreeBSD.ORG Mon Apr 11 13:57:40 2005 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 7A52D16A4CE for ; Mon, 11 Apr 2005 13:57:40 +0000 (GMT) Received: from darkness.comp.waw.pl (darkness.comp.waw.pl [195.117.238.136]) by mx1.FreeBSD.org (Postfix) with ESMTP id C247543D55 for ; Mon, 11 Apr 2005 13:57:39 +0000 (GMT) (envelope-from pjd@darkness.comp.waw.pl) Received: by darkness.comp.waw.pl (Postfix, from userid 1009) id DA8A4ACBCF; Mon, 11 Apr 2005 15:57:37 +0200 (CEST) Date: Mon, 11 Apr 2005 15:57:37 +0200 From: Pawel Jakub Dawidek To: Chris Elsworth Message-ID: <20050411135737.GM837@darkness.comp.waw.pl> References: <20050411122450.GA26898@spork.qfe3.net> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="yPo1CW2ZXioZPB28" Content-Disposition: inline In-Reply-To: <20050411122450.GA26898@spork.qfe3.net> User-Agent: Mutt/1.4.2i X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 5.2.1-RC2 i386 cc: freebsd@gizm0.org cc: freebsd-geom@freebsd.org Subject: Re: gmirror & sparc64 oddness X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 11 Apr 2005 13:57:40 -0000 --yPo1CW2ZXioZPB28 Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Apr 11, 2005 at 01:24:50PM +0100, Chris Elsworth wrote: +> Hello, +>=20 +> I'm trying FreeBSD 5.4 on a sparc64 (T1/AC200) ; it's a RELENG_5_4 +> checkout as of last night, so RC2. +>=20 +> After I create a gmirror and make some partitions in it, I'm not +> seeing any entries for the partitions in /dev/mirror, so I can't do +> anything with them. Here's results from sunlabel for the mirror (gm0) +> and it's one underlying provider, da4: +>=20 +> t1# sunlabel mirror/gm0 +> # /dev/mirror/gm0: +> text: SUN9.0G cyl 4924 alt 2 hd 27 sec 133 +> bytes/sectors: 512 +> sectors/cylinder: 3591 +> sectors/unit: 17682084 +>=20 +> 8 partitions: +> # +> # Size is in sectors. +> # Offset is in cylinders. +> # size offset tag flag +> # ---------- ---------- ---------- ---- +> a: 265734 0 root wu +> c: 17682084 0 backup wu +>=20 +>=20 +> t1# sunlabel da4 +> # /dev/da4: +> text: SUN9.0G cyl 4924 alt 2 hd 27 sec 133 +> bytes/sectors: 512 +> sectors/cylinder: 3591 +> sectors/unit: 17682084 +>=20 +> 8 partitions: +> # +> # Size is in sectors. +> # Offset is in cylinders. +> # size offset tag flag +> # ---------- ---------- ---------- ---- +> a: 265734 0 root wu +> c: 17682084 0 backup wu +>=20 +>=20 +> t1# ls /dev/mirror +> gm0 +>=20 +> t1# ls /dev/da4* +> /dev/da4 +>=20 +>=20 +> But if I remove the mirror the partitions appear in da4: +>=20 +> t1# gmirror remove gm0 da4 +> t1# ls /dev/da4* +> /dev/da4 /dev/da4a /dev/da4c +>=20 +>=20 +> I found a reference to this also asked previously over in +> freebsd-sparc64:=20 +> http://lists.freebsd.org/pipermail/freebsd-sparc64/2005-March/002834.html +>=20 +> But there was no response. Is this a known problem or something we +> both did wrong? (I'm not reading freebsd-sparc64@ mailing list.) No, the problem is that geom_sunlabel class operates only on rank#1 providers (disks, etc.). Mirrors are not rank#1 of course, because there are providers under them. This was done to prevent recursive labels creations. geom_bsd and geom_mbr are already fixed and are using MD5 to verify if metadata were already used for slices/labels creation. I don't have HW to test this, but please try this patch and tell me if it works for you: http://people.freebsd.org/~pjd/patches/geom_sunlabel.c.patch PS. I'm CCing author of post from sparc64@. --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --yPo1CW2ZXioZPB28 Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.4 (FreeBSD) iD8DBQFCWoJRForvXbEpPzQRAmfeAJ49iS6wHTJ9r2/6jZdR/lbk/I0F7gCeOVZy 6LVV/3N0pCAx/Dt797kLHwg= =4kCG -----END PGP SIGNATURE----- --yPo1CW2ZXioZPB28-- From owner-freebsd-geom@FreeBSD.ORG Tue Apr 12 07:12:36 2005 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9542A16A4CF; Tue, 12 Apr 2005 07:12:36 +0000 (GMT) Received: from spork.qfe3.net (spork.qfe3.net [212.13.207.101]) by mx1.FreeBSD.org (Postfix) with ESMTP id 2058943D39; Tue, 12 Apr 2005 07:12:36 +0000 (GMT) (envelope-from chris@qfe3.net) Received: from chris by spork.qfe3.net with local (Exim 4.50) id 1DLFZY-0002HM-Jj; Tue, 12 Apr 2005 08:12:32 +0100 Date: Tue, 12 Apr 2005 08:12:32 +0100 From: Chris Elsworth To: Pawel Jakub Dawidek Message-ID: <20050412071232.GA8756@spork.qfe3.net> References: <20050411122450.GA26898@spork.qfe3.net> <20050411135737.GM837@darkness.comp.waw.pl> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20050411135737.GM837@darkness.comp.waw.pl> User-Agent: Mutt/1.5.6i Sender: Chris Elsworth cc: freebsd-geom@freebsd.org cc: freebsd@gizm0.org cc: Chris Elsworth Subject: Re: gmirror & sparc64 oddness X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 12 Apr 2005 07:12:36 -0000 On Mon, Apr 11, 2005 at 03:57:37PM +0200, Pawel Jakub Dawidek wrote: > > No, the problem is that geom_sunlabel class operates only on rank#1 > providers (disks, etc.). > Mirrors are not rank#1 of course, because there are providers under them. > This was done to prevent recursive labels creations. > > geom_bsd and geom_mbr are already fixed and are using MD5 to verify > if metadata were already used for slices/labels creation. > > I don't have HW to test this, but please try this patch and tell me > if it works for you: Hello Pawel, This seems to work fine - no problems so far and it's happily booted off a gmirror device. The only thing I've noticed so far is that writes during a synchronization of components don't seem to be appearing in gstat for the mirror: dT: 1.010 flag_I 1000000us sizeof 288 i -1 L(q) ops/s r/s kBps ms/r w/s kBps ms/w %busy Name 0 0 0 0 0.0 0 0 0.0 0.0| acd0 1 77 0 0 0.0 77 9757 6.6 50.9| da0 0 77 77 9884 1.8 0 0 0.0 13.8| da1 0 77 77 9884 1.8 0 0 0.0 14.1| mirror/gm0 This is a sync from da1 to da0, but notice how the writes values for the mirror are zero. I can't recall offhand whether this happens on i386 as well, but I just thought I'd point it out as an oddity ; or this is recognised behaviour? Thanks very much for the patch, hope it makes it into the tree :) Cheers, -- Chris From owner-freebsd-geom@FreeBSD.ORG Tue Apr 12 07:18:55 2005 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id E1CDB16A4CE for ; Tue, 12 Apr 2005 07:18:55 +0000 (GMT) Received: from darkness.comp.waw.pl (darkness.comp.waw.pl [195.117.238.136]) by mx1.FreeBSD.org (Postfix) with ESMTP id 65C2A43D55 for ; Tue, 12 Apr 2005 07:18:55 +0000 (GMT) (envelope-from pjd@darkness.comp.waw.pl) Received: by darkness.comp.waw.pl (Postfix, from userid 1009) id 3EB6BACAFB; Tue, 12 Apr 2005 09:18:52 +0200 (CEST) Date: Tue, 12 Apr 2005 09:18:52 +0200 From: Pawel Jakub Dawidek To: Chris Elsworth Message-ID: <20050412071852.GW837@darkness.comp.waw.pl> References: <20050411122450.GA26898@spork.qfe3.net> <20050411135737.GM837@darkness.comp.waw.pl> <20050412071232.GA8756@spork.qfe3.net> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="buIjhH4yeEd3S+4P" Content-Disposition: inline In-Reply-To: <20050412071232.GA8756@spork.qfe3.net> User-Agent: Mutt/1.4.2i X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 5.2.1-RC2 i386 cc: freebsd@gizm0.org cc: freebsd-geom@freebsd.org Subject: Re: gmirror & sparc64 oddness X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 12 Apr 2005 07:18:56 -0000 --buIjhH4yeEd3S+4P Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Apr 12, 2005 at 08:12:32AM +0100, Chris Elsworth wrote: +> On Mon, Apr 11, 2005 at 03:57:37PM +0200, Pawel Jakub Dawidek wrote: +> >=20 +> > No, the problem is that geom_sunlabel class operates only on rank#1 +> > providers (disks, etc.). +> > Mirrors are not rank#1 of course, because there are providers under th= em. +> > This was done to prevent recursive labels creations. +> >=20 +> > geom_bsd and geom_mbr are already fixed and are using MD5 to verify +> > if metadata were already used for slices/labels creation. +> >=20 +> > I don't have HW to test this, but please try this patch and tell me +> > if it works for you: +>=20 +> Hello Pawel, +>=20 +> This seems to work fine - no problems so far and it's happily booted +> off a gmirror device. The only thing I've noticed so far is that +> writes during a synchronization of components don't seem to be +> appearing in gstat for the mirror: +>=20 +> dT: 1.010 flag_I 1000000us sizeof 288 i -1 +> L(q) ops/s r/s kBps ms/r w/s kBps ms/w %busy Name +> 0 0 0 0 0.0 0 0 0.0 0.0| acd0 +> 1 77 0 0 0.0 77 9757 6.6 50.9| da0 +> 0 77 77 9884 1.8 0 0 0.0 13.8| da1 +> 0 77 77 9884 1.8 0 0 0.0 14.1| mirror/gm0 +>=20 +> This is a sync from da1 to da0, but notice how the writes values for +> the mirror are zero. I can't recall offhand whether this happens on +> i386 as well, but I just thought I'd point it out as an oddity ; or +> this is recognised behaviour? It's perfect normal - I read from the mirror, but write goes only to da0 provider, so you can see writes to da0 and read from da1 and gm0. +> Thanks very much for the patch, hope it makes it into the tree :) Yes, thanks for testing. --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --buIjhH4yeEd3S+4P Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.4 (FreeBSD) iD8DBQFCW3ZcForvXbEpPzQRAocxAJ9KMRk3ZjPLBI6bZt9AcaPbWMmKcACgkUkC TL+S7b5gZIDlGSyKHukCHMI= =12YQ -----END PGP SIGNATURE----- --buIjhH4yeEd3S+4P-- From owner-freebsd-geom@FreeBSD.ORG Thu Apr 14 00:27:42 2005 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 2FEA216A4CE for ; Thu, 14 Apr 2005 00:27:42 +0000 (GMT) Received: from zproxy.gmail.com (zproxy.gmail.com [64.233.162.205]) by mx1.FreeBSD.org (Postfix) with ESMTP id 8F9C043D54 for ; Thu, 14 Apr 2005 00:27:41 +0000 (GMT) (envelope-from jclaeson@gmail.com) Received: by zproxy.gmail.com with SMTP id 40so1774600nzk for ; Wed, 13 Apr 2005 17:27:40 -0700 (PDT) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:reply-to:to:subject:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=XocLg4USEHtmIg3zsd/ZAs9a2sXsy4HsIcQzyYDu3+5yF1TMVc71HnEldwsp1JZBbXRQH6tpPKmpmfeEQ2JSLsTVdqornhGMb3NgFzp+I3FWA5T3TRjOjp33cX7eJrzGHNtYPxD6bDkVUQrwDuXG5Z0IZUbU2ssh6NrIhtaz+Qw= Received: by 10.36.34.3 with SMTP id h3mr77022nzh; Wed, 13 Apr 2005 17:27:40 -0700 (PDT) Received: by 10.36.103.4 with HTTP; Wed, 13 Apr 2005 17:27:40 -0700 (PDT) Message-ID: <16a400ac05041317272eb1ea01@mail.gmail.com> Date: Wed, 13 Apr 2005 20:27:40 -0400 From: Jeremy Claeson To: freebsd-geom@freebsd.org In-Reply-To: <20050404213800.A29631@denninger.net> Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline References: <4250A400.50200@videotron.ca> <4250F778.3040903@zvala.cz> <4251F631.3050707@videotron.ca> <20050404213800.A29631@denninger.net> Subject: Re: mirroring two data disks (no system files on them) X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: Jeremy Claeson List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 14 Apr 2005 00:27:42 -0000 I'm trying to do the same thing but I've not had any luck still. I'm messing up somewhere in preparing the drives. I've got two 250GB drives (ad4 and ad6). I'd like to mirror them as data disks. Here's what I'm doing: $ /stand/sysinstall (fdisk and label ad4 as /usr/sambashares/data and writing that out to disk. this works and I can access the disk) $ /stand/sysinstall (fdisk ad6 and write that out to disk) $ gmirror label -v -n -b round-robin gm0s1 /dev/ad3s1 $ gmirror load (Here everything looks ok but I get a warning:=20 "WARNING: Expected rawoffset 0, found 63"=20 "GEOM_MIRROR: Cannot add disk mirror/gm0s1c to gm0s1 (error=3D17).") $ gmirror configure -a gm0s1 (at this point I get an error that says "Bad address" and then nothing else works.) [root@epiphyte jclaeson]# ls /dev/ad4* /dev/ad6* /dev/ad4 /dev/ad4s1 /dev/ad4s1c /dev/ad4s1d /dev/ad6 [root@epiphyte jclaeson]# ll /dev/mirror/ total 1 dr-xr-xr-x 2 root wheel 512 Apr 13 20:19 ./ dr-xr-xr-x 5 root wheel 512 Apr 13 16:13 ../ crw-r----- 1 root operator 4, 30 Apr 13 20:13 gm0 crw-r----- 1 root operator 4, 31 Apr 13 20:13 gm0s1 crw-r----- 1 root operator 4, 31 Apr 13 20:13 gm0s1 crw-r----- 1 root operator 4, 33 Apr 13 20:13 gm0s1c crw-r----- 1 root operator 4, 33 Apr 13 20:13 gm0s1c [root@epiphyte jclaeson]# bsdlabel ad4s1 # /dev/ad4s1: 8 partitions: # size offset fstype [fsize bsize bps/cpg] c: 488392002 0 unused 0 0 # "raw" part, don't edit d: 488392002 0 4.2BSD 2048 16384 28552 [root@epiphyte jclaeson]# bsdlabel ad6s1 bsdlabel: /dev/ad6s1: No such file or directory [root@epiphyte jclaeson]# bsdlabel ad6 bsdlabel: /dev/ad6: no valid label found [root@epiphyte jclaeson]# So, I'm sure I'm preppring the disks wrong, I'm just not sure what I'm doing wrong. Thanks in advance for your help and advice! ~jeremy On 4/4/05, Karl Denninger wrote: > On Mon, Apr 04, 2005 at 10:21:37PM -0400, Christian Caron wrote: > > Tomas Zvala a =E9crit : > > > did /dev/ad3s1 contain filesystem already? did you do newfs > > > /dev/mirror/gm0s1 ? what does it mean "dies"? what does it say? > > > > Ok... man newfs shed some light on how to prepare a new disk... > > > > newfs -U /dev/mirror/gm0s1 > > mkdir /mirror > > mount /dev/mirror/gm0s1 /mirror > > > > did the trick. It boots ok and it seems to work (gmirror list does > > return something, although it says "DIRTY" which doesn't sound > > excellent...). > > > > I'll read the manual. > > > > Thanks! > > > > Christian >=20 > "Dirty" is normal. It means the volume is mounted and has data on it, an= d > is not "clean", just as a mounted disk is "dirty" while it is actually > mounted. >=20 > -- > -- > Karl Denninger (karl@denninger.net) Internet Consultant & Kids Rights Act= ivist > http://www.denninger.net My home on the net - links to everything = I do! > http://scubaforum.org Your UNCENSORED place to talk about DIVIN= G! > http://www.spamcuda.net SPAM FREE mailboxes - FREE FOR A LIMITED = TIME! > http://genesis3.blogspot.com Musings Of A Sentient Mind >=20 >=20 > _______________________________________________ > freebsd-geom@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-geom > To unsubscribe, send any mail to "freebsd-geom-unsubscribe@freebsd.org" >