From owner-freebsd-geom@FreeBSD.ORG Sun Jan 8 21:43:09 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 0469E16A420 for ; Sun, 8 Jan 2006 21:43:09 +0000 (GMT) (envelope-from brenthostetler@gmail.com) Received: from zproxy.gmail.com (zproxy.gmail.com [64.233.162.192]) by mx1.FreeBSD.org (Postfix) with ESMTP id 2E1EC43D48 for ; Sun, 8 Jan 2006 21:43:07 +0000 (GMT) (envelope-from brenthostetler@gmail.com) Received: by zproxy.gmail.com with SMTP id 9so3744314nzo for ; Sun, 08 Jan 2006 13:43:07 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=UGUfJUbxxzL+awA5WVEbQZdaNNco2ehs0Hb2oqZHElL2+78KxHjtHgyRmRG7Y+V9INYj3JkNNmG0O4QP+RD9hJgzcFAkC8EZHwIpMUjAqFRElnfkCd1MT5PSp214S8IGQIyou+oRc3QR1XNZou4lA4k3PgH12RZiYXfNEodl2Wo= Received: by 10.36.221.48 with SMTP id t48mr11625160nzg; Sun, 08 Jan 2006 13:43:07 -0800 (PST) Received: by 10.36.88.9 with HTTP; Sun, 8 Jan 2006 13:43:06 -0800 (PST) Message-ID: Date: Sun, 8 Jan 2006 13:43:06 -0800 From: Brent Hostetler To: Eric Anderson In-Reply-To: <43BE6E41.1060509@centtech.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline References: <20060104201149.GC17950@garage.freebsd.pl> <43BE6E41.1060509@centtech.com> Cc: pjd@freebsd.org, freebsd-geom@freebsd.org Subject: Re: Problems setting up gmirror of live system X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 08 Jan 2006 21:43:09 -0000 On 1/6/06, Eric Anderson wrote: > Brent Hostetler wrote: > > >How do I resolve this issue? Is this just on config file issue or > >something with MBR? > > > >Since when done, the machine will be using the onboard ide, two ide > >pci cards and a serial ide pci card will I be having issues with the > >drive order getting screwy??? > > > > > > > You might just have to reload the mbr. Read man boot0cfg for more detail= s.. > > Eric Well, I have discovered that I am very confused on how FreeBSD handles its boot stages... Now I have managed to hose the drive to the point that it will not boot with drives on either controller. I did did a boot0cfg -B on both drives and then moved them to the new controller and rebooted. I get to the first two stages fine: >> FreeBSD/i386 BOOT Default: 0:ad(0,a)/boot/loader boot: I can issue the following: boot: 0:ad(0,a)/boot/? and see the listing of the files including loader. However, once the loader tries to go my machine hangs with the following: BTX loader 1.00 BTX version 1.01 Consoles: internal video/keyboard BIOS drive A: is disk0 BIOS drive C: is disk1 BIOS 640kb/490432kB available memory FreeBSD/i386 bootstrap loader, Revision 1.1 (root@x64.samsco.home, Thu Nov 3 07:33:10 UTC 2005) - And the machine goes no further... At this point I have pulled one of the mirrored disks so hopefuly in the process of learning whats going on I keep one valid drive. I can boot with fixit CDROM and mount the drive and see all the data is fine and dandy, just cant boot.. Seems there is a config issue with the loader?? Any help would be appreciated! Im pulling my hair out reading the man pages trying to figure this out... Thanks, Brent ----- Misc Info. Fixit# fdisk -s ad0 /dev/ad0: 4961616 cyl 1 hd 63 sec Part Start Size Type Flags 1: 63 83885697 0xa5 0x80 2: 83886201 228695607 0xa5 0x00 Fixit# boot0cfg -v ad0 # flag start chs type end chs offset =20 size 1 0x80 0: 1: 1 0xa5 275: 15:63 63 8388= 5697 2 0x00 276 7: 1 0xa5 852L 15:63 83886201 228695607 version=3D1.0 drive=3D0x80 mask=3D0xf ticks=3D182 options=3Dpacket,update,nosetdrv default_selection=3DF1 (Slice 1) Fixit# mount /dev/ad0s1a /mnt Fixit# cd /mnt/boot Fixit# ls beastie.4th boot2 kernel/ loader.rc screen.4th boot cdboot loader* mbr support.= 4th boot0 defaults/ loader.4th modules/ boot0sio device.hints loader.conf pxeboot boot1 frames.4th loader.help reboot.core Fixit# cat loader.conf geom_mirror_load=3D"YES" From owner-freebsd-geom@FreeBSD.ORG Mon Jan 9 01:32:37 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 0D5F716A41F for ; Mon, 9 Jan 2006 01:32:37 +0000 (GMT) (envelope-from tyler@tylercentral.com) Received: from pd3mo2so.prod.shaw.ca (shawidc-mo1.cg.shawcable.net [24.71.223.10]) by mx1.FreeBSD.org (Postfix) with ESMTP id 67AAD43D46 for ; Mon, 9 Jan 2006 01:32:36 +0000 (GMT) (envelope-from tyler@tylercentral.com) Received: from pd5mr7so.prod.shaw.ca (pd5mr7so-qfe3.prod.shaw.ca [10.0.141.183]) by l-daemon (Sun ONE Messaging Server 6.0 HotFix 1.01 (built Mar 15 2004)) with ESMTP id <0ISS00M64XJWUFB0@l-daemon> for freebsd-geom@freebsd.org; Sun, 08 Jan 2006 18:31:08 -0700 (MST) Received: from pn2ml5so.prod.shaw.ca ([10.0.121.149]) by pd5mr7so.prod.shaw.ca (Sun ONE Messaging Server 6.0 HotFix 1.01 (built Mar 15 2004)) with ESMTP id <0ISS00097XJW6V10@pd5mr7so.prod.shaw.ca> for freebsd-geom@freebsd.org; Sun, 08 Jan 2006 18:31:08 -0700 (MST) Received: from TylerMain ([70.72.192.131]) by l-daemon (Sun ONE Messaging Server 6.0 HotFix 1.01 (built Mar 15 2004)) with ESMTP id <0ISS00HGPXJV20J0@l-daemon> for freebsd-geom@freebsd.org; Sun, 08 Jan 2006 18:31:08 -0700 (MST) Date: Sun, 08 Jan 2006 18:30:32 -0700 From: Tyler To: freebsd-geom@freebsd.org Message-id: <000101c614bc$4843fc20$6400a8c0@TylerMain> MIME-version: 1.0 X-MIMEOLE: Produced By Microsoft MimeOLE V6.00.2900.2670 X-Mailer: Microsoft Office Outlook 11 Thread-index: AcYUvEfwgZUkSt1xTtWMPFXBKhd/zA== Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: g_vfs_done error 5 X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 09 Jan 2006 01:32:37 -0000 Hi All, I don't think this error is strictly Geom related, but I thought I'd ask here anyway. I've seen a lot of posts regarding this error, but no solutions. I've run 2x 40GB drives in RAID 1 using Geom_Mirror and all has been well for about a year. I added a PCI ATA133 RAID controller today and it doesn't work well with my mirror. It is a very generic controller with a Silicon image chipset. FreeBSD see's it, I partitioned and formatted it, but if I copy large amounts of data to it, the system panics and crashes. This is a headless server, so the error's spew on the console and I can't get a copy of them, but here's the gist. g_vfs_done():ar0s1d[WRITE(offset=189802479616, length=16384)]error = 5 Repeated over 200 times. The error at the panic is: Panic: initiate_write_inodeblock_ufs2: already started. I didn't see any memory errors or anything else that would indicate limited resources. Here's my setup. Please let me know if this is a known issue, and if there is a solution. ad0: 38172MB at ata0-master UDMA100 acd0: DVDROM at ata0-slave UDMA33 ad2: 38172MB at ata1-master UDMA100 ad6: 58644MB at ata3-master UDMA133 ad7: 43979MB at ata3-slave UDMA100 ar0: 87955MB status: READY ar0: disk0 READY using ad6 at ata3-master ar0: disk1 READY using ad7 at ata3-slave GEOM_MIRROR: Device gm0 created (id=2553880986). GEOM_MIRROR: Device gm0: provider ad0 detected. GEOM_MIRROR: Device gm0: provider ad2 detected. GEOM_MIRROR: Device gm0: provider ad2 activated. GEOM_MIRROR: Device gm0: provider ad0 activated. GEOM_MIRROR: Device gm0: provider mirror/gm0 launched. Trying to mount root from ufs:/dev/mirror/gm0s1a > uname -a FreeBSD Server1 6.0-RELEASE-p1 FreeBSD 6.0-RELEASE-p1 #2: Tue Jan 3 22:17:56 MST 2006 root@Server1:/usr/obj/usr/src/sys/TYLER-FBSD6 i386 (06:27 PM)(/var/log)# fdisk /dev/mirror/gm0 ******* Working on device /dev/mirror/gm0 ******* parameters extracted from in-core disklabel are: cylinders=4866 heads=255 sectors/track=63 (16065 blks/cyl) Figures below won't work with BIOS for partitions not in cyl 1 parameters to be used for BIOS calculations are: cylinders=4866 heads=255 sectors/track=63 (16065 blks/cyl) Media sector size is 512 Warning: BIOS sector numbering starts with sector 1 Information from DOS bootblock is: The data for partition 1 is: sysid 165 (0xa5),(FreeBSD/NetBSD/386BSD) start 63, size 78172227 (38170 Meg), flag 80 (active) beg: cyl 0/ head 1/ sector 1; end: cyl 769/ head 254/ sector 63 The data for partition 2 is: The data for partition 3 is: The data for partition 4 is: (06:27 PM)(/var/log)# fdisk /dev/ar0 ******* Working on device /dev/ar0 ******* parameters extracted from in-core disklabel are: cylinders=11212 heads=255 sectors/track=63 (16065 blks/cyl) Figures below won't work with BIOS for partitions not in cyl 1 parameters to be used for BIOS calculations are: cylinders=11212 heads=255 sectors/track=63 (16065 blks/cyl) Media sector size is 512 Warning: BIOS sector numbering starts with sector 1 Information from DOS bootblock is: The data for partition 1 is: sysid 165 (0xa5),(FreeBSD/NetBSD/386BSD) start 63, size 180120717 (87949 Meg), flag 80 (active) beg: cyl 0/ head 1/ sector 1; end: cyl 1023/ head 254/ sector 63 The data for partition 2 is: The data for partition 3 is: The data for partition 4 is: Tyler From owner-freebsd-geom@FreeBSD.ORG Mon Jan 9 05:56:29 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 65C3F16A41F for ; Mon, 9 Jan 2006 05:56:29 +0000 (GMT) (envelope-from brenthostetler@gmail.com) Received: from zproxy.gmail.com (zproxy.gmail.com [64.233.162.206]) by mx1.FreeBSD.org (Postfix) with ESMTP id 897D543D45 for ; Mon, 9 Jan 2006 05:56:28 +0000 (GMT) (envelope-from brenthostetler@gmail.com) Received: by zproxy.gmail.com with SMTP id 9so58160nzo for ; Sun, 08 Jan 2006 21:56:28 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=WkVrCJl2rXbLRc8x3JxyHayQLfRPZMD9fqNdvLwTE/yU/i3HgT1Pc48peRiw3AXTgu1aThO4bk0bT3Ned1mGNthg9vb7Nu6QT4O+TPH15N8+hptOUOeUHg+ybkulgvxGy6QAlABQ/XfDFjkTeEdxZITTcyuvY9isVO+vq0cF1/w= Received: by 10.36.36.12 with SMTP id j12mr6454436nzj; Sun, 08 Jan 2006 21:56:27 -0800 (PST) Received: by 10.36.88.9 with HTTP; Sun, 8 Jan 2006 21:56:15 -0800 (PST) Message-ID: Date: Sun, 8 Jan 2006 21:56:15 -0800 From: Brent Hostetler To: freebsd-geom@freebsd.org, pjd@freebsd.org In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline References: <20060104201149.GC17950@garage.freebsd.pl> <43BE6E41.1060509@centtech.com> Cc: Subject: Re: Problems setting up gmirror of live system X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 09 Jan 2006 05:56:29 -0000 On 1/8/06, Brent Hostetler wrote: > On 1/6/06, Eric Anderson wrote: > > Brent Hostetler wrote: > > > I can issue the following: > > boot: 0:ad(0,a)/boot/? > > and see the listing of the files including loader. > > However, once the loader tries to go my machine hangs with the following: Yeah!! I discovered my problem was a disk geometry error. I switched the bios settings from Large to LBA and the system booted right up. That was frustrating.. Brent From owner-freebsd-geom@FreeBSD.ORG Mon Jan 9 11:02:22 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 1436C16A41F for ; Mon, 9 Jan 2006 11:02:22 +0000 (GMT) (envelope-from owner-bugmaster@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [216.136.204.21]) by mx1.FreeBSD.org (Postfix) with ESMTP id C694143D46 for ; Mon, 9 Jan 2006 11:02:21 +0000 (GMT) (envelope-from owner-bugmaster@freebsd.org) Received: from freefall.freebsd.org (peter@localhost [127.0.0.1]) by freefall.freebsd.org (8.13.4/8.13.4) with ESMTP id k09B2LI3066046 for ; Mon, 9 Jan 2006 11:02:21 GMT (envelope-from owner-bugmaster@freebsd.org) Received: (from peter@localhost) by freefall.freebsd.org (8.13.4/8.13.4/Submit) id k09B2KxQ066041 for freebsd-geom@freebsd.org; Mon, 9 Jan 2006 11:02:20 GMT (envelope-from owner-bugmaster@freebsd.org) Date: Mon, 9 Jan 2006 11:02:20 GMT Message-Id: <200601091102.k09B2KxQ066041@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: peter set sender to owner-bugmaster@freebsd.org using -f From: FreeBSD bugmaster To: freebsd-geom@FreeBSD.org Cc: Subject: Current problem reports assigned to you X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 09 Jan 2006 11:02:22 -0000 Current FreeBSD problem reports Critical problems Serious problems S Submitted Tracker Resp. Description ------------------------------------------------------------------------------- o [2005/01/21] kern/76538 geom [gbde] nfs-write on gbde partition stalls o [2005/08/04] kern/84556 geom [geom] GBDE-encrypted swap causes panic a o [2005/10/16] kern/87544 geom [gbde] mmaping large files on a gbde file o [2005/11/16] kern/89102 geom [geom_vfs] [panic] panic when forced unmo o [2005/12/08] bin/90093 geom fdisk(8) incapable of altering in-core ge o [2005/12/18] kern/90582 geom [geom_mirror] [panic] Restore cause panic 6 problems total. Non-critical problems S Submitted Tracker Resp. Description ------------------------------------------------------------------------------- o [2005/02/26] bin/78131 geom gbde "destroy" not working. o [2005/03/26] kern/79251 geom [2TB] newfs fails on 2.6TB gbde device 2 problems total. From owner-freebsd-geom@FreeBSD.ORG Tue Jan 10 09:30:38 2006 Return-Path: X-Original-To: geom@freebsd.org Delivered-To: freebsd-geom@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id A7D7816A41F for ; Tue, 10 Jan 2006 09:30:38 +0000 (GMT) (envelope-from asalinas@ci.garland.tx.us) Received: from 194-152-194-27.adsl.net.t-com.hr (194-152-194-27.adsl.net.t-com.hr [194.152.194.27]) by mx1.FreeBSD.org (Postfix) with ESMTP id 9163343D5D for ; Tue, 10 Jan 2006 09:30:36 +0000 (GMT) (envelope-from asalinas@ci.garland.tx.us) Date: Two, 10 Jan 2006 9:30:36 -0060 From: "Lowell Maddox" X-Mailer: The Bat! (v3.51.10) CD5BF9353B3B7091 X-Priority: 3 (Normal) Message-ID: <8376493832.20060110093036@ci.garland.tx.us> To: geom@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Cc: Subject: re: NOTIFICATION - Inv Information X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Lowell Maddox List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 10 Jan 2006 09:30:38 -0000 RYNL Climbs Again, And Is Set to Double! Company: Reynaldo's Mexican Food Inc. Symbol: RYNL (OTCBB) Monday Open: $0. Prev Price: $0.15 Monday Close: $0.16 Price Increase: 6.7% Short Term: $0.30 - $0.40 Long Term: $1.50 - $1.75 Why RYNL Before Christmas we began watching Reynaldo's Mexican Food Inc. (RYNL OTCBB) a producer of packaged Mexican Cuisine. From multiple factories RYNL distributes via several of the United States largest retail and grocery chains throughout Mexico and 14 different states. Go to the website and look at the list of huge partnerships with strategic distributors. These partnerships not only give them a great deal of stability and a strong market share but it also gives them the ability to continue expanding into an ever broader market through their partners avenues of distribution. Activity This stock had some large volume and price jumps once their exposure to the the market increased. These increases have held ground throughout the holidays and today we saw another increase in price. With increasing demand for quality convenience food, and growing interest in this stock we believe we will see larger increases tomorrow and through the week. Indicator: B U Y Review the website and grab an opening buy in the morning. This is a low price walk in buy which we believe can easy double your investment dollar this week alone. Members, this is one solid company that has already show huge potential by their ability to expand and make all the right connections. Don't over look this solid stock. Add this one to your investment portfolio. You wont regret it." From owner-freebsd-geom@FreeBSD.ORG Fri Jan 13 08:38:45 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9DDA516A41F for ; Fri, 13 Jan 2006 08:38:45 +0000 (GMT) (envelope-from oxy@field.hu) Received: from green.field.hu (green.field.hu [217.20.130.28]) by mx1.FreeBSD.org (Postfix) with ESMTP id 2939C43D45 for ; Fri, 13 Jan 2006 08:38:44 +0000 (GMT) (envelope-from oxy@field.hu) Received: from localhost (green.field.hu [217.20.130.28]) by green.field.hu (Postfix) with ESMTP id 32B1A108F6D for ; Fri, 13 Jan 2006 09:38:09 +0100 (CET) Received: from green.field.hu ([217.20.130.28]) by localhost (green.field.hu [217.20.130.28]) (amavisd-new, port 10024) with ESMTP id 93996-10 for ; Fri, 13 Jan 2006 09:38:09 +0100 (CET) Received: from oxy (dsl85-238-73-74.pool.tvnet.hu [85.238.73.74]) by green.field.hu (Postfix) with ESMTP id EA048108E9D for ; Fri, 13 Jan 2006 09:38:08 +0100 (CET) Message-ID: <000501c6181c$c7e96330$0201a8c0@oxy> From: "OxY" To: Date: Fri, 13 Jan 2006 09:38:51 +0100 MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset="iso-8859-2"; reply-type=original Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2900.2670 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.2670 X-Virus-Scanned: by Amavisd-new (Spamassassin+Razor2+Pyzor+DCC+Bayes db, Clamd Antivirus) at field.hu Subject: mirroring geli or gbde partition X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 13 Jan 2006 08:38:45 -0000 hi! i put my files on encrypted partition, to save it from others.. however my data is valuable, losing it is a tragedy :) is it possible to mirror a geli or gbde encrypted partition? thx, cheers! From owner-freebsd-geom@FreeBSD.ORG Fri Jan 13 21:35:02 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id C61AA16A420 for ; Fri, 13 Jan 2006 21:35:02 +0000 (GMT) (envelope-from lists-freebsd@biaix.org) Received: from grummit.biaix.org (86.Red-213-97-212.staticIP.rima-tde.net [213.97.212.86]) by mx1.FreeBSD.org (Postfix) with SMTP id A2E9543D4C for ; Fri, 13 Jan 2006 21:34:59 +0000 (GMT) (envelope-from lists-freebsd@biaix.org) Received: (qmail 54637 invoked by uid 1000); 13 Jan 2006 21:31:51 -0000 Date: Fri, 13 Jan 2006 22:31:51 +0100 From: Joan Picanyol i Puig To: freebsd-geom@freebsd.org Message-ID: <20060113213151.GA49805@grummit.biaix.org> Mime-Version: 1.0 Content-Type: multipart/mixed; boundary="Kj7319i9nmIyA2yE" Content-Disposition: inline User-Agent: Mutt/1.5.9i Cc: le@freebsd.org Subject: sorely missing gvinum start or attach X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 13 Jan 2006 21:35:02 -0000 --Kj7319i9nmIyA2yE Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Hi there, I'm setting up a system (STABLE from around Jan 11th) with gvinum, and I'm wondering how to add my second drive to the setup. I've can boot from gvinum, and knowing that 'attach' is not yet implemented, I've tried zeroing the gvinum on-disk configuration and recreating it with the second disk. This works, but (a) gvinum marks both disks as up, which I know is not true, so I (b) 'setstate stale' my second drive. Trying to 'start' it doesn't work, but what's worse, (c) upon rebooting (hoping that gvinum will start to rebuild the stale drive) gvinum marks everything as stale!! I figure I can just dd the whole vinum slice, but I'd like to see gvinum rebuilding a drive... Attached are two script files (*.out), the vinum config files used and the detailed vinum versions used. gvinum's messages in stderr (not recorded in the script) were: a) on creating the configuration: gvinum: size of sd scratch.p0.s0 is not a multiple of plex stripesize, taking off 314368 bytes gvinum: size of sd scratch.p0.s1 is not a multiple of plex stripesize, taking off 314368 bytes GEOM_VINUM: subdisk swap.p1.s0 state change: stale -> up GEOM_VINUM: plex swap.p1 state change: down -> up GEOM_VINUM: subdisk std-root.p1.s0 state change: stale -> up GEOM_VINUM: plex std-root.p1 state change: down -> up GEOM_VINUM: subdisk base.p1.s0 state change: stale -> up GEOM_VINUM: plex base.p1 state change: down -> up GEOM_VINUM: subdisk apps.p1.s0 state change: stale -> up GEOM_VINUM: plex apps.p1 state change: down -> up GEOM_VINUM: subdisk package.p1.s0 state change: stale -> up GEOM_VINUM: plex package.p1 state change: down -> up GEOM_VINUM: subdisk std-var.p1.s0 state change: stale -> up GEOM_VINUM: plex std-var.p1 state change: down -> up GEOM_VINUM: subdisk scratch.p0.s1 state change: down -> up GEOM_VINUM: subdisk home.p1.s0 state change: stale -> up GEOM_VINUM: plex home.p1 state change: down -> up GEOM_VINUM: subdisk swap.p0.s0 state change: down -> up GEOM_VINUM: plex swap.p0 state change: down -> up GEOM_VINUM: subdisk std-root.p0.s0 state change: down -> up GEOM_VINUM: plex std-root.p0 state change: down -> up GEOM_VINUM: subdisk base.p0.s0 state change: down -> up GEOM_VINUM: plex base.p0 state change: down -> up GEOM_VINUM: subdisk apps.p0.s0 state change: down -> up GEOM_VINUM: plex apps.p0 state change: down -> up GEOM_VINUM: subdisk package.p0.s0 state change: down -> up GEOM_VINUM: plex package.p0 state change: down -> up GEOM_VINUM: subdisk std-var.p0.s0 state change: down -> up GEOM_VINUM: plex std-var.p0 state change: down -> up GEOM_VINUM: subdisk scratch.p0.s0 state change: down -> up GEOM_VINUM: plex scratch.p0 state change: down -> up GEOM_VINUM: subdisk home.p0.s0 state change: down -> up GEOM_VINUM: plex home.p0 state change: down -> up b) on setstate stale estribor GEOM_VINUM: subdisk swap.p1.s0 state change: up -> down GEOM_VINUM: plex swap.p1 state change: up -> down GEOM_VINUM: subdisk std-root.p1.s0 state change: up -> down GEOM_VINUM: plex std-root.p1 state change: up -> down GEOM_VINUM: subdisk base.p1.s0 state change: up -> down GEOM_VINUM: plex base.p1 state change: up -> down GEOM_VINUM: subdisk apps.p1.s0 state change: up -> down GEOM_VINUM: plex apps.p1 state change: up -> down GEOM_VINUM: subdisk package.p1.s0 state change: up -> down GEOM_VINUM: plex package.p1 state change: up -> down GEOM_VINUM: subdisk std-var.p1.s0 state change: up -> down GEOM_VINUM: plex std-var.p1 state change: up -> down GEOM_VINUM: subdisk scratch.p0.s1 state change: up -> down GEOM_VINUM: plex scratch.p0 state change: up -> down GEOM_VINUM: subdisk home.p1.s0 state change: up -> down GEOM_VINUM: plex home.p1 state change: up -> down c) on rebooting GEOM_VINUM: subdisk scratch.p0.s1 state change: down -> stale GEOM_VINUM: subdisk swap.p0.s0 state change: down -> stale GEOM_VINUM: subdisk std-root.p0.s0 state change: down -> stale GEOM_VINUM: subdisk base.p0.s0 state change: down -> stale GEOM_VINUM: subdisk apps.p0.s0 state change: down -> stale GEOM_VINUM: subdisk package.p0.s0 state change: down -> stale GEOM_VINUM: subdisk std-var.p0.s0 state change: down -> stale GEOM_VINUM: subdisk scratch.p0.s0 state change: down -> stale GEOM_VINUM: subdisk home.p0.s0 state change: down -> stale How can I workaround this lack of gvinum functionality? -- pica --Kj7319i9nmIyA2yE Content-Type: text/plain; charset=us-ascii Content-Disposition: attachment; filename="adding_second_drive.out" Content-Transfer-Encoding: quoted-printable Script started on Sat Jan 14 23:12:18 2006 gromit# dd if=3D/dev/zero of=3D/dev/ad4s1d count=3D9 9+0 records in 9+0 records out 4608 bytes transferred in 0.001490 secs (3092376 bytes/sec)=0D gromit# dd if=3D/dev/zero of=3D/dev/ad4s1d count=3D9 9+0 records in=0D 9+0 records out=0D 4608 bytes transferred in 0.001460 secs (3156001 bytes/sec)=0D gromit# kldload geom_vinum gromit# gvinum create ./both-drives.vinum 2 drives:=0D D estribor State: up /dev/ad6s1d A: 214405/237444 MB= (90%)=0D D babor State: up /dev/ad4s1d A: 214405/237444 MB= (90%)=0D =0D 8 volumes:=0D V home State: up Plexes: 2 Size: 10 GB= =0D V scratch State: up Plexes: 1 Size: 3071 MB= =0D V std-var State: up Plexes: 2 Size: 2048 MB= =0D V package State: up Plexes: 2 Size: 1024 MB= =0D V apps State: up Plexes: 2 Size: 5120 MB= =0D V base State: up Plexes: 2 Size: 512 MB= =0D V swap State: up Plexes: 2 Size: 2047 MB= =0D V std-root State: up Plexes: 2 Size: 512 MB= =0D =0D 15 plexes:=0D P home.p1 C State: up Subdisks: 1 Size: 10 GB= =0D P home.p0 C State: up Subdisks: 1 Size: 10 GB= =0D P scratch.p0 S State: up Subdisks: 2 Size: 3071 MB= =0D P std-var.p1 C State: up Subdisks: 1 Size: 2048 MB= =0D P std-var.p0 C State: up Subdisks: 1 Size: 2048 MB= =0D P package.p1 C State: up Subdisks: 1 Size: 1024 MB= =0D P package.p0 C State: up Subdisks: 1 Size: 1024 MB= =0D P apps.p1 C State: up Subdisks: 1 Size: 5120 MB= =0D P apps.p0 C State: up Subdisks: 1 Size: 5120 MB= =0D P base.p1 C State: up Subdisks: 1 Size: 512 MB= =0D P base.p0 C State: up Subdisks: 1 Size: 512 MB= =0D P swap.p1 C State: up Subdisks: 1 Size: 2047 MB= =0D P swap.p0 C State: up Subdisks: 1 Size: 2047 MB= =0D P std-root.p1 C State: up Subdisks: 1 Size: 512 MB= =0D P std-root.p0 C State: up Subdisks: 1 Size: 512 MB= =0D =0D 16 subdisks:=0D S home.p1.s0 State: up D: estribor Size: 10 GB= =0D S home.p0.s0 State: up D: babor Size: 10 GB= =0D S scratch.p0.s1 State: up D: estribor Size: 1535 MB= =0D S scratch.p0.s0 State: up D: babor Size: 1535 MB= =0D S std-var.p1.s0 State: up D: estribor Size: 2048 MB= =0D S std-var.p0.s0 State: up D: babor Size: 2048 MB= =0D S package.p1.s0 State: up D: estribor Size: 1024 MB= =0D S package.p0.s0 State: up D: babor Size: 1024 MB= =0D S apps.p1.s0 State: up D: estribor Size: 5120 MB= =0D S apps.p0.s0 State: up D: babor Size: 5120 MB= =0D S base.p1.s0 State: up D: estribor Size: 512 MB= =0D S base.p0.s0 State: up D: babor Size: 512 MB= =0D S swap.p1.s0 State: up D: estribor Size: 2047 MB= =0D S swap.p0.s0 State: up D: babor Size: 2047 MB= =0D S std-root.p1.s0 State: up D: estribor Size: 512 MB= =0D S std-root.p0.s0 State: up D: babor Size: 512 MB= =0D gromit# gvinum setstate stale estribor=0D=0D gromit# gvinum start estribor=0D=0D gvinum: can't start: cannot start 'estribor' - not yet supported=0D gromit# D=0D=0D =0D=0D gromit# ^D=08=08exit=0D Script done on Sat Jan 14 23:13:13 2006 --Kj7319i9nmIyA2yE Content-Type: text/plain; charset=us-ascii Content-Disposition: attachment; filename="after_reboot.out" Content-Transfer-Encoding: quoted-printable Script started on Sat Jan 14 23:17:49 2006 gromit# kldload geom_vinum=0D=0D gromit# gvinum l=0D=0D 2 drives:=0D D babor State: up /dev/ad4s1d A: 214405/237444 MB= (90%)=0D D estribor State: up /dev/ad6s1d A: 214405/237444 MB= (90%)=0D =0D 8 volumes:=0D V std-root State: down Plexes: 2 Size: 512 MB= =0D V swap State: down Plexes: 2 Size: 2047 MB= =0D V base State: down Plexes: 2 Size: 512 MB= =0D V apps State: down Plexes: 2 Size: 5120 MB= =0D V package State: down Plexes: 2 Size: 1024 MB= =0D V std-var State: down Plexes: 2 Size: 2048 MB= =0D V scratch State: down Plexes: 1 Size: 3071 MB= =0D V home State: down Plexes: 2 Size: 10 GB= =0D =0D 15 plexes:=0D P std-root.p0 C State: down Subdisks: 1 Size: 512 MB= =0D P std-root.p1 C State: down Subdisks: 1 Size: 512 MB= =0D P swap.p0 C State: down Subdisks: 1 Size: 2047 MB= =0D P swap.p1 C State: down Subdisks: 1 Size: 2047 MB= =0D P base.p0 C State: down Subdisks: 1 Size: 512 MB= =0D P base.p1 C State: down Subdisks: 1 Size: 512 MB= =0D P apps.p0 C State: down Subdisks: 1 Size: 5120 MB= =0D P apps.p1 C State: down Subdisks: 1 Size: 5120 MB= =0D P package.p0 C State: down Subdisks: 1 Size: 1024 MB= =0D P package.p1 C State: down Subdisks: 1 Size: 1024 MB= =0D P std-var.p0 C State: down Subdisks: 1 Size: 2048 MB= =0D P std-var.p1 C State: down Subdisks: 1 Size: 2048 MB= =0D P scratch.p0 S State: down Subdisks: 2 Size: 3071 MB= =0D P home.p0 C State: down Subdisks: 1 Size: 10 GB= =0D P home.p1 C State: down Subdisks: 1 Size: 10 GB= =0D =0D 16 subdisks:=0D S std-root.p0.s0 State: stale D: babor Size: 512 MB= =0D S std-root.p1.s0 State: stale D: estribor Size: 512 MB= =0D S swap.p0.s0 State: stale D: babor Size: 2047 MB= =0D S swap.p1.s0 State: stale D: estribor Size: 2047 MB= =0D S base.p0.s0 State: stale D: babor Size: 512 MB= =0D S base.p1.s0 State: stale D: estribor Size: 512 MB= =0D S apps.p0.s0 State: stale D: babor Size: 5120 MB= =0D S apps.p1.s0 State: stale D: estribor Size: 5120 MB= =0D S package.p0.s0 State: stale D: babor Size: 1024 MB= =0D S package.p1.s0 State: stale D: estribor Size: 1024 MB= =0D S std-var.p0.s0 State: stale D: babor Size: 2048 MB= =0D S std-var.p1.s0 State: stale D: estribor Size: 2048 MB= =0D S scratch.p0.s0 State: stale D: babor Size: 1535 MB= =0D S scratch.p0.s1 State: stale D: estribor Size: 1535 MB= =0D S home.p0.s0 State: stale D: babor Size: 10 GB= =0D S home.p1.s0 State: stale D: estribor Size: 10 GB= =0D gromit# ^D=08=08exit=0D Script done on Sat Jan 14 23:18:14 2006 --Kj7319i9nmIyA2yE Content-Type: text/plain; charset=us-ascii Content-Disposition: attachment; filename="drive-babor.vinum" drive babor device /dev/ad4s1d # vol root is after swap volume std-root plex org concat sd len 1048576s driveoffset 4194288s drive babor # vol swap is the first one, starts after vinum labels # offset is 281-16 volume swap plex org concat sd len 4194023s driveoffset 265s drive babor volume base plex org concat sd len 1048576s driveoffset 5242864s drive babor # 5GB volume apps plex org concat sd len 10485760s driveoffset 6291440s drive babor # 1 GB volume package plex org concat sd len 2097152s driveoffset 16777200s drive babor # vol std-var: 2GB volume std-var plex org concat sd len 4194304s driveoffset 18874352s drive babor # vol scratch # should be striped, but for now... # sd len 3145728s # ends at 20971504s volume scratch plex org concat sd len 3145728s driveoffset 23068656s drive babor volume home plex org concat sd len 20971520s driveoffset 29360112s drive babor --Kj7319i9nmIyA2yE Content-Type: text/plain; charset=us-ascii Content-Disposition: attachment; filename="both-drives.vinum" drive babor device /dev/ad4s1d drive estribor device /dev/ad6s1d # vol root is after swap volume std-root plex org concat sd len 1048576s driveoffset 4194288s drive babor plex org concat sd len 1048576s driveoffset 4194288s drive estribor # vol swap is the first one, starts after vinum labels # offset is 281-16 volume swap plex org concat sd len 4194023s driveoffset 265s drive babor plex org concat sd len 4194023s driveoffset 265s drive estribor volume base plex org concat sd len 1048576s driveoffset 5242864s drive babor plex org concat sd len 1048576s driveoffset 5242864s drive estribor # 5GB volume apps plex org concat sd len 10485760s driveoffset 6291440s drive babor plex org concat sd len 10485760s driveoffset 6291440s drive estribor # 1 GB volume package plex org concat sd len 2097152s driveoffset 16777200s drive babor plex org concat sd len 2097152s driveoffset 16777200s drive estribor # vol std-var: 2GB volume std-var plex org concat sd len 4194304s driveoffset 18874352s drive babor plex org concat sd len 4194304s driveoffset 18874352s drive estribor # vol scratch # sd len 3145728s # ends at 20971504s volume scratch plex org striped 479k sd len 3145728s driveoffset 23068656s drive babor sd len 3145728s driveoffset 23068656s drive estribor volume home plex org concat sd len 20971520s driveoffset 29360112s drive babor plex org concat sd len 20971520s driveoffset 29360112s drive estribor --Kj7319i9nmIyA2yE Content-Type: text/plain; charset=us-ascii Content-Disposition: attachment; filename="geom_vinum.ident" gromit# ident /sbin/gvinum /sbin/gvinum: $FreeBSD: src/lib/csu/i386-elf/crti.S,v 1.7 2005/05/19 07:31:06 dfr Exp $ $FreeBSD: src/lib/csu/i386-elf/crtn.S,v 1.6 2005/05/19 07:31:06 dfr Exp $ $FreeBSD: src/lib/csu/common/crtbrand.c,v 1.4 2003/10/17 15:43:13 peter Exp $ $FreeBSD: src/lib/csu/i386-elf/crt1.c,v 1.14 2005/05/19 07:36:07 dfr Exp $ $FreeBSD: src/sys/geom/vinum/geom_vinum_share.c,v 1.4 2004/11/15 12:30:59 le Exp $ gromit# ident /boot/kernel/geom_vinum.ko /boot/kernel/geom_vinum.ko: $FreeBSD: src/sys/geom/vinum/geom_vinum.c,v 1.16.2.3 2005/12/10 14:36:17 le Exp $ $FreeBSD: src/sys/geom/vinum/geom_vinum_drive.c,v 1.18.2.4 2005/12/10 14:36:17 le Exp $ $FreeBSD: src/sys/geom/vinum/geom_vinum_plex.c,v 1.15.2.1 2005/08/19 08:48:04 le Exp $ $FreeBSD: src/sys/geom/vinum/geom_vinum_volume.c,v 1.8.2.2 2005/10/09 04:35:42 delphij Exp $ $FreeBSD: src/sys/geom/vinum/geom_vinum_subr.c,v 1.13 2005/01/19 13:57:09 le Exp $ $FreeBSD: src/sys/geom/vinum/geom_vinum_raid5.c,v 1.10 2004/11/26 11:59:51 le Exp $ $FreeBSD: src/sys/geom/vinum/geom_vinum_share.c,v 1.4 2004/11/15 12:30:59 le Exp $ $FreeBSD: src/sys/geom/vinum/geom_vinum_list.c,v 1.3 2005/01/06 18:27:30 imp Exp $ $FreeBSD: src/sys/geom/vinum/geom_vinum_rm.c,v 1.6.2.3 2005/11/26 11:06:11 le Exp $ $FreeBSD: src/sys/geom/vinum/geom_vinum_init.c,v 1.10.2.1 2005/10/09 04:36:44 delphij Exp $ $FreeBSD: src/sys/geom/vinum/geom_vinum_state.c,v 1.7 2005/01/21 18:27:23 le Exp $ $FreeBSD: src/sys/geom/vinum/geom_vinum_rename.c,v 1.3.2.1 2005/11/26 11:06:11 le Exp $ $FreeBSD: src/sys/geom/vinum/geom_vinum_move.c,v 1.2.2.1 2005/11/26 11:06:11 le Exp $ gromit# --Kj7319i9nmIyA2yE-- From owner-freebsd-geom@FreeBSD.ORG Fri Jan 13 21:49:46 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 7DEF216A41F; Fri, 13 Jan 2006 21:49:46 +0000 (GMT) (envelope-from djh@nebcorp.com) Received: from ratchet.nebcorp.com (ratchet.nebcorp.com [205.217.153.72]) by mx1.FreeBSD.org (Postfix) with ESMTP id 4B61043D45; Fri, 13 Jan 2006 21:49:42 +0000 (GMT) (envelope-from djh@nebcorp.com) Received: by ratchet.nebcorp.com (Postfix, from userid 1014) id E310AD982A; Fri, 13 Jan 2006 13:49:41 -0800 (PST) Date: Fri, 13 Jan 2006 13:49:41 -0800 From: Danny Howard To: Joan Picanyol i Puig Message-ID: <20060113214941.GB9258@ratchet.nebcorp.com> References: <20060113213151.GA49805@grummit.biaix.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20060113213151.GA49805@grummit.biaix.org> User-Agent: Mutt/1.4.2.1i X-Loop: djhoward@uiuc.edu Cc: le@freebsd.org, freebsd-geom@freebsd.org Subject: Re: sorely missing gvinum start or attach X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 13 Jan 2006 21:49:46 -0000 Joan, Could you describe what you are trying to accomplish? You're adding a second disk to the system and you want a RAID of some sort ... what kind of RAID? A mirror? Those are super easy ... just Google up a "gmirror howto" ... if you are trying to do something more complicated, please explain that, as it would help people understand all your technical stuff. -danny -- http://dannyman.toldme.com/ From owner-freebsd-geom@FreeBSD.ORG Sat Jan 14 21:19:03 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id DC42A16A422 for ; Sat, 14 Jan 2006 21:19:03 +0000 (GMT) (envelope-from brenthostetler@gmail.com) Received: from zproxy.gmail.com (zproxy.gmail.com [64.233.162.197]) by mx1.FreeBSD.org (Postfix) with ESMTP id 69F6A43D45 for ; Sat, 14 Jan 2006 21:19:03 +0000 (GMT) (envelope-from brenthostetler@gmail.com) Received: by zproxy.gmail.com with SMTP id 9so864902nzo for ; Sat, 14 Jan 2006 13:19:03 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:mime-version:content-type:content-transfer-encoding:content-disposition; b=nDX5pK+WCtO8N718T/StHPqXIFdXfSQVxqbQ/6D/LjoT3EYUByhT8PcLLMDv/fVb2SncbJeqRRUeSvU550WkbFgqkF+Gjx7CsygnPAUUoeuzNx8nKOHUecCTQSwXDmT/v//7i5lilUSA31FbcfAlVXZYHvQTrxt1DD4snZZWUOM= Received: by 10.36.247.62 with SMTP id u62mr3572373nzh; Sat, 14 Jan 2006 13:19:02 -0800 (PST) Received: by 10.36.90.19 with HTTP; Sat, 14 Jan 2006 13:19:02 -0800 (PST) Message-ID: Date: Sat, 14 Jan 2006 13:19:02 -0800 From: Brent Hostetler To: freebsd-geom@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline Subject: Metadata info. X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 14 Jan 2006 21:19:04 -0000 Hello, I am trying to understand how metadata works properly within the geom framework. I have been having varying problems which I believe are metadata related. I assume from the following quote from gmirro man page that metadata is stored on the last sector of the provider -- ie /dev/ad4, /dev/ad4s1, /dev/stripe1, or /dev/stripe1a -- and not necessarily the last sector of the disk. The gmirror utility uses on-disk metadata (stored in the provider's last sector) to store all needed information. Since the last sector is used for this purpose,it is possible to place a root file system on a mirror. Because of this I notice that when setting up a mirror of a slice you will get error from bsdlabel /dev/ad4 saying bsdlabel: partition c doesn't cover the whole unit!... If you bsdlabel the actual /dev/mirror/data1 it will not issue the warning. The is correct behavior right? So if you are mirroring /dev/ad4 then you would make sure that the last slice that is created is one sector smaller then the media size in sectors such as example 1. Example 1: gmirror label -v -n -b round-robin data1 /dev/ad4 [------ ad4 ------] [-----ad4s1------]* [ad4s1a][-ad4s1d-]* or [----------ad4------------] [-----ad4s1----][--ad4s2-]* [ad4s1a][ad4s1b][-ad4s2a-]* If you are operating on slices then you would make sure the last partition in the mirrored slice would be one sector smaller then the slice size in sectors such as example 2 and 3. Example 2: gmirror label -v -n -b round-robin data1 /dev/ad4s1 [----------- ad4 --------------] [----ad4s1-----]*[---ad4s2-----] [ad4s1d][ad4s1e]*[---ad4s2a----] Example 3: gmirror label -v -n -b round-robin data1 /dev/ad4s1 gmirror label -v -n -b round-robin data2 /dev/ad4s2 [----------- ad4 --------------] [----ad4s1-----]*[---ad4s2----]* [ad4s1d][ad4s1e]*[---ad4s2a---]* If operating on geom's class providers it works the same way correct? Example 4: gmirror label -v -n -b round-robin data1 /dev/stripe/stripe1 [------------stripe1-----------] [------stripe1s1--------------]* [------stripe1s1a-------------]* Thanks.. Brent.