From owner-freebsd-geom@FreeBSD.ORG Mon Jan 16 09:25:10 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 6525B16A41F for ; Mon, 16 Jan 2006 09:25:10 +0000 (GMT) (envelope-from lists-freebsd@biaix.org) Received: from grummit.biaix.org (86.Red-213-97-212.staticIP.rima-tde.net [213.97.212.86]) by mx1.FreeBSD.org (Postfix) with SMTP id BF8C343D70 for ; Mon, 16 Jan 2006 09:25:06 +0000 (GMT) (envelope-from lists-freebsd@biaix.org) Received: (qmail 1324 invoked by uid 1000); 16 Jan 2006 09:21:52 -0000 Date: Mon, 16 Jan 2006 10:21:52 +0100 From: Joan Picanyol i Puig To: freebsd-geom@freebsd.org, le@freebsd.org Message-ID: <20060116092151.GA99286@grummit.biaix.org> References: <20060113213151.GA49805@grummit.biaix.org> <20060113214941.GB9258@ratchet.nebcorp.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20060113214941.GB9258@ratchet.nebcorp.com> User-Agent: Mutt/1.5.9i Cc: Subject: Re: sorely missing gvinum start or attach X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 16 Jan 2006 09:25:10 -0000 Hi there, Thanks for your expression of interest; given the length of my request I realize some introduction was necessary. * Danny Howard [20060113 22:46]: > Could you describe what you are trying to accomplish? I'd like both stripes and mirrors, and more than 8 partitions. What I've provided so far is just the base system's setup: mostly mirrored volumes but already one striped volume. Many more should come, and possibly new disks too. I opted for gvinum because of it's flexibilty, and decided to create the setup on one disk first to get the "root-on-vinum" issue working and to be able to do some testing (adding and removing drives). > You're adding a second disk to the system and you want a RAID of some > sort ... what kind of RAID? A mirror? Those are super easy ... just > Google up a "gmirror howto" ... Yep, I know about rse@'s HOWTO. > if you are trying to do something more complicated, please explain > that, as it would help people understand all your technical stuff. I hope my requirements are clearer now: I want a flexible software RAID system on FreeBSD, since I envision the need for many (~20) fs's with different storage requirements. I realize Lukas might not have as much free time as he'd wish, but an ETA on 'start', 'stop' and 'attach' would be greatly appreciated. tks -- pica From owner-freebsd-geom@FreeBSD.ORG Mon Jan 16 11:02:31 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id B842E16A41F for ; Mon, 16 Jan 2006 11:02:31 +0000 (GMT) (envelope-from owner-bugmaster@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [216.136.204.21]) by mx1.FreeBSD.org (Postfix) with ESMTP id 20F7A43D60 for ; Mon, 16 Jan 2006 11:02:26 +0000 (GMT) (envelope-from owner-bugmaster@freebsd.org) Received: from freefall.freebsd.org (peter@localhost [127.0.0.1]) by freefall.freebsd.org (8.13.4/8.13.4) with ESMTP id k0GB2QUP084842 for ; Mon, 16 Jan 2006 11:02:26 GMT (envelope-from owner-bugmaster@freebsd.org) Received: (from peter@localhost) by freefall.freebsd.org (8.13.4/8.13.4/Submit) id k0GB2P77084835 for freebsd-geom@freebsd.org; Mon, 16 Jan 2006 11:02:25 GMT (envelope-from owner-bugmaster@freebsd.org) Date: Mon, 16 Jan 2006 11:02:25 GMT Message-Id: <200601161102.k0GB2P77084835@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: peter set sender to owner-bugmaster@freebsd.org using -f From: FreeBSD bugmaster To: freebsd-geom@FreeBSD.org Cc: Subject: Current problem reports assigned to you X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 16 Jan 2006 11:02:31 -0000 Current FreeBSD problem reports Critical problems Serious problems S Submitted Tracker Resp. Description ------------------------------------------------------------------------------- o [2005/01/21] kern/76538 geom [gbde] nfs-write on gbde partition stalls o [2005/08/04] kern/84556 geom [geom] GBDE-encrypted swap causes panic a o [2005/10/16] kern/87544 geom [gbde] mmaping large files on a gbde file o [2005/11/16] kern/89102 geom [geom_vfs] [panic] panic when forced unmo o [2005/12/08] bin/90093 geom fdisk(8) incapable of altering in-core ge o [2005/12/18] kern/90582 geom [geom_mirror] [panic] Restore cause panic 6 problems total. Non-critical problems S Submitted Tracker Resp. Description ------------------------------------------------------------------------------- o [2005/02/26] bin/78131 geom gbde "destroy" not working. o [2005/03/26] kern/79251 geom [2TB] newfs fails on 2.6TB gbde device 2 problems total. From owner-freebsd-geom@FreeBSD.ORG Tue Jan 17 10:36:44 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 6474E16A41F for ; Tue, 17 Jan 2006 10:36:44 +0000 (GMT) (envelope-from aragon@geek.sh) Received: from mail.geek.sh (decoder.geek.sh [196.36.198.81]) by mx1.FreeBSD.org (Postfix) with ESMTP id DDA7E43D48 for ; Tue, 17 Jan 2006 10:36:43 +0000 (GMT) (envelope-from aragon@geek.sh) Received: by mail.geek.sh (Postfix, from userid 1000) id 667C024D15; Tue, 17 Jan 2006 12:36:33 +0200 (SAST) Date: Tue, 17 Jan 2006 12:36:33 +0200 From: Aragon Gouveia To: freebsd-geom@freebsd.org Message-ID: <20060117103633.GA89290@phat.za.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.4i X-Operating-System: FreeBSD 4.10-RELEASE-p2 i386 Subject: gmirror using disk image files X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Jan 2006 10:36:44 -0000 Hi, I have a need to mirror data between two servers for failover purposes. I've been reading up on Ggate and Gmirror and I want to try them. From what I've gathered I will need a dedicated disk or disk slice in each server to be able to mirror them. Unfortunately this is an afterthought and these two machines are already sliced and partitioned without this scheme in mind. I would like to avoid rebuilding them or adding disks. Is it possible to have Ggated export a Vnode device from one machine, and from the other machine import this device with Ggatec and mirror it with another Vnode device running locally with Gmirror? Thanks, Aragon From owner-freebsd-geom@FreeBSD.ORG Tue Jan 17 12:10:01 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id BB2BA16A41F for ; Tue, 17 Jan 2006 12:10:01 +0000 (GMT) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.FreeBSD.org (Postfix) with ESMTP id 5F13A43D5A for ; Tue, 17 Jan 2006 12:09:48 +0000 (GMT) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 7447050A7F; Tue, 17 Jan 2006 13:09:40 +0100 (CET) Received: from localhost (pjd.wheel.pl [10.0.1.1]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id E3E8750A16; Tue, 17 Jan 2006 13:09:23 +0100 (CET) Date: Tue, 17 Jan 2006 13:09:08 +0100 From: Pawel Jakub Dawidek To: Brent Hostetler Message-ID: <20060117120908.GB20602@garage.freebsd.pl> References: Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="7iMSBzlTiPOCCT2k" Content-Disposition: inline In-Reply-To: X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng/devel-r535 (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-5.9 required=3.0 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.0.4 Cc: freebsd-geom@freebsd.org Subject: Re: Metadata info. X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Jan 2006 12:10:01 -0000 --7iMSBzlTiPOCCT2k Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sat, Jan 14, 2006 at 01:19:02PM -0800, Brent Hostetler wrote: +> Hello, +>=20 +> I am trying to understand how metadata works properly within the +> geom framework. I have been having varying problems which I +> believe are metadata related. +>=20 +> I assume from the following quote from gmirro man page +> that metadata is stored on the last sector of the provider -- +> ie /dev/ad4, /dev/ad4s1, /dev/stripe1, or /dev/stripe1a -- and not +> necessarily the last sector of the disk. +>=20 +> The gmirror utility uses on-disk metadata (stored in +> the provider's last sector) to store all needed information. +> Since the last sector is used for this purpose,it is possible +> to place a root file system on a mirror. +>=20 +> Because of this I notice that when setting up a mirror of a +> slice you will get error from bsdlabel /dev/ad4 saying +> bsdlabel: partition c doesn't cover the whole unit!... If you +> bsdlabel the actual /dev/mirror/data1 it will not issue the +> warning. The is correct behavior right? +>=20 +> So if you are mirroring /dev/ad4 then you would make sure that +> the last slice that is created is one sector smaller then the media +> size in sectors such as example 1. +>=20 +> Example 1: +>=20 +> gmirror label -v -n -b round-robin data1 /dev/ad4 +>=20 +> [------ ad4 ------] +> [-----ad4s1------]* +> [ad4s1a][-ad4s1d-]* +>=20 +> or +>=20 +> [----------ad4------------] +> [-----ad4s1----][--ad4s2-]* +> [ad4s1a][ad4s1b][-ad4s2a-]* That's correct. +> If you are operating on slices then you would make sure the last +> partition in the mirrored slice would be one sector smaller then +> the slice size in sectors such as example 2 and 3. +>=20 +> Example 2: +>=20 +> gmirror label -v -n -b round-robin data1 /dev/ad4s1 +>=20 +> [----------- ad4 --------------] +> [----ad4s1-----]*[---ad4s2-----] +> [ad4s1d][ad4s1e]*[---ad4s2a----] +>=20 +>=20 +> Example 3: +>=20 +> gmirror label -v -n -b round-robin data1 /dev/ad4s1 +> gmirror label -v -n -b round-robin data2 /dev/ad4s2 +>=20 +> [----------- ad4 --------------] +> [----ad4s1-----]*[---ad4s2----]* +> [ad4s1d][ad4s1e]*[---ad4s2a---]* No, example 2: [----------- ad4 --------------] [----ad4s1------][---ad4s2-----] [ad4s1d][ad4s1e]*[---ad4s2a----] Example 3: [----------- ad4 --------------] [----ad4s1------][---ad4s2-----] [ad4s1d][ad4s1e]*[---ad4s2a---]* +> If operating on geom's class providers it works the same way +> correct? +>=20 +> Example 4: +>=20 +> gmirror label -v -n -b round-robin data1 /dev/stripe/stripe1 +>=20 +> [------------stripe1-----------] +> [------stripe1s1--------------]* +> [------stripe1s1a-------------]* That's correct. But the more correct pictures are: Disk mirroring: [------------ ad4 ------------] [-------- mirror/foo --------]* [------- mirror/foos1 -------]* [mirror/foos1s][mirror/foos1d]* Slice mirroring: [------------ ad4 ------------] [---- ad4s1 ----][--- ad4s2 --] [- mirror/foo -]*[-- ad4s2a --] [ mirror/fooa -]* Partition mirroring: [------------ ad4 ------------] [---- ad4s1 ----][--- ad4s2 --] [---- ad4s1a ---][-- ad4s2a --] [- mirror/foo -]* Stripe mirroring: [--- stripe/foo ---] [--- mirror/bar --]* [-- mirror/bars1 -]* [- mirror/bars1a -]* Remember that you can setup slices/partitions on mirror device, you don't have to do it on plain disk. --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --7iMSBzlTiPOCCT2k Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.2 (FreeBSD) iD8DBQFDzN5kForvXbEpPzQRAgveAJ9jtDs7T59T6fYF89rJHMwuGxDb/ACdFcF/ 1YJcoKQDTc/lEpQ63mvGlbg= =/fFe -----END PGP SIGNATURE----- --7iMSBzlTiPOCCT2k-- From owner-freebsd-geom@FreeBSD.ORG Tue Jan 17 20:35:33 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 32DA916A420 for ; Tue, 17 Jan 2006 20:35:33 +0000 (GMT) (envelope-from ivoras@fer.hr) Received: from pinus.cc.fer.hr (pinus.cc.fer.hr [161.53.73.18]) by mx1.FreeBSD.org (Postfix) with ESMTP id C737A43D5A for ; Tue, 17 Jan 2006 20:35:31 +0000 (GMT) (envelope-from ivoras@fer.hr) Received: from [161.53.72.113] (lara.cc.fer.hr [161.53.72.113]) by pinus.cc.fer.hr (8.12.2/8.12.2) with ESMTP id k0HKZKFx022022; Tue, 17 Jan 2006 21:35:25 +0100 (MET) Message-ID: <43CD5505.2040705@fer.hr> Date: Tue, 17 Jan 2006 21:35:17 +0100 From: Ivan Voras User-Agent: Mozilla Thunderbird 1.0.6 (X11/20050921) X-Accept-Language: en-us, en MIME-Version: 1.0 To: Aragon Gouveia References: <20060117103633.GA89290@phat.za.net> In-Reply-To: <20060117103633.GA89290@phat.za.net> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-geom@freebsd.org Subject: Re: gmirror using disk image files X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Jan 2006 20:35:33 -0000 Aragon Gouveia wrote: > Is it possible to have Ggated export a Vnode device from one machine, and > from the other machine import this device with Ggatec and mirror it with > another Vnode device running locally with Gmirror? You can do use mdconfig(8) to do anything geom-related with files, including mirroring them over the network. BUT, you can't mount the mirrored file system at the same time on both machines except if both mounts are read-only. Combinations such as: - mirrored devices/file systems mounted read-write on both machines - mounted read-write on one machine and read-only on the other(s) are all invalid and will sooner or later certainly result in system panic (not because of GEOM but because of the UFS). I'd tell you to try this: http://tdfs.sourceforge.net/ but it's really not production ready. From owner-freebsd-geom@FreeBSD.ORG Tue Jan 17 21:12:00 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id AB20116A41F for ; Tue, 17 Jan 2006 21:12:00 +0000 (GMT) (envelope-from aragon@geek.sh) Received: from mail.geek.sh (decoder.geek.sh [196.36.198.81]) by mx1.FreeBSD.org (Postfix) with ESMTP id 327F443D45 for ; Tue, 17 Jan 2006 21:11:59 +0000 (GMT) (envelope-from aragon@geek.sh) Received: by mail.geek.sh (Postfix, from userid 1000) id 434DB24D15; Tue, 17 Jan 2006 23:11:55 +0200 (SAST) Date: Tue, 17 Jan 2006 23:11:55 +0200 From: Aragon Gouveia To: freebsd-geom@freebsd.org Message-ID: <20060117211155.GA12650@phat.za.net> References: <20060117103633.GA89290@phat.za.net> <43CD5505.2040705@fer.hr> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <43CD5505.2040705@fer.hr> User-Agent: Mutt/1.4i X-Operating-System: FreeBSD 4.10-RELEASE-p2 i386 Subject: Re: gmirror using disk image files X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Jan 2006 21:12:00 -0000 | By Ivan Voras | [ 2006-01-17 22:35 +0200 ] > You can do use mdconfig(8) to do anything geom-related with files, > including mirroring them over the network. BUT, you can't mount the > mirrored file system at the same time on both machines except if both > mounts are read-only. > > Combinations such as: > > - mirrored devices/file systems mounted read-write on both machines > - mounted read-write on one machine and read-only on the other(s) Cool! I was planning on implementing the second one. > are all invalid and will sooner or later certainly result in system > panic (not because of GEOM but because of the UFS). I'd tell you to try > this: http://tdfs.sourceforge.net/ but it's really not production ready. Darn, that does certainly blow it out of the water then, atleast for my use. I'll keep an eye on both options' progress. Thanks! Aragon From owner-freebsd-geom@FreeBSD.ORG Tue Jan 17 21:14:43 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 509C416A41F for ; Tue, 17 Jan 2006 21:14:43 +0000 (GMT) (envelope-from aragon@geek.sh) Received: from mail.geek.sh (decoder.geek.sh [196.36.198.81]) by mx1.FreeBSD.org (Postfix) with ESMTP id C969443D46 for ; Tue, 17 Jan 2006 21:14:42 +0000 (GMT) (envelope-from aragon@geek.sh) Received: by mail.geek.sh (Postfix, from userid 1000) id A6FA524D17; Tue, 17 Jan 2006 23:14:41 +0200 (SAST) Date: Tue, 17 Jan 2006 23:14:41 +0200 From: Aragon Gouveia To: freebsd-geom@freebsd.org Message-ID: <20060117211441.GB12650@phat.za.net> References: <20060117103633.GA89290@phat.za.net> <43CD5505.2040705@fer.hr> <20060117211155.GA12650@phat.za.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20060117211155.GA12650@phat.za.net> User-Agent: Mutt/1.4i X-Operating-System: FreeBSD 4.10-RELEASE-p2 i386 Subject: Re: gmirror using disk image files X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Jan 2006 21:14:43 -0000 | By Aragon Gouveia | [ 2006-01-17 23:12 +0200 ] > | By Ivan Voras > | [ 2006-01-17 22:35 +0200 ] > > You can do use mdconfig(8) to do anything geom-related with files, > > including mirroring them over the network. BUT, you can't mount the > > mirrored file system at the same time on both machines except if both > > mounts are read-only. > > > > Combinations such as: > > > > - mirrored devices/file systems mounted read-write on both machines > > - mounted read-write on one machine and read-only on the other(s) > > Cool! I was planning on implementing the second one. Erm, uncool I mean. :)