From owner-freebsd-geom@FreeBSD.ORG Sun Dec 11 19:23:41 2005 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 08CB716A41F; Sun, 11 Dec 2005 19:23:41 +0000 (GMT) (envelope-from lapo@seanet.com) Received: from mx.seanet.com (mx.seanet.com [199.181.164.20]) by mx1.FreeBSD.org (Postfix) with ESMTP id 6222C43D58; Sun, 11 Dec 2005 19:23:40 +0000 (GMT) (envelope-from lapo@seanet.com) Received: from [199.181.168.92] (wallace.osd.com [199.181.168.92]) (authenticated bits=0) by milkyway.seanet.com (8.13.4/8.13.4) with ESMTP id jBBJNdUJ089567; Sun, 11 Dec 2005 11:23:40 -0800 (PST) (envelope-from lapo@seanet.com) In-Reply-To: <20051210022959.GA726@garage.freebsd.pl> References: <169FE8E2-A191-491B-864D-C1CBE28EE827@seanet.com> <20051210022959.GA726@garage.freebsd.pl> Mime-Version: 1.0 (Apple Message framework v746.2) Content-Type: text/plain; charset=US-ASCII; delsp=yes; format=flowed Message-Id: <97205FE2-7C60-4CD6-B908-92DBBCF902F3@seanet.com> Content-Transfer-Encoding: 7bit From: Lapo Nustrini Date: Sun, 11 Dec 2005 11:23:15 -0800 To: Pawel Jakub Dawidek X-Mailer: Apple Mail (2.746.2) Cc: freebsd-geom@freebsd.org Subject: Re: gmirror load problem X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 11 Dec 2005 19:23:41 -0000 On Dec 9, 2005, at 6:29 PM, Pawel Jakub Dawidek wrote: > On Fri, Dec 09, 2005 at 12:30:35PM -0800, Lapo Nustrini wrote: > +> This time however "gmirror load" returns a "Command 'load' not > available" error. > +> I thought gmirror must be already loaded but I can't unload > gmirror or see a /dev/mirror directory on the system. > > Could you paste the result of the following commands: > > # kldstat -v | grep g_mirror > # sysctl kern.module_path > # ls -l /boot/kernel/geom_mirror.ko > Sure thing. % kldstat -v | grep g_mirror % sysctl kern.module_path kern.module_path: /boot/modules % ls -l /boot/kernel/geom_mirror.ko -r-xr-xr-x 1 root wheel 79886 Jun 24 13:31 /boot/kernel/ geom_mirror.ko Does this shed any light? Thank you, Lapo Nustrini From owner-freebsd-geom@FreeBSD.ORG Sun Dec 11 19:50:20 2005 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 31DB516A41F for ; Sun, 11 Dec 2005 19:50:20 +0000 (GMT) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.FreeBSD.org (Postfix) with ESMTP id 6236843D67 for ; Sun, 11 Dec 2005 19:50:01 +0000 (GMT) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id DAD5B52BC1; Sun, 11 Dec 2005 20:49:58 +0100 (CET) Received: from localhost (ana50.internetdsl.tpnet.pl [83.17.82.50]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id 371A452B3E; Sun, 11 Dec 2005 20:49:52 +0100 (CET) Date: Sun, 11 Dec 2005 20:49:07 +0100 From: Pawel Jakub Dawidek To: Lapo Nustrini Message-ID: <20051211194907.GC1029@garage.freebsd.pl> References: <169FE8E2-A191-491B-864D-C1CBE28EE827@seanet.com> <20051210022959.GA726@garage.freebsd.pl> <97205FE2-7C60-4CD6-B908-92DBBCF902F3@seanet.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="sHrvAb52M6C8blB9" Content-Disposition: inline In-Reply-To: <97205FE2-7C60-4CD6-B908-92DBBCF902F3@seanet.com> X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng/devel-r535 (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-5.9 required=3.0 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.0.4 Cc: freebsd-geom@freebsd.org Subject: Re: gmirror load problem X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 11 Dec 2005 19:50:20 -0000 --sHrvAb52M6C8blB9 Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sun, Dec 11, 2005 at 11:23:15AM -0800, Lapo Nustrini wrote: +>=20 +> On Dec 9, 2005, at 6:29 PM, Pawel Jakub Dawidek wrote: +>=20 +> >On Fri, Dec 09, 2005 at 12:30:35PM -0800, Lapo Nustrini wrote: +> >+> This time however "gmirror load" returns a "Command 'load' not avail= able" error. +> >+> I thought gmirror must be already loaded but I can't unload gmirror = or see a /dev/mirror directory on the system. +> > +> >Could you paste the result of the following commands: +> > +> > # kldstat -v | grep g_mirror +> > # sysctl kern.module_path +> > # ls -l /boot/kernel/geom_mirror.ko +> > +>=20 +> Sure thing. +>=20 +> % kldstat -v | grep g_mirror +> % sysctl kern.module_path +> kern.module_path: /boot/modules +> % ls -l /boot/kernel/geom_mirror.ko +> -r-xr-xr-x 1 root wheel 79886 Jun 24 13:31 /boot/kernel/geom_mirror.ko +>=20 +>=20 +> Does this shed any light? Yes. Your kern.module_path is wrong. It should have also /boot/kernel/. If you load manually geom_mirror.ko by doing: # kldload /boot/kernel/geom_mirror.ko it will work. The problem you're seeing is related to loader.rc changes probably. If you have loader.rc rev1.1, you should manually update to at least 1.2. The file should be here: /sys/boot/i386/loader/loader.rc I reported this problem to jmg@ which did the change and I was sure it was fixed somehow... This was some time ago, so not sure if this is the problem... --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --sHrvAb52M6C8blB9 Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.2 (FreeBSD) iD8DBQFDnIKzForvXbEpPzQRApnJAJ9tClysfO15VitW6CBQ4tUMROJecACg+aHy X2PpMFilIPfdXnryv0oMWVQ= =Ef1j -----END PGP SIGNATURE----- --sHrvAb52M6C8blB9-- From owner-freebsd-geom@FreeBSD.ORG Sun Dec 11 23:30:47 2005 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id DB04116A41F for ; Sun, 11 Dec 2005 23:30:47 +0000 (GMT) (envelope-from nonsolosoft@diff.org) Received: from fe-4c.inet.it (fe-4c.inet.it [213.92.5.108]) by mx1.FreeBSD.org (Postfix) with ESMTP id 15D1A43D5A for ; Sun, 11 Dec 2005 23:30:46 +0000 (GMT) (envelope-from nonsolosoft@diff.org) Received: from 81-174-26-135.f5.ngi.it ([::ffff:81.174.26.135]) by fe-4c.inet.it via I-SMTP-5.2.3-521 id ::ffff:81.174.26.135+u70dm8iU1XK; Mon, 12 Dec 2005 00:30:43 +0100 Received: from [127.0.0.1] (localhost [127.0.0.1]) by k7.diff.org (8.13.4/8.13.4) with ESMTP id jBBNVDvQ001022; Mon, 12 Dec 2005 00:31:13 +0100 (CET) (envelope-from nonsolosoft@diff.org) Message-ID: <439CB6C0.30109@diff.org> Date: Mon, 12 Dec 2005 00:31:12 +0100 From: Ferruccio Zamuner Organization: NonSoLoSoft - http://www.nonsolosoft.com/ User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.7.12) Gecko/20051116 X-Accept-Language: it, en-us, en MIME-Version: 1.0 To: freebsd-geom@freebsd.org Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: nonsolosoft@diff.org Subject: from vinum on FreeBSD 4.x to gvinum on 5.4 and 6.0 X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: nonsolosoft@diff.org List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 11 Dec 2005 23:30:48 -0000 Hi, I was using vinum on FreeBSD 4.x (since x >= 8) without big problems: if for power failure sometime I'd a kernel panic during reboot on vinum I've always restored vinum metadata from original creation file using resetconfig first and create -f mydefinitionfile after; and I've never lost data from vinum partitions. -----vinum mydefinitionfile ------------- drive med device /dev/ad5s1e drive new device /dev/ad6s1e volume sicuro plex org concat sd length 10g drive med plex org concat sd length 10g drive new volume veloce plex org striped 512k sd length 5g drive med sd length 5g drive new volume vtmp plex org concat sd length 300m drive med volume vvar plex org concat sd length 300m drive med ----- end of file ----- Before to upgrade my system to 5.4 I've done backup as usual and I don't expect that vinum partitions survive but using gvinum I've mount them (both mirror and stripped) without problem. Yesterday I've upgrade 5.4 to 6.0 and at first reboot gvinum shows me that drive definitions has been lost: there were still volumes, plexes, subdisks but no drives. I've tried to use gvinum commands: 1) "resetconfig" is not supported by gvinum. 2) I've create a new vinum definition file for only drives (to integrate current configuration) --- mynewdefinitionfile -- drive med device /dev/ad5s1e drive new device /dev/ad6s1e --- end file --- 3) "create -f mynewdefinitionfile" on gvinum dumps current configuration with '#' char starting eachline in a vi, but drives were not yet. 4) "create mynewdefinitionfile" on gvinum stalled the OS and I'd to reset the box. Then I thought to use FreeBSD 4.x recovery CDROM to restore vinum configuration: 1) fortunatly I still had a old 4.11 root partition in my system because FreeBSD 4.x recovery CDROM has not any vinum.ko module. 2) "# kldload /mnt/oldroot/modules/vinum.ko" 3) "# vinum" gives: "Can't get config for plex 0: Invalid argument" Segmentation fault (core dump) 4) then I tried to run vinum again and it starts. 5) while vinum "ld" has no drive defined, "lv" gives me all volumes list, "ls" the full subdisk list but "lp" gives the same error "Can't get config for plex 0". 6) "resetconfig" succeed 7) "create -f mydefinitionfile" gives me same error "Can't get config for plex 0". Then from vinum man pages I've read that vinum stores metadata in first 131,5Kb, so I've run "# dd if=/dev/zero of=/dev/ad5s1e count=263" and run again vinum: 8) "ld","lp","lv","ls" no output, it seems ok finally. 9) "create -f mynewdefinitionfile" apparently succeed writting drives: 2, but "ld" shows no drives. 10) if I run again "create -f mynewdefinitionfile" it writes "drives: 4", but again "ld" shows no drives. 11) "resetconfig" again in vinum, it succeed. 12) "create -f mydefinitionfile" it fails again with error "Can't get config for plex 0". How can I reset really such vinum metadata to recover data stored in vinum partitions? Actually I was very interested to content of partition "/vinum/sicuro" and it was simple: # dd if=/dev/ad5s1e of=/usr/vinum_sicuro.bin skip=265 count=2097152 # mdconfig -a -t vnode -f /usr/vinum_sicuro -u 1 # bsdlabel -w md1 auto # mount /dev/md1c /mnt/ Then I recover first data contents easly. Bye, \fer --- NonSoLoSoft (Italy) - http://www.nonsolosoft.com/ From owner-freebsd-geom@FreeBSD.ORG Sun Dec 11 23:56:44 2005 Return-Path: X-Original-To: freebsd-geom@FreeBSD.org Delivered-To: freebsd-geom@FreeBSD.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id CA51A16A41F for ; Sun, 11 Dec 2005 23:56:44 +0000 (GMT) (envelope-from le@FreeBSD.org) Received: from imap1u.univie.ac.at (murder1.univie.ac.at [131.130.1.183]) by mx1.FreeBSD.org (Postfix) with ESMTP id ED1EF43D5E for ; Sun, 11 Dec 2005 23:56:43 +0000 (GMT) (envelope-from le@FreeBSD.org) Received: from korben (korben.prv.univie.ac.at [131.130.7.98]) by imap1u.univie.ac.at (8.12.10/8.12.10) with ESMTP id jBBNuE4U076967 (version=TLSv1/SSLv3 cipher=RC4-MD5 bits=128 verify=NO); Mon, 12 Dec 2005 00:56:15 +0100 (CET) Date: Mon, 12 Dec 2005 00:56:13 +0100 From: Lukas Ertl To: Ferruccio Zamuner In-Reply-To: <439CB6C0.30109@diff.org> Message-ID: References: <439CB6C0.30109@diff.org> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: freebsd-geom@FreeBSD.org Subject: Re: from vinum on FreeBSD 4.x to gvinum on 5.4 and 6.0 X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 11 Dec 2005 23:56:44 -0000 On Mon, 12 Dec 2005, Ferruccio Zamuner wrote: > Before to upgrade my system to 5.4 I've done backup as usual and I don't > expect that vinum partitions survive but using gvinum I've mount them (both > mirror and stripped) without problem. > > Yesterday I've upgrade 5.4 to 6.0 and at first reboot gvinum shows me that > drive definitions has been lost: there were still volumes, plexes, subdisks > but no drives. That should be fixed in 6-STABLE, I MFCed the corresponding parts just yesterday. regards, le -- Lukas Ertl http://homepage.univie.ac.at/l.ertl/ le@FreeBSD.org http://people.freebsd.org/~le/ From owner-freebsd-geom@FreeBSD.ORG Mon Dec 12 00:40:59 2005 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9DED316A41F for ; Mon, 12 Dec 2005 00:40:59 +0000 (GMT) (envelope-from nonsolosoft@diff.org) Received: from fe-4a.inet.it (fe-4a.inet.it [213.92.5.107]) by mx1.FreeBSD.org (Postfix) with ESMTP id 2488743D5D for ; Mon, 12 Dec 2005 00:40:57 +0000 (GMT) (envelope-from nonsolosoft@diff.org) Received: from 81-174-26-135.f5.ngi.it ([::ffff:81.174.26.135]) by fe-4a.inet.it via I-SMTP-5.2.3-521 id ::ffff:81.174.26.135+N1GR99cc9TE; Mon, 12 Dec 2005 01:40:54 +0100 Received: from [127.0.0.1] (localhost [127.0.0.1]) by k7.diff.org (8.13.4/8.13.4) with ESMTP id jBC0fO7H001213; Mon, 12 Dec 2005 01:41:24 +0100 (CET) (envelope-from nonsolosoft@diff.org) Message-ID: <439CC734.5020702@diff.org> Date: Mon, 12 Dec 2005 01:41:24 +0100 From: Ferruccio Zamuner Organization: NonSoLoSoft - http://www.nonsolosoft.com/ User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.7.12) Gecko/20051116 X-Accept-Language: it, en-us, en MIME-Version: 1.0 To: freebsd-geom@freebsd.org References: <439CB6C0.30109@diff.org> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: nonsolosoft@diff.org Subject: Re: from vinum on FreeBSD 4.x to gvinum on 5.4 and 6.0 X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: nonsolosoft@diff.org List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 12 Dec 2005 00:40:59 -0000 Hi Lukas, you wrote: > That should be fixed in 6-STABLE, I MFCed the corresponding parts just > yesterday. > > regards, > le Can I re-create vinum metadata from 6.0 since I've written zero on them? Or how can re-create them from 4.0 since I got error: "Can't get config for plex 0"? Best regards, \fer From owner-freebsd-geom@FreeBSD.ORG Mon Dec 12 11:02:04 2005 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 90B6B16A420 for ; Mon, 12 Dec 2005 11:02:04 +0000 (GMT) (envelope-from owner-bugmaster@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [216.136.204.21]) by mx1.FreeBSD.org (Postfix) with ESMTP id 0C9AC43D67 for ; Mon, 12 Dec 2005 11:02:02 +0000 (GMT) (envelope-from owner-bugmaster@freebsd.org) Received: from freefall.freebsd.org (peter@localhost [127.0.0.1]) by freefall.freebsd.org (8.13.4/8.13.4) with ESMTP id jBCB21lN064603 for ; Mon, 12 Dec 2005 11:02:01 GMT (envelope-from owner-bugmaster@freebsd.org) Received: (from peter@localhost) by freefall.freebsd.org (8.13.4/8.13.4/Submit) id jBCB20V5064592 for freebsd-geom@freebsd.org; Mon, 12 Dec 2005 11:02:00 GMT (envelope-from owner-bugmaster@freebsd.org) Date: Mon, 12 Dec 2005 11:02:00 GMT Message-Id: <200512121102.jBCB20V5064592@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: peter set sender to owner-bugmaster@freebsd.org using -f From: FreeBSD bugmaster To: freebsd-geom@FreeBSD.org Cc: Subject: Current problem reports assigned to you X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 12 Dec 2005 11:02:04 -0000 Current FreeBSD problem reports Critical problems Serious problems S Submitted Tracker Resp. Description ------------------------------------------------------------------------------- o [2005/01/21] kern/76538 geom [gbde] nfs-write on gbde partition stalls o [2005/08/04] kern/84556 geom [geom] GBDE-encrypted swap causes panic a o [2005/10/16] kern/87544 geom [gbde] mmaping large files on a gbde file o [2005/11/16] kern/89102 geom [geom_vfs] [panic] panic when forced unmo o [2005/12/08] bin/90093 geom fdisk(8) incapable of altering in-core ge 5 problems total. Non-critical problems S Submitted Tracker Resp. Description ------------------------------------------------------------------------------- o [2005/02/26] bin/78131 geom gbde "destroy" not working. o [2005/03/26] kern/79251 geom [2TB] newfs fails on 2.6TB gbde device 2 problems total. From owner-freebsd-geom@FreeBSD.ORG Mon Dec 12 12:50:29 2005 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id DC52B16A422 for ; Mon, 12 Dec 2005 12:50:28 +0000 (GMT) (envelope-from nonsolosoft@diff.org) Received: from fe-4a.inet.it (fe-4a.inet.it [213.92.5.107]) by mx1.FreeBSD.org (Postfix) with ESMTP id E274743D60 for ; Mon, 12 Dec 2005 12:49:53 +0000 (GMT) (envelope-from nonsolosoft@diff.org) Received: from 81-174-26-135.f5.ngi.it ([::ffff:81.174.26.135]) by fe-4a.inet.it via I-SMTP-5.2.3-521 id ::ffff:81.174.26.135+YB6X8DFE75A; Mon, 12 Dec 2005 13:49:39 +0100 Received: from [127.0.0.1] (localhost [127.0.0.1]) by k7.diff.org (8.13.4/8.13.4) with ESMTP id jBCCo9wP002075; Mon, 12 Dec 2005 13:50:10 +0100 (CET) (envelope-from nonsolosoft@diff.org) Message-ID: <439D7201.8010301@diff.org> Date: Mon, 12 Dec 2005 13:50:09 +0100 From: Ferruccio Zamuner Organization: NonSoLoSoft - http://www.nonsolosoft.com/ User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.7.12) Gecko/20051116 X-Accept-Language: it, en-us, en MIME-Version: 1.0 To: freebsd-geom@freebsd.org References: <439CB6C0.30109@diff.org> In-Reply-To: <439CB6C0.30109@diff.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: nonsolosoft@diff.org Subject: Re: from vinum on FreeBSD 4.x to gvinum on 5.4 and 6.0 X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: nonsolosoft@diff.org List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 12 Dec 2005 12:50:29 -0000 Ferruccio Zamuner wrote: > Actually I was very interested to content of partition "/vinum/sicuro" > and it was simple: > # dd if=/dev/ad5s1e of=/usr/vinum_sicuro.bin skip=265 count=2097152 > # mdconfig -a -t vnode -f /usr/vinum_sicuro.bin -u 1 > # bsdlabel -w md1 auto > # mount /dev/md1c /mnt/ > > Then I recover first data contents easly. I thought to recover, ls shows me the root directory of my ex-sicuro partition, but I'm not able to access to contents. Then I thought about a consistent trouble to fix with fsck: root@k7# fsck -t ufs /dev/md1c ** /dev/md1c CANNOT READ BLK: 20779040 CONTINUE? [yn] y THE FOLLOWING DISK SECTORS COULD NOT BE READ: 20779040, 20779041, 20779042, 20779043, /dev/md1c: NOT LABELED AS A BSD FILE SYSTEM (unused) root@k7# fsck -t ufs /dev/md1 ** /dev/md1 CANNOT READ BLK: 20779040 CONTINUE? [yn] y THE FOLLOWING DISK SECTORS COULD NOT BE READ: 20779040, 20779041, 20779042, 20779043, ioctl (GCINFO): Inappropriate ioctl for device fsck_ufs: /dev/md1: can't read disk label But it doesn't fix anything. Any suggestion? Bye, \fer From owner-freebsd-geom@FreeBSD.ORG Mon Dec 12 22:26:23 2005 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 5B23716A41F for ; Mon, 12 Dec 2005 22:26:23 +0000 (GMT) (envelope-from grog@lemis.com) Received: from ext-gw.lemis.com (ext-gw.lemis.com [150.101.14.10]) by mx1.FreeBSD.org (Postfix) with ESMTP id ACD8343D53 for ; Mon, 12 Dec 2005 22:26:22 +0000 (GMT) (envelope-from grog@lemis.com) Received: from wantadilla.lemis.com (wantadilla.lemis.com [192.109.197.135]) by ext-gw.lemis.com (Postfix) with ESMTP id 47E23131D4F; Tue, 13 Dec 2005 08:56:21 +1030 (CST) Received: by wantadilla.lemis.com (Postfix, from userid 1004) id B9EE0856B1; Tue, 13 Dec 2005 08:57:21 +1030 (CST) Date: Tue, 13 Dec 2005 08:57:21 +1030 From: Greg 'groggy' Lehey To: Ferruccio Zamuner Message-ID: <20051212222721.GJ3080@wantadilla.lemis.com> References: <439CB6C0.30109@diff.org> <439D7201.8010301@diff.org> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="f84gc1imS8AYVgCy" Content-Disposition: inline In-Reply-To: <439D7201.8010301@diff.org> User-Agent: Mutt/1.4.2.1i Organization: The FreeBSD Project Phone: +61-8-8388-8286 Fax: +61-8-8388-8725 Mobile: +61-418-838-708 WWW-Home-Page: http://www.FreeBSD.org/ X-PGP-Fingerprint: 9A1B 8202 BCCE B846 F92F 09AC 22E6 F290 507A 4223 Cc: freebsd-geom@freebsd.org Subject: Re: from vinum on FreeBSD 4.x to gvinum on 5.4 and 6.0 X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 12 Dec 2005 22:26:23 -0000 --f84gc1imS8AYVgCy Content-Type: text/plain; charset=us-ascii Content-Disposition: inline On Monday, 12 December 2005 at 13:50:09 +0100, Ferruccio Zamuner wrote: > Ferruccio Zamuner wrote: > >> Actually I was very interested to content of partition "/vinum/sicuro" >> and it was simple: >> # dd if=/dev/ad5s1e of=/usr/vinum_sicuro.bin skip=265 count=2097152 >> # mdconfig -a -t vnode -f /usr/vinum_sicuro.bin -u 1 >> # bsdlabel -w md1 auto >> # mount /dev/md1c /mnt/ >> >> Then I recover first data contents easly. > > I thought to recover, ls shows me the root directory of my ex-sicuro > partition, but I'm not able to access to contents. > > Then I thought about a consistent trouble to fix with fsck: > > root@k7# fsck -t ufs /dev/md1c > ** /dev/md1c > > CANNOT READ BLK: 20779040 > CONTINUE? [yn] y > > THE FOLLOWING DISK SECTORS COULD NOT BE READ: 20779040, 20779041, 20779042, > 20779043, These are I/O errors. I'm not sure how they map to the disk, but your dmesg output should clarify that. > /dev/md1c: NOT LABELED AS A BSD FILE SYSTEM (unused) And this is to be expected. Partition c is of type unused. Take a look at what bsdlabel(8) says and see if it even comes close to what you want. The same considerations apply to using /dev/md1. Greg -- See complete headers for address and phone numbers. --f84gc1imS8AYVgCy Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.1 (FreeBSD) iD8DBQFDnflJIubykFB6QiMRAksgAJ0XLI6wo5GmNN7Yg0CTCmhK6JCCcwCfVUB2 N9hfluKlIH50/hXYwWHNoy4= =rh9h -----END PGP SIGNATURE----- --f84gc1imS8AYVgCy-- From owner-freebsd-geom@FreeBSD.ORG Tue Dec 13 12:21:28 2005 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 4C2B916A41F for ; Tue, 13 Dec 2005 12:21:28 +0000 (GMT) (envelope-from michael.schuh@gmail.com) Received: from nproxy.gmail.com (nproxy.gmail.com [64.233.182.206]) by mx1.FreeBSD.org (Postfix) with ESMTP id 4563543D60 for ; Tue, 13 Dec 2005 12:21:26 +0000 (GMT) (envelope-from michael.schuh@gmail.com) Received: by nproxy.gmail.com with SMTP id a27so539469nfc for ; Tue, 13 Dec 2005 04:21:25 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=DkTzxIj0QP0MvJjwtFxfTxJ1T9RqfbO8CS/5/uDvg0rlNJAuQ2KcsQ5sFMrXVTlSUy/AgU43ODj2dift1KtjmKN7PsTsrP+mFtFShtCVFDvD90FMaF4t2RB7m+/NB8utQ7mCLSLE0iB40t0HTDBv4n7rbPLke0czbvghrlZmQY0= Received: by 10.48.225.20 with SMTP id x20mr904862nfg; Tue, 13 Dec 2005 04:21:25 -0800 (PST) Received: by 10.48.240.11 with HTTP; Tue, 13 Dec 2005 04:21:25 -0800 (PST) Message-ID: <1dbad3150512130421i5278d693g@mail.gmail.com> Date: Tue, 13 Dec 2005 13:21:25 +0100 From: Michael Schuh To: Ivan Voras In-Reply-To: <43998C95.3050505@fer.hr> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline References: <1dbad3150512090509l2ab08e03k@mail.gmail.com> <43998C95.3050505@fer.hr> Cc: freebsd-geom@freebsd.org Subject: Re: Questions about geom-gate and RAID1/10 and CARP X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 13 Dec 2005 12:21:28 -0000 Hello, thanks to Ivan for his suggestions and his experiences. I have this mailing first mailed to stable, but i think now this was the wrong place. It this the real place, or even better place as stable? I hope so. >From the suggestions from Ivan i have learned, that i must think a little bit in other directions. First change to following case is: I woud have a Machine that do the Writer Job. I call this Machine W. W binds the shared Disks (per ggated-exports) from A and B with his own shared Disk-Device to an RAID1 OR RAID10. Incoming Traffic like ftp-uploads, passwdchanges, accountchanges must be done on W. The Machines A and B mount the ggate-exported RAID on an unique mountpoint read only, so that all software work on an that shared RAID. On the other site all Loggings are made through the private interfaces to W. He is the only one where could write the logfiles to the RAID. For the rest of functionality look down in the original posting, i pasted it after this mailing. Have anyone any suggestion. Should this work ready? Give it another Way to work so? Thanks for all help. regards michael --------8<---snip---8<-------- Hello, i have searched informations about geom-gate and RAID1 or Raid10 over TCP/IP. But nothing relevant found, so that i write the questions here. My opinion/scenario that i thinked out: i Have 2 Machines Host A and Host B, both Machines have 2 Networkinterfaces, one official and one private. The official interfaces getting bound with CARP for traffic, so that peoples think they connect's to one Machine. So that i get, for this case, a high-availibility-solution on CARP-Base. The private interfaces get to be used to derive my data from one Machine to the other Machine, and also spend the possibility to watch the other Mac= hine. To this point everything is clear for me, so let us go to the more complex part. In the description above i be suppressed to derive the shared-data for booth machines from one to another. My idea was to build an RAID1 or RAID10 over the Network by using geom-gate and vinum respective gvinum. Has anyone any experiences with geom-gate and doing RAID1 or RAID10 over TCP/IP? And has anyone a good solution in Production use? My Questions about these thema are: a) Is this generally possible with FreeBSD ? b)is this generally a good idea ? c)how must i setup the RAID? d)who must build the raid? Host A? Host B? or BOTH? e) can i use this way to become an HA-Solution? I have searched in the Web about these questions, but nothing found. Only things that i have found was Mirroring (local) and mode generals related to local work with geom. Thanks for help. regards Michael -------->8---snap--->8-------- 2005/12/9, Ivan Voras : > Michael Schuh wrote: > > > i have searched informations about geom-gate and RAID1 or > > Raid10 over TCP/IP. But nothing relevant found, so that i write > > the questions here. > > Actually, there has been some discussion about this, but you probably > won't like the result... > > > Has anyone any experiences with geom-gate and doing RAID1 or RAID10 ove= r > > TCP/IP? And has anyone a good solution in Production use? > > Theoretically, yes - it can be done this way. You could use any > GEOM-aware RAID solution, and throw ggate in the mix. > > When I tried it (back in early 5-stable days) I could create the setup > just fine, but could not stabilise it - gmirror kept loosing the ggate > component(s), possibly(?) due to timeouts from network latency. IIRC, > just around the time 6-stable was branched there was a similar report > from somebody else. BUT, ggate has had several changes since then that > should address performace, so maybe it's time to try again. > > There's another problem: if you do get the over-the-network mirroring to > work, you won't be able to share data this way: the > one-writer-multiple-readers scenario won't work because the filesystem > doesn't support it on the reader side (when the data gets modified by > the writer, the reader doesn't know about it). Readonly-for-all scenario > will work. > > (see also this: http://docs.freebsd.org/cgi/mid.cgi?438B05D6.3000108 - > I'll maybe find the time soon) > From owner-freebsd-geom@FreeBSD.ORG Tue Dec 13 13:16:28 2005 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 1B81E16A41F for ; Tue, 13 Dec 2005 13:16:28 +0000 (GMT) (envelope-from mark@gaiahost.coop) Received: from biodiesel.gaiahost.coop (biodiesel.gaiahost.coop [64.95.78.120]) by mx1.FreeBSD.org (Postfix) with ESMTP id 3277F43D62 for ; Tue, 13 Dec 2005 13:16:27 +0000 (GMT) (envelope-from mark@gaiahost.coop) Received: from localhost (host-64-65-195-19.spr.choiceone.net [::ffff:64.65.195.19]) (AUTH: LOGIN mark@hubcapconsulting.com) by biodiesel.gaiahost.coop with esmtp; Tue, 13 Dec 2005 08:16:24 -0500 id 006FC054.439EC9AA.00005433 Received: by localhost (sSMTP sendmail emulation); Tue, 13 Dec 2005 08:16:38 -0500 Date: Tue, 13 Dec 2005 08:16:37 -0500 From: Mark Bucciarelli To: freebsd-geom@freebsd.org Message-ID: <20051213131637.GC2188@rabbit> Mail-Followup-To: freebsd-geom@freebsd.org Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Content-Disposition: inline User-Agent: Mutt/1.4.2.1i Subject: How to recover a gmirror from a disaster X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 13 Dec 2005 13:16:28 -0000 The disaster: 1. gmirror setup (full disk mirror, da0 + da1) 2. disk head crash into platter on da1 3. reboot 4. mirror starts to sync, hits bad spot on da1, halts 5. restart (can work for a while b/f bad spot hit) 6. Enter command "gmirror remove gm0 da1" 7. Now on restart, da0 will not boot. On attempting boot on da0, this is the last output b/f system hangs: GEOM_MIRROR: Device gm0 created (id=...) GEOM_MIRROR: Device gm0: provider da0 detected GEOM_MIRROR: Device gm0 destroyed GEOM_MIRROR: Device gm0 created (id=...) GEOM_MIRROR: Device gm0: provider da0c detected GEOM_MIRROR: Device gm0 destroyed GEOM_MIRROR: Device gm0 created (id=...) GEOM_MIRROR: Device gm0: provider da0 detected GEOM_MIRROR: Device gm0 destroyed SMP: AP CPU #1 Launched! Mounting root from ufs:/dev/mirror/gm0s1a setrootbyname failed ffs_mountroot: can't find rootvp Root mount failed: 6 This is 5.4-RELEASE. The da0 disk is good (I did a surface scan) and I can mount it and backup the data when I put it in bay #2. So ... Did my command in step #6 cause this mess? If so, what should I have used--forget first? How can I get this disk to boot again? m From owner-freebsd-geom@FreeBSD.ORG Tue Dec 13 13:44:44 2005 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 270C816A41F for ; Tue, 13 Dec 2005 13:44:44 +0000 (GMT) (envelope-from anderson@centtech.com) Received: from mh2.centtech.com (moat3.centtech.com [207.200.51.50]) by mx1.FreeBSD.org (Postfix) with ESMTP id 7D15343D82 for ; Tue, 13 Dec 2005 13:44:29 +0000 (GMT) (envelope-from anderson@centtech.com) Received: from [10.177.171.220] (neutrino.centtech.com [10.177.171.220]) by mh2.centtech.com (8.13.1/8.13.1) with ESMTP id jBDDiF4L038542; Tue, 13 Dec 2005 07:44:15 -0600 (CST) (envelope-from anderson@centtech.com) Message-ID: <439ED00E.7050701@centtech.com> Date: Tue, 13 Dec 2005 07:43:42 -0600 From: Eric Anderson User-Agent: Mozilla Thunderbird 1.0.7 (X11/20051204) X-Accept-Language: en-us, en MIME-Version: 1.0 To: Michael Schuh References: <1dbad3150512090509l2ab08e03k@mail.gmail.com> <43998C95.3050505@fer.hr> <1dbad3150512130421i5278d693g@mail.gmail.com> In-Reply-To: <1dbad3150512130421i5278d693g@mail.gmail.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV 0.87.1/1209/Mon Dec 12 09:48:01 2005 on mh2.centtech.com X-Virus-Status: Clean Cc: Ivan Voras , freebsd-geom@freebsd.org Subject: Re: Questions about geom-gate and RAID1/10 and CARP X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 13 Dec 2005 13:44:44 -0000 Michael Schuh wrote: >Hello, > >thanks to Ivan for his suggestions and his experiences. >I have this mailing first mailed to stable, but i think now this was the >wrong place. It this the real place, or even better place as stable? >I hope so. > >>From the suggestions from Ivan i have learned, that >i must think a little bit in other directions. >First change to following case is: >I woud have a Machine that do the Writer Job. >I call this Machine W. >W binds the shared Disks (per ggated-exports) from A and B >with his own shared Disk-Device to an RAID1 OR RAID10. >Incoming Traffic like ftp-uploads, passwdchanges, accountchanges >must be done on W. The Machines A and B mount the ggate-exported RAID >on an unique mountpoint read only, so that all software work on an >that shared RAID. On the other site all Loggings are made through the >private interfaces to >W. He is the only one where could write the logfiles to the RAID. > >For the rest of functionality look down in the original posting, i >pasted it after this mailing. > >Have anyone any suggestion. Should this work ready? >Give it another Way to work so? > If I understand correctly, you would like one node to do all the writes, and the other nodes to be read-only of that same device that node 'w' is writing to. This would work, in the respect that it should not cause problems, but it may not work as you expect. The nodes mounting the device read-only would only be able to see the data that had been commited to disk on the writer side at the time the read-only side mounted the filesystem. This means that any changes made after the read-only side mounted would result in an inconsistent view of the filesystem, since the read-only side would have the inodes and dirent's cached, and would not expect them to change. This *could* cause issues, for instance, if the read-only machine cached an inode entry, then the inode entry changed, but the read-only side did not know it, so it loads the data blocks referenced in the old inode, which may not be the correct data, so you would get a corrupt file. The only way I can think of to prevent this is to use synchronous writes (metadata and data, so the 'sync' option on the writer side), *AND* also somehow disable the buffer cache on the read-only side, so for each access, it looks to the block device for the newest information, however this would most likely result in very poor performance. You might be able to make something with NFS work, but not sure the how you would implement that completely. Eric -- ------------------------------------------------------------------------ Eric Anderson Sr. Systems Administrator Centaur Technology Anything that works is better than anything that doesn't. ------------------------------------------------------------------------ From owner-freebsd-geom@FreeBSD.ORG Tue Dec 13 13:48:08 2005 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 5EC1416A41F for ; Tue, 13 Dec 2005 13:48:08 +0000 (GMT) (envelope-from anderson@centtech.com) Received: from mh1.centtech.com (moat3.centtech.com [207.200.51.50]) by mx1.FreeBSD.org (Postfix) with ESMTP id C06A643D58 for ; Tue, 13 Dec 2005 13:48:07 +0000 (GMT) (envelope-from anderson@centtech.com) Received: from [10.177.171.220] (neutrino.centtech.com [10.177.171.220]) by mh1.centtech.com (8.13.1/8.13.1) with ESMTP id jBDDm6Dx015852; Tue, 13 Dec 2005 07:48:07 -0600 (CST) (envelope-from anderson@centtech.com) Message-ID: <439ED0F6.2070507@centtech.com> Date: Tue, 13 Dec 2005 07:47:34 -0600 From: Eric Anderson User-Agent: Mozilla Thunderbird 1.0.7 (X11/20051204) X-Accept-Language: en-us, en MIME-Version: 1.0 To: Mark Bucciarelli References: <20051213131637.GC2188@rabbit> In-Reply-To: <20051213131637.GC2188@rabbit> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV 0.87.1/1209/Mon Dec 12 09:48:01 2005 on mh1.centtech.com X-Virus-Status: Clean Cc: freebsd-geom@freebsd.org Subject: Re: How to recover a gmirror from a disaster X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 13 Dec 2005 13:48:08 -0000 Mark Bucciarelli wrote: >The disaster: > > 1. gmirror setup (full disk mirror, da0 + da1) > > 2. disk head crash into platter on da1 > > 3. reboot > > 4. mirror starts to sync, hits bad spot on da1, halts > > 5. restart (can work for a while b/f bad spot hit) > > 6. Enter command "gmirror remove gm0 da1" > > 7. Now on restart, da0 will not boot. > >On attempting boot on da0, this is the last output b/f system hangs: > > GEOM_MIRROR: Device gm0 created (id=...) > GEOM_MIRROR: Device gm0: provider da0 detected > GEOM_MIRROR: Device gm0 destroyed > GEOM_MIRROR: Device gm0 created (id=...) > GEOM_MIRROR: Device gm0: provider da0c detected > GEOM_MIRROR: Device gm0 destroyed > GEOM_MIRROR: Device gm0 created (id=...) > GEOM_MIRROR: Device gm0: provider da0 detected > GEOM_MIRROR: Device gm0 destroyed > SMP: AP CPU #1 Launched! > Mounting root from ufs:/dev/mirror/gm0s1a > setrootbyname failed > ffs_mountroot: can't find rootvp > Root mount failed: 6 > >This is 5.4-RELEASE. > >The da0 disk is good (I did a surface scan) and I can mount it and >backup the data when I put it in bay #2. > >So ... > > Did my command in step #6 cause this mess? If so, what should I > have used--forget first? > > How can I get this disk to boot again? > > I think you wanted to do a 'forget'.. Can you set root to /dev/da0s1a, boot up, and then check gmirror status? Eric -- ------------------------------------------------------------------------ Eric Anderson Sr. Systems Administrator Centaur Technology Anything that works is better than anything that doesn't. ------------------------------------------------------------------------ From owner-freebsd-geom@FreeBSD.ORG Tue Dec 13 15:27:13 2005 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 7574F16A41F for ; Tue, 13 Dec 2005 15:27:13 +0000 (GMT) (envelope-from mark@gaiahost.coop) Received: from biodiesel.gaiahost.coop (biodiesel.gaiahost.coop [64.95.78.120]) by mx1.FreeBSD.org (Postfix) with ESMTP id D6C2243D5C for ; Tue, 13 Dec 2005 15:27:12 +0000 (GMT) (envelope-from mark@gaiahost.coop) Received: from localhost (host-64-65-195-19.spr.choiceone.net [::ffff:64.65.195.19]) (AUTH: LOGIN mark@hubcapconsulting.com) by biodiesel.gaiahost.coop with esmtp; Tue, 13 Dec 2005 10:27:10 -0500 id 006FC063.439EE84F.00000865 Received: by localhost (sSMTP sendmail emulation); Tue, 13 Dec 2005 10:27:22 -0500 Date: Tue, 13 Dec 2005 10:27:22 -0500 From: Mark Bucciarelli To: freebsd-geom@freebsd.org Message-ID: <20051213152722.GG2188@rabbit> Mail-Followup-To: freebsd-geom@freebsd.org References: <20051213131637.GC2188@rabbit> <439ED0F6.2070507@centtech.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Content-Disposition: inline In-Reply-To: <439ED0F6.2070507@centtech.com> User-Agent: Mutt/1.4.2.1i Subject: Re: How to recover a gmirror from a disaster X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 13 Dec 2005 15:27:13 -0000 On Tue, Dec 13, 2005 at 07:47:34AM -0600, Eric Anderson wrote: > Mark Bucciarelli wrote: > > > How can I get this disk to boot again? > > Can you set root to /dev/da0s1a, boot up, and then check gmirror > status? Yes. :) Edit fstab back to da0 from mirror/gm0 and now machine boots properly. gmirror status gives no output. /me goes back to read gmirror man page. m From owner-freebsd-geom@FreeBSD.ORG Tue Dec 13 23:21:08 2005 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 4DCF316A41F for ; Tue, 13 Dec 2005 23:21:08 +0000 (GMT) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.FreeBSD.org (Postfix) with ESMTP id EB99643D73 for ; Tue, 13 Dec 2005 23:21:04 +0000 (GMT) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id E251C51B27; Wed, 14 Dec 2005 00:21:01 +0100 (CET) Received: from localhost (dkp188.neoplus.adsl.tpnet.pl [83.24.19.188]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id 2FEF850F92 for ; Wed, 14 Dec 2005 00:20:55 +0100 (CET) Date: Wed, 14 Dec 2005 00:20:08 +0100 From: Pawel Jakub Dawidek To: freebsd-geom@freebsd.org Message-ID: <20051213232008.GA749@garage.freebsd.pl> References: <20051213131637.GC2188@rabbit> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="h31gzZEtNLTqOjlF" Content-Disposition: inline In-Reply-To: <20051213131637.GC2188@rabbit> X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng/devel-r535 (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-0.5 required=3.0 tests=BAYES_00,RCVD_IN_NJABL_DUL, RCVD_IN_SORBS_DUL autolearn=no version=3.0.4 Subject: Re: How to recover a gmirror from a disaster X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 13 Dec 2005 23:21:08 -0000 --h31gzZEtNLTqOjlF Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Dec 13, 2005 at 08:16:37AM -0500, Mark Bucciarelli wrote: +> The disaster: +>=20 +> 1. gmirror setup (full disk mirror, da0 + da1) +>=20 +> 2. disk head crash into platter on da1 +>=20 +> 3. reboot +>=20 +> 4. mirror starts to sync, hits bad spot on da1, halts +>=20 +> 5. restart (can work for a while b/f bad spot hit) +>=20 +> 6. Enter command "gmirror remove gm0 da1" +>=20 +> 7. Now on restart, da0 will not boot. +>=20 +> On attempting boot on da0, this is the last output b/f system hangs: +>=20 +> GEOM_MIRROR: Device gm0 created (id=3D...) +> GEOM_MIRROR: Device gm0: provider da0 detected +> GEOM_MIRROR: Device gm0 destroyed +> GEOM_MIRROR: Device gm0 created (id=3D...) +> GEOM_MIRROR: Device gm0: provider da0c detected +> GEOM_MIRROR: Device gm0 destroyed +> GEOM_MIRROR: Device gm0 created (id=3D...) +> GEOM_MIRROR: Device gm0: provider da0 detected +> GEOM_MIRROR: Device gm0 destroyed +> SMP: AP CPU #1 Launched! +> Mounting root from ufs:/dev/mirror/gm0s1a +> setrootbyname failed +> ffs_mountroot: can't find rootvp +> Root mount failed: 6 Could you add kern.geom.mirror.debug=3D3 to your /boot/loader.conf and boot again? +> This is 5.4-RELEASE. +>=20 +> The da0 disk is good (I did a surface scan) and I can mount it and=20 +> backup the data when I put it in bay #2. +>=20 +> So ... +>=20 +> Did my command in step #6 cause this mess? If so, what should I=20 +> have used--forget first? If da1 was disconnected you should get an error, that mirror is not complete. Yes, 'forget' is the right command. +> How can I get this disk to boot again? Actually you can simply: # gmirror label gm0 da0 No data will be lost. You can also boot from da0 directly. --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --h31gzZEtNLTqOjlF Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.2 (FreeBSD) iD8DBQFDn1coForvXbEpPzQRAgyUAKDOX6ffp90Sfcvf+XuMhDiF49i7qACgxFmh LVGHiPPbSqMNb/B7zE1HnuI= =Se5K -----END PGP SIGNATURE----- --h31gzZEtNLTqOjlF-- From owner-freebsd-geom@FreeBSD.ORG Wed Dec 14 02:52:11 2005 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id C69AC16A41F for ; Wed, 14 Dec 2005 02:52:11 +0000 (GMT) (envelope-from mark@gaiahost.coop) Received: from biodiesel.gaiahost.coop (biodiesel.gaiahost.coop [64.95.78.120]) by mx1.FreeBSD.org (Postfix) with ESMTP id 53A7E43D55 for ; Wed, 14 Dec 2005 02:52:11 +0000 (GMT) (envelope-from mark@gaiahost.coop) Received: from localhost (host-64-65-195-19.spr.choiceone.net [::ffff:64.65.195.19]) (AUTH: LOGIN mark@hubcapconsulting.com) by biodiesel.gaiahost.coop with esmtp; Tue, 13 Dec 2005 21:52:08 -0500 id 003940CB.439F88D9.000073A5 Received: by localhost (sSMTP sendmail emulation); Tue, 13 Dec 2005 21:52:22 -0500 Date: Tue, 13 Dec 2005 21:52:22 -0500 From: Mark Bucciarelli To: freebsd-geom@freebsd.org Message-ID: <20051214025222.GB2708@rabbit> Mail-Followup-To: freebsd-geom@freebsd.org References: <20051213131637.GC2188@rabbit> <20051213232008.GA749@garage.freebsd.pl> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Content-Disposition: inline In-Reply-To: <20051213232008.GA749@garage.freebsd.pl> User-Agent: Mutt/1.4.2.1i Subject: Re: How to recover a gmirror from a disaster X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 14 Dec 2005 02:52:11 -0000 On Wed, Dec 14, 2005 at 12:20:08AM +0100, Pawel Jakub Dawidek wrote: > Could you add kern.geom.mirror.debug=3 to your /boot/loader.conf and > boot again? I'm sorry, with the previous posters help I was able to boot and this error no longer occurs. > +> This is 5.4-RELEASE. > +> > +> The da0 disk is good (I did a surface scan) and I can mount it and > +> backup the data when I put it in bay #2. > +> > +> So ... > +> > +> Did my command in step #6 cause this mess? If so, what should I > +> have used--forget first? > > If da1 was disconnected you should get an error, that mirror is not > complete. Yes, 'forget' is the right command. Yes, as is documented in the man page. > +> How can I get this disk to boot again? > > Actually you can simply: > > # gmirror label gm0 da0 > > No data will be lost. You can also boot from da0 directly. No data loss. My error was not using the forget command. m From owner-freebsd-geom@FreeBSD.ORG Wed Dec 14 13:35:38 2005 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 4250616A420 for ; Wed, 14 Dec 2005 13:35:38 +0000 (GMT) (envelope-from lapo@seanet.com) Received: from mx.seanet.com (mx.seanet.com [199.181.164.20]) by mx1.FreeBSD.org (Postfix) with ESMTP id CD1A943D53 for ; Wed, 14 Dec 2005 13:35:37 +0000 (GMT) (envelope-from lapo@seanet.com) Received: from [199.181.168.92] (wallace.osd.com [199.181.168.92]) (authenticated bits=0) by milkyway.seanet.com (8.13.4/8.13.4) with ESMTP id jBEDZbOU052594 for ; Wed, 14 Dec 2005 05:35:37 -0800 (PST) (envelope-from lapo@seanet.com) Mime-Version: 1.0 (Apple Message framework v746.2) In-Reply-To: <20051211194907.GC1029@garage.freebsd.pl> References: <169FE8E2-A191-491B-864D-C1CBE28EE827@seanet.com> <20051210022959.GA726@garage.freebsd.pl> <97205FE2-7C60-4CD6-B908-92DBBCF902F3@seanet.com> <20051211194907.GC1029@garage.freebsd.pl> Content-Type: text/plain; charset=US-ASCII; delsp=yes; format=flowed Message-Id: Content-Transfer-Encoding: 7bit From: Lapo Nustrini Date: Wed, 14 Dec 2005 05:35:27 -0800 To: freebsd-geom@freebsd.org X-Mailer: Apple Mail (2.746.2) Subject: Re: gmirror load problem X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 14 Dec 2005 13:35:38 -0000 On Dec 11, 2005, at 11:49 AM, Pawel Jakub Dawidek wrote: > On Sun, Dec 11, 2005 at 11:23:15AM -0800, Lapo Nustrini wrote: > +> > +> On Dec 9, 2005, at 6:29 PM, Pawel Jakub Dawidek wrote: > +> > +> >On Fri, Dec 09, 2005 at 12:30:35PM -0800, Lapo Nustrini wrote: > +> >+> This time however "gmirror load" returns a "Command 'load' > not available" error. > +> >+> I thought gmirror must be already loaded but I can't unload > gmirror or see a /dev/mirror directory on the system. > +> > > +> >Could you paste the result of the following commands: > +> > > +> > # kldstat -v | grep g_mirror > +> > # sysctl kern.module_path > +> > # ls -l /boot/kernel/geom_mirror.ko > +> > > +> > +> Sure thing. > +> > +> % kldstat -v | grep g_mirror > +> % sysctl kern.module_path > +> kern.module_path: /boot/modules > +> % ls -l /boot/kernel/geom_mirror.ko > +> -r-xr-xr-x 1 root wheel 79886 Jun 24 13:31 /boot/kernel/ > geom_mirror.ko > +> > +> > +> Does this shed any light? > > Yes. Your kern.module_path is wrong. It should have also /boot/ > kernel/. > If you load manually geom_mirror.ko by doing: > > # kldload /boot/kernel/geom_mirror.ko > > it will work. > Yes, it does work but how do I make it load automatically on boot? (Obviously, I already have geom_mirror_load="YES" in the /boot/ loader.conf file.) > > The problem you're seeing is related to loader.rc changes probably. > If you have loader.rc rev1.1, you should manually update to at least > 1.2. The file should be here: > > /sys/boot/i386/loader/loader.rc > > I reported this problem to jmg@ which did the change and I was sure it > was fixed somehow... > This was some time ago, so not sure if this is the problem... > > I checked the loader.rc version and it is already 1.2 (The system was upgraded from 5.3 to 5.4 when 5.4 was released.) The strange thing is that we have two identical servers (load sharing mail and ldap systems) which run on the same hardware and software. The first system was converted over to gmirror without a hitch. This second one has the problem outlined above. The loader.rc files are the same version on both systems. Also, the output of: # kldstat -v | grep g_mirror # sysctl kern.module_path # ls -l /boot/kernel/geom_mirror.ko is also identical on both systems. I'm not versed enough in the detailed workings of geom to know where to look to find what is different between the two systems. Any suggestions? Thanks, Lapo Nustrini From owner-freebsd-geom@FreeBSD.ORG Thu Dec 15 11:55:09 2005 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 1403A16A41F for ; Thu, 15 Dec 2005 11:55:09 +0000 (GMT) (envelope-from michael.schuh@gmail.com) Received: from nproxy.gmail.com (nproxy.gmail.com [64.233.182.193]) by mx1.FreeBSD.org (Postfix) with ESMTP id 54B6043D64 for ; Thu, 15 Dec 2005 11:55:08 +0000 (GMT) (envelope-from michael.schuh@gmail.com) Received: by nproxy.gmail.com with SMTP id p48so126651nfa for ; Thu, 15 Dec 2005 03:55:07 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=ULxKXUdTmg9pzZXfZ2VBTnqELx6sLOvQHSL/6a6Tue3QBup4HarvGED4Oj982z/g4Kx6LJGxHTUFFXe84Ka1t9wef1BTysw69WOkdMKV5tNj2eKWLDhBnXhoEkwz3FYcYffDb5+N6+Pm13v7VcQRkwrHtVd3HVwGVHFsxXtgUOA= Received: by 10.48.232.17 with SMTP id e17mr77062nfh; Thu, 15 Dec 2005 03:55:06 -0800 (PST) Received: by 10.48.240.11 with HTTP; Thu, 15 Dec 2005 03:55:06 -0800 (PST) Message-ID: <1dbad3150512150355r576b1b0j@mail.gmail.com> Date: Thu, 15 Dec 2005 12:55:06 +0100 From: Michael Schuh To: Eric Anderson In-Reply-To: <439ED00E.7050701@centtech.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline References: <1dbad3150512090509l2ab08e03k@mail.gmail.com> <43998C95.3050505@fer.hr> <1dbad3150512130421i5278d693g@mail.gmail.com> <439ED00E.7050701@centtech.com> Cc: Ivan Voras , freebsd-geom@freebsd.org Subject: Re: Questions about geom-gate and RAID1/10 and CARP X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 15 Dec 2005 11:55:09 -0000 Hello Eric, Hello list, oh my first, or better primary opinion was to have two mostly identically Machines, that uses ggated and gvinum to have an redundant system where it looks like one Machine to the public side access. But later i have realized that this whis can't run with ufs or ufs2 while it is not really good to have one filesyst= em mounted rw on both machines, so that i think i must have one Writer and two listeners. But you are right, it is also impossible to mount an Filesystem ro while another machine write things to that FS. So the only good concept is to have one writer and another (or two) listeners, there listens over NFS. But this throws my wish completely away to the stars. Only FS that i know that have these functionality is the really young ZFS from Solaris. Or do it give another solution for my whish? I would paint it to remember what my target was: 2 Machines A and B, booth mostly identical hardware and OS (RELENG_6) both machines have one private interface that is cross bind to the other ma= chine for updates on the FS and Monitoring the other..... the public interfaces of both machines should get bound to one public address with CARP and pfsync, so that clients see only one Machine. And last, my wish are the RAID1/10 do the sync of both machines automagically........hope you understand what my target is. Thanks for your help. regards michael 2005/12/13, Eric Anderson : > Michael Schuh wrote: > > >Hello, > > > >thanks to Ivan for his suggestions and his experiences. > >I have this mailing first mailed to stable, but i think now this was the > >wrong place. It this the real place, or even better place as stable? > >I hope so. > > > >>From the suggestions from Ivan i have learned, that > >i must think a little bit in other directions. > >First change to following case is: > >I woud have a Machine that do the Writer Job. > >I call this Machine W. > >W binds the shared Disks (per ggated-exports) from A and B > >with his own shared Disk-Device to an RAID1 OR RAID10. > >Incoming Traffic like ftp-uploads, passwdchanges, accountchanges > >must be done on W. The Machines A and B mount the ggate-exported RAID > >on an unique mountpoint read only, so that all software work on an > >that shared RAID. On the other site all Loggings are made through the > >private interfaces to > >W. He is the only one where could write the logfiles to the RAID. > > > >For the rest of functionality look down in the original posting, i > >pasted it after this mailing. > > > >Have anyone any suggestion. Should this work ready? > >Give it another Way to work so? > > > > If I understand correctly, you would like one node to do all the writes, > and the other nodes to be read-only of that same device that node 'w' is > writing to. This would work, in the respect that it should not cause > problems, but it may not work as you expect. The nodes mounting the > device read-only would only be able to see the data that had been > commited to disk on the writer side at the time the read-only side > mounted the filesystem. This means that any changes made after the > read-only side mounted would result in an inconsistent view of the > filesystem, since the read-only side would have the inodes and dirent's > cached, and would not expect them to change. This *could* cause issues, > for instance, if the read-only machine cached an inode entry, then the > inode entry changed, but the read-only side did not know it, so it loads > the data blocks referenced in the old inode, which may not be the > correct data, so you would get a corrupt file. The only way I can think > of to prevent this is to use synchronous writes (metadata and data, so > the 'sync' option on the writer side), *AND* also somehow disable the > buffer cache on the read-only side, so for each access, it looks to the > block device for the newest information, however this would most likely > result in very poor performance. > > You might be able to make something with NFS work, but not sure the how > you would implement that completely. > > Eric > > > > > -- > ------------------------------------------------------------------------ > Eric Anderson Sr. Systems Administrator Centaur Technology > Anything that works is better than anything that doesn't. > ------------------------------------------------------------------------ > > From owner-freebsd-geom@FreeBSD.ORG Thu Dec 15 15:33:56 2005 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id D915416A41F for ; Thu, 15 Dec 2005 15:33:56 +0000 (GMT) (envelope-from anderson@centtech.com) Received: from mh1.centtech.com (moat3.centtech.com [207.200.51.50]) by mx1.FreeBSD.org (Postfix) with ESMTP id CF2F943D5A for ; Thu, 15 Dec 2005 15:33:42 +0000 (GMT) (envelope-from anderson@centtech.com) Received: from [10.177.171.220] (neutrino.centtech.com [10.177.171.220]) by mh1.centtech.com (8.13.1/8.13.1) with ESMTP id jBFFXX2g058204; Thu, 15 Dec 2005 09:33:33 -0600 (CST) (envelope-from anderson@centtech.com) Message-ID: <43A18CAB.6020705@centtech.com> Date: Thu, 15 Dec 2005 09:32:59 -0600 From: Eric Anderson User-Agent: Mozilla Thunderbird 1.0.7 (X11/20051204) X-Accept-Language: en-us, en MIME-Version: 1.0 To: Michael Schuh References: <1dbad3150512090509l2ab08e03k@mail.gmail.com> <43998C95.3050505@fer.hr> <1dbad3150512130421i5278d693g@mail.gmail.com> <439ED00E.7050701@centtech.com> <1dbad3150512150355r576b1b0j@mail.gmail.com> In-Reply-To: <1dbad3150512150355r576b1b0j@mail.gmail.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV 0.87.1/1209/Mon Dec 12 09:48:01 2005 on mh1.centtech.com X-Virus-Status: Clean Cc: Ivan Voras , freebsd-geom@freebsd.org Subject: Re: Questions about geom-gate and RAID1/10 and CARP X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 15 Dec 2005 15:33:57 -0000 Michael Schuh wrote: >Hello Eric, >Hello list, > >oh my first, or better primary opinion was to have two >mostly identically Machines, that uses ggated and gvinum >to have an redundant system where it looks like one Machine to >the public side access. But later i have realized that this whis >can't run with ufs or ufs2 while it is not really good to have one filesystem >mounted rw on both machines, so that i think i must have one Writer >and two listeners. But you are right, it is also impossible to mount >an Filesystem ro while another machine write things to that FS. > >So the only good concept is to have one writer and another (or two) >listeners, there listens over NFS. >But this throws my wish completely away to the stars. > > >Only FS that i know that have these functionality is the really young ZFS >from Solaris. Or do it give another solution for my whish? > > There are others, like lustre, gfs, polyserve, etc, however none of them work in FreeBSD at this point. A few people (including myself) have started a project to port gfs to FreeBSD (gfs4fbsd project on sourceforge). >I would paint it to remember what my target was: >2 Machines A and B, booth mostly identical hardware and OS (RELENG_6) >both machines have one private interface that is cross bind to the other machine >for updates on the FS and Monitoring the other..... >the public interfaces of both machines should get bound to one public >address with CARP and pfsync, so that clients see only one Machine. >And last, my wish are the RAID1/10 do the sync of both machines >automagically........hope you understand what my target is. > I'm wondering actually if you couldn't actually do this with NFS, and hacking some pieces together. Haven't thought through it, but seems like maybe you could make the active writer an nfs server, that also mounts it's own nfs share rw, but the nfs sharing would be on a virtual interface, or at least the one that 'moves' with your failover. The other machines would mount that nfs server's export ro, and when it fails over, the one taking over would have to run a script to begin serving that export rw to all, and it's own client would continue its connection but now on it's new virtual interface. You'd also have to have the ggate stuff set up, so that it was mirroring the original 'master' disk, but when the failover occurred, you would quickly mount your local mirrored disk rw, ignoring the 'unclean' message, begin a background fsck, then start the nfs server on that mount point. You would probably also have to fail the original drive in the mirror to effectively 'fence' that node from making disk changes at the same time the new master did. Eric -- ------------------------------------------------------------------------ Eric Anderson Sr. Systems Administrator Centaur Technology Anything that works is better than anything that doesn't. ------------------------------------------------------------------------ From owner-freebsd-geom@FreeBSD.ORG Fri Dec 16 00:06:14 2005 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 78AFE16A41F for ; Fri, 16 Dec 2005 00:06:14 +0000 (GMT) (envelope-from lapo@seanet.com) Received: from mx.seanet.com (mx.seanet.com [199.181.164.20]) by mx1.FreeBSD.org (Postfix) with ESMTP id 962F643D78 for ; Fri, 16 Dec 2005 00:06:12 +0000 (GMT) (envelope-from lapo@seanet.com) Received: from [199.181.168.92] (wallace.osd.com [199.181.168.92]) (authenticated bits=0) by milkyway.seanet.com (8.13.4/8.13.4) with ESMTP id jBG06AlG051321 for ; Thu, 15 Dec 2005 16:06:10 -0800 (PST) (envelope-from lapo@seanet.com) Mime-Version: 1.0 (Apple Message framework v746.2) Content-Transfer-Encoding: 7bit Message-Id: <8B452D98-4FD5-4755-AB7F-31D278DF33F7@seanet.com> Content-Type: text/plain; charset=US-ASCII; delsp=yes; format=flowed To: freebsd-geom@freebsd.org From: Lapo Nustrini Date: Thu, 15 Dec 2005 16:06:08 -0800 X-Mailer: Apple Mail (2.746.2) Subject: gconcat X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 16 Dec 2005 00:06:14 -0000 Can anyone tell me whether it is possible to expand a gconcat volume (by adding a drive to the end of it) without having to wipe the data from the existing set and recreate from scratch? I don't mind having to manually edit bsdlabels and such. Just wondering if its possible at all. I've been looking for some docs on this but can't seem to find a definitive answer. Thanks! Lapo Nustrini Seanet Corporation lapo@seanet.com From owner-freebsd-geom@FreeBSD.ORG Fri Dec 16 02:18:58 2005 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id A056616A41F for ; Fri, 16 Dec 2005 02:18:58 +0000 (GMT) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.FreeBSD.org (Postfix) with ESMTP id 4F28343D6D for ; Fri, 16 Dec 2005 02:18:56 +0000 (GMT) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 1900552B3E; Fri, 16 Dec 2005 03:18:55 +0100 (CET) Received: from localhost (dkb189.neoplus.adsl.tpnet.pl [83.24.5.189]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id 12CE851B27; Fri, 16 Dec 2005 03:18:48 +0100 (CET) Date: Fri, 16 Dec 2005 03:17:59 +0100 From: Pawel Jakub Dawidek To: Lapo Nustrini Message-ID: <20051216021759.GA14087@garage.freebsd.pl> References: <8B452D98-4FD5-4755-AB7F-31D278DF33F7@seanet.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="DocE+STaALJfprDB" Content-Disposition: inline In-Reply-To: <8B452D98-4FD5-4755-AB7F-31D278DF33F7@seanet.com> X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng/devel-r535 (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-0.5 required=3.0 tests=BAYES_00,RCVD_IN_NJABL_DUL, RCVD_IN_SORBS_DUL autolearn=no version=3.0.4 Cc: freebsd-geom@freebsd.org Subject: Re: gconcat X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 16 Dec 2005 02:18:58 -0000 --DocE+STaALJfprDB Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Dec 15, 2005 at 04:06:08PM -0800, Lapo Nustrini wrote: +>=20 +> Can anyone tell me whether it is possible to expand a gconcat volume (by= adding a drive to the end of it) without having to wipe the data from the = existing set and recreate=20 +> from scratch? +> I don't mind having to manually edit bsdlabels and such. Just wondering= if its possible at all. +> I've been looking for some docs on this but can't seem to find a definit= ive answer. It should just work be relabeling providers. If you did something like: # gconcat label foo da0 da1 You can expand it with: # gconcat label foo da0 da1 da2 da3 etc. Just be sure the order of old providers is the same. PS. You'd need to stop device 'foo' first. --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --DocE+STaALJfprDB Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.2 (FreeBSD) iD8DBQFDoiPXForvXbEpPzQRApaRAKCX2YnYCIjf7WSyNqRDxOuADuYyKgCg79nn 6/BBqBEDRXwwjAleYIdrxwI= =GZHR -----END PGP SIGNATURE----- --DocE+STaALJfprDB-- From owner-freebsd-geom@FreeBSD.ORG Fri Dec 16 13:37:29 2005 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 4432316A41F for ; Fri, 16 Dec 2005 13:37:29 +0000 (GMT) (envelope-from michael.schuh@gmail.com) Received: from nproxy.gmail.com (nproxy.gmail.com [64.233.182.193]) by mx1.FreeBSD.org (Postfix) with ESMTP id 0CE2343D46 for ; Fri, 16 Dec 2005 13:37:27 +0000 (GMT) (envelope-from michael.schuh@gmail.com) Received: by nproxy.gmail.com with SMTP id p48so226271nfa for ; Fri, 16 Dec 2005 05:37:26 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=A0y8BEp70+nDiXyFw/irdp941/D7MHwBLVt4nuzPUeE1sKdJu2fEjxrpULxWdEZHmRz9NOXUnmbH09jRK27/b96nL5xrX2RgEj5iqjs18UtUeLN+y85tgfc2Kgh+B9RdwpsgYcS52n9X/xcJGbRyqHyNyIXRWelLH0o7VTdF/zQ= Received: by 10.49.32.19 with SMTP id k19mr137142nfj; Fri, 16 Dec 2005 05:37:26 -0800 (PST) Received: by 10.48.240.11 with HTTP; Fri, 16 Dec 2005 05:37:26 -0800 (PST) Message-ID: <1dbad3150512160537y4a944f81u@mail.gmail.com> Date: Fri, 16 Dec 2005 14:37:26 +0100 From: Michael Schuh To: Eric Anderson In-Reply-To: <43A18CAB.6020705@centtech.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline References: <1dbad3150512090509l2ab08e03k@mail.gmail.com> <43998C95.3050505@fer.hr> <1dbad3150512130421i5278d693g@mail.gmail.com> <439ED00E.7050701@centtech.com> <1dbad3150512150355r576b1b0j@mail.gmail.com> <43A18CAB.6020705@centtech.com> Cc: Ivan Voras , freebsd-geom@freebsd.org Subject: Re: Questions about geom-gate and RAID1/10 and CARP X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 16 Dec 2005 13:37:29 -0000 > There are others, like lustre, gfs, polyserve, etc, however none of them > work in FreeBSD at this point. A few people (including myself) have > started a project to port gfs to FreeBSD (gfs4fbsd project on > sourceforge). Oh i think this was a very good idea......i'm will watch this project. another good thing was gpfs from IBM....... > > > > I'm wondering actually if you couldn't actually do this with NFS, and > hacking some pieces together. Haven't thought through it, but seems > like maybe you could make the active writer an nfs server, that also > mounts it's own nfs share rw, but the nfs sharing would be on a virtual > interface, or at least the one that 'moves' with your failover. The > other machines would mount that nfs server's export ro, and when it > fails over, the one taking over would have to run a script to begin > serving that export rw to all, and it's own client would continue its > connection but now on it's new virtual interface. You'd also have to > have the ggate stuff set up, so that it was mirroring the original > 'master' disk, but when the failover occurred, you would quickly mount > your local mirrored disk rw, ignoring the 'unclean' message, begin a > background fsck, then start the nfs server on that mount point. You > would probably also have to fail the original drive in the mirror to > effectively 'fence' that node from making disk changes at the same time > the new master did. Oh yes, this was also possible, but i would slunk around the script/cron-he= ll. It wasn't really a hell, but a serious error source..... my prior idea was to mount union two different mounted nfs-servers..... like your suggestion, but here comes the next problem......unionfs.... and later the sync....... I hope a good solution for real HA is around the corner.... michael From owner-freebsd-geom@FreeBSD.ORG Fri Dec 16 14:51:20 2005 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 8F7FC16A41F for ; Fri, 16 Dec 2005 14:51:20 +0000 (GMT) (envelope-from michael.schuh@gmail.com) Received: from nproxy.gmail.com (nproxy.gmail.com [64.233.182.203]) by mx1.FreeBSD.org (Postfix) with ESMTP id DE3F343D5A for ; Fri, 16 Dec 2005 14:51:09 +0000 (GMT) (envelope-from michael.schuh@gmail.com) Received: by nproxy.gmail.com with SMTP id p48so232049nfa for ; Fri, 16 Dec 2005 06:51:08 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=VKk0s1Jpvv0VX4PDJzgQN0oWMJZyEeM5W/ozRdDpsEddDMhyOeZGikZETcOPdjcwtl6sZf/kEcDjwWJB9qcgm6gVmro2NxkVqvlMS2j2nwyX/f6WKanA0NfqqVUIFjE+CjHZ/VjIZVFwAw9b5UsRttGLCljcj47QLiRGX8fVvi0= Received: by 10.48.249.2 with SMTP id w2mr140442nfh; Fri, 16 Dec 2005 06:51:07 -0800 (PST) Received: by 10.48.240.11 with HTTP; Fri, 16 Dec 2005 06:51:07 -0800 (PST) Message-ID: <1dbad3150512160651nc440efer@mail.gmail.com> Date: Fri, 16 Dec 2005 15:51:07 +0100 From: Michael Schuh To: Eric Anderson In-Reply-To: <1dbad3150512160537y4a944f81u@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline References: <1dbad3150512090509l2ab08e03k@mail.gmail.com> <43998C95.3050505@fer.hr> <1dbad3150512130421i5278d693g@mail.gmail.com> <439ED00E.7050701@centtech.com> <1dbad3150512150355r576b1b0j@mail.gmail.com> <43A18CAB.6020705@centtech.com> <1dbad3150512160537y4a944f81u@mail.gmail.com> Cc: Ivan Voras , freebsd-geom@freebsd.org Subject: Re: Questions about geom-gate and RAID1/10 and CARP X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 16 Dec 2005 14:51:20 -0000 Hello Eric, Hello List, 2005/12/16, Michael Schuh : > > There are others, like lustre, gfs, polyserve, etc, however none of the= m > > work in FreeBSD at this point. A few people (including myself) have > > started a project to port gfs to FreeBSD (gfs4fbsd project on > > sourceforge). > Oh i think this was a very good idea......i'm will watch this project. > another good thing was gpfs from IBM....... > > > > > > > > I'm wondering actually if you couldn't actually do this with NFS, and > > hacking some pieces together. Haven't thought through it, but seems > > like maybe you could make the active writer an nfs server, that also > > mounts it's own nfs share rw, but the nfs sharing would be on a virtual > > interface, or at least the one that 'moves' with your failover. The > > other machines would mount that nfs server's export ro, and when it > > fails over, the one taking over would have to run a script to begin > > serving that export rw to all, and it's own client would continue its > > connection but now on it's new virtual interface. You'd also have to > > have the ggate stuff set up, so that it was mirroring the original > > 'master' disk, but when the failover occurred, you would quickly mount > > your local mirrored disk rw, ignoring the 'unclean' message, begin a > > background fsck, then start the nfs server on that mount point. You > > would probably also have to fail the original drive in the mirror to > > effectively 'fence' that node from making disk changes at the same time > > the new master did. I have made a quick lookup into the coda-doc's and it seems to me, that coda is exactly the solution for this Problem, but im not really sure. i do further reading the doc's of coda....... > > Oh yes, this was also possible, but i would slunk around the script/cron-= hell. > It wasn't really a hell, but a serious error source..... > my prior idea was to mount union two different mounted nfs-servers..... > like your suggestion, but here comes the next problem......unionfs.... > and later the sync....... > > I hope a good solution for real HA is around the corner.... > > michael > Thanks to all regards michael From owner-freebsd-geom@FreeBSD.ORG Fri Dec 16 16:11:03 2005 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id E286A16A41F; Fri, 16 Dec 2005 16:11:03 +0000 (GMT) (envelope-from lapo@seanet.com) Received: from mx.seanet.com (mx.seanet.com [199.181.164.50]) by mx1.FreeBSD.org (Postfix) with ESMTP id DD08943D7E; Fri, 16 Dec 2005 16:10:52 +0000 (GMT) (envelope-from lapo@seanet.com) Received: from [199.181.168.92] (wallace.osd.com [199.181.168.92]) (authenticated bits=0) by milkyway.seanet.com (8.13.4/8.13.4) with ESMTP id jBGGAn9g047802; Fri, 16 Dec 2005 08:10:50 -0800 (PST) (envelope-from lapo@seanet.com) In-Reply-To: <20051216021759.GA14087@garage.freebsd.pl> References: <8B452D98-4FD5-4755-AB7F-31D278DF33F7@seanet.com> <20051216021759.GA14087@garage.freebsd.pl> Mime-Version: 1.0 (Apple Message framework v746.2) Content-Type: text/plain; charset=US-ASCII; delsp=yes; format=flowed Message-Id: <52A581CA-EC39-4C83-8C77-CB373F68D3FB@seanet.com> Content-Transfer-Encoding: 7bit From: Lapo Nustrini Date: Fri, 16 Dec 2005 08:10:51 -0800 To: Pawel Jakub Dawidek X-Mailer: Apple Mail (2.746.2) Cc: freebsd-geom@freebsd.org Subject: Re: gconcat X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 16 Dec 2005 16:11:04 -0000 On Dec 15, 2005, at 6:17 PM, Pawel Jakub Dawidek wrote: > On Thu, Dec 15, 2005 at 04:06:08PM -0800, Lapo Nustrini wrote: > +> > +> Can anyone tell me whether it is possible to expand a gconcat > volume (by adding a drive to the end of it) without having to wipe > the data from the existing set and recreate > +> from scratch? > +> I don't mind having to manually edit bsdlabels and such. Just > wondering if its possible at all. > +> I've been looking for some docs on this but can't seem to find a > definitive answer. > > It should just work be relabeling providers. > If you did something like: > > # gconcat label foo da0 da1 > > You can expand it with: > > # gconcat label foo da0 da1 da2 da3 > > etc. Just be sure the order of old providers is the same. > > PS. You'd need to stop device 'foo' first. > This is what I tried: # mount /dev/concat/gc0 /mnt # cp -pr ttt /mnt # ls -la /mnt total 8 drwxr-xr-x 4 root wheel 512 Dec 16 07:49 . drwxr-xr-x 25 root wheel 1024 Dec 15 15:02 .. drwxrwxr-x 2 root operator 512 Dec 16 07:48 .snap drwxr-xr-x 2 lapo wheel 512 Nov 9 22:48 ttt # umount /mnt # gconcat stop gc0 # gconcat label gc0 ad1 ad3 ad4 ad6 ad7 # mount /dev/concat/gc0 /mnt # ls -la ls: ttt: Bad file descriptor total 6 drwxr-xr-x 4 root wheel 512 Dec 16 07:49 . drwxr-xr-x 25 root wheel 1024 Dec 15 15:02 .. drwxrwxr-x 2 root operator 512 Dec 16 07:48 .snap Am I missing a step? Thanks! Lapo Nustrini From owner-freebsd-geom@FreeBSD.ORG Fri Dec 16 16:33:29 2005 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 8505916A41F for ; Fri, 16 Dec 2005 16:33:29 +0000 (GMT) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.FreeBSD.org (Postfix) with ESMTP id 8CB2743D53 for ; Fri, 16 Dec 2005 16:33:26 +0000 (GMT) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 644FF52B3F; Fri, 16 Dec 2005 17:33:24 +0100 (CET) Received: from localhost (pjd.wheel.pl [10.0.1.1]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id AC3C650F93; Fri, 16 Dec 2005 17:33:07 +0100 (CET) Date: Fri, 16 Dec 2005 17:32:17 +0100 From: Pawel Jakub Dawidek To: Lapo Nustrini Message-ID: <20051216163217.GC14985@garage.freebsd.pl> References: <8B452D98-4FD5-4755-AB7F-31D278DF33F7@seanet.com> <20051216021759.GA14087@garage.freebsd.pl> <52A581CA-EC39-4C83-8C77-CB373F68D3FB@seanet.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="vOmOzSkFvhd7u8Ms" Content-Disposition: inline In-Reply-To: <52A581CA-EC39-4C83-8C77-CB373F68D3FB@seanet.com> X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng/devel-r535 (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-5.9 required=3.0 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.0.4 Cc: freebsd-geom@freebsd.org Subject: Re: gconcat X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 16 Dec 2005 16:33:29 -0000 --vOmOzSkFvhd7u8Ms Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Dec 16, 2005 at 08:10:51AM -0800, Lapo Nustrini wrote: +>=20 +> On Dec 15, 2005, at 6:17 PM, Pawel Jakub Dawidek wrote: +>=20 +> >On Thu, Dec 15, 2005 at 04:06:08PM -0800, Lapo Nustrini wrote: +> >+> +> >+> Can anyone tell me whether it is possible to expand a gconcat volume= (by adding a drive to the end of it) without having to wipe the data from = the existing set and=20 +> >recreate +> >+> from scratch? +> >+> I don't mind having to manually edit bsdlabels and such. Just wonde= ring if its possible at all. +> >+> I've been looking for some docs on this but can't seem to find a def= initive answer. +> > +> >It should just work be relabeling providers. +> >If you did something like: +> > +> > # gconcat label foo da0 da1 +> > +> >You can expand it with: +> > +> > # gconcat label foo da0 da1 da2 da3 +> > +> >etc. Just be sure the order of old providers is the same. +> > +> >PS. You'd need to stop device 'foo' first. +> > +>=20 +> This is what I tried: +>=20 +> # mount /dev/concat/gc0 /mnt +> # cp -pr ttt /mnt +> # ls -la /mnt +> total 8 +> drwxr-xr-x 4 root wheel 512 Dec 16 07:49 . +> drwxr-xr-x 25 root wheel 1024 Dec 15 15:02 .. +> drwxrwxr-x 2 root operator 512 Dec 16 07:48 .snap +> drwxr-xr-x 2 lapo wheel 512 Nov 9 22:48 ttt +> # umount /mnt +> # gconcat stop gc0 +> # gconcat label gc0 ad1 ad3 ad4 ad6 ad7 +> # mount /dev/concat/gc0 /mnt +> # ls -la +> ls: ttt: Bad file descriptor +> total 6 +> drwxr-xr-x 4 root wheel 512 Dec 16 07:49 . +> drwxr-xr-x 25 root wheel 1024 Dec 15 15:02 .. +> drwxrwxr-x 2 root operator 512 Dec 16 07:48 .snap +>=20 +> Am I missing a step? +> Thanks! Are you sure you gave correct order? It works here just fine... What was the previous 'gconcat label' command you gave? --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --vOmOzSkFvhd7u8Ms Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.2 (FreeBSD) iD8DBQFDouwRForvXbEpPzQRAqlEAKDXFG5rCBDdJbLrx2WFCT+rfIjOmQCgtJTA eaoLso0t7hmcCrBP6CL3lHg= =6ab2 -----END PGP SIGNATURE----- --vOmOzSkFvhd7u8Ms-- From owner-freebsd-geom@FreeBSD.ORG Fri Dec 16 20:04:59 2005 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id A896C16A41F; Fri, 16 Dec 2005 20:04:59 +0000 (GMT) (envelope-from lapo@seanet.com) Received: from mx.seanet.com (mx.seanet.com [199.181.164.50]) by mx1.FreeBSD.org (Postfix) with ESMTP id 0378643D45; Fri, 16 Dec 2005 20:04:58 +0000 (GMT) (envelope-from lapo@seanet.com) Received: from [199.181.168.92] (wallace.osd.com [199.181.168.92]) (authenticated bits=0) by milkyway.seanet.com (8.13.4/8.13.4) with ESMTP id jBGK4wlK093544; Fri, 16 Dec 2005 12:04:58 -0800 (PST) (envelope-from lapo@seanet.com) In-Reply-To: <20051216163217.GC14985@garage.freebsd.pl> References: <8B452D98-4FD5-4755-AB7F-31D278DF33F7@seanet.com> <20051216021759.GA14087@garage.freebsd.pl> <52A581CA-EC39-4C83-8C77-CB373F68D3FB@seanet.com> <20051216163217.GC14985@garage.freebsd.pl> Mime-Version: 1.0 (Apple Message framework v746.2) Content-Type: text/plain; charset=US-ASCII; delsp=yes; format=flowed Message-Id: <0A47F650-AEDC-439D-B5D7-B3FA7C410DB1@seanet.com> Content-Transfer-Encoding: 7bit From: Lapo Nustrini Date: Fri, 16 Dec 2005 12:05:01 -0800 To: Pawel Jakub Dawidek X-Mailer: Apple Mail (2.746.2) Cc: freebsd-geom@freebsd.org Subject: Re: gconcat X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 16 Dec 2005 20:04:59 -0000 On Dec 16, 2005, at 8:32 AM, Pawel Jakub Dawidek wrote: > On Fri, Dec 16, 2005 at 08:10:51AM -0800, Lapo Nustrini wrote: > +> > +> On Dec 15, 2005, at 6:17 PM, Pawel Jakub Dawidek wrote: > +> > +> >On Thu, Dec 15, 2005 at 04:06:08PM -0800, Lapo Nustrini wrote: > +> >+> > +> >+> Can anyone tell me whether it is possible to expand a > gconcat volume (by adding a drive to the end of it) without having > to wipe the data from the existing set and recreate from scratch? > +> >+> I don't mind having to manually edit bsdlabels and such. > Just wondering if its possible at all. > +> >+> I've been looking for some docs on this but can't seem to > find a definitive answer. > +> > > +> >It should just work be relabeling providers. > +> >If you did something like: > +> > > +> > # gconcat label foo da0 da1 > +> > > +> >You can expand it with: > +> > > +> > # gconcat label foo da0 da1 da2 da3 > +> > > +> >etc. Just be sure the order of old providers is the same. > +> > > +> >PS. You'd need to stop device 'foo' first. > +> > > +> > +> This is what I tried: > +> > +> # mount /dev/concat/gc0 /mnt > +> # cp -pr ttt /mnt > +> # ls -la /mnt > +> total 8 > +> drwxr-xr-x 4 root wheel 512 Dec 16 07:49 . > +> drwxr-xr-x 25 root wheel 1024 Dec 15 15:02 .. > +> drwxrwxr-x 2 root operator 512 Dec 16 07:48 .snap > +> drwxr-xr-x 2 lapo wheel 512 Nov 9 22:48 ttt > +> # umount /mnt > +> # gconcat stop gc0 > +> # gconcat label gc0 ad1 ad3 ad4 ad6 ad7 > +> # mount /dev/concat/gc0 /mnt > +> # ls -la /mnt > +> ls: ttt: Bad file descriptor > +> total 6 > +> drwxr-xr-x 4 root wheel 512 Dec 16 07:49 . > +> drwxr-xr-x 25 root wheel 1024 Dec 15 15:02 .. > +> drwxrwxr-x 2 root operator 512 Dec 16 07:48 .snap > +> > +> Am I missing a step? > +> Thanks! > > Are you sure you gave correct order? It works here just fine... > What was the previous 'gconcat label' command you gave? > I was thought the previous command was, "#gconcat label gc0 ad1 ad3 ad4" However, to make sure I tried this again and it does indeed appear to work. I do have a further question. If I create a new volume with: #gconcat label gc0 ad1 ad3 Then place a file system on it: #newfs -U /dev/concat/gc0 And mount it, the output from "df" will be: /dev/concat/gc0 15135708 4 13924848 0% /mnt If I then umount and stop the gconcat volume, add aother drive to it with: #gconcat label gc0 ad1 ad3 ad5 I can't run newfs on it or I will lose any data, but the output of "df" will still only show: /dev/concat/gc0 15135708 4 13924848 0% /mnt Is there a way to tell the system the drive is now bigger? Should I be using bsdlabel / fdisk at some point? Thanks again, Lapo Nustrini From owner-freebsd-geom@FreeBSD.ORG Fri Dec 16 20:09:04 2005 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id DE8F716A41F; Fri, 16 Dec 2005 20:09:03 +0000 (GMT) (envelope-from anderson@centtech.com) Received: from mh2.centtech.com (moat3.centtech.com [207.200.51.50]) by mx1.FreeBSD.org (Postfix) with ESMTP id DED3543D66; Fri, 16 Dec 2005 20:08:59 +0000 (GMT) (envelope-from anderson@centtech.com) Received: from [192.168.42.22] (andersonbox2.centtech.com [192.168.42.22]) by mh2.centtech.com (8.13.1/8.13.1) with ESMTP id jBGK8wgx005396; Fri, 16 Dec 2005 14:08:58 -0600 (CST) (envelope-from anderson@centtech.com) Message-ID: <43A31ED9.9090005@centtech.com> Date: Fri, 16 Dec 2005 14:08:57 -0600 From: Eric Anderson User-Agent: Mozilla Thunderbird 1.0.7 (X11/20051204) X-Accept-Language: en-us, en MIME-Version: 1.0 To: Lapo Nustrini References: <8B452D98-4FD5-4755-AB7F-31D278DF33F7@seanet.com> <20051216021759.GA14087@garage.freebsd.pl> <52A581CA-EC39-4C83-8C77-CB373F68D3FB@seanet.com> <20051216163217.GC14985@garage.freebsd.pl> <0A47F650-AEDC-439D-B5D7-B3FA7C410DB1@seanet.com> In-Reply-To: <0A47F650-AEDC-439D-B5D7-B3FA7C410DB1@seanet.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV 0.87.1/1210/Thu Dec 15 09:23:22 2005 on mh2.centtech.com X-Virus-Status: Clean Cc: Pawel Jakub Dawidek , freebsd-geom@freebsd.org Subject: Re: gconcat X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 16 Dec 2005 20:09:04 -0000 Lapo Nustrini wrote: > On Dec 16, 2005, at 8:32 AM, Pawel Jakub Dawidek wrote: > >> On Fri, Dec 16, 2005 at 08:10:51AM -0800, Lapo Nustrini wrote: >> +> >> +> On Dec 15, 2005, at 6:17 PM, Pawel Jakub Dawidek wrote: >> +> >> +> >On Thu, Dec 15, 2005 at 04:06:08PM -0800, Lapo Nustrini wrote: >> +> >+> >> +> >+> Can anyone tell me whether it is possible to expand a gconcat >> volume (by adding a drive to the end of it) without having to wipe >> the data from the existing set and recreate from scratch? >> +> >+> I don't mind having to manually edit bsdlabels and such. >> Just wondering if its possible at all. >> +> >+> I've been looking for some docs on this but can't seem to >> find a definitive answer. >> +> > >> +> >It should just work be relabeling providers. >> +> >If you did something like: >> +> > >> +> > # gconcat label foo da0 da1 >> +> > >> +> >You can expand it with: >> +> > >> +> > # gconcat label foo da0 da1 da2 da3 >> +> > >> +> >etc. Just be sure the order of old providers is the same. >> +> > >> +> >PS. You'd need to stop device 'foo' first. >> +> > >> +> >> +> This is what I tried: >> +> >> +> # mount /dev/concat/gc0 /mnt >> +> # cp -pr ttt /mnt >> +> # ls -la /mnt >> +> total 8 >> +> drwxr-xr-x 4 root wheel 512 Dec 16 07:49 . >> +> drwxr-xr-x 25 root wheel 1024 Dec 15 15:02 .. >> +> drwxrwxr-x 2 root operator 512 Dec 16 07:48 .snap >> +> drwxr-xr-x 2 lapo wheel 512 Nov 9 22:48 ttt >> +> # umount /mnt >> +> # gconcat stop gc0 >> +> # gconcat label gc0 ad1 ad3 ad4 ad6 ad7 >> +> # mount /dev/concat/gc0 /mnt >> +> # ls -la /mnt >> +> ls: ttt: Bad file descriptor >> +> total 6 >> +> drwxr-xr-x 4 root wheel 512 Dec 16 07:49 . >> +> drwxr-xr-x 25 root wheel 1024 Dec 15 15:02 .. >> +> drwxrwxr-x 2 root operator 512 Dec 16 07:48 .snap >> +> >> +> Am I missing a step? >> +> Thanks! >> >> Are you sure you gave correct order? It works here just fine... >> What was the previous 'gconcat label' command you gave? >> > > I was thought the previous command was, "#gconcat label gc0 ad1 ad3 > ad4" > However, to make sure I tried this again and it does indeed appear to > work. > I do have a further question. > If I create a new volume with: > #gconcat label gc0 ad1 ad3 > Then place a file system on it: > #newfs -U /dev/concat/gc0 > And mount it, the output from "df" will be: > /dev/concat/gc0 15135708 4 13924848 0% /mnt > > If I then umount and stop the gconcat volume, add aother drive to it > with: > #gconcat label gc0 ad1 ad3 ad5 > I can't run newfs on it or I will lose any data, but the output of > "df" will still only show: > /dev/concat/gc0 15135708 4 13924848 0% /mnt > > Is there a way to tell the system the drive is now bigger? Should I > be using bsdlabel / fdisk at some point? You can use growfs to do that. Eric -- ------------------------------------------------------------------------ Eric Anderson Sr. Systems Administrator Centaur Technology Anything that works is better than anything that doesn't. ------------------------------------------------------------------------