From owner-freebsd-geom@FreeBSD.ORG Sun Jun 22 05:52:37 2008 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 38BE41065672 for ; Sun, 22 Jun 2008 05:52:37 +0000 (UTC) (envelope-from hywel@hmallett.co.uk) Received: from lisbon.directrouter.com (lisbon.directrouter.com [72.249.30.130]) by mx1.freebsd.org (Postfix) with ESMTP id 2A1D98FC1D for ; Sun, 22 Jun 2008 05:52:36 +0000 (UTC) (envelope-from hywel@hmallett.co.uk) Received: from hmallett.plus.com ([81.174.158.104] helo=[192.168.0.64]) by lisbon.directrouter.com with esmtpa (Exim 4.69) (envelope-from ) id 1KACtQ-0006F9-Oh for freebsd-geom@freebsd.org; Sat, 21 Jun 2008 18:53:23 -0500 Message-Id: <0A8C1986-1DC1-4445-9111-0DEDBBCC6847@hmallett.co.uk> From: Hywel Mallett To: freebsd-geom@freebsd.org Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v924) Date: Sun, 22 Jun 2008 00:53:15 +0100 X-Mailer: Apple Mail (2.924) X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - lisbon.directrouter.com X-AntiAbuse: Original Domain - freebsd.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - hmallett.co.uk X-Source: X-Source-Args: X-Source-Dir: Subject: Filesystem replication geom proposal X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 22 Jun 2008 05:52:37 -0000 FreeBSD doesn't have a defined method of replicating data between two servers, for HA/DR purposes, similar to Veritas Volume Replicator. Linux has DRDB (http://www.drbd.org/) which isn't quite the same, and someone has tried using gmirror and ggate to have a mirror across teo systems, but neither of those can cope well with a disconnected network, or a slow network link. I was wondering if there would be any interest in creating a new geom provider to solve this problem. I can see that questions about this functionality have been asked on the mailing lists before, and I've drawn up some initial thoughts aand ideas at http://www.hmallett.co.uk/computing-mainmenu-49/72-computing/124-open-source-replicated-filesystems.html Hywel Mallett From owner-freebsd-geom@FreeBSD.ORG Sun Jun 22 07:34:10 2008 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B72641065677 for ; Sun, 22 Jun 2008 07:34:10 +0000 (UTC) (envelope-from phk@critter.freebsd.dk) Received: from phk.freebsd.dk (phk.freebsd.dk [130.225.244.222]) by mx1.freebsd.org (Postfix) with ESMTP id 8CF088FC18 for ; Sun, 22 Jun 2008 07:34:10 +0000 (UTC) (envelope-from phk@critter.freebsd.dk) Received: from critter.freebsd.dk (unknown [192.168.64.3]) by phk.freebsd.dk (Postfix) with ESMTP id AD2E6170E4; Sun, 22 Jun 2008 07:34:08 +0000 (UTC) Received: from critter.freebsd.dk (localhost [127.0.0.1]) by critter.freebsd.dk (8.14.2/8.14.2) with ESMTP id m5M7Y7q6001392; Sun, 22 Jun 2008 07:34:07 GMT (envelope-from phk@critter.freebsd.dk) To: Hywel Mallett From: "Poul-Henning Kamp" In-Reply-To: Your message of "Sun, 22 Jun 2008 00:53:15 +0100." <0A8C1986-1DC1-4445-9111-0DEDBBCC6847@hmallett.co.uk> Date: Sun, 22 Jun 2008 07:34:07 +0000 Message-ID: <1391.1214120047@critter.freebsd.dk> Sender: phk@critter.freebsd.dk Cc: freebsd-geom@freebsd.org Subject: Re: Filesystem replication geom proposal X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 22 Jun 2008 07:34:10 -0000 In message <0A8C1986-1DC1-4445-9111-0DEDBBCC6847@hmallett.co.uk>, Hywel Mallett writes: >FreeBSD doesn't have a defined method of replicating data between two >servers, for HA/DR purposes, [...] >I was wondering if there would be any interest in creating a new geom >provider to solve this problem. Go for it! -- Poul-Henning Kamp | UNIX since Zilog Zeus 3.20 phk@FreeBSD.ORG | TCP/IP since RFC 956 FreeBSD committer | BSD since 4.3-tahoe Never attribute to malice what can adequately be explained by incompetence. From owner-freebsd-geom@FreeBSD.ORG Sun Jun 22 19:08:32 2008 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 66949106567D for ; Sun, 22 Jun 2008 19:08:32 +0000 (UTC) (envelope-from gcubfg-freebsd-geom@m.gmane.org) Received: from ciao.gmane.org (main.gmane.org [80.91.229.2]) by mx1.freebsd.org (Postfix) with ESMTP id E912C8FC17 for ; Sun, 22 Jun 2008 19:08:31 +0000 (UTC) (envelope-from gcubfg-freebsd-geom@m.gmane.org) Received: from list by ciao.gmane.org with local (Exim 4.43) id 1KATpw-0004gF-KP for freebsd-geom@freebsd.org; Sun, 22 Jun 2008 17:58:48 +0000 Received: from 78-0-84-134.adsl.net.t-com.hr ([78.0.84.134]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Sun, 22 Jun 2008 17:58:48 +0000 Received: from ivoras by 78-0-84-134.adsl.net.t-com.hr with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Sun, 22 Jun 2008 17:58:48 +0000 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-geom@freebsd.org From: Ivan Voras Date: Sun, 22 Jun 2008 19:58:34 +0200 Lines: 66 Message-ID: References: <0A8C1986-1DC1-4445-9111-0DEDBBCC6847@hmallett.co.uk> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig1504CD62C27849ABF1105167" X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: 78-0-84-134.adsl.net.t-com.hr User-Agent: Thunderbird 2.0.0.14 (Windows/20080421) In-Reply-To: <0A8C1986-1DC1-4445-9111-0DEDBBCC6847@hmallett.co.uk> X-Enigmail-Version: 0.95.6 Sender: news Subject: Re: Filesystem replication geom proposal X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 22 Jun 2008 19:08:32 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig1504CD62C27849ABF1105167 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: quoted-printable Hywel Mallett wrote: > FreeBSD doesn't have a defined method of replicating data between two=20 > servers, for HA/DR purposes, similar to Veritas Volume Replicator. Linu= x=20 > has DRDB (http://www.drbd.org/) which isn't quite the same, and someone= =20 > has tried using gmirror and ggate to have a mirror across teo systems, = > but neither of those can cope well with a disconnected network, or a=20 > slow network link. > I was wondering if there would be any interest in creating a new geom=20 > provider to solve this problem. I can see that questions about this=20 > functionality have been asked on the mailing lists before, and I've=20 > drawn up some initial thoughts aand ideas at=20 > http://www.hmallett.co.uk/computing-mainmenu-49/72-computing/124-open-s= ource-replicated-filesystems.html=20 Hmmm. If I understand your proposal, you want to create IO journals on=20 both the master and the slave, then replicate journal data from the=20 master to the slave, then replay the journal on the slave? This looks=20 like a lot of work for something that looks like it could be implemented = by a linked list in the kernel (to achieve aynchronous operation). The DCM looks like an alternative to the above "transactional" method of = replication - it looks like instead of asynchronously replaying the=20 transaction log, you constantly replicate the DCM to the slave (or at=20 least the changed bits), and then the slave asks the server to send the=20 blocks corresponding to what's marked as changed in the DCM, right? Regarding swapping the master/slave roles: I think you need a fsck step=20 somewhere in there, or the same tricks gjournal uses (hooks into UFS)=20 since the file system will be marked dirty if you suddenly stop using=20 it. Also, to manually force the failover, the master needs to umount the = file system, probably with "-f". Will it work? Of course, if you think the things you proposed will solve reliable=20 replication of data across the network, go ahead :) But since=20 ggate+gmirror has already tried to solve this, maybe you'd be interested = in increasing their reliability, as an exercise before trying something=20 from scratch? --------------enig1504CD62C27849ABF1105167 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFIXpLKldnAQVacBcgRAkDWAKCVLdvBBvhXKnCu227t/Rzk9tg6FwCgphKI Kvu6ziF/NbwjFq7juqW/p1s= =5KG3 -----END PGP SIGNATURE----- --------------enig1504CD62C27849ABF1105167-- From owner-freebsd-geom@FreeBSD.ORG Sun Jun 22 22:36:41 2008 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A5F201065674 for ; Sun, 22 Jun 2008 22:36:41 +0000 (UTC) (envelope-from hywel@hmallett.co.uk) Received: from lisbon.directrouter.com (lisbon.directrouter.com [72.249.30.130]) by mx1.freebsd.org (Postfix) with ESMTP id 76A228FC13 for ; Sun, 22 Jun 2008 22:36:41 +0000 (UTC) (envelope-from hywel@hmallett.co.uk) Received: from localhost ([127.0.0.1]) by lisbon.directrouter.com with esmtpa (Exim 4.69) (envelope-from ) id 1KAYAo-0006LM-Gn; Sun, 22 Jun 2008 17:36:38 -0500 Received: from 81.174.158.104 ([81.174.158.104]) by www.hmallett.co.uk (Horde MIME library) with HTTP; Sun, 22 Jun 2008 23:36:38 +0100 Message-ID: <20080622233638.4hclgmsw8408s4cg@www.hmallett.co.uk> Date: Sun, 22 Jun 2008 23:36:38 +0100 From: hywel@hmallett.co.uk To: Ivan Voras References: <0A8C1986-1DC1-4445-9111-0DEDBBCC6847@hmallett.co.uk> In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8; DelSp="Yes"; format="flowed" Content-Disposition: inline Content-Transfer-Encoding: quoted-printable User-Agent: Internet Messaging Program (IMP) H3 (4.1.6) X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - lisbon.directrouter.com X-AntiAbuse: Original Domain - freebsd.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - hmallett.co.uk X-Source: X-Source-Args: X-Source-Dir: Cc: freebsd-geom@freebsd.org Subject: Re: Filesystem replication geom proposal X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 22 Jun 2008 22:36:41 -0000 Quoting Ivan Voras : > Hmmm. If I understand your proposal, you want to create IO journals on > both the master and the slave, then replicate journal data from the > master to the slave, then replay the journal on the slave? That's about the size of it. > This looks > like a lot of work for something that looks like it could be > implemented by a linked list in the kernel (to achieve aynchronous > operation). I don't know about that... > The DCM looks like an alternative to the above "transactional" method > of replication - it looks like instead of asynchronously replaying the > transaction log, you constantly replicate the DCM to the slave (or at > least the changed bits), and then the slave asks the server to send the > blocks corresponding to what's marked as changed in the DCM, right? The DCM only gets used during initial synchronisation, or when the =20 outstanding transactions have overflowed the log (which is a bad =20 thing), so the DCM gets little used, and only when the slave is =20 inconsistent. > Regarding swapping the master/slave roles: I think you need a fsck step > somewhere in there, or the same tricks gjournal uses (hooks into UFS) > since the file system will be marked dirty if you suddenly stop using > it. Also, to manually force the failover, the master needs to umount > the file system, probably with "-f". Will it work? I would agree with all that. I haven't looked into the UFS hooks used =20 by gjournal in any depth, so will investigate more. > Of course, if you think the things you proposed will solve reliable > replication of data across the network, go ahead :) But since > ggate+gmirror has already tried to solve this, maybe you'd be > interested in increasing their reliability, as an exercise before > trying something from scratch? I certainly agree that there's no point in reinventing the wheel, =20 however I don't see how gmirror, without major changes, can work in a =20 way that can cope with a disconnected network and maintain data =20 consistency when the network is reconnected. As a result of your comments I've added some more details to the =20 original article. --=20 Hywel Mallett From owner-freebsd-geom@FreeBSD.ORG Mon Jun 23 11:06:54 2008 Return-Path: Delivered-To: freebsd-geom@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 89AFE1065672 for ; Mon, 23 Jun 2008 11:06:54 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id 7840E8FC23 for ; Mon, 23 Jun 2008 11:06:54 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.2/8.14.2) with ESMTP id m5NB6sN3064961 for ; Mon, 23 Jun 2008 11:06:54 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.2/8.14.1/Submit) id m5NB6rlW064957 for freebsd-geom@FreeBSD.org; Mon, 23 Jun 2008 11:06:53 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 23 Jun 2008 11:06:53 GMT Message-Id: <200806231106.m5NB6rlW064957@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-geom@FreeBSD.org Cc: Subject: Current problem reports assigned to freebsd-geom@FreeBSD.org X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Jun 2008 11:06:54 -0000 Current FreeBSD problem reports Critical problems Serious problems S Tracker Resp. Description -------------------------------------------------------------------------------- s kern/73177 geom kldload geom_* causes panic due to memory exhaustion o kern/84556 geom [geom] GBDE-encrypted swap causes panic at shutdown o kern/87544 geom [gbde] mmaping large files on a gbde filesystem deadlo s kern/89102 geom [geom] [panic] panic when forced unmount FS from unplu o kern/89546 geom [geom] GEOM error a kern/89660 geom [vinum] [patch] [panic] due to g_malloc returning null o bin/90093 geom fdisk(8) incapable of altering in-core geometry o kern/90582 geom [geom] [panic] Restore cause panic string (ffs_blkfree o kern/98034 geom [geom] dereference of NULL pointer in acd_geom_detach o kern/104389 geom [geom] [patch] sys/geom/geom_dump.c doesn't encode XML o kern/113419 geom [geom] geom fox multipathing not failing back o kern/113957 geom [gmirror] gmirror is intermittently reporting a degrad o kern/115572 geom [gbde] [patch] gbde partitions fail at 28bit/48bit LBA o kern/120021 geom net-p2p/qbittorrent crashes system when it works thoug o kern/120231 geom [geom] GEOM_CONCAT error adding second drive o kern/121364 geom [gmirror] Removing all providers create a "zombie" mir o kern/122067 geom [panic]: Geom crashed during boot f kern/122415 geom [geom] UFS labels are being constantly created and rem o kern/123122 geom GEOM / gjournal kernel lock o kern/123962 geom [panic] gjournal(8): gjournal (455Gb data, 8Gb journal o kern/124130 geom [gmirror][usb] gmirror fails to start usb devices that o kern/124294 geom [geom] gmirror(8) have inappropriate logic when workin 22 problems total. Non-critical problems S Tracker Resp. Description -------------------------------------------------------------------------------- o bin/78131 geom gbde(8) "destroy" not working. o kern/79035 geom [vinum] gvinum unable to create a striped set of mirro o kern/79251 geom [2TB] newfs fails on 2.6TB gbde device o kern/94632 geom [geom] Kernel output resets input while GELI asks for o kern/107707 geom [geom] [patch] [request] add new class geom_xbox360 to p bin/110705 geom gmirror(8) control utility does not exit with correct o kern/113837 geom [geom] unable to access 1024 sector size storage o kern/113885 geom [gmirror] [patch] improved gmirror balance algorithm o kern/114532 geom [geom] GEOM_MIRROR shows up in kldstat even if compile f kern/115547 geom [geom] [patch] [request] let GEOM Eli get password fro o kern/119743 geom [geom] geom label for cds is keeped after dismount and o kern/120044 geom [msdosfs] [geom] incorrect MSDOSFS label fries adminis o kern/121559 geom [patch] [geom] geom label class allows to create inacc f kern/121907 geom [request] [geom] geom output to console obscures other o kern/123630 geom [patch] [gmirror] gmirror doesnt allow the original dr o misc/124434 geom [UPDATING] [patch]: Missing UPDATING entry for geom mi 16 problems total. From owner-freebsd-geom@FreeBSD.ORG Mon Jun 23 11:27:43 2008 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 909251065680 for ; Mon, 23 Jun 2008 11:27:43 +0000 (UTC) (envelope-from andrea@ragedrecords.com) Received: from carota.brancatelli.it (brancatelli.it [84.233.228.130]) by mx1.freebsd.org (Postfix) with ESMTP id 1A3728FC26 for ; Mon, 23 Jun 2008 11:27:42 +0000 (UTC) (envelope-from andrea@ragedrecords.com) Received: from webmail.ragedrecords.com (localhost.brancatelli.it [IPv6:::1]) by carota.brancatelli.it (8.13.8/8.13.8) with SMTP id m5NB8xxI053675 for ; Mon, 23 Jun 2008 13:08:59 +0200 (CEST) (envelope-from andrea@ragedrecords.com) Received: from 217.133.85.183 (auth. user andrea@ragedrecords.com@localhost) by webmail.ragedrecords.com with HTTP; Mon, 23 Jun 2008 12:08:59 +0100 To: "freebsd-geom@freebsd.org" Date: Mon, 23 Jun 2008 12:08:59 +0100 X-Mailer: IlohaMail/0.8.14 (On: webmail.ragedrecords.com) Message-ID: In-Reply-To: <722jk9fo.1214219192.4360070.andrea@ragedrecords.com> From: "Andrea Brancatelli" Bounce-To: "Andrea Brancatelli" Errors-To: "Andrea Brancatelli" MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Spam-Status: No, score=-4.4 required=4.0 tests=ALL_TRUSTED,BAYES_00, DK_POLICY_SIGNSOME autolearn=ham version=3.1.8 X-Spam-Checker-Version: SpamAssassin 3.1.8 (2007-02-13) on carota.brancatelli.it Subject: Re: GMirror problem updating from FreeBSD 6.2 to 7.0 X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Jun 2008 11:27:43 -0000 Sorry, my finger slippend on the send button, I'm continuing down below: On 6/23/2008, "Andrea Brancatelli" wrote: [.....] >What should I do? Maybe write a new bsdlabel and hope it matches the >previous one (it should as I think) Should I try to restart the old 6.2 installation and see if it can see the mirror? Maybe I should try to mount the partition directly bypassing the mirror? Thank you very much for your help, the situation's pretty much critical... Andrea From owner-freebsd-geom@FreeBSD.ORG Mon Jun 23 11:27:44 2008 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A058C106567A for ; Mon, 23 Jun 2008 11:27:44 +0000 (UTC) (envelope-from andrea@ragedrecords.com) Received: from carota.brancatelli.it (brancatelli.it [84.233.228.130]) by mx1.freebsd.org (Postfix) with ESMTP id 2B29A8FC25 for ; Mon, 23 Jun 2008 11:27:43 +0000 (UTC) (envelope-from andrea@ragedrecords.com) Received: from webmail.ragedrecords.com (localhost.brancatelli.it [IPv6:::1]) by carota.brancatelli.it (8.13.8/8.13.8) with SMTP id m5NB6WUn053625 for ; Mon, 23 Jun 2008 13:06:32 +0200 (CEST) (envelope-from andrea@ragedrecords.com) Received: from 217.133.85.183 (auth. user andrea@ragedrecords.com@localhost) by webmail.ragedrecords.com with HTTP; Mon, 23 Jun 2008 12:06:32 +0100 To: freebsd-geom@freebsd.org Date: Mon, 23 Jun 2008 12:06:32 +0100 X-Mailer: IlohaMail/0.8.14 (On: webmail.ragedrecords.com) Message-ID: <722jk9fo.1214219192.4360070.andrea@ragedrecords.com> From: "Andrea Brancatelli" Bounce-To: "Andrea Brancatelli" Errors-To: "Andrea Brancatelli" MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Spam-Status: No, score=-4.4 required=4.0 tests=ALL_TRUSTED,BAYES_00, DK_POLICY_SIGNSOME autolearn=ham version=3.1.8 X-Spam-Checker-Version: SpamAssassin 3.1.8 (2007-02-13) on carota.brancatelli.it Subject: GMirror problem updating from FreeBSD 6.2 to 7.0 X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Jun 2008 11:27:44 -0000 Hello everybody. I have a problem with GMirror that maybe you can help me to solve. I had a FreeBSD 6.2 machine running ok for about an year with a couple of mirrors in it. One was named Maxtor and coupled, guess what, a pair of Maxtor HD. They both contained a single parition that was mounted, guess again, under /Maxtor :) What I did was shutdown the 6.2 machine pop in a new HD and put FreeBSD 7.0 over it. Everything went OK, I even mirrored the boot drive. Then I replugged the Maxtor HardDrives and powered on the machine. The Maxtor mirror appeared in /dev/mirror but there was nothing else, I mean, just /dev/Maxtor, no /dev/Maxtors1 or anything else. I gave a quick look at dmesg and found that when it found the mirror he updated the metadata from V3 to V4. I thought that maybe of this the machine didn't reread the drive after updating the metadata. So I went for the easy way and rebooted the machine. After the reboot something else appeared: I had both /dev/Maxtor and /dev/Maxtors1. The only problem is that no matter what I cannot read the bsd label out of it. No /dev/Maxtors1a in any way. bdslabel /dev/Maxtors1 doesn't report anything significant, I think he doesn't find any bsdlabel, but I wouldn't know how. So I freezed as the mirror contains very important data that i really don't wanna loose. And before you ask, no, I don't have tape backups or anything as I tought a mirror would be a safely-enough storage. What should I do? Maybe write a new bsdlabel and hope it matches the previous one (it should as I think From owner-freebsd-geom@FreeBSD.ORG Mon Jun 23 19:15:38 2008 Return-Path: Delivered-To: freebsd-geom@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 69583106567E; Mon, 23 Jun 2008 19:15:38 +0000 (UTC) (envelope-from gavin@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id 3A10C8FC0A; Mon, 23 Jun 2008 19:15:38 +0000 (UTC) (envelope-from gavin@FreeBSD.org) Received: from freefall.freebsd.org (gavin@localhost [127.0.0.1]) by freefall.freebsd.org (8.14.2/8.14.2) with ESMTP id m5NJFcJP055240; Mon, 23 Jun 2008 19:15:38 GMT (envelope-from gavin@freefall.freebsd.org) Received: (from gavin@localhost) by freefall.freebsd.org (8.14.2/8.14.1/Submit) id m5NJFcpH055236; Mon, 23 Jun 2008 19:15:38 GMT (envelope-from gavin) Date: Mon, 23 Jun 2008 19:15:38 GMT Message-Id: <200806231915.m5NJFcpH055236@freefall.freebsd.org> To: gbradley@rocketmail.com, gavin@FreeBSD.org, freebsd-geom@FreeBSD.org From: gavin@FreeBSD.org Cc: Subject: Re: kern/115572: [gbde] [patch] gbde partitions fail at 28bit/48bit LBA addressing boundary X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Jun 2008 19:15:38 -0000 Synopsis: [gbde] [patch] gbde partitions fail at 28bit/48bit LBA addressing boundary State-Changed-From-To: open->closed State-Changed-By: gavin State-Changed-When: Mon Jun 23 19:14:13 UTC 2008 State-Changed-Why: Close, this is fixed in 6.3 and 7.0 with the commits mentioned in the audit log. http://www.freebsd.org/cgi/query-pr.cgi?pr=115572 From owner-freebsd-geom@FreeBSD.ORG Wed Jun 25 05:26:52 2008 Return-Path: Delivered-To: freebsd-geom@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 081B61065670; Wed, 25 Jun 2008 05:26:52 +0000 (UTC) (envelope-from linimon@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id AC1028FC12; Wed, 25 Jun 2008 05:26:51 +0000 (UTC) (envelope-from linimon@FreeBSD.org) Received: from freefall.freebsd.org (linimon@localhost [127.0.0.1]) by freefall.freebsd.org (8.14.2/8.14.2) with ESMTP id m5P5Qp23054485; Wed, 25 Jun 2008 05:26:51 GMT (envelope-from linimon@freefall.freebsd.org) Received: (from linimon@localhost) by freefall.freebsd.org (8.14.2/8.14.1/Submit) id m5P5QpW5054481; Wed, 25 Jun 2008 05:26:51 GMT (envelope-from linimon) Date: Wed, 25 Jun 2008 05:26:51 GMT Message-Id: <200806250526.m5P5QpW5054481@freefall.freebsd.org> To: linimon@FreeBSD.org, freebsd-bugs@FreeBSD.org, freebsd-geom@FreeBSD.org From: linimon@FreeBSD.org Cc: Subject: Re: kern/124969: gvinum(8): gvinum raid5 plex does not detect missing subdisk X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 25 Jun 2008 05:26:52 -0000 Old Synopsis: gvinum raid5 plex does not detect missing subdisk New Synopsis: gvinum(8): gvinum raid5 plex does not detect missing subdisk Responsible-Changed-From-To: freebsd-bugs->freebsd-geom Responsible-Changed-By: linimon Responsible-Changed-When: Wed Jun 25 05:25:24 UTC 2008 Responsible-Changed-Why: Over to maintainer(s). http://www.freebsd.org/cgi/query-pr.cgi?pr=124969 From owner-freebsd-geom@FreeBSD.ORG Wed Jun 25 13:10:16 2008 Return-Path: Delivered-To: freebsd-geom@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id F107A1065671; Wed, 25 Jun 2008 13:10:16 +0000 (UTC) (envelope-from gavin@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id CEC858FC1E; Wed, 25 Jun 2008 13:10:16 +0000 (UTC) (envelope-from gavin@FreeBSD.org) Received: from freefall.freebsd.org (gavin@localhost [127.0.0.1]) by freefall.freebsd.org (8.14.2/8.14.2) with ESMTP id m5PDAGPm063725; Wed, 25 Jun 2008 13:10:16 GMT (envelope-from gavin@freefall.freebsd.org) Received: (from gavin@localhost) by freefall.freebsd.org (8.14.2/8.14.1/Submit) id m5PDAGjm063721; Wed, 25 Jun 2008 13:10:16 GMT (envelope-from gavin) Date: Wed, 25 Jun 2008 13:10:16 GMT Message-Id: <200806251310.m5PDAGjm063721@freefall.freebsd.org> To: gavin@FreeBSD.org, freebsd-bugs@FreeBSD.org, freebsd-geom@FreeBSD.org From: gavin@FreeBSD.org Cc: Subject: Re: kern/124973: [gjournal] [patch] boot order affects geom_journal consumers selection X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 25 Jun 2008 13:10:17 -0000 Old Synopsis: boot order affects geom_journal consumers selection New Synopsis: [gjournal] [patch] boot order affects geom_journal consumers selection Responsible-Changed-From-To: freebsd-bugs->freebsd-geom Responsible-Changed-By: gavin Responsible-Changed-When: Wed Jun 25 13:08:18 UTC 2008 Responsible-Changed-Why: Over to maintainer(s). Although there is a patch in the PR, I think it is more of a workaround than the actual fix, so passing it to -geom rather than -rc. http://www.freebsd.org/cgi/query-pr.cgi?pr=124973 From owner-freebsd-geom@FreeBSD.ORG Wed Jun 25 19:50:05 2008 Return-Path: Delivered-To: freebsd-geom@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 3B7141065672 for ; Wed, 25 Jun 2008 19:50:05 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id 2E8AE8FC2D for ; Wed, 25 Jun 2008 19:50:05 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (gnats@localhost [127.0.0.1]) by freefall.freebsd.org (8.14.2/8.14.2) with ESMTP id m5PJo4SX024330 for ; Wed, 25 Jun 2008 19:50:04 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.2/8.14.1/Submit) id m5PJo4gf024329; Wed, 25 Jun 2008 19:50:04 GMT (envelope-from gnats) Date: Wed, 25 Jun 2008 19:50:04 GMT Message-Id: <200806251950.m5PJo4gf024329@freefall.freebsd.org> To: freebsd-geom@FreeBSD.org From: lulf@stud.ntnu.no Cc: Subject: Re: misc/124969: gvinum raid5 plex does not detect missing subdisk X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: lulf@stud.ntnu.no List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 25 Jun 2008 19:50:05 -0000 The following reply was made to PR kern/124969; it has been noted by GNATS. From: lulf@stud.ntnu.no To: Dan Ports Cc: freebsd-gnats-submit@FreeBSD.org Subject: Re: misc/124969: gvinum raid5 plex does not detect missing subdisk Date: Wed, 25 Jun 2008 21:42:06 +0200 Siterer Dan Ports : > >> Number: 124969 >> Category: misc >> Synopsis: gvinum raid5 plex does not detect missing subdisk >> Confidential: no >> Severity: serious >> Priority: medium >> Responsible: freebsd-bugs >> State: open >> Quarter: >> Keywords: >> Date-Required: >> Class: sw-bug >> Submitter-Id: current-users >> Arrival-Date: Wed Jun 25 01:30:01 UTC 2008 >> Closed-Date: >> Last-Modified: >> Originator: Dan Ports >> Release: 6.3-STABLE >> Organization: >> Environment: > FreeBSD clamshell.ambulatoryclam.net 6.3-STABLE FreeBSD 6.3-STABLE =20 > #4: Sat Jun 14 10:05:12 PDT 2008 =20 > root@clamshell.ambulatoryclam.net:/usr/obj/usr/src/sys/CLAMSHELL i386 >> Description: > I am using gvinum to create a RAID 5 array with three drives (i.e. a =20 > single raid5 plex with three subdisks). Recently, one drive failed. =20 > When the drive failed (but was present on boot), the array =20 > continues to work fine, albeit degraded, as one would expect. =20 > However, with the drive removed, gvinum does not properly detect =20 > the plex's configuration on boot: > > 2 drives: > D b State: up /dev/ad11s1d A: 0/474891 MB (0%= ) > D a State: up /dev/ad10s1d A: 0/474891 MB (0%= ) > > 1 volume: > V space State: up Plexes: 1 Size: 463 G= B > > 1 plex: > P space.p0 R5 State: degraded Subdisks: 2 Size: 463 G= B > > 3 subdisks: > S space.p0.s2 State: down D: c Size: 463 G= B > S space.p0.s1 State: up D: b Size: 463 G= B > S space.p0.s0 State: up D: a Size: 463 G= B > > Note that space.p0 has a capacity of 463 GB, the size of the drive, =20 > when it should be twice that. It seems as though the plex isn't =20 > aware that the downed subdisk ever existed. As a result, the volume =20 > is up, but its data is not valid. > > It seems a rather alarming flaw that a RAID 5 array fails to work =20 > correctly when one drive is not present! >> How-To-Repeat: > Create a gvinum raid5 plex with three subdisks, then remove the =20 > drive corresponding to one of them. >> Fix: > No fix, but the following thread appears to be describing the same =20 > problem, and includes an analysis. However, the problem appears to =20 > still exist. (I'm running 6.3-STABLE, and haven't tried either =20 > 7-STABLE or -CURRENT, but a cursory examination of the cvs history =20 > provides no indication that the problem has been fixed in other =20 > branches.) > > http://lists.freebsd.org/pipermail/freebsd-geom/2007-March/002109.html > > I'm willing to poke at this problem a bit more, but am probably the =20 > wrong person to do so since I currently have neither the time nor =20 > any geom experience. > >> Release-Note: >> Audit-Trail: >> Unformatted: > _______________________________________________ > freebsd-bugs@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-bugs > To unsubscribe, send any mail to "freebsd-bugs-unsubscribe@freebsd.org" > > This is a known issue, and I've fixed it in patches that are pending review (for a few months now... ;). If it's very critical for you right now, I can create a patch for you, and request a commit for it, but as there are some gvinum restructuring I'd like to get into the tree, I'd rather not fix the same issues twice. but I agree this is a special case, so I'll try get out a fix soon. I'm sorry for the inconvenience. --=20 Ulf Lilleengen From owner-freebsd-geom@FreeBSD.ORG Thu Jun 26 04:58:44 2008 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id EE721106567F for ; Thu, 26 Jun 2008 04:58:44 +0000 (UTC) (envelope-from haet.stars@gmail.com) Received: from qb-out-0506.google.com (qb-out-0506.google.com [72.14.204.227]) by mx1.freebsd.org (Postfix) with ESMTP id 9D6F48FC1B for ; Thu, 26 Jun 2008 04:58:44 +0000 (UTC) (envelope-from haet.stars@gmail.com) Received: by qb-out-0506.google.com with SMTP id f10so9208103qba.13 for ; Wed, 25 Jun 2008 21:58:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:mime-version:content-type; bh=Gp2EohiK8kK0O7YpklbTd2MOskzd9UV5kMc2UJm3ZMo=; b=GQzxzVFfJ9bFIwl/jr8e2iRyb8LfbTvNIWGVIl4HlxeVIeR92MgY0y8HiSid0M+O8Q iQZv8sCtcJact40+U9Auv968rFGfKuakMYmC08sMaOJ2BHqwxJBRFZSjzp/3khuH6+AD oaTHeDLugJeZ1OqrokaN1NyvqIZqEQZWtjRSc= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:mime-version:content-type; b=QHoRymdiigWeXo1WMQh6/KS/Q4g4nDHFL4WYP3+Xg1tdw9rYBwoH4Ft8ntqd37a93y psTlN0u4iei/Vsgbe/UeTQOC/4WqzvzoOchYkRnxseCxwjBrWS1G3jscrBaZjFOb1+Z8 h2rAikcsYFdGpFBnAf5HppjZ2DNjJD2T40FN0= Received: by 10.115.106.7 with SMTP id i7mr6730319wam.131.1214455430005; Wed, 25 Jun 2008 21:43:50 -0700 (PDT) Received: by 10.114.57.20 with HTTP; Wed, 25 Jun 2008 21:43:49 -0700 (PDT) Message-ID: Date: Wed, 25 Jun 2008 21:43:49 -0700 From: "Stars butts" To: freebsd-geom@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: geom_eli passphrase prompt unresponsive at boot after recompiling kernel without kbdmux X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 26 Jun 2008 04:58:45 -0000 hai, I recently installed FreeBSD 6.2 onto a geli encrypted disk with the /boot partition on a usb thumbdrive, after compiling the kernel without the kbdmux driver. however, my usb keyboard is completely unresponsive during bootup, and when the prompt to enter my geli passphrase comes up I cannot enter it. I have tried with several different keyboards and it worked on the previous non-geli install. Any thoughts? From owner-freebsd-geom@FreeBSD.ORG Fri Jun 27 13:30:06 2008 Return-Path: Delivered-To: freebsd-geom@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 708DA1065681; Fri, 27 Jun 2008 13:30:06 +0000 (UTC) (envelope-from gavin@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id 4FF2C8FC21; Fri, 27 Jun 2008 13:29:00 +0000 (UTC) (envelope-from gavin@FreeBSD.org) Received: from freefall.freebsd.org (gavin@localhost [127.0.0.1]) by freefall.freebsd.org (8.14.2/8.14.2) with ESMTP id m5RDSxHB034252; Fri, 27 Jun 2008 13:28:59 GMT (envelope-from gavin@freefall.freebsd.org) Received: (from gavin@localhost) by freefall.freebsd.org (8.14.2/8.14.1/Submit) id m5RDRrva034240; Fri, 27 Jun 2008 13:27:53 GMT (envelope-from gavin) Date: Fri, 27 Jun 2008 13:27:53 GMT Message-Id: <200806271327.m5RDRrva034240@freefall.freebsd.org> To: mdh@solitox.net, gavin@FreeBSD.org, freebsd-geom@FreeBSD.org, freebsd-kern@FreeBSD.org From: gavin@FreeBSD.org Cc: Subject: Re: kern/121907: [request] output to console can obscure other messages X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 27 Jun 2008 13:30:06 -0000 Old Synopsis: [request] [geom] geom output to console obscures other messages New Synopsis: [request] output to console can obscure other messages State-Changed-From-To: feedback->open State-Changed-By: gavin State-Changed-When: Fri Jun 27 13:25:21 UTC 2008 State-Changed-Why: Feedback was received Responsible-Changed-From-To: freebsd-geom->freebsd-kern Responsible-Changed-By: gavin Responsible-Changed-When: Fri Jun 27 13:25:21 UTC 2008 Responsible-Changed-Why: Not a problem specific to geom http://www.freebsd.org/cgi/query-pr.cgi?pr=121907