From owner-freebsd-geom@FreeBSD.ORG Mon Nov 21 11:02:37 2005 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 5BEE816A41F for ; Mon, 21 Nov 2005 11:02:37 +0000 (GMT) (envelope-from owner-bugmaster@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [216.136.204.21]) by mx1.FreeBSD.org (Postfix) with ESMTP id 084F543D68 for ; Mon, 21 Nov 2005 11:02:30 +0000 (GMT) (envelope-from owner-bugmaster@freebsd.org) Received: from freefall.freebsd.org (peter@localhost [127.0.0.1]) by freefall.freebsd.org (8.13.3/8.13.3) with ESMTP id jALB2UaV090032 for ; Mon, 21 Nov 2005 11:02:30 GMT (envelope-from owner-bugmaster@freebsd.org) Received: (from peter@localhost) by freefall.freebsd.org (8.13.3/8.13.1/Submit) id jALB2TtQ090026 for freebsd-geom@freebsd.org; Mon, 21 Nov 2005 11:02:29 GMT (envelope-from owner-bugmaster@freebsd.org) Date: Mon, 21 Nov 2005 11:02:29 GMT Message-Id: <200511211102.jALB2TtQ090026@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: peter set sender to owner-bugmaster@freebsd.org using -f From: FreeBSD bugmaster To: freebsd-geom@FreeBSD.org Cc: Subject: Current problem reports assigned to you X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 21 Nov 2005 11:02:37 -0000 Current FreeBSD problem reports Critical problems Serious problems S Submitted Tracker Resp. Description ------------------------------------------------------------------------------- o [2005/01/21] kern/76538 geom [gbde] nfs-write on gbde partition stalls o [2005/08/04] kern/84556 geom [geom] GBDE-encrypted swap causes panic a o [2005/10/16] kern/87544 geom [gbde] mmaping large files on a gbde file o [2005/11/16] kern/89102 geom [geom_vfs] [panic] panic when forced unmo 4 problems total. Non-critical problems S Submitted Tracker Resp. Description ------------------------------------------------------------------------------- o [2005/02/26] bin/78131 geom gbde "destroy" not working. o [2005/03/26] kern/79251 geom [2TB] newfs fails on 2.6TB gbde device 2 problems total. From owner-freebsd-geom@FreeBSD.ORG Tue Nov 22 11:12:37 2005 Return-Path: X-Original-To: freebsd-geom@FreeBSD.org Delivered-To: freebsd-geom@FreeBSD.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 97F2616A41F for ; Tue, 22 Nov 2005 11:12:37 +0000 (GMT) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.FreeBSD.org (Postfix) with ESMTP id 3E94B43D7C for ; Tue, 22 Nov 2005 11:12:25 +0000 (GMT) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 6F62450F93; Tue, 22 Nov 2005 12:12:23 +0100 (CET) Received: from localhost (dkm94.neoplus.adsl.tpnet.pl [83.24.16.94]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id 8877250B83; Tue, 22 Nov 2005 12:12:17 +0100 (CET) Date: Tue, 22 Nov 2005 12:11:52 +0100 From: Pawel Jakub Dawidek To: Alexey Luckyanchikov Message-ID: <20051122111152.GB7826@garage.freebsd.pl> References: <20051113105915.GC13743@alkar.net> <20051113125657.GE34696@garage.freebsd.pl> <20051114144637.GS13743@alkar.net> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="V0207lvV8h4k8FAm" Content-Disposition: inline In-Reply-To: <20051114144637.GS13743@alkar.net> X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng/devel-r535 (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-0.5 required=3.0 tests=BAYES_00,RCVD_IN_NJABL_DUL, RCVD_IN_SORBS_DUL autolearn=no version=3.0.4 Cc: freebsd-geom@FreeBSD.org Subject: Re: GELI doesn't ask passphrase on boot X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 22 Nov 2005 11:12:37 -0000 --V0207lvV8h4k8FAm Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Nov 14, 2005 at 04:46:37PM +0200, Alexey Luckyanchikov wrote: +> On Sun, 13 Nov 2005, Pawel Jakub Dawidek wrote: +>=20 +> PJD> +> After boot "dmesg -a | fgrep -i eli" show: +> PJD> +> GEOM_ELI[1]: Start tasting. +> PJD> +> g_modevent(ELI, LOAD) +> PJD> +> g_load_class(ELI) +> PJD> +> g_eli_taste(ELI, ad0) +> PJD> +> GEOM_ELI[3]: Tasting ad0. +> PJD> +> g_destroy_geom(0xc1257300(eli:taste)) +> PJD> +> g_eli_taste(ELI, ad0s1) +> PJD> +> GEOM_ELI[3]: Tasting ad0s1. +> PJD> +> g_destroy_geom(0xc1256e80(eli:taste)) +> PJD> +> GEOM_ELI[1]: Tasting no more. +> PJD> +> g_eli_taste(ELI, ad0s1a) +> PJD> +> g_eli_taste(ELI, ad0s1b) +> PJD> +> g_eli_taste(ELI, ad0s1c) +> PJD> +> g_eli_taste(ELI, ad1) +> PJD> +> g_eli_taste(ELI, ad1s1) +> PJD> +> g_eli_taste(ELI, ad1s1a) +> PJD> +> g_eli_taste(ELI, ad1s1c) +> PJD> +> g_eli_taste(ELI, ad0s1a) +> PJD> +>=20 +> PJD> +> It seems that problem is in g_eli.c, line 1092: +> PJD> +> SYSINIT(geli_boot_end, SI_SUB_RUN_SCHEDULER, SI_ORDER_ANY, g_eli= _on_boot_end, NULL) +> PJD> +> geli_boot_end() called before GELI finish tasting. +> PJD>=20 +> PJD> Use this feature only for encrypting root file system. +> PJD> In case of other file systems, check out /etc/defaults/rc.conf for +> PJD> examples of geli configuration on boot. +>=20 +> It was just an experiment, actually I want to encrypt root partition. +> Let us assume that ad0 contain only unencrypted /boot and /etc/fstab +> with: +> /dev/ad1s1a.eli / ufs rw 1 1 +> AIUI GELI doesn't ask passphrase on boot for /dev/ad1s1a.eli. +>=20 +> Could you explain "right way" to create encrypted root partition? You are right, something is wrong here. Hard to say how it can be fixed easly... There is root_mount() KPI for delying root file system mount, but you have to know that there is a reason to delay it. Maybe root_mount() KPI should be used in GEOM itself, to delay root mount if there are provider for taste... --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --V0207lvV8h4k8FAm Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.2 (FreeBSD) iD8DBQFDgvz4ForvXbEpPzQRAmnoAKCm5YqdAkj8t95nBTRUQd1UsmncaQCfVHDz VpyzmAqh49B21e7MxJ4yTvk= =vvEw -----END PGP SIGNATURE----- --V0207lvV8h4k8FAm-- From owner-freebsd-geom@FreeBSD.ORG Tue Nov 22 16:33:11 2005 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 4534416A42C for ; Tue, 22 Nov 2005 16:33:11 +0000 (GMT) (envelope-from wjw@withagen.nl) Received: from freebee.digiware.nl (dsl439.iae.nl [212.61.63.187]) by mx1.FreeBSD.org (Postfix) with ESMTP id 72A9C43D55 for ; Tue, 22 Nov 2005 16:32:53 +0000 (GMT) (envelope-from wjw@withagen.nl) Received: from [212.61.27.82] (laptop.digiware.nl [212.61.27.82]) by freebee.digiware.nl (Postfix) with ESMTP id A86C92AAAA for ; Tue, 22 Nov 2005 17:32:36 +0100 (CET) Message-ID: <4383480A.7070606@withagen.nl> Date: Tue, 22 Nov 2005 17:32:10 +0100 From: Willem Jan Withagen User-Agent: Mozilla Thunderbird 1.0.7 (Windows/20050923) X-Accept-Language: en-us, en MIME-Version: 1.0 To: freebsd-geom@freebsd.org Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Subject: A question on gmirror and "load sharing" X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 22 Nov 2005 16:33:11 -0000 Hi, I'm in the proces of running some "performance" tests on raw disks, as a small configuration test to run my NFS-perfomance tests on a different setup. (http://withagen.dyndns.org/FreeBSD/Performance) So I build a mirror with gmirror and 2 80Gb WD-sata disks. On that I run tests like (for reading): ---- while ($i < 16000) dd of=/dev/null if=/dev/ad4 bs=5M count=1 iseek=$i end ---- Giving me transfer times and rates that depend on the location of the head on the platter. The graphs seem to suggest that this simple test is not at all bad as an approach to this. When you run this on an old BigFoot, which has a plexiglas view on the heads. You really see the arm creeping slowly to the spindle. However when I run this read test on a mirrored set of disks. I see (with systat -vm 1) that data is only transfered from 1 disk for a long time. And then several seconds later the other disk is used. This also happens if I create the mirror with 'gmirror label -b load'. And as such the transferrate of the mirror is equal or less than a single disk. Perhaps I should test this with 'split'? Or is this something internal in the kernel that a 5Mb request comes in, and is forwarded as a whole request down the filesystem. And thus there is no parallellism to take advantage off. (Even on an SMP the request is to one disk only) --WjW From owner-freebsd-geom@FreeBSD.ORG Wed Nov 23 00:46:25 2005 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id BCB2216A41F for ; Wed, 23 Nov 2005 00:46:25 +0000 (GMT) (envelope-from tomas@zvala.cz) Received: from smtp.dkm.cz (smtp.dkm.cz [62.24.64.34]) by mx1.FreeBSD.org (Postfix) with SMTP id D75B343D5D for ; Wed, 23 Nov 2005 00:46:24 +0000 (GMT) (envelope-from tomas@zvala.cz) Received: (qmail 12874 invoked by uid 0); 22 Nov 2005 22:06:57 -0000 Received: from null.murder.cz (HELO ?192.168.1.2?) (213.220.234.254) by smtp.dkm.cz with SMTP; 22 Nov 2005 22:06:57 -0000 Message-ID: <43839684.9050106@zvala.cz> Date: Tue, 22 Nov 2005 23:07:00 +0100 From: Tomas Zvala User-Agent: Thunderbird 1.5 (Windows/20051025) MIME-Version: 1.0 To: freebsd-geom@freebsd.org References: <4383480A.7070606@withagen.nl> In-Reply-To: <4383480A.7070606@withagen.nl> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Subject: Re: A question on gmirror and "load sharing" X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 23 Nov 2005 00:46:25 -0000 Hello, I did some similar testing and came to similar conclusion. As PJD explained, the mirror will never double the transfer rate in sequential I/O. Here's the thread: http://docs.freebsd.org/cgi/getmsg.cgi?fetch=0+0+archive/2004/freebsd-geom/20041205.freebsd-geom Tomas btw. i never said thank you for his answer, so now i do :) thanks. Willem Jan Withagen wrote: > Hi, > > I'm in the proces of running some "performance" tests on raw disks, as > a small configuration test to run my NFS-perfomance tests on a > different setup. > > (http://withagen.dyndns.org/FreeBSD/Performance) > > So I build a mirror with gmirror and 2 80Gb WD-sata disks. > > On that I run tests like (for reading): > ---- > while ($i < 16000) > dd of=/dev/null if=/dev/ad4 bs=5M count=1 iseek=$i > end > ---- > > Giving me transfer times and rates that depend on the location of the > head on the platter. The graphs seem to suggest that this simple test > is not at all bad as an approach to this. > When you run this on an old BigFoot, which has a plexiglas view on the > heads. You really see the arm creeping slowly to the spindle. > > However when I run this read test on a mirrored set of disks. I see > (with systat -vm 1) that data is only transfered from 1 disk for a > long time. And then several seconds later the other disk is used. This > also happens if I create the mirror with 'gmirror label -b load'. And > as such the transferrate of the mirror is equal or less than a single > disk. > > Perhaps I should test this with 'split'? > Or is this something internal in the kernel that a 5Mb request comes > in, and is forwarded as a whole request down the filesystem. And thus > there is no parallellism to take advantage off. (Even on an SMP the > request is to one disk only) > > --WjW > _______________________________________________ > freebsd-geom@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-geom > To unsubscribe, send any mail to "freebsd-geom-unsubscribe@freebsd.org" > From owner-freebsd-geom@FreeBSD.ORG Wed Nov 23 04:57:21 2005 Return-Path: X-Original-To: freebsd-geom@hub.freebsd.org Delivered-To: freebsd-geom@hub.freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 7C82016A41F; Wed, 23 Nov 2005 04:57:21 +0000 (GMT) (envelope-from linimon@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [216.136.204.21]) by mx1.FreeBSD.org (Postfix) with ESMTP id 375B843D45; Wed, 23 Nov 2005 04:57:21 +0000 (GMT) (envelope-from linimon@FreeBSD.org) Received: from freefall.freebsd.org (linimon@localhost [127.0.0.1]) by freefall.freebsd.org (8.13.3/8.13.3) with ESMTP id jAN4vLDY074258; Wed, 23 Nov 2005 04:57:21 GMT (envelope-from linimon@freefall.freebsd.org) Received: (from linimon@localhost) by freefall.freebsd.org (8.13.3/8.13.1/Submit) id jAN4vL6k074254; Wed, 23 Nov 2005 04:57:21 GMT (envelope-from linimon) Date: Wed, 23 Nov 2005 04:57:21 GMT From: Mark Linimon Message-Id: <200511230457.jAN4vL6k074254@freefall.freebsd.org> To: linimon@FreeBSD.org, freebsd-bugs@FreeBSD.org, freebsd-geom@FreeBSD.org Cc: Subject: Re: kern/80938: [geom] gmirror: DEVFS Overflow table X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 23 Nov 2005 04:57:21 -0000 Synopsis: [geom] gmirror: DEVFS Overflow table Responsible-Changed-From-To: freebsd-bugs->freebsd-geom Responsible-Changed-By: linimon Responsible-Changed-When: Wed Nov 23 04:57:11 GMT 2005 Responsible-Changed-Why: Over to maintainer(s). http://www.freebsd.org/cgi/query-pr.cgi?pr=80938 From owner-freebsd-geom@FreeBSD.ORG Wed Nov 23 06:30:06 2005 Return-Path: X-Original-To: freebsd-geom@hub.freebsd.org Delivered-To: freebsd-geom@hub.freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 576AD16A41F; Wed, 23 Nov 2005 06:30:06 +0000 (GMT) (envelope-from phk@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [216.136.204.21]) by mx1.FreeBSD.org (Postfix) with ESMTP id 9DB8943D67; Wed, 23 Nov 2005 06:30:05 +0000 (GMT) (envelope-from phk@FreeBSD.org) Received: from freefall.freebsd.org (phk@localhost [127.0.0.1]) by freefall.freebsd.org (8.13.3/8.13.3) with ESMTP id jAN6U5UP087707; Wed, 23 Nov 2005 06:30:05 GMT (envelope-from phk@freefall.freebsd.org) Received: (from phk@localhost) by freefall.freebsd.org (8.13.3/8.13.1/Submit) id jAN6U5l3087703; Wed, 23 Nov 2005 06:30:05 GMT (envelope-from phk) Date: Wed, 23 Nov 2005 06:30:05 GMT From: Poul-Henning Kamp Message-Id: <200511230630.jAN6U5l3087703@freefall.freebsd.org> To: cris@deana.it, phk@FreeBSD.org, freebsd-geom@FreeBSD.org Cc: Subject: Re: kern/80938: [geom] gmirror: DEVFS Overflow table X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 23 Nov 2005 06:30:06 -0000 Synopsis: [geom] gmirror: DEVFS Overflow table State-Changed-From-To: open->closed State-Changed-By: phk State-Changed-When: Wed Nov 23 06:29:50 GMT 2005 State-Changed-Why: DEVFS don't have an overflow table any more. http://www.freebsd.org/cgi/query-pr.cgi?pr=80938 From owner-freebsd-geom@FreeBSD.ORG Wed Nov 23 15:23:45 2005 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 806F416A41F for ; Wed, 23 Nov 2005 15:23:45 +0000 (GMT) (envelope-from wjw@withagen.nl) Received: from freebee.digiware.nl (dsl439.iae.nl [212.61.63.187]) by mx1.FreeBSD.org (Postfix) with ESMTP id 151F643D4C for ; Wed, 23 Nov 2005 15:23:44 +0000 (GMT) (envelope-from wjw@withagen.nl) Received: from [212.61.27.82] (laptop.digiware.nl [212.61.27.82]) by freebee.digiware.nl (Postfix) with ESMTP id B93382AAA9 for ; Wed, 23 Nov 2005 16:23:42 +0100 (CET) Message-ID: <43848961.3050506@withagen.nl> Date: Wed, 23 Nov 2005 16:23:13 +0100 From: Willem Jan Withagen User-Agent: Mozilla Thunderbird 1.0.7 (Windows/20050923) X-Accept-Language: en-us, en MIME-Version: 1.0 CC: freebsd-geom@freebsd.org References: <4383480A.7070606@withagen.nl> <43839684.9050106@zvala.cz> In-Reply-To: <43839684.9050106@zvala.cz> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Subject: Re: A question on gmirror and "load sharing" X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 23 Nov 2005 15:23:45 -0000 [Remember it is considered bad etiquette to top post. trimming sigs and others is also a nice thing to do] > Willem Jan Withagen wrote: >> I'm in the proces of running some "performance" tests on raw disks, as >> a small configuration test to run my NFS-perfomance tests on a >> different setup. >> >> (http://withagen.dyndns.org/FreeBSD/Performance) >> >> So I build a mirror with gmirror and 2 80Gb WD-sata disks. >> >> On that I run tests like (for reading): >> ---- >> while ($i < 16000) >> dd of=/dev/null if=/dev/ad4 bs=5M count=1 iseek=$i >> end >> ---- >> >> Giving me transfer times and rates that depend on the location of the >> head on the platter. The graphs seem to suggest that this simple test >> is not at all bad as an approach to this. >> When you run this on an old BigFoot, which has a plexiglas view on the >> heads. You really see the arm creeping slowly to the spindle. >> >> However when I run this read test on a mirrored set of disks. I see >> (with systat -vm 1) that data is only transfered from 1 disk for a >> long time. And then several seconds later the other disk is used. This >> also happens if I create the mirror with 'gmirror label -b load'. And >> as such the transferrate of the mirror is equal or less than a single >> disk. >> >> Perhaps I should test this with 'split'? >> Or is this something internal in the kernel that a 5Mb request comes >> in, and is forwarded as a whole request down the filesystem. And thus >> there is no parallellism to take advantage off. (Even on an SMP the >> request is to one disk only) Tomas Zvala wrote: > Hello, > I did some similar testing and came to similar conclusion. As PJD > explained, the mirror will never double the transfer rate in sequential > I/O. > Here's the thread: > http://docs.freebsd.org/cgi/getmsg.cgi?fetch=0+0+archive/2004/freebsd-geom/20041205.freebsd-geom Thanx for the pointer. Interesting to read. And I'm now in the proces of testing the 'split' algorithm. And I have the feeling that I certain cases I do get above the speedmark equal to the transferrate of 1 disk. But I'd have to agree with Pawel that in general seeking for 128K will be the same (or longer) than reading for 128K. Especially true when things are stored in the disk-cache, then perhaps a whole track is stored at once and the remainder is served from the cache. --WjW