From owner-freebsd-geom@FreeBSD.ORG Mon Feb 2 02:48:08 2009 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9CC631065678 for ; Mon, 2 Feb 2009 02:48:08 +0000 (UTC) (envelope-from anderson@freebsd.org) Received: from ns.trinitel.com (186.161.36.72.static.reverse.ltdomains.com [72.36.161.186]) by mx1.freebsd.org (Postfix) with ESMTP id 6DF808FC1D for ; Mon, 2 Feb 2009 02:48:08 +0000 (UTC) (envelope-from anderson@freebsd.org) Received: from [10.0.7.197] (r74-193-77-79.pfvlcmta01.grtntx.tl.dh.suddenlink.net [74.193.77.79]) (authenticated bits=0) by ns.trinitel.com (8.14.1/8.14.1) with ESMTP id n122L7mL057752; Sun, 1 Feb 2009 20:21:07 -0600 (CST) (envelope-from anderson@freebsd.org) Message-Id: <9C533E30-BD08-4938-8D1A-5CE046FB6BF6@freebsd.org> From: Eric Anderson To: Ivan Voras In-Reply-To: Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v930.3) Date: Sun, 1 Feb 2009 20:48:06 -0600 References: <6612C205-C346-4493-9DA4-3B5A73E9A4F7@freebsd.org> X-Mailer: Apple Mail (2.930.3) X-Virus-Scanned: ClamAV 0.94.1/8937/Sun Feb 1 18:15:18 2009 on ns.trinitel.com X-Virus-Status: Clean X-Spam-Status: No, score=-2.1 required=5.0 tests=AWL,BAYES_00,RDNS_DYNAMIC autolearn=no version=3.2.5 X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on ns.trinitel.com Cc: freebsd-geom@freebsd.org Subject: Re: Performance numbers? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 02 Feb 2009 02:48:09 -0000 On Jan 30, 2009, at 2:50 PM, Ivan Voras wrote: > Eric Anderson wrote: >> Hi GEOMers! >> >> Does anyone have any benchmarks or numbers relating to GEOM >> performance? >> >> I tried doing some on my own, but I didn't get very satisfactory >> results, so I'm curious what others have seen or used. >> >> My hardware is a Core 2 Quad, with 4GB of ram. >> >> First, I made an mdconfig'ed malloc backed 'disk' of 1.5GB. Then, I >> tried running such tools as rawio, and diskinfo. rawio fails with >> input/output errors, and diskinfo wants a larger device to give the >> full >> stats. I ended up using purely dd since that worked. Interestingly >> enough, dd'ing to the malloc device results in about 1000 >> operations per >> second, regardless of a blocksize of 512bytes or 1MB. > > It's a good idea for testing. > > 1000 ops/s looks suspiciously like HZ, though I don't know why HZ > would > influence GEOM (AFAIK context switches between threads, including GEOM > threads do not depend on it) - can you try ruling out HZ? > Is there a way to pump the data through the GEOM layers without doing a mdconfig'd disk? Also, are you thinking setting the hz to some other setting, and rerunning? What setting were you thinking? I can easily try anything. Thanks! Eric From owner-freebsd-geom@FreeBSD.ORG Mon Feb 2 09:16:53 2009 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B5F88106564A for ; Mon, 2 Feb 2009 09:16:53 +0000 (UTC) (envelope-from gcubfg-freebsd-geom@m.gmane.org) Received: from ciao.gmane.org (main.gmane.org [80.91.229.2]) by mx1.freebsd.org (Postfix) with ESMTP id 3ADC38FC20 for ; Mon, 2 Feb 2009 09:16:52 +0000 (UTC) (envelope-from gcubfg-freebsd-geom@m.gmane.org) Received: from list by ciao.gmane.org with local (Exim 4.43) id 1LTuvE-0004rm-UU for freebsd-geom@freebsd.org; Mon, 02 Feb 2009 09:16:52 +0000 Received: from lara.cc.fer.hr ([161.53.72.113]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Mon, 02 Feb 2009 09:16:52 +0000 Received: from ivoras by lara.cc.fer.hr with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Mon, 02 Feb 2009 09:16:52 +0000 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-geom@freebsd.org From: Ivan Voras Date: Mon, 02 Feb 2009 10:16:30 +0100 Lines: 66 Message-ID: References: <6612C205-C346-4493-9DA4-3B5A73E9A4F7@freebsd.org> <9C533E30-BD08-4938-8D1A-5CE046FB6BF6@freebsd.org> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig7780B08CA2E76E7BDD8B1A81" X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: lara.cc.fer.hr User-Agent: Thunderbird 2.0.0.19 (X11/20090105) In-Reply-To: <9C533E30-BD08-4938-8D1A-5CE046FB6BF6@freebsd.org> X-Enigmail-Version: 0.95.0 Sender: news Subject: Re: Performance numbers? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 02 Feb 2009 09:16:53 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig7780B08CA2E76E7BDD8B1A81 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Eric Anderson wrote: >=20 > On Jan 30, 2009, at 2:50 PM, Ivan Voras wrote: >=20 >> Eric Anderson wrote: >>> Hi GEOMers! >>> >>> Does anyone have any benchmarks or numbers relating to GEOM performan= ce? >>> >>> I tried doing some on my own, but I didn't get very satisfactory >>> results, so I'm curious what others have seen or used. >>> >>> My hardware is a Core 2 Quad, with 4GB of ram. >>> >>> First, I made an mdconfig'ed malloc backed 'disk' of 1.5GB. Then, I >>> tried running such tools as rawio, and diskinfo. rawio fails with >>> input/output errors, and diskinfo wants a larger device to give the f= ull >>> stats. I ended up using purely dd since that worked. Interestingly >>> enough, dd'ing to the malloc device results in about 1000 operations = per >>> second, regardless of a blocksize of 512bytes or 1MB. >> >> It's a good idea for testing. >> >> 1000 ops/s looks suspiciously like HZ, though I don't know why HZ woul= d >> influence GEOM (AFAIK context switches between threads, including GEOM= >> threads do not depend on it) - can you try ruling out HZ? >=20 > Is there a way to pump the data through the GEOM layers without doing a= > mdconfig'd disk? You could use gzero, it ignores written data and produces read data with memset. > Also, are you thinking setting the hz to some other setting, and > rerunning? What setting were you thinking? I can easily try anything.= Yes. Try 1500. --------------enig7780B08CA2E76E7BDD8B1A81 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFJhrn1ldnAQVacBcgRAu52AKC8+YGgRqwX2VqbKBRuWkyZGyXK/gCePlbG g2btQr41+24k12240RbxxEI= =0tsg -----END PGP SIGNATURE----- --------------enig7780B08CA2E76E7BDD8B1A81-- From owner-freebsd-geom@FreeBSD.ORG Mon Feb 2 11:06:51 2009 Return-Path: Delivered-To: freebsd-geom@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 89F2C10656BF for ; Mon, 2 Feb 2009 11:06:51 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id 74B408FC0C for ; Mon, 2 Feb 2009 11:06:51 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.3/8.14.3) with ESMTP id n12B6psM094428 for ; Mon, 2 Feb 2009 11:06:51 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.3/8.14.3/Submit) id n12B6otd094424 for freebsd-geom@FreeBSD.org; Mon, 2 Feb 2009 11:06:50 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 2 Feb 2009 11:06:50 GMT Message-Id: <200902021106.n12B6otd094424@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-geom@FreeBSD.org Cc: Subject: Current problem reports assigned to freebsd-geom@FreeBSD.org X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 02 Feb 2009 11:06:52 -0000 Note: to view an individual PR, use: http://www.freebsd.org/cgi/query-pr.cgi?pr=(number). The following is a listing of current problems submitted by FreeBSD users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/131037 geom [geli] Unable to create disklabel on .eli-Device o bin/130632 geom [patch] gpart(8) assert failure if used from FreeBSD L o kern/130528 geom gjournal fsck during boot o kern/129674 geom [geom] gjournal root did not mount on boot o kern/129645 geom gjournal(8): GEOM_JOURNAL causes system to fail to boo o kern/129245 geom [geom] gcache is more suitable for suffix based provid o bin/128398 geom [patch] glabel(8): teach geom_label to recognise gpt l f kern/128276 geom [gmirror] machine lock up when gmirror module is used o kern/126902 geom [geom] [geom_label] Kernel panic during install boot o kern/124973 geom [gjournal] [patch] boot order affects geom_journal con o kern/124969 geom gvinum(8): gvinum raid5 plex does not detect missing s o kern/124294 geom [geom] gmirror(8) have inappropriate logic when workin o kern/124130 geom [gmirror] [usb] gmirror fails to start usb devices tha o kern/123962 geom [panic] [gjournal] gjournal (455Gb data, 8Gb journal), o kern/123630 geom [patch] [gmirror] gmirror doesnt allow the original dr o kern/123122 geom [geom] GEOM / gjournal kernel lock f kern/122415 geom [geom] UFS labels are being constantly created and rem o kern/122067 geom [geom] [panic] Geom crashed during boot o kern/121559 geom [patch] [geom] geom label class allows to create inacc o kern/121364 geom [gmirror] Removing all providers create a "zombie" mir o kern/120231 geom [geom] GEOM_CONCAT error adding second drive o kern/120044 geom [msdosfs] [geom] incorrect MSDOSFS label fries adminis o kern/120021 geom [geom] [panic] net-p2p/qbittorrent crashes system when o kern/119743 geom [geom] geom label for cds is keeped after dismount and f kern/115547 geom [geom] [patch] [request] let GEOM Eli get password fro o kern/114532 geom [geom] GEOM_MIRROR shows up in kldstat even if compile o kern/113957 geom [gmirror] gmirror is intermittently reporting a degrad o kern/113837 geom [geom] unable to access 1024 sector size storage o kern/113419 geom [geom] geom fox multipathing not failing back p bin/110705 geom gmirror(8) control utility does not exit with correct o kern/107707 geom [geom] [patch] [request] add new class geom_xbox360 to o kern/104389 geom [geom] [patch] sys/geom/geom_dump.c doesn't encode XML o kern/98034 geom [geom] dereference of NULL pointer in acd_geom_detach o kern/94632 geom [geom] Kernel output resets input while GELI asks for o kern/90582 geom [geom] [panic] Restore cause panic string (ffs_blkfree o bin/90093 geom fdisk(8) incapable of altering in-core geometry a kern/89660 geom [vinum] [patch] [panic] due to g_malloc returning null o kern/89546 geom [geom] GEOM error s kern/89102 geom [geom] [panic] panic when forced unmount FS from unplu o kern/87544 geom [gbde] mmaping large files on a gbde filesystem deadlo o kern/84556 geom [geom] [panic] GBDE-encrypted swap causes panic at shu o kern/79251 geom [2TB] newfs fails on 2.6TB gbde device o kern/79035 geom [vinum] gvinum unable to create a striped set of mirro o bin/78131 geom gbde(8) "destroy" not working. s kern/73177 geom kldload geom_* causes panic due to memory exhaustion 45 problems total. From owner-freebsd-geom@FreeBSD.ORG Mon Feb 2 19:09:34 2009 Return-Path: Delivered-To: freebsd-geom@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 787F5106566B; Mon, 2 Feb 2009 19:09:34 +0000 (UTC) (envelope-from lulf@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id 4DAB28FC0A; Mon, 2 Feb 2009 19:09:34 +0000 (UTC) (envelope-from lulf@FreeBSD.org) Received: from freefall.freebsd.org (lulf@localhost [127.0.0.1]) by freefall.freebsd.org (8.14.3/8.14.3) with ESMTP id n12J9Ydh061639; Mon, 2 Feb 2009 19:09:34 GMT (envelope-from lulf@freefall.freebsd.org) Received: (from lulf@localhost) by freefall.freebsd.org (8.14.3/8.14.3/Submit) id n12J9YWp061635; Mon, 2 Feb 2009 19:09:34 GMT (envelope-from lulf) Date: Mon, 2 Feb 2009 19:09:34 GMT Message-Id: <200902021909.n12J9YWp061635@freefall.freebsd.org> To: lulf@FreeBSD.org, freebsd-geom@FreeBSD.org, lulf@FreeBSD.org From: lulf@FreeBSD.org Cc: Subject: Re: bin/130632: [patch] gpart(8) assert failure if used from FreeBSD Live CD X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 02 Feb 2009 19:09:34 -0000 Synopsis: [patch] gpart(8) assert failure if used from FreeBSD Live CD Responsible-Changed-From-To: freebsd-geom->lulf Responsible-Changed-By: lulf Responsible-Changed-When: Mon Feb 2 19:08:39 UTC 2009 Responsible-Changed-Why: I'll take this. http://www.freebsd.org/cgi/query-pr.cgi?pr=130632 From owner-freebsd-geom@FreeBSD.ORG Tue Feb 3 13:08:05 2009 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7100A10656DF; Tue, 3 Feb 2009 13:08:05 +0000 (UTC) (envelope-from anderson@freebsd.org) Received: from ns.trinitel.com (186.161.36.72.static.reverse.ltdomains.com [72.36.161.186]) by mx1.freebsd.org (Postfix) with ESMTP id 24ADC8FC12; Tue, 3 Feb 2009 13:08:05 +0000 (UTC) (envelope-from anderson@freebsd.org) Received: from proton.storspeed.com (mail.storspeed.com [209.163.168.123]) (authenticated bits=0) by ns.trinitel.com (8.14.1/8.14.1) with ESMTP id n13CemPs084002; Tue, 3 Feb 2009 06:40:49 -0600 (CST) (envelope-from anderson@freebsd.org) Message-Id: From: Eric Anderson To: Ivan Voras In-Reply-To: Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v930.3) Date: Tue, 3 Feb 2009 07:07:58 -0600 References: <6612C205-C346-4493-9DA4-3B5A73E9A4F7@freebsd.org> <9C533E30-BD08-4938-8D1A-5CE046FB6BF6@freebsd.org> X-Mailer: Apple Mail (2.930.3) X-Virus-Scanned: ClamAV 0.94.1/8945/Tue Feb 3 01:03:14 2009 on ns.trinitel.com X-Virus-Status: Clean X-Spam-Status: No, score=-2.2 required=5.0 tests=AWL,BAYES_00 autolearn=ham version=3.2.5 X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on ns.trinitel.com Cc: freebsd-geom@freebsd.org Subject: Re: Performance numbers? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Feb 2009 13:08:05 -0000 On Feb 2, 2009, at 3:16 AM, Ivan Voras wrote: > Eric Anderson wrote: >> >> On Jan 30, 2009, at 2:50 PM, Ivan Voras wrote: >> >>> Eric Anderson wrote: >>>> Hi GEOMers! >>>> >>>> Does anyone have any benchmarks or numbers relating to GEOM >>>> performance? >>>> >>>> I tried doing some on my own, but I didn't get very satisfactory >>>> results, so I'm curious what others have seen or used. >>>> >>>> My hardware is a Core 2 Quad, with 4GB of ram. >>>> >>>> First, I made an mdconfig'ed malloc backed 'disk' of 1.5GB. >>>> Then, I >>>> tried running such tools as rawio, and diskinfo. rawio fails with >>>> input/output errors, and diskinfo wants a larger device to give >>>> the full >>>> stats. I ended up using purely dd since that worked. >>>> Interestingly >>>> enough, dd'ing to the malloc device results in about 1000 >>>> operations per >>>> second, regardless of a blocksize of 512bytes or 1MB. >>> >>> It's a good idea for testing. >>> >>> 1000 ops/s looks suspiciously like HZ, though I don't know why HZ >>> would >>> influence GEOM (AFAIK context switches between threads, including >>> GEOM >>> threads do not depend on it) - can you try ruling out HZ? >> >> Is there a way to pump the data through the GEOM layers without >> doing a >> mdconfig'd disk? > > You could use gzero, it ignores written data and produces read data > with > memset. Ok, I tried gzero, and now the numbers are *much* different. I'm getting roughly 60,000 ops/s now single threaded, or about 140,000 ops/ s using 4 threads. Much better! :) I could not for the life of me remember geom_zero, so thanks for the reminder. > > >> Also, are you thinking setting the hz to some other setting, and >> rerunning? What setting were you thinking? I can easily try >> anything. > > Yes. Try 1500. > I think I'll skip that now that I have gzero working giving me more realistic numbers. Eric From owner-freebsd-geom@FreeBSD.ORG Tue Feb 3 13:38:07 2009 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5D2D810658CD; Tue, 3 Feb 2009 13:38:07 +0000 (UTC) (envelope-from anderson@vnode.org) Received: from ns.trinitel.com (186.161.36.72.static.reverse.ltdomains.com [72.36.161.186]) by mx1.freebsd.org (Postfix) with ESMTP id 11FB38FC23; Tue, 3 Feb 2009 13:38:06 +0000 (UTC) (envelope-from anderson@vnode.org) Received: from proton.storspeed.com (mail.storspeed.com [209.163.168.123]) (authenticated bits=0) by ns.trinitel.com (8.14.1/8.14.1) with ESMTP id n13CdRUl083961; Tue, 3 Feb 2009 06:39:27 -0600 (CST) (envelope-from anderson@vnode.org) Message-Id: <4E34132B-9EFF-4108-8E50-80A5CE186EAB@vnode.org> From: Eric Anderson To: Ivan Voras In-Reply-To: Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v930.3) Date: Tue, 3 Feb 2009 07:06:36 -0600 References: <6612C205-C346-4493-9DA4-3B5A73E9A4F7@freebsd.org> <9C533E30-BD08-4938-8D1A-5CE046FB6BF6@freebsd.org> X-Mailer: Apple Mail (2.930.3) X-Virus-Scanned: ClamAV 0.94.1/8945/Tue Feb 3 01:03:14 2009 on ns.trinitel.com X-Virus-Status: Clean X-Spam-Status: No, score=-2.3 required=5.0 tests=AWL,BAYES_00 autolearn=ham version=3.2.5 X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on ns.trinitel.com Cc: freebsd-geom@freebsd.org Subject: Re: Performance numbers? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Feb 2009 13:38:08 -0000 On Feb 2, 2009, at 3:16 AM, Ivan Voras wrote: > Eric Anderson wrote: >> >> On Jan 30, 2009, at 2:50 PM, Ivan Voras wrote: >> >>> Eric Anderson wrote: >>>> Hi GEOMers! >>>> >>>> Does anyone have any benchmarks or numbers relating to GEOM >>>> performance? >>>> >>>> I tried doing some on my own, but I didn't get very satisfactory >>>> results, so I'm curious what others have seen or used. >>>> >>>> My hardware is a Core 2 Quad, with 4GB of ram. >>>> >>>> First, I made an mdconfig'ed malloc backed 'disk' of 1.5GB. >>>> Then, I >>>> tried running such tools as rawio, and diskinfo. rawio fails with >>>> input/output errors, and diskinfo wants a larger device to give >>>> the full >>>> stats. I ended up using purely dd since that worked. >>>> Interestingly >>>> enough, dd'ing to the malloc device results in about 1000 >>>> operations per >>>> second, regardless of a blocksize of 512bytes or 1MB. >>> >>> It's a good idea for testing. >>> >>> 1000 ops/s looks suspiciously like HZ, though I don't know why HZ >>> would >>> influence GEOM (AFAIK context switches between threads, including >>> GEOM >>> threads do not depend on it) - can you try ruling out HZ? >> >> Is there a way to pump the data through the GEOM layers without >> doing a >> mdconfig'd disk? > > You could use gzero, it ignores written data and produces read data > with > memset. Ok, I tried gzero, and now the numbers are *much* different. I'm getting roughly 60,000 ops/s now single threaded, or about 140,000 ops/ s using 4 threads. Much better! :) I could not for the life of me remember geom_zero, so thanks for the reminder. > > >> Also, are you thinking setting the hz to some other setting, and >> rerunning? What setting were you thinking? I can easily try >> anything. > > Yes. Try 1500. > I think I'll skip that now that I have gzero working giving me more realistic numbers. Eric From owner-freebsd-geom@FreeBSD.ORG Tue Feb 3 14:19:03 2009 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 585F01065673; Tue, 3 Feb 2009 14:19:03 +0000 (UTC) (envelope-from anderson@freebsd.org) Received: from ns.trinitel.com (186.161.36.72.static.reverse.ltdomains.com [72.36.161.186]) by mx1.freebsd.org (Postfix) with ESMTP id 261DA8FC1F; Tue, 3 Feb 2009 14:19:03 +0000 (UTC) (envelope-from anderson@freebsd.org) Received: from proton.storspeed.com (mail.storspeed.com [209.163.168.123]) (authenticated bits=0) by ns.trinitel.com (8.14.1/8.14.1) with ESMTP id n13DpatW013268; Tue, 3 Feb 2009 07:51:37 -0600 (CST) (envelope-from anderson@freebsd.org) Message-Id: From: Eric Anderson To: Ivan Voras In-Reply-To: <9bbcef730902030554m501e961clf755fefc299aac75@mail.gmail.com> Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v930.3) Date: Tue, 3 Feb 2009 08:18:46 -0600 References: <6612C205-C346-4493-9DA4-3B5A73E9A4F7@freebsd.org> <9C533E30-BD08-4938-8D1A-5CE046FB6BF6@freebsd.org> <9bbcef730902030554m501e961clf755fefc299aac75@mail.gmail.com> X-Mailer: Apple Mail (2.930.3) X-Virus-Scanned: ClamAV 0.94.1/8946/Tue Feb 3 06:32:04 2009 on ns.trinitel.com X-Virus-Status: Clean X-Spam-Status: No, score=-2.2 required=5.0 tests=AWL,BAYES_00 autolearn=ham version=3.2.5 X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on ns.trinitel.com Cc: freebsd-geom@freebsd.org Subject: Re: Performance numbers? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Feb 2009 14:19:03 -0000 On Feb 3, 2009, at 7:54 AM, Ivan Voras wrote: > 2009/2/3 Eric Anderson : > >> Ok, I tried gzero, and now the numbers are *much* different. I'm >> getting >> roughly 60,000 ops/s now single threaded, or about 140,000 ops/s >> using 4 >> threads. Much better! :) I could not for the life of me remember >> geom_zero, so thanks for the reminder. > > What do you mean by "4 threads"? 4 parallel instances of dd? Yes. Eric From owner-freebsd-geom@FreeBSD.ORG Tue Feb 3 14:27:40 2009 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D5F3E106567C for ; Tue, 3 Feb 2009 14:27:40 +0000 (UTC) (envelope-from ivoras@gmail.com) Received: from fk-out-0910.google.com (fk-out-0910.google.com [209.85.128.186]) by mx1.freebsd.org (Postfix) with ESMTP id 6254F8FC1D for ; Tue, 3 Feb 2009 14:27:40 +0000 (UTC) (envelope-from ivoras@gmail.com) Received: by fk-out-0910.google.com with SMTP id f40so1747651fka.11 for ; Tue, 03 Feb 2009 06:27:39 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:sender:received:in-reply-to :references:date:x-google-sender-auth:message-id:subject:from:to:cc :content-type:content-transfer-encoding; bh=VbHXnlwhLeGMUgXD3q8IP3Q/VH4VicDInDhAI80+zes=; b=llrdnP3Hr6EiA/UFSxAlmhAozK8EltZRzYnGJMkB5HkCLkJs0zcznup8DPRSv6h+Ud ZpfDP5WC1ykFGybybWtAMIia3Mg61OI24d1wvaNnOeeuHN3QCG7PKv8fzP3gyF10mg5t 7SnBCaWtcpCDdt6+POHeFkP+LGSGouEL+pgT8= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type :content-transfer-encoding; b=LgMoPk1fiV3PgKJhULBA2ZDPYsXpBr1zf0xcJRV7Q2T9I+3wL4IigQxGmD0ANjHfQ6 d9UT1OGUDVd4ADRtbhQWf2aasxQAhu0r3+tqwr8ZTiNo4nE1nd5ksgpVmPNU3fXkRNTK E8BL4N8yuAmvXd5zF/ydA07d7tru0jeyWE96I= MIME-Version: 1.0 Sender: ivoras@gmail.com Received: by 10.181.11.3 with SMTP id o3mr2088337bki.172.1233669286619; Tue, 03 Feb 2009 05:54:46 -0800 (PST) In-Reply-To: References: <6612C205-C346-4493-9DA4-3B5A73E9A4F7@freebsd.org> <9C533E30-BD08-4938-8D1A-5CE046FB6BF6@freebsd.org> Date: Tue, 3 Feb 2009 14:54:46 +0100 X-Google-Sender-Auth: 78828088ca26d4ae Message-ID: <9bbcef730902030554m501e961clf755fefc299aac75@mail.gmail.com> From: Ivan Voras To: Eric Anderson Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Cc: freebsd-geom@freebsd.org Subject: Re: Performance numbers? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Feb 2009 14:27:41 -0000 2009/2/3 Eric Anderson : > Ok, I tried gzero, and now the numbers are *much* different. I'm getting > roughly 60,000 ops/s now single threaded, or about 140,000 ops/s using 4 > threads. Much better! :) I could not for the life of me remember > geom_zero, so thanks for the reminder. What do you mean by "4 threads"? 4 parallel instances of dd? From owner-freebsd-geom@FreeBSD.ORG Wed Feb 4 12:33:45 2009 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B74411065670 for ; Wed, 4 Feb 2009 12:33:45 +0000 (UTC) (envelope-from davej@wsnet.co.za) Received: from ctb-mesg-1-1.saix.net (ctb-mesg-1-1.saix.net [196.25.240.79]) by mx1.freebsd.org (Postfix) with ESMTP id 537C78FC2A for ; Wed, 4 Feb 2009 12:33:44 +0000 (UTC) (envelope-from davej@wsnet.co.za) Received: from adsl.wsnet.co.uk (dsl-145-103-193.telkomadsl.co.za [165.145.103.193]) by ctb-mesg-1-1.saix.net (Postfix) with SMTP id E2BF01C789 for ; Wed, 4 Feb 2009 13:35:30 +0200 (SAST) Received: (qmail 36334 invoked from network); 4 Feb 2009 11:49:37 -0000 Received: from unknown (HELO ?192.168.1.73?) (192.168.1.73) by adsl.wsnet.co.uk with SMTP; 4 Feb 2009 11:49:37 -0000 From: Dave Johnson To: freebsd-geom@freebsd.org Organization: WSNET Date: Wed, 04 Feb 2009 13:33:22 +0200 Message-Id: <1233747202.20913.9.camel@susedesk> Mime-Version: 1.0 X-Mailer: Evolution 2.22.1.1 Content-Type: text/plain Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: Different size drives X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: davej@wsnet.co.za List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Feb 2009 12:33:46 -0000 Hi All Is there a way to get geom to ignore the size of the 2nd drive? Both drives are 250GB The "slave" is a 100k larger. Regards From owner-freebsd-geom@FreeBSD.ORG Wed Feb 4 15:33:42 2009 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B3444106564A for ; Wed, 4 Feb 2009 15:33:42 +0000 (UTC) (envelope-from ulf.lilleengen@gmail.com) Received: from bene1.itea.ntnu.no (bene1.itea.ntnu.no [IPv6:2001:700:300:3::56]) by mx1.freebsd.org (Postfix) with ESMTP id 6E5D48FC29 for ; Wed, 4 Feb 2009 15:33:42 +0000 (UTC) (envelope-from ulf.lilleengen@gmail.com) Received: from localhost (localhost [127.0.0.1]) by bene1.itea.ntnu.no (Postfix) with ESMTP id BEDA524022; Wed, 4 Feb 2009 16:33:40 +0100 (CET) Received: from carrot (unknown [IPv6:2001:700:300:3::184]) by bene1.itea.ntnu.no (Postfix) with ESMTP id 655DA2401F; Wed, 4 Feb 2009 16:33:40 +0100 (CET) Date: Wed, 4 Feb 2009 16:34:16 +0000 From: Ulf Lilleengen To: Dave Johnson Message-ID: <20090204163416.GB1293@carrot.BalPol.Local> References: <1233747202.20913.9.camel@susedesk> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <1233747202.20913.9.camel@susedesk> User-Agent: Mutt/1.5.18 (2008-05-17) X-Virus-Scanned: Debian amavisd-new at bene1.itea.ntnu.no Cc: freebsd-geom@freebsd.org Subject: Re: Different size drives X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: "..."@carrot.BalPol.Local List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Feb 2009 15:33:43 -0000 On ons, feb 04, 2009 at 01:33:22pm +0200, Dave Johnson wrote: > Hi All > > Is there a way to get geom to ignore the size of the 2nd drive? > > Both drives are 250GB > In what context? -- Ulf Lilleengen From owner-freebsd-geom@FreeBSD.ORG Wed Feb 4 15:46:38 2009 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id BE7D510656EE for ; Wed, 4 Feb 2009 15:46:38 +0000 (UTC) (envelope-from gcubfg-freebsd-geom@m.gmane.org) Received: from ciao.gmane.org (main.gmane.org [80.91.229.2]) by mx1.freebsd.org (Postfix) with ESMTP id 48FCE8FC13 for ; Wed, 4 Feb 2009 15:46:38 +0000 (UTC) (envelope-from gcubfg-freebsd-geom@m.gmane.org) Received: from list by ciao.gmane.org with local (Exim 4.43) id 1LUjxQ-0007cn-7o for freebsd-geom@freebsd.org; Wed, 04 Feb 2009 15:46:32 +0000 Received: from lara.cc.fer.hr ([161.53.72.113]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Wed, 04 Feb 2009 15:46:32 +0000 Received: from ivoras by lara.cc.fer.hr with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Wed, 04 Feb 2009 15:46:32 +0000 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-geom@freebsd.org From: Ivan Voras Date: Wed, 04 Feb 2009 16:46:08 +0100 Lines: 72 Message-ID: References: <1233747202.20913.9.camel@susedesk> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig5583C62C07836AA053DAEAB5" X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: lara.cc.fer.hr User-Agent: Thunderbird 2.0.0.19 (X11/20090105) In-Reply-To: <1233747202.20913.9.camel@susedesk> X-Enigmail-Version: 0.95.0 Sender: news Subject: Re: Different size drives X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Feb 2009 15:46:39 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig5583C62C07836AA053DAEAB5 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Dave Johnson wrote: > Hi All >=20 > Is there a way to get geom to ignore the size of the 2nd drive? >=20 > Both drives are 250GB >=20 > The "slave" is a 100k larger. If you're asking about gmirror, it should automatically "just work". I have a configuration like that (different drive manufacturers, different sector counts): ~> gmirror list Geom name: gm0 State: COMPLETE Components: 2 Balance: split Slice: 4096 Flags: NONE GenID: 0 SyncID: 2 ID: 468895920 Providers: 1. Name: mirror/gm0 Mediasize: 80026361344 (75G) Sectorsize: 512 Mode: r7w7e8 Consumers: 1. Name: ad0 Mediasize: 80026361856 (75G) Sectorsize: 512 Mode: r1w1e1 State: ACTIVE Priority: 0 Flags: NONE GenID: 0 SyncID: 2 ID: 1459003038 2. Name: ad2 Mediasize: 81964302336 (76G) Sectorsize: 512 Mode: r1w1e1 State: ACTIVE Priority: 0 Flags: NONE GenID: 0 SyncID: 2 ID: 1951693847 --------------enig5583C62C07836AA053DAEAB5 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFJibhAldnAQVacBcgRAjOxAKCsZXcoSMMG2OTebdEtwGMU6y5yOgCglS8m 9+mHglhIaR8TCzyCb2qjEjE= =MbMN -----END PGP SIGNATURE----- --------------enig5583C62C07836AA053DAEAB5-- From owner-freebsd-geom@FreeBSD.ORG Wed Feb 4 16:10:25 2009 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 486C0106566B for ; Wed, 4 Feb 2009 16:10:25 +0000 (UTC) (envelope-from ulf.lilleengen@gmail.com) Received: from bene1.itea.ntnu.no (bene1.itea.ntnu.no [IPv6:2001:700:300:3::56]) by mx1.freebsd.org (Postfix) with ESMTP id 845258FC1B for ; Wed, 4 Feb 2009 16:10:24 +0000 (UTC) (envelope-from ulf.lilleengen@gmail.com) Received: from localhost (localhost [127.0.0.1]) by bene1.itea.ntnu.no (Postfix) with ESMTP id 11D622403F; Wed, 4 Feb 2009 17:10:23 +0100 (CET) Received: from carrot (unknown [IPv6:2001:700:300:3::184]) by bene1.itea.ntnu.no (Postfix) with ESMTP id A54FA2401F; Wed, 4 Feb 2009 17:10:22 +0100 (CET) Date: Wed, 4 Feb 2009 17:10:56 +0000 From: Ulf Lilleengen To: Dave Johnson Message-ID: <20090204171056.GA36355@carrot.BalPol.Local> References: <1233747202.20913.9.camel@susedesk> <20090204163416.GB1293@carrot.BalPol.Local> <1233762664.20913.53.camel@susedesk> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <1233762664.20913.53.camel@susedesk> User-Agent: Mutt/1.5.18 (2008-05-17) X-Virus-Scanned: Debian amavisd-new at bene1.itea.ntnu.no Cc: freebsd-geom@freebsd.org Subject: Re: Different size drives X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Feb 2009 16:10:26 -0000 On Wed, Feb 04, 2009 at 05:51:03PM +0200, Dave Johnson wrote: > Hi > > Thanks for the reply > > > Example > > master drive(ad0) 100014 > > slave(ad1) 100000 > > We need to "clone" from master to slave > > geom comes back with > > mail# gmirror insert gm0 /dev/ad1 > gmirror: Provider ad1 too small. Oh, hmm. You have already a filesystem setup and everything on the "master" mirror? If so, I'm not sure if you can do this without recreating the gmirror, as the filesystem expects a provider of the master size, and attaching a smaller slave which can't mirror all the master data won't really work. The other way around is ofcourse much easier. -- Ulf Lilleengen