From owner-freebsd-geom@FreeBSD.ORG Mon Jan 5 11:06:52 2009 Return-Path: Delivered-To: freebsd-geom@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 64CDA106566B for ; Mon, 5 Jan 2009 11:06:52 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id 523A88FC1A for ; Mon, 5 Jan 2009 11:06:52 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.3/8.14.3) with ESMTP id n05B6qqH002787 for ; Mon, 5 Jan 2009 11:06:52 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.3/8.14.3/Submit) id n05B6pkG002783 for freebsd-geom@FreeBSD.org; Mon, 5 Jan 2009 11:06:51 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 5 Jan 2009 11:06:51 GMT Message-Id: <200901051106.n05B6pkG002783@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-geom@FreeBSD.org Cc: Subject: Current problem reports assigned to freebsd-geom@FreeBSD.org X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 05 Jan 2009 11:06:52 -0000 Note: to view an individual PR, use: http://www.freebsd.org/cgi/query-pr.cgi?pr=(number). The following is a listing of current problems submitted by FreeBSD users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/129674 geom [geom] gjournal root did not mount on boot o kern/129645 geom gjournal(8): GEOM_JOURNAL causes system to fail to boo o kern/129245 geom [geom] gcache is more suitable for suffix based provid o bin/128398 geom [patch] glabel(8): teach geom_label to recognise gpt l f kern/128276 geom [gmirror] machine lock up when gmirror module is used o kern/126902 geom [geom] [geom_label] Kernel panic during install boot o kern/124973 geom [gjournal] [patch] boot order affects geom_journal con o kern/124969 geom gvinum(8): gvinum raid5 plex does not detect missing s o kern/124294 geom [geom] gmirror(8) have inappropriate logic when workin o kern/124130 geom [gmirror][usb] gmirror fails to start usb devices that o kern/123962 geom [panic] [gjournal] gjournal (455Gb data, 8Gb journal), o kern/123630 geom [patch] [gmirror] gmirror doesnt allow the original dr o kern/123122 geom [geom] GEOM / gjournal kernel lock f kern/122415 geom [geom] UFS labels are being constantly created and rem o kern/122067 geom [geom] [panic] Geom crashed during boot o kern/121559 geom [patch] [geom] geom label class allows to create inacc o kern/121364 geom [gmirror] Removing all providers create a "zombie" mir o kern/120231 geom [geom] GEOM_CONCAT error adding second drive o kern/120044 geom [msdosfs] [geom] incorrect MSDOSFS label fries adminis o kern/120021 geom [geom] [panic] net-p2p/qbittorrent crashes system when o kern/119743 geom [geom] geom label for cds is keeped after dismount and f kern/115547 geom [geom] [patch] [request] let GEOM Eli get password fro o kern/114532 geom [geom] GEOM_MIRROR shows up in kldstat even if compile o kern/113957 geom [gmirror] gmirror is intermittently reporting a degrad o kern/113837 geom [geom] unable to access 1024 sector size storage o kern/113419 geom [geom] geom fox multipathing not failing back p bin/110705 geom gmirror(8) control utility does not exit with correct o kern/107707 geom [geom] [patch] [request] add new class geom_xbox360 to o kern/104389 geom [geom] [patch] sys/geom/geom_dump.c doesn't encode XML o kern/98034 geom [geom] dereference of NULL pointer in acd_geom_detach o kern/94632 geom [geom] Kernel output resets input while GELI asks for o kern/90582 geom [geom] [panic] Restore cause panic string (ffs_blkfree o bin/90093 geom fdisk(8) incapable of altering in-core geometry a kern/89660 geom [vinum] [patch] [panic] due to g_malloc returning null o kern/89546 geom [geom] GEOM error s kern/89102 geom [geom] [panic] panic when forced unmount FS from unplu o kern/87544 geom [gbde] mmaping large files on a gbde filesystem deadlo o kern/84556 geom [geom] [panic] GBDE-encrypted swap causes panic at shu o kern/79251 geom [2TB] newfs fails on 2.6TB gbde device o kern/79035 geom [vinum] gvinum unable to create a striped set of mirro o bin/78131 geom gbde(8) "destroy" not working. s kern/73177 geom kldload geom_* causes panic due to memory exhaustion 42 problems total. From owner-freebsd-geom@FreeBSD.ORG Mon Jan 5 11:21:34 2009 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 12CD81065884 for ; Mon, 5 Jan 2009 11:21:34 +0000 (UTC) (envelope-from mikej@paymentallianceintl.com) Received: from mx2.confluenttech.com (mx2.confluentasp.com [216.26.153.14]) by mx1.freebsd.org (Postfix) with ESMTP id C690D8FC19 for ; Mon, 5 Jan 2009 11:21:33 +0000 (UTC) (envelope-from mikej@paymentallianceintl.com) Received: from calvin.pai.local (calvin.pai.local [10.0.6.33]) by mx2.confluenttech.com (8.14.1/8.13.8) with ESMTP id n05BLS8U083916; Mon, 5 Jan 2009 06:21:28 -0500 (EST) (envelope-from mikej@paymentallianceintl.com) Authentication-Results: mx2.confluenttech.com from=mikej@paymentallianceintl.com; sender-id=neutral; spf=neutral X-MimeOLE: Produced By Microsoft MimeOLE V6.00.3790.4325 Content-class: urn:content-classes:message MIME-Version: 1.0 Date: Mon, 5 Jan 2009 06:21:22 -0500 Message-ID: In-Reply-To: <917871cf0812270615j4f43ce0v497804ce5a71690f@mail.gmail.com> X-MS-Has-Attach: X-MS-TNEF-Correlator: Thread-Topic: Encrypting raid5 volume with geli Thread-Index: AcloLafA8/HXh9cYTqC3oVRUVD2kyQG9GKag From: "Michael Jung" To: "Ulf Lilleengen" Importance: normal Priority: normal Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: John-Mark Gurney , freebsd-geom@freebsd.org Subject: RE: Encrypting raid5 volume with geli X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 05 Jan 2009 11:21:39 -0000 I've been on vacation and yes the new patch works fine. --mikej ________________________________ From: Ulf Lilleengen [mailto:ulf.lilleengen@gmail.com] Sent: Saturday, December 27, 2008 9:15 AM To: Michael Jung Cc: John-Mark Gurney; freebsd-geom@freebsd.org Subject: Re: Encrypting raid5 volume with geli On Fri, Dec 19, 2008 at 10:49 PM, Michael Jung wrote: FreeBSD 7.1-PRERELEASE #1: Fri Dec 19 09:04:23 EST 2008 With the new patch I can create UFS system and mount. I can also: (root@charon) /etc# geli init -P -K /root/test.key /dev/gvinum/test But when I try to attach it: (root@charon) /etc# geli attach -p -k /root/test.key /dev/gvinum/test (root@charon) /etc# mount /dev/gvinum/test.eli /mnt mount: /dev/gvinum/test.eli : Invalid argument (root@charon) /etc# Uhm, haven't you forgotten to do a newfs /dev/gvinum/test.eli before mounting it? It works fine for me when doing that first. -- Ulf Lilleengen CONFIDENTIALITY NOTE: This message is intended only for the use of the individual or entity to whom it is addressed and may contain information that is privileged, confidential, and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this transmission in error, please notify us by telephone at (502) 212-4001 or notify us at PAI , Dept. 99, 11857 Commonwealth Drive, Louisville, KY 40299. Thank you. From owner-freebsd-geom@FreeBSD.ORG Wed Jan 7 03:06:00 2009 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 563EA106566B for ; Wed, 7 Jan 2009 03:06:00 +0000 (UTC) (envelope-from gcubfg-freebsd-geom@m.gmane.org) Received: from ciao.gmane.org (main.gmane.org [80.91.229.2]) by mx1.freebsd.org (Postfix) with ESMTP id CD9A28FC17 for ; Wed, 7 Jan 2009 03:05:59 +0000 (UTC) (envelope-from gcubfg-freebsd-geom@m.gmane.org) Received: from list by ciao.gmane.org with local (Exim 4.43) id 1LKOjw-0005aB-JV for freebsd-geom@freebsd.org; Wed, 07 Jan 2009 03:05:52 +0000 Received: from 78-1-183-240.adsl.net.t-com.hr ([78.1.183.240]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Wed, 07 Jan 2009 03:05:52 +0000 Received: from ivoras by 78-1-183-240.adsl.net.t-com.hr with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Wed, 07 Jan 2009 03:05:52 +0000 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-geom@freebsd.org From: Ivan Voras Date: Wed, 07 Jan 2009 04:05:24 +0100 Lines: 44 Message-ID: References: <4AD370A6-2226-442F-BD80-8CFD4045B094@panasas.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig6C7F72843F284BBA96789D41" X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: 78-1-183-240.adsl.net.t-com.hr User-Agent: Thunderbird 2.0.0.19 (Windows/20081209) In-Reply-To: <4AD370A6-2226-442F-BD80-8CFD4045B094@panasas.com> X-Enigmail-Version: 0.95.7 Sender: news Subject: Re: performance problem with gstripe X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 07 Jan 2009 03:06:00 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig6C7F72843F284BBA96789D41 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Joel Jacobson wrote: > i have a bit of a weird issue, which i suspect is a configuration > problem, and was looking for a little advice. i have an LSI JBOD box > with a bunch of SAS drives that i would like to gstripe together. each= > drive individually seems to be able to do about 80 MB/sec streaming > write, and doing parallel dd's gives me the 160 MB/sec i would expect. = > if i gstripe them together with a 256k stripe width, i only see 80 > MB/sec, though. How do you measure this? If with dd, what block size (bs) do you use? >=20 > if, however, i newfs/mount it as ufs and then dd myself a big file, tha= t > gets me about 120-130 MB/sec. >=20 > why does mounting matter? I'd guess because of write caching that enables you to make use of multiple stripes at once, if your dd bs is smaller than 2*stripe size. --------------enig6C7F72843F284BBA96789D41 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iEYEARECAAYFAklkG/QACgkQldnAQVacBcgANwCgkIv2J0Q1IlVS7IpqWrhVCRH+ Q38AoLW+L3QE8L390yw02URRWyEM1ivc =66OT -----END PGP SIGNATURE----- --------------enig6C7F72843F284BBA96789D41-- From owner-freebsd-geom@FreeBSD.ORG Wed Jan 7 03:37:11 2009 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7FD45106564A for ; Wed, 7 Jan 2009 03:37:11 +0000 (UTC) (envelope-from jjacobson@panasas.com) Received: from laguna.int.panasas.com (gw-ca.panasas.com [66.104.249.162]) by mx1.freebsd.org (Postfix) with ESMTP id 648D38FC17 for ; Wed, 7 Jan 2009 03:37:10 +0000 (UTC) (envelope-from jjacobson@panasas.com) Received: from [172.17.133.249] ([172.17.133.249]) by laguna.int.panasas.com with Microsoft SMTPSVC(6.0.3790.3959); Tue, 6 Jan 2009 19:37:03 -0800 Message-Id: From: Joel Jacobson To: Ivan Voras In-Reply-To: Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v929.2) Date: Tue, 6 Jan 2009 19:37:07 -0800 References: <4AD370A6-2226-442F-BD80-8CFD4045B094@panasas.com> X-Mailer: Apple Mail (2.929.2) X-OriginalArrivalTime: 07 Jan 2009 03:37:03.0670 (UTC) FILETIME=[34D81560:01C97079] Cc: freebsd-geom@freebsd.org Subject: Re: performance problem with gstripe X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 07 Jan 2009 03:37:11 -0000 here's what i did: --------------------------- ca-sbox-2# foreach i (0 1) foreach? dd if=/dev/zero of=/dev/da$i bs=512k count=1024 & foreach? end [1] 5402 [2] 5403 ca-sbox-2# 1024+0 records in 1024+0 records out 536870912 bytes transferred in 4.262723 secs (125945532 bytes/sec) 1024+0 records in 1024+0 records out 536870912 bytes transferred in 4.272499 secs (125657357 bytes/sec) ca-sbox-2# gstripe create -s 262144 d0 /dev/da{0,1} ca-sbox-2# dd if=/dev/zero of=/dev/stripe/d0 bs=512k count=4096 4096+0 records in 4096+0 records out 2147483648 bytes transferred in 34.124683 secs (62930508 bytes/sec) ca-sbox-2# newfs /dev/stripe/d0 > /dev/null ca-sbox-2# mount /dev/stripe/d0 /mnt ca-sbox-2# dd if=/dev/zero of=/mnt/bigfile bs=512k count=4096 && /usr/ bin/time sync 4096+0 records in 4096+0 records out 2147483648 bytes transferred in 11.081184 secs (193795502 bytes/sec) 0.06 real 0.00 user 0.04 sys # sysctl kern.geom kern.geom.collectstats: 1 kern.geom.debugflags: 0 kern.geom.label.debug: 0 kern.geom.stripe.fast_failed: 0 kern.geom.stripe.maxmem: 13107200 kern.geom.stripe.fast: 1 kern.geom.stripe.debug: 0 ---------------------- - j On Jan 6, 2009, at 7:05 PM, Ivan Voras wrote: > Joel Jacobson wrote: >> i have a bit of a weird issue, which i suspect is a configuration >> problem, and was looking for a little advice. i have an LSI JBOD box >> with a bunch of SAS drives that i would like to gstripe together. >> each >> drive individually seems to be able to do about 80 MB/sec streaming >> write, and doing parallel dd's gives me the 160 MB/sec i would >> expect. >> if i gstripe them together with a 256k stripe width, i only see 80 >> MB/sec, though. > > How do you measure this? If with dd, what block size (bs) do you use? > >> >> if, however, i newfs/mount it as ufs and then dd myself a big file, >> that >> gets me about 120-130 MB/sec. >> >> why does mounting matter? > > I'd guess because of write caching that enables you to make use of > multiple stripes at once, if your dd bs is smaller than 2*stripe size. > From owner-freebsd-geom@FreeBSD.ORG Wed Jan 7 04:08:21 2009 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 31AFB106564A for ; Wed, 7 Jan 2009 04:08:21 +0000 (UTC) (envelope-from gcubfg-freebsd-geom@m.gmane.org) Received: from ciao.gmane.org (main.gmane.org [80.91.229.2]) by mx1.freebsd.org (Postfix) with ESMTP id D6E7C8FC12 for ; Wed, 7 Jan 2009 04:08:20 +0000 (UTC) (envelope-from gcubfg-freebsd-geom@m.gmane.org) Received: from list by ciao.gmane.org with local (Exim 4.43) id 1LKPiL-0007XU-NS for freebsd-geom@freebsd.org; Wed, 07 Jan 2009 04:08:17 +0000 Received: from 78-1-183-240.adsl.net.t-com.hr ([78.1.183.240]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Wed, 07 Jan 2009 04:08:17 +0000 Received: from ivoras by 78-1-183-240.adsl.net.t-com.hr with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Wed, 07 Jan 2009 04:08:17 +0000 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-geom@freebsd.org From: Ivan Voras Date: Wed, 07 Jan 2009 05:08:09 +0100 Lines: 42 Message-ID: References: <4AD370A6-2226-442F-BD80-8CFD4045B094@panasas.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enigD0A0E3736B77A97D761DA11B" X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: 78-1-183-240.adsl.net.t-com.hr User-Agent: Thunderbird 2.0.0.19 (Windows/20081209) In-Reply-To: X-Enigmail-Version: 0.95.7 Sender: news Subject: Re: performance problem with gstripe X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 07 Jan 2009 04:08:21 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enigD0A0E3736B77A97D761DA11B Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Joel Jacobson wrote: > here's what i did: > ca-sbox-2# dd if=3D/dev/zero of=3D/dev/stripe/d0 bs=3D512k count=3D4096= > 4096+0 records in > 4096+0 records out > 2147483648 bytes transferred in 34.124683 secs (62930508 bytes/sec) > ca-sbox-2# dd if=3D/dev/zero of=3D/mnt/bigfile bs=3D512k count=3D4096 &= & > /usr/bin/time sync > 4096+0 records in > 4096+0 records out > 2147483648 bytes transferred in 11.081184 secs (193795502 bytes/sec) Hmm ok, you might be hitting the MAXPHYS problem. Could you try and create your gstripe array with a stripe size of 64 kB and 32 kB and test on those ? --------------enigD0A0E3736B77A97D761DA11B Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iEYEARECAAYFAklkKqkACgkQldnAQVacBcj43ACg/gelUd4uD5lQofLo+b91Agrm PkgAn0dcO/4spEzgUQCvsdJrKYl1fb8O =/sM+ -----END PGP SIGNATURE----- --------------enigD0A0E3736B77A97D761DA11B-- From owner-freebsd-geom@FreeBSD.ORG Wed Jan 7 16:44:01 2009 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9B3AB1065670; Wed, 7 Jan 2009 16:44:01 +0000 (UTC) (envelope-from jjacobson@panasas.com) Received: from laguna.int.panasas.com (gw-ca.panasas.com [66.104.249.162]) by mx1.freebsd.org (Postfix) with ESMTP id 7D70F8FC22; Wed, 7 Jan 2009 16:44:00 +0000 (UTC) (envelope-from jjacobson@panasas.com) Received: from [172.17.133.249] ([172.17.133.249]) by laguna.int.panasas.com with Microsoft SMTPSVC(6.0.3790.3959); Wed, 7 Jan 2009 08:42:02 -0800 Message-Id: From: Joel Jacobson To: Ivan Voras In-Reply-To: Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v929.2) Date: Wed, 7 Jan 2009 08:42:06 -0800 References: <4AD370A6-2226-442F-BD80-8CFD4045B094@panasas.com> X-Mailer: Apple Mail (2.929.2) X-OriginalArrivalTime: 07 Jan 2009 16:42:02.0792 (UTC) FILETIME=[DE1BC280:01C970E6] Cc: freebsd-geom@freebsd.org Subject: Re: performance problem with gstripe X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 07 Jan 2009 16:44:02 -0000 still works badly at 64k, but works well if i use 32k (and have kern.geom.stripe.fast=1). that being said, i was only seeing 64k I/O through ufs when i was doing the 256k stripe, so im still not sure why this matters. i have a somewhat hidden agenda here, too, in that i have my own filesystem that suffers the same problem im seeing with dd. i figured there was something ufs does which i do not, and was trying to figure out what that might be. it works fine on 4.6.2 using ccd and a 256k stripe size [and i send 128k I/O requests, which is what i would prefer to see sent to the driver, rather than 64k]. - j On Jan 6, 2009, at 8:08 PM, Ivan Voras wrote: > Joel Jacobson wrote: >> here's what i did: > >> ca-sbox-2# dd if=/dev/zero of=/dev/stripe/d0 bs=512k count=4096 >> 4096+0 records in >> 4096+0 records out >> 2147483648 bytes transferred in 34.124683 secs (62930508 bytes/sec) > >> ca-sbox-2# dd if=/dev/zero of=/mnt/bigfile bs=512k count=4096 && >> /usr/bin/time sync >> 4096+0 records in >> 4096+0 records out >> 2147483648 bytes transferred in 11.081184 secs (193795502 bytes/sec) > > > Hmm ok, you might be hitting the MAXPHYS problem. Could you try and > create your gstripe array with a stripe size of 64 kB and 32 kB and > test > on those ? > From owner-freebsd-geom@FreeBSD.ORG Wed Jan 7 18:54:12 2009 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C708410656D6 for ; Wed, 7 Jan 2009 18:54:12 +0000 (UTC) (envelope-from gcubfg-freebsd-geom@m.gmane.org) Received: from ciao.gmane.org (main.gmane.org [80.91.229.2]) by mx1.freebsd.org (Postfix) with ESMTP id 441698FC08 for ; Wed, 7 Jan 2009 18:54:12 +0000 (UTC) (envelope-from gcubfg-freebsd-geom@m.gmane.org) Received: from list by ciao.gmane.org with local (Exim 4.43) id 1LKdXf-00074K-Es for freebsd-geom@freebsd.org; Wed, 07 Jan 2009 18:54:11 +0000 Received: from 78-1-183-240.adsl.net.t-com.hr ([78.1.183.240]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Wed, 07 Jan 2009 18:54:11 +0000 Received: from ivoras by 78-1-183-240.adsl.net.t-com.hr with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Wed, 07 Jan 2009 18:54:11 +0000 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-geom@freebsd.org From: Ivan Voras Date: Wed, 07 Jan 2009 19:53:56 +0100 Lines: 78 Message-ID: References: <4AD370A6-2226-442F-BD80-8CFD4045B094@panasas.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig8912F83176CA91661B4DF7AB" X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: 78-1-183-240.adsl.net.t-com.hr User-Agent: Thunderbird 2.0.0.19 (Windows/20081209) In-Reply-To: X-Enigmail-Version: 0.95.7 Sender: news Subject: Re: performance problem with gstripe X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 07 Jan 2009 18:54:14 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig8912F83176CA91661B4DF7AB Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Joel Jacobson wrote: > still works badly at 64k, but works well if i use 32k (and have > kern.geom.stripe.fast=3D1). that being said, i was only seeing 64k I/O= > through ufs when i was doing the 256k stripe, so im still not sure why > this matters. You have robably stumbled on the group of problems collectively knows as "the MAXPHYS problem". This is what's happening: Many disk drivers in FreeBSD were first created when the controllers and the motherboards didn't support DMA larger than 64 kB. In addition to that there's a hard limit on IO request sizes set to 128 kB (the MAXPHYS kernel option) but which is not often reached. Thus, the maximum IO size that can reach a single drive is 64 kB and this limit is propagated in unclear ways back to UFS. If you have a stripe size larger or equal to then 64 kB then in no way can the IO request be split between two drives - you get the performance of a single drive. If the stripe size is smaller, the IO request can be split between the drives and you get better performance. All this discussion maps 1:1 to the "dd" utility accessing the raw device (/dev/something). In FreeBSD, raw device access is not buffered, so what the dd requests, the drive delivers, in exactly the same way it was requested, chopped into 64 kB pieces if needed. The reason why UFS is better is that it asynchronously fills a queue (bioq) with requests, which are sent to the device in the same way, asynchronously, so even if a single write cannot span multiple stripes, there will be many writes queued which can be done in parallel. This works upto a point, and still breaks down for high loads, large number of devices, really large stripe sizes etc. The problem is annoying but not serious if you know about it. It limits the sequential performance, but if you'd tried a random IO benchmark that can do parallel IO itself (try http://arctic.org/~dean/randomio/) on the device and uses small-ish block sizes, you'd probably find that you still get better performance. > i have a somewhat hidden agenda here, too, in that i have my own > filesystem that suffers the same problem im seeing with dd. i figured I'm interested in file systems so I'd be happy to test it for you. :) > there was something ufs does which i do not, and was trying to figure > out what that might be. it works fine on 4.6.2 using ccd and a 256k > stripe size [and i send 128k I/O requests, which is what i would prefer= > to see sent to the driver, rather than 64k]. I don't know how CCD works - maybe it can queue IO in parallel? Maybe 4.x still had cached block devices (they were thrown out at some point in time but I don't know when - see http://www.freebsd.org/doc/en/books/arch-handbook/driverbasics-block.html= )? I think there were so many changes in between 4.x and 8-CURRENT that you'll need to find someone who has worked specifically on VFS to explain exactly what is going on. Contact me if you need pointers. --------------enig8912F83176CA91661B4DF7AB Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iEYEARECAAYFAklk+kUACgkQldnAQVacBchJVwCgs0C2SuVd8GDV8NgOq5L46kKw YgwAoMqHe8kYSFZ0ISTsmrU+aNydaXvd =hKo+ -----END PGP SIGNATURE----- --------------enig8912F83176CA91661B4DF7AB-- From owner-freebsd-geom@FreeBSD.ORG Thu Jan 8 20:01:59 2009 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 691861065678 for ; Thu, 8 Jan 2009 20:01:59 +0000 (UTC) (envelope-from kgysmits@gmail.com) Received: from mail-bw0-f20.google.com (mail-bw0-f20.google.com [209.85.218.20]) by mx1.freebsd.org (Postfix) with ESMTP id 894408FC20 for ; Thu, 8 Jan 2009 20:01:57 +0000 (UTC) (envelope-from kgysmits@gmail.com) Received: by bwz13 with SMTP id 13so1428661bwz.19 for ; Thu, 08 Jan 2009 12:01:56 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:mime-version:content-type; bh=NEERFKRFgCAfCptRLu/72WybMORTvMDtj1c9W81CZzY=; b=MK/kMsiwc/ShiG1DIUsLay90Y7atM1Oz80sBIQj8ebD1wDbg2idcyL2xl8nUFKZnIn MCZ4EbIbnT2uB//OnomX7KTBGti4HXfkh85HkzT/s8LUjA+yqMu969902BAXDM/gtQKj oQQOufsm3ZPUztHrXbohf/ybcEMvwp5k5XL9Q= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:mime-version:content-type; b=jlXDysojwSkLrAHqqTmZVulS8Mn6oG+o5vzZOMj3U9iDUvfXUTNd0lgz3wAzYLcFQS bGb8I7qzeCHRKRjOff1l662qc/vvc5vt81N+f2ZT4Fkf+XQU7waQPmQZJUzXhFeMN5pI qAKdmIpuux+kVxiLRdgdPAUgLYcHaDEfrRQnk= Received: by 10.223.109.84 with SMTP id i20mr17901830fap.42.1231443325977; Thu, 08 Jan 2009 11:35:25 -0800 (PST) Received: by 10.223.108.136 with HTTP; Thu, 8 Jan 2009 11:35:25 -0800 (PST) Message-ID: Date: Thu, 8 Jan 2009 20:35:25 +0100 From: "Koen Smits" To: freebsd-geom@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: mirror a GPT partition, what label? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 08 Jan 2009 20:02:00 -0000 Hi, My new NAS will have the following disk layout: ad0 -> 2gb CF ad4 -> 1TB WD Green ad6 -> 1TB WD Green The CF will boot the rig, the 2 1TB disks will be mirrored with ZFS. No problem there, did it before. The problem lies in the swap space, which I want to place at the first gigabyte of the 1TB disks. The disks will use GPT layout. I want to gmirror the first 1GB partition on both disks. How should I accomplish this? Is it sufficient to label both partitions 'freebsd'? According to man 8 gpart 'freebsd' should not be used when using GPT. Any insight would be appreciated. -Koen From owner-freebsd-geom@FreeBSD.ORG Thu Jan 8 20:37:33 2009 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1D3EF1065670 for ; Thu, 8 Jan 2009 20:37:33 +0000 (UTC) (envelope-from brooks@lor.one-eyed-alien.net) Received: from lor.one-eyed-alien.net (lor.one-eyed-alien.net [69.66.77.232]) by mx1.freebsd.org (Postfix) with ESMTP id C79238FC13 for ; Thu, 8 Jan 2009 20:37:32 +0000 (UTC) (envelope-from brooks@lor.one-eyed-alien.net) Received: from lor.one-eyed-alien.net (localhost [127.0.0.1]) by lor.one-eyed-alien.net (8.14.3/8.14.3) with ESMTP id n08KLMAS075094; Thu, 8 Jan 2009 14:21:22 -0600 (CST) (envelope-from brooks@lor.one-eyed-alien.net) Received: (from brooks@localhost) by lor.one-eyed-alien.net (8.14.3/8.14.3/Submit) id n08KLMGF075093; Thu, 8 Jan 2009 14:21:22 -0600 (CST) (envelope-from brooks) Date: Thu, 8 Jan 2009 14:21:22 -0600 From: Brooks Davis To: Koen Smits Message-ID: <20090108202122.GA72107@lor.one-eyed-alien.net> References: MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="ikeVEW9yuYc//A+q" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.17 (2007-11-01) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-3.0 (lor.one-eyed-alien.net [127.0.0.1]); Thu, 08 Jan 2009 14:21:22 -0600 (CST) Cc: freebsd-geom@freebsd.org Subject: Re: mirror a GPT partition, what label? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 08 Jan 2009 20:37:33 -0000 --ikeVEW9yuYc//A+q Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Jan 08, 2009 at 08:35:25PM +0100, Koen Smits wrote: > Hi, >=20 > My new NAS will have the following disk layout: > ad0 -> 2gb CF > ad4 -> 1TB WD Green > ad6 -> 1TB WD Green >=20 > The CF will boot the rig, the 2 1TB disks will be mirrored with ZFS. No > problem there, did it before. > The problem lies in the swap space, which I want to place at the first > gigabyte of the 1TB disks. The disks will use GPT layout. I want to gmirr= or > the first 1GB partition on both disks. How should I accomplish this? Is it > sufficient to label both partitions 'freebsd'? According to man 8 gpart > 'freebsd' should not be used when using GPT. Any insight would be > appreciated. gmirror shouldn't care what the underlying type is though using freebsd may confuse future tools that expect to find a bsdlabel on the partition. That being said, I'd be pretty surprised if mirroring your swap partition did anything other than causing pain and preventing coredumps. You can have quite a number of swap partitions so why not just add both and have twice as much (plus the chance to successfully produce a core dump if you need to debug something). -- Brooks --ikeVEW9yuYc//A+q Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (FreeBSD) iD8DBQFJZmBBXY6L6fI4GtQRAlDPAJ9VYrYj3HNq1pEqTAPKT4Dnm7AZWgCgsoOV f3mcWDMXITe9KwbColrIBrs= =Vxri -----END PGP SIGNATURE----- --ikeVEW9yuYc//A+q-- From owner-freebsd-geom@FreeBSD.ORG Thu Jan 8 20:42:42 2009 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id BE2851065680 for ; Thu, 8 Jan 2009 20:42:42 +0000 (UTC) (envelope-from kgysmits@gmail.com) Received: from mail-bw0-f20.google.com (mail-bw0-f20.google.com [209.85.218.20]) by mx1.freebsd.org (Postfix) with ESMTP id 174B28FC14 for ; Thu, 8 Jan 2009 20:42:41 +0000 (UTC) (envelope-from kgysmits@gmail.com) Received: by bwz13 with SMTP id 13so1496459bwz.19 for ; Thu, 08 Jan 2009 12:42:40 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:cc:in-reply-to:mime-version:content-type:references; bh=q+sSFIDxIBEF6GfsQ8OdymF98uaCOHSIOGVj3h5QsKA=; b=FWBDF/HoUNto9rVzUvRk1QPVI+5YUl17leul9dmCMFn/MXTBpV3cZzxYi6hOfbH+Lo b3F03W+GSjOTbxKXhbx/A8ceB+atCjlpv8ov0SbCM0wPF2dvEyUspfg3fef+cEREOP6Y JWaZL/rXnUcAkkUNsKAYrTuFqTGv+rsLjzzzA= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version :content-type:references; b=TaKmfZv7ds8CIl7aK/S/ZEeeWO6RldRA5VTwsDg/FXlTajIeUEmRffsl83hzPfWNy5 C7887GNTuM7jgv/d0WiTr1jtpomonzhb77s3Gwp73KBrj/WWHthnQoAMIf86xV1XMKob sGkD89pnzl0IfTvI6IPzKAZjs+Rjn8pk5FU5s= Received: by 10.223.108.15 with SMTP id d15mr9447991fap.105.1231447360529; Thu, 08 Jan 2009 12:42:40 -0800 (PST) Received: by 10.223.108.136 with HTTP; Thu, 8 Jan 2009 12:42:40 -0800 (PST) Message-ID: Date: Thu, 8 Jan 2009 21:42:40 +0100 From: "Koen Smits" To: "Brooks Davis" In-Reply-To: <20090108202122.GA72107@lor.one-eyed-alien.net> MIME-Version: 1.0 References: <20090108202122.GA72107@lor.one-eyed-alien.net> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-geom@freebsd.org Subject: Re: mirror a GPT partition, what label? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 08 Jan 2009 20:42:43 -0000 On Thu, Jan 8, 2009 at 21:21, Brooks Davis wrote: > On Thu, Jan 08, 2009 at 08:35:25PM +0100, Koen Smits wrote: > > Hi, > > > > My new NAS will have the following disk layout: > > ad0 -> 2gb CF > > ad4 -> 1TB WD Green > > ad6 -> 1TB WD Green > > > > The CF will boot the rig, the 2 1TB disks will be mirrored with ZFS. No > > problem there, did it before. > > The problem lies in the swap space, which I want to place at the first > > gigabyte of the 1TB disks. The disks will use GPT layout. I want to > gmirror > > the first 1GB partition on both disks. How should I accomplish this? Is > it > > sufficient to label both partitions 'freebsd'? According to man 8 gpart > > 'freebsd' should not be used when using GPT. Any insight would be > > appreciated. > > gmirror shouldn't care what the underlying type is though using freebsd > may confuse future tools that expect to find a bsdlabel on the partition. > That being said, I'd be pretty surprised if mirroring your swap > partition did anything other than causing pain and preventing coredumps. > You can have quite a number of swap partitions so why not just add both > and have twice as much (plus the chance to successfully produce a core > dump if you need to debug something). > > -- Brooks > Well, the theory was that if I lose a disk, the system wouldn't go flat on its face because the swap space suddenly disappeared. So there is no recommended procedure for using GPT partitions for gmirror/gstripe? From owner-freebsd-geom@FreeBSD.ORG Thu Jan 8 21:06:44 2009 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 85423106566B for ; Thu, 8 Jan 2009 21:06:44 +0000 (UTC) (envelope-from xcllnt@mac.com) Received: from asmtpout015.mac.com (asmtpout015.mac.com [17.148.16.90]) by mx1.freebsd.org (Postfix) with ESMTP id 7089A8FC1E for ; Thu, 8 Jan 2009 21:06:44 +0000 (UTC) (envelope-from xcllnt@mac.com) MIME-version: 1.0 Content-transfer-encoding: 7BIT Content-type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Received: from scalzia-t60-1.jnpr.net (natint3.juniper.net [66.129.224.36]) by asmtp015.mac.com (Sun Java(tm) System Messaging Server 6.3-7.03 (built Aug 7 2008; 32bit)) with ESMTPSA id <0KD600DK57Z7MJ80@asmtp015.mac.com> for freebsd-geom@freebsd.org; Thu, 08 Jan 2009 13:06:44 -0800 (PST) Message-id: <5D9E8EEA-AE0D-42F6-96A9-A9137C39C4FA@mac.com> From: Marcel Moolenaar To: Koen Smits In-reply-to: Date: Thu, 08 Jan 2009 13:06:39 -0800 References: X-Mailer: Apple Mail (2.930.3) Cc: freebsd-geom@freebsd.org Subject: Re: mirror a GPT partition, what label? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 08 Jan 2009 21:06:45 -0000 On Jan 8, 2009, at 11:35 AM, Koen Smits wrote: > Hi, > > My new NAS will have the following disk layout: > ad0 -> 2gb CF > ad4 -> 1TB WD Green > ad6 -> 1TB WD Green > > The CF will boot the rig, the 2 1TB disks will be mirrored with ZFS. > No > problem there, did it before. > The problem lies in the swap space, which I want to place at the first > gigabyte of the 1TB disks. The disks will use GPT layout. I want to > gmirror > the first 1GB partition on both disks. How should I accomplish this? > Is it > sufficient to label both partitions 'freebsd'? According to man 8 > gpart > 'freebsd' should not be used when using GPT. Any insight would be > appreciated. Use "freebsd-swap" as the partition type. -- Marcel Moolenaar xcllnt@mac.com From owner-freebsd-geom@FreeBSD.ORG Thu Jan 8 22:18:19 2009 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 680CF10657B2 for ; Thu, 8 Jan 2009 22:18:19 +0000 (UTC) (envelope-from kgysmits@gmail.com) Received: from mail-bw0-f20.google.com (mail-bw0-f20.google.com [209.85.218.20]) by mx1.freebsd.org (Postfix) with ESMTP id D68658FC14 for ; Thu, 8 Jan 2009 22:18:18 +0000 (UTC) (envelope-from kgysmits@gmail.com) Received: by bwz13 with SMTP id 13so1644531bwz.19 for ; Thu, 08 Jan 2009 14:18:17 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:cc:in-reply-to:mime-version:content-type:references; bh=X58nwFhDC1gUWwSPfPGpt2ncOOSBMflNAy7ltzGRHQI=; b=Bf0/NTSMesIOk5bBSdSEJL2+vMOfQx9Nb3sX/k7H457SgZPKFww8zEwH2kUWBfBRKk 8AJ4Iu8UFqjy3bhzTMEDn4/u4zw3ig+80SGsXSzF+M1fuvIoGLLfay3qEi49u2lr8ciP nRB6118/RlqPNgXzFQzP64h/3boaLv6wXwJlQ= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version :content-type:references; b=k1ojBB2Q7NzAelK8+DcWmQ/PjSzFph8jDo91ldbsG4xJbgw7yE+EyXALdjoIFW5l+t 01eKIZAhk1cFtKFyRnq7Fr0H/wvGwYcmBBuTDMUCH8aioxuGkR9XAWf1WaKf0GFBEDpZ hr7/+ghOuHRk4P9Qe938OzA1J59uCDCJXAOWA= Received: by 10.223.109.20 with SMTP id h20mr18035418fap.41.1231453097756; Thu, 08 Jan 2009 14:18:17 -0800 (PST) Received: by 10.223.108.136 with HTTP; Thu, 8 Jan 2009 14:18:17 -0800 (PST) Message-ID: Date: Thu, 8 Jan 2009 23:18:17 +0100 From: "Koen Smits" To: "Marcel Moolenaar" In-Reply-To: <5D9E8EEA-AE0D-42F6-96A9-A9137C39C4FA@mac.com> MIME-Version: 1.0 References: <5D9E8EEA-AE0D-42F6-96A9-A9137C39C4FA@mac.com> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-geom@freebsd.org Subject: Re: mirror a GPT partition, what label? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 08 Jan 2009 22:18:20 -0000 Ok, let's give that a shot then. I still don't see the big picture here, but if it works I guess that's fine with me too. On Thu, Jan 8, 2009 at 22:06, Marcel Moolenaar wrote: > > On Jan 8, 2009, at 11:35 AM, Koen Smits wrote: > > Hi, >> >> My new NAS will have the following disk layout: >> ad0 -> 2gb CF >> ad4 -> 1TB WD Green >> ad6 -> 1TB WD Green >> >> The CF will boot the rig, the 2 1TB disks will be mirrored with ZFS. No >> problem there, did it before. >> The problem lies in the swap space, which I want to place at the first >> gigabyte of the 1TB disks. The disks will use GPT layout. I want to >> gmirror >> the first 1GB partition on both disks. How should I accomplish this? Is it >> sufficient to label both partitions 'freebsd'? According to man 8 gpart >> 'freebsd' should not be used when using GPT. Any insight would be >> appreciated. >> > > Use "freebsd-swap" as the partition type. > > -- > Marcel Moolenaar > xcllnt@mac.com > > > > From owner-freebsd-geom@FreeBSD.ORG Sat Jan 10 21:19:13 2009 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D33A010656C4 for ; Sat, 10 Jan 2009 21:19:13 +0000 (UTC) (envelope-from rabe@uugrn.org) Received: from mail.uugrn.org (mail.uugrn.org [195.49.138.123]) by mx1.freebsd.org (Postfix) with ESMTP id 448D28FC1C for ; Sat, 10 Jan 2009 21:19:12 +0000 (UTC) (envelope-from rabe@uugrn.org) Received: from rabe.uugrn.org (root@rabe.uugrn.org [195.49.138.102]) by mail.uugrn.org (8.14.3/8.13.8) with ESMTP id n0AKvuXZ074726 for ; Sat, 10 Jan 2009 21:58:06 +0100 (CET) (envelope-from rabe@uugrn.org) Received: from daemon.ma.sigsys.de (rabe@rabe.uugrn.org [195.49.138.102]) by rabe.uugrn.org (8.14.3/8.13.8) with ESMTP id n0AKvtvH074722 for ; Sat, 10 Jan 2009 21:57:56 +0100 (CET) (envelope-from rabe@uugrn.org) Received: from daemon.ma.sigsys.de (localhost.ma.sigsys.de [127.0.0.1]) by daemon.ma.sigsys.de (8.14.3/8.14.2) with ESMTP id n0AKwAk5012134 for ; Sat, 10 Jan 2009 21:58:10 +0100 (CET) (envelope-from rabe@uugrn.org) Received: (from rabe@localhost) by daemon.ma.sigsys.de (8.14.3/8.14.2/Submit) id n0AKwAvU012133 for freebsd-geom@freebsd.org; Sat, 10 Jan 2009 21:58:10 +0100 (CET) (envelope-from rabe@uugrn.org) X-Authentication-Warning: daemon.ma.sigsys.de: rabe set sender to rabe@uugrn.org using -f Date: Sat, 10 Jan 2009 21:58:10 +0100 From: Raphael Becker To: freebsd-geom@freebsd.org Message-ID: <20090110205810.GA11441@ma.sigsys.de> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="liOOAslEiF7prFVr" Content-Disposition: inline User-Agent: Mutt/1.4.2.3i Subject: fsck order/parallel on /dev/ufs/* X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 10 Jan 2009 21:19:14 -0000 --liOOAslEiF7prFVr Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hi *, fsck(8) tell me about how to fsck filesystems parallel on a "per drive" basis: In preen mode, after pass 1 completes, all remaining file systems are checked, in pass number order running one process per disk drive in pa= r- allel for each pass number in increasing order. In other words: In preen mode all pass 1 partitions are checked sequen- tially. Next all pass 2 partitions are checked in parallel, one proce= ss per disk drive. Next all pass 3 partitions are checked in parallel, o= ne process per disk drive. etc. The disk drive containing each file system is inferred from the shorte= st prefix of the device name that ends in a digit; the remaining characte= rs are assumed to be the partition and slice designators. my /etc/fstab looks like this: /dev/ufs/ROOT / ufs rw 1 1 /dev/ufs/VAR /var ufs rw 2 2 /dev/ufs/USR /usr ufs rw 2 2 /dev/ufs/DATA2 /data ufs rw 2 2 /dev/ufs/SPACE /space ufs rw 2 2 /dev/ufs/MULTIMEDIA /data/multimedia ufs rw 2 2 /dev/ufs/HOME2 /home ufs rw 0 0 /dev/ufs/PRIVATE /private ufs rw 0 0 Some of the filesystems are on top of a partition/label, others are on=20 top of a geli device, others may be md-devices etc.=20 Is fsck able to find out the "real hardware"? Is fsck "geom-aware"? Regards Raphael PS: $ uname -srm FreeBSD 7.1-RELEASE i386 --=20 Raphael Becker http://rabe.uugrn.org/ GnuPG: E7B2 1D66 3AF2 EDC7 9828 6D7A 9CDA 3E7B 10CA 9F2D =2E........|.........|.........|.........|.........|.........|.........|.. --liOOAslEiF7prFVr Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.2 (FreeBSD) iD8DBQFJaQvinNo+exDKny0RAiO0AJ9e7NwfjeAurZMc7V2Frgl+2vbiVACgnXQu iveesC63mnUyzbuITgEi/68= =zhr3 -----END PGP SIGNATURE----- --liOOAslEiF7prFVr-- From owner-freebsd-geom@FreeBSD.ORG Sat Jan 10 21:27:33 2009 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 28171106566B for ; Sat, 10 Jan 2009 21:27:33 +0000 (UTC) (envelope-from phk@critter.freebsd.dk) Received: from phk.freebsd.dk (phk.freebsd.dk [130.225.244.222]) by mx1.freebsd.org (Postfix) with ESMTP id E14558FC1B for ; Sat, 10 Jan 2009 21:27:32 +0000 (UTC) (envelope-from phk@critter.freebsd.dk) Received: from critter.freebsd.dk (critter.freebsd.dk [192.168.61.3]) by phk.freebsd.dk (Postfix) with ESMTP id 7BF683F12F; Sat, 10 Jan 2009 21:27:31 +0000 (UTC) Received: from critter.freebsd.dk (localhost [127.0.0.1]) by critter.freebsd.dk (8.14.3/8.14.3) with ESMTP id n0ALRUJT095785; Sat, 10 Jan 2009 21:27:31 GMT (envelope-from phk@critter.freebsd.dk) To: Raphael Becker From: "Poul-Henning Kamp" In-Reply-To: Your message of "Sat, 10 Jan 2009 21:58:10 +0100." <20090110205810.GA11441@ma.sigsys.de> Date: Sat, 10 Jan 2009 21:27:30 +0000 Message-ID: <95784.1231622850@critter.freebsd.dk> Sender: phk@critter.freebsd.dk Cc: freebsd-geom@freebsd.org Subject: Re: fsck order/parallel on /dev/ufs/* X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 10 Jan 2009 21:27:33 -0000 In message <20090110205810.GA11441@ma.sigsys.de>, Raphael Becker writes: >Is fsck able to find out the "real hardware"? Is fsck "geom-aware"? No. -- Poul-Henning Kamp | UNIX since Zilog Zeus 3.20 phk@FreeBSD.ORG | TCP/IP since RFC 956 FreeBSD committer | BSD since 4.3-tahoe Never attribute to malice what can adequately be explained by incompetence.