From owner-freebsd-geom@FreeBSD.ORG Mon Oct 3 11:02:28 2005 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 5877516A429 for ; Mon, 3 Oct 2005 11:02:28 +0000 (GMT) (envelope-from owner-bugmaster@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [216.136.204.21]) by mx1.FreeBSD.org (Postfix) with ESMTP id F03B943D5E for ; Mon, 3 Oct 2005 11:02:10 +0000 (GMT) (envelope-from owner-bugmaster@freebsd.org) Received: from freefall.freebsd.org (peter@localhost [127.0.0.1]) by freefall.freebsd.org (8.13.3/8.13.3) with ESMTP id j93B2A3e066227 for ; Mon, 3 Oct 2005 11:02:10 GMT (envelope-from owner-bugmaster@freebsd.org) Received: (from peter@localhost) by freefall.freebsd.org (8.13.3/8.13.1/Submit) id j93B29rn066221 for freebsd-geom@freebsd.org; Mon, 3 Oct 2005 11:02:09 GMT (envelope-from owner-bugmaster@freebsd.org) Date: Mon, 3 Oct 2005 11:02:09 GMT Message-Id: <200510031102.j93B29rn066221@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: peter set sender to owner-bugmaster@freebsd.org using -f From: FreeBSD bugmaster To: freebsd-geom@FreeBSD.org Cc: Subject: Current problem reports assigned to you X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 03 Oct 2005 11:02:28 -0000 Current FreeBSD problem reports Critical problems Serious problems Non-critical problems S Submitted Tracker Resp. Description ------------------------------------------------------------------------------- o [2005/02/26] bin/78131 geom gbde "destroy" not working. o [2005/03/26] kern/79251 geom [2TB] newfs fails on 2.6TB gbde device 2 problems total. From owner-freebsd-geom@FreeBSD.ORG Thu Oct 6 17:52:26 2005 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id AA25816A420 for ; Thu, 6 Oct 2005 17:52:26 +0000 (GMT) (envelope-from josh@oplink.net) Received: from mail.oplnk.net (smtp.oplink.net [216.90.3.140]) by mx1.FreeBSD.org (Postfix) with ESMTP id 2D60143D46 for ; Thu, 6 Oct 2005 17:52:26 +0000 (GMT) (envelope-from josh@oplink.net) Received: from localhost (localhost [127.0.0.1]) by mail.oplnk.net (Postfix) with ESMTP id 0006A7546E1 for ; Thu, 6 Oct 2005 12:52:17 -0500 (CDT) Received: from mail.oplnk.net ([127.0.0.1]) by localhost (mail [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 16831-02 for ; Thu, 6 Oct 2005 12:52:17 -0500 (CDT) Received: from devious.oplink.net (devious.oplink.net [216.90.3.155]) by mail.oplnk.net (Postfix) with SMTP id DB70A7546DB for ; Thu, 6 Oct 2005 12:52:17 -0500 (CDT) Date: Thu, 6 Oct 2005 12:52:33 -0500 From: Joshua Bell To: freebsd-geom@freebsd.org Message-Id: <20051006125233.754dd00e.josh@oplink.net> Organization: Optimal Link X-Mailer: Sylpheed version 2.0.2 (GTK+ 2.6.10; i386-portbld-freebsd6.0) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Virus-and-Spam-Scanned: by oplink.net email shield Subject: GEOM's RAID level support X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 Oct 2005 17:52:26 -0000 I am sorry if this is covered in areas I was unable to view. But, from what it looks like GEOM is limited to 0/1 raid levels. Basically, what I am needing is a raid5 configuration from bootstrap. Any information that can be provided towards suggested solutions for this, is greatly appriciated. -Josh From owner-freebsd-geom@FreeBSD.ORG Thu Oct 6 19:24:39 2005 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id E6C8D16A420 for ; Thu, 6 Oct 2005 19:24:39 +0000 (GMT) (envelope-from des@des.no) Received: from tim.des.no (tim.des.no [194.63.250.121]) by mx1.FreeBSD.org (Postfix) with ESMTP id 73FF143D53 for ; Thu, 6 Oct 2005 19:24:39 +0000 (GMT) (envelope-from des@des.no) Received: from tim.des.no (localhost [127.0.0.1]) by spam.des.no (Postfix) with ESMTP id 212AD6177; Thu, 6 Oct 2005 21:24:24 +0200 (CEST) X-Spam-Tests: ALL_TRUSTED,AWL,BAYES_00 X-Spam-Learn: ham X-Spam-Score: -4.5/3.0 X-Spam-Checker-Version: SpamAssassin 3.1.0 (2005-09-13) on tim.des.no Received: from xps.des.no (des.no [80.203.228.37]) by tim.des.no (Postfix) with ESMTP id 139416152; Thu, 6 Oct 2005 21:24:24 +0200 (CEST) Received: by xps.des.no (Postfix, from userid 1001) id 5C87933C1D; Thu, 6 Oct 2005 21:01:36 +0200 (CEST) To: Joshua Bell References: <20051006125233.754dd00e.josh@oplink.net> From: des@des.no (=?iso-8859-1?q?Dag-Erling_Sm=F8rgrav?=) Date: Thu, 06 Oct 2005 21:01:36 +0200 In-Reply-To: <20051006125233.754dd00e.josh@oplink.net> (Joshua Bell's message of "Thu, 6 Oct 2005 12:52:33 -0500") Message-ID: <86r7aywju7.fsf@xps.des.no> User-Agent: Gnus/5.110002 (No Gnus v0.2) Emacs/21.3 (berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable Cc: freebsd-geom@freebsd.org Subject: Re: GEOM's RAID level support X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 Oct 2005 19:24:40 -0000 Joshua Bell writes: > I am sorry if this is covered in areas I was unable to view. But, > from what it looks like GEOM is limited to 0/1 raid levels. > Basically, what I am needing is a raid5 configuration from > bootstrap. You can't boot from a RAID 5 volume without hardware support. DES --=20 Dag-Erling Sm=F8rgrav - des@des.no From owner-freebsd-geom@FreeBSD.ORG Thu Oct 6 20:08:11 2005 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 8B9CF16A41F for ; Thu, 6 Oct 2005 20:08:11 +0000 (GMT) (envelope-from djh@nebcorp.com) Received: from ratchet.nebcorp.com (ratchet.nebcorp.com [205.217.153.72]) by mx1.FreeBSD.org (Postfix) with ESMTP id C59C843D6B for ; Thu, 6 Oct 2005 20:08:02 +0000 (GMT) (envelope-from djh@nebcorp.com) Received: by ratchet.nebcorp.com (Postfix, from userid 1014) id 3416BD9875; Thu, 6 Oct 2005 13:08:02 -0700 (PDT) Date: Thu, 6 Oct 2005 13:08:02 -0700 From: Danny Howard To: Dag-Erling Sm?rgrav Message-ID: <20051006200802.GL564@ratchet.nebcorp.com> References: <20051006125233.754dd00e.josh@oplink.net> <86r7aywju7.fsf@xps.des.no> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <86r7aywju7.fsf@xps.des.no> User-Agent: Mutt/1.4.2.1i X-Loop: djhoward@uiuc.edu Cc: Joshua Bell , freebsd-geom@freebsd.org Subject: Re: GEOM's RAID level support X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 Oct 2005 20:08:11 -0000 On Thu, Oct 06, 2005 at 09:01:36PM +0200, Dag-Erling Sm?rgrav wrote: > Joshua Bell writes: > > I am sorry if this is covered in areas I was unable to view. But, > > from what it looks like GEOM is limited to 0/1 raid levels. > > Basically, what I am needing is a raid5 configuration from > > bootstrap. > > You can't boot from a RAID 5 volume without hardware support. Has anyone a recipe for a RAID1,0 bootstrap? :) -danny From owner-freebsd-geom@FreeBSD.ORG Thu Oct 6 20:16:25 2005 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id CD95A16A41F for ; Thu, 6 Oct 2005 20:16:25 +0000 (GMT) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.FreeBSD.org (Postfix) with ESMTP id 35DAF43D46 for ; Thu, 6 Oct 2005 20:16:25 +0000 (GMT) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id B010350BC1; Thu, 6 Oct 2005 22:16:23 +0200 (CEST) Received: from localhost (dlc37.neoplus.adsl.tpnet.pl [83.24.32.37]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id B1EC150B99; Thu, 6 Oct 2005 22:16:18 +0200 (CEST) Date: Thu, 6 Oct 2005 22:16:16 +0200 From: Pawel Jakub Dawidek To: Danny Howard Message-ID: <20051006201616.GE26614@garage.freebsd.pl> References: <20051006125233.754dd00e.josh@oplink.net> <86r7aywju7.fsf@xps.des.no> <20051006200802.GL564@ratchet.nebcorp.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="TD8GDToEDw0WLGOL" Content-Disposition: inline In-Reply-To: <20051006200802.GL564@ratchet.nebcorp.com> X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng devel (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-0.5 required=3.0 tests=BAYES_00,RCVD_IN_NJABL_DUL, RCVD_IN_SORBS_DUL autolearn=no version=3.0.4 Cc: Dag-Erling Sm?rgrav , freebsd-geom@freebsd.org, Joshua Bell Subject: Re: GEOM's RAID level support X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 Oct 2005 20:16:25 -0000 --TD8GDToEDw0WLGOL Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Oct 06, 2005 at 01:08:02PM -0700, Danny Howard wrote: +> On Thu, Oct 06, 2005 at 09:01:36PM +0200, Dag-Erling Sm?rgrav wrote: +> > Joshua Bell writes: +> > > I am sorry if this is covered in areas I was unable to view. But, +> > > from what it looks like GEOM is limited to 0/1 raid levels. +> > > Basically, what I am needing is a raid5 configuration from +> > > bootstrap. +> >=20 +> > You can't boot from a RAID 5 volume without hardware support. +>=20 +> Has anyone a recipe for a RAID1,0 bootstrap? :) Forget it. Everything which splits the data across disks will not work. With software RAID you can operate on disks, slices, partitions, etc. no limits here. I'd suggest creating small RAID1 on top of small partitions for the root file system (or at least for /boot/ directory, which is minimum). --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --TD8GDToEDw0WLGOL Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.1 (FreeBSD) iD8DBQFDRYYQForvXbEpPzQRAjSCAKC0prLt1CANA/cCGuAbZKAvW3whwQCfYapT EQRD8vd2SDB1GLqavYa1sqE= =hCJD -----END PGP SIGNATURE----- --TD8GDToEDw0WLGOL-- From owner-freebsd-geom@FreeBSD.ORG Thu Oct 6 20:27:00 2005 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 6D46216A41F; Thu, 6 Oct 2005 20:27:00 +0000 (GMT) (envelope-from djh@nebcorp.com) Received: from ratchet.nebcorp.com (ratchet.nebcorp.com [205.217.153.72]) by mx1.FreeBSD.org (Postfix) with ESMTP id 3A16C43D46; Thu, 6 Oct 2005 20:27:00 +0000 (GMT) (envelope-from djh@nebcorp.com) Received: by ratchet.nebcorp.com (Postfix, from userid 1014) id 1CD18D9848; Thu, 6 Oct 2005 13:27:00 -0700 (PDT) Date: Thu, 6 Oct 2005 13:27:00 -0700 From: Danny Howard To: Pawel Jakub Dawidek Message-ID: <20051006202700.GM564@ratchet.nebcorp.com> References: <20051006125233.754dd00e.josh@oplink.net> <86r7aywju7.fsf@xps.des.no> <20051006200802.GL564@ratchet.nebcorp.com> <20051006201616.GE26614@garage.freebsd.pl> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20051006201616.GE26614@garage.freebsd.pl> User-Agent: Mutt/1.4.2.1i X-Loop: djhoward@uiuc.edu Cc: Dag-Erling Sm?rgrav , freebsd-geom@freebsd.org, Joshua Bell Subject: Re: GEOM's RAID level support X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 Oct 2005 20:27:00 -0000 On Thu, Oct 06, 2005 at 10:16:16PM +0200, Pawel Jakub Dawidek wrote: > On Thu, Oct 06, 2005 at 01:08:02PM -0700, Danny Howard wrote: > +> Has anyone a recipe for a RAID1,0 bootstrap? :) > > Forget it. Everything which splits the data across disks will not work. > With software RAID you can operate on disks, slices, partitions, etc. > no limits here. I'd suggest creating small RAID1 on top of small > partitions for the root file system (or at least for /boot/ directory, > which is minimum). Well, I have RAID1 systems ... It seems reasonable to conclude that one could set up / as a RAID1 on the first pair of disks, and bootstrap far enough to include swap, /var, and /usr from a RAID10 stretched across a full-disk set. It just sounds somewhat tricky to set it all up, is all, so if someone has grokked out a recipe ... :) -danny From owner-freebsd-geom@FreeBSD.ORG Thu Oct 6 20:41:00 2005 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 7857F16A41F for ; Thu, 6 Oct 2005 20:41:00 +0000 (GMT) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.FreeBSD.org (Postfix) with ESMTP id 9288343D45 for ; Thu, 6 Oct 2005 20:40:59 +0000 (GMT) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 8194B50B99; Thu, 6 Oct 2005 22:40:57 +0200 (CEST) Received: from localhost (dlc37.neoplus.adsl.tpnet.pl [83.24.32.37]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id 155F050B1C; Thu, 6 Oct 2005 22:40:38 +0200 (CEST) Date: Thu, 6 Oct 2005 22:40:36 +0200 From: Pawel Jakub Dawidek To: Danny Howard Message-ID: <20051006204036.GF26614@garage.freebsd.pl> References: <20051006125233.754dd00e.josh@oplink.net> <86r7aywju7.fsf@xps.des.no> <20051006200802.GL564@ratchet.nebcorp.com> <20051006201616.GE26614@garage.freebsd.pl> <20051006202700.GM564@ratchet.nebcorp.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="Wb5NtZlyOqqy58h0" Content-Disposition: inline In-Reply-To: <20051006202700.GM564@ratchet.nebcorp.com> X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng devel (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-0.5 required=3.0 tests=BAYES_00,RCVD_IN_NJABL_DUL, RCVD_IN_SORBS_DUL autolearn=no version=3.0.4 Cc: Dag-Erling Sm?rgrav , freebsd-geom@freebsd.org, Joshua Bell Subject: Re: GEOM's RAID level support X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 Oct 2005 20:41:00 -0000 --Wb5NtZlyOqqy58h0 Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Oct 06, 2005 at 01:27:00PM -0700, Danny Howard wrote: +> On Thu, Oct 06, 2005 at 10:16:16PM +0200, Pawel Jakub Dawidek wrote: +> > On Thu, Oct 06, 2005 at 01:08:02PM -0700, Danny Howard wrote: +>=20 +> > +> Has anyone a recipe for a RAID1,0 bootstrap? :) +> >=20 +> > Forget it. Everything which splits the data across disks will not work. +> > With software RAID you can operate on disks, slices, partitions, etc. +> > no limits here. I'd suggest creating small RAID1 on top of small +> > partitions for the root file system (or at least for /boot/ directory, +> > which is minimum). +>=20 +> Well, I have RAID1 systems ... +>=20 +> It seems reasonable to conclude that one could set up / as a RAID1 on +> the first pair of disks, and bootstrap far enough to include swap, /var, +> and /usr from a RAID10 stretched across a full-disk set. It just sounds +> somewhat tricky to set it all up, is all, so if someone has grokked out +> a recipe ... :) This is one of mine setups (5 SATA disks): beast:root:~# df -h -t ufs Filesystem Size Used Avail Capacity Mounted on /dev/mirror/root 1.9G 228M 1.6G 13% / /dev/raid3/usr 3.9G 1.9G 1.7G 53% /usr /dev/raid3/data 570G 99G 425G 19% /usr/home beast:root:~# graid3 status Name Status Components raid3/data COMPLETE ad0s1d ad1s1d ad2s1d ad3s1d ad4s1d raid3/usr COMPLETE ad1s1a ad3s1a ad4s1a beast:root:~# gmirror status Name Status Components mirror/root COMPLETE ad0s1a ad2s1a Next one (RAID1 on three components for root): puppet:root:~# df -h -t ufs Filesystem Size Used Avail Capacity Mounted on /dev/mirror/root 989M 77M 833M 9% / /dev/raid3/usr 3.9G 1.5G 2.0G 43% /usr /dev/raid3/home 56G 1.6G 50G 3% /usr/home puppet:root:~# gmirror status Name Status Components mirror/root COMPLETE da0s1a da1s1a da2s1a puppet:root:~# graid3 status Name Status Components raid3/usr COMPLETE da0s1d da1s1d da2s1d raid3/home COMPLETE da0s1e da1s1e da2s1e But on most of my systems, I've simple RAID1 (this time on whole disks): whiplash:root:~# df -h -t ufs Filesystem Size Used Avail Capacity Mounted on /dev/mirror/COREs1a 989M 53M 857M 6% / /dev/mirror/COREs1d 15G 1.8G 12G 12% /usr whiplash:root:~# gmirror status Name Status Components mirror/CORE COMPLETE da0 da1 My home machine is most interesting (RAID3 is configured on top of two slices and one disk): slayer:root:~# egrep '^ad[0-9]+' /var/run/dmesg.boot ad0: 152627MB at ata0-master UDMA100 ad1: 76319MB at ata1-master UDMA100 ad2: 114473MB at ata2-master UDMA100 ad3: 152627MB at ata3-master UDMA100 slayer:root:~# df -h -t ufs Filesystem Size Used Avail Capacity Mounted on /dev/mirror/COREa 1.9G 687M 1.1G 38% / /dev/mirror/COREd 33G 23G 7.7G 75% /usr /dev/raid3/STUFF 217G 214G 626M 100% /var/ftp slayer:root:~# gmirror status Name Status Components mirror/CORE COMPLETE ad0s1 ad3s1 slayer:root:~# graid3 status Name Status Components raid3/STUFF COMPLETE ad0s2 ad2 ad3s2 Just use your imagination:) --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --Wb5NtZlyOqqy58h0 Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.1 (FreeBSD) iD8DBQFDRYvDForvXbEpPzQRAo2gAJ9IONlLUjiKXZUCrFdsjFRf0L06SgCg0Pnh Ir/9wrqLvjSpDGhablRAWXk= =FPB2 -----END PGP SIGNATURE----- --Wb5NtZlyOqqy58h0-- From owner-freebsd-geom@FreeBSD.ORG Sat Oct 8 01:35:26 2005 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 3B84116A423 for ; Sat, 8 Oct 2005 01:35:26 +0000 (GMT) (envelope-from aw1@stade.co.uk) Received: from lon-mail-1.gradwell.net (lon-mail-1.gradwell.net [193.111.201.125]) by mx1.FreeBSD.org (Postfix) with ESMTP id 6DE5643D46 for ; Sat, 8 Oct 2005 01:35:25 +0000 (GMT) (envelope-from aw1@stade.co.uk) Received: from alsager-adsl.stade.co.uk ([81.6.222.119] helo=access2.hanley.stade.co.uk) by lon-mail-1.gradwell.net with esmtp (Gradwell gwh-smtpd 1.190) id 4347225b.41f.1b9c for freebsd-geom@freebsd.org; Sat, 8 Oct 2005 02:35:23 +0100 (envelope-sender ) Received: from titus.hanley.stade.co.uk (titus [192.168.1.5]) by access2.hanley.stade.co.uk (8.13.4/8.13.3) with ESMTP id j981ZN7i012000 for ; Sat, 8 Oct 2005 02:35:23 +0100 (BST) (envelope-from aw1@titus.hanley.stade.co.uk) Received: from titus.hanley.stade.co.uk (localhost [127.0.0.1]) by titus.hanley.stade.co.uk (8.12.11/8.12.11) with ESMTP id j981ZMQR056946 for ; Sat, 8 Oct 2005 02:35:22 +0100 (BST) (envelope-from aw1@titus.hanley.stade.co.uk) Received: (from aw1@localhost) by titus.hanley.stade.co.uk (8.12.11/8.12.11/Submit) id j981ZLxB056945 for freebsd-geom@freebsd.org; Sat, 8 Oct 2005 02:35:21 +0100 (BST) (envelope-from aw1) Date: Sat, 8 Oct 2005 02:35:21 +0100 From: Adrian Wontroba To: freebsd-geom@freebsd.org Message-ID: <20051008023521.D55180@titus.hanley.stade.co.uk> References: <20051006125233.754dd00e.josh@oplink.net> <86r7aywju7.fsf@xps.des.no> <20051006200802.GL564@ratchet.nebcorp.com> <20051006201616.GE26614@garage.freebsd.pl> <20051006202700.GM564@ratchet.nebcorp.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.2i In-Reply-To: <20051006202700.GM564@ratchet.nebcorp.com>; from dannyman@toldme.com on Thu, Oct 06, 2005 at 01:27:00PM -0700 X-Operating-System: FreeBSD 4.10-STABLE Organization: Oh dear, I've joined one again. X-Virus-Scanned: ClamAV 0.86.1/1121/Fri Oct 7 18:38:02 2005 on access2.hanley.stade.co.uk X-Virus-Status: Clean Subject: Re: GEOM's RAID level support X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: aw1@stade.co.uk List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 08 Oct 2005 01:35:26 -0000 On Thu, Oct 06, 2005 at 01:27:00PM -0700, Danny Howard wrote: > Well, I have RAID1 systems ... I've just reworked one of my home systems, doubling its disk capacity. I started with a pretty standard gmirrored two disk system, added another Promise controller and another pair of (nearly) identical disks, setting up the new disks as: Mirrored root (gm0). Single plex mirror of swap (gm1) or Single plex mirror of /var and /usr (gm2) Rest of the space striped (gs0), underneath a single plex mirror of /home (gm3) When I'd got the new mirrors working, I manually amended /etc/fstab etc, booted from them and setup the other stripes/ plexes on the original disks, ending up with four plexes for /root and two for everything else. With the ATA write cache enabled it flies. With the write cache disabled it crawls. Must buy a UPS. The end result looks like: bash-2.05b# gmirror status Name Status Components mirror/gm0 COMPLETE ad4a ad6a ad8a ad10a mirror/gm1 COMPLETE ad4d ad8d mirror/gm2 COMPLETE ad6d ad10d mirror/gm3 COMPLETE stripe/gs1 stripe/gs0 bash-2.05b# gstripe status Name Status Components stripe/gs1 UP ad4e ad6e stripe/gs0 UP ad8e ad10e bash-2.05b# df Filesystem 1K-blocks Used Avail Capacity Mounted on /dev/mirror/gm0 1012972 56370 875566 6% / devfs 1 1 0 100% /dev /dev/mirror/gm2d 1012974 18558 913380 2% /var /dev/mirror/gm2e 3045004 1398126 1403278 50% /usr /dev/mirror/gm3 292588412 74542894 194638446 28% /home /dev/md0 1012974 284 931654 0% /tmp bash-2.05b# swapinfo Device 1K-blocks Used Avail Capacity /dev/mirror/gm1 4194300 148 4194152 0% I set the system up with a Makefile and some initial disk labels (below my sig) and lots of trial and error, executing make zap, make label_disks, etc. No doubt less than perfect, but it worked for me. At work, I've developed a makefile based version of RSE's "single disk to two disk" approach. If there is any interest, I'll ask my boss if I can release it. Is anybody doing anything about: Making systinstall GEOM aware? Putting RSE's excellent instructions in the handbook? -- Adrian Wontroba ==> Makefile <== clear: # stop and clear anything left over from last attempt @logger -p crit "clear" -gmirror stop -v gm3 -gmirror clear -v stripe/gs0 -gstripe stop -v gs0 -gstripe clear -v ad8e ad10e -gmirror stop -v gm2 -gmirror clear -v ad10d -gmirror stop -v gm1 -gmirror clear -v ad8d -gmirror stop -v gm0 -gmirror clear -v ad8a ad10a zap: # zap the front of the disks @logger -p crit "zap" dd if=/dev/zero of=/dev/ad8 count=100 dd if=/dev/zero of=/dev/ad10 count=100 label_disks: # label disks @logger -p crit "label disks" fdisk -v -B -I /dev/ad8 fdisk -v -B -I /dev/ad10 bsdlabel -w -B ad8 bsdlabel -w -B ad10 label_partitions: @logger -p crit "label slices" bsdlabel -R ad8 initial_ad8.label bsdlabel ad8 > ad8.label bsdlabel -R ad10 initial_ad10.label bsdlabel ad10 > ad10.label mirrors: # bring on the mirrors @logger -p crit "gm0" gmirror label -v -h -n -b round-robin gm0 ad8a ad10a @logger -p crit "gm1" gmirror label -v -h -n -b round-robin gm1 ad8d @logger -p crit "gm2" gmirror label -v -h -n -b round-robin gm2 ad10d @logger -p crit "gs0" gstripe label -v -h gs0 ad8e ad10e @logger -p crit "gm3" gmirror label -v -h -n -b round-robin gm3 stripe/gs0 label_mirrors: # label the mirrors which contain more than one filesystem # gm2 contains d: var and e: usr bsdlabel -w mirror/gm2 bsdlabel -R mirror/gm2 initial_gm2.label bsdlabel mirror/gm2 > gm2.label newfs: # newfs the filesystems # gm1 is swap, doesn't need newfs newfs -U /dev/mirror/gm0 | tee gm0.newfs newfs -U /dev/mirror/gm2d | tee gm2d.newfs newfs -U /dev/mirror/gm2e | tee gm2e.newfs newfs -U /dev/mirror/gm3 | tee gm3.newfs restore_root: # dump and restore root filesystem mount /dev/mirror/gm0 /mnt; dump -L -C 32 -0 -f- / | (cd /mnt; restore -r -f-) restore_rest: # dump and restore other filesystem mount /dev/mirror/gm2d /mnt/var; dump -L -C 32 -0 -f- /var | (cd /mnt/var; restore -r -f-) mount /dev/mirror/gm2e /mnt/usr; dump -L -C 32 -0 -f- /usr | (cd /mnt/usr; restore -r -f-) mount /dev/mirror/gm3 /mnt/home; dump -L -C 32 -0 -f- /home | (cd /mnt/home; restore -r -f-) zap1: # zap the front of the disks @logger -p crit "zap" dd if=/dev/zero of=/dev/ad4 count=100 dd if=/dev/zero of=/dev/ad6 count=100 label_disks1: # label disks @logger -p crit "label disks" fdisk -v -B -I /dev/ad4 fdisk -v -B -I /dev/ad6 bsdlabel -w -B ad4 bsdlabel -w -B ad6 label_partitions1: @logger -p crit "label slices" bsdlabel -R ad4 initial_ad4.label bsdlabel ad4 > ad4.label bsdlabel -R ad6 initial_ad6.label bsdlabel ad6 > ad6.label mirrors1: # bring on the mirror plexes @logger -p crit "gm0" gmirror insert -v -h gm0 ad4a ad6a @logger -p crit "gm1" gmirror insert -v -h gm1 ad4d @logger -p crit "gm2" gmirror insert -v -h gm2 ad6d @logger -p crit "gs1" gstripe label -v -h gs1 ad4e ad6e @logger -p crit "gm3" gmirror insert -v -h gm3 stripe/gs1 auto1: # configure mirrors for automatic recovery gmirror configure -v -h -a gm0 gmirror configure -v -h -a gm1 gmirror configure -v -h -a gm2 gmirror configure -v -h -a gm3 ==> initial_ad10.label <== # /dev/ad8: 8 partitions: # size offset fstype [fsize bsize bps/cpg] c: 312581808 0 unused 0 0 # "raw" part, don't edit a: 1G * 4.2BSD 0 0 d: 4G * 4.2BSD 0 0 e: * * 4.2BSD 0 0 ==> initial_ad10s1.label <== # /dev/ad8s1: 8 partitions: # size offset fstype [fsize bsize bps/cpg] a: 1G * 4.2BSD 0 0 c: 312581745 0 unused 0 0 # "raw" part, don't edit d: 4G * 4.2BSD 0 0 e: * * 4.2BSD 0 0 ==> initial_ad4.label <== # /dev/ad8: 8 partitions: # size offset fstype [fsize bsize bps/cpg] c: 312581808 0 unused 0 0 # "raw" part, don't edit a: 1G * 4.2BSD 0 0 d: 4G * 4.2BSD 0 0 e: * * 4.2BSD 0 0 ==> initial_ad6.label <== # /dev/ad8: 8 partitions: # size offset fstype [fsize bsize bps/cpg] c: 312581808 0 unused 0 0 # "raw" part, don't edit a: 1G * 4.2BSD 0 0 d: 4G * 4.2BSD 0 0 e: * * 4.2BSD 0 0 ==> initial_ad8.label <== # /dev/ad8: 8 partitions: # size offset fstype [fsize bsize bps/cpg] c: 312581808 0 unused 0 0 # "raw" part, don't edit a: 1G * 4.2BSD 0 0 d: 4G * 4.2BSD 0 0 e: * * 4.2BSD 0 0 ==> initial_ad8s1.label <== # /dev/ad8s1: 8 partitions: # size offset fstype [fsize bsize bps/cpg] a: 1G * 4.2BSD 0 0 c: 312581745 0 unused 0 0 # "raw" part, don't edit d: 4G * 4.2BSD 0 0 e: * * 4.2BSD 0 0 ==> initial_gm1.label~ <== # /dev/mirror/gm1: 8 partitions: # size offset fstype [fsize bsize bps/cpg] a: 8388591 16 unused 0 0 c: 8388607 0 unused 0 0 # "raw" part, don't edit ==> initial_gm2.label <== # /dev/mirror/gm1: 8 partitions: # size offset fstype [fsize bsize bps/cpg] c: 8388607 0 unused 0 0 # "raw" part, don't edit d: 1G * 4.2BSD 0 0 e: * * 4.2BSD 0 0 From owner-freebsd-geom@FreeBSD.ORG Sat Oct 8 06:58:05 2005 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id B633916A41F for ; Sat, 8 Oct 2005 06:58:05 +0000 (GMT) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.FreeBSD.org (Postfix) with ESMTP id 17C5843D46 for ; Sat, 8 Oct 2005 06:58:05 +0000 (GMT) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 4271050C1F; Sat, 8 Oct 2005 08:58:03 +0200 (CEST) Received: from localhost (bmn111.neoplus.adsl.tpnet.pl [83.28.233.111]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id 0577F50C0C; Sat, 8 Oct 2005 08:57:56 +0200 (CEST) Date: Sat, 8 Oct 2005 08:57:51 +0200 From: Pawel Jakub Dawidek To: Adrian Wontroba Message-ID: <20051008065751.GC1000@garage.freebsd.pl> References: <20051006125233.754dd00e.josh@oplink.net> <86r7aywju7.fsf@xps.des.no> <20051006200802.GL564@ratchet.nebcorp.com> <20051006201616.GE26614@garage.freebsd.pl> <20051006202700.GM564@ratchet.nebcorp.com> <20051008023521.D55180@titus.hanley.stade.co.uk> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="qtZFehHsKgwS5rPz" Content-Disposition: inline In-Reply-To: <20051008023521.D55180@titus.hanley.stade.co.uk> X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng devel (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-0.5 required=3.0 tests=BAYES_00,RCVD_IN_NJABL_DUL, RCVD_IN_SORBS_DUL autolearn=no version=3.0.4 Cc: freebsd-geom@freebsd.org Subject: Re: GEOM's RAID level support X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 08 Oct 2005 06:58:05 -0000 --qtZFehHsKgwS5rPz Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sat, Oct 08, 2005 at 02:35:21AM +0100, Adrian Wontroba wrote: +> The end result looks like: +>=20 +> bash-2.05b# gmirror status +> Name Status Components +> mirror/gm0 COMPLETE ad4a +> ad6a +> ad8a +> ad10a Isn't that waste of space? I see your /var/ file system is the same size as / file system, so creating two mirrors (ad4a+ad6a) for / and (ad8a+ad10a) for /var/ will save you some space. +> I set the system up with a Makefile and some initial disk labels +> (below my sig) and lots of trial and error, executing make zap, make +> label_disks, etc. No doubt less than perfect, but it worked for me. +>=20 +> At work, I've developed a makefile based version of RSE's "single disk +> to two disk" approach. If there is any interest, I'll ask my boss if I +> can release it. Nice idea, but I think at this point it is too much specific for you configuration. It'd be much useful when it will be more general somehow. +> Is anybody doing anything about: +> Making systinstall GEOM aware? Yes, Craig Rodrigues (rodrigc@) is working on it. +> Putting RSE's excellent instructions in the handbook? Not sure about this one. --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --qtZFehHsKgwS5rPz Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.1 (FreeBSD) iD8DBQFDR23vForvXbEpPzQRAs6OAJ4j+0Moq7qmbZECS/uvPEiHSe5T3wCeIZn1 caNMEectxQMcq6hg+VVVJZc= =qA2S -----END PGP SIGNATURE----- --qtZFehHsKgwS5rPz--