From owner-freebsd-stable@FreeBSD.ORG Wed Jun 22 10:37:06 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5EB461065674 for ; Wed, 22 Jun 2011 10:37:06 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from qmta01.westchester.pa.mail.comcast.net (qmta01.westchester.pa.mail.comcast.net [76.96.62.16]) by mx1.freebsd.org (Postfix) with ESMTP id 0AAF58FC1D for ; Wed, 22 Jun 2011 10:37:05 +0000 (UTC) Received: from omta01.westchester.pa.mail.comcast.net ([76.96.62.11]) by qmta01.westchester.pa.mail.comcast.net with comcast id yyam1g0020EZKEL51yd6qF; Wed, 22 Jun 2011 10:37:06 +0000 Received: from koitsu.dyndns.org ([67.180.84.87]) by omta01.westchester.pa.mail.comcast.net with comcast id yyd41g00m1t3BNj3Myd5yL; Wed, 22 Jun 2011 10:37:06 +0000 Received: by icarus.home.lan (Postfix, from userid 1000) id 42587102C36; Wed, 22 Jun 2011 03:37:03 -0700 (PDT) Date: Wed, 22 Jun 2011 03:37:03 -0700 From: Jeremy Chadwick To: Alexander Motin Message-ID: <20110622103703.GA14901@icarus.home.lan> References: <20110618005124.GA43568@icarus.home.lan> <20110621191626.GA99204@icarus.home.lan> <4E01AFBA.809@FreeBSD.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <4E01AFBA.809@FreeBSD.org> User-Agent: Mutt/1.5.21 (2010-09-15) Cc: freebsd-fs@freebsd.org, freebsd-stable@freebsd.org Subject: Re: MFC: graid(8) (RAID GEOM) support X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Jun 2011 10:37:06 -0000 On Wed, Jun 22, 2011 at 12:02:50PM +0300, Alexander Motin wrote: > Jeremy Chadwick wrote: > > On Fri, Jun 17, 2011 at 05:51:24PM -0700, Jeremy Chadwick wrote: > >> Sorry for the cross-post, but I thought both lists would want to know > >> about this. > >> > >> Looks like mav@ just committed this ~17 hours ago: > >> http://www.freebsd.org/cgi/cvsweb.cgi/src/sys/geom/raid/g_raid.c > >> > >> Those who have historically wanted to use Intel MatrixRAID (now called > >> Intel RST (Rapid Storage Technology)), but haven't due to the severe > >> issues/risks with ataraid(4), will probably be very interested in > >> this commit. I know I am! > >> > >> I plan on stress-testing the Intel support on a 2-disk system with > >> RAID-1 enabled, and will document my experiences, procedures, etc... > >> > >> Thanks, mav@ and imp@ ! > >> > >> I'll be sending another mail momentarily asking about USB memory stick > >> image building, since to accomplish the above, I want to do a > >> "bare-bones" install on our test system (e.g. enable Intel RAID, set up > >> 2 disks in a RAID-1 mirror, boot a USB memory stick that contains this > >> latest RELENG_8 build, and do sysinstall, etc.. the normal way). > >> > >> > >> ===================================================================== > >> MFC r219974, r220209, r220210, r220790: > >> Add new RAID GEOM class, that is going to replace ataraid(4) in supporting > >> various BIOS-based software RAIDs. Unlike ataraid(4) this implementation > >> does not depend on legacy ata(4) subsystem and can be used with any disk > >> drivers, including new CAM-based ones (ahci(4), siis(4), mvs(4), ata(4) > >> with `options ATA_CAM`). To make code more readable and extensible, this > >> implementation follows modular design, including core part and two sets > >> of modules, implementing support for different metadata formats and RAID > >> levels. > >> > >> Support for such popular metadata formats is now implemented: > >> Intel, JMicron, NVIDIA, Promise (also used by AMD/ATI) and SiliconImage. > >> > >> Such RAID levels are now supported: > >> RAID0, RAID1, RAID1E, RAID10, SINGLE, CONCAT. > >> > >> For all of these RAID levels and metadata formats this class supports > >> full cycle of volume operations: reading, writing, creation, deletion, > >> disk removal and insertion, rebuilding, dirty shutdown detection > >> and resynchronization, bad sector recovery, faulty disks tracking, > >> hot-spare disks. For Intel and Promise formats there is support multiple > >> volumes per disk set. > >> > >> Look graid(8) manual page for additional details. > >> > >> Co-authored by: imp > >> Sponsored by: Cisco Systems, Inc. and iXsystems, Inc. > >> ===================================================================== > > > > By the way, it doesn't look like the graid(8) man page is being brought > > in to the base system on either of the two RELENG_8 systems I've rebuilt > > in the past few days. > > > > I'm thinking /usr/src/sbin/geom/class/raid/graid.8 isn't being noticed > > as a man page. > > > > /usr/src/sbin/geom/class/raid/Makefile doesn't have MAN8=graid.8 in it, > > is that the problem? > > I've just rebuilt my test 8-STABLE system and it installed graid(8). Hmm, there must be something I'm missing either in the base system or the kernel or both. Does this kernel module and/or bits and pieces not get built unless it's included strictly in the kernel? Below is one of the two systems, looking for both graid* and geom_raid*. There's the old geom_raid3 stuff there, and the source bits/pieces for the new graid(8), but nothing seems built (including kernel module) for the new graid(8). If you'd like I can rm -fr /usr/src/* ; rm -fr /var/db/sup/src-all and then re-download source from an official cvsup mirror (I've been using cvsup9.freebsd.org for both boxes). icarus# uname -a FreeBSD icarus.home.lan 8.2-STABLE FreeBSD 8.2-STABLE #0: Fri Jun 17 18:01:45 PDT 2011 root@icarus.home.lan:/usr/obj/usr/src/sys/X7SBA_RELENG_8_amd64 amd64 icarus# find /usr -name "graid*" -ls 3211128 8 -r--r--r-- 1 root wheel 2521 Jun 17 18:25 /usr/share/man/man8/graid3.8.gz 169318 16 -rw-r--r-- 1 root wheel 6390 Aug 3 2009 /usr/src/sbin/geom/class/raid3/graid3.8 169624 16 -rw-r--r-- 1 root wheel 8126 Jun 16 23:59 /usr/src/sbin/geom/class/raid/graid.8 921430 8 -rw-r--r-- 1 root wheel 2521 Jun 17 17:51 /usr/obj/usr/src/sbin/geom/class/raid3/graid3.8.gz 3369372 4 drwxr-xr-x 2 root wheel 512 May 3 03:58 /usr/ports/sysutils/graid5 icarus# icarus# find /boot -name "graid*" -ls icarus# icarus# find /usr -name "geom_raid*" -ls 169317 20 -rw-r--r-- 1 root wheel 9257 Jan 18 21:13 /usr/src/sbin/geom/class/raid3/geom_raid3.c 165265 8 -rw-r--r-- 1 root wheel 2992 Jun 16 23:59 /usr/src/sbin/geom/class/raid/geom_raid.c 259652 4 drwxr-xr-x 2 root wheel 512 Jun 6 06:28 /usr/src/sys/modules/geom/geom_raid3 285292 4 drwxr-xr-x 2 root wheel 512 Jun 17 17:17 /usr/src/sys/modules/geom/geom_raid 262798 4 drwxr-xr-x 2 root wheel 512 Jun 6 06:29 /usr/src/tools/regression/geom_raid3 921428 48 -rw-r--r-- 1 root wheel 22760 Jun 17 17:51 /usr/obj/usr/src/sbin/geom/class/raid3/geom_raid3.So 921431 64 -rwxr-xr-x 1 root wheel 32207 Jun 17 17:51 /usr/obj/usr/src/sbin/geom/class/raid3/geom_raid3.so 1014175 4 drwxr-xr-x 2 root wheel 512 Jun 17 18:00 /usr/obj/usr/src/sys/X7SBA_RELENG_8_amd64/modules/usr/src/sys/modules/geom/geom_raid3 1015257 736 -rw-r--r-- 1 root wheel 359456 Jun 17 18:00 /usr/obj/usr/src/sys/X7SBA_RELENG_8_amd64/modules/usr/src/sys/modules/geom/geom_raid3/geom_raid3.ko.debug 1015258 640 -rw-r--r-- 1 root wheel 304432 Jun 17 18:00 /usr/obj/usr/src/sys/X7SBA_RELENG_8_amd64/modules/usr/src/sys/modules/geom/geom_raid3/geom_raid3.ko.symbols 1015259 272 -rw-r--r-- 1 root wheel 137448 Jun 17 18:00 /usr/obj/usr/src/sys/X7SBA_RELENG_8_amd64/modules/usr/src/sys/modules/geom/geom_raid3/geom_raid3.ko icarus# icarus# find /boot -name "geom_raid*" -ls 94943 272 -r-xr-xr-x 1 root wheel 137448 Jun 17 18:24 /boot/kernel/geom_raid3.ko 94944 640 -r-xr-xr-x 1 root wheel 304432 Jun 17 18:24 /boot/kernel/geom_raid3.ko.symbols 71074 272 -r-xr-xr-x 1 root wheel 137448 Jun 6 05:35 /boot/kernel.old/geom_raid3.ko 71075 640 -r-xr-xr-x 1 root wheel 304432 Jun 6 05:35 /boot/kernel.old/geom_raid3.ko.symbols -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, US | | Making life hard for others since 1977. PGP 4BD6C0CB |