From owner-freebsd-current@FreeBSD.ORG Tue Nov 6 18:53:17 2007 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 2880B16A468 for ; Tue, 6 Nov 2007 18:53:17 +0000 (UTC) (envelope-from john@jnielsen.net) Received: from ns1.jnielsen.net (ns1.jnielsen.net [69.55.238.237]) by mx1.freebsd.org (Postfix) with ESMTP id EC25413C480 for ; Tue, 6 Nov 2007 18:53:16 +0000 (UTC) (envelope-from john@jnielsen.net) Received: from ns1.jnielsen.net (jn@ns1 [69.55.238.237]) by ns1.jnielsen.net (8.12.9p2/8.12.9) with ESMTP id lA6IHg69008544; Tue, 6 Nov 2007 13:17:42 -0500 (EST) (envelope-from john@jnielsen.net) Received: (from www@localhost) by ns1.jnielsen.net (8.12.9p2/8.12.9/Submit) id lA6IHgjJ008542; Tue, 6 Nov 2007 13:17:42 -0500 (EST) (envelope-from john@jnielsen.net) X-Authentication-Warning: ns1.jnielsen.net: www set sender to john@jnielsen.net using -f Received: from nc-2wac-zop09.wachovia.com (nc-2wac-zop09.wachovia.com [162.111.235.21]) by newwebmail.jnielsen.net (Horde MIME library) with HTTP; Tue, 06 Nov 2007 13:17:41 -0500 Message-ID: <20071106131741.grldkfpy80s4sw0w@newwebmail.jnielsen.net> Date: Tue, 06 Nov 2007 13:17:41 -0500 From: John Nielsen To: "fluffles.net" References: <47307736.9060900@fluffles.net> In-Reply-To: <47307736.9060900@fluffles.net> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format="flowed" Content-Disposition: inline Content-Transfer-Encoding: quoted-printable User-Agent: Internet Messaging Program (IMP) H3 (4.0.4) / FreeBSD-4.9 X-Virus-Scanned: ClamAV version 0.88.4, clamav-milter version 0.88.4 on ns1.jnielsen.net X-Virus-Status: Clean X-Mailman-Approved-At: Tue, 06 Nov 2007 18:54:40 +0000 Cc: freebsd-current@freebsd.org, Arne Woerner Subject: Re: geom_raid5 inclusion in HEAD? X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Nov 2007 18:53:17 -0000 Quoting "fluffles.net" : > I was wondering if and when the excellent geom_raid5 module created > by Arne W=F6rner would be committed to HEAD or releng_7. Right now > there's gvinum with RAID5 support and geom_raid3. The latter is nice > but only works with a 'strange' number of disks (3,5,9,17,33, etc) > and has the disadvantages associated with RAID3 (no parallel access; > all disks are involved in one single write operation), while gvinum > offers poor RAID5 write performance (~20MB/s in my testings). > > geom_raid5, on the other hand, offers excellent performance due to > write combining, that allows 2-phase requests to be converted into > 1-phase requests. This is achieved by waiting for contiguous requests > and splitting those into the 'full stripe', meaning: stripesize * ( > number_of_disks - 1). This way, no parity information has to be read > from any disk since all required data is already in memory. In normal > english this means excellent sequential performance. In my own > testings i have achieved over 400MB/s of RAID5 write performance > using a simple "dd if=3D/dev/zero of=3D/dev/raid5/data bs=3D1m" of at lea= st > 10GB worth of data. raidtest benchmarks show that geom_raid5 scales > nicely with the number of disks, though ofcourse RAID5's weak point > is random write. > > Considering this project has been around for quite a while, and > sister project FreeNAS has been using it for more than a year in > their official (stable) branch, i think it should become available in > the official FreeBSD distribution as well. I don't know who decides > on this, but i would like to get a discussion going on this matter. I would like to see this get wider testing and eventually be included as well. A few questions (some of which I know the answer to but would like to have you field for the list): Where can I get/test/review the code? Is there still any focus on the "previous" generation code or is "TNG" where everything is happening now? Which generation are you talking about above? Does the code in the FreeBSD perforce repository represent the latest improvements? Which generation? How much and what kinds of testing has it already received? What is the relationship between the FreeNAS project and the geom_raid5 developer(s)? What version(s) of the code is/are in FreeNAS? Has the FreeNAS project or anyone else done any (preferrably thorough and repeatable) testing for correctness, stability and performance? Are the methods and/or results publicly available? Just who is (/are) the developer(s) behind this code? Where can I get more information? Can the information on your blog be considered authoritative? What is the status of the code? Are there any known outstanding issues or poorly tested functionality/configurations? Are there any threads on the freebsd-geom or other mailing lists that would be enlightening? Has a call for testing and/or code review been made on that list recently? Thanks. :) JN