From owner-freebsd-performance@FreeBSD.ORG Sat Oct 28 04:15:04 2006 Return-Path: X-Original-To: performance@freebsd.org Delivered-To: freebsd-performance@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id E6DFA16A403 for ; Sat, 28 Oct 2006 04:15:04 +0000 (UTC) (envelope-from anderson@centtech.com) Received: from mh1.centtech.com (moat3.centtech.com [64.129.166.50]) by mx1.FreeBSD.org (Postfix) with ESMTP id 7A82043D49 for ; Sat, 28 Oct 2006 04:15:04 +0000 (GMT) (envelope-from anderson@centtech.com) Received: from [192.168.42.25] ([192.168.42.25]) by mh1.centtech.com (8.13.8/8.13.8) with ESMTP id k9S4ExHl024948; Fri, 27 Oct 2006 23:15:02 -0500 (CDT) (envelope-from anderson@centtech.com) Message-ID: <4542D941.2070204@centtech.com> Date: Fri, 27 Oct 2006 23:14:57 -0500 From: Eric Anderson User-Agent: Thunderbird 1.5.0.7 (X11/20061015) MIME-Version: 1.0 To: Steve Peterson References: <6.2.3.4.0.20061027180329.020bed68@localhost> In-Reply-To: <6.2.3.4.0.20061027180329.020bed68@localhost> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV 0.88.4/2126/Fri Oct 27 08:48:55 2006 on mh1.centtech.com X-Virus-Status: Clean X-Spam-Status: No, score=-2.2 required=8.0 tests=AWL,BAYES_00 autolearn=ham version=3.1.6 X-Spam-Checker-Version: SpamAssassin 3.1.6 (2006-10-03) on mh1.centtech.com Cc: performance@freebsd.org Subject: Re: gvinum raid5 performance seems slow X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 28 Oct 2006 04:15:05 -0000 On 10/27/06 18:03, Steve Peterson wrote: > I recently set up a media server for home use and decided to try the > gvinum raid5 support to learn about it and see how it performs. It > seems slower than I'd expect -- a little under 6MB/second, with about > 50 IOs/drive/second -- and I'm trying to understand why. Any > assistance/pointers would be appreciated. > > The disk system consists of 4 Seagate NL35 SATA ST3250623NS drives > connected to a Promise TX4300 (PDC40719) controller, organized as a > RAID5 volume via gvinum using this configuration: > > drive drive01 device /dev/ad10 > drive drive02 device /dev/ad6 > drive drive03 device /dev/ad4 > drive drive04 device /dev/ad8 > > volume vol1 > plex org raid5 256k > sd length 200001m drive drive01 > sd length 200001m drive drive02 > sd length 200001m drive drive03 > sd length 200001m drive drive04 > > dd reports the following performance on a 1G file write to the RAID5 > hosted volume: > > $ time dd if=/dev/zero of=big.file bs=1m count=1000 > 1000+0 records in > 1000+0 records out > 1048576000 bytes transferred in 179.717742 secs (5834571 bytes/sec) > 179.76 real 0.02 user 16.60 sys > > By comparison, creating the same file on the system disk (an old ATA > ST380021A connected via a SIS 730 on the motherboard): > > time dd if=/dev/zero of=big.file bs=1m count=1000 > 1000+0 records in > 1000+0 records out > 1048576000 bytes transferred in 28.264056 secs (37099275 bytes/sec) > 28.32 real 0.01 user 19.13 sys > > and vmstat reports about 280-300 IOs/second to that drive. > > The CPU is pretty weak -- an Athlon 750. Is that the source of my > problem? If you look at the vmstat output below the machine is busy > but not pegged. Try the dd to the raw gvinum device instead of through a filesystem, and also to the individual disks. That will at least tell us where to look. Eric -- ------------------------------------------------------------------------ Eric Anderson Sr. Systems Administrator Centaur Technology Anything that works is better than anything that doesn't. ------------------------------------------------------------------------