From owner-freebsd-fs@FreeBSD.ORG Fri Jan 12 09:30:16 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 372A216A407 for ; Fri, 12 Jan 2007 09:30:16 +0000 (UTC) (envelope-from scottl@samsco.org) Received: from pooker.samsco.org (pooker.samsco.org [168.103.85.57]) by mx1.freebsd.org (Postfix) with ESMTP id D4E3113C428 for ; Fri, 12 Jan 2007 09:30:15 +0000 (UTC) (envelope-from scottl@samsco.org) Received: from phobos.samsco.home (phobos.samsco.home [192.168.254.11]) (authenticated bits=0) by pooker.samsco.org (8.13.4/8.13.4) with ESMTP id l0C9U53q027930; Fri, 12 Jan 2007 02:30:11 -0700 (MST) (envelope-from scottl@samsco.org) Message-ID: <45A7551C.5030006@samsco.org> Date: Fri, 12 Jan 2007 02:30:04 -0700 From: Scott Long User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.2pre) Gecko/20061227 SeaMonkey/1.1 MIME-Version: 1.0 To: Ahnjoan Amous References: <5e575c8a0701111155l859d0ecif617dbda43cef842@mail.gmail.com> <45A6A138.8090208@samsco.org> <5e575c8a0701111307s5a839b82ra4ba5c45d554d3b9@mail.gmail.com> In-Reply-To: <5e575c8a0701111307s5a839b82ra4ba5c45d554d3b9@mail.gmail.com> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Greylist: Sender succeeded SMTP AUTH authentication, not delayed by milter-greylist-2.0.2 (pooker.samsco.org [168.103.85.57]); Fri, 12 Jan 2007 02:30:11 -0700 (MST) X-Spam-Status: No, score=-1.4 required=3.8 tests=ALL_TRUSTED autolearn=failed version=3.1.1 X-Spam-Checker-Version: SpamAssassin 3.1.1 (2006-03-10) on pooker.samsco.org Cc: freebsd-fs@freebsd.org Subject: Re: aac scsi raid driver performance X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 12 Jan 2007 09:30:16 -0000 Turn off read caching Ahnjoan Amous wrote: > I reset the controller to the defaults for everything before I did the > installation. > > Each of the containers were created with the following options. > Container Type - RAID 0 > Container Label - data03 > Container Size - 279.396 GB > Chunk Size - 64KB > Read Caching (Yes/No) - Y > Write Caching : Enable when protected > Create RAID 5 via - N/A > > Then the controller itself has a single cache option > Drives Write Cache - Disabled > > Thanks > Ahnjoan > > On 1/11/07, Scott Long wrote: >> Did you enable read caching for the arrays? >> >> Scott >> >> >> Ahnjoan Amous wrote: >> > I'm trying to find possible explanations for slow concurrent writes >> > through the >> > aac driver. This machine runs under 1% load and has less than 4 >> > transfers per >> > second to the drives in question when not being used for testing. >> > >> > When I attempt sequential "dd"s as follow, the results are better then >> > 70MB/sec. >> > dd if=/dev/zero of=/data02/helloworld bs=1m count=1000 >> > 1048576000 bytes transferred in 13.886718 secs (75509274 bytes/sec) >> > dd if=/dev/zero of=/data03/helloworld bs=1m count=1000 >> > 1048576000 bytes transferred in 14.011323 secs (74837758 bytes/sec) >> > >> > When I attempt concurrent "dd"s as follow, with a 1 second sleep >> interval >> > between starts, the results are better than 40MB/sec >> > dd if=/dev/zero of=/data02/helloworld bs=1m count=1000 & >> > sleep 1 >> > dd if=/dev/zero of=/data03/helloworld bs=1m count=1000 & >> > 1048576000 bytes transferred in 25.269555 secs (41495626 bytes/sec) >> > 1048576000 bytes transferred in 24.935765 secs (42051086 bytes/sec) >> > >> > When I attempt concurrent "dd"s as follow, the results are little >> better >> > than >> > 20MB/sec >> > dd if=/dev/zero of=/data02/helloworld bs=1m count=1000 & >> > dd if=/dev/zero of=/data03/helloworld bs=1m count=1000 & >> > 1048576000 bytes transferred in 44.963408 secs (23320652 bytes/sec) >> > 1048576000 bytes transferred in 45.010065 secs (23296478 bytes/sec) >> > >> > I can't account for what causes the huge difference however the >> results are >> > reproducible. I've run the tests dozens and dozens of times now, first >> > blaming >> > the em driver for my slow ggatec/ggated results, then GEOM for my slow >> > local >> > mirroring after eliminating the network, and finally blaming the aac >> driver >> > after removing GEOM from the equation. If anyone has ideas on what >> I might >> > look at or change or test I would love to hear. >> > >> > >> > ****** Misc. Information ****** >> > root:somehost:~ > df -k >> > Filesystem 1K-blocks Used Avail Capacity Mounted on >> > /dev/aacd2s1e 2026030 1024532 839416 55% /data02 >> > /dev/aacd3s1e 2026030 1024532 839416 55% /data03 >> > Hardware - >> > aac - Dell PERC3/Di U160 >> > aacd2 - hardware RAID 0, w/1 U320 300G drive >> > aacd3 - hardware RAID 0, w/1 U320 300G drive >> > _______________________________________________ >> > freebsd-fs@freebsd.org mailing list >> > http://lists.freebsd.org/mailman/listinfo/freebsd-fs >> > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" >> >>