From owner-freebsd-stable@FreeBSD.ORG Tue Oct 31 16:54:46 2006 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 3095316A403 for ; Tue, 31 Oct 2006 16:54:46 +0000 (UTC) (envelope-from fredrik.widlund@qbrick.com) Received: from mail.qbrick.com (mail.qbrick.com [62.13.40.40]) by mx1.FreeBSD.org (Postfix) with ESMTP id ABA9843D45 for ; Tue, 31 Oct 2006 16:54:45 +0000 (GMT) (envelope-from fredrik.widlund@qbrick.com) Received: from localhost (localhost [127.0.0.1]) by mail.qbrick.com (Postfix) with ESMTP id 23D655199C for ; Tue, 31 Oct 2006 17:54:06 +0100 (CET) Received: from mail.qbrick.com ([127.0.0.1]) by localhost (mail0.p0.w0.local [127.0.0.1]) (amavisd-new, port 10024) with LMTP id 36385-01-6 for ; Tue, 31 Oct 2006 17:53:58 +0100 (CET) Received: from [10.43.0.2] (fkwd0.p0.u3.local [10.43.0.2]) by mail.qbrick.com (Postfix) with ESMTP id B098C5196B for ; Tue, 31 Oct 2006 17:53:58 +0100 (CET) Message-ID: <45477FCC.9050901@qbrick.com> Date: Tue, 31 Oct 2006 17:54:36 +0100 From: Fredrik Widlund User-Agent: Thunderbird 1.5.0.7 (Windows/20060909) MIME-Version: 1.0 To: freebsd-stable@freebsd.org References: <45470D95.5020801@qbrick.com> <454718DD.8060108@qbrick.com> <45471ACC.2030604@fer.hr> <4547421D.2010206@qbrick.com> In-Reply-To: <4547421D.2010206@qbrick.com> X-Enigmail-Version: 0.93.2.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Virus-Scanned: by amavisd-new at qbrick.com Subject: Re: SAS Raid - mfi driver X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 31 Oct 2006 16:54:46 -0000 Solved my issue with LSI 8480E without BBU. With "write: BadBBU", "cache: enabled", and "io: cached", performance rose to around 200MB/s from 20MB/s. With BadBBU/enabled cache/io cached: [root@ ~/bench]# ./bench /dev/mfid0p1 65536 file /dev/mfid0p1, bs 65536 rate: 228130816 Bps, write: 285 us rate: 206635008 Bps, write: 299 us rate: 206372864 Bps, write: 305 us rate: 206438400 Bps, write: 307 us ... With Write through: [root@ ~/bench]# ./bench /dev/mfid0p1 65536 file /dev/mfid0p1, bs 65536 rate: 40763392 Bps, write: 1609 us rate: 19202048 Bps, write: 2260 us rate: 25231360 Bps, write: 2301 us rate: 19660800 Bps, write: 2418 us ... 10x performance win, so this is one thing off my back. Kind regards, Fredrik Widlund Fredrik Widlund wrote: > 256MB cache, no BBU. Tried a lot of different combinations of settings. > > fbsd 6.2pre writes 220MB/s with raid-0 > > If I boot windows server 2003 instead, it writes at around 180MB/s with > raid-5 (same configs). > > With fbsd6.2pre, I get the "best" performance with BadBBU/direct > io/disabled cache and 8 drives, maybe around 50 MB/s, however I get a > zig-zag performance pattern, with the adapter running at 500% (gstat) > utilization one second, then down to 0% for maybe 3 seconds, back, etc. > > Fredrik > > Ivan Voras wrote: > >> Fredrik Widlund wrote: >> >>> Ivan Voras wrote: >>> >>>> Several: >>>> >>>> - are there cache differences between the controllers (amount of >>>> memory, cache policy)? >>>> >>> Default settings on both. >>> >> Maybe you should check what the defaults are :) Especially the amount >> of memory and is there a battery to back the cache. >> >> >>>> - how does writing directly to the device (bypassing file system) >>>> compare? >>>> >>> Drives are four seagate 7200.10 400GB in a Raid-5 configuration. >>> >>> [/mnt/test (/dev/mfid0p1 mounted)] >>> read: 200MB/s >>> write: 15MB/s >>> >>> [/dev/mfid0p1] >>> read: 200MB/s >>> write: 8MB/s >>> >>> [/dev/mfid0] >>> read: 200MB/s >>> write: 10MB/s >>> >> This is bad :( The difference between p0 and raw device might indicate >> a stripe size misalignment, but the values are too low in any case. >> >> >> _______________________________________________ >> freebsd-stable@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-stable >> To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" >> > > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" >