From owner-freebsd-current@FreeBSD.ORG Tue Dec 21 02:53:57 2004 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id DF8AD16A4CE for ; Tue, 21 Dec 2004 02:53:56 +0000 (GMT) Received: from web4.thecenturiongroup.com (fw14.delivery.com [67.102.42.14]) by mx1.FreeBSD.org (Postfix) with ESMTP id 35E9843D39 for ; Tue, 21 Dec 2004 02:53:54 +0000 (GMT) (envelope-from mjm@michaelmeltzer.com) Received: from [127.0.0.1] (ix1x1000.thecenturiongroup.com [192.32.248.52]) by web4.thecenturiongroup.com (Postfix) with ESMTP id A24917C00B for ; Mon, 20 Dec 2004 21:53:53 -0500 (EST) Message-ID: <41C78F9B.4010804@michaelmeltzer.com> Date: Mon, 20 Dec 2004 21:51:07 -0500 From: Michael Meltzer User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.7.2) Gecko/20040804 Netscape/7.2 (ax) X-Accept-Language: en-us, en MIME-Version: 1.0 To: current@freebsd.org Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Subject: twa driver, 3ware 9500s-4lp, speed issue X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 21 Dec 2004 02:53:57 -0000 I have a 3ware 9500s-4lp controller with 4 10,000rpm raptors hooked up to it. 0+1 configuration. AMD dual 64 bit processor. This Hardware setup had Sese 9.1 running on it for a few days, One on the issues I had was that the controller seemed "slow". After reading 3ware white paper for turning for 2.6, the issue seemed to be buffer read ahead, i.e. blockdev -setra 16384 /dev/sda was needed for any type of read speed. Some quick benchmark under Bonnie++ Sequential read speeds from the mid 40's to 105meg/sec and had the write remained around 98 meg/sec. Now the Problem. loaded 5.3 , cvsup'ed and built for freebsd 5.3 stable, same hardware, the controller is feeling "slow" again. I tried to play with the vfs prams (vfs.read_max after some googling around). I could not find much information(other than the handbook) about the vfs prams and was unable to increase the speed. Can Any one sheed some light, subjections? insight, Gratefull for any help. Her is a iozone report pretty close to the linux bonnie++(sorry the bonnie failed) to give you all an idea whats up. exect same hardware. only change was OS and filesystem. Thank You MJM iozone -s 20480m -r 60 -i 0 -i 1 -t 1 Iozone: Performance Test of File I/O Version $Revision: 3.196 $ Compiled for 64 bit mode. Build: freebsd Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Jean-Marc Zucconi, Jeff Blomberg. Run began: Mon Dec 20 21:03:36 2004 File size set to 20971520 KB Record Size 60 KB Command line used: iozone -s 20480m -r 60 -i 0 -i 1 -t 1 Output is in Kbytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 Kbytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. Throughput test with 1 process Each process writes a 20971520 Kbyte file in 60 Kbyte records Children see throughput for 1 initial writers = 78738.67 KB/sec Parent sees throughput for 1 initial writers = 78716.55 KB/sec Min throughput per process = 78738.67 KB/sec Max throughput per process = 78738.67 KB/sec Avg throughput per process = 78738.67 KB/sec Min xfer = 20971500.00 KB Children see throughput for 1 rewriters = 32126.46 KB/sec Parent sees throughput for 1 rewriters = 32125.77 KB/sec Min throughput per process = 32126.46 KB/sec Max throughput per process = 32126.46 KB/sec Avg throughput per process = 32126.46 KB/sec Min xfer = 20971500.00 KB Children see throughput for 1 readers = 58563.70 KB/sec Parent sees throughput for 1 readers = 58557.14 KB/sec Min throughput per process = 58563.70 KB/sec Max throughput per process = 58563.70 KB/sec Avg throughput per process = 58563.70 KB/sec Min xfer = 20971500.00 KB Children see throughput for 1 re-readers = 58583.77 KB/sec Parent sees throughput for 1 re-readers = 58581.98 KB/sec Min throughput per process = 58583.77 KB/sec Max throughput per process = 58583.77 KB/sec Avg throughput per process = 58583.77 KB/sec Min xfer = 20971500.00 KB iozone test complete.