From owner-freebsd-hardware@FreeBSD.ORG Tue Jun 28 09:58:11 2005 Return-Path: X-Original-To: freebsd-hardware@freebsd.org Delivered-To: freebsd-hardware@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 0681B16A41C for ; Tue, 28 Jun 2005 09:58:11 +0000 (GMT) (envelope-from freebsd@sharktech.net) Received: from sharktech.net (usr1-123.sharktech.net [66.90.92.201]) by mx1.FreeBSD.org (Postfix) with ESMTP id B41CA43D1D for ; Tue, 28 Jun 2005 09:58:10 +0000 (GMT) (envelope-from freebsd@sharktech.net) Received: (qmail 7173 invoked from network); 28 Jun 2005 09:58:08 -0000 Received: from psyxakias.ath.forthnet.gr (HELO none) (213.16.181.212) by admin.sharktech.net with SMTP; 28 Jun 2005 09:58:08 -0000 Message-ID: <024c01c57bc7$e10867e0$0301a8c0@none> From: "SharkTECH Internet Services" To: Date: Tue, 28 Jun 2005 12:58:02 +0300 MIME-Version: 1.0 X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2800.1478 X-MIMEOLE: Produced By Microsoft MimeOLE V6.00.2800.1478 Content-Type: text/plain; charset="iso-8859-7" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: Slow Performance: Intel SRC16 RAID controller (amr driver) X-BeenThere: freebsd-hardware@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: General discussion of FreeBSD hardware List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Jun 2005 09:58:11 -0000 Hello,=20 I'm e-mailing you as a last ditch of effort to resolve this problem = which really have left us hopeless. We have recently acquired a high-end = server and have been beta testing it to bring it to production, but we = are experiencing SERIOUS problems with the performance of the raid = controller read/write performance which we are coming to you hoping for = a resolution.=20 System Specs:=20 2 x AMD Opteron 244 2GB DDR-3200 ECC REG RAM Tyan S2882 Board (most recent bios release) Intel SRCS16 Raid Controller (Most recent bios release) 5 x 200GB 7.2KRPM WD 8MBuffer HDD's Intel Pro/1000 SC Fiber O/S:=20 FreeBSD 5.4 RELEASE (amd64) Raid is configured as Raid-5 with 64Kbyte and pretty much default = settings all the way on that part. FreeBSD detects the Raid and installs = it just fine. When it starts installing the O/S from CD it bursts to = ~2000KB/s and go as low as 40KB/s while installing ports. Once system is = installed we tried dd/bonnie/bonnie++ and a small script we even made to = benchmark it yet all show really bad performance. Logs below will show = tests made:=20 bonnie:=20 -------Sequential Output-------- ---Sequential Input-- = --Random-- -Per Char- --Block--- -Rewrite-- -Per Char- --Block--- = --Seeks--- Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU = /sec %CPU 100 5116 4.6 3412 0.7 9850 1.6 91008 99.8 1530299 99.9 = 118084.7 98.7 bonnie++:=20 Version 1.93c ------Sequential Output------ --Sequential Input- = --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- = --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP = /sec %CP godzilla.hosts 300M 326 98 4824 1 4459 1 749 99 +++++ +++ = 1261 3 Latency 34053us 299ms 291ms 24724us 653us = 6277ms Version 1.93c ------Sequential Create------ --------Random = Create-------- godzilla.hosts.bc1. -Create-- --Read--- -Delete-- -Create-- --Read--- = -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP = /sec %CP 16 3216 9 +++++ +++ +++++ +++ 2582 6 +++++ +++ = +++++ +++ Latency 1757ms 299us 64us 1811ms 159us = 253us 1.93c,1.93c,godzilla.hosts.bc1.bresnan.net,1,1116728125,300M,,326,98,4824= ,1,4459,1,749,99, +++++,+++,1261,3,16,,,,,3216,9,+++++,+++,+++++,+++,2582,6,+++++,+++,+++++= , +++,34053us,299ms,291ms,24724us,653us,6277ms,1757ms,299us,64us,1811ms,159= us,253us dd:=20 dd if=3D/dev/amrd0s1a of=3D/dev/null ^C36267+0 records in 36267+0 records out 18568704 bytes transferred in 9.330515 secs (1990105 bytes/sec) Custom script making continuous copies of 1 file (223M): Sat May 21 18:58:24 MDT 2005: 291072 KB/min (4851.20 KB/sec) Sat May 21 18:59:25 MDT 2005: 286064 KB/min (4767.73 KB/sec) Sat May 21 19:00:25 MDT 2005: 285808 KB/min (4763.46 KB/sec) Sat May 21 19:01:25 MDT 2005: 279728 KB/min (4662.13 KB/sec) dmesg information: amr0: mem 0xff5f0000-0xff5fffff irq 28 at = device 3.0 on pci3 amr0: Firmware 713N, BIOS = G401, 64MB RAM amrd0: on amr0 amrd0: 763108MB (1562845184 sectors) RAID 5 (optimal) We have already tried to play around with enabling/disabling the cache = on the hard drives, we even used a different set of 3 80GB 7.2KRPM WD = drives instead to see if their is a disfunctional drive causing this yet = nothing. This problem has been really frustrating for us and we even got = a couple of people emailing us with the same problem they are having I = hope you understand we've been using FreeBSD for the last 7 years and we = really don't wanna stop using it now, as the problem does not occur in = other O/S (ie MSWindows). If any driver developers that can modify amr driver would like to test = it on our system, feel free to contact me back via e-mail to provide you = SSH access. I really hope you would be able to help us out, really appreciate your = time on this. Thank you Tim Timrawi SharkTECH Internet Services.