From owner-freebsd-stable@FreeBSD.ORG Wed Mar 5 15:46:19 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 75AB9106566B for ; Wed, 5 Mar 2008 15:46:19 +0000 (UTC) (envelope-from freebsd-stable@m.gmane.org) Received: from ciao.gmane.org (main.gmane.org [80.91.229.2]) by mx1.freebsd.org (Postfix) with ESMTP id EA9068FC12 for ; Wed, 5 Mar 2008 15:46:18 +0000 (UTC) (envelope-from freebsd-stable@m.gmane.org) Received: from list by ciao.gmane.org with local (Exim 4.43) id 1JWvoq-00052R-Uc for freebsd-stable@freebsd.org; Wed, 05 Mar 2008 15:46:12 +0000 Received: from lara.cc.fer.hr ([161.53.72.113]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Wed, 05 Mar 2008 15:46:12 +0000 Received: from ivoras by lara.cc.fer.hr with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Wed, 05 Mar 2008 15:46:12 +0000 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-stable@freebsd.org From: Ivan Voras Date: Wed, 05 Mar 2008 16:49:44 +0100 Lines: 87 Message-ID: References: <915419.88748.qm@web50505.mail.re2.yahoo.com> <47CE816A.6050903@tefre.com> <47CEB75E.7080906@tefre.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enigC343D880D3C6B347303FC3AD" X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: lara.cc.fer.hr User-Agent: Thunderbird 2.0.0.6 (X11/20071022) In-Reply-To: <47CEB75E.7080906@tefre.com> X-Enigmail-Version: 0.95.0 Sender: news Subject: Re: 7.0-Release and 3ware 9550SXU w/BBU - horrible write performance X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 05 Mar 2008 15:46:19 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enigC343D880D3C6B347303FC3AD Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Erik Stian Tefre wrote: > It was completely idle. Changing vfs.read_max to 80 triples the > sequential read performance, see bonnie++ output below (run on the same= > box, nothing changed except vfs.read_max). It might be that 3ware is specially pessimized by FreeBSD chopping IO into 64K blocks. But vfs.read_max doesn't change that so it's maybe not i= t. > bonnie++ with vfs_max=3D80: > Version 1.93d ------Sequential Output------ --Sequential Input- > --Random- > Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- > --Seeks-- > Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP > /sec %CP > xxxxxxxxxxxxxxxx 1G 285 83 88193 28 26858 6 690 89 218642 59 > 406.5 5 > Latency 44353us 557ms 542ms 90795us 209ms 361= ms > Version 1.93d ------Sequential Create------ --------Random > Create-------- > xxxxxxxxxxxxxxxxxxx -Create-- --Read--- -Delete-- -Create-- --Read--- > -Delete-- > files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP > /sec %CP > 16 8204 19 +++++ +++ 22163 36 9925 25 +++++ +++ > +++++ +++ > Latency 585ms 571us 3844us 257ms 24015us 768= us Are these numbers typical for 3ware's controllers? I still think something's bad about your setup, see the following performance results on a 3-drive RAID5 on Dell PERC5: Version 1.93d ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP xxxxx.xxx.xx 4000M 298 99 92319 25 30729 13 440 88 121370 25 533.1 29 Latency 28140us 711ms 430ms 528ms 74013us 225ms Version 1.93d ------Sequential Create------ --------Random Create-------- xxxxx.xxx.xx -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 30 18782 85 50106 99 45405 99 16481 58 60185 99 49638 99 Latency 259ms 21091us 130us 27529us 50us 75us I consider this ok, since (for the simple case of READing) the 3-drive RAID5 array has the performance of a 2-drive striped array. Your CPU usage is quite high (59% on sequential block input, if I'm reading it correctly) - are you limited by your CPU? --------------enigC343D880D3C6B347303FC3AD Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) iD8DBQFHzsEhldnAQVacBcgRAhjGAKCostznLnuGPuouFFhmM828VuXUEwCffSzz gNyk00B44FyxUUTQWjWFkrs= =AmyL -----END PGP SIGNATURE----- --------------enigC343D880D3C6B347303FC3AD--