From owner-freebsd-performance@FreeBSD.ORG Tue Aug 11 21:29:07 2009 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 79D65106566B for ; Tue, 11 Aug 2009 21:29:07 +0000 (UTC) (envelope-from nathan@lenevez.net.au) Received: from smtp1.l33t.net.au (smtp1.l33t.net.au [IPv6:2400:5000:1337:a::71]) by mx1.freebsd.org (Postfix) with ESMTP id 07A9B8FC3D for ; Tue, 11 Aug 2009 21:29:06 +0000 (UTC) Received: from talon.lenevez.net.au (smtp-outbound.lenevez.net.au [119.15.98.178]) by smtp1.l33t.net.au (8.14.2/8.14.2) with ESMTP id n7BLSkTk052866; Wed, 12 Aug 2009 07:28:47 +1000 (EST) (envelope-from nathan@lenevez.net.au) Received: from talon.lenevez.net.au ([119.15.98.178]) by talon.lenevez.net.au ([119.15.98.178]) with mapi; Wed, 12 Aug 2009 07:27:11 +1000 From: Nathan Le Nevez To: Krassimir Slavchev Date: Wed, 12 Aug 2009 07:28:53 +1000 Thread-Topic: Very slow I/O performance on HP BL465c Thread-Index: AcoaeOv11wNZ5eR6TZyJcc2MshjO8wAUZK9g Message-ID: References: <4A8159A8.3030206@bulinfo.net> In-Reply-To: <4A8159A8.3030206@bulinfo.net> Accept-Language: en-US, en-AU Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US, en-AU Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.0 (smtp1.l33t.net.au [119.15.98.71]); Wed, 12 Aug 2009 07:28:47 +1000 (EST) X-L33T-MailScanner-Information: Please contact the ISP for more information X-MailScanner-ID: n7BLSkTk052866 X-L33T-MailScanner: Found to be clean X-L33T-MailScanner-From: nathan@lenevez.net.au X-Spam-Status: No Cc: "freebsd-performance@freebsd.org" Subject: RE: Very slow I/O performance on HP BL465c X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 11 Aug 2009 21:29:07 -0000 # vmstat -i interrupt total rate irq1: atkbd0 18 0 irq5: ohci0 ohci1+ 1 0 irq19: ciss0 144916 3 irq21: uhci0 22 0 cpu0: timer 80002970 1999 irq256: bce0 17042 0 cpu2: timer 79994902 1999 cpu1: timer 79994975 1999 cpu3: timer 79995009 1999 cpu6: timer 79994957 1999 cpu5: timer 79995046 1999 cpu4: timer 79995041 1999 cpu7: timer 79995057 1999 Total 640129956 16000 # camcontrol tags da0 (pass0:ciss0:0:0:0): device openings: 254 Just for clarification, both systems are running amd64. Thanks, Nathan -----Original Message----- From: Krassimir Slavchev [mailto:krassi@bulinfo.net]=20 Sent: Tuesday, 11 August 2009 9:45 PM To: Nathan Le Nevez Cc: freebsd-performance@freebsd.org Subject: Re: Very slow I/O performance on HP BL465c -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, What is the output of 'vmstat -i' and 'camcontrol tags da0' ? I have a ML350 running 7-STABLE with same controller and disks and performance is almost same as your good server. Nathan Le Nevez wrote: > Hi, >=20 > I'm running 7.2-p3 on 2x HP BL465c blade servers, one of which performs v= ery > poorly. Both have the same RAID controller and 2 x 146GB 10k SAS disks > configured in RAID-1. Both controllers have write-cache enabled. Both > servers are running the same BIOS and firmware versions. Neither servers = are > running any services other than sshd. >=20 > Blade with good performance (2 x Opteron 2218, 8GB RAM): >=20 > ciss0: port 0x4000-0x40ff mem > 0xfdf80000-0xfdffffff,0xfdf70000-0xfdf77fff irq 19 at device 8.0 on pci80 > ciss0: [ITHREAD] > da0 at ciss0 bus 0 target 0 lun 0 > da0: AFPi xCePdU D#i2r Leacuntc hAcecde!= s > s SCSI-5 device > da0: 135.168MB/s transfers > dSaM0P:: CAoP CPU #3 Launched! > mmand Queueing Enabled > da0: 139979MB (286677120 512 byte sectors: 255H 32S/T 35132C) >=20 > Blade with bad performance (2 x Opteron 2352, 16GB RAM): >=20 > ciss0: port 0x4000-0x40ff mem > 0xfdf80000-0xfdffffff,0xfdf70000-0xfdf77fff irq 19 at device 8.0 on pci80 > ciss0: [ITHREAD] > da0 at ciss0 bus 0 target 0 lun 0 > da0: Fixed Direct Access SCSI-5 device > da0: 135.168MB/s transfers > da0: Command Queueing Enabled > da0: 139979MB (286677120 512 byte sectors: 255H 32S/T 35132C) >=20 > # dbench -t 10 1 2 3 4 > blade1 183.456 MB/sec 236.86 MB/sec 299.28 MB/sec 192.675 MB/s= ec > blade2 6.97931 MB/sec 9.42293 MB/sec 10.2482 MB/sec 12.407 MB/se= c >=20 > Any help/ideas would be greatly appreciated. I have run through all the > Insight diagnostics tools and it fails to find anything wrong with the sl= ow > server. >=20 > Cheers, > Nathan=20 >=20 > _______________________________________________ > freebsd-performance@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-performance > To unsubscribe, send any mail to "freebsd-performance-unsubscribe@freebsd= .org" >=20 -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.7 (FreeBSD) iD8DBQFKgVmoxJBWvpalMpkRAvilAJsGF0J34SgD34EcBxX8Ic8Hq6OUBACghpBL C7YgX2qmvgb7WSvgFhDrKl8=3D =3DJDJx -----END PGP SIGNATURE-----