From owner-freebsd-hackers@FreeBSD.ORG Tue Sep 24 12:12:23 2013 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 590C9924 for ; Tue, 24 Sep 2013 12:12:23 +0000 (UTC) (envelope-from freebsd-hackers@m.gmane.org) Received: from plane.gmane.org (plane.gmane.org [80.91.229.3]) (using TLSv1 with cipher AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 141C7281A for ; Tue, 24 Sep 2013 12:12:22 +0000 (UTC) Received: from list by plane.gmane.org with local (Exim 4.69) (envelope-from ) id 1VORTY-0002Bn-0i for freebsd-hackers@freebsd.org; Tue, 24 Sep 2013 14:12:20 +0200 Received: from lara.cc.fer.hr ([161.53.72.113]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Tue, 24 Sep 2013 14:12:20 +0200 Received: from ivoras by lara.cc.fer.hr with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Tue, 24 Sep 2013 14:12:20 +0200 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-hackers@freebsd.org From: Ivan Voras Subject: Re: IO Performance under VMware on LSI RAID controller Date: Tue, 24 Sep 2013 14:12:05 +0200 Lines: 51 Message-ID: References: <207F05D4-9D33-41E8-9258-6C47F266D892@gmail.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="6MUKxr58EfAMLngETMfV6CWSFFN3S6DWH" X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: lara.cc.fer.hr User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:24.0) Gecko/20100101 Thunderbird/24.0 In-Reply-To: <207F05D4-9D33-41E8-9258-6C47F266D892@gmail.com> X-Enigmail-Version: 1.5.2 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 Sep 2013 12:12:23 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --6MUKxr58EfAMLngETMfV6CWSFFN3S6DWH Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable On 20/09/2013 15:08, Guy Helmer wrote: > On Sep 19, 2013, at 11:25 AM, Guy Helmer wrote: >=20 >> Normally I build VMware ESXi servers with enterprise-class WD SATA dri= ves and I/O performance in FreeBSD VMs on the servers is fine. >> Whenever I build a VMware ESXi server with a RAID controller, IO perfo= rmance is awful in FreeBSD VMs. I've previously seen this effect with VMw= are ESXi 3ware 9690SA-8I and 9650 RAID controllers, and now I'm seeing si= milar performance with a Dell 6/iR controller. >> >> Any suggestions would be appreciated. >> >> Guy >=20 > (Replying to self due to hint received off-list) >=20 > I seem to remember controllers mentioned previously by FreeBSD device d= river developers that don't deal well with large I/O requests. It turns o= ut that may be the case with VMware device drivers as well -- reducing th= e VMware Disk.DiskMaxIOSize value from its huge default of 32676KB to 32K= B seems to have helped. Disk ops/sec in the FreeBSD VM are now peaking ov= er 400/sec. Interesting that the problem shows only on RAID controllers. Do you have any ideas why this reduction helps (did you find a FAQ or a forum post)? The default RAID stripe size in LSI is 64 KiB, maybe it would help even further to align it also? --6MUKxr58EfAMLngETMfV6CWSFFN3S6DWH Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.21 (FreeBSD) Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iKYEARECAGYFAlJBgZZfFIAAAAAALgAoaXNzdWVyLWZwckBub3RhdGlvbnMub3Bl bnBncC5maWZ0aGhvcnNlbWFuLm5ldDYxNDE4MkQ3ODMwNDAwMDJFRUIzNDhFNUZE MDhENTA2M0RGRjFEMkMACgkQ/QjVBj3/HSwqtQCdEs1nccVlzDTOv21yrIkkpTfP s8gAn31S/5nq3DJCr+PusjDrGX0hVsQ/ =RfCu -----END PGP SIGNATURE----- --6MUKxr58EfAMLngETMfV6CWSFFN3S6DWH--