Date: Sat, 19 Oct 2013 12:31:39 -0700 From: aurfalien <aurfalien@gmail.com> To: FreeBSD Mailing List <freebsd-questions@freebsd.org> Subject: Re: FreeBSD, Centos and ZFS Message-ID: <DF3E552D-D2E6-464C-88EA-7AF34E8329CC@gmail.com> In-Reply-To: <525D143B.50202@gmail.com> References: <CBA24BB3-4A57-428C-B342-4BEB678B8D43@gmail.com> <1381600575.18393.33219025.5D7B78D0@webmail.messagingengine.com> <8CA809B3-1692-4760-A63F-9D7451EB49BD@gmail.com> <525D143B.50202@gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
On Oct 15, 2013, at 3:08 AM, Johan Hendriks wrote: > aurfalien wrote: >> On Oct 12, 2013, at 10:56 AM, Mark Felder wrote: >>=20 >>> On Sat, Oct 12, 2013, at 10:53, aurfalien wrote: >>>> Hi, >>>>=20 >>>> I would like to first say that by no means is this a "hey, why is = my Mac >>>> faster then my PC" kind of email. >>>>=20 >>>> I'm really hoping its an LSI driver issue. >>>>=20 >>> It may very well be an LSI firmware issue. What are the firmwares = for >>> those HBAs? >> Upon doing this; >>=20 >> sysctl -a | grep mps >>=20 >> I get this; >>=20 >> dev.mps.0.driver_version: 14.00.00.01-fbsd >>=20 >> LSIs site mentions the latest drives at being 17.00.00.00 >>=20 >> I'll go ahead and install the latest to see what happens. >>=20 >> Whats the best way to do this, I assume build it and load via = loader.conf? >>=20 >> - aurf >> _______________________________________________ >> freebsd-questions@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-questions >> To unsubscribe, send any mail to = "freebsd-questions-unsubscribe@freebsd.org" > The way i do it is from FreeBSD itself. > I did it on FreeBSD 9.0 and 9.2, never did it on a 9.1 or 10 Current. = I also never did it on cards other then the 9211-8i LSI cards.=20 > So do not hold me responsible if things go wrong :D > If things go wrong it can damage the card so it has to be put in for = RMA > Download the firmware, and the sas2flash file for FreeBSD=20 >=20 > Then i do the following > =20 >=20 > myrootonzfs ~ # ./sas2flash -listall >=20 >=20 Rather then up the driver in FreeBSD 9, (I tried and it didn't go too = well anyways) I left it at v14 and down graded the firmware. While the = Intel rebranded LSI controllers were stuck at an older Intel version, I = decided to make them all v14 of the LSI firmware. Throughput has improved a bit and it seems more consistent in terms of = test results. So the key here in FreeBSD is to match firmware with driver versions. = Linux didn't seem to care but all OS's have there nuances so I'm not = concerned. In terms of flashing the firmware, I had to do it via EFI using the = -force flag. Even though v14 didn't have an EFI tool , v17 did so I = used it while specifying v14 firmware file. But a note on the Linux comparison; While I mimicked my values on both platforms, I did not mimic all = values. ZoL comes with a little interesting feature; arc2 compression, which = does seem to enhance performance all around. I disabled this in CentOS = to level the playing field. There are several other things I saw on ZoL which seem very new and more = in line with ZFS on FreeBSD 10. So I installed FreeBSD 10, set up my prefs as before but performance = were very close to FreeBSD 9, which were both lower to ZoL in CentOS. I've attached my IOzone results in zipped xls format if any one is = interested. I'm still baffled as to why CentOS has substantially better = results. * Concerning the graphs; Scales are all set equal to allow for easy comparisons. Values to the right are avg file sizes in my env; 8MB 12MB 16MB 30MB 53MB 2GB At any rate, I'm hoping some one could help solve this performance = discrepancy. I suppose a dump of my hardware list and ZFS properties are in order but = only if any one is interested as I don't like typing in vein :) Thanks in advance, - aurf
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?DF3E552D-D2E6-464C-88EA-7AF34E8329CC>