From owner-freebsd-hardware@freebsd.org  Wed Jun 22 07:05:03 2016
Return-Path: <owner-freebsd-hardware@freebsd.org>
Delivered-To: freebsd-hardware@mailman.ysv.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 by mailman.ysv.freebsd.org (Postfix) with ESMTP id DF723AC678A;
 Wed, 22 Jun 2016 07:05:03 +0000 (UTC)
 (envelope-from borjam@sarenet.es)
Received: from cu1176c.smtpx.saremail.com (cu1176c.smtpx.saremail.com
 [195.16.148.151])
 (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
 (Client did not present a certificate)
 by mx1.freebsd.org (Postfix) with ESMTPS id A1F722730;
 Wed, 22 Jun 2016 07:05:03 +0000 (UTC)
 (envelope-from borjam@sarenet.es)
Received: from [172.16.8.36] (izaro.sarenet.es [192.148.167.11])
 by proxypop02.sare.net (Postfix) with ESMTPSA id 48E909DC9D4;
 Wed, 22 Jun 2016 08:58:08 +0200 (CEST)
Content-Type: text/plain; charset=utf-8
Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\))
Subject: Re: mfi driver performance too bad on LSI MegaRAID SAS 9260-8i
From: Borja Marcos <borjam@sarenet.es>
In-Reply-To: <1790833A-9292-4A46-B43C-BF41C7C801BE@cyphytech.com>
Date: Wed, 22 Jun 2016 08:58:08 +0200
Cc: Mark Felder <feld@FreeBSD.org>, freebsd-performance@freebsd.org,
 freebsd-stable@freebsd.org, freebsd-hardware@freebsd.org
Content-Transfer-Encoding: quoted-printable
Message-Id: <B2239257-E136-4918-8FA3-1EE51BC50FB4@sarenet.es>
References: <16CD100A-3BD0-47BA-A91E-F445E5DF6DBC@cyphytech.com>
 <1466527001.2694442.644278905.18E236CD@webmail.messagingengine.com>
 <1790833A-9292-4A46-B43C-BF41C7C801BE@cyphytech.com>
To: Jason Zhang <jasonzhang@cyphytech.com>
X-Mailer: Apple Mail (2.3124)
X-BeenThere: freebsd-hardware@freebsd.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: General discussion of FreeBSD hardware <freebsd-hardware.freebsd.org>
List-Unsubscribe: <https://lists.freebsd.org/mailman/options/freebsd-hardware>, 
 <mailto:freebsd-hardware-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hardware/>
List-Post: <mailto:freebsd-hardware@freebsd.org>
List-Help: <mailto:freebsd-hardware-request@freebsd.org?subject=help>
List-Subscribe: <https://lists.freebsd.org/mailman/listinfo/freebsd-hardware>, 
 <mailto:freebsd-hardware-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Wed, 22 Jun 2016 07:05:04 -0000


> On 22 Jun 2016, at 04:08, Jason Zhang <jasonzhang@cyphytech.com> =
wrote:
>=20
> Mark,
>=20
> Thanks
>=20
> We have same RAID setting both on FreeBSD and CentOS including cache =
setting.  In FreeBSD, I enabled the write cache but the performance is =
the same. =20
>=20
> We don=E2=80=99t use ZFS or UFS, and test the performance on the RAW =
GEOM disk =E2=80=9Cmfidx=E2=80=9D exported by mfi driver.  We observed =
the =E2=80=9Cgstat=E2=80=9D result and found that the write latency
> is too high.  When we =E2=80=9Cdd" the disk with 8k, it is lower than =
1ms, but it is 6ms on 64kb write.  It seems that each single write =
operation is very slow. But I don=E2=80=99t know
> whether it is a driver problem or not.

There is an option you can use (I do it all the time!) to make the card =
behave as a plain HBA so that the disks are handled by the =E2=80=9Cda=E2=80=
=9D driver.=20

Add this to /boot/loader.conf

hw.mfi.allow_cam_disk_passthrough=3D1
mfip_load=3D=E2=80=9CYES"

And do the tests accessing the disks as =E2=80=9Cda=E2=80=9D. To avoid =
confusions, it=E2=80=99s better to make sure the disks are not part of a =
=E2=80=9Cjbod=E2=80=9D or logical volume configuration.




Borja.