From owner-freebsd-hardware@freebsd.org  Wed Jun 22 02:14:22 2016
Return-Path: <owner-freebsd-hardware@freebsd.org>
Delivered-To: freebsd-hardware@mailman.ysv.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 by mailman.ysv.freebsd.org (Postfix) with ESMTP id 379B3AC524F;
 Wed, 22 Jun 2016 02:14:22 +0000 (UTC)
 (envelope-from jasonzhang@cyphytech.com)
Received: from m50-210.qiye.163.com (m50-210.qiye.163.com [123.125.50.210])
 by mx1.freebsd.org (Postfix) with ESMTP id DED3F16A7;
 Wed, 22 Jun 2016 02:14:19 +0000 (UTC)
 (envelope-from jasonzhang@cyphytech.com)
Received: from [192.168.120.81] (unknown [125.39.30.134])
 by smtp6 (Coremail) with SMTP id RNOowEDp80Mt82lXOrMOBQ--.15S3;
 Wed, 22 Jun 2016 10:08:45 +0800 (CST)
Content-Type: text/plain; charset=gb2312
Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\))
Subject: Re: mfi driver performance too bad on LSI MegaRAID SAS 9260-8i
From: Jason Zhang <jasonzhang@cyphytech.com>
In-Reply-To: <1466527001.2694442.644278905.18E236CD@webmail.messagingengine.com>
Date: Wed, 22 Jun 2016 10:08:49 +0800
Cc: freebsd-stable@freebsd.org, freebsd-performance@freebsd.org,
 freebsd-hardware@freebsd.org
Content-Transfer-Encoding: quoted-printable
Message-Id: <1790833A-9292-4A46-B43C-BF41C7C801BE@cyphytech.com>
References: <16CD100A-3BD0-47BA-A91E-F445E5DF6DBC@cyphytech.com>
 <1466527001.2694442.644278905.18E236CD@webmail.messagingengine.com>
To: Mark Felder <feld@FreeBSD.org>
X-Mailer: Apple Mail (2.3124)
X-CM-TRANSID: RNOowEDp80Mt82lXOrMOBQ--.15S3
X-Coremail-Antispam: 1Uf129KBjDUn29KB7ZKAUJUUUUU529EdanIXcx71UUUUU7v73
 VFW2AGmfu7bjvjm3AaLaJ3UbIYCTnIWIevJa73UjIFyTuYvjxUrXo7UUUUU
X-Originating-IP: [125.39.30.134]
X-CM-SenderInfo: pmdv00x2kd0wg6f11xp1whuxoofrz/1tbiQA2QHFbdGLa1zwAAse
X-BeenThere: freebsd-hardware@freebsd.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: General discussion of FreeBSD hardware <freebsd-hardware.freebsd.org>
List-Unsubscribe: <https://lists.freebsd.org/mailman/options/freebsd-hardware>, 
 <mailto:freebsd-hardware-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hardware/>
List-Post: <mailto:freebsd-hardware@freebsd.org>
List-Help: <mailto:freebsd-hardware-request@freebsd.org?subject=help>
List-Subscribe: <https://lists.freebsd.org/mailman/listinfo/freebsd-hardware>, 
 <mailto:freebsd-hardware-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Wed, 22 Jun 2016 02:14:22 -0000

Mark,

Thanks

We have same RAID setting both on FreeBSD and CentOS including cache =
setting.  In FreeBSD, I enabled the write cache but the performance is =
the same. =20

We don=A1=AFt use ZFS or UFS, and test the performance on the RAW GEOM =
disk =A1=B0mfidx=A1=B1 exported by mfi driver.  We observed the =
=A1=B0gstat=A1=B1 result and found that the write latency
is too high.  When we =A1=B0dd" the disk with 8k, it is lower than 1ms, =
but it is 6ms on 64kb write.  It seems that each single write operation =
is very slow. But I don=A1=AFt know
whether it is a driver problem or not.


Jason


> =D4=DA 2016=C4=EA6=D4=C222=C8=D5=A3=AC=C9=CF=CE=E712:36=A3=ACMark =
Felder <feld@FreeBSD.org> =D0=B4=B5=C0=A3=BA
>=20
>=20
>=20
> On Fri, Jun 17, 2016, at 02:17, Jason Zhang wrote:
>> Hi,
>>=20
>> I am working on storage service based on FreeBSD.  I look forward to =
a
>> good result because many professional storage company use FreeBSD as =
its
>> OS.  But I am disappointed with the Bad performance.  I tested the =
the
>> performance of LSI MegaRAID 9260-8i and had the following bad result:
>>=20
>>  1.  Test environment:
>>       (1) OS:   FreeBSD 10.0 release
>=20
> 10.0-RELEASE is no longer supported. Can you test this on =
10.3-RELEASE?
>=20
> Have you confirmed that both servers are using identical RAID =
controller
> settings? It's possible the CentOS install has enabled write caching =
but
> it's disabled on your FreeBSD server. Are you using UFS or ZFS on
> FreeBSD? Do you have atime enabled? I believe CentOS is going to have
> "relatime" or "nodiratime" by default to mitigate the write penalty on
> each read access.
>=20
> We need more data :-)
>=20
>=20
> --=20
>  Mark Felder
>  ports-secteam member
>  feld@FreeBSD.org