From owner-freebsd-hardware@freebsd.org Fri Jun 17 13:42:29 2016 Return-Path: Delivered-To: freebsd-hardware@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B0E14A44EB4 for ; Fri, 17 Jun 2016 13:42:29 +0000 (UTC) (envelope-from crest@rlwinm.de) Received: from smtp.rlwinm.de (smtp.rlwinm.de [IPv6:2a01:4f8:201:31ef::e]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 7E29825EE for ; Fri, 17 Jun 2016 13:42:29 +0000 (UTC) (envelope-from crest@rlwinm.de) Received: from vader9.bultmann.eu (unknown [87.253.189.132]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.rlwinm.de (Postfix) with ESMTPSA id 43DCD2EAE for ; Fri, 17 Jun 2016 15:42:26 +0200 (CEST) Subject: Re: mfi driver performance too bad on LSI MegaRAID SAS 9260-8i To: freebsd-hardware@freebsd.org References: <16CD100A-3BD0-47BA-A91E-F445E5DF6DBC@cyphytech.com> From: Jan Bramkamp Message-ID: Date: Fri, 17 Jun 2016 15:42:25 +0200 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.11; rv:45.0) Gecko/20100101 Thunderbird/45.1.1 MIME-Version: 1.0 In-Reply-To: <16CD100A-3BD0-47BA-A91E-F445E5DF6DBC@cyphytech.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-hardware@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: General discussion of FreeBSD hardware List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 17 Jun 2016 13:42:29 -0000 On 17/06/16 09:17, Jason Zhang wrote: > Hi, > > I am working on storage service based on FreeBSD. I look forward to a good result because many professional storage company use FreeBSD as its OS. But I am disappointed with the Bad performance. I tested the the performance of LSI MegaRAID 9260-8i and had the following bad result: > > 1. Test environment: > (1) OS: FreeBSD 10.0 release > (2) Memory: 16G > (3) RAID adapter: LSI MegaRAID 9260-8i > (4) Disks: 9 SAS hard drives (10000 rpm), performance is expected for each hard drive > (5) Test tools: fio with io-depth=1, thread num is 32 and block size is 64k or 1M > (6) RAID configuration: RAID 5, stripe size is 1M > > 2. Test result: > (1) write performance too bad: 20Mbytes/s throughput and 200 random write IOPS > (2) read performance is expected: 700Mbytes/s throughput and 1500 random read IOPS > > > I tested the same hardware configuration with CentOS linux and Linux's write performance is 5 times better than FreeBSD. > > > Anyone encountered the same performance problem? Does the mfi driver have performance issue or I should give up on FreeBSD? I have an old server with the same LSI 2108 chip as onboard HW RAID controller, but I can't test run performance tests on it right now. As far as I remember the controller was a bit annoying to configure but works well for a SAS HW-RAID controller once configured. The real question is why do you even want to use a hardware RAID controller. In most cases you're better of with a dumb SAS HBA and ZFS. Hardware RAID controllers just get in the way. Invest in more RAM or low latency SSDs as dedicated ZIL devices instead of hardware RAID controllers if you want to build a FreeBSD based storage system. Which filesystem did you use for your benchmark? Please not that FreeBSD 10.0 is EoL. The latest FreeBSD release is 10.3 and FreeBSD 11.0 is just around the corner.