From owner-freebsd-current@FreeBSD.ORG Tue Sep 11 02:31:43 2012 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 2DA3D10656A7; Tue, 11 Sep 2012 02:31:43 +0000 (UTC) (envelope-from yanegomi@gmail.com) Received: from mail-oa0-f54.google.com (mail-oa0-f54.google.com [209.85.219.54]) by mx1.freebsd.org (Postfix) with ESMTP id D0B0E8FC15; Tue, 11 Sep 2012 02:31:42 +0000 (UTC) Received: by oagm1 with SMTP id m1so7875oag.13 for ; Mon, 10 Sep 2012 19:31:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=C9VjtnJjs+bHrPvyPzfCXSvIznJg8N/DRU0XzLqaYuM=; b=AWqvhahKvtbJQBTJk1rE4yKvCjQ9QHmdnpBm7QZNWBYCKIqrvnw4bOYJl3VVN5GrIv wduN9iGNJFV4yvDCXl94YCDxK0e8BCOCKoibWzTDfz94N88NL0OnAaTFiHGJP7EkxDiC vg6fdHVur9zFNw5SYAm9TtDeDym43O1DqtlgtWkJC4B3OWc3TPdk7C0uKxfZPwp6Bl8E XvGV9ZWlDLaNBDHqzjXM8ZShO3hZqtYIkj3Z8HJZZ0HocQt82h8iFgZQ5lhg2sVoeA4W 3ez8BwBm6gtgKy10X4E1yy7tU3gx7irQYFQ3CxbKs9rI3/iys7OvBNIT1xay4289YELO n8dA== MIME-Version: 1.0 Received: by 10.60.20.69 with SMTP id l5mr16001572oee.114.1347330702422; Mon, 10 Sep 2012 19:31:42 -0700 (PDT) Received: by 10.76.142.201 with HTTP; Mon, 10 Sep 2012 19:31:42 -0700 (PDT) In-Reply-To: <504E9EB0.2040504@gmail.com> References: <6A0C3360-0A1E-4905-A33E-D6CC590D7A5A@bnc.net> <504E200A.5020604@gmail.com> <504E330A.4090806@FreeBSD.org> <504E9EB0.2040504@gmail.com> Date: Mon, 10 Sep 2012 19:31:42 -0700 Message-ID: From: Garrett Cooper To: matt Content-Type: text/plain; charset=ISO-8859-1 Cc: Achim Patzner , Andrey Zonov , freebsd-current@freebsd.org Subject: Re: mfi driver performance X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 11 Sep 2012 02:31:43 -0000 On Mon, Sep 10, 2012 at 7:15 PM, matt wrote: ... > mfip was necessary, and allowed smartctl to work with '-d sat' > > bonnie++ comparison. Run with no options immediately after system boot. In > both cases the same disks are used, two Seagate Barracuda 1TB 3G/S (twin > platter) and a Barracuda 500G 3G/s (single platter) in a zfs triple mirror > that the system was booted from. All are 7200 RPM drives with 32mb cache, > and mediocre performance compared to my hitachi 7k3000s or the 15k sas > cheetahs at work etc. Firmwares were the latest 2108it vs the latest imr_fw > that work on the 9240/9220/m1015/drake skinny. I wish I had some 6g ssds to > try! > > MPS: > Version 1.96 ------Sequential Output------ --Sequential Input- --Random- > Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- > Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP > flatline.local 32G 122 99 71588 24 53293 20 284 90 222157 33 252.6 49 > Latency 542ms 356ms 914ms 991ms 337ms 271ms > Version 1.96 ------Sequential Create------ --------Random Create-------- > flatline.local -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- > files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP > 16 22197 93 9367 27 16821 99 23555 99 +++++ +++ 23717 99 > Latency 31650us 290ms 869us 23036us 66us 131us > 1.96,1.96,flatline.local,1,1347322810,32G,,122,99,71588,24,53293,20,284,90,222157,33,252.6,49,16,,,,,22197,93,9367,27,16821,99,23555,99,+++++,+++,23717,99,542ms,356ms,914ms,991ms,337ms,271ms,31650us,290ms,869us,23036us,66us,131us > > MFI: > Version 1.96 ------Sequential Output------ --Sequential Input- --Random- > Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- > Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP > flatline.local 32G 125 99 71443 24 53177 21 317 99 220280 33 255.3 52 > Latency 533ms 566ms 1134ms 86565us 357ms 252ms > Version 1.96 ------Sequential Create------ --------Random Create-------- > flatline.local -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- > files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP > 16 22347 94 12389 30 16804 100 18729 99 27798 99 5317 99 > Latency 33818us 233ms 558us 26581us 75us 12319us > 1.96,1.96,flatline.local,1,1347329123,32G,,125,99,71443,24,53177,21,317,99,220280,33,255.3,52,16,,,,,22347,94,12389,30,16804,100,18729,99,27798,99,5317,99,533ms,566ms,1134ms,86565us,357ms,252ms,33818us,233ms,558us,26581us,75us,12319us > > A close race, with some wins for each. Latency on sequential input and > deleted files per second appear to be interesting salients. > A lot of the other stuff is back and forth and probably not statistically > significant (although not much of a sample set :) ). > > I tried to control as many variables as possible, but obviously it's one > controller in one configuration, Your Mileage May Vary. Try upping the queue depth (hw.mfi.max_cmds); this is controller dependent. Cheers, -Garrett