From owner-freebsd-current@FreeBSD.ORG Thu Sep 13 20:49:55 2012 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B76F9106566B; Thu, 13 Sep 2012 20:49:55 +0000 (UTC) (envelope-from sendtomatt@gmail.com) Received: from mail-pb0-f54.google.com (mail-pb0-f54.google.com [209.85.160.54]) by mx1.freebsd.org (Postfix) with ESMTP id 5DC718FC12; Thu, 13 Sep 2012 20:49:55 +0000 (UTC) Received: by pbbrp2 with SMTP id rp2so4982980pbb.13 for ; Thu, 13 Sep 2012 13:49:55 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:x-enigmail-version:content-type :content-transfer-encoding; bh=lDNVU/iuQVUfJv4UUmN5J8pRosaLdS0/8yb+9e8TpUw=; b=drkbfwOWpv2maieaVSSZ6RcH0677zVVDwu3kCjyGanfjy+vMYABRpuPWdXcFStGwi/ 0F1BpGu95AtliUTXGt5gk4tAtGignyHeOR1NiRwArcj81O4K50ntpK0bMAIokXKyDWue 1tjQijq/tH5FXHrFdUAKIkdaW3TTmTWwyPJya8Tqs1BOOdQV1jPkAISuuh0yUJjdH6wB blLCCRnukOkOzBznqNKLlnOD0bNXzOF3/1PYGz9iLKwstgBKpNEvJTe09glL5GFySJn3 yI7WViUDGNalaGdISjV9QG3uWhsIpvvv5a6/3fmt+xl1lqyCj1e7NAHr27aFeIjzOq5d qIVA== Received: by 10.66.85.4 with SMTP id d4mr631342paz.11.1347569395127; Thu, 13 Sep 2012 13:49:55 -0700 (PDT) Received: from bakeneko.local (108-213-216-134.lightspeed.sntcca.sbcglobal.net. [108.213.216.134]) by mx.google.com with ESMTPS id nt7sm7466124pbb.33.2012.09.13.13.49.52 (version=SSLv3 cipher=OTHER); Thu, 13 Sep 2012 13:49:54 -0700 (PDT) Message-ID: <50524694.3040808@gmail.com> Date: Thu, 13 Sep 2012 13:48:20 -0700 From: matt User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:10.0.7) Gecko/20120913 Thunderbird/10.0.7 MIME-Version: 1.0 To: Garrett Cooper References: <6A0C3360-0A1E-4905-A33E-D6CC590D7A5A@bnc.net> <504E200A.5020604@gmail.com> <504E330A.4090806@FreeBSD.org> <504E9EB0.2040504@gmail.com> <505239E2.1040805@gmail.com> In-Reply-To: X-Enigmail-Version: 1.3.5 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: Achim Patzner , Andrey Zonov , freebsd-current@freebsd.org Subject: Re: mfi driver performance X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 13 Sep 2012 20:49:55 -0000 On 09/13/12 13:13, Garrett Cooper wrote: > On Thu, Sep 13, 2012 at 12:54 PM, matt wrote: >> On 09/10/12 19:31, Garrett Cooper wrote: > ... > >> It seems hw.mfi.max_cmds is read only. The performance is pretty close to >> expected with no nvram or bbu on this card and commodity disks from 1.5 >> years ago, as far as I'm concerned. I'd love better write performance, but >> it's probably being held back by the single platter in the mirror when it is >> writing far from its edge. > Try loader.conf: > > $ grep -r hw.mfi.max_cmds /sys/dev/mfi/ > /sys/dev/mfi/mfi.c:TUNABLE_INT("hw.mfi.max_cmds", &mfi_max_cmds); > > Cheers, > -Garrett $ cat /usr/src/sys/dev/mfi/*.c | fgrep 'max_cmds' static int mfi_max_cmds = 128; TUNABLE_INT("hw.mfi.max_cmds", &mfi_max_cmds); SYSCTL_INT(_hw_mfi, OID_AUTO, max_cmds, CTLFLAG_RD, &mfi_max_cmds, ncmds = MIN(mfi_max_cmds, sc->mfi_max_fw_cmds); Definitely a loader tunable, thanks. I'll try increasing and decreasing the value and running bonnie again...Still not sure whether I'm getting 3gb/s and 6gb/s negotiation with my drives. MPS correctly reported da devices with 600mb/s and 300mb/s transfers where appropriate. mfiutil doesn't seem to know, and mfip devices appear as 150mb/s. No transfer speed message when mfisyspd devices attach. Matt