From owner-freebsd-fs@FreeBSD.ORG Thu Apr 25 20:40:11 2013 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 29BDD56F for ; Thu, 25 Apr 2013 20:40:11 +0000 (UTC) (envelope-from scrappy@hub.org) Received: from hub.org (hub.org [200.46.208.146]) by mx1.freebsd.org (Postfix) with ESMTP id ED5F81A41 for ; Thu, 25 Apr 2013 20:40:10 +0000 (UTC) Received: from maia.hub.org (unknown [200.46.151.188]) by hub.org (Postfix) with ESMTP id 08D13B9808D; Thu, 25 Apr 2013 17:40:10 -0300 (ADT) Received: from hub.org ([200.46.208.146]) by maia.hub.org (mx1.hub.org [200.46.151.188]) (amavisd-maia, port 10024) with ESMTP id 45116-01; Thu, 25 Apr 2013 20:40:09 +0000 (UTC) Received: from [10.5.250.150] (remote.ilcs.sd63.bc.ca [142.31.148.2]) by hub.org (Postfix) with ESMTPA id 25869B9808C; Thu, 25 Apr 2013 17:40:08 -0300 (ADT) Content-Type: text/plain; charset=windows-1252 Mime-Version: 1.0 (Mac OS X Mail 6.3 \(1503\)) Subject: Re: NFS Performance issue against NetApp From: "Marc G. Fournier" In-Reply-To: <972106612.1125159.1366850215231.JavaMail.root@erie.cs.uoguelph.ca> Date: Thu, 25 Apr 2013 13:40:07 -0700 Content-Transfer-Encoding: quoted-printable Message-Id: <9393AE5A-CDF5-4541-85CC-F402D8652A0F@hub.org> References: <972106612.1125159.1366850215231.JavaMail.root@erie.cs.uoguelph.ca> To: Rick Macklem X-Mailer: Apple Mail (2.1503) Cc: freebsd-fs@freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Apr 2013 20:40:11 -0000 On 2013-04-24, at 17:36 , Rick Macklem wrote: >>=20 > For the new client, it defaults to the min(MAXBSIZE, server-max), = where > server-max is whatever the server says is its maximum (also MAXBSIZE = for > the new server). I think the old server uses 32768. > These numbers are for the default tcp mounts. Specify udp (or mntudp) = and > I think the default becomes 16384. >=20 > If you explicitly set rsize=3DN,wsize=3DN on a mount, those sizes will = be > used unless they are greater than min(MAXBSIZE, server-max). MAXBSIZE = is > the limit for the client side buffer cache and server-max is whatever > the server says is its max, so the client never uses a value greater = than > that. >=20 > For readahead, the default is 1. This seems rather small to me and I = think is > in the "from the old days" category. You can set it to > a larger value, although there is an ifdef'd upper limit, which is = what > you'll get if you specify a really large value for readahead. = Admittedly, > if you are using a large rsize,wsize on a low latency LAN, readahead=3D1= > may be sufficient. >=20 > As someone else noted, if you are using head or stable/9, "nfsstat -m" > shows you what is actually being used, for the new client only. 'k, with the Intel card in (igb driver), I've tried various different = mount options =85 64k (default), 32k, 1/2/3 for read ahead =85 all tend = to come ou taround the same 250s to run =85 I'm getting drastic now, = and am reformatting one of the other server (exact same config, but = without the Intel for the first try) with Centos 6.4 =85 test out its = nfsclient =85 see if I get similar results =85=20=