From owner-freebsd-questions@FreeBSD.ORG Thu Nov 3 10:24:46 2011 Return-Path: <owner-freebsd-questions@FreeBSD.ORG> Delivered-To: FreeBSD-Questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C19401065670 for <FreeBSD-Questions@freebsd.org>; Thu, 3 Nov 2011 10:24:46 +0000 (UTC) (envelope-from vince@unsane.co.uk) Received: from unsane.co.uk (unsane-pt.tunnel.tserv5.lon1.ipv6.he.net [IPv6:2001:470:1f08:110::2]) by mx1.freebsd.org (Postfix) with ESMTP id 358B18FC15 for <FreeBSD-Questions@freebsd.org>; Thu, 3 Nov 2011 10:24:46 +0000 (UTC) Received: from vhoffman-macbooklocal.local (lon.namesco.net [195.7.254.102]) (authenticated bits=0) by unsane.co.uk (8.14.4/8.14.4) with ESMTP id pA3AOiVP050119 (version=TLSv1/SSLv3 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO); Thu, 3 Nov 2011 10:24:45 GMT (envelope-from vince@unsane.co.uk) Message-ID: <4EB26BEC.3070004@unsane.co.uk> Date: Thu, 03 Nov 2011 10:24:44 +0000 From: Vincent Hoffman <vince@unsane.co.uk> User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:7.0.1) Gecko/20110929 Thunderbird/7.0.1 MIME-Version: 1.0 To: Michael Sierchio <kudzu@tenebras.com> References: <4EB1D792.8070103@unsane.co.uk> <CAHu1Y71aQAZuSsAsJPTbqoz3LNnaqo5enf0ZRXzY_YfEOARjMw@mail.gmail.com> In-Reply-To: <CAHu1Y71aQAZuSsAsJPTbqoz3LNnaqo5enf0ZRXzY_YfEOARjMw@mail.gmail.com> X-Enigmail-Version: 1.3.2 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: FreeBSD-Questions@freebsd.org Subject: Re: nfs client speed lower than expected. X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions <freebsd-questions.freebsd.org> List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-questions>, <mailto:freebsd-questions-request@freebsd.org?subject=unsubscribe> List-Archive: <http://lists.freebsd.org/pipermail/freebsd-questions> List-Post: <mailto:freebsd-questions@freebsd.org> List-Help: <mailto:freebsd-questions-request@freebsd.org?subject=help> List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-questions>, <mailto:freebsd-questions-request@freebsd.org?subject=subscribe> X-List-Received-Date: Thu, 03 Nov 2011 10:24:46 -0000 I'll give it a try when i get a moment, These servers are all on gigabit LAN (sadly 1500 mtu until I can get the network guy to schedule an outage to reboot the switches and enable jumbo frames,) same subnet so i would expect UDP to have similar or better performance. Vince On 02/11/2011 23:53, Michael Sierchio wrote: > Mount via tcp. > > On Wed, Nov 2, 2011 at 4:51 PM, Vincent Hoffman <vince@unsane.co.uk> wrote: >> Hi all, >> What kind of speed should I be expecting over an NFS mount from >> a linux box using a gig interface (igb)? I'm seeing linux clients >> getting approx 2 or 3 times the throughput rsyncing files from a linux >> nfs server that i get from a 8-stable FreeBSD client. >> representative results >> 7.26MB/s - Freebsd client >> 21.10MB/s liunx client >> I've tried a variety of files to try and take caching out of the >> equation, I've tweaked a few sysctls after much googling >> >> kern.ipc.maxsockbuf=4000000 >> net.inet.tcp.sendbuf_max=16777216 >> net.inet.tcp.recvbuf_max=16777216 >> net.inet.tcp.sendbuf_inc=16384 >> net.inet.tcp.recvbuf_inc=524288 >> net.inet.udp.recvspace=65535 >> net.local.stream.recvspace=65535 >> net.local.stream.sendspace=65535 >> >> with no obvious improvement. >> freebsd mount options >> ro,noatime,noexec,nosuid,udp,nfsv3,rsize=1024,wsize=1024,bg,hard,intr,timeout=4,retrans=4 >> linux mount options >> _netdev,ro,noatime,nodev,noexec,nosuid,proto=udp,vers=3,rsize=1k,wsize=1k,bg,hard,intr,timeo=4,retrans=4 >> >> I have seen that using the linux server as an nfs client to write to the >> NFS server on the freebsd box gives similar performance to a linux >> client pulling from the linux server so I'm guessing its something to do >> with the freebsd nfs client? >> >> Any suggestions/clues welcome. >> >> Thanks, >> Vince >> _______________________________________________ >> freebsd-questions@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-questions >> To unsubscribe, send any mail to "freebsd-questions-unsubscribe@freebsd.org" >>