Skip site navigation (1)Skip section navigation (2)
Date:      Sat, 24 Feb 2024 21:52:11 -0500
From:      Mark Saad <nonesuch@longcount.org>
To:        freebsd-net@freebsd.org
Subject:   Re: NFS performance with 10GBase-T
Message-ID:  <9F370420-52DC-4895-B2B3-5254B6E470D0@longcount.org>
In-Reply-To: <034cc6ea-26d8-4520-879a-672459832407@fsfe.org>
References:  <034cc6ea-26d8-4520-879a-672459832407@fsfe.org>

next in thread | previous in thread | raw e-mail | index | archive | help

[-- Attachment #1 --]


> On Feb 24, 2024, at 7:18 PM, Hannes Hauswedell <h2+lists2024@fsfe.org> wrote:
> 
> Hi everyone,
> 
> I am coming here from
> https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=2771971160
> 
> TL;DR:
> 
> * I have a FreeBSD14 Server and Client with an Intel X540 (ix) adaptor each.
> * I am trying to improve the NFS throughput.
> * I get 1160 MiB/s via nc, but only ~200 MiB/s via NFS.
> * Increasing rsize and wsize to 1 MiB increases throughput to 395 MiB/s
> * But a Linux client achieves 560-600 MiB/s with any rsize.
> * The mtu is set to 9000 but this doesn't make a difference for the FreeBSD client (it does make a difference for Linux).
> 
> I assume < 400 MiB/s is not the expected performance? Do you have any advice on debugging this?
> 
> Thank you for your help,
> Hannes
> 

Hi Hannes,
  The link didn’t work . Can you tell us more about the file system , what type of disks . Details about the server , hardware details.  If you want post a copy of your dmesg to https://dmesgd.nycbug.org/index.cgi that can help too .

Also what kinds of clients are you using ?

Do you have any relevant network stats or a topology/ diagram of the shape of things ? 

Mark saad | nonesuch@longcount.org
[-- Attachment #2 --]
<html><head><meta http-equiv="content-type" content="text/html; charset=utf-8"></head><body dir="auto"><div dir="ltr"><br></div><div dir="ltr"><br><blockquote type="cite">On Feb 24, 2024, at 7:18 PM, Hannes Hauswedell &lt;h2+lists2024@fsfe.org&gt; wrote:<br><br></blockquote></div><blockquote type="cite"><div dir="ltr"><span>Hi everyone,</span><br><span></span><br><span>I am coming here from</span><br><span>https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=2771971160</span><br><span></span><br><span>TL;DR:</span><br><span></span><br><span>* I have a FreeBSD14 Server and Client with an Intel X540 (ix) adaptor each.</span><br><span>* I am trying to improve the NFS throughput.</span><br><span>* I get 1160 MiB/s via nc, but only ~200 MiB/s via NFS.</span><br><span>* Increasing rsize and wsize to 1 MiB increases throughput to 395 MiB/s</span><br><span>* But a Linux client achieves 560-600 MiB/s with any rsize.</span><br><span>* The mtu is set to 9000 but this doesn't make a difference for the FreeBSD client (it does make a difference for Linux).</span><br><span></span><br><span>I assume &lt; 400 MiB/s is not the expected performance? Do you have any advice on debugging this?</span><br><span></span><br><span>Thank you for your help,</span><br><span>Hannes</span><br><span></span><br></div></blockquote><br><div>Hi Hannes,</div><div>&nbsp; The link didn’t work . Can you tell us more about the file system , what type of disks . Details about the server , hardware details. &nbsp;If you want post a copy of your dmesg to&nbsp;<a href="https://dmesgd.nycbug.org/index.cgi">https://dmesgd.nycbug.org/index.cgi</a>&nbsp;that can help too .</div><div><br></div><div>Also what kinds of clients are you using ?</div><div><br></div><div>Do you have any relevant network stats or a topology/ diagram of the shape of things ?&nbsp;</div><div><br></div><div><div style="display: block;" class="">Mark saad | nonesuch@longcount.org</div></div></body></html>

Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?9F370420-52DC-4895-B2B3-5254B6E470D0>