Date: Sun, 25 Feb 2024 15:51:10 -0800 From: Rick Macklem <rick.macklem@gmail.com> To: tuexen@freebsd.org Cc: Hannes Hauswedell <h2+lists2024@fsfe.org>, "freebsd-net@freebsd.org" <freebsd-net@freebsd.org> Subject: Re: NFS performance with 10GBase-T Message-ID: <CAM5tNy5guh99YZ7DLxgVsaE2LcXAqSSjs2FocMYpGJ9tspkYEQ@mail.gmail.com> In-Reply-To: <9066A50F-26DC-4314-B79E-66120A2B5A2F@freebsd.org> References: <034cc6ea-26d8-4520-879a-672459832407@fsfe.org> <9066A50F-26DC-4314-B79E-66120A2B5A2F@freebsd.org>
next in thread | previous in thread | raw e-mail | index | archive | help
On Sun, Feb 25, 2024 at 1:21=E2=80=AFAM <tuexen@freebsd.org> wrote: > > CAUTION: This email originated from outside of the University of Guelph. = Do not click links or open attachments unless you recognize the sender and = know the content is safe. If in doubt, forward suspicious emails to IThelp@= uoguelph.ca. > > > > On Feb 25, 2024, at 01:18, Hannes Hauswedell <h2+lists2024@fsfe.org> wr= ote: > > > > Hi everyone, > > > > I am coming here from > > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D2771971160 > I guess this should read: > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D277197 Btw, what Hannes reported in the PR was that performance was about the same for Linux and FreeBSD NFS clients when the link was using a 1500byte ethernet frames. However, Linux performs much better with 9K jumbo frames whereas FreeBSD performance does not improve for 9K jumbo frames. (Some mount options I suggested did help somewhat for FreeBSD. Basically increasing rsize/wsize did help, but he still sees performance below what Linux gets when 9K jumbo frames are used. (I did note the potential problem of mbuf cluster pool fragmentation when 9K jumbo frames are used, although I did not intent to imply that this issue is involved, just that it is a known deficiency that "might" be a factor.) rick > > Best regards > Michael > > > > TL;DR: > > > > * I have a FreeBSD14 Server and Client with an Intel X540 (ix) adaptor = each. > > * I am trying to improve the NFS throughput. > > * I get 1160 MiB/s via nc, but only ~200 MiB/s via NFS. > > * Increasing rsize and wsize to 1 MiB increases throughput to 395 MiB/s > > * But a Linux client achieves 560-600 MiB/s with any rsize. > > * The mtu is set to 9000 but this doesn't make a difference for the Fre= eBSD client (it does make a difference for Linux). > > > > I assume < 400 MiB/s is not the expected performance? Do you have any a= dvice on debugging this? > > > > Thank you for your help, > > Hannes > > > > >
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAM5tNy5guh99YZ7DLxgVsaE2LcXAqSSjs2FocMYpGJ9tspkYEQ>