Date: Tue, 20 Feb 2024 16:34:45 +0000 From: bugzilla-noreply@freebsd.org To: bugs@FreeBSD.org Subject: [Bug 277197] NFS is much to slow at 10GbaseT Message-ID: <bug-277197-227@https.bugs.freebsd.org/bugzilla/>
next in thread | raw e-mail | index | archive | help
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D277197 Bug ID: 277197 Summary: NFS is much to slow at 10GbaseT Product: Base System Version: 14.0-RELEASE Hardware: amd64 OS: Any Status: New Severity: Affects Only Me Priority: --- Component: kern Assignee: bugs@FreeBSD.org Reporter: h2+fbsdports@fsfe.org I have FreeBSD 14 server and client. Both have Intel X540 10GBase-T adapters and are connected via CAT7 and a Netgear switch that has the respective 10GBase-T ports. Via iperf3, I measure 1233 MiB/s (9.87GBit/s) throughput.=20 Via nc, I measure 1160 MiB/s throughput. Via NFS, I get around 190-250MiB/s. I did not expect to get the full 1100Mi= B/s with NFS, but I did hope to be between 600-800MB/s at least. Various guides suggest tinkering with different TCP related sysctls, but I haven't had any luck improving the performance. And since nc also manages to push >1GByte over TCP, this doesn't seem like the core of the problem. I have replaced the base system's ix with the one from ports, but no change. Again, I don't think the driver or the network stack have an issue per se; = it seems to be NFS related. I have used default options to do the mounts. This is what nfsstat shows for the NFS3 mount: ``` nfsv3,tcp,resvport,nconnect=3D1,hard,cto,lockd,sec=3Dsys,acdirmin=3D3,acdir= max=3D60,acregmin=3D5,acregmax=3D60,nametimeo=3D60,n egnametimeo=3D60,rsize=3D65536,wsize=3D65536,readdirsize=3D65536,readahead= =3D1,wcommitsize=3D16777216,timeout=3D120,retrans=3D2=20 ``` and for the NFS4 mount: ``` nfsv4,minorversion=3D2,tcp,resvport,nconnect=3D1,hard,cto,sec=3Dsys,acdirmi= n=3D3,acdirmax=3D60,acregmin=3D5,acregmax=3D60,namet imeo=3D60,negnametimeo=3D60,rsize=3D65536,wsize=3D65536,readdirsize=3D65536= ,readahead=3D1,wcommitsize=3D16777216,timeout=3D120,re trans=3D2147483647 ``` Am I missing something? Is this a bug or a configuration problem? I will try to set up a linux NFS client to see if the issues are client or server related. Thanks for your help! P.S.: The server has an NVME raidz and can maintain throughput speeds over 900MiB/s reading and writing hundreds of gigabytes from/to different datase= ts of the pool. Even with encryption and compression. So I don't think disks a= re a limiting factor. --=20 You are receiving this mail because: You are the assignee for the bug.=
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?bug-277197-227>