From nobody Tue Feb 20 16:34:45 2024 X-Original-To: bugs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TfQ3p2Dmvz53xBN for ; Tue, 20 Feb 2024 16:34:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4TfQ3n6Q7Yz48L3 for ; Tue, 20 Feb 2024 16:34:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1708446885; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=R9Ey60JqkXeqiXLouy4i0IpGq04SJVd2OSdlAUXDpHc=; b=qhjScnQTIvnbMIEYhJpuW/Zz4nmYCWBtzoD8nI32mR+J75VR+JoOTOe1g+SNpGT+mUxlsV +sl9JjqKuW3nUcPXiOttGtvLKFUQmHGHMcE1Oax7oA6RRBYEeovpAgFByOCr3hxLxPZOnx FY7GK4aEV9i3BXy4XAbR3JwVyNvkjVzvKmwr7Py2CeBTdjbNgRNTGFYnTz+jz+fit7La0a VRrzE34mKGLgTq968q9x+wEMkVoRL8t52dz2l59gTp/T94VsKqKduTe6VF2kWg6o26WtML 571heumrIWFjGvGAatTt0Uuo4eYk4BKUZRazxcNDP7kqcP2VAxeac69Eq5lWLQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1708446885; a=rsa-sha256; cv=none; b=W8NOa1YgL0wb8bOLwf7iOvjyJxmKirzkqzVq2VTmp9MX9RKwps+BGWyx18Rec0ZP/mqHCw 2B95G+iZ9ZAe+V/ISHl+ikogKp9SiE0wD0KemMERleLAb1ZWW8ep1W+S8h0KRS3hXodaa6 shAfwz2dGG0Wlc5Rz0Up6/BYHtcuTtyNtQjpU8BgDaKOXVkmA9lfPvYTvxpwU7Xmh2QoQD 9rxQXbftdkxZ1/GzeLNq9UiYOETMmr2sN9rfLiz8AHDScci8KkwFv4D/ZMeC3MQlochA2q RuS4f3liRocXtpRmkuEY//6AL9yJLEoRpoj+5WMexuK/N+0uhyID0WslleIFcA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4TfQ3n52P9zQ7G for ; Tue, 20 Feb 2024 16:34:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 41KGYjSk029977 for ; Tue, 20 Feb 2024 16:34:45 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 41KGYjF9029971 for bugs@FreeBSD.org; Tue, 20 Feb 2024 16:34:45 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: bugs@FreeBSD.org Subject: [Bug 277197] NFS is much to slow at 10GbaseT Date: Tue, 20 Feb 2024 16:34:45 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 14.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: h2+fbsdports@fsfe.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Bug reports List-Archive: https://lists.freebsd.org/archives/freebsd-bugs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-bugs@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D277197 Bug ID: 277197 Summary: NFS is much to slow at 10GbaseT Product: Base System Version: 14.0-RELEASE Hardware: amd64 OS: Any Status: New Severity: Affects Only Me Priority: --- Component: kern Assignee: bugs@FreeBSD.org Reporter: h2+fbsdports@fsfe.org I have FreeBSD 14 server and client. Both have Intel X540 10GBase-T adapters and are connected via CAT7 and a Netgear switch that has the respective 10GBase-T ports. Via iperf3, I measure 1233 MiB/s (9.87GBit/s) throughput.=20 Via nc, I measure 1160 MiB/s throughput. Via NFS, I get around 190-250MiB/s. I did not expect to get the full 1100Mi= B/s with NFS, but I did hope to be between 600-800MB/s at least. Various guides suggest tinkering with different TCP related sysctls, but I haven't had any luck improving the performance. And since nc also manages to push >1GByte over TCP, this doesn't seem like the core of the problem. I have replaced the base system's ix with the one from ports, but no change. Again, I don't think the driver or the network stack have an issue per se; = it seems to be NFS related. I have used default options to do the mounts. This is what nfsstat shows for the NFS3 mount: ``` nfsv3,tcp,resvport,nconnect=3D1,hard,cto,lockd,sec=3Dsys,acdirmin=3D3,acdir= max=3D60,acregmin=3D5,acregmax=3D60,nametimeo=3D60,n egnametimeo=3D60,rsize=3D65536,wsize=3D65536,readdirsize=3D65536,readahead= =3D1,wcommitsize=3D16777216,timeout=3D120,retrans=3D2=20 ``` and for the NFS4 mount: ``` nfsv4,minorversion=3D2,tcp,resvport,nconnect=3D1,hard,cto,sec=3Dsys,acdirmi= n=3D3,acdirmax=3D60,acregmin=3D5,acregmax=3D60,namet imeo=3D60,negnametimeo=3D60,rsize=3D65536,wsize=3D65536,readdirsize=3D65536= ,readahead=3D1,wcommitsize=3D16777216,timeout=3D120,re trans=3D2147483647 ``` Am I missing something? Is this a bug or a configuration problem? I will try to set up a linux NFS client to see if the issues are client or server related. Thanks for your help! P.S.: The server has an NVME raidz and can maintain throughput speeds over 900MiB/s reading and writing hundreds of gigabytes from/to different datase= ts of the pool. Even with encryption and compression. So I don't think disks a= re a limiting factor. --=20 You are receiving this mail because: You are the assignee for the bug.=