Skip site navigation (1)Skip section navigation (2)
Date:      Thu, 21 Mar 2024 22:37:56 +0000
From:      bugzilla-noreply@freebsd.org
To:        fs@FreeBSD.org
Subject:   [Bug 277197] NFS is much too slow at 10GbaseT
Message-ID:  <bug-277197-3630-8wCPBQzoUr@https.bugs.freebsd.org/bugzilla/>
In-Reply-To: <bug-277197-3630@https.bugs.freebsd.org/bugzilla/>

index | next in thread | previous in thread | raw e-mail

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=277197

Peter Eriksson <pen@lysator.liu.se> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |pen@lysator.liu.se

--- Comment #6 from Peter Eriksson <pen@lysator.liu.se> ---
(In reply to Rick Macklem from comment #1)

A quick test between two FreeBSD 13.2 servers with 10G Intel X710 ethernet:
(writing to a ZFS zpool with spinning disks/log on SSD/cache on SSD):

# mount -t nfs -o sec=sys,vers=4 dedur01:/test /mnt
# cd /mnt

# dd if=/dev/zero of=16G bs=1M count=16384 status=progress
  16982736896 bytes (17 GB, 16 GiB) transferred 61.065s, 278 MB/s   

# dd of=/dev/null if=16G bs=1M count=16384 status=progress
  17151557632 bytes (17 GB, 16 GiB) transferred 49.015s, 350 MB/s   


# cd /
# umount /mnt

# mount -t nfs -o sec=sys,vers=4,readahead=8 dedur01:/test /mnt
# cd /mnt

# dd of=/dev/null if=16G bs=1M count=16384 status=progress
  16490954752 bytes (16 GB, 15 GiB) transferred 16.019s, 1029 MB/s  

# nfsstat -m
dedur01:/test on /mnt
nfsv4,minorversion=2,tcp,resvport,nconnect=1,hard,cto,sec=sys,acdirmin=3,acdirmax=60,acregmin=5,acregmax=60,nametimeo=60,negnametimeo=60,rsize=65536,wsize=65536,readdirsize=65536,readahead=8,wcommitsize=16777216,timeout=120,retrans=2147483647

# ifconfig ixl0
ixl0: flags=8963<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu
1500
       
options=4e507bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6,NOMAP>
        ether 3c:fd:fe:24:e7:e0
        media: Ethernet autoselect (10Gbase-Twinax <full-duplex>)
        status: active
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>


If I redo the read test without unmounting and remounting I get some silly
number like 4GB/s or so (cached locally in RAM I suppose :-)

-- 
You are receiving this mail because:
You are the assignee for the bug.

help

Want to link to this message? Use this
URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?bug-277197-3630-8wCPBQzoUr>