From nobody Wed Mar 9 08:46:01 2022 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 626D21A07C74 for ; Wed, 9 Mar 2022 13:44:25 +0000 (UTC) (envelope-from ota@j.email.ne.jp) Received: from mail02.asahi-net.or.jp (mail02.asahi-net.or.jp [202.224.55.14]) by mx1.freebsd.org (Postfix) with ESMTP id 4KDD2H4PSyz3mM2 for ; Wed, 9 Mar 2022 13:44:23 +0000 (UTC) (envelope-from ota@j.email.ne.jp) Received: from vmware13.advok.com (pool-96-225-64-148.nwrknj.fios.verizon.net [96.225.64.148]) (Authenticated sender: NR2Y-OOT) by mail02.asahi-net.or.jp (Postfix) with ESMTPSA id 2EE732C033 for ; Wed, 9 Mar 2022 22:44:13 +0900 (JST) Date: Wed, 9 Mar 2022 03:46:01 -0500 From: Yoshihiro Ota To: freebsd-stable Subject: nfsd becomes slow when machine CPU usage is at or over 100% on STABLE/13 Message-Id: <20220309034601.ea3135e31aec3ffb2623f145@j.email.ne.jp> X-Mailer: Sylpheed 3.7.0 (GTK+ 2.24.33; i386-portbld-freebsd12.2) List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4KDD2H4PSyz3mM2 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of ota@j.email.ne.jp designates 202.224.55.14 as permitted sender) smtp.mailfrom=ota@j.email.ne.jp X-Spamd-Result: default: False [-2.16 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.47)[-0.472]; FROM_HAS_DN(0.00)[]; MV_CASE(0.50)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; DMARC_NA(0.00)[email.ne.jp]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-0.99)[-0.986]; RCVD_IN_DNSWL_NONE(0.00)[202.224.55.14:from]; R_SPF_ALLOW(-0.20)[+ip4:202.224.55.0/24]; MLMMJ_DEST(0.00)[freebsd-stable]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:4685, ipnet:202.224.32.0/19, country:JP]; RCVD_COUNT_TWO(0.00)[2]; MID_RHS_MATCH_FROM(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[96.225.64.148:received] X-ThisMailContainsUnwantedMimeParts: N Hi, I'm on stable/13 with latest code base. I started testing pre-13.1 branch. I noticed major performance degrades with NFS when all CPUs are fully utilized. This happends with stable/13 but not releng/13.0 nor releng/12.3. I had NFS server with above versions and rsynced nfs mount to ufs mount on NFS clients. My NFS server has 4 cores. When I had load average of 3 with make buildworld -j3, NFS server was fine. After adding another 1 load, NFS server throughput came down to about 10% of before. After taking back to 3 load avg, performance recovered and down again after getting over 4. Disk was fully avaiable for rsync; buildworld was done on another disk. Someone told me his smbfs was also slow and he suspected TCP/IP regression instead of NFS, by the way. Hiro