From nobody Sun Mar 20 12:26:47 2022 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 008DB1A14E92 for ; Sun, 20 Mar 2022 12:26:50 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "smarthost1.sentex.ca", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KLxnj2Y0fz4Z5b for ; Sun, 20 Mar 2022 12:26:49 +0000 (UTC) (envelope-from mike@sentex.net) Received: from pyroxene2a.sentex.ca (pyroxene19.sentex.ca [199.212.134.19]) by smarthost1.sentex.ca (8.16.1/8.16.1) with ESMTPS id 22KCQmR2008869 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Sun, 20 Mar 2022 08:26:48 -0400 (EDT) (envelope-from mike@sentex.net) Received: from [IPV6:2607:f3e0:0:4:7416:8ada:3120:2eaf] ([IPv6:2607:f3e0:0:4:7416:8ada:3120:2eaf]) by pyroxene2a.sentex.ca (8.16.1/8.15.2) with ESMTPS id 22KCQlGf010464 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO); Sun, 20 Mar 2022 08:26:48 -0400 (EDT) (envelope-from mike@sentex.net) Message-ID: <9aee6d0f-e1c9-8c98-7352-7a0ff3e3d147@sentex.net> Date: Sun, 20 Mar 2022 08:26:47 -0400 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Thunderbird/91.7.0 Subject: Re: nfsd becomes slow when machine CPU usage is at or over 100% on STABLE/13 Content-Language: en-US From: mike tancsa To: Yoshihiro Ota , Rick Macklem Cc: freebsd-stable References: <20220309034601.ea3135e31aec3ffb2623f145@j.email.ne.jp> <20220318211850.67b77d43b3a02043c3819bf3@j.email.ne.jp> <9b2935cd-5f70-d2a2-a328-004fa3e7b3f8@sentex.net> In-Reply-To: <9b2935cd-5f70-d2a2-a328-004fa3e7b3f8@sentex.net> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Scanned-By: MIMEDefang 2.84 X-Rspamd-Queue-Id: 4KLxnj2Y0fz4Z5b X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of mike@sentex.net designates 2607:f3e0:0:1::12 as permitted sender) smtp.mailfrom=mike@sentex.net X-Spamd-Result: default: False [-1.55 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FREEFALL_USER(0.00)[mike]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip6:2607:f3e0::/32]; NEURAL_HAM_LONG(-1.00)[-0.999]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[sentex.net]; NEURAL_SPAM_SHORT(0.85)[0.851]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; MLMMJ_DEST(0.00)[freebsd-stable]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:11647, ipnet:2607:f3e0::/32, country:CA]; RCVD_TLS_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[199.212.134.19:received] X-ThisMailContainsUnwantedMimeParts: N On 3/20/2022 7:43 AM, mike tancsa wrote: > On 3/18/2022 9:18 PM, Yoshihiro Ota wrote: >> I had built several versions between releng/13.0 branch point to >> stable/13 (before releng/13.1 was created) and all of them had such >> performance degrade. >> >> I started suspecting stable debug options and thus built releng/13.1 >> and tested. >> I don't see NFS slowdown unlike stable/13. >> releng/13.0 and releng/12.2 were also fine. > > Hi, > >     I would think there is very little difference (if any) between > releng/13.1 and stable/13 right now.  Are you sure stable/13 suffers > from this issue you are seeing ? > > These look to be the only files touched below. 0{cage}% git diff remotes/origin/releng/13.1..remotes/origin/stable/13 | grep '^\-\-' --- a/contrib/tzcode/stdtime/ctime.3 --- a/lib/libc/gen/time.3 --- a/lib/libcasper/services/cap_net/cap_net.c --- a/lib/libpfctl/libpfctl.c --- a/lib/libpfctl/libpfctl.h --- a/libexec/rc/rc.d/dumpon --- a/release/pkg_repos/release-dvd.conf --- a/sbin/devd/devd.conf --- a/sbin/ipf/common/ipf.h --- a/sbin/ipf/libipf/printactivenat.c --- a/sbin/ipf/libipf/printstate.c --- a/sbin/pfctl/pfctl.c --- a/sbin/pfctl/pfctl_optimize.c --- a/share/man/man4/Makefile --- a/share/man/man4/netmap.4 --- /dev/null --- a/share/man/man4/vale.4 --- a/share/man/man9/crypto_buffer.9 --- a/stand/efi/libefi/efi_console.c --- a/stand/i386/libi386/vidconsole.c --- a/sys/arm64/include/pcpu.h --- a/sys/cddl/contrib/opensolaris/uts/common/dtrace/fasttrap.c --- a/sys/cddl/contrib/opensolaris/uts/intel/dtrace/fasttrap_isa.c --- a/sys/conf/newvers.sh --- a/sys/crypto/armv8/armv8_crypto.c --- a/sys/crypto/armv8/armv8_crypto.h --- a/sys/crypto/armv8/armv8_crypto_wrap.c --- a/sys/dev/netmap/netmap.c --- a/sys/dev/netmap/netmap_bdg.c --- a/sys/dev/netmap/netmap_kern.h --- a/sys/dev/netmap/netmap_vale.c --- a/sys/i386/i386/machdep.c --- a/sys/kern/kern_rmlock.c --- a/sys/kern/sys_process.c --- a/sys/kern/vfs_cache.c --- a/sys/kern/vfs_subr.c --- a/sys/modules/if_epair/Makefile --- a/sys/modules/linuxkpi/Makefile --- a/sys/net/if_epair.c --- a/sys/opencrypto/cryptodev.h --- a/sys/riscv/include/cpufunc.h --- a/sys/riscv/include/pmap.h --- a/sys/riscv/include/pte.h --- a/sys/riscv/include/riscvreg.h --- a/sys/riscv/include/vmparam.h --- a/sys/riscv/riscv/elf_machdep.c --- a/sys/riscv/riscv/locore.S --- a/sys/riscv/riscv/pmap.c --- a/sys/sys/param.h --- a/sys/x86/x86/mp_x86.c --- a/usr.bin/diff/pr.c --- a/usr.bin/touch/touch.c 0{cage}%