From nobody Fri Oct 3 03:45:07 2025 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4cdF1M0RGWz69MRD for ; Fri, 03 Oct 2025 03:45:27 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic309-22.consmr.mail.gq1.yahoo.com (sonic309-22.consmr.mail.gq1.yahoo.com [98.137.65.148]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4cdF1L54vZz3HXt for ; Fri, 03 Oct 2025 03:45:26 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=kpds9W6P; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.65.148 as permitted sender) smtp.mailfrom=marklmi@yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1759463120; bh=ddFbdyg5hJCtfAd91pgVk5SirWDLHzWXbWcPt2NZ3jQ=; h=From:Subject:Date:References:To:In-Reply-To:From:Subject:Reply-To; b=kpds9W6PAdU2ZoMZ4ABes+01oldfude4VJmIpKFfUphpM13803nOB6b7rC1aVyeD58Q00EcIr8dJ75n0yYqlrkFPSlX8VDpI8u9VbqBXkiN70sGT/fREZt+v/VYpjsclO5VouzvtoGiN5oq7bUQ2c3bAJH4vQ/QqAqmS0+GO4vnKO777Ak9M1HYV22HiOFJKdxj6o3hH7FmHSMK/pP1e+rTa9tqCBHc4tHxp/BT8vdVtKdB0pR3c5TYBrYsPP0Az4uVlLzt70y1apxu1yWg6ZgnsfDrOgUus/ImKBZ27VgHxvr/glrUQT9LbTn/Cr5KRS2Bolvgw12ii1g+MUblryw== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1759463120; bh=PF19iPqJbUPKUgjrQb31v7qmfzcpdoYPeo4RgMrRpiO=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=j6ruZeGHf4q4x8SM170diC7bPACCjEw93Ypy69ETqipfOWN4ruy/XVmaJWQaR3Om2dPi6EH4I/to4E6oqKux8J+fAIA7TDWRvmJrmWV0r4FuHFaaijVnrJ/DIGPNQWfFrYmf/u8JqS3n5jH5J57dygau+77t7IUOOAZa4SgVwR3tXstro1ghThEwfooT2kVBGwEpnx9PdE3puDMxe0PYFNOFIsRxEThyhME7MQb7OlmMwtgcs3NiHJVRVj6R4U4bC5VlS/hrKbMB9EpspSpspaSS1Ydu/jT/xgKkGWN3uQn5GWcBKDVtFA4J/21Ci3FqeRjLMgWSssmBygTP8MoLUA== X-YMail-OSG: YGsa2bYVM1lK7TWVdr5EO_Ie59QAqOL53tqIndeoBOpYyKFzz4jO5xumBQt9r6H v1z.joOFLXM0c9cOkfEPzwmLgO9cSRSdLlamo1h.iSEqExCJD.IJcrWbXB4ZX5Ej6gbFerGkwjat vnjNVQADEdqQTdjX7bF4PCm8eAZiFKx_D4J1snKqDz2QPNHI3A2SyEPkMb8zg9H83slaLlJOWh4H skqNR9e4s5VcGT7xEQ443lxz.w7E8JjM3HTAisnBquIZWzbEDl0r6XtbLa7YYdm57YNu6Oh_1eiC t_tAb.CwiFddRyHM_vPJXIG5YHV0Ss_wVYgZCD7gT7bgVpXc0ybwqgxtllztbCoqRIXvRNCUqeDs AjiwjFcIqc7.YFjVqmaQIiLjWi1_93rvUTrBpBf2brImjeUPxpZE3WeAI.QxtI0t5JI9GbwYpOVz z8oVNpm0fJTwdneJsBOUptl.70B5KXOqGiAMiuRz.JMfplm3DXsdEWkCCjDI.8EYxlYOVnrti3dS uyqpAdL3gxNNvq0c5CZCXw2Gguv5.6L2HcGr5QBT0p4tV99U1AZjqcmWM9C7y4a0_gqLS5qrly7E 9DkDbrun1yl0Gpc1GqOltv65pBjM9kZ.ncVWYhCrFGzGFS1i7uc7_VtU5XBSM5EoL7u4zat9o0QF eW1.0CoS8vx6KDzREmeZvqMu0kM3ZSs_jRlit2Tqg3qqf1kH.RLpGVNMjoIajR2ZY0xYro86fTcG Jg2_8J537P.YYJeyq1uM565VoxaEFfIOltRevGYCZc4YVeJ4qRKz2s4REerXH4Vp1zj0ieSdBpwc R4Lgvh937H0IamYrYHCppWcw9OZ9jLdvkI8A3OybhheX5fCkb7vk8a9Q1YMkAzQaskHGF5GsqJab s4sdTVVmqXbF1._VeOG0a_qzlD5RmqMuzvfOpb3t2PaN6giYmHAIa7tp7cVtsGpLxnGWRrJ2pboL Itd1xIP07CxipKIkgKLFNnWArUK2j7GgvJb0tTCAr1z7V3ZHKpnkrDv_sU6XM875VJmCKu5elrEZ 1EOXtFY4Q.c_wAsRVs8Blw9P0uQTqirxZiwQIsayUWQJ6TcwdQ18ShAoTh.vNB3.3fXoOGIw3W7w KA0QhVJhj0mUXbsO.pGaftzbDmapGROtWxFb8uxQHS0MDP1YV3N57RMW9pjApo6RK4TSTmafFBQz ozuv8YLIDcujyAtesVPoL7bMlX8oHI7r18hH1B.grVm8oCnIRCl2fDSh_tlggJbqLuPc_Uh3VjEc 6LD45MAKBZdIKEsKM.dIIg.CmIIYLhfxvrmGtv9RFj2pK_O6c3o3fVQ4K4fHM5IGh_6KVZVkgIEu ZAx_OuU_ouJuNxkVEiQYfHJwI_DgqFzKVpYyLUrgROtF8d_92.tZfB7ZiRN3_4J9NiR0S4C2xxnU jGFm9YGROGNaefVEWVpRWupOE1r08y27LK2A_nGz9y5cagYxfYFZAtYtrVKeDsssrrnP62B.QmLt BMv5WTwH0UdVkUH00FywwZSKDMLGKO7a1yUnF6ceb0WDiElwhPBas2xQ59TKiKHEk2JYsmF_a0z5 kuNNUq.0pKyWeD4aoGm2MaKBAMNyb.yCLbauGHJGgeW_MSe19NL_VFCzt.AuqdDzfMFdgIMF3HL1 JkAJEw9i3kMn5lUkf2uvI50IyS3PQbUSW.Hp5WnbFRqXB70TyMBQpmpjpcojuBI87PQopf_ccPwK hgFQW.p59dR7CMHaJaU5V47WxAL_ktmudHZ4h0JQrr6dsFbtVVetJ.5HRcYrsSGRQJg4Y_3tUi7I 5YLEoI1nDJa1WxMGYMuHihAp6mvmKcG_HJW1zpyjtx1nOYP_WkSP3hvIw7FZEJS4TQCDAKLZFycc I.7chhu8Ew4tH208HL80LukxPuoHOSZT91xXIpDDoN5OUUp1gLjrk1XIx37jlgju5xw0fUsVsJW_ Om0SVxa0Xgh5wvJmZA.fnglAha42WqSZ0yYeZZ02Ln7fC_R7kqFR6Shz1dOlml7k_PeOZSHa7thp J5NpaxVs.Jw.TkN72Gp0g.WrxjPhTrBmZ2wyptNSM_JnE5XzH7brUHOo8vYOn6anBg3O1bF_LB7M uHPB.h7wZvzkCvVW6yhyAgCmaQtINfr0ouIYSE7KhyUqx18KMYviyb2pi_dbIfKLfkz91RkrsAbJ r1Fv4C8486CdlnY6TdWTAlIPI4Q9GJRl5Y9aLClUe_gClPd8AIR3N_4ZAVwMQeB5lvgGkpYdL0eE 2o04AYIkECpGH1OhURVgi0bMEzI2TeeE- X-Sonic-MF: X-Sonic-ID: 3c1add6a-6998-4e90-8b75-6cb27bf41c76 Received: from sonic.gate.mail.ne1.yahoo.com by sonic309.consmr.mail.gq1.yahoo.com with HTTP; Fri, 3 Oct 2025 03:45:20 +0000 Received: by hermes--production-gq1-66b66ffd5-hmf7t (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 11d7cd582ea6cd03d87914bac68fb0d0; Fri, 03 Oct 2025 03:45:18 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3826.700.81\)) Subject: Re: main 16 and 15.0-ALPHA4 [on amd64]: using a USB3 context gets extensive "flswai" [and "rename"] STATE time during poudriere builds (UFS context happens to be in use); more Date: Thu, 2 Oct 2025 20:45:07 -0700 References: <46E0F6E8-A365-4C01-BFF8-CE2423B6DA00@yahoo.com> <4D74D446-2078-4A5F-B245-913273E2DDD1@yahoo.com> <03B6ABBE-DF0B-441F-9ABD-5565ADBF29ED@yahoo.com> To: FreeBSD Current , FreeBSD-STABLE Mailing List In-Reply-To: <03B6ABBE-DF0B-441F-9ABD-5565ADBF29ED@yahoo.com> Message-Id: <93873756-54C8-4408-9395-5E67F0300D5E@yahoo.com> X-Mailer: Apple Mail (2.3826.700.81) X-Spamd-Bar: --- X-Spamd-Result: default: False [-4.00 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; TO_DN_ALL(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; MIME_TRACE(0.00)[0:+]; ARC_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; FREEMAIL_FROM(0.00)[yahoo.com]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; APPLE_MAILER_COMMON(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.148:from]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.148:from] X-Rspamd-Queue-Id: 4cdF1L54vZz3HXt On Sep 30, 2025, at 20:43, Mark Millard wrote: > [The new material here ends up being about nameicap_cleanup > and its exclusive use of mnt_renamelock being one potential > bottleneck involved here. I make no claim it has anything to > do with the flswai activity reported. The possible > bottleneck is an observation, not something that I claim > there is any alternative to. I do not know if this is of any > interest or not.] >=20 > On Sep 29, 2025, at 16:06, Mark Millard wrote: >=20 >> On Sep 29, 2025, at 13:01, Mark Millard wrote: >>=20 >>> An example is during the cpdup activities when multiple happen >>> in overlappingtime frames: >>=20 >> I'll note that I see this on the amd64 32-FreeBSD-cpu system >> but not on the aarch64 8-FreeBSD-cpu Windows Dev Kit 2023 >> system. May be at some point I'll try the older 16-FreeBSD-cpu >> aarch64 (Cortex-A72) system. >>=20 >> Also, on the 7950X3D amd74 system, I see the behavior with >> 14.3-Stable. Apparently, this is not new with 15+. It has >> been a long time since I'd tried using an amd64 system for >> such activity based on using USB3 media. But it has been >> common for me for aarch64 over that time frame. >>=20 >>> . . . >>> . . .=20 >=20 > . . . >=20 >=20 >>> . . . >>> . . . >>>=20 >>> But I'll also see such on c compiles, ld commands, etc. I've >>> not seen rename for pkg-static but I have seen flswai for it. >>>=20 >>> The system spends lots of time 95%+ idle from the wait >>> activities. >>>=20 >>> I see such directly booted from the USB3 media (a 15.0-ALPHA4 >>> context on UFS media) and when using that media via chroot >>> from both ZFS and UFS boots that are not USB based. The ZFS >>> and UFS boots do not show the behavior with the normal >>> non-USB3 media used instead. >>>=20 >>> The system in use is an AMD 7950X3D with 32 FreeBSD cpus, >>> 192 GiBytes of RAM. main 16 booting for non-USB boots >>> and 15.0-ALPHA4 boots for the USB3 boots. kernel and >>> world are via official pkgbase distribution installs: >>> it is not a personal build of the kernel or world. >>>=20 >>>=20 >>> . . . >>> . . . I got a test context were I could compare the same media used on the same USB4 port on a laptop (Dell Precision 5490, 22 FreeBSD cpus, 32 GiBytes RAM, 4 USB4 ports), where, on boot, the media ends up being handled as either: ) "nda0 at nvme0" (via involving a Thunderbolt 3 hub) ) "da0" (via a direct connection) (The UEFI/ACPI does enough to make basic operation work, presenting some view to FreeBSD for media on USB4 ports.) Both have the bottlenecks visible when monitored with top, both "flswai" and "rename" examples occur in both contexts. But "nda0 at nvme0" bottleneck periods do not last nearly as long as "da0" bottleneck periods do, making "nda0 at nvme0" use much more reasonable for the type of activity. Still, this eliminates the possibility that the issue was limited to USB. It also eliminates it being specific to the prior AMD (7950X3D) test context. For reference: # uname -apKU FreeBSD USB4sys 16.0-CURRENT FreeBSD 16.0-CURRENT = main-n280801-213170eb956f GENERIC-NODEBUG amd64 amd64 1600001 1600001 (It is from official pkgbase distribution use, a copy of another boot media with some parameters replaced afterwards.) QUOTE CPU: Intel(R) Core(TM) Ultra 7 165H (3072.00-MHz K8-class CPU) Origin=3D"GenuineIntel" Id=3D0xa06a4 Family=3D0x6 Model=3D0xaa = Stepping=3D4 . . . WARNING: L3 data cache covers more APIC IDs than a package (6 > 3) FreeBSD/SMP: Multiprocessor System Detected: 22 CPUs FreeBSD/SMP: Non-uniform topology END QUOTE (The internal NVMe media has Dell's ubuntu on it.) Note: Ignoring very old Intel MacBook Pro's and Mac Mini 2018's, none of which I've ever native-booted FreeBSD on, the Dell P. 5490 is the only Thunderbolt or USB4 based system that I've access to. =3D=3D=3D Mark Millard marklmi at yahoo.com