From nobody Thu Feb 13 05:58:33 2025 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4YtkyL1ZTSz5n0tP for ; Thu, 13 Feb 2025 05:58:50 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic306-19.consmr.mail.gq1.yahoo.com (sonic306-19.consmr.mail.gq1.yahoo.com [98.137.68.82]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4YtkyK1qjcz3VTg for ; Thu, 13 Feb 2025 05:58:49 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=qKCIqsxZ; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.68.82 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1739426327; bh=/hkSZCeSS0kmVNMIwowPoIP3Jbr53UVzF0lIJzbAL/Y=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=qKCIqsxZjMIZkdwerDf4tkglqbCFzpA0PBSF90HjGC/ZC3liqbk/Q/UDYDg/Bl/C3nwYsUHWwT/BcxjthogNk0fQu9XwRg/azKewB4qC9v8SPB7TtGVXbus0Tmb2G3QmSJrb5IxX7cHIcaoBygesLGjg90avKR35wKSIogDpjDXk76mErK3QfobsosUUTha7blLsadLzFItjRF4qhafzn/34Dy6UNq9u5En0y8JCHHWho83qM4PnUtspRCpe7Lxxshx5GkSwf59QrzPzySf/UFbnwvLp6DqUwIG0ShKDFSJELTy54IkoqRSUN3x5VXD7jPtsp+XnpUrqZZUjnFgRwA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1739426327; bh=lCNPSyDQXXl9jek6k16hR9Dya4DbHu2qJip/AtQfq3J=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=kjnIsrBJxumcVBQ2HCiNktm0rIt93qX+YNEnC5gBv5bQnVOKiPwnn+Ha4A7Aw2eR68FEQpErrCTfMI28qbR9Jc69FLI16s0Dlu8RXVqPvEdlaXdaDNgLjdyCXUtw1uQb13lUtgBgCYOXg2sTUTPzUu2u3rlPpSCBiHOnmSMEAVRUx18WDBvfl7tnvuaVdpVo7nzsL4nvoBoEEXjM2bjjYxN091PiEHk8SrcvBybX2bK9RbyI2xOzmXiAtdrs4x6Yfwt1Y7h8keJJPOvPkp9l+CZbNPF6qQKC0abT8QP+Fmc8tdS8raVgul+7COo3ukMOsAVO2J2wYA4j4t5JezXY9g== X-YMail-OSG: AHZE23EVM1krKJzAeQ.c_ty8VLCJ2FzsZkgBXFSQSb_KIU.O4rbJX2N4fjpO404 VYO_J0QYihRnWdRi2CYNKlm4NTaB8Vn8iT90_2w9aWdcILVWSwpuNvhcEVnQ2aEzBYyvXluQcA67 nmcINnmfY_2MHCLLxMpgOlkdHWet1TfEH81WlnKhjW0gM2L_FJamniDuZjO2Ulm7wcdlyJvTDyt6 ngWd9DdFJb3prv9XiKSneXXA3wDpGb3RLkyDkblk3MW0wWgHsui5euknU6lZkNT8qwp8mlCm.GLG tVFHrAuzl8WW629JZeGFRczl0Qi.i29JCGwprO_o86Sw9fKBUGaBtheZ0CRJxQeQsxYUhgKG1gao fcjGFWhHqJMEskOALzc9zx0SmW1x7qxG_CcizhRezxE5q6GfMu9JVcjqInhWcc21n8T.9G1Ojvs6 iL4FOWlO2LJjfUuhfSsnb3SXrFXFp8frpWt1QvEOUTCRqk.mVVQGsQ4MoC7xJYwzSvGKaNffraiU 6OPzYaMIZWCXHKYry0ePDHgN1Y5taIiclnDP.31WyIAnWxHTpcyowwacvJ1ne.U4.sc1eifdG5f3 QI0JLZ6qBP5_O3jynVePH9vLS5iwEkGZ3glKS.of12Pm8fSsFJa3pAoihDENeBnHCebvhRbDZY9I E_XtQpaCxzQsT5uegrbZigQu226gxuHkDMWaBe0yPByM6RkcSKEqjXW3T8Evnu8vwcDghMLekVYS .1pu08k8u6hoj.P7etsADAp94hiBYdqFvQSPDZOr2WCW6s1lg5M5qmeM1fcOtjShQNZEV50nXADA aIpZzaY8M3KBEylz2ikZ5HQrYqcuoaybqGtILk7NTNnkv.oS63S7aUkR63cqpWLI1gkfqrfpleNL jwthkM6oJqzjqnn6yLYFzQhg4kGTJke6rTKcsD1l9erRqFRJ1pxEz2IxHsdrqWkEtzYyB4zWlBhR kS6W34fSbJM8vs4TqdzlEDOSufHXxltK1x9HZGkC72p_vDys4OX9yourJFmZRm66ocP5yqIShjH. V086BSPVo3ftH2Iqi1HEO9O4c94xGUhBbE2Jkurv.YmHf0t9r.pIPQbLCyJcx519PUxbtH2YN1uQ kf7f2aoN64E1_5Gl8x_rQ5HkCJAaQszI46YEtZN6m_.E8tPoRif6ffIRVi5xVA8Nkc7dkCystAXs Wn63wqNIwnvG_JiniXqg6H5VRkcUADIda_S_WzI1HBD1PcxzZ.RsZZN5QcQYoM69ZypyNilB7w8j xHs9CcPPNxzWnQOgqVFwF8RwVX6k4o4jnIZ0nyxM.gmNSgutQ3ZpceOM4.dKylGJXJjYA4rZkb4t _GX6eRvZQQj.NZFhugEbOuoxufVrrh0lt6G1eeoDHGpcOoIF6wX0vXB9_7XRbFPQG5mNvvC6DaTk cxbVkvnxG5_3lW81OTs18NaveUVMIdYU.WT5CNfztEsYC9mXkUAe_DSZbB3kxjvk2ntsRhsFK_6_ nJdCz2O_A62NAT4.6VhiYFpPmHSA53PKJ34nNyuipjfyqgUAm3Fl18juF8D6gYWzcf0QNmPbCHC9 NNx0s1vqvEytO6FvhCV0dGdwAaKF8yAxfXa9AsAP_sMvf4C3rh8ibdhbDN.tlU9FAHquucvqwM3z VJzI0R.1JK6jgC3PG_OMJlZ.q.4inbqrsKrIlqK1tf9VAtDw0hWHMajXeWN6bJe.8OLRXo4LqWff 2ter129Jnx6zFtaKGy95Bk7.5DgLuOhRdDrO6z_ruaGBPzeg6YbSbKB2FmXqrI_BAYoz59.8ifIa 7jnlcUaU9G6ILL7_bC9iJXlYs3LbXHaZ6oh9OcgX5CTFqck.4ZYT7tFaTwRxPmIfXqDX5HemCzx9 AUQwU_QQnLAHhKJpTeNzAoUJsJKJNy4_OLbPnkwGuZ6PAfFnP710G4L2M9gVBGKW57Af_ZJfMl.C 963R7tfIVbsoR9lEVvBgHgsbCVC2Twvl_mSL8qbucMbpkQwVcAeCsH4X7LUUt1PjYUWRY1U6_5_o vX1Xl7IA0_55oOHuZTKZxuvvHlbwlWI3QbltlWFQkJAxCt8JEzpS5ULGLMh8Gl9d4yIsXXuwqnWR DUUygMIpHFYzL5jJmtI8Aj7Dc0QzyeziMpwfnvz2iYMTnoDbovgLVweaUqxxWr2WEUVkoA0kBZm4 1C6T4edjBnKeMNG.gNrz3aehYsBT5wZx2m3s7esxcgYjM8QnomP0tnc7bVZV2SMykQZvH7KU1C9O gzvqCod1uanxJVBqSb_alwj4BhwIGtU8Zpe.Iz9TOiiExbfFgScQDMkaUbw4xZbnQv7Fv4oQCXJj n_Cl9KjqK X-Sonic-MF: X-Sonic-ID: 414bdec3-5b2a-4e31-85bf-ae7759bf195c Received: from sonic.gate.mail.ne1.yahoo.com by sonic306.consmr.mail.gq1.yahoo.com with HTTP; Thu, 13 Feb 2025 05:58:47 +0000 Received: by hermes--production-gq1-5dd4b47f46-sx6k2 (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 2692fa5f3b1d6e5bb78c2043fba7b91f; Thu, 13 Feb 2025 05:58:44 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3826.400.131.1.6\)) Subject: Re: Fairly Modern poudriere-devel on fairly modern main gets "mount_nullfs: /usr/local/poudriere/data/.m/NAME/ref/packages: Resource deadlock avoided" when operated in a chroot context. From: Mark Millard In-Reply-To: Date: Wed, 12 Feb 2025 21:58:33 -0800 Cc: Konstantin Belousov Content-Transfer-Encoding: quoted-printable Message-Id: References: To: Baptiste Daroussin , FreeBSD Current , FreeBSD Mailing List X-Mailer: Apple Mail (2.3826.400.131.1.6) X-Spamd-Result: default: False [-4.37 / 15.00]; RBL_SENDERSCORE_REPUT_9(-1.00)[98.137.68.82:from]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.87)[-0.867]; MV_CASE(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; DKIM_TRACE(0.00)[yahoo.com:+]; ARC_NA(0.00)[]; TO_DN_ALL(0.00)[]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RCPT_COUNT_THREE(0.00)[4]; FROM_HAS_DN(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.68.82:from]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.68.82:from] X-Spamd-Bar: ---- X-Rspamd-Queue-Id: 4YtkyK1qjcz3VTg [I've now tried my UFS context as well.] On Feb 12, 2025, at 18:24, Mark Millard wrote: > I use pkg and poudriere-devel in areas that I've chroot'ed into. = (This > may be unusual and so is noted just in case it turns out to be = involved. > I've been doing that for years. Also, when I tried the same without = being > chroot'd things behaved normally and worked fine.) >=20 > The context does use: >=20 > USE_TMPFS=3Dall > TMPFS_BLACKLIST=3D. . . > TMPFS_BLACKLIST_TMPDIR=3D${BASEFS}/data/cache/tmp >=20 >=20 > As of my attempt to update to modern pkg and poudrere after having = update > the FreeBSD main vintage, all my attempts fail with the likes of: >=20 > [00:00:02] [01] [00:00:00] Builder starting > [00:00:02] [01] [00:00:00] Builder started > [00:00:02] [01] [00:00:00] Building ports-mgmt/pkg | pkg-2.0.6 > [00:00:39] [01] [00:00:37] Finished ports-mgmt/pkg | pkg-2.0.6: = Success ending TMPFS: 3.70 GiB > [00:00:39] [02] [00:00:00] Builder starting > [00:00:39] [01] [00:00:00] Building misc/freebsd-release-manifests | = freebsd-release-manifests-20250207 > [00:00:40] [02] [00:00:01] Builder started > [00:00:40] [02] [00:00:00] Building devel/bsddialog | = bsddialog-1.0.1 > [00:00:40] [01] [00:00:01] Finished misc/freebsd-release-manifests | = freebsd-release-manifests-20250207: Success ending TMPFS: 2.88 GiB > [00:00:42] [02] [00:00:02] Finished devel/bsddialog | = bsddialog-1.0.1: Success ending TMPFS: 2.89 GiB > [00:00:42] [01] [00:00:00] Building ports-mgmt/portconfig | = portconfig-0.6.1_1 > [00:00:43] [01] [00:00:01] Finished ports-mgmt/portconfig | = portconfig-0.6.1_1: Success ending TMPFS: 2.88 GiB > [00:00:43] [01] [00:00:00] Building ports-mgmt/poudriere-devel | = poudriere-devel-3.4.99.20250209 > [00:00:46] [01] [00:00:03] Finished ports-mgmt/poudriere-devel | = poudriere-devel-3.4.99.20250209: Success ending TMPFS: 2.96 GiB > [00:00:47] Stopping 5 builders > [00:00:47] Creating pkg repository > mount_nullfs: = /usr/local/poudriere/data/.m/main-ZNV4-default/ref/packages: Resource = deadlock avoided I also see the just-above and just-below like messages in my UFS context. > [00:00:47] Error: = /usr/local/share/poudriere/bulk.sh:mount_packages:7:Failed to mount the = packages directory =20 >=20 > It later reports: >=20 > [00:00:47] Unmounting file systems > Error: (50608) rm:rm:1: = /usr/local/poudriere/data/.m/main-ZNV4-default: Device busy I also see the just-above like message in my UFS context. > After that the df -m output includes the likes of: >=20 > tmpfs 144265 0 144265 = 0% = /usr/obj/DESTDIRs/main-ZNV4-chroot-ports-local/usr/local/poudriere/data/.m= /main-ZNV4-default >=20 > which is the /usr/local/poudriere/data/.m/main-ZNV4-default involved. >=20 > I reduced the context down to having the chroot based on > just (showing df -m output from in the chroot session > after the failure, showing just what was put in the chroot > area, other than poudriere's run generates the tmpfs shown): >=20 > zoptb/DESTDIRs/main-ZNV4-chroot-ports-local 759185 9745 749439 = 1% /usr/obj/DESTDIRs/main-ZNV4-chroot-ports-local > devfs 0 0 0 = 0% /usr/obj/DESTDIRs/main-ZNV4-chroot-ports-local/dev > /usr/local/etc/poudriere.conf 752193 2753 749439 = 0% = /usr/obj/DESTDIRs/main-ZNV4-chroot-ports-local/usr/local/etc/poudriere.con= f > tmpfs 148322 0 148322 = 0% = /usr/obj/DESTDIRs/main-ZNV4-chroot-ports-local/usr/local/poudriere/data/.m= /main-mmjnk-default > /usr/obj/DESTDIRs/main-ZNV4-poud 751882 2442 749439 = 0% = /usr/obj/DESTDIRs/main-ZNV4-chroot-ports-local/usr/obj/DESTDIRs/main-ZNV4-= poud > /usr/ports 759648 10208 749439 = 1% /usr/obj/DESTDIRs/main-ZNV4-chroot-ports-local/usr/ports >=20 > Note the name main-mmjnk-default for this simpler context that is > otherwise similar. >=20 > So the rest is local to /usr/obj/DESTDIRs/main-ZNV4-chroot-ports-local > instead of being mount points referencing places outside that. >=20 > I then added some echos into poudriere's common.sh and include/fs.sh = and saw: >=20 > [00:00:02] Stopping 4 builders > About to: findmounts = /usr/local/poudriere/data/.m/main-mmjnk-default/04 1 > About to: findmounts = /usr/local/poudriere/data/.m/main-mmjnk-default/02 1 > About to: findmounts = /usr/local/poudriere/data/.m/main-mmjnk-default/03 1 > About to: findmounts = /usr/local/poudriere/data/.m/main-mmjnk-default/01 1 > findmounts result: > findmounts result: > findmounts result: > findmounts result: = /usr/obj/DESTDIRs/main-ZNV4-chroot-ports-local/usr/local/poudriere/data/.m= /main-mmjnk-default/01/var/db/ports = /usr/obj/DESTDIRs/main-ZNV4-chroot-ports-local/usr/local/poudriere/data/.m= /main-mmjnk-default/01/usr/tests = /usr/obj/DESTDIRs/main-ZNV4-chroot-ports-local/usr/local/poudriere/data/.m= /main-mmjnk-default/01/usr/src = /usr/obj/DESTDIRs/main-ZNV4-chroot-ports-local/usr/local/poudriere/data/.m= /main-mmjnk-default/01/usr/share = /usr/obj/DESTDIRs/main-ZNV4-chroot-ports-local/usr/local/poudriere/data/.m= /main-mmjnk-default/01/usr/ports = /usr/obj/DESTDIRs/main-ZNV4-chroot-ports-local/usr/local/poudriere/data/.m= /main-mmjnk-default/01/usr/lib32 = /usr/obj/DESTDIRs/main-ZNV4-chroot-ports-local/usr/local/poudriere/data/.m= /main-mmjnk-default/01/rescue = /usr/obj/DESTDIRs/main-ZNV4-chroot-ports-local/usr/local/poudriere/data/.m= /main-mmjnk-default/01/proc = /usr/obj/DESTDIRs/main-ZNV4-chroot-ports-local/usr/local/poudriere/data/.m= /main-mmjnk-default/01/packages = /usr/obj/DESTDIRs/main-ZNV4-chroot-ports-local/usr/local/poudriere/data/.m= /main-mmjnk-default/01/distfiles = /usr/obj/DESTDIRs/main-ZNV4-chroot-ports-local/usr/local/poudriere/data/.m= /main-mmjnk-default/01/dev/fd = /usr/obj/DESTDIRs/main-ZNV4-chroot-ports-local/usr/local/poudriere/data/.m= /main-mmjnk-default/01/dev = /usr/obj/DESTDIRs/main-ZNV4-chroot-ports-local/usr/local/poudriere/data/.m= /main-mmjnk-default/01/compat/linux/proc = /usr/obj/DESTDIRs/main-ZNV4-chroot-ports-local/usr/local/poudriere/data/.m= /main-mmjnk-default/01/.p > [00:00:02] Creating pkg repository > About to: umountfs = /usr/local/poudriere/data/.m/main-mmjnk-default/ref/packages > About to: findmounts = /usr/local/poudriere/data/.m/main-mmjnk-default/ref/packages 0 > findmounts result: > About to: /sbin/mount -t nullfs -o rw = /usr/local/poudriere/data/packages/main-mmjnk-default/.building = /usr/local/poudriere/data/.m/main-mmjnk-default/ref/packages > mount_nullfs: = /usr/local/poudriere/data/.m/main-mmjnk-default/ref/packages: Resource = deadlock avoided >=20 > I'll note that /usr/local/poudriere/data/.m/main-mmjnk-default in the > chroot area is reported to be tmpfs, like the mroe complicated > main-ZNV4-default example. >=20 > Nothing else in that area is listed as being tmpfs after the problem. >=20 >=20 > (That looks to me like it is possibly hitting a new system constraint, > appearently associated with at least chroot contexts.) >=20 > I'll note that the example happens to be based on a GPT partition with = a > ZFS file system, in ase that somehow matters. (ZFS classically used = just > for bectl usage, not other typical reasons.) >=20 >=20 > The jail creation had been via: >=20 > # poudriere jail -c -jmain-mmjnk -m null -M = /usr/obj/DESTDIRs/main-ZNV4-poud -S /usr/main-src -v 15.0-CURRENT > [00:00:00] Recording filesystem state for clean... done > [00:00:00] Jail main-mmjnk 15.0-CURRENT amd64 is ready to be used >=20 > I'll note: >=20 > # poudriere ports -l > PORTSTREE METHOD TIMESTAMP PATH > default null 2021-04-18 02:05:47 /usr/ports >=20 > Entering the chroot had been via: >=20 > # chroot /usr/obj/DESTDIRs/main-ZNV4-chroot-ports-local/ > # >=20 > The starting environment in the chroot had: >=20 > # pkg -v > 1.21.3 >=20 > # poudriere version > poudriere-git-3.4.99.20250115 >=20 > from prior activity. >=20 >=20 > The content of: >=20 > /usr/obj/DESTDIRs/main-ZNV4-chroot-ports-local/ >=20 > is a personal world build that was installed there. (The system boots > to an official PkgBase installed world.) So this is not just official > materials involved in the activity, unfortunately. =3D=3D=3D Mark Millard marklmi at yahoo.com