From nobody Fri Feb 14 21:35:00 2025 X-Original-To: freebsd-pkg@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4YvlhR2W0Sz5nhQ9 for ; Fri, 14 Feb 2025 21:35:19 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic301-22.consmr.mail.gq1.yahoo.com (sonic301-22.consmr.mail.gq1.yahoo.com [98.137.64.148]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4YvlhQ34qTz3Yc3 for ; Fri, 14 Feb 2025 21:35:18 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1739568916; bh=+WNE0MQoxYTkspK2GgnPp6KospxAwEBw/WkHHLdGGcI=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=ZcW2zWBb1plMAVJg48Rp0deMer5XV1r/o3aTdjMLcCDm1ALgrPMMjX5rHxL+V7rwr1YiraCbbU4IfuIrQrghX76oXEwe2rjixWMrBWY2hCFg0M1K/afyGmpvfgmz8bWz3mqTngscHvK1R5UlC6mA+WXDBAxiA7UE+ohJ9yUNJG3XueqDjdZ4/nqOHnefoPWsAuMSWoJqlRbuiJpCSmXugWn3Gz1Tz8wliC/iL6MTdS016DSccZYjehN6P/K4ZfmxMdgWc/0sSx5tTbw1YTx0RKeKDZFLpA9Hj2+IJgqoNrh48UqOejA2UcTaux8BMUKz57uhgCcSCuh4h1ZOSoMcJg== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1739568916; bh=PLy7x6xh7/LGCTlt2fTRAlXJ7Io9C0bvJ4h8z4WSkli=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=jyEHSORH7oxsTunp+mR4cgWQFiXgcJNrfw7dKH1PFFxwa3v0gCTzHQug2miK8KBKefuJdYU2Zl+mIW5UZ8ZkBE9yRdt4INcW343VGwy9+QvTSt2MO8qnfNM03xc3zQlj13ED2IWg8DD7IujjVp3sLOlpFCHzAHOJf8v1UfTvjdr0IjooKd7YCOf1JEA/Q0tjVIwaDhog09IAZLZvnGgKoxlbWgDovR7x6GFbdlyi+wQ6dx1e2f4/xDrm0S5vFRK1v14ac0JJoKk9aJ84tTyaI5a2hS95DK5EvtBZVn+WsmUboIJWPE2Hcy3J0WR8CXvEA6Ug2rYiBAb3VNah1HzKdg== X-YMail-OSG: Soa4Vz8VM1mqylUp0s7A7XdPCgk53pcWv8_nMSoGDSw0W.l0IK25sW349vz0bP9 5Dh31ztIgAz_HNOkpqn3W1IkL0yC7TXcQ47ymAsCYIJmAWp96qKjg1o3vZY7eZuuILKQZYm9WgjY oYkj2FTkpLEmKyvmmSr58KQWd8HovqXBWTppe0XKQcoOSZQ0dKLrdPE0c70UWRDk7ooEwf0_zHkn BoJY0Zl77EhYCzz8Oe2tNly72O7qfSnp31s.qoNinvs_8WsT9YoP3t8OU5EWEHQ._J4m3buR.Vvo 74Yetm55CvpYw4CUgkcUbfEdI8OzX6wQZWuktwBzl09fnuX7CAWIKGB3hR2JHkViAKu9igUpfI_U __MzOOlO6ZbuGKfefZaLiGPazHf8WxXEYio4mcs4990W1N1HFg2C0NFiuMkK3RdGGALTplfVAfoc 8GrxBiRAMSsvtzn1SzyXpSyOlEGT2TUrlWVaZ8Vr9lVBaljne1zvVxklXaO3FQMMH2icFYlf2R6m D686qfBYZsdwADPMr4GrvN36fE6WFTUlRiJ7BycbxkPTA6On6k1vSf0kaQBparbif6sGA61QnlsH 2UJ.SJaW_VbtFP8ud19aHnZYzC_FmRQmfzU50hn1Scl4L4SNXQ6GzCEo1g2VvF9CPWVsVePxPTGH 9zTKA2xeANLhR9dxIoJ2C.vSzP.kSiDj1U5X0HMeezGR97Q2PUBeMYQsl3iVMMQuAHlzslvFzcL7 YMORdljKlPsr9To7_uUyy855pedQjl7D.KhAWwiLof885GSreCSbzRkUDoQ5PTnRLe2O5uOogKdn vjaMsDEbTp._C19q83xuQ7aFhxk3CT4Excoa2QKKPC3nh3sxoyaaW97gwRm2zcc3nWrZ6qzCGyd3 63N49yHyM4cP8ew84WlAyJu0ijUtXuiACFW_aEiFXunv_HoCyUqBws1XY.towK.eNi3pnuCOT7u9 v9w5Is.fWvJjECQgGv1LvfLB2d446FU0SzddYFrn2gLCCUMAu03i.cnUNNqbhqVFs54FdwxRATw2 sudUTzQh9Z.3rXaFk2bhrZQTt.8e8bBBqBbFld0icoGYG0QXYQQog5DJx1dYz2jeeXb1JAEJh8VV 1XmMHNMruTGAMMBdti4cVh_2ZsGX5D11yXPQbwwu6VxL9W387zxkWfkkWwG7sTlPFzghkQTKQBf8 74JO.LRHfgPrHRzT4l9MN_r9qYBKTOW6W6NlDA2Sz5S87i1IbOSDHEmayZ55RsKrl_h6ZtG8voGD M2yATtAvLEnEvBilF3tlL0DuNSKBoii6WMY1dIyevJTivJKvGqSJL8iqazOIioaFwofDklvJG2TU 4CirasFB7dDf1ETNkbqbzvSKLRV90tvVcpJKMXZPA9ZtphFkLuWRwIpuE3Sguen4ei9i1SzPbENy _NzTYj1t4WOTxSzZ0AirPi1X7s1DNOAt_TTrxpqEEKqFNfZPUugw9OJBmIrMF0s1Vt.sJipRufX2 k5KK2oXdiVXs4WY57UNA33V8PfVsqOXCH524EFur6Fb0nrLc0qcCIaYcPVloLuxJaOoVjEgQ4svT VzCpXkNUpCdBFH56fpyKg306vyv65FrLpCVKSvfYXEI3VTfqmebkg8H5E1Hy_021pXXQGTQNhCEu vjzX0dDJj1Ljv1nb8FLuSUyvEnYwPHV1U1vYDweRkXPnQL5gZUfEZSo1mGCQXqsKU8yUgrRh7IO2 DL_qL0tGkRbuZlDbBfLeA7it1mxO9MEZW4v60vdvEZaiDEIpKDglB2pI7hmRCexTgc213rnQGm3w W8aQCun3kq9UeOxyGRQfXQGhs.MqdXSorcirjgbZb.U5vHYN5fVB3s_WLAeYHO3AdNjf0pshKZFQ osPvmGgBfNXl2.5PBT9NqvVa8Y8BY6n1SrWOp5N8Isr25qXPMsujdMJ.Dar3SrU8aXpajhpxBeUh m0FrVVk09KyUsn2HlgpdJqcUn0qpv881slcYJ9AetdFuveTgNFFwVv6X28bSi55sh0YttjiGXX4i x7fML_iWBJEVvh6NjYGiiHs.xZM7nmSkRJ5SoL3NWGjD1I2PqTY8.jWVqsZu5Nu_k1lVZNeA0Xyb Amjee_AJQtHvkFAd0MuOhMgOo2i0r_JOo1Tlqg3OHsW96RCqyZh9ZqL7jMEO7H0KlebbacIu3qTN cCIbl24DfxqyjVaSCMD6X8aH4XBWu4pwkdm1sWw0.WA1oMIHjhcquk8JwOHVjVQOJf5Olnjov4fB fGB5_zOqSaLDMH9E2wC4xru.HpAaWBA1fUL98DRaqbHOmOPnPYvK0VlcGWCE5R7hlzt29FiZ9IQJ TVvM- X-Sonic-MF: X-Sonic-ID: ab1b45f6-2686-4564-8cc8-07f75391869f Received: from sonic.gate.mail.ne1.yahoo.com by sonic301.consmr.mail.gq1.yahoo.com with HTTP; Fri, 14 Feb 2025 21:35:16 +0000 Received: by hermes--production-gq1-5dd4b47f46-5qmz7 (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 249a5762f8875e1ffdd38e939cc16b9f; Fri, 14 Feb 2025 21:35:11 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Binary package management and package tools discussion List-Archive: https://lists.freebsd.org/archives/freebsd-pkg List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-pkg@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3826.400.131.1.6\)) Subject: Re: Poudriere insists on using tmpfs for packages listed in TMPFS_BLACKLIST From: Mark Millard In-Reply-To: <78cd193e-e60c-4e65-b75b-3848d582fc9d@protonmail.com> Date: Fri, 14 Feb 2025 13:35:00 -0800 Cc: freebsd-pkg@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <2e040ffc-f587-40a2-9ad1-9edf80b1862f@protonmail.com> <78cd193e-e60c-4e65-b75b-3848d582fc9d@protonmail.com> To: Yusuf Yaman X-Mailer: Apple Mail (2.3826.400.131.1.6) X-Rspamd-Queue-Id: 4YvlhQ34qTz3Yc3 X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] On Feb 14, 2025, at 12:37, Yusuf Yaman wrote: > root@hale:~ # pkg info -x poudriere > poudriere-3.4.2 > root@hale:~ # uname -a > FreeBSD hale.home.arpa 14.2-RELEASE-p1 FreeBSD 14.2-RELEASE-p1 GENERIC = amd64 >=20 > -------- Forwarded Message -------- Subject: Poudriere insists on = using tmpfs for packages listed in TMPFS_BLACKLIST Date: Fri, 14 Feb = 2025 20:07:33 +0300 From: Yusuf Yaman To: = FreeBSD Ports ML =20 >=20 > Hi, >=20 > I am having a problem where Poudriere (even -devel) does insist on = using tmpfs for big packages that i listed in TMPFS_BLACKLIST list in = configuration, also TMPFS_BLACKLIST_DIR is set. I am using ZFS. It = happens on at least lang/rust and devel/llvm15. The likes of lang/rust and devel/llvm* use large amounts of file system space (compared to, say, just 2 GiBytes) it is the larger areas that are redirected into where you have TMPFS_BLACKLIST_DIR point, avoiding that also being a tmpfs area. These can be like 17+ GiByte, 25+ GiByte, or more for just one builder in the TMPFS_BLACKLIST_DIR area. These can be larger than the RAM that some might have, making having a huge RAM+SWAP be important absent the TMPFS_BLACKLIST entry, especially if multiple such builders happen to run in parallel. (There is also a hook for avoiding any of a list of packages from building in parallel.) TMPFS_BLACKLIST is not intended to eliminate all tmpfs use by a a builder, just what most likely potentially grows to be huge/massive compared to normal: wrkdirs For reference: # grep -r TMPFS_BLACKLIST_TMPDIR /usr/local/share/poudriere/ /usr/local/share/poudriere/common.sh: case = "${TMPFS_BLACKLIST_TMPDIR:+set}" in /usr/local/share/poudriere/common.sh: if [ -d = "${TMPFS_BLACKLIST_TMPDIR:?}/wrkdirs" ] && /usr/local/share/poudriere/common.sh: ! rm -rf = "${TMPFS_BLACKLIST_TMPDIR:?}/wrkdirs/"*; then /usr/local/share/poudriere/common.sh: = "${TMPFS_BLACKLIST_TMPDIR:?}/wrkdirs"/* || : /usr/local/share/poudriere/common.sh: rm -rf = "${TMPFS_BLACKLIST_TMPDIR:?}/wrkdirs"/* || /usr/local/share/poudriere/common.sh: mkdir -p = "${TMPFS_BLACKLIST_TMPDIR:?}/wrkdirs" /usr/local/share/poudriere/common.sh: = TMPDIR=3D"${TMPFS_BLACKLIST_TMPDIR:?}/wrkdirs" \ An example of normal/small is ports-mgmt/portmaster ends up using under 2.5 GiBytes of tmpfs for USE_TMPFS=3Dall . >=20 > Thanks in advance. >=20 > yusuf@hale ~ % mount -v | grep llvm > yusuf@hale ~ % mount -v | grep tmpfs > tmpfs on /poudriere/data/.m/142x86-default/ref/.p (tmpfs, local, = vnodes: count 36 ) > tmpfs on /poudriere/data/.m/142x86-default/ref/wrkdirs (tmpfs, local, = vnodes: count 2 ) > tmpfs on /poudriere/data/.m/142x86-default/ref/var/db/ports (tmpfs, = local, vnodes: count 4 ) > tmpfs on /poudriere/data/.m/142x86-default/01/.p (tmpfs, local, = vnodes: count 7 ) > tmpfs on /poudriere/data/.m/142x86-default/01/wrkdirs (tmpfs, local, = vnodes: count 135024 ) > yusuf@hale ~ % I'll note that the (unused): /poudriere/data/.m/142x86-default/01/wrkdirs=20 is still present when: ${TMPFS_BLACKLIST_TMPDIR:?}/wrkdirs is used instead. The: /poudriere/data/.m/142x86-default/01/wrkdirs is not deleted and recreated for each builder to use slot 01 , just avoided for TMPFS_BLACKLIST usage and emptied before starting a new builder in the slot. > Queued: 1 Inspected: 0 Ignored: 0 Built: 0 Failed: 0 Skipped: 0 = Fetched: 0 Remaining: 1 > ID TOTAL ORIGIN PKGNAME PHASE TIME = TMPFS CPU% MEM% > [01] 00:04:01 devel/llvm15@default | llvm15-15.0.7_10 build 00:03:03 = 1.55 GiB 99.9% 5% 1.55 GiB indicates that the large amount of file system space was not placed in TMPFS. The 1.55 GiB appears to have been in/under: /poudriere/data/.m/142x86-default/01/.p instead. =3D=3D=3D Mark Millard marklmi at yahoo.com