From nobody Tue Sep 2 20:49:35 2025 X-Original-To: freebsd-pkg@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4cGdCj2TJdz65QGt for ; Tue, 02 Sep 2025 20:49:53 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic311-24.consmr.mail.gq1.yahoo.com (sonic311-24.consmr.mail.gq1.yahoo.com [98.137.65.205]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4cGdCg61f9z40MG for ; Tue, 02 Sep 2025 20:49:51 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b="lXx/k2r3"; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.65.205 as permitted sender) smtp.mailfrom=marklmi@yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1756846189; bh=zzDxtOXnslBHVlnmee5Gmotph6rahTR+nTbINxt78jk=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=lXx/k2r3WgUihEVYB+42KN3l8KBUsaY0ysOEVMBLAEYvyrHuB2rW7p3JPrXAJ/7YqbQmK87B3EpCwOutL8TwTkn5MhgI9nmezoanXn3jPutRzBLHYKtMASx5L/xlQq3YJwCyIgOV1WcCnAfqP/9ua4vD8hfYZogJMpnuy3w95OznGKpaYYvCErUIuLcmYIF1rm+8/l6yCPH8VUqq4XQG2N/Qwl/du5LuKvbA593smfgal53QTiJtUWFeaQEOMaaxEiRrgnuE8+Ey9+/BveSX7F/p+BBD/DY37HG6l/yi2/cJa1aDQ++P01O8uxPp41Qz7VWhRAkFDqQTjxQ5FEbhDA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1756846189; bh=FyuFY0snL1xwG/EasFq+rK5onxzhZbha/sJW2XLx/oo=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=TVjQZQw7EaYdfwSzc3I25BAaIQU4lt/axNu8l6CcttQEX/o0p4bUVpKKjd4Mgx2X/+VAAAzR6oQiq25AiLJE+G7ueEY13EyKe2B0aB9LigVuUb/jsrR3+HKM1+H3nrh1AQA4yJIADemsEqGcrRaMr7oX7zv1XHEVN/CxC6pZL88vxpgXmXDI62NrSvUQY6Oxn4u5Quhpz90BsBoB5nrz9Opk4Pexv8znQCIB0xFtrkgOsKXbJk4D2rwqIN20x9ii6SyC+pv5UEPsBIbnvSnVS+6apozZmG9QUrbvjbc7/j6yZ/LT7OSuugJ15USf8Ezg98JRK98mcUOT5J1m9cFjKA== X-YMail-OSG: 77UnQCgVM1l3_rDC0eOrt7otvS9jyQD2jp4cbfPRURbXqwCFpEqV2.tIRRHbzBo _5c6YVfq3k_wY_sgzQ3L9PA7UCUWNEszxW85GZsHvvVTjmFu0SLteYTcNwYJi4cH86LSx_9sQpnn A758pr76xyB2G_rCEl_L8_jdlkj6lrHGPiWKZS_XGBLJUpQvj.ZUexTg7DZ5SYa..7OPEWCWk6sH Q5eiNku7ot7t2ORergyQbzUCL29e4oCcPK9TekFIkr273M7wvYW2Z5tu0LKitYQioddV9T3T2ada IBIggX1If1ZjnG_cZbbEYQrIVroc0FaxqmwrC04pDji3gBLpyh_pKLxlgS3F6sWCMaf5Y5zO5CMr hGPwlRYgruSARtcsBd53pdQy2YG8SoOykUIR25vNJQSBj2sWZCxKYrX3C1RSynq1EljYdJFNHjJU 5Ryl.Q.TZ5I9lUl9TEc5LiznGrOZ1W9H.NmHZuXz59VojnfIDPZvQKEO7.enxsgeJuWXueyrZfaI uHLAZlPjuEi6FQCbS9x3VFDVlReVuh3T7U7_nFEQpHaZYJF.6kc_RNCzC67CkalpgFHI2KUEpZ.X 8JusdQ_lVyEq3IrX4XgrCQ9L7VtITCy4MwfK0TYZ3xHX7A6ZfusBXSsx9aBYrrwHsag1gWBG5AhM omi_fiPm.e8CO0er9PYgL9GbuVeGZcu0uQddOmKBrvHYlK1jKM6I1uyOo3Bxv8aQRTDGuwxX36FQ lIBys29qZH8OF1rKhAnmrkQq8DASWuatynDGBDlbFM5vb3x2LueoD4NLekIJvPkN06yJ0lrW6d2i s8ZR6grINWVjs6D1yREjBKr5QmQDOxMYe_9upxJPe.KuFV_iP7mflBzJYEo4WQ0sza7dPng8KSJB A4H2aUiAhuzuXHr6HlH_xQpdyzZ5o4jEq0jRjJb0FXFwshh9iG_A6JmRtpFlR0gRn0S6nIUGx4ZB DYvBTOocZtWDZ68FXTEGo9pUdI8kTG5lo8NYkEb27AXD.j4TWjtqd7CSKduJHRgF2OGe4i_xkqB6 .jL9bApwjzIu3lisj2lnA4jODaCR2YrdrEj1nbcM2GDsfD2wo0fmatowAMNtyuBvxIECZcp6fHH6 JJveLTaqZwW3Zu7OKt8hZ5xOs_MFyKjf0H.ciW7gCcppc4oDTI8z0fc6N4uQgGXPzzOBHlGzV0DQ TycsNWKzocJ9EwFoqOV95Cu8Hlg1vlXEYbRyPSIOJHqrCpe0rDam5KyWBXRQfOv0Uw2YtJhMtBEm OO6g3iIa0QKYUNm4sXBbNoYBo7ubCtdGOxfT4HjSEgZJINIK4mMDgpTyly1Dvf7dja1Onq2vw82r eicxhCDPgCCd5WISymhnxfiUadpAyDsqudi17AvsW8won3llJCBO2IgYqqC4Z0zh7WKJcv6sotTk uZXPsEER8BOu.bDwXITqLYoUTXHBEqrFDq_F5wgZIfwyAGmmClq2QGzCLAJ8rFtLXnatauEWeXX3 _S_9r_6P9OS5H5xW.OAbi8VNheViQpC7No9jqjb0Dj7WxgEB7VPpS4yK04B_FZ_i6QnKta.wSkQc DN22VqdGZX49lIiewo3uWZYmbH98WAxHXb0favPJcbVq128a1dDMmValArwRY4gfyHFDfN7AI9UA 3KbIMjGTeExVHAzeLKtWLOUEQGGE7G8hb2qc7HGYSjvrZKMxSm7aGaLASTi1Dik8pl3g57gDhwiq KrkAWU7jfZJ2vjhX0wFqCqVQdy8dyN33Ib8jxaJBbjnUv9aLJuye0VHBGKLAraPfOv8NPfgntT5c c548I4UHDw1lm9fdCJpPxZ7U3wcYljveieqDL3IcVUDFrV_xyBumt5oQI1U9U4deyJZaoVdBK3Cx W34RrmQaLGAiFiV3QpMt6GeEUWvzLT51tVC9xhQqgh4WjSzoJ3YGR0cYlRwcAlp0.2w3xf1DfVDT 3KeZ8QLAQwjnmOd3ziQYz48gNXuWyKei0cp6OEW0KGV25qpvwz_Tlc6EIwH66jqLilw4NZM51ecK FieWQkiqvxriXmZNuD4OC7J5EkbBwRWjFVcO21kPLfDlUmJYxnaqvtOA8Z2AmRUWgsRZLP2LV3OM CMB1oPddTtGGQ6Xxyv_lftEI1t3m7dUcmlJ6lU39sNX5TzDIti4jWb8qJ9wCXdj7QbSb_o4M1mOZ grQjEUvyatrmznYiXg618BZ8dX9tk6cGuXTeofFqVQWJItg8zlAqZHyAfMCGSalUKu9sySPOMZHM TqP8tpiu.QbciM3Pr2xSMqUwykrZXJVxayP1.BZozzoczSBsEzenm4LI7Hi0JYysqhu8_YcGH2rb W2GbFvw-- X-Sonic-MF: X-Sonic-ID: 8e400ed3-81d3-4ba4-86a4-558a3638da00 Received: from sonic.gate.mail.ne1.yahoo.com by sonic311.consmr.mail.gq1.yahoo.com with HTTP; Tue, 2 Sep 2025 20:49:49 +0000 Received: by hermes--production-gq1-7bfc77444d-969lh (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID ea1260b28265b58f4cd1045903a01e29; Tue, 02 Sep 2025 20:49:46 +0000 (UTC) Content-Type: text/plain; charset=utf-8 List-Id: Binary package management and package tools discussion List-Archive: https://lists.freebsd.org/archives/freebsd-pkg List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-pkg@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3826.700.81\)) Subject: Re: pkg upgrade, vfs.zfs.arc.free_target, vfs.zfs.arc.sys_free, vm.pageout_oom_seq [Notes about error messages during and RAM+SWAP requirements, UFS context] From: Mark Millard In-Reply-To: <73877048-A3B4-4920-AC92-A8C7A4FF83B5@yahoo.com> Date: Tue, 2 Sep 2025 13:49:35 -0700 Cc: freebsd-pkg@freebsd.org, freebsd-pkgbase@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <4FAA1DFB-0AEB-42E3-A135-F9A8A94AFC44@yahoo.com> References: <0dbf8c95-7697-4887-a890-335c3ccd80f1@gmail.com> <29ff7f7e-12ef-4d10-8ca4-15ae35ce6bae@gmail.com> <19251E67-BC92-4D71-9E71-6C7546A46D8C@yahoo.com> <9300201D-9D53-449B-9F0A-DFF6194B2830@yahoo.com> <6d1606ac-8ad0-4f15-96c7-30c6f50ca9b9@gmail.com> <73877048-A3B4-4920-AC92-A8C7A4FF83B5@yahoo.com> To: Graham Perrin X-Mailer: Apple Mail (2.3826.700.81) X-Spamd-Bar: --- X-Spamd-Result: default: False [-4.00 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; FREEMAIL_TO(0.00)[gmail.com]; FREEMAIL_FROM(0.00)[yahoo.com]; TO_DN_SOME(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; MLMMJ_DEST(0.00)[freebsd-pkg@freebsd.org]; APPLE_MAILER_COMMON(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.205:from]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.205:from] X-Rspamd-Queue-Id: 4cGdCg61f9z40MG On Sep 2, 2025, at 11:19, Mark Millard wrote: > On Aug 31, 2025, at 12:01, Graham Perrin = wrote: >=20 >> On 31/08/2025 09:38, Mark Millard wrote: >>=20 >>> =E2=80=A6 >>>=20 >>> So 4 GiBytyes of RAM is insufficient, even with use of: = vm.pageout_oom_seq=3D120 >>>=20 >>> Note: In this context increases is not going to help: it is way too = little RAM >>> for pkg. (I was observing via top at the time.) >>>=20 >>> If pkg continues to require such RAM+SWAP usage, FreeBSD is going to = end up >>> requiring more than, say, 5 GiBytes of RAM+SWAP, even for UFS = contexts. >>>=20 >>>> =E2=80=A6 >>>=20 >>> For reference, see: >>>=20 >>> = https://lists.freebsd.org/archives/freebsd-pkgbase/2025-August/000804.html= >>>=20 >>> with details of my test context (where swap was in use). >>=20 >>=20 >> Interesting. >>=20 >> Here, with faster storage for a new guest, 1,024 MB base memory was = enough =E2=80=93 for both UFS and ZFS =E2=80=93 as outlined below. >>=20 >> ---- >>=20 >>=20 >> VirtualBox >> bidirectional shared clipboard >> 1 GB memory >> EFI >> four processors >> PAE/NX >> VBoxSVGA >> FreeBSD-14.3-RELEASE-amd64-dvd1.iso >> disable host I/O cache >> vm.pageout_oom_seq=3D120 >> UFS >> 3 G swap >> install all components >> pkbasify conversion before first boot (519 packages) >> first boot >> vm.pageout_oom_seq=3D120 >=20 > The notes here are about the following sequence of 4 commands: >=20 >> pkg install -Fy firefox gitup htop hw-probe kde lsblk lynx nano = pciutils plasma6-sddm-kcm roxterm sddm stressdisk uclcmd usbutils = virtualbox-ose-additions xfce xorg >> pkg install -Uy firefox gitup htop hw-probe kde lsblk lynx nano = pciutils plasma6-sddm-kcm roxterm sddm stressdisk uclcmd usbutils = virtualbox-ose-additions xfce xorg >> pkg upgrade -fFqy >> pkg upgrade -fUy >=20 > In a 14.3-Stable amd64 UFS context the above command sequence: >=20 > 1) Will probably OOM on a system with 1 GiByte of RAM but no swap = space, > even for the first install command. >=20 > 2) The sequence of 4 commands used (RAM+SWAP): > 1024 MiBytes + 2312 MiBytes (observed maximum) > (So between 3 and 4 GiBytes of RAM+SWAP overall.) >=20 > 3) So will OOM on a system with 2 GiByte of RAM but no swap space, > overall. >=20 > 4) generates the error messages shown by: >=20 > # grep -e ^pkg: -e ^ELF = ~/mmjnk-pkg-1GiByteRAM-3p5GiByteSWAPspace-test.txt | sort -u > ELF interpreter /libexec/ld-elf.so.1 not found, error 2 > pkg: Cannot runscript DEINSTALL:No such file or directory > pkg: Cannot runscript POST-DEINSTALL:No such file or directory > pkg: Cannot runscript POST-INSTALL:No such file or directory > pkg: Cannot runscript PRE-INSTALL:No such file or directory > pkg: POST-INSTALL script failed >=20 > # grep -e ^pkg: -e ^ELF = ~/mmjnk-pkg-1GiByteRAM-3p5GiByteSWAPspace-test.txt | wc -l > 501 >=20 > All these happen during the "pkg upgrade -fUy". >=20 > I give more details later below. >=20 >> 1353 packages >> 2601 steps >> success >> vm.pageout_oom_seq=3D12 >> pkg upgrade -fUy >> success >>=20 >> ---- >>=20 >>=20 >> The same with ZFS. Success with, then without, the increased = vm.pageout_oom_seq >=20 >=20 > Other information for the text context: >=20 > RAM: 1024 MiByte > RAM+SWAP: 3584 MiByte > vm.pageout_oom_seq: 120 >=20 > # uname -apKU > FreeBSD FBSDamd64S 14.3-STABLE FreeBSD 14.3-STABLE = stable/14-n272276-b06973a2f2a8 GENERIC amd64 amd64 1403506 1403506 >=20 > # pkg -v > 2.2.2 >=20 > pkg was the only port-package already installed at the start of > the command sequence. >=20 >=20 > The counts of instances of the 6 individual error message types > were: >=20 > # grep -e ^ELF ~/mmjnk-pkg-1GiByteRAM-3p5GiByteSWAPspace-test.txt | wc = -l > 44 >=20 > # grep -e "^pkg:.* DEINSTALL" = ~/mmjnk-pkg-1GiByteRAM-3p5GiByteSWAPspace-test.txt | wc -l > 21 >=20 > # grep -e "^pkg:.*POST-DEINSTALL" = ~/mmjnk-pkg-1GiByteRAM-3p5GiByteSWAPspace-test.txt | wc -l > 378 >=20 > # grep -e "^pkg: .* POST-INSTALL" = ~/mmjnk-pkg-1GiByteRAM-3p5GiByteSWAPspace-test.txt | wc -l > 50 >=20 > # grep -e "^pkg: .* PRE-INSTALL" = ~/mmjnk-pkg-1GiByteRAM-3p5GiByteSWAPspace-test.txt | wc -l > 2 >=20 > # grep -e "^pkg: POST-INSTALL script failed" = ~/mmjnk-pkg-1GiByteRAM-3p5GiByteSWAPspace-test.txt | wc -l > 6 >=20 >=20 > The RAM+SWAP usage for the sequence progressed as below, > where a top variant monitored system Maximum Observed > Used figures: >=20 >=20 > # pkg install -Fy firefox gitup htop hw-probe kde lsblk lynx nano = pciutils plasma6-sddm-kcm roxterm sddm stressdisk uclcmd usbutils = virtualbox-ose-additions xfce xorg > . . . > Number of packages to be installed: 834 > . . . >=20 > Swap: 121500Ki MaxObsUsed, > and 1085Mi MaxObs(Active+Wir+Lndry+SwapUsed) > with max 1085Mi (Active+Wir+Lndry+SwapUsed+InAct) at the time >=20 >=20 > # pkg install -Uy firefox gitup htop hw-probe kde lsblk lynx nano = pciutils plasma6-sddm-kcm roxterm sddm stressdisk uclcmd usbutils = virtualbox-ose-additions xfce xorg > . . . > Number of packages to be installed: 834 > . . . >=20 > Swap: 585012Ki MaxObsUsed, > and 1489Mi MaxObs(Active+Wir+Lndry+SwapUsed) > with max 1521Mi (Active+Wir+Lndry+SwapUsed+InAct) at the time >=20 >=20 > # pkg upgrade -fFqy >=20 > Swap: 1760Mi MaxObsUsed, > and 2726Mi MaxObs(Active+Wir+Lndry+SwapUsed) > with max 2726Mi (Active+Wir+Lndry+SwapUsed+InAct) at the time >=20 >=20 > NOTE: The upgrade command below also involved all the FreeBSD-* base > packages as well. In my context that was all of them: > # pkg info -g "FreeBSD-*" | wc -l > 534 >=20 > # pkg upgrade -fUy > Checking for upgrades (1369 candidates): 100% > Processing candidates (1369 candidates): 100% > Checking integrity... > . . . > Number of packages to be upgraded: 534 > Number of packages to be reinstalled: 835 > [1/2628] Deinstalling FreeBSD-acct-dbg-14.snap20250831004235... > . . . >=20 > Swap: 2312Mi MaxObsUsed, > and 3192Mi MaxObsMaxObs(Active+Wir+Lndry+SwapUsed) > with max 3225Mi (Active+Wir+Lndry+SwapUsed+InAct) at the time >=20 >=20 > So, absent SWAP being enabled, it takes a 4 GiByte system > to avoid OOM activity for the whole sequence in my context. > Otherwise RAM+SWAP needs to be about that big. >=20 >=20 > Other experiments with a different set of port-packages had > an example of needing a 6 GiByte system if SWAP was not > enabled. Otherwise RAM+SWAP needs to be about that big. >=20 > I've no clue what combination of port-packages would > need the most RAM+SWAP for "pkg upgrade -fUy". >=20 >=20 > As stands, various pkg commands may need to have documented > warnings about RAM+SWAP requirements. >=20 Some extra information for excluding FreeBSD-base via "pkg upgrade -r FreeBSD-ports -fUy" . . . Note: the below produced just the 4 error messages: pkg: unlinkat(usr/local/share/mime/x-scheme-handler/): No such file or = directory pkg: unlinkat(usr/local/share/mime/uri/): No such file or directory pkg: unlinkat(usr/local/share/mime/print/): No such file or directory pkg: unlinkat(usr/local/share/mime/all/): No such file or directory # pkg upgrade -r FreeBSD-ports -fUy Checking for upgrades (1369 candidates): 100% Processing candidates (1369 candidates): 100% Checking integrity... done (0 conflicting) The following 835 package(s) will be affected (of 0 checked): . . . Number of packages to be reinstalled: 835 [1/1607] Deinstalling firefox-142.0.1_1,2... . . . Swap: 1456Mi MaxObsUsed, and 2314Mi MaxObs(Active+Wir+Lndry+SwapUsed) with max 2416Mi (Active+Wir+Lndry+SwapUsed+InAct) at the time So: max RAM+SwapUsed =3D 1024 Mi + 1456 Mi =3D=3D 2480 MiBytes vs. max RAM+SwapUsed =3D 1024 Mi + 2312 Mi =3D=3D 3366 MiBytes with FreeBSD-base also involved. =3D=3D=3D Mark Millard marklmi at yahoo.com