From nobody Tue Sep 2 18:19:41 2025 X-Original-To: freebsd-pkgbase@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4cGYtp66qvz677mB for ; Tue, 02 Sep 2025 18:20:02 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic309-21.consmr.mail.gq1.yahoo.com (sonic309-21.consmr.mail.gq1.yahoo.com [98.137.65.147]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4cGYtp2TSkz3T55 for ; Tue, 02 Sep 2025 18:20:02 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=KicI1WdD; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.65.147 as permitted sender) smtp.mailfrom=marklmi@yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1756837196; bh=ZhfWdR3hJD0W8NlgRDo5DJ84Qa2W3rBK4il+Gg8+gCU=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=KicI1WdD8uiaMCyzB93TvFYDV/KhwNOfvxcNY3MDthF/yEDwwCz7si85o4VbDlTP8NzxWFY3Bmy6TKyw8G+iZ9WZ342PPmqduC4fdM1mJj6O0BEfNF0GI80yc7WoCDaK1+NZIhLBQuh4hCBU02T9INPvvFOG/oHfCjGDbU2BIPcFqZYumVJ2Tnxgyj01BcVJ195AQdXD54LocIJXnAmLsCL9+h5fCRtCoeY0fAg4TNHn8oIDWoXvNzETCiLwDPCdpupF6JOCLJ8CkdQfMn2hF7quN+JxnJ62H+kZsHvfgAkszRghcR6ZWUWxEU3cmWEssidyFW/8dPNYx3dzkVMerA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1756837196; bh=XzRam8t5pKmeZEBzLAjMcoUIHXC/VNWP7xblRcUgyGu=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=TnFMr3gPfnEon0ev8fxC6LgpS2Mfix4Y+sITLBjG7Jkm6s2TQnJvOI+Tf9n1OUpYxv5jAnAixLPGqetm120d0flKeQldGAwfXQ52clJJpcd3l14TdqWzXSPKMKl2FzEG1UE6WbjONhTtFK6k7CFyKIpXmGf8AGZYos6qrcR8suiuyNNg6fMp4EeCxlee8+bZ2XJ+d2x3N2FDlHs8GRWBV8IPb70S/aVsUExaYakJKfgNwz3FOG/8qLYuO7f5IF1lwwbmZTee0DSolUu+SdaRITHH4nJEMwgVIro8UWi/r2TnPWlNsCufHcsI/ZuQ7xffwuuYvgsF1AwEg8+5DJeYog== X-YMail-OSG: Fb2Gv48VM1kuCDBJkXkt1gmsTfwQwQUcj0YmtsUGOpVwDM5wb18ae4GlKyIIW_s kx4RN2UJZ.4iGjbXpkZ08tEk6gJQnusNZ7_sXRwDngwhrbjMoPVTAmcWlaQ.w9ToStgs5H2DRhEk HRiV7QxsEIopWzayhZOmmirJ6N2Njj_s.iuv6O1pbHDh5qOJ8U2KVujpNu2F9lmqRCgUzz0F4pID 74wppewhBXVhZZokwIuPPO.tDHnlytxHz84xQsV2uHfUdqQnLoLNMAKjaxgqxZmYg_p.UQ8gS4ID JZNIdfHENoGmZKNW8QErEpBMOgTYXx_AqPhwydDRTdQDfOuWqENBUseTgY9owVGzei3lyNDbfsCC HS0cJMPfmz25ZhxscufyeqC.xtLYQOD8ARBP.AV1FWbJc8DrpSEe4ugsYfiXZqxiwnHh3c5fji1V kqhkfnNUlycVGd_4UwESIKdm1uKgs3fkVrwfni8.UMFIYWvahW0EXrdl11t0eUGvfgY26gwgtCMw oBlNNqBdg2L8WRWUA3bqesRd0dOTjLe.PA5XbCp3jwI9a6s0jL3hhI93U8iYGnITWI3m1rz5i4Lb KBp5_F7BS_vG85IscArg9mt6GWnP6nEqfxzlGd_fAM1dH2u0l7zmIVNJjZBFGJyRDGq03ZeC_P_d jmm9ApBydj.VSsD_7e4rzSkHXA8IX6DDR7PC0eV6TARvd4k1cL6WoxxZymO.a_fpKfvrBE7h1jpy cjVG_MIwZqEEDPcLeFx0E2.W9lRNURU8Z9b7foOtJMDVU3H8IWyisgORCpUDau6gwSzogOtkOqht 4vdtNXgYgILW9gN98vr44Le7nhdmDYsC5DCkbXCIW3Fa3omxMxgrlVLj3HymuoyHhaVyEakeWzGe GD6i9xqF5Icwvadc.b06dlLwMJkbZF2GtiGskIFOBtUAK4xNPqiaq8LFAjtLcMoiNiIHG05gp7QK 7d2DKwQckTbXeVIEbYZox8O03aoNA4kae2IMxZ1D1N6PLm3TGP1L5GlJxcUmeod7POmZv8te05AA E7mUh1d3cEGCl43PSbrFLznOJ1XRRUSFEmOKMmXwoFYexP6x5sYaBi3eEKcYHYAeaex47QfjH3Zd 6z8bRB0puJ0xcrViCccuPP4KwmgmGPvC1dyg41xj3YxmM0Yaz5LODT.t0Hqe6pu6GONXmEh8TyIy 2qQ2IhY4aZ0j7uitlCa3N4X53IxxyAt7XTAEuSiEDuLmifRfjaZVfPNz.Sef3WiSOqI5BrvveNHh TT8VB5oibLHq0I0PyeZvFzucGH20oW_W5V__R2utQSpjGZ57iJ8.dp9DJOvlNnwn3A4HoRB2H4N9 pECkDdj.16lyPitUcT8gxbq9TtDhMVboNh1IL_VZqGKX4Kw_UV9vNruioYIu16FwGGGEb7CEfyBK BRUxUl5ys7QSwIWWxTkluNp5c7PzhX4Ds3LC3512Zkp9k2sK_kB8F9eHvTD8hZE8KH.jq0UWOQ2d rp9KUO3IgI_HFHcKPVd7L20ukA_QSwX.Vix0_K46FHZie3QVVdyQ.t9G1guZ75KwAjgn5yepU8R. fSlUtb_1xEECPWIwYUHGqP7jCdEXRVNYklaHAO5PfJ.l8ofek2FDPNDe2ZzPlPkPhH2E_2ZLnqhi VI48bWXZDChvwK.lXDaV.th_BZgnUwbB8_OKisyciokpMU6SRZVR582Z25gLvzr5lCQAK3IqcPXH .QGu47PsfAUZlUrZ9zviW69zF96V._48jYmi9vT6cxxk2.yYBk5PIhxhk98USF58WJe4Grw2agw4 bszj9pydnxjkbIRP72Ns41ooi3VR0XLMuOX0xBp76lmELEG4AQw1e3RMmtt3GMRRbaVk.sz_VxwU 0C2AmxXFRjnaDxdcJO3YfaQT7K3TLemdDEEBEO2vvqkMzBvEEWJcQbVnK57F1sFEXP5DeDzMN5B6 dCoAjcu2NG88D1bKDTBRoEmg4WYAxpumpy.ROC.NvILlq8P9EVt2ExwYtLwDKTE.R6VgXxEGIY5j TKpRRssDPu91vCaUgb2tpIQHPKUXI2TrYZJbHP61kP2HL2hxPvHdF7lhrI31KpHml7c4YsPo2hdP yL30pAlYGUcgB7UmljoX6RE4sT1z6.ZriPJ2ZJVAoSDXHYlpJjL4nuequeBWppHep4qJzIwgJey1 IpB_8pxHQmrs49DKuKsFxmgUHa8A9drlYBIxkliViLzlscUmlTWmnEel2408YTVaTBW9sEmGlewg I9M3F81kDu9GTmT.fIUGkQ3BG_iTG7JbYpWr_3fIm8giqJFzoj0BrYABpp2piY8CcPzsZcY90up3 pv9E6ZQ-- X-Sonic-MF: X-Sonic-ID: 862c9617-b082-46df-b6df-a42113211f73 Received: from sonic.gate.mail.ne1.yahoo.com by sonic309.consmr.mail.gq1.yahoo.com with HTTP; Tue, 2 Sep 2025 18:19:56 +0000 Received: by hermes--production-gq1-7bfc77444d-lvf2q (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 7aaba6312d010ce98f8334c59f039369; Tue, 02 Sep 2025 18:19:52 +0000 (UTC) Content-Type: text/plain; charset=utf-8 List-Id: Packaging the FreeBSD base system List-Archive: https://lists.freebsd.org/archives/freebsd-pkgbase List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-pkgbase@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3826.700.81\)) Subject: Re: pkg upgrade, vfs.zfs.arc.free_target, vfs.zfs.arc.sys_free, vm.pageout_oom_seq [Notes about error messages during and RAM+SWAP requirements, UFS context] From: Mark Millard In-Reply-To: <6d1606ac-8ad0-4f15-96c7-30c6f50ca9b9@gmail.com> Date: Tue, 2 Sep 2025 11:19:41 -0700 Cc: freebsd-pkg@freebsd.org, freebsd-pkgbase@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <73877048-A3B4-4920-AC92-A8C7A4FF83B5@yahoo.com> References: <0dbf8c95-7697-4887-a890-335c3ccd80f1@gmail.com> <29ff7f7e-12ef-4d10-8ca4-15ae35ce6bae@gmail.com> <19251E67-BC92-4D71-9E71-6C7546A46D8C@yahoo.com> <9300201D-9D53-449B-9F0A-DFF6194B2830@yahoo.com> <6d1606ac-8ad0-4f15-96c7-30c6f50ca9b9@gmail.com> To: Graham Perrin X-Mailer: Apple Mail (2.3826.700.81) X-Spamd-Bar: --- X-Spamd-Result: default: False [-4.00 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; FREEMAIL_TO(0.00)[gmail.com]; FREEMAIL_FROM(0.00)[yahoo.com]; TO_DN_SOME(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; MLMMJ_DEST(0.00)[freebsd-pkgbase@freebsd.org]; APPLE_MAILER_COMMON(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.147:from]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.147:from] X-Rspamd-Queue-Id: 4cGYtp2TSkz3T55 On Aug 31, 2025, at 12:01, Graham Perrin wrote: > On 31/08/2025 09:38, Mark Millard wrote: >=20 >> =E2=80=A6 >>=20 >> So 4 GiBytyes of RAM is insufficient, even with use of: = vm.pageout_oom_seq=3D120 >>=20 >> Note: In this context increases is not going to help: it is way too = little RAM >> for pkg. (I was observing via top at the time.) >>=20 >> If pkg continues to require such RAM+SWAP usage, FreeBSD is going to = end up >> requiring more than, say, 5 GiBytes of RAM+SWAP, even for UFS = contexts. >>=20 >>> =E2=80=A6 >>=20 >> For reference, see: >>=20 >> = https://lists.freebsd.org/archives/freebsd-pkgbase/2025-August/000804.html= >>=20 >> with details of my test context (where swap was in use). >=20 >=20 > Interesting. >=20 > Here, with faster storage for a new guest, 1,024 MB base memory was = enough =E2=80=93 for both UFS and ZFS =E2=80=93 as outlined below. >=20 > ---- >=20 >=20 > VirtualBox > bidirectional shared clipboard > 1 GB memory > EFI > four processors > PAE/NX > VBoxSVGA > FreeBSD-14.3-RELEASE-amd64-dvd1.iso > disable host I/O cache > vm.pageout_oom_seq=3D120 > UFS > 3 G swap > install all components > pkbasify conversion before first boot (519 packages) > first boot > vm.pageout_oom_seq=3D120 The notes here are about the following sequence of 4 commands: > pkg install -Fy firefox gitup htop hw-probe kde lsblk lynx nano = pciutils plasma6-sddm-kcm roxterm sddm stressdisk uclcmd usbutils = virtualbox-ose-additions xfce xorg > pkg install -Uy firefox gitup htop hw-probe kde lsblk lynx nano = pciutils plasma6-sddm-kcm roxterm sddm stressdisk uclcmd usbutils = virtualbox-ose-additions xfce xorg > pkg upgrade -fFqy > pkg upgrade -fUy In a 14.3-Stable amd64 UFS context the above command sequence: 1) Will probably OOM on a system with 1 GiByte of RAM but no swap space, even for the first install command. 2) The sequence of 4 commands used (RAM+SWAP): 1024 MiBytes + 2312 MiBytes (observed maximum) (So between 3 and 4 GiBytes of RAM+SWAP overall.) 3) So will OOM on a system with 2 GiByte of RAM but no swap space, overall. 4) generates the error messages shown by: # grep -e ^pkg: -e ^ELF = ~/mmjnk-pkg-1GiByteRAM-3p5GiByteSWAPspace-test.txt | sort -u ELF interpreter /libexec/ld-elf.so.1 not found, error 2 pkg: Cannot runscript DEINSTALL:No such file or directory pkg: Cannot runscript POST-DEINSTALL:No such file or directory pkg: Cannot runscript POST-INSTALL:No such file or directory pkg: Cannot runscript PRE-INSTALL:No such file or directory pkg: POST-INSTALL script failed # grep -e ^pkg: -e ^ELF = ~/mmjnk-pkg-1GiByteRAM-3p5GiByteSWAPspace-test.txt | wc -l 501 All these happen during the "pkg upgrade -fUy". I give more details later below. > 1353 packages > 2601 steps > success > vm.pageout_oom_seq=3D12 > pkg upgrade -fUy > success >=20 > ---- >=20 >=20 > The same with ZFS. Success with, then without, the increased = vm.pageout_oom_seq Other information for the text context: RAM: 1024 MiByte RAM+SWAP: 3584 MiByte vm.pageout_oom_seq: 120 # uname -apKU FreeBSD FBSDamd64S 14.3-STABLE FreeBSD 14.3-STABLE = stable/14-n272276-b06973a2f2a8 GENERIC amd64 amd64 1403506 1403506 # pkg -v 2.2.2 pkg was the only port-package already installed at the start of the command sequence. The counts of instances of the 6 individual error message types were: # grep -e ^ELF ~/mmjnk-pkg-1GiByteRAM-3p5GiByteSWAPspace-test.txt | wc = -l 44 # grep -e "^pkg:.* DEINSTALL" = ~/mmjnk-pkg-1GiByteRAM-3p5GiByteSWAPspace-test.txt | wc -l 21 # grep -e "^pkg:.*POST-DEINSTALL" = ~/mmjnk-pkg-1GiByteRAM-3p5GiByteSWAPspace-test.txt | wc -l 378 # grep -e "^pkg: .* POST-INSTALL" = ~/mmjnk-pkg-1GiByteRAM-3p5GiByteSWAPspace-test.txt | wc -l 50 # grep -e "^pkg: .* PRE-INSTALL" = ~/mmjnk-pkg-1GiByteRAM-3p5GiByteSWAPspace-test.txt | wc -l 2 # grep -e "^pkg: POST-INSTALL script failed" = ~/mmjnk-pkg-1GiByteRAM-3p5GiByteSWAPspace-test.txt | wc -l 6 The RAM+SWAP usage for the sequence progressed as below, where a top variant monitored system Maximum Observed Used figures: # pkg install -Fy firefox gitup htop hw-probe kde lsblk lynx nano = pciutils plasma6-sddm-kcm roxterm sddm stressdisk uclcmd usbutils = virtualbox-ose-additions xfce xorg . . . Number of packages to be installed: 834 . . . Swap: 121500Ki MaxObsUsed, and 1085Mi MaxObs(Active+Wir+Lndry+SwapUsed) with max 1085Mi (Active+Wir+Lndry+SwapUsed+InAct) at the time # pkg install -Uy firefox gitup htop hw-probe kde lsblk lynx nano = pciutils plasma6-sddm-kcm roxterm sddm stressdisk uclcmd usbutils = virtualbox-ose-additions xfce xorg . . . Number of packages to be installed: 834 . . . Swap: 585012Ki MaxObsUsed, and 1489Mi MaxObs(Active+Wir+Lndry+SwapUsed) with max 1521Mi (Active+Wir+Lndry+SwapUsed+InAct) at the time # pkg upgrade -fFqy Swap: 1760Mi MaxObsUsed, and 2726Mi MaxObs(Active+Wir+Lndry+SwapUsed) with max 2726Mi (Active+Wir+Lndry+SwapUsed+InAct) at the time NOTE: The upgrade command below also involved all the FreeBSD-* base packages as well. In my context that was all of them: # pkg info -g "FreeBSD-*" | wc -l 534 # pkg upgrade -fUy Checking for upgrades (1369 candidates): 100% Processing candidates (1369 candidates): 100% Checking integrity... . . . Number of packages to be upgraded: 534 Number of packages to be reinstalled: 835 [1/2628] Deinstalling FreeBSD-acct-dbg-14.snap20250831004235... . . . Swap: 2312Mi MaxObsUsed, and 3192Mi MaxObsMaxObs(Active+Wir+Lndry+SwapUsed) with max 3225Mi (Active+Wir+Lndry+SwapUsed+InAct) at the time So, absent SWAP being enabled, it takes a 4 GiByte system to avoid OOM activity for the whole sequence in my context. Otherwise RAM+SWAP needs to be about that big. Other experiments with a different set of port-packages had an example of needing a 6 GiByte system if SWAP was not enabled. Otherwise RAM+SWAP needs to be about that big. I've no clue what combination of port-packages would need the most RAM+SWAP for "pkg upgrade -fUy". As stands, various pkg commands may need to have documented warnings about RAM+SWAP requirements. =3D=3D=3D Mark Millard marklmi at yahoo.com