From nobody Fri May 30 16:02:50 2025 X-Original-To: freebsd-pkgbase@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4b87Lh5Sv3z5xqXY for ; Fri, 30 May 2025 16:03:08 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic317-20.consmr.mail.gq1.yahoo.com (sonic317-20.consmr.mail.gq1.yahoo.com [98.137.66.146]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4b87Ld0CCQz3Wvl for ; Fri, 30 May 2025 16:03:04 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=kwAbxd2d; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.66.146 as permitted sender) smtp.mailfrom=marklmi@yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1748620983; bh=6t3xTjIWjyncmiRgjmfaziYEZ/TiBId8R6Eq0ZbnlVI=; h=From:Subject:Date:Cc:To:References:From:Subject:Reply-To; b=kwAbxd2d48iTv781bT6k6lw6pE4wpbSLso84dw5IsFsTNmzryEvm2jWIsBtSeRYUm6B7P0B07RlsoDJr0UnunP4d7HLX/JVbIS99lmQUuKrtc2QpD9c/xaPhwCJveckjVe7XJ07Xz7WynVFTqGoIbO1FJH0r7tEMTz7lo8gOdmJc+5pmpZPWehflS+LedbUkE8GML4BgochW4H+8MCRdKBcoeZE14ddQFyPrKBNVo/TgTJkxiinsAEn6w4Be3W2m9BaAwJASPq2jwbnfITmc4YbuXihUFCIc7+tLgAsGMlw3jmILHSwKKEq76mS6HZPOCmGxKj879L3sMhhz/7VDxA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1748620983; bh=BGMycqIPKQ0ZxUnjwjzlt2VFgjWGKTcht3RqCFfFBT+=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=jfAw3sWg0Z01cDd7UI8lx03qNFFJYABWu4BB6btmlj+e8pBohyZI165SXQWhOpj1EEuyzu4ztQhynkPSfwMDIg5bqbdNmKHZMCJZCftASi+HtntMMNx7jOHVYwYmaqKizzHDYUXSIhz9x6ExpVWDRpL6tty7zaXWnXFF/JpNBUJkrQlJ+PpcdCEbK7ZpuCsBSYyhPxkLVTOgPORNFq8zgr66DmX0Q+7Iw8BGCoOMV/q0hJj70x/ESzdxVgE2BUXOjvWtbn0/M8Qb6opRLWkUeZs+GNKp2YXFb6nMLyRpudmq4W8ipTW0a/NZQi5EjfYRtBSOMuJVTT/xZn5yH99xFQ== X-YMail-OSG: jNOpCycVM1nckG8QogBmmHVieDRL5ByUwnZx46YPFoHcQXEXVJ9wCuVWS_lpz_I IGtfQgC7fs9e9YW9ALZOnKzQ_iTpoihA6HCnXHDvig4VdGiWdM9UL6BiIcF_8aoytfWLN5PSJP4a hJYebCQS1Fo690duRkJ4Cj2c4YXc2Ff9F6.tcEJ0jHOWU4h7V72BIYO7lcC_6vOpBhPyK4ucLoCv IInZgbpocPGqYdzX7t9J_unZzi5F2MdlUsWqqcoYMqS07BD1HdKeFetj865wf4fs68W9EX99o3Es 5eucX1kAm0RgC4oEySQl8MImOMo8.xHqKQSJSfPSiP9q65kDXTAVjdVJE2NoKdxrVQoj9q47S7JU preWX5F_sN8_t41NsvgvnXlzrEjGnLF3FGm4T8v8tPYpSEYor4QWqgHhAE1jDBW_D8IdHo54zvu_ BUqKTMYB3DxQMuvSnBXwi7.wsLwRM07_gUw6u4YADQOhGAyRgCFnYxFb3Bvt506JkR5z.e0vdgzf ppstpMItyFpLKl16jkepqG8Y7Si8d5Gh52hpcHliBcmr8zGcd6ioergFPspCXTdBSONj7OdD50Fb h8mwF6vLTtGddDlrH8SQ.IZOImVbVPnFxCuFj5EkiFZDl9Wg9IwmFigyL3ldDdDqAnuaENFh7pxd VQ.57eyNLNz2coYB6Jl4xa1rOCochG.NWM5_LOLwKGFQ0fIyTyB6B4BPoyXtntmej3W8101ZUxus tD0E5Fm_F1oKWJ2PkXcqX_6qC_VFbt1zzmkxbAvI5CrQbQC97hMeilDrvMwRz4reowGcnc_UaG4J 6erlM8PtsFLo4jMYrEg7Ofh5YR_QSYIaI.J_Of5d_HXoqGSiqhEAFYRQSwGGZjf.9NIiH3w.pddo vifnTon8FMf5HcrDiW1oi.ZmqU304Xv99BCoXkJ231Onvk_Avaic9h7rfmmKuDvMDwkc4C15RwZ0 R76JX0H8swNcO81W9nyLT5DK0dXBP5J7AYIdwhmrNeEEp_95m37IT8BxVncxrvuofKQdFZ_8YJ4e JGzMBLUzbnVlPT.spZcRQF60od5vtwqGY7KYakCQlYBFhJfwU20qw0Y.L8ziEa5rJtq9TpjIbyIT 2EMmVMXijEeGKOQoieh4ydAtBDvTPX7f1NPPa9gykhP4lrqtBlp.pq6w9k_2SqU1f2BCQST8vMGh RSVmz4mv74kc2LViXsuY_nIX0BcTHUERAz6IJ4RT6mvDx5926av16U95TCQnji47sTRrBeCTfr5I IzwNM0j3DQY8vJPkTJ1r8mi6OIoviBOc5H.ZaZ9LcoVhAzIwNDKV3Kndd.YK_Bu4H0uUD1SJQN25 lWBAzs2jB7BwcalOWZlhIxREINy6hnPjRXpBcagpr3UHPTe2nSFPZMlW0A1UyTIuX6YOfb80t9RT hxLmFbgk1OUCe858GZHDvnxxCj._RVIKGggyKrNb1KzUzBQoUOwUomEpiNtHvvN7FUb9FD_dAEOH vGhgB9M94dlxFBfjBvGtPP6ZKSY_kgBxaNLIjIskqeSsj8RkTl_xksHXvE8b0l6.48FIDYxnxuBG o6fzgPz9_TVyXkljiqD0WaEeKwLIA3qEhHkK9WhBpWT44EK53U16Xy_pM5Mb28QjmrdEzBkLIevE BluoNQTIczIi2sx2n5ykLOEEjmYnY09ezqWDp5dSu5rxdjVe0qJL3BBioQLP9wuXyAiJQjqlY1Hu p.tdWImNrROcdWYLUuiK514KmfCltrO3LQWubjAUkbDHYmdadSjBMVUA8JF.6aA1Xj6VUtXR8_vc LfW3bHVnZEAxeHglfSQBfabZLjcXiB2uaV4YOuRw_f8_iICjNLaYSaLgNhxQ4qnrrvSyp.duqw7w 0LjqYriNLuEKTr0sjVf5MBAjSc8HObmMQnlsdopmOY0okF_zLkH40wehwgnCeFStiX_T0GGn1NK. lyiRZ0aEjT8KHu6vfPw.m2jX6ZlVPP3zmxr1DUajsCyQJ0N8nl31Gif_IeZlYuCZJucnkVGa2RyC SdY9DDglxfBn.4QyP3W1nPbQmge7JifhGcW9Vks6OweO7SsdmpwKo93u9jA8iYPP_146vZK2_T_N c8OyPaFNx9lc.P1.VR0TG_D9Hcf6g1k1LUMM.a1c02hHbZpGHwJg9.ixxaW0u3nP722Vk0dm_tcK KvHHC0sOVRtwDWhKNCdaxi6.ZNxHg4Re2irY9NpDwvC5clspmXkps08xX43irUVIbzD1KyYEFCAb lWXH9zPrmOkerPbEDUrQ9Dtf_Es0rWQwU7uJuFmwtdvk.IslYSlCZOuNtkdgGekdBVWmCJbw_2MD yYobAjz8t6XY- X-Sonic-MF: X-Sonic-ID: 034adf7e-7243-4c20-807d-fd47a7285ce8 Received: from sonic.gate.mail.ne1.yahoo.com by sonic317.consmr.mail.gq1.yahoo.com with HTTP; Fri, 30 May 2025 16:03:03 +0000 Received: by hermes--production-gq1-74d64bb7d7-5wzx5 (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 2c0612b3b22a721cac819465f0b50ee8; Fri, 30 May 2025 16:03:01 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable List-Id: Packaging the FreeBSD base system List-Archive: https://lists.freebsd.org/archives/freebsd-pkgbase List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-pkgbase@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3826.600.51.1.1\)) Subject: Re: CFT: pkgbase support in 15.0 Message-Id: Date: Fri, 30 May 2025 09:02:50 -0700 Cc: FreeBSD-pkgbase@freebsd.org To: Graham Perrin , FreeBSD-pkg@freebsd.org X-Mailer: Apple Mail (2.3826.600.51.1.1) References: X-Spamd-Result: default: False [0.66 / 15.00]; NEURAL_SPAM_LONG(1.00)[0.999]; NEURAL_SPAM_MEDIUM(0.97)[0.968]; NEURAL_HAM_SHORT(-0.81)[-0.811]; MV_CASE(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; FREEMAIL_TO(0.00)[gmail.com,freebsd.org]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ARC_NA(0.00)[]; TO_DN_SOME(0.00)[]; MIME_TRACE(0.00)[0:+]; RCPT_COUNT_THREE(0.00)[3]; RCVD_IN_DNSWL_NONE(0.00)[98.137.66.146:from]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; MLMMJ_DEST(0.00)[FreeBSD-pkgbase@freebsd.org]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.66.146:from]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RCVD_VIA_SMTP_AUTH(0.00)[]; FROM_HAS_DN(0.00)[] X-Rspamd-Queue-Id: 4b87Ld0CCQz3Wvl X-Spamd-Bar: / Graham Perrin wrote on Date: Fri, 30 May 2025 08:18:17 UTC : [This seems to be about pkg in use for updating ports, but was sent to just FreeBSD-pkgbase@ instead of to FreeBSD-pkg@ .] > Maybe worth noting: >=20 >=20 > A) pkg: killed: failed to reclaim memory > First, some notes about the various reports that were not here for reference, various examples, including notes about missing information: 4 GiBytes of RAM with 16 GByte of SWAP (ZFS? tmpfs use?) (sddm-gre* and Xorg are shown to be in use in the screen shot) real memory =3D 536870912 (512 MB) avail memory =3D 481169408 (458 MB) (SWAP? ZFS? tmpfs use? sddm? Xorg?) 2048 MB "Base Memory". ZFS is shown as in use for this example. (SWAP? tmpfs use?) (sddm? Xorg?) In general for leading up to the failures: All significant sources of keeping at least one CPU busy keeping memory use active and free RAM low? (This combination does NOT use SWAP for paging the Active category's RAM use. "failed to reclaim memory" means Active stayed large via busy CPUs and the FreeRAM threshold was not achieved within vm.pageout_oom_seq attempts.) Note about the above: If SWAP avoids memory constraints is workload dependent. It takes specifying workload properties to identify if SWAP space for paging use is helpful vs. not. Active? Inact? Wired? Free? Swap? for use leading up to the failure? Which processes were keeping the Active category large via the memory access patterns of some busy cpu(s)? (Note: Wired includes the ZFS ARC.) Context for the following quote: Based on the same amount of RAM, going from a 32-bit system to a 64-bit one does not generally mean needing less RAM (or less RAM+SWAP): they are separate issues. The Design and Implementation of the FreeBSD Operating System 2nd edition, bottom paragraph of page 49 and top paragraph of page 549, both being sections about ZFS: "However, it is neither designed for nor is it well suited to run on resource-constrained systems using 32-bit CPUs with less than 8 GBytes of memory and one small, nearly full disk typical of many embedded system. Thus, the fast filesystem continues to be the file system of choice for these smaller systems." (There is more material documenting the context for the repeated summary statements.) I expect that VM configurations made to look like such a system count in that. Did you do any tuning of the ZFS-in-use examples to try to mitigate some of that status? (Not that I've any expertise to interpret/judge such.) You wrote elsewhere: QUOTE I might expect a killing in a constrained environment, however in this case: =E2=80=A2 the virtual machine has 4 G memory (and 16 G swap) . . . END QUOTE When ZFS is involved, your definition for constrained vs. not does not match the Book's. > B) pkg upgrade finding nothing after an incomplete upgrade > , in particular > >=20 > > =E2=80=A6 I see what may be variations of this issue: > |> > > * pkg upgrade| following an interruption to an upgrade command > /> does/ proceed to install packages, but not everything > > that should be installed. >=20 >=20 > Scenario A is not rare. For whatever the type of contexts you have set up, anyway. > It may lead to scenario B. Your types of contexts that are having the problem may well be good as part of tests of some error-handling and/or of some recovery-procedures. > Whilst B (with or without A) might not affect a base package, affected=20= > users might perceive the overall upgrade experience (including base) = as=20 > unreliable. =3D=3D=3D Mark Millard marklmi at yahoo.com