From nobody Sun Jul 27 23:23:32 2025 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4bqyNP5kGJz63FMP for ; Sun, 27 Jul 2025 23:23:49 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic.asd.mail.yahoo.com (sonic308-8.consmr.mail.gq1.yahoo.com [98.137.68.32]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4bqyNN2rKMz3SdR for ; Sun, 27 Jul 2025 23:23:48 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=hoCvv8Sk; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.68.32 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1753658625; bh=n0jiK5alAL8p2Vf33tqdJhzT80DqLvv2RRNP3QhgLac=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=hoCvv8SkkeG8QNcZLM3mHwzaHinkGQYgm5dBA5QLDCb1MmyONQBF2y7iMFKw5aKkZ2LF83Zdru6/1Dq/eLN8HX1hdBfianfd1pZCxjrC77W1nFTPKzQnkVGsCO3cMaTagllKcLcpaMW9IAx+vCS0c3vifgPT5T6caYuO/jakP454uXKk1nq5X3AINw9QFi4Ey1TqhhDjU6YoXL7QNFUJ016Qh63H4QPWgLEonh1ZQN+RMjdTrf88oNudQds+91JTysIZLT/Drdf0gJBJrPyCAY7ys2bMf6L27Zra5WHdw7pkH0S/Yd5ya2zr3PgyvVM2Go0RjQqJZG0gVzBczLZcsA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1753658625; bh=MaI+F3EM9ULswISugezZ1xVv5Af1ipSdeVXc2G2Ix06=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=FNG7RiZIDCpIzpv/Y3FS2AwqYg+yO4ziMhsgeh/IePkPaQ7Zh1zEa31JCshLkve/UNlb72iHbeLnZrlKlxWnEtrq4v672WJhh2yxx8GVhiRMeVW7/VLJMzrQTYNCOq91Bk6dXy05GKkncuE4WGCBDG4fEW+TMKe+uU7+/JvsUNgpuX4VqmYU+3FKF5EZUaGPQ65r4+ayaBFKQl1ZSm4KwNG0TBbvw+Am3ICoPXB9QbQEtiU/AdRPtBhdgqB3xNzp7VrEniBA0GXbFdKRJ1YYF8/DiSy+SPBjUJaDA2ZxEuU5d93xd0X9fxfpggdB4NrOE10vCtVKXMNPcGk3BNLy8g== X-YMail-OSG: JcbaqfYVM1kq0tM2VRCiicxEuLHjclTb.yq5u_HALSZE8lfsOsUdlbjTjho8exP vcyYRhqhj4P5e9KsnAOdRkvKdOJQi.gVbegCirB1xtYC1b6Pk0737BKdTrVAfVaxJQKchvczu_Rw 04_H.b3AVBLwiCegsrZpGGzlbS53rmjL6BLIcU7bi_RhSCCSAJaQlr8PvyMQeOk.1bkplTLxUyzU d7GqmJg4I1BZ_UhuK1cVd2sSoTu56HhLIgXQEODeytTaEMX0hxUJGl8hkCnhWlFJDov.Urt6tfIh qardM5UWbu3iHx2v8j5V3xtO7LXnONc6LBujrQJ5EpiZmHL_ewQHnmyBUjra3xt1YUcFc5xGhy5W piZpmDzNMdrcU4GZ8Fm8.CFoxFKvxuzSRhKTAYeW_u.QkZFoYJ0xrHlrIklh_UmIrAqUzFaePpOn Lya4H7ox1xAaxSgq62AXGQpEuaO0.w9str.Qe.nEeT5YrNkwG.7cCtNR3lg3YRE_X2yiJffeVS.G DuAOIlv5.tp.ybS73V9qF7IKsBLL18F7N1KNThLsqAVfsU.PFxivYoyxtcvKxnIDgLazpRNsJ9aG .NZh0Gcs6Wg0PAMdfPbOHjAcVr_P_38EKf8Oa55LKEEylFKIUfeKPhUN3repsuZ5CtDvmPJSnuhT 6G19Z.JCoDMMH5VVLQa41kyVht.j6WwoeAH6d91Ua4vea1I7jar0U5.dsgSCvO7woDRrmlPKH85x H_ky96XMo47sTJpMIni2kVWibtLWtYZ7QSgLkovW0BU8Vu6y34MWKL1xuQnzXkxBe7cUQji2Bu_p oBRr_wcLvFoDVHaqvAw.p5_c1sfxztn5JcVig20C4dMzePES_uzeA7ROecgZ88o6ewEMj1WF7cSf mXcwzxn5ZCEOdVjw_klb6dNGysnCP1oAt719EyGzn4Ja_UDtroF4KJD_FCyn6fOHeLSV619RgjjQ hue_oDm66t8NWXAtZ5buZgBgnXDFYIad57wKrxLEGOCV8uXOqlpez36heWAoJuQiiaqs.iqfxhZL 0E20JvPMCdpNOgbfrYP6a0_zBYi_TJAOi76oUViIOivkRyiQKvyHOpUv6eL5LIC78q6.bgE1S5Do XL4RgLD4Tk6vxr0.ZlJGnx8MES2Qp9h1cTG874J4MfsfLHNLDhlUxrWFhjRYNJI.IBi37_ovFgdx KE39xRd03CPoK9OPp9UCnJj1YRdRFQpyZBqp7pdnyTtkfaq8BbspCorj2fJMqr4somgrBCtdGg9f RB3Yops7W3Z0WJqkLhz5g1Sk3EkEhda.VcnOG8QmQ7sqwZMCxq1XUsiA5PLz8itFulLb9p3KkSk7 SA8pO13O4hB09l6fxV1XhZCW3DfiyvzUE70k8Bx4Xdl4JOTMTKTdfCMyahEYAJtlR08cVgl98.kV I5B2clQhpgbA5ivxfEd8f2gxIxPNZnHIzw4iBVEqOKCdZoXUblEOKTRznETyLnJab_0gPDuAxtaS d2tVWNglUTNkWS1DXMpx8LkqlWVpQOkIuiwKtj.mv6jNr8.87m3B_z.vm1L1cnsd2iQcRzZWV38O Ar0uWXWqmt6UxE0D1y8UW1GwOR2XgGRHIylF2BfwPRL9S.Z.uJvcLe4FZ2wrQ_n.websSATSl.2c o9rk5LWUeudWiUPqziwwAnLid.1qn0av2OTiOB.ezDiMndQvh6hz2Abl6WWs_SD6Dr_pvBDTl7Ai bqWQNsz_ygqsfZkuUku3dnVK.fgI_StXsDzMeUBgcXOBysoX.eypq59zrSdzRqG4meisDN_nGRkZ YV5xvPJyY__RR6jj6fgJbQhiIpZc3a8f4k_e9XulrVYIKhV.iQpW9Vc2M9pjQTNw7txQ9abiKwvy bMok87GhkchVDuaOprW9yi_imDtvVqiZ9zbzg9_GjrphfgGh8fS_6aZMvzpjRczhToxLHJZVcftA SZTwqtDrgQMXoXJEeNZ5wx_yWk5lssh0Oht_sY5T6O0PluO.o1YzeiNd9toPAGWaLNufHUX_IEYf YIXUFp7hzl2Mww6cmBOV4ObsTUOv67RPNl_j7k807f3sQYk9pCKUjM1b5X2NRj_ugPmyqJsPZAUG 4lhEvc5OSuQds0nN6rDW7lOtiIY57Z2vC2WkM6yqVPHGIXjkzG2sEYefcZVQW0WG.6Y0V9wbuggE Ec5Kd6eBErFs43lr8XJNYso_XBXMbCbkq45NNAxXhh8K6rHDqL93kCs7ww1njIQz_hClMiNa.8xD wsLDmiovVyNpas.B9BtM8139FGAE.kNJ8vtgmsBFy5aAduYb.owx9JKNELLywBZ8rFt4W3PQX2Er CYw-- X-Sonic-MF: X-Sonic-ID: 1f3f297e-cfd8-4eb6-9215-262f8084525d Received: from sonic.gate.mail.ne1.yahoo.com by sonic308.consmr.mail.gq1.yahoo.com with HTTP; Sun, 27 Jul 2025 23:23:45 +0000 Received: by hermes--production-gq1-74d64bb7d7-lwch7 (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 6dd7211a376a957899d4fd6c401deaf5; Sun, 27 Jul 2025 23:23:43 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3826.600.51.1.1\)) Subject: Re: A panic by vm_pageout_scan_active activity, some details in case they might help From: Mark Millard In-Reply-To: Date: Sun, 27 Jul 2025 16:23:32 -0700 Cc: FreeBSD Current Content-Transfer-Encoding: quoted-printable Message-Id: References: To: Mark Johnston X-Mailer: Apple Mail (2.3826.600.51.1.1) X-Spamd-Result: default: False [-1.89 / 15.00]; NEURAL_HAM_SHORT(-0.84)[-0.840]; NEURAL_HAM_LONG(-0.81)[-0.813]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; NEURAL_SPAM_MEDIUM(0.26)[0.261]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; FREEMAIL_FROM(0.00)[yahoo.com]; RCPT_COUNT_TWO(0.00)[2]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ARC_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; TO_DN_ALL(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; MID_RHS_MATCH_FROM(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCVD_COUNT_TWO(0.00)[2]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.68.32:from]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.68.32:from]; FROM_HAS_DN(0.00)[] X-Rspamd-Queue-Id: 4bqyNN2rKMz3SdR X-Spamd-Bar: - On Jul 27, 2025, at 15:25, Mark Millard wrote: > On Jul 27, 2025, at 15:00, Mark Johnston wrote: >>=20 >> On Sun, Jul 27, 2025 at 02:26:29PM -0700, Mark Millard wrote: >>> I tried a poudriere(-devel) bulk -Ca on the amd64 system that >>> I have access to and a package build used up much of the >>> RAM+SWAP =3D=3D 704 GiBytes before a panic happened. Past examples >>> OOM'd without panics, although I did not know the context until >>> examining this crash dump. >>=20 >> What is the panic string? >=20 > The picture I took shows: >=20 > Fatal Trap 12: page fault while in kernel mode >=20 > # more /var/crash/info.4 > Dump header from device: /dev/gpt/OptBswp364 > Architecture: amd64 > Architecture Version: 2 > Dump Length: 20258381824 > Blocksize: 512 > Compression: none > Dumptime: 2025-07-26 18:56:16 -0700 > Hostname: 7950X3D-ZFS > Magic: FreeBSD Kernel Dump > Version String: FreeBSD 15.0-CURRENT main-n278320-3a33e39edd48 = GENERIC-NODEBUG > Panic String: page fault > Dump Parity: 668710208 > Bounds: 4 > Dump Status: good >=20 >> Could you please open a report on bugzilla >> and include the full core.txt.4? >=20 > Okay. Done: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D288507 >>> # uname -apKU >>> FreeBSD 7950X3D-ZFS 15.0-CURRENT FreeBSD 15.0-CURRENT = main-n278320-3a33e39edd48 GENERIC-NODEBUG amd64 amd64 1500048 1500048 >>>=20 >>> That is an official PkgBase installation of the boot-kernel and >>> boot-world, not a personal build. >>>=20 >>> The dump materials had references for doxygen and for dot to : >>>=20 >>> /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/06/dev >>>=20 >>> that let me track this to the [06] builder running at the time >>> of the crash: >>>=20 >>> [2D:01:22:29] [06] [00:00:00] Building graphics/sdl2_gpu | = sdl2_gpu-0.12.0 >>>=20 >>> It was running doxygen, which in turn was running mulitple dot's. >>>=20 >>> =46rom /var/crash/core.txt.4 : >>>=20 >>> UID PID PPID C PRI NI VSZ RSS MWCHAN STAT TT = TIME COMMAND >>> . . . >>> 0 79229 40923 4 59 0 23524 4148 wait D - = 0:00.00 [sh] >>> 0 79230 79229 5 59 0 14208 172 wait Ds - = 0:00.01 [make] >>> 0 79233 79230 4 59 0 14668 176 wait D - = 0:00.00 [sh] >>> 0 79234 79233 5 59 0 14668 176 wait D - = 0:00.00 [sh] >>> 0 79235 79234 12 0 0 16284 356 select D - = 0:00.01 [ninja] >>> 0 79236 79235 28 59 0 223048 1052 uwait D - = 0:00.44 [doxygen] >>> 0 79272 79236 25 59 0 157589964 41424308 pfault D - = 3:25.33 [dot] >>> 0 79279 79236 31 59 0 157601740 41513520 pfault D - = 3:23.41 [dot] >>> 0 79289 79236 14 59 0 157589964 41361600 pfault D - = 3:22.72 [dot] >>> 0 79301 79236 18 49 0 157667276 41208476 pfault D - = 3:24.32 [dot] >>> . . . >>>=20 >>> . . . >>> #14 >>> No locals. >>> #15 vm_pageout_scan_active (vmd=3D0xffffffff81c22380 , >>> page_shortage=3D102849) >>> at /home/pkgbuild/worktrees/main/sys/vm/vm_pageout.c:1264 >>> ss =3D {bq =3D {bq_pa =3D {0xfffffe0030a1e500, = 0xfffffe00a8798110, >>> 0xfffffe00e3083e30, 0xfffffe00a47a4228, = 0xfffffe002b6d8ef8, >>> 0xfffffe0065cf29a0, 0xfffffe007a1b83b8, = 0xfffffe008cf7b3c0, >>> 0xfffffe005cd565e0, 0xfffffe0048ced5d8, = 0xfffffe00c761d488, >>> 0xfffffe008a5efe90, 0xfffffe00cf341738, = 0xfffffe00413f97b8, >>> 0xfffffe005270cc68, 0xfffffe00a5d9d690, = 0xfffffe00294329e0, >>> 0xfffffe005ef52f00, 0xfffffe0020dff308, = 0xfffffe00ce1e9a40, >>> 0xfffffe007ec47618, 0xfffffe005d1ba7e8, = 0xfffffe0032d73470, >>> 0xfffffe0030835e88, 0xfffffe009969c438, = 0xfffffe00f151b0c8, >>> 0xfffffe0063916fe8, 0xfffffe00dac0b778, = 0xfffffe0016267348, >>> 0xfffffe00b74a5fe0, 0xfffffe003434ef80, = 0xfffffe009e31e840, >>> 0xfffffe00530f6408, 0xfffffe00e0649508, = 0xfffffe0102e87ad8, >>> 0xfffffe0092c52848, 0xfffffe00ba829618, = 0xfffffe008bf0fd10, >>> 0xfffffe00550708c0, 0xfffffe00eedc67b8, = 0xfffffe00d45f8210, >>> 0xfffffe00b89a8698, 0xfffffe0082ffb310, = 0xfffffe00accd53c0, >>> 0xfffffe0091c8f5d8, 0xfffffe004e20f180, = 0xfffffe004dfb4f90, >>> 0xfffffe00a437fbb0, 0xfffffe00218cb698, = 0xfffffe004ee5d278, >>> 0xfffffe00a9e845a0, 0xfffffe0025d4a7c8, = 0xfffffe0037612ac8, >>> 0xfffffe005c7d3da8, 0xfffffe00d307c1b8, = 0xfffffe00ee416538, >>> 0xfffffe0043747508, 0xfffffe00ef30b508, = 0xfffffe00c04de600, >>> 0xfffffe008c0e3040, 0xfffffe0071a97b40, = 0xfffffe005b644ad8, >>> 0xfffffe00dd5da3b0}, bq_cnt =3D 39}, >>> pq =3D 0xffffffff81c22400 , >>> marker =3D 0xffffffff81c22778 , maxscan =3D = 37165731, >>> scanned =3D 15440544} >>> marker =3D 0xffffffff81c22778 >>> pq =3D 0xffffffff81c22400 >>> old =3D >>> scan_tick =3D >>> min_scan =3D >>> m =3D 0xfffffe00eedc67b8 >>> object =3D 0x2b6c70f000 >>> refs =3D >>> new =3D >>> ps_delta =3D >>> act_delta =3D >>> max_scan =3D >>> nqueue =3D >>> _v =3D >>> _tid =3D >>> _v =3D >>> _tid =3D >>> _v =3D >>> _v =3D >>> _tid =3D >>> _v =3D >>> . . . >>>=20 >>> =46rom the /usr/src/sys/ for the PkgBase installation in use, there = is in >>> vm_pageout_scan_active : >>>=20 >>> /home/pkgbuild/worktrees/main/sys/vm/vm_pageout.c: unmodified, = readonly: line 1264 of 2416 [52%] >>>=20 >>> /* >>> * Check to see "how much" the page has been used. >>> * >>> * Test PGA_REFERENCED after calling = pmap_ts_referenced() so >>> * that a reference from a concurrently destroyed = mapping is >>> * observed here and now. >>> * >>> * Perform an unsynchronized object ref count check. = While >>> * the page lock ensures that the page is not = reallocated to >>> * another object, in particular, one with unmanaged = mappings >>> * that cannot support pmap_ts_referenced(), two races = are, >>> * nonetheless, possible: >>> * 1) The count was transitioning to zero, but we saw = a non- >>> * zero value. pmap_ts_referenced() will return = zero >>> * because the page is not mapped. >>> * 2) The count was transitioning to one, but we saw = zero. >>> * This race delays the detection of a new = reference. At >>> * worst, we will deactivate and reactivate the = page. >>> */ >>> refs =3D object->ref_count !=3D 0 ? = pmap_ts_referenced(m) : 0; >>>=20 >>> I am unlikely to be able to replicate the panic. >>>=20 >>> I hope that this is of some use. >>>=20 >>> Note: >>>=20 >>> I linked /home/pkgbuild/worktrees/main/sys to >>> /usr/sys/src so that such paths work in my >>> context. >>=20 =3D=3D=3D Mark Millard marklmi at yahoo.com