From nobody Mon Mar 7 01:01:30 2022 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 6D13B1A079C0 for ; Mon, 7 Mar 2022 01:01:47 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic308-8.consmr.mail.gq1.yahoo.com (sonic308-8.consmr.mail.gq1.yahoo.com [98.137.68.32]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4KBgCG04n4z4VKV for ; Mon, 7 Mar 2022 01:01:45 +0000 (UTC) (envelope-from marklmi@yahoo.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1646614898; bh=qJXed/5Q88ToOyEdiQZiR5ivJB6/QvkGlux+mxdrBXA=; h=From:Subject:Date:Cc:To:References:From:Subject:Reply-To; b=bziJam2bMUiiuJzuOJjVUoxb63IdUUFMqW5r4Jsc4IUeEW0pTOV0wYNstAu9FrReKbNyswT/NU842nHTJYdHkUfX4z2rDkZb92rFiCrheegCKiJJ4xiZUP7fi08ZV94C/FG7k3NAfZOgVq0mLQGZ2dKiU1MM1opVeMJitZUPmVJtw6NF2FIxscetQzifPy7cM3k8xx+d/uhBdvtcYcVaSe47Z3bWya/7ZbpA/pkqmdaGUuRA2w2Oc2DwIeG1XTUB/ddawxBDKCqMTDOduYXxscv3LFQRDW6T7rRoM4wzZ2qYczu4DlBnTSQqj/ZPD93fryS/thlMBI4KP87YgCcDqA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1646614898; bh=MZL3X/f9pfSnBKp9SEVMo9+WKXeScXT9W4nAr3OGxmI=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=bmL81e5mKR5d2CxJu5EhaEGf50hGApd379WTIsTogeYiAymy1/A817xri+MlWRxQgqm20lfF/zv7YoEvkNIqoDduy9yu1gnXfdkHb5uSgjlhWtcU2PBcE7vQQ8NhVwZGPdXFZGyZvlkKQNoBT1uY+XAVhWECSWa5h11pRk8VhAyz8zPHoCH94NgTyAWQL3jNCAiPi6/1XNubewcCN1gZqPyPhv05Hd4bFm94SfKLlGAtc++wEKD+8cqzP/rGNp2xZ9vTxV8e13z5LQrojcfnJqK29P29555+0LBqn5ztD+t/gklDnoAoSqB2x4PyV3wVZzBaRsVwBGqaKRFE/vq9eQ== X-YMail-OSG: bVTJIrAVM1mfAlMmVvS2GgciBhLvrFvnoyT70TO_VIHFofWVroaPX_M6_Tr1xap nX2XokGJevFTImCbu9n4URvKNF20d4gWuf1QT.4pd4xFD.6c5xKpArFJEMyT0m7nQ0XS0ShcrIBm 7navi8RZ7LVkV8Cm2lJhxYhcCfteratbSe9g8C4lFQ5lk8IDHAqOZKNSSfxUJSKHdLwbt0xyPdqG 9avq94nDWcam1nnaps4yDijswVXkXnn1tJuxtMqbsz4k3Nqdt5pAkL5kcHIuFcey6iRGhROCPdQ3 x_KN3_K7PHpj_VnGCzttjfkMy3Dl8OI8MrUpr1LLrD0TdDM9M255DhG1RIJMtiFn0yGGxXmFRTJ5 sP8bRO2LnJjLsdevTu9NXP66Wjehf6M8W1AN5S1cqipHSA54vUgwSPXPgG3qtkpeJ2fIrCA1FhM6 34vRFoXph5qKxmX4IN4.MM0LbT0MyipthQN8YPDe9jUGj6eYPRadQ12jqRAF_hIKRU4nJsBh7n9V GkJKOkdLd2.X_E5cJTFsn1i1ym5vuYDY9EZ36CaGHxdN5E93Dk2E22K5GiqALqPfQ5HiBga13qwk SyTrQNgsyPtBEtcnTLr2IYVGJmx_NZoYXEUaEYG.g3aweqSNiHXs8QfSMBG_K1RO9Ir_O2e.J9Mp xhfaUg0yEWUsRseUPLCNQIOLHJN9rkDTeIBMthK6QQ01.wCCSSpR0iYkvEh3xB9QQHqOm8V8zvV. AR6D9bHCVHj0Xd14ShxKMgp0RPYu2yY0vPudLPEUdvWZG03p._lXEwXWKnVTo048nCzaMY3Zy_a6 SORSbiTju3TW1x9mbE1JtQo0W8lFqy6IFlsWyKCAM452ng8chbQwgyUlICPs.V8Vg_O000lK5Nw8 wjX8HYUlz4dacskhb6LhohdMuD2F.C8gNVN0WImxTXPQpBzLE4Zb0j0nVJiTXHmUdtbKPvHZrSRo QI4PWIs5voZQ3KuCBcqdC0HAAUlwJLQmppUwx7oULO.KL5lySt4WN6M_5p6zQf4Q71MOz76vkMFS Co6AxI4Pr4EDCt1lqYhsBoQuGSlE5ndUCVsMsWkgLBNupj5l11VHa.7mz6m_OaVZnDcZzWeMNO4X C2HTYB6r4W19tst0k7SbpauylI6NJn6d9jABH2SKS5nDoKh92uEpL9_hz8lrPpAroreTk8TeGxF9 Ku25TEWxVj6LabZ8Vp8WNpXd.TsvsS9SPQ8Rt8lcRzEblZY412OHubQcsG0ZNjd4FPhoLlhWyYqR vCHmOobfnfWQTFbc3CxpGqsvMUs0y7xTTERCEizHD0FHh2W0FKZ7rfeHqMGjJKbYQ5IpBx2bW891 lGei4DNT3quayuBS01IAQrVVOLmy9fJ4YFtqOl3XsfrzHZRRetaAjO2LR9rkECD0RhAirwYrTuHR HL73F6zfYt3ShgNWjgXZu3gWnN3.TSK55044IqMDzc85w0UbDmpjpaBgyRem4Ed_v9x1a2ZDsKeD NSKRYF9.HfXB.0qa.sQS7RReVExaX4O0o1wS_KSsdXXHXD77vGNAF6FzsQxbeAs4.PDdVsOis99E V2BP1yDbL1yt2W0MTb0CE64XvydVL9r71JYNvrecobs0vXzYRShO6xyDCPBWICX8H8h4.lIZRDHT p7DcnjFm0eZgNcP9tT.3cH2GeY0BkzGStmYKauzhTD.x3Vb5geawKEJtr7DFwLl8DctGgBLP5vhR 165c.v4JhC05psQoBeYZORU6l0TiKXTu8AMH..nXhf.cs8E65zoBK8Oup5ic8LOW5N5Ppu1w4HK4 upyQ0Yny0q2Lv77QIDBadrJa5MEsiQ0WSes1DNVrCvIDm7pY6kTRDaKhSqmc43v4eC78KoJJ8IsB 2thlCj8ACfAPqzlyGbYcfaYRWY6PPkT3Qr0JeZ6IlsDA74RUCDbTjtmzjY0SKtgOHFAXgp9E96ZV WuIPvh.XSLrqiE5tWDMYAhYRR2bL5rDk5t2ypeCJNSKyFIM1oYqZ3T.9bLX26akqTJLdKsiZ295K 9gOzf0hT9Rd2XXCXHnqn0GIWKRoutTLLTBhpJ.sLMKxp7MDxHBTZvPykOp8kJWLl3F.ChUHOsdn3 Qa4TWMf3nX4E1HFppv90Fsm3klyyxvcCeEGAWf7U7GVUIAvcgpkZiZNuCjSgIbS_TUIBk9VM79yn BDtk0QHU1uI1CO5N0T8TK9_k2bwK2AV3nK8mrwjhdv9XQTf5NQ__rMjC3hFZIa.nOn8lv5QCShoJ IohJCN28kG2kPUt2IeqlNURtmJ2B.iQDavGM0E7IqZf41hacMvNwHY5.FP07OyHYBwcxHzWpKMYv 77NDgWdO7vruJ15fW7mcE9ColemwaZWRxvimORb7B7be65jtIVTBdsaykIpzLyeetiwQ7cdVV5ZI ZR_Qb X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic308.consmr.mail.gq1.yahoo.com with HTTP; Mon, 7 Mar 2022 01:01:38 +0000 Received: by kubenode520.mail-prod1.omega.bf1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID cbba54f0c60057021da8cc5638ef069e; Mon, 07 Mar 2022 01:01:33 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.120.0.1.13\)) Subject: Re: panic: data abort in critical section or under mutex (was: Re: panic: Unknown kernel exception 0 esr_el1 2000000 (on 14-CURRENT/aarch64 Feb 28)) Message-Id: Date: Sun, 6 Mar 2022 17:01:30 -0800 Cc: freebsd-current , bob prohaska To: Ronald Klop X-Mailer: Apple Mail (2.3654.120.0.1.13) References: X-Rspamd-Queue-Id: 4KBgCG04n4z4VKV X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=bziJam2b; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.68.32 as permitted sender) smtp.mailfrom=marklmi@yahoo.com X-Spamd-Result: default: False [-3.09 / 15.00]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-0.60)[-0.597]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.996]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-0.999]; MIME_GOOD(-0.10)[text/plain]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.68.32:from]; MLMMJ_DEST(0.00)[freebsd-current]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.68.32:from]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N From: Ronald Klop wrote on Date: Sun, 6 Mar 2022 23:22:42 +0100 (CET) : > Did some binary search with kernels from artifact.ci.freebsd.org. >=20 > I suspect "rmlock: Micro-optimize read locking" as cause. >=20 > = https://cgit.freebsd.org/src/commit/?id=3Dc84bb8cd771ce4bed58152e47a32dda4= 70bef23a >=20 >=20 > And "rmlock: Add required compiler barriers to _rm_runlock()" as = solution. >=20 > = https://cgit.freebsd.org/src/commit/?id=3D89ae8eb74e87ac19aa2d7abe4ba16bcc= cd32bb9f >=20 >=20 > So I probably just had a bad day. Well, there is a report of a buildkernel crash after that pair: https://lists.freebsd.org/archives/freebsd-arm/2022-March/001078.html that references additional information at: http://www.zefox.net/~fbsd/rpi3/crashes/20220304/readme and reported: QUOTE The console connection dropped before the crash (unrelated) I didn't get the preamble, all I have is the backtrace and buildkernel log.=20 Here's the backtrace: db> bt Tracing pid 14795 tid 100098 td 0xffffa00017815600 db_trace_self() at db_trace_self db_stack_trace() at db_stack_trace+0x11c db_command() at db_command+0x368 db_command_loop() at db_command_loop+0x54 db_trap() at db_trap+0xf8 kdb_trap() at kdb_trap+0x1cc handle_el1h_sync() at handle_el1h_sync+0x10 --- exception, esr 0xf2000000 kdb_enter() at kdb_enter+0x44 vpanic() at vpanic+0x1b0 panic() at panic+0x44 data_abort() at data_abort+0x2e8 handle_el1h_sync() at handle_el1h_sync+0x10 --- exception, esr 0x96000004 _rm_rlock_debug() at _rm_rlock_debug+0x8c sysctl_root_handler_locked() at sysctl_root_handler_locked+0x140 sysctl_root() at sysctl_root+0x1ac userland_sysctl() at userland_sysctl+0x140 sys___sysctl() at sys___sysctl+0x68 do_el0_sync() at do_el0_sync+0x520 handle_el0_sync() at handle_el0_sync+0x40 --- exception, esr 0x56000000 END QUOTE The above material does reference _rm_rlock_debug . Might be related? The readme reports: main-n253603-0b25cbc79d3: Thu Mar 3 22:48:31 PST 2022 for the system doing the buildkernel. This is after 89ae8eb74e8 . (It also mentions another panic earlier in the week, apparently not reported to the lists at the time.) =3D=3D=3D Mark Millard marklmi at yahoo.com