From owner-freebsd-current@freebsd.org Fri May 1 09:36:20 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 35F962CFECD for ; Fri, 1 May 2020 09:36:20 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic309-20.consmr.mail.gq1.yahoo.com (sonic309-20.consmr.mail.gq1.yahoo.com [98.137.65.146]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49D6ZV3lWRz4HVv for ; Fri, 1 May 2020 09:36:18 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: mFbs9jcVM1lEtlj9E6lWHtV7NCqoBOwb_BGR8Tp.RuYTiuKbIZdgXQbuSGAtcfL iBLJkuJk.THvflagmlUrPFZa7vWWAPWQLYjjlDdPbdCJGllyt6AQ48MUWDDYIeYa0bvveealjIkx jbLt.Xpk3FfYsUFNcvVrpkddndLPoAkcSkVR2QvirvZP1GMlVq3Wb_mktfkWTEDKBFVaz6lXC9fL KS71isEn0tB6ISaofcQITvW6XFOcXHdcku6WkBfSpLYvCCh5DhxT9xDyyt4YTc7yy8KpvJlTIGrC 8ZVrUUW4NjjO16vQWyE8kf2.wME8qosvK7Cv2zDS80tEdnLNNHNfjUFkpYKVzX63Pzfe9TrWc8YZ hBtSqK1uQtJFiX6WZVfL7hhSE.IkpZtSCGwIoOgM7KrQtaLgxx6fTRd47gUi4CxI64mGsXj9xf0W 1wSiI_G7dpnxjEd844PBApFc3TigKsJG.92_lllk78hkeJ2U7FqLROIOh6rDDtPYGI0u5CaBSCiU 0jMyXaRR1rkydeSFnl0d4hMJGxm7_xXZq7zJb17iqJ2KpT2W5_vknLYkpsDz67kTrcyY5ySqvFq9 Qz.GfEAqHnSaTj7dwJvr_84o6fdlIPBE1i3fyZpSCq1D8Gd.TwmLw_9qwjR955drGqIiqzXPHLwY zCpUIc6jjPQUq_reGr0aupgTvjb8d1puc.Qbl3uAhkLOd1RFPSFyU5dCsmR2E2mOV6HSrIonkVZu tYDnaJ3rot6OK3Or.aa4sL9vchi40EzhQtGv9GHmJ7hfzr5i0jCydfDwZPrj91tZtq6R9.6jes_4 jw7TWyQr.8OD0qXBMGZqKxanSFMhiXDv1IgDhmFX2Jb2pafnWAOI3WfjFBP4aNTv4VI105ibDs9n 9E0gr5_32lhtdexz4GCcIxOEYFwUgFMuWelHwrDlwpGjVnwpLHAD5A6m8Jqu0GRZI0F1py_xdcMZ .9E95A_mT4.Q3_aM9hEV_oVMEsLdtQV3i45xGTEAC2nLgHokrTdz8YZl5XqHTHWBfg9yBNAEXALB .xZ0nRma9zeKePUQDdloGUX6LEit_Y4kBvDR7fo6hZm16i_XA4X5qc0i1KZBgAOxUwCVasZEtgI8 dOseoo7piqeBEt5G6nHJQ33q0TJeoqyqlVF5SLOeAdxgJrDQZTcsa2smkHGn93uvW5svdvQZCbZs zI.W4hyz3bHwzH5G1hlg5kQrTmQpa26GqvkyGZ46z_LTcINHOdUNlFAmC_wJA5.Ln95LK.kjBYdK RHzX3JcQ4WF7fWrEUbgJUDoW4QEI1NXCn.frBq3xUMMByQeYoZ_NncJjeasfK84J7q8C_xdkMAFh Vyzy56TQaM6w_N9OkJLUruwgAUCp_7jI_BVwtrAd8tldUiBSDWcDZ0nVxYOE_C5bL8goNKqTYrwn SFQOphvPooVps0JyocnTnPg-- Received: from sonic.gate.mail.ne1.yahoo.com by sonic309.consmr.mail.gq1.yahoo.com with HTTP; Fri, 1 May 2020 09:36:16 +0000 Received: by smtp410.mail.ne1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 682561493c4a7b8ff05a7d1b98a098d2; Fri, 01 May 2020 09:36:13 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.80.23.2.2\)) Subject: Re: 32-bit powerpc head -r360311: lock order reversal between: "PROC (UMA zone)" and "kernelpmap (kernelpmap)": Is this expected? Date: Fri, 1 May 2020 02:36:12 -0700 References: <013FB43E-7DB1-4A66-A6ED-12A891539788@yahoo.com> To: FreeBSD PowerPC ML , FreeBSD Hackers , FreeBSD Current In-Reply-To: <013FB43E-7DB1-4A66-A6ED-12A891539788@yahoo.com> Message-Id: X-Mailer: Apple Mail (2.3608.80.23.2.2) X-Rspamd-Queue-Id: 49D6ZV3lWRz4HVv X-Spamd-Bar: + X-Spamd-Result: default: False [1.79 / 15.00]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; SUBJECT_ENDS_QUESTION(1.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/21, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; MIME_GOOD(-0.10)[text/plain]; IP_SCORE(0.00)[ip: (6.64), ipnet: 98.137.64.0/21(0.82), asn: 36647(0.66), country: US(-0.05)]; NEURAL_SPAM_MEDIUM(0.41)[0.413,0]; IP_SCORE_FREEMAIL(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_SPAM_LONG(0.87)[0.873,0]; RCVD_IN_DNSWL_NONE(0.00)[146.65.137.98.list.dnswl.org : 127.0.5.0]; RCVD_TLS_LAST(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[146.65.137.98.rep.mailspike.net : 127.0.0.17]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 01 May 2020 09:36:20 -0000 On 2020-Apr-30, at 18:30, Mark Millard wrote: > Using artifact.ci's head -r360311 debug-kernel materials: >=20 > = https://artifact.ci.freebsd.org/snapshot/head/r360311/powerpc/powerpc/kern= el*.txz >=20 > I got the following notice: >=20 > lock order reversal: > 1st 0x1cbb680 PROC (UMA zone) @ /usr/src/sys/vm/uma_core.c:4387 > 2nd 0x113c99c kernelpmap (kernelpmap) @ = /usr/src/sys/powerpc/aim/mmu_oea.c:1524 > stack backtrace: > #0 0x5d1e5c at witness_debugger+0x94 > #1 0x5d1b34 at witness_checkorder+0xb50 > #2 0x51d774 at __mtx_lock_flags+0xcc > #3 0x90902c at moea_kextract+0x5c > #4 0x9462ac at pmap_kextract+0x98 > #5 0x8a417c at zone_release+0xf0 > #6 0x8abc14 at bucket_drain+0x2f0 > #7 0x8ab64c at bucket_free+0x54 > #8 0x8ab8bc at bucket_cache_reclaim+0x1bc > #9 0x8ab3c4 at zone_reclaim+0x128 > #10 0x8a7e60 at uma_reclaim+0x1d0 > #11 0x8d96ac at vm_pageout_worker+0x4d8 > #12 0x8d91c0 at vm_pageout+0x1b0 > #13 0x4f67a0 at fork_exit+0xb0 > #14 0x94892c at fork_trampoline+0xc >=20 > Is the above interesting or is it one of the > known-safe lock order reversals that should > be ignored? >=20 > (The notice is from something like 4.5 hours > before I noticed it.) >=20 While running kyua to see what it might run into . . . lock order reversal: 1st 0x1c34800 filedesc0 (UMA zone) @ /usr/src/sys/vm/uma_core.c:4387 2nd 0x113c99c kernelpmap (kernelpmap) @ = /usr/src/sys/powerpc/aim/mmu_oea.c:1524 stack backtrace: #0 0x5d1e5c at witness_debugger+0x94 #1 0x5d1b34 at witness_checkorder+0xb50 #2 0x51d774 at __mtx_lock_flags+0xcc #3 0x90902c at moea_kextract+0x5c #4 0x9462ac at pmap_kextract+0x98 #5 0x8a417c at zone_release+0xf0 #6 0x8abc14 at bucket_drain+0x2f0 #7 0x8ab64c at bucket_free+0x54 #8 0x8ab8bc at bucket_cache_reclaim+0x1bc #9 0x8ab3c4 at zone_reclaim+0x128 #10 0x8a7d58 at uma_reclaim+0xc8 #11 0x656d24 at vnlru_proc+0x908 #12 0x4f67a0 at fork_exit+0xb0 #13 0x94892c at fork_trampoline+0xc witness_debugger through zone_reclaim look the same as the prior report. uma_reclaim has different associated figures. There is also: lock order reversal: 1st 0xfbed24 allprison (allprison) @ /usr/src/sys/kern/kern_jail.c:984 2nd 0x10706c4 vnet_sysinit_sxlock (vnet_sysinit_sxlock) @ = /usr/src/sys/net/vnet.c:577 stack backtrace: #0 0x5d1e5c at witness_debugger+0x94 #1 0x5d1b34 at witness_checkorder+0xb50 #2 0x555300 at _sx_slock_int+0xa0 #3 0x555b10 at _sx_slock+0x28 #4 0x6b7d84 at vnet_alloc+0xf4 #5 0x4fd09c at kern_jail_set+0x1868 #6 0x4fe938 at sys_jail_set+0x70 #7 0x9492fc at trap+0x748 #8 0x93d1c0 at powerpc_interrupt+0x178 And: lock order reversal: 1st 0x106f5d8 ifnet_sx (ifnet_sx) @ /usr/src/sys/netinet/in.c:914 2nd 0x107071c in_control (in_control) @ /usr/src/sys/netinet/in.c:243 stack backtrace: #0 0x5d1e5c at witness_debugger+0x94 #1 0x5d1b34 at witness_checkorder+0xb50 #2 0x553ca4 at _sx_xlock+0x98 #3 0x6c45b8 at in_ifscrub_all+0xec #4 0x6dbbc4 at ip_destroy+0xb0 #5 0x6b81c0 at vnet_destroy+0x154 #6 0x4fefb0 at prison_deref+0x2cc #7 0x5007dc at prison_remove_one+0x148 #8 0x500658 at sys_jail_remove+0x2a4 #9 0x9492fc at trap+0x748 #10 0x93d1c0 at powerpc_interrupt+0x178 I also do not know about the below GEOM topology related lock order reversals . . . lock order reversal: 1st 0xfbca1c GEOM topology (GEOM topology) @ = /usr/src/sys/geom/eli/g_eli.c:746 2nd 0xd49000 allproc (allproc) @ /usr/src/sys/kern/kern_fork.c:382 stack backtrace: #0 0x5d1e5c at witness_debugger+0x94 #1 0x5d1b34 at witness_checkorder+0xb50 #2 0x553ca4 at _sx_xlock+0x98 #3 0x4f4fb4 at fork1+0x7dc #4 0x5041c8 at kproc_create+0xd4 #5 0xdd27c390 at g_eli_create+0x774 #6 0xdd281048 at g_eli_config+0x23fc #7 0x499188 at g_ctl_req+0x154 #8 0x49e784 at g_run_events+0x194 #9 0x4a1580 at g_event_procbody+0x74 #10 0x4f67a0 at fork_exit+0xb0 #11 0x94892c at fork_trampoline+0xc lock order reversal: 1st 0xfbca1c GEOM topology (GEOM topology) @ = /usr/src/sys/geom/eli/g_eli.c:746 2nd 0xd2baccc8 filedesc structure (filedesc structure) @ = /usr/src/sys/kern/kern_descrip.c:2064 stack backtrace: #0 0x5d1e5c at witness_debugger+0x94 #1 0x5d1b34 at witness_checkorder+0xb50 #2 0x555300 at _sx_slock_int+0xa0 #3 0x555b10 at _sx_slock+0x28 #4 0x4dc128 at fdinit+0xe8 #5 0x4dc638 at fdcopy+0x68 #6 0x4f52ac at fork1+0xad4 #7 0x5041c8 at kproc_create+0xd4 #8 0xdd27c390 at g_eli_create+0x774 #9 0xdd281048 at g_eli_config+0x23fc #10 0x499188 at g_ctl_req+0x154 #11 0x49e784 at g_run_events+0x194 #12 0x4a1580 at g_event_procbody+0x74 #13 0x4f67a0 at fork_exit+0xb0 #14 0x94892c at fork_trampoline+0xc lock order reversal: 1st 0xfbca1c GEOM topology (GEOM topology) @ = /usr/src/sys/geom/eli/g_eli.c:746 2nd 0xd49080 proctree (proctree) @ /usr/src/sys/kern/kern_fork.c:557 stack backtrace: #0 0x5d1e5c at witness_debugger+0x94 #1 0x5d1b34 at witness_checkorder+0xb50 #2 0x553ca4 at _sx_xlock+0x98 #3 0x4f5650 at fork1+0xe78 #4 0x5041c8 at kproc_create+0xd4 #5 0xdd27c390 at g_eli_create+0x774 #6 0xdd281048 at g_eli_config+0x23fc #7 0x499188 at g_ctl_req+0x154 #8 0x49e784 at g_run_events+0x194 #9 0x4a1580 at g_event_procbody+0x74 #10 0x4f67a0 at fork_exit+0xb0 #11 0x94892c at fork_trampoline+0xc =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar)