From owner-freebsd-ppc@freebsd.org Thu Jan 9 02:09:56 2020 Return-Path: Delivered-To: freebsd-ppc@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id DA684223BE3 for ; Thu, 9 Jan 2020 02:09:56 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic315-55.consmr.mail.gq1.yahoo.com (sonic315-55.consmr.mail.gq1.yahoo.com [98.137.65.31]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 47tV1b5r4Xz4SKn for ; Thu, 9 Jan 2020 02:09:55 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: Z0L4TF8VM1lDitbpXo.RxnFAued.r3Gwd8NywAPQ4D2dOexgHU1Plcusvf0zMB9 18kywkLGyITgzsTlXxaopqfIlO.XgRzpYTlO4GgQxJ70d1AjwPkPKkW6WPNgfFD7i9Mdfy78bbxu HoqSL8qk4a4POhzIUA02npdxqqAzjXCxJNKoosQIX5pQHtxeUGON1WSOZLEDlNozOJWTNFsHETEV x_7q.n0LdSQOgm8IUn76LQXsIq99L5kdTf.QEYUSLytZrEkqAaLpQqxI48GRqW8THxppGamZS_X2 yKE7nNuNEGTFT2qEJUlBJfH_Zx5MdJ_n1Rqwtc9rTDPPFfbB12AvaGVd.AP3UhiEGkWuvlq4aTDJ ypTfgw13MxjZFuvt5zXTOPcOxYLJq69F_Riv_ux4qtcEmdKEli4mARHyfBb1OYNLbS4Rdu.fmkw1 w7TpxkqTjSv8RZBrlqMWKWPNrJCIvlnnKHn91dTR4xBXMCQemOWTTR.518LWY0Gpj6fXF0_Vyrq5 vZyGIK7MXzfHIKKoq.Z.zcNvrFtUIPjdy71h1M51Ifjg1meejwmk_freQoW8TI3WrM56VA.4LIIk 02gZ2PwOUMgFYFnqTdNRA4RotdVlhUY53VRy9HeRD87T48S4lB4oFmjcSXKN7gDCEIMcH0zyX17o BIzCWIPWqf16LNi3J4aoXgLuPaKkhIZagGAtMTEqQp5JMGhA7cy2gVoq..dkjE3BysZDk5LC84gJ cm63qGr3fMypI5zzX2rSsLMcKL36ibRUoIl8lO54wjeYm642.F6oEfjdhApq7SYf_RHuTmijnQDh zmLYVgFzDJDDa7SZdkeNzuAWw.O3UzZ4Ii83pwWQV_DDO_d9tB9ZxfKiW_WqCb3R3jsIqLnLg.mi 2IhyoMpYv4sZ5RuQVVbjIByBXHV1C3p98z6y2_tjrGSyDAL7Dd4FK5ZzLgz9sKW83JkxePR7LhyQ AEG3ZuEzVkhQN8nCrQ3ook0Y5aUtkThJf4qFwF_QDL1fd5FiIaGkKM4Jl7sXbPm6L_f4C.5YPVO0 YHHN2t_vsLcgYySojyQsAu1raZOzTG6g7gc2TvDq9r7J4aOue8wmOpj2pImq7Fotx76WHwWJUh8e rg1YJWhiOhOrM.3LSqXpUrWEnfODgtRoGMBVd4YRipKiRTKFtB6xKQ6eIUCxu5OXTPWkgyQ_lzi_ Wsy0sfiHqT1Owocf90npShXIRosSIcogiOhXzfMptukblqr.lxRsspoFCEu5d_z1KUXqX0G4VlnN MRX42ZG8KSrJ8Khp0LGH0PWRYSSXO_6VwcCLMYAgGtYZNu_myCDyZwHXH7obGlOXTw_9wAZvE5Ss 6bxh9JdzVKqtwDhjulVR4trIvQAv.F3c075dGyDjXT2IDrubA9oCN6dR.bIuq80doWO0TsNXnWnH S9cTtx1i9br3BAULdNtAO.0L4boL.PJnh6w-- Received: from sonic.gate.mail.ne1.yahoo.com by sonic315.consmr.mail.gq1.yahoo.com with HTTP; Thu, 9 Jan 2020 02:09:54 +0000 Received: by smtp426.mail.bf1.yahoo.com (Oath Hermes SMTP Server) with ESMTPA ID 3c5154a412003a410da9e61611c25d14; Thu, 09 Jan 2020 02:09:49 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 13.0 \(3608.40.2.2.4\)) Subject: Re: head -356426 based 32-bit powerpc (2 sock PowerMac G4): kyua sys/vm/mlock_test:mlock__copy_on_write_vnode seems stuck From: Mark Millard In-Reply-To: Date: Wed, 8 Jan 2020 18:09:47 -0800 Cc: FreeBSD Current Content-Transfer-Encoding: quoted-printable Message-Id: <67C0401B-7135-4B79-912F-6AD2CBD60B6B@yahoo.com> References: To: FreeBSD PowerPC ML X-Mailer: Apple Mail (2.3608.40.2.2.4) X-Rspamd-Queue-Id: 47tV1b5r4Xz4SKn X-Spamd-Bar: - X-Spamd-Result: default: False [-1.66 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.62)[-0.617,0]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; FREEMAIL_FROM(0.00)[yahoo.com]; MIME_GOOD(-0.10)[text/plain]; MV_CASE(0.50)[]; NEURAL_HAM_LONG(-0.55)[-0.548,0]; RCVD_COUNT_TWO(0.00)[2]; IP_SCORE_FREEMAIL(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[31.65.137.98.list.dnswl.org : 127.0.5.0]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/21, country:US]; MID_RHS_MATCH_FROM(0.00)[]; IP_SCORE(0.00)[ip: (4.83), ipnet: 98.137.64.0/21(0.87), asn: 36647(0.70), country: US(-0.05)]; DWL_DNSWL_NONE(0.00)[yahoo.com.dwl.dnswl.org : 127.0.5.0] X-BeenThere: freebsd-ppc@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Porting FreeBSD to the PowerPC List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 Jan 2020 02:09:56 -0000 [I got kernel backtrace information, included.] On 2020-Jan-8, at 15:12, Mark Millard wrote: > I've attempted a head -356426 based kyua run on an > old 2-socket PowerMac G4. The buildworld and > buildkernel were non-debug. The context has personal > patches, mostly for dealing with PowerMac issues. >=20 > It has had over 180 CPU minutes running for: >=20 > sys/vm/mlock_test:mlock__copy_on_write_vnode -> =20 >=20 > Normal seems to be way under 0.1 sec on the > other platforms I've made runs on recently. >=20 > Hopefully kyua will time out and continue the > testing at some point. >=20 > The 2 socket (2 cores each) G5 powerpc64 context > did not have this problem. Nor did the armv7 or > aarch64 examples (CortexA7, CortexA53, CortexA57, > and CortexA72). I finally gave up on it after 240 CPU minutes but could not kill/stop the stuck process. So I sync'd the file system and tried a "shutdown -r now" and forced the power off after it got stuck (no reboot happened). After power-up I tried: # kyua test -k /usr/tests/Kyuafile sys/vm/mlock_test sys/vm/mlock_test:mlock__copy_on_write_anon -> passed [0.017s] sys/vm/mlock_test:mlock__copy_on_write_vnode -> =20 and it got stuck again. I'll note that ps -auxd shows the likes of: root 1120 0.0 0.4 11512 8772 0 I+ 16:38 0:00.62 | | = `-- kyua test -k /usr/tests/Kyuafile sys/vm/mlock_test root 1124 100.0 0.1 4640 2332 - Rs 16:38 2:57.43 | | = `-- /usr/tests/sys/vm/mlock_test -vunprivileged-user=3Dtests = -r/tmp/kyua.B2pXx8/3/result.atf mlock__copy_on_write_vnode root 1125 0.0 0.0 4640 620 - TXL 16:38 0:00.00 | | = `-- /usr/tests/sys/vm/mlock_test -vunprivileged-user=3Dtests = -r/tmp/kyua.B2pXx8/3/result.atf mlock__copy_on_write_vnode I got a couple of backtraces from the kernel via the ddb> prompt : pid 1125 was in thread_suspend_switch called via ptracestop. I've a couple of examples of pid 1124 (the CPU time taker): (manually typed from screen images) 0xdc9e0520: at mi_switch+0x17c 0xdc9e0540: at critical_exit_preempt+0x7c 0xdc9e0560: at powerpc_interrupt+0x1c4 0xdc9e0590: at kernel EXI trap by __syncicache+0x5c: srr1=3D 0x209032 r1=3D 0xdc9e0650 cr=3D 0x8822fc22 xer=3D 0 ctr=3D 0 frame=3D0xdc9e0598 0xdc9e0650: at 0x5ed67ec 0xdc9e0660: at moea_sync_icache+0x118 Note: =46rom here on down is common with the other example backtrace: 0xdc9e0690: at pmap_sync_icache+0x98 0xdc9e06b0: at vm_sync_icache+0x2c 0xdc9e06c0: at proc_rwmem+0x13c 0xdc9e0710: at kern_ptrace+0x76c 0xdc9e0830: at sys_ptrace+0x12c 0xdc9e0960: at trap+0xae8 0xdc9e0a10: at powerpc_interrupt+0x1ec 0xdc9e0a40: at use SC trap by 0x4191ea48: srr1=3D 0x209032 r1=3D 0xffffc6d0 cr=3D 0x28000200 xer=3D 0 ctr=3D 0x4191ea40 frame=3D0xdc9e0a48 The non-common part of the other backtrace is: 0xdc9e04a0: at intr_event_handle+0xd4 0xdc9e04e0: at powerpc_dispatch_intr+0xe0 0xdc9e0520: at openpic_dispatch+0x90 0xdc9e0540: at powerpc_interrupt+0x128 0xdc9e0570: at kernel EXI trap by moea_pvo_find_va: srr1=3D 0xf032 r1=3D 0xdc9e0630 cr=3D 0x4822fc22 xer=3D 0 ctr=3D 0 frame=3D0xdc9e0578 0xdc9e0630: at 0x41b76ffc 0xdc9e0660: at moea_sync_icache+0x100 Showing a lock chain showed just one line: thread 100151 (pid 1124, mlock_test) running on CPU 0 The pcpu output for cpuid 0 metioned: critnest 2 "mlock_test" when I tried it. (After that I did something that locked up the machine, probably my fault.) It does not look like I can complete a normal kyua run for a 2-socket 32-bit powerpc. May be someone else can for some multi-socket 32-bit powerpc to see if this repeats. Single-socket/single-core might prove interesting as well. Maybe I can try such. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar)