From nobody Sat Jun 24 20:48:16 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4QpR5z2Pcgz4gyd6 for ; Sat, 24 Jun 2023 20:48:39 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic313-20.consmr.mail.gq1.yahoo.com (sonic313-20.consmr.mail.gq1.yahoo.com [98.137.65.83]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4QpR5w3pMGz45Dx for ; Sat, 24 Jun 2023 20:48:36 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=STn1RSGa; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.65.83 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1687639714; bh=ZGspgUnePUnZB5h60e0gUyXHKB8EEFn/tsdCZn05AKM=; h=From:Subject:Date:References:To:In-Reply-To:From:Subject:Reply-To; b=STn1RSGaGwDpYp4XXSt7LQu2o35ioaa/UEuco0ND3OlYOS5PEj+pOBXIz5cuGuJj4E+P7W+p3Yv7Z3YyX7ONgJdnWU1mHoY6kaPccncoJi6SQTALQszNGiHTArJs0REI4Q/9tQ8t+znPO//Ry7yVfqpE+mhS9NhjpSdvgnZdw0O86kfc0d8YEhAi63qc/nlY3HRRTxZPPnZCXAgIlZ1AFWU86Brv1swY2/uhawmrstp+6S2IRQh37k/b9Qf6sKgblkCSa7fZTwTTzC8cQ/pFosSdhV6VbSRgWfQyz9o+gawPWeeznQx0zVse0oekPs/mN0d3RJRR0LeUC3lQkpQbVg== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1687639714; bh=qD+eETkUjSGY/8PkL2SlWLNe7PjEAsZGggfhy8ecZfl=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=KnWTev2enMo7fNG7anwJooshD7GKp2M7hikRdy8Ur+DZJWcrwwhwiznMeEdazLt55QoWt10PiLQLwUUiWpmvp0KPf+2T9Qqlu/yzm4JhlHMWr8A6GK6lQ4HGLHw7MHsd+RyZ0sKo3w8nKP3+l82OtYAdaOwBMN0hLSEtKfWE05z0/dol3JenDtJ8U2zSpjFeeqNOwi70Z/G62N7ZGdKIVFqwCgOsMTAeH3LCyX/WNvDXxsK7c49iTyqv9mV3gJIL+9z3veR96arUoOZ8yRO/NkMT7ghvswgbK3MfjNEFE8De1FAdPuDX86Z0/BeSOYrEbYL+ksqq2ziUGa8SnuOMZA== X-YMail-OSG: G1dBJr4VM1nM_spfv9DeoGe3FcAUxJGaQluwcJFVYLSm95jgwl9tdYTipTczJVM AI9nazznpfRVmemUo_WrgqCSyzuHXNnYM2kpllmt9DjzcwLbV_0OF.MqIvyYsACg7AQqvC_wwQRm 6BWiDC0IE_1Myff7KUh07iGKCE9Cx8dD98p8M_yPBrLlIX1MEpvAdfnNUnaK25kyup.97bEVd.L. ZUa4tsaRti8u4JUCeUl_zKT8ucEjxGxDAqjyP9FOVbILOSrR5ugOqOlz1ynkDVsuQpELTzRRQw5S TEAv40qS2P3KeRsliWX14l52jUiQEsp1nhS5sV5OuFI1JuH9IqXzk8I4Rhfsg.mN3ie5mjzueHUG G7O4sbAIC14FMheB0cGztZOvIZqA3Jy4HTzufF8afcXJsl3Unvs6szaHhsbIWy8WQi8riH3kahx5 FwbDgF4hAIjC2Ll3S0Pd_dB_DT0s0A8KGYapfPARHV1POT7W5eepCc.R_G3KiP0SMqssnUaiO1kn 5btNUGMkB0nuiLf0uiUk1KVPqHua.jFdyg8RKSjgmkC_UL_dkD9MH1Z_hi_CEus1Z2vdT9vvgGrK YVCX8Rxw_Q2FuEed2CzyGPkAz6OuIcr6oHgpaL9Dm2GFH3IjdSPrX8GuE65PjZa5Jmkn0ijYV5eG .iO17c8rz32THlS6CLjWae9zVPgeCDg2c_.7YPKO2dhzY8P_NZABHew6EEwPh3bhKfAR71yG2I2V UBr59sd.Yhj1Caqef32HxXe4NtwJfnFnLMoUNGt6anJkDZltkP1JyjV1mqynpecVRrNh6L9LFDDL 01cCakD_rEMEnaj_RAtAtjdfv.zTxFLJQgoLKnPmbu3dzD4yk30avygeFYkVaNr5RKaaykaFTKO2 WVQWdkREES5cbxQRr.4LEyl2Fzh5DikQYuVBpkeXD76BCCHUvUn04q0qnMl7gtC7.UTypjMNbcBZ mTbn8cmSdu0L5Sr5m3s21bDmTmjshFAIeMrw3oG2MyWQJ0o3VZ08hUCB3crYzWOMQ3K0M8rjzodP ZNT7T.CLGBdAiXRLcFiPB4zEpwNdjHWBKxMLKMtE3eyblsBWDqZG87qDfpijDC5TTmRFlxKz6AcM wOcFT60.PfocGtrwaG2w4P6aDs8pL0dm5_zMH_tzoohpM7Q6jU5uRC.rtk9W2hUz0hZzXdY_oGQ4 XkHhveCJdEJYRjB2TbPiZJ7Qj1UJn2vf_iISb1Mfiazz5nkm0LgDUKfUcEl1gj1Z3GLSD1myjq5L FRYo.nf5YF8B5PR8VMgCGRUwSFHBZXHcQhl03eFSpQq7vv9gNziIwssuH8iSd9.2k9Z9pb_gWJHM rpXexeCUTb0UojVubxQKwtIbE97ByHcVmJUns8zfz5lqbMaIm1dNzT1LPz8WAcudMpATPLFQFL.B w720WDPiiNyxr950JIeasxYlAjMcvDpEvW6Ixi08B5uUQIyX9.BT9utE0d1XAC2g23qo.sUW4pEo jKP0lP6wilu3XWuAfk8sGM8CmMOZOXG7ChZ_55ShtuYVv4lumj3FBzSxhYc_tqPchfkU4.PZ7PKx 1X1JVoTGrOEtZi7Vvp7OeWGC8URKVH0iL0zdsdW6oRN8GcNJoIFWkU8Okq_NrFtj.rQ5QMyZv7b_ t5vXnrQOtd7GU7EKZ3nYhQsTfhSQfzjL9uqRUpoRC.CsLqlDtUgP7d40t9hzv0VNw799gY.GwNQ3 mmlfgOc4nyoGbH_OfgDoGTrnLn3nP7eMABN2D0EY1XkD.BcX1.q7Fp2YC5amI.qtqiAPa9L6uFld Jb974ZliW_SeP5f.QgyOJ6gBRfqIrVvnzzQ3mre4fpI3LvDWxsRH_DYbUu_sgY3wC8LcQhoN0Snw QjJJogD1lTdKZjMFp1x0FQWLT02FAF4LQXx1zR5cYupwy8zpa2FMRasIeyMOVjSrGr2iBJ3SWnlQ BT3.GbRHmcvye3SB3slntWBv.78jnqA_wuQP.ZrS9YFEVhO_uehvEwgYidI8vf4J8UthjOvsu0Vf Aqgbqdb69z6Ny.PiZtnCzD2_6AshvXpI_LnXdJUxRjMwjy8ZXRd.8syfPm.DfxRDyEkjahHqv.Wo tTbbUbX0RGdOXCtuGPniM5Nx_AL5gNcljLWPecWePJAlcG1YBuwN.jKTN18t7CjpWIUSRvKX7WXA cIR2zLmsqCODcNSMy14frahh1jYKtRgKWZ3OVQb3nVXYO30M8ppDfOBnYNHEDULpKUDUejmkA6e. etH4AzhB1n8Z5CF082TrM_JkmJXzJ1k3RcAyWvlp2r9C3zf7YNH61iFvM0KYosA9bu_sLhFG2z3N iGXNTsCEY X-Sonic-MF: X-Sonic-ID: 3bb06e92-874e-43c5-bd9d-ee46c252ac38 Received: from sonic.gate.mail.ne1.yahoo.com by sonic313.consmr.mail.gq1.yahoo.com with HTTP; Sat, 24 Jun 2023 20:48:34 +0000 Received: by hermes--production-ne1-574d4b7954-wtfnl (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 1961c497b2d8e5cb419155f4fdb73774; Sat, 24 Jun 2023 20:48:28 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.600.7\)) Subject: Re: aarch64 main-n263493-4e8d558c9d1c-dirty (so: 2023-Jun-10) Kyuafile run: "Fatal data abort" crash during vnet_register_sysinit Date: Sat, 24 Jun 2023 13:48:16 -0700 References: <3FD359F8-CFCC-400F-B6DE-B635B747DE7F@yahoo.com> <8E9937A8-1563-49C2-A1B1-150864C09AA0@yahoo.com> To: Current FreeBSD , freebsd-arm In-Reply-To: <8E9937A8-1563-49C2-A1B1-150864C09AA0@yahoo.com> Message-Id: <2CACE963-7846-475D-B139-D11B551E4A3F@yahoo.com> X-Mailer: Apple Mail (2.3731.600.7) X-Spamd-Result: default: False [-2.30 / 15.00]; NEURAL_HAM_SHORT(-0.98)[-0.979]; NEURAL_HAM_MEDIUM(-0.70)[-0.695]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; NEURAL_HAM_LONG(-0.13)[-0.126]; MIME_GOOD(-0.10)[text/plain]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.83:from]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; MLMMJ_DEST(0.00)[freebsd-arm@freebsd.org]; TO_DN_ALL(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; FREEMAIL_FROM(0.00)[yahoo.com]; RCVD_TLS_LAST(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; FROM_EQ_ENVFROM(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.83:from] X-Rspamd-Queue-Id: 4QpR5w3pMGz45Dx X-Spamd-Bar: -- X-ThisMailContainsUnwantedMimeParts: N On Jun 24, 2023, at 12:16, Mark Millard wrote: > On Jun 24, 2023, at 10:49, Mark Millard wrote: >=20 >> On Jun 24, 2023, at 10:00, Mark Millard wrote: >>=20 >>> The running system build is a non-debug build (but >>> with symbols not stripped). >>>=20 >>> The HoneyComb's console log shows: >>>=20 >>> . . . >>> GEOM_STRIPE: Device stripe.IMfBZr destroyed. >>> GEOM_NOP: Device md0.nop created. >>> g_vfs_done():md0.nop[READ(offset=3D5885952, length=3D8192)]error =3D = 5 >>> GEOM_NOP: Device md0.nop removed. >>> GEOM_NOP: Device md0.nop created. >>> g_vfs_done():md0.nop[READ(offset=3D5935104, length=3D4096)]error =3D = 5 >>> g_vfs_done():md0.nop[READ(offset=3D5935104, length=3D4096)]error =3D = 5 >>> GEOM_NOP: Device md0.nop removed. >>> GEOM_NOP: Device md0.nop created. >>> GEOM_NOP: Device md0.nop removed. >>> Fatal data abort: >>> x0: ffffa02506e64400 >>> x1: ffff0001ea401880 (g_raid3_post_sync + 3a145f8) >>> x2: 4b >>> x3: a343932b0b22fb30 >>> x4: 0 >>> x5: 3310b0d062d0e1d >>> x6: 1d0e2d060d0b3103 >>> x7: 0 >>> x8: ea325df8 >>> x9: ffff0001eec946d0 ($d.6 + 0) >>> x10: ffff0001ea401880 (g_raid3_post_sync + 3a145f8) >>> x11: 0 >>> x12: 0 >>> x13: ffff000000cd8960 (lock_class_mtx_sleep + 0) >>> x14: 0 >>> x15: ffffa02506e64405 >>> x16: ffff0001eec94860 (_DYNAMIC + 160) >>> x17: ffff00000063a450 (ifc_attach_cloner + 0) >>> x18: ffff0001eb290400 (g_raid3_post_sync + 48a3178) >>> x19: ffff0001eec94600 (vnet_epair_init_vnet_init + 0) >>> x20: ffff000000fa5b68 (vnet_sysinit_sxlock + 18) >>> x21: ffff000000d8e000 (sdt_vfs_vop_vop_spare4_return + 0) >>> x22: ffff000000d8e000 (sdt_vfs_vop_vop_spare4_return + 0) >>> x23: ffffa0000042e500 >>> x24: ffffa0000042e500 >>> x25: ffff000000ce0788 (linker_lookup_set_desc + 0) >>> x26: ffffa0203cdef780 >>> x27: ffff0001eec94698 (__set_sysinit_set_sym_if_epairmodule_sys_init = + 0) >>> x28: ffff000000d8e000 (sdt_vfs_vop_vop_spare4_return + 0) >>> x29: ffff0001eb290430 (g_raid3_post_sync + 48a31a8) >>> sp: ffff0001eb290400 >>> lr: ffff0001eec82a4c ($x.1 + 3c) >>> elr: ffff0001eec82a60 ($x.1 + 50) >>> spsr: 60000045 >>> far: ffff0002d8fba4c8 >>> esr: 96000046 >>> panic: vm_fault failed: ffff0001eec82a60 error 1 >>> cpuid =3D 14 >>> time =3D 1687625470 >>> KDB: stack backtrace: >>> db_trace_self() at db_trace_self >>> db_trace_self_wrapper() at db_trace_self_wrapper+0x30 >>> vpanic() at vpanic+0x13c >>> panic() at panic+0x44 >>> data_abort() at data_abort+0x2fc >>> handle_el1h_sync() at handle_el1h_sync+0x14 >>> --- exception, esr 0x96000046 >>> $x.1() at $x.1+0x50 >>> vnet_register_sysinit() at vnet_register_sysinit+0x114 >>> linker_load_module() at linker_load_module+0xae4 >>> kern_kldload() at kern_kldload+0xfc >>> sys_kldload() at sys_kldload+0x60 >>> do_el0_sync() at do_el0_sync+0x608 >>> handle_el0_sync() at handle_el0_sync+0x44 >>> --- exception, esr 0x56000000 >>> KDB: enter: panic >>> [ thread pid 70419 tid 101003 ] >>> Stopped at kdb_enter+0x44: str xzr, [x19, #3200] >>> db>=20 >>>=20 >>> I'll see if a re-run is repeatable. >>>=20 >>=20 >> It repeats: >>=20 >> GEOM_STRIPE: Device stripe/stripe.VkbPk1 deactivated. >> GEOM_STRIPE: Disk md1 removed from stripe.VkbPk1. >> GEOM_STRIPE: Disk md0 removed from stripe.VkbPk1. >> GEOM_STRIPE: Device stripe.VkbPk1 destroyed. >> GEOM_NOP: Device md0.nop created. >> g_vfs_done():md0.nop[READ(offset=3D5885952, length=3D8192)]error =3D = 5 >> GEOM_NOP: Device md0.nop removed. >> GEOM_NOP: Device md0.nop created. >> g_vfs_done():md0.nop[READ(offset=3D5935104, length=3D4096)]error =3D = 5 >> g_vfs_done():md0.nop[READ(offset=3D5935104, length=3D4096)]error =3D = 5 >> GEOM_NOP: Device md0.nop removed. >> GEOM_NOP: Device md0.nop created. >> GEOM_NOP: Device md0.nop removed. >> Fatal data abort: >> x0: ffffa0003b1a9500 >> x1: ffff00021b530260 >> x2: 4b >> x3: a343932b0b22fb30 >> x4: 0 >> x5: 3310b0d062d0e1d >> x6: 1d0e2d060d0b3103 >> x7: 0 >> x8: ea325df8 >> x9: ffff00021d6946d0 ($d.6 + 0) >> x10: ffff00021b530260 >> x11: 0 >> x12: 0 >> x13: ffff000000cd8960 (lock_class_mtx_sleep + 0) >> x14: 0 >> x15: ffffa0003b1a9505 >> x16: ffff00021d694860 (_DYNAMIC + 160) >> x17: ffff00000063a450 (ifc_attach_cloner + 0) >> x18: ffff00021a6ea400 >> x19: ffff00021d694600 (vnet_epair_init_vnet_init + 0) >> x20: ffff000000fa5b68 (vnet_sysinit_sxlock + 18) >> x21: ffff000000d8e000 (sdt_vfs_vop_vop_spare4_return + 0) >> x22: ffff000000d8e000 (sdt_vfs_vop_vop_spare4_return + 0) >> x23: ffffa00000431500 >> x24: ffffa00000431500 >> x25: ffff000000ce0788 (linker_lookup_set_desc + 0) >> x26: ffffa02e1ab6d180 >> x27: ffff00021d694698 (__set_sysinit_set_sym_if_epairmodule_sys_init = + 0) >> x28: ffff000000d8e000 (sdt_vfs_vop_vop_spare4_return + 0) >> x29: ffff00021a6ea430 >> sp: ffff00021a6ea400 >> lr: ffff00021d682a4c ($x.1 + 3c) >> elr: ffff00021d682a60 ($x.1 + 50) >> spsr: 60000045 >> far: ffff0003079ba4c8 >> esr: 96000046 >> panic: vm_fault failed: ffff00021d682a60 error 1 >> cpuid =3D 1 >> time =3D 1687628622 >> KDB: stack backtrace: >> db_trace_self() at db_trace_self >> db_trace_self_wrapper() at db_trace_self_wrapper+0x30 >> vpanic() at vpanic+0x13c >> panic() at panic+0x44 >> data_abort() at data_abort+0x2fc >> handle_el1h_sync() at handle_el1h_sync+0x14 >> --- exception, esr 0x96000046 >> $x.1() at $x.1+0x50 >> vnet_register_sysinit() at vnet_register_sysinit+0x114 >> linker_load_module() at linker_load_module+0xae4 >> kern_kldload() at kern_kldload+0xfc >> sys_kldload() at sys_kldload+0x60 >> do_el0_sync() at do_el0_sync+0x608 >> handle_el0_sync() at handle_el0_sync+0x44 >> --- exception, esr 0x56000000 >> KDB: enter: panic >> [ thread pid 36377 tid 100985 ] >> Stopped at kdb_enter+0x44: str xzr, [x19, #3200] >> db>=20 >>=20 >>=20 >> For reference, the output of the run in the ssh >> session ends with: >>=20 >> . . . >> sys/kqueue/libkqueue/kqueue_test:main -> passed [48.258s] >> sys/mac/bsdextended/ugidfw_test:main -> skipped: mac_bsdextended = not loaded [0.006s] >> sys/mac/portacl/nobody_test:main -> skipped: MAC_PORTACL is = unavailable. [0.010s] >> sys/mac/portacl/root_test:main -> skipped: MAC_PORTACL is = unavailable. [0.010s] >> sys/mqueue/mqueue_test:mqtest1 -> passed [0.025s] >> sys/mqueue/mqueue_test:mqtest2 -> passed [0.025s] >> sys/mqueue/mqueue_test:mqtest5 -> passed [0.025s] >> sys/net/if_ovpn/if_ovpn_c:tcp -> skipped: if_ovpn not loaded = [0.006s] >> sys/netinet/arp:arp_add_success -> =20 >>=20 >> That should give some extra information about the context >> of failure. >=20 > So I installed, booted, and tried my debug build. It failed > the same way in the same place, with no extra console > reporting for the crash by the debug code: no assertion > failures or WITNESS reports or the like first. I tried doing just: # kyua test -k /usr/tests/Kyuafile sys/netinet/arp and it crashed the same way at the same place. The prior kyua activity in other tests does not need to be involved to get the crash. For now I've touched the /usr/tests/sys/netinet/Kyuafile to comment out the arp test line. There does not seem to be a supported way to indicate to skip just one or a few specific tests. So I'm touching a do-not-touch file instead. We will see how far it gets when skipping sys/netinet/arp . =3D=3D=3D Mark Millard marklmi at yahoo.com