From nobody Sun Jun 25 00:25:35 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4QpWwd0W3Pz4fwFP for ; Sun, 25 Jun 2023 00:25:53 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic309-22.consmr.mail.gq1.yahoo.com (sonic309-22.consmr.mail.gq1.yahoo.com [98.137.65.148]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4QpWwc50DRz4Y4F for ; Sun, 25 Jun 2023 00:25:52 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1687652750; bh=TPFdGh8HRqUf+3b9o4Wkv5WDL6+QPc7vTdIVPu6SG0k=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=RlzuB6JtKa1S8yDMmirxEcu4wZ6XdUkq17sY4qNYAc+wmQt9azqbJ9JZnY7IemTFPG//+CNnYuKOsrqagjW4s1/Q1iMRP1xeYNeAxfmioDl6a9Kwbj0VasRqvKFIMeJYP6sZQwOCqSXAzhfgDm7cv92dRbnPKEHaRvUGkLGEUA+9cHaEkahZnP/2Dm+5sA3jnAEpXdpAOakhtUzyCBDQr3etTtVnpQnF4ibTiZOH6ATSTdafcBUoRtkjkT4m7bG29LpYCQQ1+hkeZpwcCniM5UxyMn7lBonBit25682pdyhj25QtFg4rOEBwRG/Kw6YRCZVUfmxM/wYeYkOaz/SeNw== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1687652750; bh=j4oevzRlGsuLdJULt66EhMyXgcyHPvTxDqf/kT8cKd+=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=QubJj/iZn01ZYigKBziEA5am8h3P94MrHIIGD9cZH4ooCeDhYnMBDK2K/e9xcI8BovRBotbr8X9VSCiAQI5tNn1Wb+bWEB52x7+YwVYcvpFMV5RB8uoKrQVktJPsIKFNbJeSN+3VZAj+Xe8YHETCS/CQ7eCK7G80ZenO3CREFDuIPf3WGmy6UE9N91+uga6e/9Xw7pK/mrfs2MZyUXRVEfVXUdZFhF1Mwx7E+9m4jCNJ7B0XLRxlsXe20IVYhQH7LCQ/czqSqJkrNAkuy/anA8V37b+P0clzu7KceWiLQNsy9tgAQ5Iy+ypG2g0pqzONLmhKHpv0wg68Qn/JWARjdQ== X-YMail-OSG: FKwoVRkVM1l.QSauy4fOrWnokZ2yG9vOqU4vfLbJGNwMA98FxXqKuvRg8InhvkK cwdMsutNywPHCCR822EIb1J1lsy57SSc9Au84_Lsl5Op8oB4PAZz1ymzq3qpxR6a84hTgwSVj3td _fiNtoe0_taqe1h_NIsOrokRdg55fy6ZZqGfWaduWUaOx4O0yBR.HhZ23uVrYgBLaWg0GQSeQwwp tHO_cJ_wOdzD35KkWfAO5B4b2r1egwgoG5HoGTcB_J_QwKy_hPWwE4_BmDwkdxDTIYvV2kag5.GX 79XTpjT5tGurbO8AM7oetJlvV8cnlMf6_38yqjamCZhJiFOrxdonFE4f8rQM4fsURVUDkUYNqCH4 mB14vpcUXDu.BJKdIVropWoPSV9O8aaITi7ThZYLUNfWkHGZKsBsAQCVqk9SvtRR3BdXu2L.HSPC JtXZDjCqBzGV1U.TwTsoTMXiYN8_fqrV_1ZEky1mihjWzyz7lT8BLvQqXIX26qfWFxfOwSDlqKPN qUgObBXyhnTzxWTQbpYxwGsNTrrjcrqz4Hlx3Gc6Sw8fz3foQiKD0jH32VbYWHRnw3QAaXn.QAvh ae6mFJ9EHEk8r8HvKt4tadJ6EU4nZGMyEYRSagLltQ2pmtnA4esk_eBrXZ_m5YT89KxtBTZRAVKJ z0bj_om8QeT5_KfxNYjbdvPUV8YOHIEVt_3ltLOZurpSs_yvmoR_dCCYuJjowMLtjI7gYHwtWGQH 4PZhYF41bvYr22rVwHNRwqoJTM9f9pz2CskftMl82YTfIqktnJBeOEWvBCf.HvgFBln.toLgogy2 JqeKJ6dDHDU7vZ91f1b8Ua3UoWpZMzwD.fUEuKwbSJ59mZTyGYuu2XyTvYKFNSCsNkKjL9aKXSts YagIIRvJfVuzey3ax9oI_MZ3bcX4igVO_Ammyb9eeGHv9JAccBf8F7RqwPUxYB87XsJZ02XZCGLE N0MfCMN5ghASoUqYqOd26nnN7cjB240GgESFojax57S45RchXDTgTiw4AP9NsbTJ2PyEs35MrNgy 57PeFJjUNNS9dUeIRCVfW.sBVg5a7KNplQkMgw1Cj.QoCib8PKJQab7PqxM0vZse21vc.uV5cjtY 4WoKc1eUZt9PMD3yRzrfsns7Ht7CC7R6tPfZrpsKzbduWRKFKpVh55K8BGPkWPEMBobxaxLVS3W4 HcT1AYDIE.p7RFND8K2drfTkYYXFYrtNzkWKL7xH2VjrLekfHRd7F73Owt4FJXjxaUfPLDzVWcm6 sdhyX.N_fRlFgUQA3a7ieEM9tIJX5oiKIM_6u9lWe4atScKBgsnCLBTFbDpvPZ8TpxWv_dWOAVd4 ZwJN3rLCRmr5ifgdIW82Qpa.mTkhhtu7rrFaSis8nyd1dz5jDXixwbLh5Gzuv0KGz7Hfp_sx5eLi w5iTkqEj29oB6dUHjwusa_Eq7sGCTSalFpm.cbzeQ0DdCxRqEGQy4P5DOM8bhu9Y2oJla1SZv2.I sWEuxqWvumS.Ex_v4BngPofQJXjmxcoEsFZpKL5.JubTxSYG8wK7zHB65SZPVzC1h.bgClsUES0. yZAvT9rrcF4Hpjs7PUj8HZAcdMpWpE8oz6JIUU8fzym8k4JMH__bfORs_zRX.i8EleavZdz1u3QM EjNJybBaj2rHM.jMTNCl.Uayf_W4irmXo1pMFZG5j5pztjH49kh4dK7Qrje10i8GV1umgNshA0Y6 ul0JdaUgohD6uAK2vz8aWkvBpQyUEtHHhYp18jxTip5LLPmVLHZ2ZxSH344urVV54U5DyoW0IGZc Wt.ZptZkMQ9Bj5agfbcLbbIeC8M_6HuqAZo9JT.IfYAyYcyz2o.FXslEkQyL2Y.Bw6ku2ERK93u5 .FECOJSmgP_dX.AdWj41H6Qb9mkmzzFHcWlGgrhLBE2Uranv733dEGHGzoyPtZI.9Dkt8wcgr8Yq dzy6x97vTF.yHm0GIts1Tjto2rBouBgFdD2yg5OwleGQzbVG2As4.3JSpdxme8rhvMSfeaedtQtb Df2yHYsqOD3NFp1KMc1YumP.4oEAOh.9bqQcBwf963YCXZYaDaebISu_NMOeEAR187bITfgmYds7 o3UKvTya2O.ev6pGRUQb2aLNa.pBIdXSFz1M20nXaWR5qwBn_u0rhGptscNwGcjzoshkePw9avZe pqOcm9hgYZ8ZgmlkWC1LAjoN4mltVoWpBaV79TRh5qini4r_eyvNCAojD__Y8czyH4tc7cShSqZw ezdxsDrmWpkox_xe2eFu0.pceLiGAsFg.Q2BIFZroP9flyiFA3E1wwGM_.vfsAhpAArSLltUD6_3 OFpuRusg- X-Sonic-MF: X-Sonic-ID: dd9c2e7a-db3e-4472-a555-ba1cf66d471f Received: from sonic.gate.mail.ne1.yahoo.com by sonic309.consmr.mail.gq1.yahoo.com with HTTP; Sun, 25 Jun 2023 00:25:50 +0000 Received: by hermes--production-bf1-54475bbfff-lfx8r (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 075c9bb24c642fe578221f15a2e45d58; Sun, 25 Jun 2023 00:25:47 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.600.7\)) Subject: Re: aarch64 main-n263493-4e8d558c9d1c-dirty (so: 2023-Jun-10) Kyuafile run: "Fatal data abort" crash during vnet_register_sysinit From: Mark Millard In-Reply-To: Date: Sat, 24 Jun 2023 17:25:35 -0700 Cc: Current FreeBSD , freebsd-arm Content-Transfer-Encoding: quoted-printable Message-Id: <4A380699-7C9E-4E2E-8DCD-F9ECC2112667@yahoo.com> References: <3FD359F8-CFCC-400F-B6DE-B635B747DE7F.ref@yahoo.com> <3FD359F8-CFCC-400F-B6DE-B635B747DE7F@yahoo.com> To: John F Carr X-Mailer: Apple Mail (2.3731.600.7) X-Rspamd-Queue-Id: 4QpWwc50DRz4Y4F X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On Jun 24, 2023, at 14:26, John F Carr wrote: >=20 >> On Jun 24, 2023, at 13:00, Mark Millard wrote: >>=20 >> The running system build is a non-debug build (but >> with symbols not stripped). >>=20 >> The HoneyComb's console log shows: >>=20 >> . . . >> GEOM_STRIPE: Device stripe.IMfBZr destroyed. >> GEOM_NOP: Device md0.nop created. >> g_vfs_done():md0.nop[READ(offset=3D5885952, length=3D8192)]error =3D = 5 >> GEOM_NOP: Device md0.nop removed. >> GEOM_NOP: Device md0.nop created. >> g_vfs_done():md0.nop[READ(offset=3D5935104, length=3D4096)]error =3D = 5 >> g_vfs_done():md0.nop[READ(offset=3D5935104, length=3D4096)]error =3D = 5 >> GEOM_NOP: Device md0.nop removed. >> GEOM_NOP: Device md0.nop created. >> GEOM_NOP: Device md0.nop removed. >> Fatal data abort: >> x0: ffffa02506e64400 >> x1: ffff0001ea401880 (g_raid3_post_sync + 3a145f8) >> x2: 4b >> x3: a343932b0b22fb30 >> x4: 0 >> x5: 3310b0d062d0e1d >> x6: 1d0e2d060d0b3103 >> x7: 0 >> x8: ea325df8 >> x9: ffff0001eec946d0 ($d.6 + 0) >> x10: ffff0001ea401880 (g_raid3_post_sync + 3a145f8) >> x11: 0 >> x12: 0 >> x13: ffff000000cd8960 (lock_class_mtx_sleep + 0) >> x14: 0 >> x15: ffffa02506e64405 >> x16: ffff0001eec94860 (_DYNAMIC + 160) >> x17: ffff00000063a450 (ifc_attach_cloner + 0) >> x18: ffff0001eb290400 (g_raid3_post_sync + 48a3178) >> x19: ffff0001eec94600 (vnet_epair_init_vnet_init + 0) >> x20: ffff000000fa5b68 (vnet_sysinit_sxlock + 18) >> x21: ffff000000d8e000 (sdt_vfs_vop_vop_spare4_return + 0) >> x22: ffff000000d8e000 (sdt_vfs_vop_vop_spare4_return + 0) >> x23: ffffa0000042e500 >> x24: ffffa0000042e500 >> x25: ffff000000ce0788 (linker_lookup_set_desc + 0) >> x26: ffffa0203cdef780 >> x27: ffff0001eec94698 (__set_sysinit_set_sym_if_epairmodule_sys_init = + 0) >> x28: ffff000000d8e000 (sdt_vfs_vop_vop_spare4_return + 0) >> x29: ffff0001eb290430 (g_raid3_post_sync + 48a31a8) >> sp: ffff0001eb290400 >> lr: ffff0001eec82a4c ($x.1 + 3c) >> elr: ffff0001eec82a60 ($x.1 + 50) >> spsr: 60000045 >> far: ffff0002d8fba4c8 >> esr: 96000046 >> panic: vm_fault failed: ffff0001eec82a60 error 1 >> cpuid =3D 14 >> time =3D 1687625470 >> KDB: stack backtrace: >> db_trace_self() at db_trace_self >> db_trace_self_wrapper() at db_trace_self_wrapper+0x30 >> vpanic() at vpanic+0x13c >> panic() at panic+0x44 >> data_abort() at data_abort+0x2fc >> handle_el1h_sync() at handle_el1h_sync+0x14 >> --- exception, esr 0x96000046 >> $x.1() at $x.1+0x50 >> vnet_register_sysinit() at vnet_register_sysinit+0x114 >> linker_load_module() at linker_load_module+0xae4 >> kern_kldload() at kern_kldload+0xfc >> sys_kldload() at sys_kldload+0x60 >> do_el0_sync() at do_el0_sync+0x608 >> handle_el0_sync() at handle_el0_sync+0x44 >> --- exception, esr 0x56000000 >> KDB: enter: panic >> [ thread pid 70419 tid 101003 ] >> Stopped at kdb_enter+0x44: str xzr, [x19, #3200] >> db>=20 >=20 > The failure appears to be initializing module if_epair. Yep: trying: # kldload if_epair.ko was enough to cause the crash. (Just a HoneyComb context at that point.) I tried media dd'd from the recent main snapshot, booting the same system. No crash. I moved my build boot media to some other systems and tested them: crashes. I tried my boot media built optimized for Cortex-A53 or Cortex-X1C/Cortex-A78C instead of Cortex-A72: no crashes. (But only one system can use the X1C/A78C code in that build.) So variation testing only gets the crashes for my builds that are code-optimized for Cortex-A72's. The same source tree vintage built for cortex-53 or Cortex-X1C/Cortex-A78C optimization does not get the crashes. But I also demonstrated an optmized for Cortex-A72 build from 2023-Mar that gets the crash. The last time I ran into one of these "crashes tied to cortex-a72 code optimization" examples it turned out to be some missing memory-model management code in FreeBSD's USB code. But being lucky enough to help identify a FreeBSD source code problem again seems not that likely. It could easily be a code generation error by clang for all I know. So, unless at some point I produce fairly solid evidence that the code actually running is messed up by FreeBSD source code, this should likely be treated as "blame the operator" and should likely be largely ignored as things are. (Just My Problem, as I want the Cortex-A72 optimized builds.) Sorry for the noise. > I see no recent changes in that module that would be likely to break = initialization. >=20 > a9bfd080d09a if_epair: do not transmit packets that exceed the = interface MTU > 4d846d260e2b spdx: The BSD-2-Clause-FreeBSD identifier is obsolete, = drop -FreeBSD > a6b55ee6be15 net: replace IFF_KNOWSEPOCH with IFF_NEEDSEPOCH > c69ae8419734 if_epair: also remove vlan metadata from mbufs > 29c9b1673305 epair: Remove unneeded includes and sort some of the rest My kyua run examples included a Cortex-A72 optimized system build from last 2023-Mar. It also crashes. It looks like my last kyua runs were back in 2022-Jan or so, associated with some ASAN and UBSAN experiments --and so would have been on amd64, not aarch64. Otherwise any aarch64 ones would be even older. I've no useful narrowing of the potential time frame for the problem starting. =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Sun Jun 25 21:00:54 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Qq3Kg3z4bz4j3W5 for ; Sun, 25 Jun 2023 21:00:55 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Qq3Kg0yG9z40Hg for ; Sun, 25 Jun 2023 21:00:55 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1687726855; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=wzvkgz4XcajUDxtwmdyCuVc7BAK9RVzXgQnkfFFtnBk=; b=uBNZHld5Yj0xfFdISYbM4axNe0URIhpQrSXqCz+IkrTFg7p4iiyS5ZyjoBTbF9o1DjssiI TAN/A78ZW9pGMWhEhNaye5MA96ck1geROd4a+UVz53BrbpzxIet1VmKt2DQ7bZNRTBSAKM l7VAfktDXExS/ilCiol/1nVt9n1SYZtpEnIvU5te9JC7qq0pSaazzxqF3a44FOWvXFCF7m 5oNYo6z7t3+Zc60SSWmO4Xk/J79jkJpulMVUJDlMqg6uzxZAO9ltPx3R3W/uaCXuUtkyqf /29MfXWGlyMgj13BOyYjgulFUuy1FawndeNsjmqvIlofVvXpCO+DoipKe8wzLw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1687726855; a=rsa-sha256; cv=none; b=uhYldolHZOs0PIOF4/qCnDf/AId/beGM2MC01D8kRZAtP0FHgnAS/TW5pTJt34uh5a2eaG 1cS7yxZ1gzTX8Zsp46SsoH6eFz8V5ibnnfjtnC0GUMN8Q25HmwwV/RzfBio9hig7FLLSy9 vSxA7sEaLL/9RAVDI4QwlqixRLo/Eho6Hf+oBV/DEgC2ipNgg+HQvAymTUqLCdFxWjWQEu 1Pp9DpfSNIf3FMnmYmgoMdJ2k3b3vAyKcyNIsL7pS6q+Y9fAm350Rb6ekyHuKCYchyX+K9 I+aMqR+ZNc6+KAT/W9NN20trCPq79DL8/QFyrx6P6bRrQ0oHY5IYSHWu2mlqHg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Qq3Kf6kmhzjR5 for ; Sun, 25 Jun 2023 21:00:54 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 35PL0sLh069050 for ; Sun, 25 Jun 2023 21:00:54 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 35PL0sR0069049 for freebsd-arm@FreeBSD.org; Sun, 25 Jun 2023 21:00:54 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202306252100.35PL0sR0069049@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: freebsd-arm@FreeBSD.org Subject: Problem reports for freebsd-arm@FreeBSD.org that need special attention Date: Sun, 25 Jun 2023 21:00:54 +0000 List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16877268546.28865E7.66237" Content-Transfer-Encoding: 7bit X-ThisMailContainsUnwantedMimeParts: N --16877268546.28865E7.66237 Date: Sun, 25 Jun 2023 21:00:54 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 238576 | Raspberry Pi 3B+ "shutdown -p" does not shut off Open | 257670 | mpr(4): SAS3008 PCI-Express Fusion-MPT SAS-3: Fat 2 problems total for which you should take action. --16877268546.28865E7.66237 Date: Sun, 25 Jun 2023 21:00:54 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    238576 | Raspberry Pi 3B+ "shutdown -p" does not shut off 
Open        |    257670 | mpr(4): SAS3008 PCI-Express Fusion-MPT SAS-3: Fat

2 problems total for which you should take action.
--16877268546.28865E7.66237-- From nobody Mon Jun 26 00:16:09 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Qq7gM0FGJz4hxsK for ; Mon, 26 Jun 2023 00:16:31 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic309-22.consmr.mail.gq1.yahoo.com (sonic309-22.consmr.mail.gq1.yahoo.com [98.137.65.148]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Qq7gK4gtNz460Z for ; Mon, 26 Jun 2023 00:16:29 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=pS+pm3+Q; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.65.148 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1687738587; bh=xtui23EsTEl2m1SoZXyjv1JoKKw2VISGhLDJC8RK2h0=; h=From:Subject:Date:To:References:From:Subject:Reply-To; b=pS+pm3+QfGO8XFM2g3tK0QX1LJEG+ZcwRZ9Shg3eXYF19ampcwnbG9MpJfcHhPQHlscU9dFBpj0zxa+tUVgNm3MTiMTS0g9Oq/m/KYON5ueZSy9OVjm3bjFxzD4UL7bMqPBrONCZC3iLdmqnqy15c+pA7QOEQvUX6fqbj9cTu7WndWZ1ZQk+BxQbR+VvNPdRAqpLhxkWCQ1RhPtE+CQ9WZOP+dH00B5ZcTO0quVRx4tIRraELdbQdbLRe56xEebaBl74vXepGBnTnrHa5RMq+foNPLhyHcF2wbhvxtQzqXtRsdlZiH9+nAqJHte+w/pWtTShvvP/Yv8jZal4V/d2rw== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1687738587; bh=jeZjNfioAz/6CN2eB/OIw6Y7CDuz+72ExyYAtlotNFX=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=Z+sMMJsuTb/I1RMES6TLEf6IK8JgQdlAfqMpePqx2D+ojVbCW3JPtr7ynHpF3pYuMFo2mHwhhJDnKGTMjvpqs88k00YIz79ZbpqO8NBQF+nVAzA+pn7w9VPL0fkZCLm1M7WIiGaCaKqUFYrqYFgwdiIDy5UVRPzcuGemR0hJi6QlWPF3wMZEd+RGNLxaCzARBfEhVS5avN5ADhjB7FDaVVy9GhrDVW3IjRoJV9WUIYnES9jcxsoUJx7zRxQftsp2O6fKri9EQYdgwnhsNc3ZpF66McIUyqvEGvvBGjQc6Jy0SE02CVkwB7zKHVQaq5YTQgsAKRWYdQ/jL7j8Z4bN0g== X-YMail-OSG: 3FRuPPEVM1mzC8vKArT89_gQQIxV3EjP6bnaVfmSlWNeJIaAhlsDN2fRRGEgBeP uC7u35ACA93bx2k45mXFl6JkO9utvpKRvd4s7_rtEobTjOheE6m_QwBRO4dBc9W66BU3wtH7zbTl fejIo.eixAzZ1miOgCwzKe4SqPJgNWdcem0SBZF.mL.OwcILSoOzYPbiNASoat_4X5zy4.7DyLKt PJ5Jp.3YyYQtvOXJVBk7b4qAfQRDKo7fAs2xGNuYa07TtrO7nCJG2B4l0qCOU.N8jeipglIicj.U _oSsjsHzXhgJXewGwLAjOLkK839_qYdBxQSx70lMhiuQ0_mXjAx.DIWI2SsoK5zvRfOVmPztmCAQ 8mWiDDzn6ef736f1xdITe9DNdH.BN6.nd.6grpp9a4Ds3Kh5G_ArBvg2d0h70bppe8s.qGW0.gT4 zKoXCSa0.kK.mMKTm9zlNVtfIvtGNuXoGn1rBRYAQw8dt2L120tUtpYt0ATr_xwM_c5mnEjMpC7K Vo.CWnqP0Vm4DUCk8bfJg7OZnDcPH9p_v..0CZhEMYV5tEJZAJq3a4tIzZZ5aNoNR_m4yZY46ZDu 0lToANHUupqE03GgSDAkvr1qsVDNDyk0Zx6IhTRe7zsQ2GGxvoqQ3yVO1.j62QrRyR_bcP4qC2mW D2OuXNxO0kZfSuuYJ.1C5sCnVgUuDdivw_WLEz1QottBQyna0T8XgyKZL9bADd4zWftwiRLgK3C7 2ACcYhUgRQ70kLTWn3zm_ioRASD1X5jSehunQ8jj.B4um9W0XbbaNWZs3acb6gddDjKpQFKc_QSA uJJUDh4gAwmhyyTp8BEqm_Ypx7oudRgTKuW3fYawZDQr9Qgzk8CUJG4Pf3Nj19R_1gy6U0KLG_4w IZvS8VlSXB42OGZ.fAwViL2hgolgTFIG2ZTiB2ptMETsa.oo2km.xoBOaMWjg6rKGE2AgaqDRPXH Ci6YYyAnni76XhGzWQa90fqz7zrKIaIM2456Ay54_yOgTEGNPsYIwYR8V_JuqeHYH9pnCPVzTU49 cjDj6JQcntqvdT0RVej_wh009fCIlic1jqbHERnx_ElL1GQBMBtxp_qHoeeTrJ_7jrBk2H4ppULZ MG7xpx1MmKnGEnWbh.pu5Aa0.mN4jqSXL4FYfn1BHJVGEuoYU1pWctcy.yKLCqeSioyWC66cqZmK InfOFTtWgDibML46G7tWKJ_Xa7QYVtMGTD_v3.4XUbmu.2mKO2U5yoRIZmvXyosZOU0IqaMsWjnQ 3JDPT0PO7YzDW9zDb1nPEjhzoayJ2ju8NVz.gEtpsbPD04jajzWXRCt9PiItse2BtN3LGRC0yK1I EjoGoKABvl8O8fdkJbXwrQDApIWPnwd4cyEA3n0CYQO6V4yp71vl9oOqoPVjnCeW5hNZ8bWWhZdE noW_wE_mDX.V0MRvcl4mtmhSjm0vW78YXvz5o2OptVo12Pi7mCNFd9zvq9coSd_SYOsyVoHmhmol 5ZN.R0OxlLwzfBAIdc0VVFDf5gaCL6c2_EeXnOhC0cNTR3XHozTH5_RyUo.jGZsiSwJ5INastg7J UVWS3v3BAfz1GcV2WEbO2bG.M4d0sekePxpDTo__HVF.kIqghP47zbPwYzDzr.cboO1pxmDPo1ny ZGMXgBNP5iFeUUnPSEEdyZLB2bqhFU_9bLkbISv5mUQINvjnDQYJLtb.7P7vQPWXInWmuPYenpS7 Fr34LQYHuWcHgNT5ACdXJ92rGcM.G9cMxrJT0AbBjJqkRzZOZdUe7cVR2BxTWuXVNh55CECRw5HU aB7sN9G6UtfJ0XIBG2bctyN0yQzJ6q.Wz9aYf6LOLwBbGsTaijIoQRTpsHKW_MJ.dgutcB6wNuRj 78P1CG3BjiU_OqP_ifFNooXrfhXv_tx72WpPn5Zu8uN_v_Yqp3b0bRfY2NZiRe0ft.NH4X0ByHPj CrkvjBLDFhegc0kJ94lEBcsX6Hb_CVlqQ0ERDt0eYkBvFHAzoVsu9Q2QH0vZO6p7P.fSvSP7tiEy rCFSkMi1yZ0lgLjLuAx4pfVhJO_YTMmHG6IIoeMW9glVevP5y5Mr1x8z00GeluGbbc5AZt.JFz1S gC.duKLX5CEm5b3XOIESGtxJlXpJ7o_gCM5M88nyYYnCrHl2pej_fFmw8.UXJsuyqMkmdKKQdz.M jRBTpRb6uK0CwooI7k.T.l6golCYaKv2.UmPRkx2O7R6.pqnfsPDvjOUvusngwyppQ3eJ3LzPfvb .wqgygF5_eotV3HSCP1OdGFKgUT.C1rDJjqcXNTC8WaKWx_cXcy1qZkCafGN_ASqzM2q77D1MjDb zxg-- X-Sonic-MF: X-Sonic-ID: 3b1454df-8019-4a08-a510-c1aaad7b0863 Received: from sonic.gate.mail.ne1.yahoo.com by sonic309.consmr.mail.gq1.yahoo.com with HTTP; Mon, 26 Jun 2023 00:16:27 +0000 Received: by hermes--production-ne1-574d4b7954-bq277 (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 6055e03e7599a8ccf2626d81bf317192; Mon, 26 Jun 2023 00:16:21 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.600.7\)) Subject: For snapshot builds: armv7 chroot on aarch64 has kyua test -k /usr/tests/Kyuafile sys/kern/kern_copyin hung up [in getpid?], unkillable, prevents reboot Message-Id: <7A41DED4-876F-4270-A980-549A4832B39A@yahoo.com> Date: Sun, 25 Jun 2023 17:16:09 -0700 To: Current FreeBSD , freebsd-arm X-Mailer: Apple Mail (2.3731.600.7) References: <7A41DED4-876F-4270-A980-549A4832B39A.ref@yahoo.com> X-Spamd-Result: default: False [-3.20 / 15.00]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-0.98)[-0.984]; NEURAL_HAM_LONG(-0.72)[-0.717]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; TO_MATCH_ENVRCPT_SOME(0.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.148:from]; SUBJECT_HAS_QUESTION(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MLMMJ_DEST(0.00)[freebsd-arm@freebsd.org]; TO_DN_ALL(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; FREEMAIL_FROM(0.00)[yahoo.com]; MID_RHS_MATCH_FROM(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; FROM_EQ_ENVFROM(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.148:from] X-Rspamd-Queue-Id: 4Qq7gK4gtNz460Z X-Spamd-Bar: --- X-ThisMailContainsUnwantedMimeParts: N Using the likes of: = FreeBSD-14.0-CURRENT-arm64-aarch64-ROCK64-20230622-b95d2237af40-263748.img= and: = FreeBSD-14.0-CURRENT-arm-armv7-GENERICSD-20230622-b95d2237af40-263748.img I have shown the following behavior after setting up storage media based on them. (This was a test that my builds were not odd for the issue.) Boot the aarch64 media and log in. (Note: I logged in as root.) mount the armv7 media (-noatime is just my habit) and then put it to use: # mount -onoatime /dev/da1s2a /mnt # chroot /mnt/ # kyua test -k /usr/tests/Kyuafile sys/kern/kern_copyin sys/kern/kern_copyin:kern_copyin -> =20 On the serial console: # ps -xu USER PID %CPU %MEM VSZ RSS TT STAT STARTED TIME COMMAND root 11 1498.4 0.0 0 256 - RNL 23:24 542:52.92 [idle] root 1174 100.0 0.0 0 16 - Rs 23:37 0:00.00 = /usr/tests/sys/kern/kern_copyin -vunprivileged-user=3Dtests = -r/tmp/kyua.9YUttj/2/result.atf kern_copyin root 0 0.0 0.0 0 1616 - DLs 23:24 0:00.50 [kernel] root 1 0.0 0.0 11704 1288 - ILs 23:24 0:00.02 /sbin/init root 2 0.0 0.0 0 256 - WL 23:24 0:00.26 [clock] root 3 0.0 0.0 0 272 - DL 23:24 0:00.00 [crypto] root 4 0.0 0.0 0 80 - DL 23:24 0:00.95 [cam] root 5 0.0 0.0 0 16 - DL 23:24 0:00.00 [busdma] root 6 0.0 0.0 0 16 - DL 23:24 0:00.03 = [rand_harvestq] root 7 0.0 0.0 0 48 - DL 23:24 0:00.06 [pagedaemon] root 8 0.0 0.0 0 16 - DL 23:24 0:00.00 [vmdaemon] root 9 0.0 0.0 0 160 - DL 23:24 0:00.38 [bufdaemon] root 10 0.0 0.0 0 16 - DL 23:24 0:00.00 [audit] root 12 0.0 0.0 0 880 - WL 23:24 0:11.81 [intr] root 13 0.0 0.0 0 48 - DL 23:24 0:00.04 [geom] root 14 0.0 0.0 0 16 - DL 23:24 0:00.00 [sequencer = 00] root 15 0.0 0.0 0 160 - DL 23:24 0:06.42 [usb] root 16 0.0 0.0 0 16 - DL 23:24 0:00.10 = [acpi_thermal] root 17 0.0 0.0 0 16 - DL 23:24 0:00.00 = [acpi_cooling0] root 18 0.0 0.0 0 16 - DL 23:24 0:00.04 [syncer] root 19 0.0 0.0 0 16 - DL 23:24 0:00.00 [vnlru] root 671 0.0 0.0 13260 2600 - Is 23:25 0:00.00 dhclient: = system.syslog (dhclient) root 674 0.0 0.0 13260 2752 - Is 23:25 0:00.00 dhclient: = dpni0 [priv] (dhclient) root 761 0.0 0.0 14572 3972 - Ss 23:25 0:00.02 /sbin/devd root 964 0.0 0.0 12832 2764 - Is 23:25 0:00.02 = /usr/sbin/syslogd -s root 1033 0.0 0.0 13012 2604 - Ss 23:25 0:00.01 = /usr/sbin/cron -s root 1058 0.0 0.0 21052 8308 - Is 23:25 0:00.01 sshd: = /usr/sbin/sshd [listener] 0 of 10-100 startups (sshd) root 1078 0.0 0.0 21288 9304 - Is 23:26 0:00.09 sshd: = root@pts/0 (sshd) root 1175 0.0 0.0 21288 9496 - Is 23:37 0:00.04 sshd: = root@pts/1 (sshd) root 1074 0.0 0.0 13380 3008 u0 Is 23:25 0:00.01 login [pam] = (login) root 1075 0.0 0.0 13460 3292 u0 S 23:25 0:00.02 -sh (sh) root 1233 0.0 0.0 13588 3016 u0 R+ 00:00 0:00.00 ps -xu root 1081 0.0 0.0 13460 3328 0 Is 23:26 0:00.02 -sh (sh) root 1170 0.0 0.0 5788 2884 0 I 23:36 0:00.02 /bin/sh -i root 1172 0.0 0.0 10408 7192 0 I+ 23:37 0:00.30 kyua test -k = /usr/tests/Kyuafile sys/kern/kern_copyin root 1178 0.0 0.0 13460 3320 1 Is+ 23:38 0:00.01 -sh (sh) 1174 is stuck, even if one waits for 30min+. kill and kill -9 will not kill 1174. "shutdown -r now" hangs before the reboot happens and reports: "some processes would not die". An interesting property is that ps and top disagree about 1174 CPU usage: ps 100%, top 0%. But top also indicates 1174 always has CPU0 "STATE". (Across tests CPUn varies but within a test it has a fixed n.) I have also seen ps "STAT" being RXs. The following is from my earlier activity with my own builds involved, here 1119, not the 1174 from above. truss reports as the last thing for the stuck process as "getpid()". . . . 1119: 0.588983953 fstatat(AT_FDCWD,"/usr/tests/sys/kern/kern_copyin",{ = mode=3D-r-xr-xr-x ,inode=3D111756,size=3D9776,blksize=3D10240 = },AT_SYMLINK_NOFOLLOW) =3D 0 (0x0) 1119: 0.589065030 = mmap(0x0,20480,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON|MAP_ALIGNED(12),-= 1,0x0) =3D 1074188288 (0x4006d000) 1119: 0.589227544 = openat(AT_FDCWD,"/tmp/kyua.aBQv6E/2/result.atf",O_WRONLY|O_CREAT|O_TRUNC,0= 644) =3D 3 (0x3) 1119: 0.589276503 getpid() =3D 1119 (0x45f) For reference, from inside an armv7 chroot session before doing such a test: # uname -apKU FreeBSD generic 14.0-CURRENT FreeBSD 14.0-CURRENT #0 = main-n263748-b95d2237af40: Thu Jun 22 11:10:50 UTC 2023 = root@releng1.nyi.freebsd.org:/usr/obj/usr/src/arm64.aarch64/sys/GENERIC = arm armv7 1400090 1400090 =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Mon Jun 26 08:32:03 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4QqLgR2L3Fz4jsyc for ; Mon, 26 Jun 2023 08:32:19 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic313-21.consmr.mail.gq1.yahoo.com (sonic313-21.consmr.mail.gq1.yahoo.com [98.137.65.84]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4QqLgQ1LXqz455r for ; Mon, 26 Jun 2023 08:32:18 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=WqOTVZve; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.65.84 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1687768335; bh=OoeAj94wbT/zS0bI3st+o4bYBZqT9a1V976NRb0CHmk=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=WqOTVZvekuO/f4SQBa2+3hg4UlcaRVCGvq9f8mJezv8a6Z+Q6vKuRcDfHYp++MwBM3P0CAdvrQLKMmrhEGuNzoiZx4dV6em/kjALT0aekFth+oFl/Zt1wxxItEaY7OQilt1o4DDCwJByGu1KYjEiLIKZKwZmIQotcqNs7Iw/4mQUhQzvaFR8Pdm0SpiElVfeQCneVHr9HliYH6Ffy+b3MKhuz6Ys5sR9Lft+eMFQ+1K+lnigE2zLnohmeergtikAexHDT4dMpRQQkVg47SForQw5fKlKGsVvAoa34FQEqBJ8yJL1hBcN/FDGg3yVWEnNYe0poOh9OoukxiEpBDhGfA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1687768335; bh=JSMPRw2eP06k342XHLJl8zVCgJoJmauBlIQrEeUUZ+3=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=OI593rr7KE5iovPIrETD+fQGJJqf7eWk96tiFXSmbAID5bHjBwkS3S7dlIC+r254TKD3geF1XKcgJqvzie5fXEODJydcmaMHhyUx7noNmN9eVrgeeQriM9e4MzqQtG21K0CR/IWucGz3uvH+Anr8Hzgm8hFThEZlH2T1UlmB9HX7Usa6R1nln6nd6Gxv9oB7NjZAm22EIsXmTCThHzfhYh78qef0Rj3wfjxOEkmrBp/7wrtlcdTb81NcuG5eM2cu+TSOAGKEK5Yi5D9b+sgKc6u9NA1OnP5KEQV+tFdTKawtdrR2Lx0v2tEZBltCRrVxF4/wPFCGmoD4tyS4bHX0Xw== X-YMail-OSG: K6Sgd.4VM1nBp_RKH6YuKSo2t.JLgeSS04OHV_S7Mt3CUX6CPM_RmTgP_EgyO36 eocoScVC29fFutx02V73WEtU21VgEW7vqWUTXX6qcgUujOkDitMS.fRIj4hFOvPrcYeGY24mNrKE ZSQiEjcpX4Oik0701Lx0Yz_Mms7Jf4a55QwUWisAXh8jvJcOOh_o9oBnvfld6L141zb47f4bshaI aJ4HmvN8_2kKnMp0FFngGjdbTzHTAS2bJiaYQZdKU9j_JpSOsevERixCryoWwLTvbFx88C.OQckz mv0t418fAAP3QzOIwO1pDxzqQkeZH86_IGQKwrb4uEmArbxZhNY1wFDSxnoR4I.rVunGhNoXB72X qo9zs2oZX6TfNjK.aM5LThBr5AOekEvxlB8Q0aTUnKnPsl6F6_oho8RwTwdPf2oi60Kak.G0ohEX odtzpAHezGRY1LdG_LxRKa_MFgwKRNuxDPOSGJzErsxhxWybz72guHotOOmsaDPrEh1x45mEuoK6 Bhng_tCQK6ZviSyhQOskRhPbrpIxPeB6PuAJup6zPuObUt3zrFfGhiYtabwEJjSdyGaDWhjPZcBs 9nsstaNnZjUI6I2fnW1WcaFyPTQ_th4dQ4ixoT8lABOnGL_DJU74bwYnyvKvIgi_5nXJs7V2nWv_ DXk4yVsIGHVk2VmVKG6Gu3_Hooy3rFN1fsH8E9s4JgQGH4hC44cG5x_dLtnfQlmgJfpX_qGgCpOE fnuf.oQmxI31DTRUS7Ag7op2kIom8NKabpa4ODoIN.M4RX.PIw3sZHgWKFjvRHkqhDwCDN0RkXi5 u3O6DWOkd25VRQ3.NSs5POZwtrjGnEhm6nDTxZkVo4k1RvqO6D5mkRe1XpP5IK45shHIhdEt2HQa ON6M1L4.SRg5.E1LGT8rsCLYMAFjnWakRa_ob.4BP97kL8mxo3.jSyJqwKxwhGfdidTqR49.Z.8j Jet2lE9Nvy4pJh_Jcebp8JnGyXyU6JfDvBb2UmwAmoCjS0vcj_8eoP7ImrQSUHN.V9i5e6YFWN2D tMKmEIfybd_s0OELEjVWzXtF79bKICyOeghCSd.WRZ4r1G6Bq1jk0XL0io42x0EEFLr9FVtGNv3H p4xbaFzsu6cXGhEeWCm8EoPu5UNnhpF7ypRDc2httWV8MRy9C7qD7HvaYn60Cp0tko98owPhyxZ4 pQdBhCoiB7SO2.Z0vmfjvgvJBJqn0Nie.HSRBFLJilToLioUTuuKTIP0.nLKh1_ygWc5gs1NW01Y GV6uEP31y.oNR_r92mYzvFUjQTdJOULSmTZZ_h7GEgUxxMFiHcahRG0c6j.jo8_ZoFJG853h0nvZ 74yUCZrQY44IOEJ5K6O2QyDL5pQx1qNMKbuWCyTGcnTp3GiTF6kI0v79H8_huEm60l9Dt0SL6AwZ bsAsgXeC_ksM_YsVy0oXj6v9myYxpC1UkmQ5Lsx2EPW0LpTx41yDnQ2T0IkEqkbbBATUOezosKlh 2AgtFFJFQfOPCLLSmFeGHBt.GxGwRhkFTAJn0L4D6odtNNfRoIU1ST1mCzdIn3IOsFJN1H5eTNLI XvL4VmOjUWhDPIyhQLOmOY6DmsQQiho_mCwZwp9moybm9FDYMiwZpmqZ.ozUcmlmtwyJOY8iX4BJ X3RuubTc.Pa6c_eQv6DT9GkfFdl97y_uxg8YEwQHKhS_ifVjKAf2f0D0_Q86O4ylJyFp9s0jFyvH MeAYjUJ2KC4TPtr4MOTu9wpc8aRE2c71Aq9bufj_bY5.KJ0cZ6UqmHGJx.Nm_KDitMx_JtDm1Vy. rwYeYIV3KP842vmCOpp33Q.TbAwpm2uvlFePnb3iqCHf0HbI3ZFNngyq8cajhktLOanHGd6gErg9 O7J2m8xdsl7zB_UyxE0ElhUEIR_GrmrGIR51IQzHecXmGb7L_ONvaCEL2SPHBAGKyy6WQk0rhey7 C_Bn6l1YTrBDNUwBc_KrqtdCZ761mhKkz3SAWAyBXfRpmUNh_G2fDa3cCEt_ndtlaiYEpWrT06n_ u9uHHQnmNQ2pERG14hJYsmbstdtxLwlfHpxgNHz.fFkax2S5bRwu0ifjf9nG02wOqW4a1z.iBPLz pquj4VJE1fOTmdyExvM_y7Vlq.vxeeaShc15UCMUz_l3MJTpZoeQ26pmE.re3Q0WIo3_m2gT1tTB 1AM6fQlV15uX5_GUW5nHv_ulFbIialsYLgGb5qkeHRXykXcbhZpnZb7Nxttirkb4_ZVAA26_0kHO .mrzOmdtrXI8uEUK4H61a0FDyITzCRbKy.rI9kuKmvpl_CdoMmpOrIZuLPp76ILBWwcYXAP8- X-Sonic-MF: X-Sonic-ID: a4fd8e93-72ab-4c90-8358-0224aaaf109a Received: from sonic.gate.mail.ne1.yahoo.com by sonic313.consmr.mail.gq1.yahoo.com with HTTP; Mon, 26 Jun 2023 08:32:15 +0000 Received: by hermes--production-gq1-6db989bfb-jqsjz (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID dc9e0481b93b31d6754aa9d9bd11fd48; Mon, 26 Jun 2023 08:32:14 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.600.7\)) Subject: Re: aarch64 main-n263493-4e8d558c9d1c-dirty (so: 2023-Jun-10) Kyuafile run: "Fatal data abort" crash during vnet_register_sysinit From: Mark Millard In-Reply-To: <4A380699-7C9E-4E2E-8DCD-F9ECC2112667@yahoo.com> Date: Mon, 26 Jun 2023 01:32:03 -0700 Cc: Current FreeBSD , freebsd-arm Content-Transfer-Encoding: quoted-printable Message-Id: <64F18C76-BD2A-4608-A8CC-38AC2820FC12@yahoo.com> References: <3FD359F8-CFCC-400F-B6DE-B635B747DE7F.ref@yahoo.com> <3FD359F8-CFCC-400F-B6DE-B635B747DE7F@yahoo.com> <4A380699-7C9E-4E2E-8DCD-F9ECC2112667@yahoo.com> To: John F Carr X-Mailer: Apple Mail (2.3731.600.7) X-Spamd-Result: default: False [-3.44 / 15.00]; NEURAL_HAM_SHORT(-0.98)[-0.985]; NEURAL_HAM_LONG(-0.98)[-0.983]; NEURAL_HAM_MEDIUM(-0.98)[-0.976]; MV_CASE(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; ARC_NA(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.84:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; RCVD_TLS_LAST(0.00)[]; MLMMJ_DEST(0.00)[freebsd-arm@freebsd.org]; TO_DN_ALL(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; FREEMAIL_FROM(0.00)[yahoo.com]; MID_RHS_MATCH_FROM(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.84:from] X-Rspamd-Queue-Id: 4QqLgQ1LXqz455r X-Spamd-Bar: --- X-ThisMailContainsUnwantedMimeParts: N On Jun 24, 2023, at 17:25, Mark Millard wrote: > On Jun 24, 2023, at 14:26, John F Carr wrote: >=20 >>=20 >>> On Jun 24, 2023, at 13:00, Mark Millard wrote: >>>=20 >>> The running system build is a non-debug build (but >>> with symbols not stripped). >>>=20 >>> The HoneyComb's console log shows: >>>=20 >>> . . . >>> GEOM_STRIPE: Device stripe.IMfBZr destroyed. >>> GEOM_NOP: Device md0.nop created. >>> g_vfs_done():md0.nop[READ(offset=3D5885952, length=3D8192)]error =3D = 5 >>> GEOM_NOP: Device md0.nop removed. >>> GEOM_NOP: Device md0.nop created. >>> g_vfs_done():md0.nop[READ(offset=3D5935104, length=3D4096)]error =3D = 5 >>> g_vfs_done():md0.nop[READ(offset=3D5935104, length=3D4096)]error =3D = 5 >>> GEOM_NOP: Device md0.nop removed. >>> GEOM_NOP: Device md0.nop created. >>> GEOM_NOP: Device md0.nop removed. >>> Fatal data abort: >>> x0: ffffa02506e64400 >>> x1: ffff0001ea401880 (g_raid3_post_sync + 3a145f8) >>> x2: 4b >>> x3: a343932b0b22fb30 >>> x4: 0 >>> x5: 3310b0d062d0e1d >>> x6: 1d0e2d060d0b3103 >>> x7: 0 >>> x8: ea325df8 >>> x9: ffff0001eec946d0 ($d.6 + 0) >>> x10: ffff0001ea401880 (g_raid3_post_sync + 3a145f8) >>> x11: 0 >>> x12: 0 >>> x13: ffff000000cd8960 (lock_class_mtx_sleep + 0) >>> x14: 0 >>> x15: ffffa02506e64405 >>> x16: ffff0001eec94860 (_DYNAMIC + 160) >>> x17: ffff00000063a450 (ifc_attach_cloner + 0) >>> x18: ffff0001eb290400 (g_raid3_post_sync + 48a3178) >>> x19: ffff0001eec94600 (vnet_epair_init_vnet_init + 0) >>> x20: ffff000000fa5b68 (vnet_sysinit_sxlock + 18) >>> x21: ffff000000d8e000 (sdt_vfs_vop_vop_spare4_return + 0) >>> x22: ffff000000d8e000 (sdt_vfs_vop_vop_spare4_return + 0) >>> x23: ffffa0000042e500 >>> x24: ffffa0000042e500 >>> x25: ffff000000ce0788 (linker_lookup_set_desc + 0) >>> x26: ffffa0203cdef780 >>> x27: ffff0001eec94698 (__set_sysinit_set_sym_if_epairmodule_sys_init = + 0) >>> x28: ffff000000d8e000 (sdt_vfs_vop_vop_spare4_return + 0) >>> x29: ffff0001eb290430 (g_raid3_post_sync + 48a31a8) >>> sp: ffff0001eb290400 >>> lr: ffff0001eec82a4c ($x.1 + 3c) >>> elr: ffff0001eec82a60 ($x.1 + 50) >>> spsr: 60000045 >>> far: ffff0002d8fba4c8 >>> esr: 96000046 >>> panic: vm_fault failed: ffff0001eec82a60 error 1 >>> cpuid =3D 14 >>> time =3D 1687625470 >>> KDB: stack backtrace: >>> db_trace_self() at db_trace_self >>> db_trace_self_wrapper() at db_trace_self_wrapper+0x30 >>> vpanic() at vpanic+0x13c >>> panic() at panic+0x44 >>> data_abort() at data_abort+0x2fc >>> handle_el1h_sync() at handle_el1h_sync+0x14 >>> --- exception, esr 0x96000046 >>> $x.1() at $x.1+0x50 >>> vnet_register_sysinit() at vnet_register_sysinit+0x114 >>> linker_load_module() at linker_load_module+0xae4 >>> kern_kldload() at kern_kldload+0xfc >>> sys_kldload() at sys_kldload+0x60 >>> do_el0_sync() at do_el0_sync+0x608 >>> handle_el0_sync() at handle_el0_sync+0x44 >>> --- exception, esr 0x56000000 >>> KDB: enter: panic >>> [ thread pid 70419 tid 101003 ] >>> Stopped at kdb_enter+0x44: str xzr, [x19, #3200] >>> db>=20 >>=20 >> The failure appears to be initializing module if_epair. >=20 > Yep: trying: >=20 > # kldload if_epair.ko >=20 > was enough to cause the crash. (Just a HoneyComb context at > that point.) >=20 > I tried media dd'd from the recent main snapshot, booting the > same system. No crash. I moved my build boot media to some > other systems and tested them: crashes. I tried my boot media > built optimized for Cortex-A53 or Cortex-X1C/Cortex-A78C > instead of Cortex-A72: no crashes. (But only one system can > use the X1C/A78C code in that build.) >=20 > So variation testing only gets the crashes for my builds > that are code-optimized for Cortex-A72's. The same source > tree vintage built for cortex-53 or Cortex-X1C/Cortex-A78C > optimization does not get the crashes. But I also > demonstrated an optmized for Cortex-A72 build from 2023-Mar > that gets the crash. >=20 > The last time I ran into one of these "crashes tied to > cortex-a72 code optimization" examples it turned out to be > some missing memory-model management code in FreeBSD's USB > code. But being lucky enough to help identify a FreeBSD > source code problem again seems not that likely. It could > easily be a code generation error by clang for all I know. >=20 > So, unless at some point I produce fairly solid evidence > that the code actually running is messed up by FreeBSD > source code, this should likely be treated as "blame the > operator" and should likely be largely ignored as things > are. (Just My Problem, as I want the Cortex-A72 optimized > builds.) Turns out that the source code in question is the assignment to V_epair_cloner below: static void vnet_epair_init(const void *unused __unused) { struct if_clone_addreq req =3D { .match_f =3D epair_clone_match, .create_f =3D epair_clone_create, .destroy_f =3D epair_clone_destroy, }; V_epair_cloner =3D ifc_attach_cloner(epairname, &req); } VNET_SYSINIT(vnet_epair_init, SI_SUB_PSEUDO, SI_ORDER_ANY, vnet_epair_init, NULL); Example code when not optimizing for the Cortex-A72: 11a4c: d0000089 adrp x9, 0x23000 11a50: f9400248 ldr x8, [x18] 11a54: f942c508 ldr x8, [x8, #1416] 11a58: f943d929 ldr x9, [x9, #1968] 11a5c: a9437bfd ldp x29, x30, [sp, #48] 11a60: f9401508 ldr x8, [x8, #40] 11a64: f8296900 str x0, [x8, x9] The code when optmizing for the Cortex-A72: 11a4c: f9400248 ldr x8, [x18] 11a50: f942c508 ldr x8, [x8, #1416] 11a54: d503201f nop 11a58: 1008e3c9 adr x9, #72824 11a5c: f9401508 ldr x8, [x8, #40] 11a60: f8296900 str x0, [x8, x9] 11a64: a9437bfd ldp x29, x30, [sp, #48] It is the "str x0, [x8, x9]" that vm_fault's for the optimized code. So: 11a4c: d0000089 adrp x9, 0x23000 11a58: f943d929 ldr x9, [x9, #1968] was optimized via replacement by: 11a58: 1008e3c9 adr x9, #72824 I.e., the optimization is based on the offset from the instruction being fixed in order to produce the value in x9, even if the instruction is relocated. This resulted in the specific x9 value shown in the x8/x9 pair: x8: ea325df8 x9: ffff0001eec946d0 which total's to the fault address (value in far): far: ffff0002d8fba4c8 > Sorry for the noise. >=20 >> I see no recent changes in that module that would be likely to break = initialization. >>=20 >> a9bfd080d09a if_epair: do not transmit packets that exceed the = interface MTU >> 4d846d260e2b spdx: The BSD-2-Clause-FreeBSD identifier is obsolete, = drop -FreeBSD >> a6b55ee6be15 net: replace IFF_KNOWSEPOCH with IFF_NEEDSEPOCH >> c69ae8419734 if_epair: also remove vlan metadata from mbufs >> 29c9b1673305 epair: Remove unneeded includes and sort some of the = rest >=20 > My kyua run examples included a Cortex-A72 optimized system build > from last 2023-Mar. It also crashes. It looks like my last kyua > runs were back in 2022-Jan or so, associated with some ASAN and > UBSAN experiments --and so would have been on amd64, not aarch64. > Otherwise any aarch64 ones would be even older. I've no useful > narrowing of the potential time frame for the problem starting. =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Mon Jun 26 14:29:04 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4QqVc009gkz4kGGd for ; Mon, 26 Jun 2023 14:29:52 +0000 (UTC) (envelope-from jfc@mit.edu) Received: from outgoing-exchange-5.mit.edu (outgoing-exchange-5.mit.edu [18.9.28.59]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.outgoing-exchange.mit.edu", Issuer "InCommon RSA Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4QqVbz6jR3z4GJl for ; Mon, 26 Jun 2023 14:29:51 +0000 (UTC) (envelope-from jfc@mit.edu) Authentication-Results: mx1.freebsd.org; none Received: from oc11exedge2.exchange.mit.edu (OC11EXEDGE2.EXCHANGE.MIT.EDU [18.9.3.18]) by outgoing-exchange-5.mit.edu (8.14.7/8.12.4) with ESMTP id 35QETcvN018300; Mon, 26 Jun 2023 10:29:48 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=mit.edu; s=outgoing; t=1687789788; bh=n1eeb31OuVcsDZa2KeMH/0oqPoCT3A0oHSOg+LvOMYg=; h=From:To:CC:Subject:Date:References:In-Reply-To; b=M3jx0NPkTxw66NbYeoy4bp1we81kJLKUBVv0tIg2Zhs2rqNNfAmHNkqNsNkdyS8Mr qzn7JNPVq0Do9w5VjjibVay/t0oReayywcMBi5gvKlCRuf1ZfW+szdpVCsSylY8iiP Uam8MU5YzG1BkkG3+YJbj0VSMPvWIgySbK99GVwFF8wdkdkp5uilS5EJxxjkSkozBQ hpD2un9J/pTp19DaZmitIhiycdPNZlpysHv2d7IntwOAghBc7CN8Gd2PIKq4wjSa/l YaPTIlKsaNov5Dko2hR/iH9XPzj4ie2DjhwRb0dP9TzaLO1w6br8rv6lE/mVj+s6Ox chhL+UIlxHCww== Received: from oc11expo23.exchange.mit.edu (18.9.4.88) by oc11exedge2.exchange.mit.edu (18.9.3.18) with Microsoft SMTP Server (TLS) id 15.0.1497.48; Mon, 26 Jun 2023 10:28:50 -0400 Received: from oc11exhyb1.exchange.mit.edu (18.9.1.60) by oc11expo23.exchange.mit.edu (18.9.4.88) with Microsoft SMTP Server (TLS) id 15.0.1497.42; Mon, 26 Jun 2023 10:29:06 -0400 Received: from NAM10-DM6-obe.outbound.protection.outlook.com (104.47.58.109) by oc11exhyb1.exchange.mit.edu (18.9.1.60) with Microsoft SMTP Server (TLS) id 15.0.1497.48 via Frontend Transport; Mon, 26 Jun 2023 10:29:06 -0400 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=m10dDsKVRnML9S689kNbK+SQigwPzF5fN4t750CtAT1A3HkLqWVo+tiTARyfWsYmQnaJWJKXsoFK5YXgGNU2y46XSS5y/UPac/8CGeR8wwEXXdaeKEdoOhF+G3/XymrbWkQqrEQrXfoNC2cGOUbMY7yydnlaQ/3gdwmgGVFBS1cJYjqJGNgHg9ehlM4narur8LQKMkJxEvdHozVQp9xDFQfPGIrXwL/tevCRAYT4rEa1RZtxLNEzsAAnbmjGhKAKlAeR86uS2F7KdawnJa+pAKlluPQC8s1p/w02adj+CKodLsWA34KaASlhLo7Tp5oYwKS18eSkqBl6EWsZznqokw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=n1eeb31OuVcsDZa2KeMH/0oqPoCT3A0oHSOg+LvOMYg=; b=GSBEZBKFtP2KAWfQ+vYbCcGJJh3HLzcVKtFTNEe735rwU0Ajhc66CZD1nyyAwMerqwxJ5wE5gJu21u353C2VpFtPvw/c8FKss28JWLQW/5DGrxNeB+P3M4qsIIARUHhV/fo0BSZ0XvEpPAsF0mi2qqYSo6qLix6YPZHGRczn7bRoBogxY9qa5sWnT9spRcfq55/BkrFUcFpyARzr2epQVgYLlohDen/2Wm0BNDgv8k9+jrx+S04dH3ww8aH6VdSun/AFXinMCLgpP9IIzBMfzMjefM+Lm5gfkWXcu5qKYfQBN0tG4Fns/jy9t8DfTP5VEanfZBRYbagAOYUiDxgAUw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=mit.edu; dmarc=pass action=none header.from=mit.edu; dkim=pass header.d=mit.edu; arc=none Received: from DS7PR01MB7712.prod.exchangelabs.com (2603:10b6:8:7b::17) by MW4PR01MB6388.prod.exchangelabs.com (2603:10b6:303:7f::14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6521.24; Mon, 26 Jun 2023 14:29:04 +0000 Received: from DS7PR01MB7712.prod.exchangelabs.com ([fe80::5d78:4464:66e8:94a9]) by DS7PR01MB7712.prod.exchangelabs.com ([fe80::5d78:4464:66e8:94a9%7]) with mapi id 15.20.6521.024; Mon, 26 Jun 2023 14:29:04 +0000 From: John F Carr To: Mark Millard CC: Current FreeBSD , freebsd-arm Subject: Re: aarch64 main-n263493-4e8d558c9d1c-dirty (so: 2023-Jun-10) Kyuafile run: "Fatal data abort" crash during vnet_register_sysinit Thread-Topic: aarch64 main-n263493-4e8d558c9d1c-dirty (so: 2023-Jun-10) Kyuafile run: "Fatal data abort" crash during vnet_register_sysinit Thread-Index: AQHZpr1rzd2h1E+wcEelf+6QGJgaxK+ad6YAgAAx/YCAAho/gIAAY7OA Date: Mon, 26 Jun 2023 14:29:04 +0000 Message-ID: <2E9684B7-9359-4A3D-A0C2-C1D2B221F2C4@mit.edu> References: <3FD359F8-CFCC-400F-B6DE-B635B747DE7F.ref@yahoo.com> <3FD359F8-CFCC-400F-B6DE-B635B747DE7F@yahoo.com> <4A380699-7C9E-4E2E-8DCD-F9ECC2112667@yahoo.com> <64F18C76-BD2A-4608-A8CC-38AC2820FC12@yahoo.com> In-Reply-To: <64F18C76-BD2A-4608-A8CC-38AC2820FC12@yahoo.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-publictraffictype: Email x-ms-traffictypediagnostic: DS7PR01MB7712:EE_|MW4PR01MB6388:EE_ x-ms-office365-filtering-correlation-id: 13e81668-19bc-4931-10e3-08db7651b1a8 x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: LqOp2mUMyAzBUbfPPdZwGwqm/0KnzSWNAkASaRDUxNqqnE2CFT8s2YAXouKz8Uy/vlYEC057q3VidfezbcOVHMXt0FzAmXfyTI40RHoHXR2sxtuZigGhOQTbOd/TNTHqqEGf4l/UrrdkZ4uP78mQHSdzQhAK3wazlz/Fg97ucQ0jJBQ4ij1iqfYmKPmdVlHAuaOTk7cO9hCO+TMoJAc+argi5/rj6HpB54Kc4vgKKhOgN20COXHOhf5Hi/kR0BCfN0mvjTsaKAT6jZ4VXfkR1+WbGFDqXiZv4WFfAsXniRWAZpDJqefWMrL0UdYi92Wm+5ob7lUL4XEbFubgKxtVyhLoT9ASZmcV3Xj5iPTVRmACHlyoQhV3a09U7cPZDNg8zURe2RyD3yq27FG643wLyz627IUGfSJgqbdo+risn4J1ccWLRTFMsHXjJVuiBgq35RAkS0ufSJBt7hhtGlOg/ILBx/Mx5/IUjO8AwQnwjq1E/u37hC16lnNvfltttlQfjUf1qWzJ5h3d3iCGxnjrhv6dFrAQbnDeL26eydPSaGG43fnE4Pq/qJ3WkzIVJqO2/dQMVZzcG8T1fc6u0vSV2ZwpoqYYJEXWHInUWDFuBgFBI+lILLgsDKFAxCUpw64U x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:DS7PR01MB7712.prod.exchangelabs.com;PTR:;CAT:NONE;SFS:(13230028)(4636009)(136003)(396003)(346002)(376002)(366004)(39860400002)(451199021)(64756008)(4326008)(76116006)(66946007)(66556008)(66476007)(66446008)(33656002)(316002)(6916009)(786003)(478600001)(38070700005)(8936002)(36756003)(91956017)(8676002)(5660300002)(75432002)(966005)(19627235002)(86362001)(54906003)(41300700001)(6486002)(2906002)(53546011)(26005)(6512007)(6506007)(186003)(122000001)(38100700002)(71200400001)(83380400001)(2616005)(14143004);DIR:OUT;SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?0pOHWxJhjrMCjPwpJU6iXJ6M7isvXzxsWtGOgfDainf810YfwWZdXJU51D7n?= =?us-ascii?Q?ne34YKu1sMvJC1D70p2h1iEpCMzYyb6xHBlvUKOxue+4c0ymg6a9Ka/sU81k?= =?us-ascii?Q?GElg1Swnvp+RtBWXpBorj9c+O2ScvGqTNHkyU79GbbidyQJKDJhRhXl2k+Wv?= =?us-ascii?Q?+I+5wQp+UK9Cqj/Mztx+qJNuYJ25LNxVMYRx6wXZFykKybL6ZPFW57WCjsHe?= =?us-ascii?Q?MTYgpaJcCUcuuNsaTmWP4zlHQlx8GqynsKVxCWVdJSZTwFn49rr9BYfotfc9?= =?us-ascii?Q?HSFfdO/LTF3e+1y5sTRlo3Dh10tOpMCSlDKjQUf7SBjO0jKI10frj4If3z6W?= =?us-ascii?Q?u3AfZuSjPVuNDN5KGFtfwomJFZy81R/4Uco3wJfDSvMjRmZmGtTRP527Owu0?= =?us-ascii?Q?AGk6OgLo7xWc3VKF6iw3pdg45t2zIun6knN8qGHOTzOZGh5uCbiTk8ajRacs?= =?us-ascii?Q?6XcbGj7WYBPjuyExNsmCNf/Evl/gryLEeT8naIdsDwi7pEsrEOBL4D7Q2LDs?= =?us-ascii?Q?RwHbsbVVM3X9xfemt4SxV2oxpkpYm0ihS7iiRvFwl4355fPeD9/b6Zl9HOei?= =?us-ascii?Q?+dcOhq7jBkK+d7UwQDifrh/FmABPTmuYLCybmyElwPRNDNe+Zzj7OdfivShN?= =?us-ascii?Q?t5/wChoaTN4+28r0hE5Hrq4GS7GPzy9GIrMI8OtXPQQ6Ek4JfXzIMHX8qdpX?= =?us-ascii?Q?UEslG9w8RNyFIF2887Wgonx/LvvgcsuffYTpdmT8j1IYdZU1gk1EJtWr5Uui?= =?us-ascii?Q?e93d0kP4vfrJ2dMDXYEZYoh0YOL2Ti9eq/HkZQZTILFhdZERE3rmxhX9NvYK?= =?us-ascii?Q?bLqzrQkoYJujsvbEhXaI67RbrFVOXgkfBJEEb1Cn1Hd/5p5SRfsrcfdGZJSa?= =?us-ascii?Q?2DmmONhBOiVDpIpUtA3lYuTvCTr332F1uPWhJ4qfvSuR+YC45ovCAes/Fing?= =?us-ascii?Q?s/pHO6j9n9pNPYV+DDcZ+pDvHtn4fS/T9XNUOIbEBcAWxl7Pym4rmTzXZw/i?= =?us-ascii?Q?E/g7m5GL65sfnLoCDm8usAame3FLZ4pXy/FdD6fA4JdFwk1rMbme07Q/BulX?= =?us-ascii?Q?mXvPTe1dJbdmk7hwl4bvZrtwij9dUAO9+YVM37q5E7CvRaVMzDPwshPvjtdD?= =?us-ascii?Q?2/s/QQnZ8zTgkozABFm1u78xTuHH1y7PhMDO6HUb8BdlTC3RZRYDnRaKbMng?= =?us-ascii?Q?bgYhgQ4xbMitxfm55xiC/56U9GaC0hihcR7Al8q+Mj17FBCFp/IGBFi8m66q?= =?us-ascii?Q?Asgpk3HTIckULJmk1T5yHiLpB5Bb02UJScUQC+5Cfp5VPtO5xiwnl+thtg/S?= =?us-ascii?Q?xmZJBiIWSrB5LeZnMzPIJ8HnY4uzmd2eXo1SGXxNMmnadZbQ++67VkyZP8/5?= =?us-ascii?Q?r/6GUe4+DUGN8scJfGghR1RyObLbijqnJDv9X//Nu+70fNGTSVfzLoUUWZ7h?= =?us-ascii?Q?clJiwMH6rsyvmFoTFDH6yB26FW2JyUvkDu27KiE6Q3/T6rpfq/iWpfjs1psd?= =?us-ascii?Q?0/Hs01nxHOdd1AWFLxBnqBhrKxrx6fAZdUokwbqKHT4OYFV/m1cSRlFkMAFO?= =?us-ascii?Q?y1WOZLMzyXqXMOB+w2o=3D?= Content-Type: text/plain; charset="us-ascii" Content-ID: Content-Transfer-Encoding: quoted-printable List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: DS7PR01MB7712.prod.exchangelabs.com X-MS-Exchange-CrossTenant-Network-Message-Id: 13e81668-19bc-4931-10e3-08db7651b1a8 X-MS-Exchange-CrossTenant-originalarrivaltime: 26 Jun 2023 14:29:04.8075 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 64afd9ba-0ecf-4acf-bc36-935f6235ba8b X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: WhgvTU391ieeZBIS4HzUTeNOZffGcsnrkH4NQKPTB4kg7bo2LrsKsNPxuEiYtkPd X-MS-Exchange-Transport-CrossTenantHeadersStamped: MW4PR01MB6388 X-OriginatorOrg: mit.edu X-Rspamd-Queue-Id: 4QqVbz6jR3z4GJl X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:3, ipnet:18.9.0.0/16, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N > On Jun 26, 2023, at 04:32, Mark Millard wrote: >=20 > On Jun 24, 2023, at 17:25, Mark Millard wrote: >=20 >> On Jun 24, 2023, at 14:26, John F Carr wrote: >>=20 >>>=20 >>>> On Jun 24, 2023, at 13:00, Mark Millard wrote: >>>>=20 >>>> The running system build is a non-debug build (but >>>> with symbols not stripped). >>>>=20 >>>> The HoneyComb's console log shows: >>>>=20 >>>> . . . >>>> GEOM_STRIPE: Device stripe.IMfBZr destroyed. >>>> GEOM_NOP: Device md0.nop created. >>>> g_vfs_done():md0.nop[READ(offset=3D5885952, length=3D8192)]error =3D 5 >>>> GEOM_NOP: Device md0.nop removed. >>>> GEOM_NOP: Device md0.nop created. >>>> g_vfs_done():md0.nop[READ(offset=3D5935104, length=3D4096)]error =3D 5 >>>> g_vfs_done():md0.nop[READ(offset=3D5935104, length=3D4096)]error =3D 5 >>>> GEOM_NOP: Device md0.nop removed. >>>> GEOM_NOP: Device md0.nop created. >>>> GEOM_NOP: Device md0.nop removed. >>>> Fatal data abort: >>>> x0: ffffa02506e64400 >>>> x1: ffff0001ea401880 (g_raid3_post_sync + 3a145f8) >>>> x2: 4b >>>> x3: a343932b0b22fb30 >>>> x4: 0 >>>> x5: 3310b0d062d0e1d >>>> x6: 1d0e2d060d0b3103 >>>> x7: 0 >>>> x8: ea325df8 >>>> x9: ffff0001eec946d0 ($d.6 + 0) >>>> x10: ffff0001ea401880 (g_raid3_post_sync + 3a145f8) >>>> x11: 0 >>>> x12: 0 >>>> x13: ffff000000cd8960 (lock_class_mtx_sleep + 0) >>>> x14: 0 >>>> x15: ffffa02506e64405 >>>> x16: ffff0001eec94860 (_DYNAMIC + 160) >>>> x17: ffff00000063a450 (ifc_attach_cloner + 0) >>>> x18: ffff0001eb290400 (g_raid3_post_sync + 48a3178) >>>> x19: ffff0001eec94600 (vnet_epair_init_vnet_init + 0) >>>> x20: ffff000000fa5b68 (vnet_sysinit_sxlock + 18) >>>> x21: ffff000000d8e000 (sdt_vfs_vop_vop_spare4_return + 0) >>>> x22: ffff000000d8e000 (sdt_vfs_vop_vop_spare4_return + 0) >>>> x23: ffffa0000042e500 >>>> x24: ffffa0000042e500 >>>> x25: ffff000000ce0788 (linker_lookup_set_desc + 0) >>>> x26: ffffa0203cdef780 >>>> x27: ffff0001eec94698 (__set_sysinit_set_sym_if_epairmodule_sys_init += 0) >>>> x28: ffff000000d8e000 (sdt_vfs_vop_vop_spare4_return + 0) >>>> x29: ffff0001eb290430 (g_raid3_post_sync + 48a31a8) >>>> sp: ffff0001eb290400 >>>> lr: ffff0001eec82a4c ($x.1 + 3c) >>>> elr: ffff0001eec82a60 ($x.1 + 50) >>>> spsr: 60000045 >>>> far: ffff0002d8fba4c8 >>>> esr: 96000046 >>>> panic: vm_fault failed: ffff0001eec82a60 error 1 >>>> cpuid =3D 14 >>>> time =3D 1687625470 >>>> KDB: stack backtrace: >>>> db_trace_self() at db_trace_self >>>> db_trace_self_wrapper() at db_trace_self_wrapper+0x30 >>>> vpanic() at vpanic+0x13c >>>> panic() at panic+0x44 >>>> data_abort() at data_abort+0x2fc >>>> handle_el1h_sync() at handle_el1h_sync+0x14 >>>> --- exception, esr 0x96000046 >>>> $x.1() at $x.1+0x50 >>>> vnet_register_sysinit() at vnet_register_sysinit+0x114 >>>> linker_load_module() at linker_load_module+0xae4 >>>> kern_kldload() at kern_kldload+0xfc >>>> sys_kldload() at sys_kldload+0x60 >>>> do_el0_sync() at do_el0_sync+0x608 >>>> handle_el0_sync() at handle_el0_sync+0x44 >>>> --- exception, esr 0x56000000 >>>> KDB: enter: panic >>>> [ thread pid 70419 tid 101003 ] >>>> Stopped at kdb_enter+0x44: str xzr, [x19, #3200] >>>> db>=20 >>>=20 >>> The failure appears to be initializing module if_epair. >>=20 >> Yep: trying: >>=20 >> # kldload if_epair.ko >>=20 >> was enough to cause the crash. (Just a HoneyComb context at >> that point.) >>=20 >> I tried media dd'd from the recent main snapshot, booting the >> same system. No crash. I moved my build boot media to some >> other systems and tested them: crashes. I tried my boot media >> built optimized for Cortex-A53 or Cortex-X1C/Cortex-A78C >> instead of Cortex-A72: no crashes. (But only one system can >> use the X1C/A78C code in that build.) >>=20 >> So variation testing only gets the crashes for my builds >> that are code-optimized for Cortex-A72's. The same source >> tree vintage built for cortex-53 or Cortex-X1C/Cortex-A78C >> optimization does not get the crashes. But I also >> demonstrated an optmized for Cortex-A72 build from 2023-Mar >> that gets the crash. >>=20 >> The last time I ran into one of these "crashes tied to >> cortex-a72 code optimization" examples it turned out to be >> some missing memory-model management code in FreeBSD's USB >> code. But being lucky enough to help identify a FreeBSD >> source code problem again seems not that likely. It could >> easily be a code generation error by clang for all I know. >>=20 >> So, unless at some point I produce fairly solid evidence >> that the code actually running is messed up by FreeBSD >> source code, this should likely be treated as "blame the >> operator" and should likely be largely ignored as things >> are. (Just My Problem, as I want the Cortex-A72 optimized >> builds.) >=20 > Turns out that the source code in question is the > assignment to V_epair_cloner below: >=20 > static void > vnet_epair_init(const void *unused __unused) > { > struct if_clone_addreq req =3D { > .match_f =3D epair_clone_match, > .create_f =3D epair_clone_create, > .destroy_f =3D epair_clone_destroy, > }; > V_epair_cloner =3D ifc_attach_cloner(epairname, &req); > } > VNET_SYSINIT(vnet_epair_init, SI_SUB_PSEUDO, SI_ORDER_ANY, > vnet_epair_init, NULL); >=20 > Example code when not optimizing for the Cortex-A72: >=20 > 11a4c: d0000089 adrp x9, 0x23000 > 11a50: f9400248 ldr x8, [x18] > 11a54: f942c508 ldr x8, [x8, #1416] > 11a58: f943d929 ldr x9, [x9, #1968] > 11a5c: a9437bfd ldp x29, x30, [sp, #48] > 11a60: f9401508 ldr x8, [x8, #40] > 11a64: f8296900 str x0, [x8, x9] >=20 > The code when optmizing for the Cortex-A72: >=20 > 11a4c: f9400248 ldr x8, [x18] > 11a50: f942c508 ldr x8, [x8, #1416] > 11a54: d503201f nop > 11a58: 1008e3c9 adr x9, #72824 > 11a5c: f9401508 ldr x8, [x8, #40] > 11a60: f8296900 str x0, [x8, x9] > 11a64: a9437bfd ldp x29, x30, [sp, #48] >=20 > It is the "str x0, [x8, x9]" that vm_fault's for > the optimized code. >=20 > So: >=20 > 11a4c: d0000089 adrp x9, 0x23000 > 11a58: f943d929 ldr x9, [x9, #1968] >=20 > was optimized via replacement by: >=20 > 11a58: 1008e3c9 adr x9, #72824 >=20 > I.e., the optimization is based on the offset from > the instruction being fixed in order to produce the > value in x9, even if the instruction is relocated. >=20 > This resulted in the specific x9 value shown in > the x8/x9 pair: >=20 > x8: ea325df8 > x9: ffff0001eec946d0 >=20 > which total's to the fault address (value > in far): >=20 > far: ffff0002d8fba4c8 >=20 >=20 Is this the same as bug 264094? https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264094 From nobody Mon Jun 26 15:59:14 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4QqXbT192dz4k1Sp for ; Mon, 26 Jun 2023 15:59:33 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic311-24.consmr.mail.gq1.yahoo.com (sonic311-24.consmr.mail.gq1.yahoo.com [98.137.65.205]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4QqXbS4hnpz3qGJ for ; Mon, 26 Jun 2023 15:59:32 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1687795170; bh=k4v3nS5LiR7Z6em8a4MLZD+gby7TyxEZyaGvWT3ZHys=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=WbHCH3Ms5jQ52ZrQ+8MTPzn4FpuG7gdg1QcNpZCCdPXCbGzJ9sGrv4m/AWKC+a1lOMPOrLzoGPZI8fNtBfAhVwRcx6zwYQawQeS0P1e+1BncuGN/G1ccqHFoBwYLYmx1Ducmg1wlrXezqhxILdFCGVgT1UV49lhyh9gX+BvgnoR510TXk0+bcqdsItAMGI5G/vDJf6N6OPTcObOTVtFaQABfJONe1prL5UA77sv3ordIZr1A4vpmW3Srg+6jVIoxxBDD+Pne1Aqdf+9Z2rlLtnX1z2XExltVrJ0BUHGQz3epX4U4GYlC+zgePK4fnzJ6SEIQ6TBd18J3QyQpPz5wVg== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1687795170; bh=KnNHHq2Aw47+DcZTjIW8+j4D2q6+WNC2p+s39Azbvox=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=BSBa65kXAHSxfLP4IVtnGSOua0p1HimIVe4TngfQUFtb3n7dxXd+7tqNUYiNEeGB94etWMevCaqux0+OKgmz+VVjaBQ/0ugMz6Za9socsEzN4SOUZZupL2rNDx26Lu68Yjhw0etsP8wGgIjQBfWdkJxnf/hWIJoZhQEBN6LqHme84XUNp4V05icansBcSouKDLtsUQBs7bIAWM9qCLNAmDBzOG8+zrmEX1/NdpBVhnFntG59PKx85TXhxtFxLRai7Gx3mtdEQNBMeLOWLFb/eMYs2Ji0+1aXC0K1OGL+iMtEo2BZKl3RtfDeG8xk9HSdZ+EK4emu0N1LNMJQlewjzw== X-YMail-OSG: kzGb8t8VM1lEhLd5fj68xqIrPXEeSAqDNo91vCpOGS_lj5qWfrt.mO4it_jYeEE V.eTXeMXmVOT6EqcnGcjIfrgU1o80AD3CWVfXQhU4sDcTX_PKTvworyTfyZgSr6IQ_C_AfQ_5Cb2 m7x3ewAW_cnzkGoVHdsWd3GzrssYWe9BJf_RZd5q7gMJ54Lw2SPgQAPHTnXE324FxwqQ3_WtAwxL IwFc9pU3z66_sIrlEsBg9UuPQZYlViXBubizD1ul7LqotShAY40ZiRf6Qgsc1DI6ymfxK3SDBnTE rQ5JYSRVcFT_t2RB7yVhvrq595EgKrzMg4as9ypJdoC5fupEA.SAVLF0bzgM9pa.o2iEim61kJgm 3VN5QgrL7Dvjx.LR0MItphXsQqWHpg4wKnkUusUzOx1lH07ibe.C3a67bfpWkaHYWYdwP7cIUXxK y_IXMh40bvi36GgI9Tqw7Nvb6D0wCzrd1A1pVVif8cBFNVP8.VPl5Sl_vjsNZwKcPUAM4mSuU5f7 OmuErtBAvQMCjwk3cv2Nl6A3o8quNYG_6coEh_TyH.nhoE.c6vHclt3I6_A1R6p01o6T1kQfSK93 RPPsJI2h46.Bo7bSIVDuoHuDsPjBho9PwGx8AhOz6qi0ZQ1rQSVncQYweh7l66A_t2befwXJnPF7 fE4jtLSJ2x_xhCKNt.4134N8EJf_pvNXCfONCLmN1U490pOvb.n5guY3NQDjTACSJFbh1FuvFnp_ oLxV7nr8UlR7GbPsasS7UcYv9yLpZo3ZZCVfME0gHWU45ogr6YGL9d5DAyHHTgKGNlEuPaBc.cI3 LfuANBGBqTy_3JddYtNJFHZAtEwYzK21D6DX_dd5onk_E8nLQIQ.dWZP6lu1T98ZRLCdeapwmNXq 7LnwUdnBgsNwj_3DZoQqkqqRaMZRhM3iEEwsaHArx_8v5bIbIqel1u9hJEhT.vS_wmQnyHuOXIoE TQ7JNgbFq.8_EVch.gGAzFuZy2nNaXsdzJvf8fYQR1bxTszHrmqSQycTUkR.ePiUSPf6EzHey3mw 8IpUncdw.zwxQg201cF9vNIDvZry4dsWzHrAPPa6P0vi3ljHXpR9hYEiP.dwQNvj2srZcxx_YEwl ipcanSCi.kIUaHcPaZbfqYXyp88sxyNjrZQP3Y34caL6yjrICcu_w4WScv6T7d1l4XxRI9n90NG2 GloiZpj9KW3JYeNRAbRFy_Fz3ZXTlHovX5wfL272DBlWnvpTWqalqmEApSM3OGb8rJBuBSBVOR5Z Y2e2hqM0wUUT6dyojvtrdcLjXxEvIr1tFymOYSRbAii3q5rsMvzTEy5ey2yq_dTb8JIv2T3dpkss vy6EGfpXr9PMxQpA1VY_Y6jR_2qL84dr5D4pEgGn.cQZdHwvJr5FTwP3AHwbPfKfaUvxxNlYQSkf 9j45B15eXNqHHC5sst1M6PwjzVh4MkybJrLjB0GGiRsn8Ue.Thj8x89MDluDxI2K2u21wSPaRcOU Jkh7ge4l_GUcOgxyx2AJ9iBOM7OvmWmWpg7tNQMEN6NRNG_RQq5BAbBYq30iJl6Q8XUgScAUnrgX ax2uupIgI1Uk.c8qkOakkr8hTBtT2UJTXFhzaEaBdq86kuDYtUnU9Aaf.OThCpx3iEQGZlKrDeOB FjVacMTPDG4AjTZjFqWVn.34YbsJSDYP5Y1DxVBgESq5JRADEbtZWWvTZb9v7me_b6SWv9KiXzPK QkRvp0pMiVJFAuf6RuM6eaHYy7dwJkumZp1OS8NoeYUNW91_OR8iKHjGnGHyO7ZZ2ZCjrLt1aA8M aEotBmo9JnRE2DBM9QnTdFVeveSxlPPF0FUHNZXVNPWn12XTafqMo5LcVaDJRX1uFTmQrBlT8Iiy nzqkRlRNwkZh9uwYBrlgVBbZY9ZVRN8rkFbt9uLFGh4VdWIJ7htSFErhwLW9_5w5L0Hx9oMhnN.0 9I677zRbh0pIjnCn2hFgs1.ylkcP5Z4CNO0LuM8lRiRWQ2bYrgyeb8bilMWEUwqcNiJEE_El2gv_ YkCLsm6DdKFWZs1pzadkXsm8.wJ2A.5iohyB7lZNHOlbmjkfT0QL0O4LXYgaeZ4OePt0wWEC8J2b 7XIF2YnoHI38ZOh9vEZR3bLgOaLw8d8IsLuZjzav.CYGyO5t815cL72S4uyva5z3xb.0oI8qKoV2 9VmFh2754.p6AxKz.Cb6DVnm4rrz9IQuBu2MjDMyGizoUGcwtzUcBVI5ovLj.A6uDCTR0k8S2fa. pXkn1mPMvH1yqc8cyJJzgQAuDEXU3usXfXvSn7GdaGTBnH57UI9E9T2y366az7hQOXr3R3bG59GQ - X-Sonic-MF: X-Sonic-ID: 90f205a6-5b37-4986-9e50-fc4a616a13a5 Received: from sonic.gate.mail.ne1.yahoo.com by sonic311.consmr.mail.gq1.yahoo.com with HTTP; Mon, 26 Jun 2023 15:59:30 +0000 Received: by hermes--production-ne1-574d4b7954-c659b (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID aa70eed5f1762368987f66b78490f380; Mon, 26 Jun 2023 15:59:26 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.600.7\)) Subject: Re: aarch64 main-n263493-4e8d558c9d1c-dirty (so: 2023-Jun-10) Kyuafile run: "Fatal data abort" crash during vnet_register_sysinit From: Mark Millard In-Reply-To: <2E9684B7-9359-4A3D-A0C2-C1D2B221F2C4@mit.edu> Date: Mon, 26 Jun 2023 08:59:14 -0700 Cc: Current FreeBSD , freebsd-arm Content-Transfer-Encoding: quoted-printable Message-Id: <79849041-5E0E-4244-9BA7-F7F1C673F31F@yahoo.com> References: <3FD359F8-CFCC-400F-B6DE-B635B747DE7F.ref@yahoo.com> <3FD359F8-CFCC-400F-B6DE-B635B747DE7F@yahoo.com> <4A380699-7C9E-4E2E-8DCD-F9ECC2112667@yahoo.com> <64F18C76-BD2A-4608-A8CC-38AC2820FC12@yahoo.com> <2E9684B7-9359-4A3D-A0C2-C1D2B221F2C4@mit.edu> To: John F Carr X-Mailer: Apple Mail (2.3731.600.7) X-Rspamd-Queue-Id: 4QqXbS4hnpz3qGJ X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On Jun 26, 2023, at 07:29, John F Carr wrote: >=20 >=20 >> On Jun 26, 2023, at 04:32, Mark Millard wrote: >>=20 >> On Jun 24, 2023, at 17:25, Mark Millard wrote: >>=20 >>> On Jun 24, 2023, at 14:26, John F Carr wrote: >>>=20 >>>>=20 >>>>> On Jun 24, 2023, at 13:00, Mark Millard wrote: >>>>>=20 >>>>> The running system build is a non-debug build (but >>>>> with symbols not stripped). >>>>>=20 >>>>> The HoneyComb's console log shows: >>>>>=20 >>>>> . . . >>>>> GEOM_STRIPE: Device stripe.IMfBZr destroyed. >>>>> GEOM_NOP: Device md0.nop created. >>>>> g_vfs_done():md0.nop[READ(offset=3D5885952, length=3D8192)]error =3D= 5 >>>>> GEOM_NOP: Device md0.nop removed. >>>>> GEOM_NOP: Device md0.nop created. >>>>> g_vfs_done():md0.nop[READ(offset=3D5935104, length=3D4096)]error =3D= 5 >>>>> g_vfs_done():md0.nop[READ(offset=3D5935104, length=3D4096)]error =3D= 5 >>>>> GEOM_NOP: Device md0.nop removed. >>>>> GEOM_NOP: Device md0.nop created. >>>>> GEOM_NOP: Device md0.nop removed. >>>>> Fatal data abort: >>>>> x0: ffffa02506e64400 >>>>> x1: ffff0001ea401880 (g_raid3_post_sync + 3a145f8) >>>>> x2: 4b >>>>> x3: a343932b0b22fb30 >>>>> x4: 0 >>>>> x5: 3310b0d062d0e1d >>>>> x6: 1d0e2d060d0b3103 >>>>> x7: 0 >>>>> x8: ea325df8 >>>>> x9: ffff0001eec946d0 ($d.6 + 0) >>>>> x10: ffff0001ea401880 (g_raid3_post_sync + 3a145f8) >>>>> x11: 0 >>>>> x12: 0 >>>>> x13: ffff000000cd8960 (lock_class_mtx_sleep + 0) >>>>> x14: 0 >>>>> x15: ffffa02506e64405 >>>>> x16: ffff0001eec94860 (_DYNAMIC + 160) >>>>> x17: ffff00000063a450 (ifc_attach_cloner + 0) >>>>> x18: ffff0001eb290400 (g_raid3_post_sync + 48a3178) >>>>> x19: ffff0001eec94600 (vnet_epair_init_vnet_init + 0) >>>>> x20: ffff000000fa5b68 (vnet_sysinit_sxlock + 18) >>>>> x21: ffff000000d8e000 (sdt_vfs_vop_vop_spare4_return + 0) >>>>> x22: ffff000000d8e000 (sdt_vfs_vop_vop_spare4_return + 0) >>>>> x23: ffffa0000042e500 >>>>> x24: ffffa0000042e500 >>>>> x25: ffff000000ce0788 (linker_lookup_set_desc + 0) >>>>> x26: ffffa0203cdef780 >>>>> x27: ffff0001eec94698 = (__set_sysinit_set_sym_if_epairmodule_sys_init + 0) >>>>> x28: ffff000000d8e000 (sdt_vfs_vop_vop_spare4_return + 0) >>>>> x29: ffff0001eb290430 (g_raid3_post_sync + 48a31a8) >>>>> sp: ffff0001eb290400 >>>>> lr: ffff0001eec82a4c ($x.1 + 3c) >>>>> elr: ffff0001eec82a60 ($x.1 + 50) >>>>> spsr: 60000045 >>>>> far: ffff0002d8fba4c8 >>>>> esr: 96000046 >>>>> panic: vm_fault failed: ffff0001eec82a60 error 1 >>>>> cpuid =3D 14 >>>>> time =3D 1687625470 >>>>> KDB: stack backtrace: >>>>> db_trace_self() at db_trace_self >>>>> db_trace_self_wrapper() at db_trace_self_wrapper+0x30 >>>>> vpanic() at vpanic+0x13c >>>>> panic() at panic+0x44 >>>>> data_abort() at data_abort+0x2fc >>>>> handle_el1h_sync() at handle_el1h_sync+0x14 >>>>> --- exception, esr 0x96000046 >>>>> $x.1() at $x.1+0x50 >>>>> vnet_register_sysinit() at vnet_register_sysinit+0x114 >>>>> linker_load_module() at linker_load_module+0xae4 >>>>> kern_kldload() at kern_kldload+0xfc >>>>> sys_kldload() at sys_kldload+0x60 >>>>> do_el0_sync() at do_el0_sync+0x608 >>>>> handle_el0_sync() at handle_el0_sync+0x44 >>>>> --- exception, esr 0x56000000 >>>>> KDB: enter: panic >>>>> [ thread pid 70419 tid 101003 ] >>>>> Stopped at kdb_enter+0x44: str xzr, [x19, #3200] >>>>> db>=20 >>>>=20 >>>> The failure appears to be initializing module if_epair. >>>=20 >>> Yep: trying: >>>=20 >>> # kldload if_epair.ko >>>=20 >>> was enough to cause the crash. (Just a HoneyComb context at >>> that point.) >>>=20 >>> I tried media dd'd from the recent main snapshot, booting the >>> same system. No crash. I moved my build boot media to some >>> other systems and tested them: crashes. I tried my boot media >>> built optimized for Cortex-A53 or Cortex-X1C/Cortex-A78C >>> instead of Cortex-A72: no crashes. (But only one system can >>> use the X1C/A78C code in that build.) >>>=20 >>> So variation testing only gets the crashes for my builds >>> that are code-optimized for Cortex-A72's. The same source >>> tree vintage built for cortex-53 or Cortex-X1C/Cortex-A78C >>> optimization does not get the crashes. But I also >>> demonstrated an optmized for Cortex-A72 build from 2023-Mar >>> that gets the crash. >>>=20 >>> The last time I ran into one of these "crashes tied to >>> cortex-a72 code optimization" examples it turned out to be >>> some missing memory-model management code in FreeBSD's USB >>> code. But being lucky enough to help identify a FreeBSD >>> source code problem again seems not that likely. It could >>> easily be a code generation error by clang for all I know. >>>=20 >>> So, unless at some point I produce fairly solid evidence >>> that the code actually running is messed up by FreeBSD >>> source code, this should likely be treated as "blame the >>> operator" and should likely be largely ignored as things >>> are. (Just My Problem, as I want the Cortex-A72 optimized >>> builds.) >>=20 >> Turns out that the source code in question is the >> assignment to V_epair_cloner below: >>=20 >> static void >> vnet_epair_init(const void *unused __unused) >> { >> struct if_clone_addreq req =3D { >> .match_f =3D epair_clone_match, >> .create_f =3D epair_clone_create, >> .destroy_f =3D epair_clone_destroy, >> }; >> V_epair_cloner =3D ifc_attach_cloner(epairname, &req); >> } >> VNET_SYSINIT(vnet_epair_init, SI_SUB_PSEUDO, SI_ORDER_ANY, >> vnet_epair_init, NULL); >>=20 >> Example code when not optimizing for the Cortex-A72: >>=20 >> 11a4c: d0000089 adrp x9, 0x23000 >> 11a50: f9400248 ldr x8, [x18] >> 11a54: f942c508 ldr x8, [x8, #1416] >> 11a58: f943d929 ldr x9, [x9, #1968] >> 11a5c: a9437bfd ldp x29, x30, [sp, #48] >> 11a60: f9401508 ldr x8, [x8, #40] >> 11a64: f8296900 str x0, [x8, x9] >>=20 >> The code when optmizing for the Cortex-A72: >>=20 >> 11a4c: f9400248 ldr x8, [x18] >> 11a50: f942c508 ldr x8, [x8, #1416] >> 11a54: d503201f nop >> 11a58: 1008e3c9 adr x9, #72824 >> 11a5c: f9401508 ldr x8, [x8, #40] >> 11a60: f8296900 str x0, [x8, x9] >> 11a64: a9437bfd ldp x29, x30, [sp, #48] >>=20 >> It is the "str x0, [x8, x9]" that vm_fault's for >> the optimized code. >>=20 >> So: >>=20 >> 11a4c: d0000089 adrp x9, 0x23000 >> 11a58: f943d929 ldr x9, [x9, #1968] >>=20 >> was optimized via replacement by: >>=20 >> 11a58: 1008e3c9 adr x9, #72824 >>=20 >> I.e., the optimization is based on the offset from >> the instruction being fixed in order to produce the >> value in x9, even if the instruction is relocated. >>=20 >> This resulted in the specific x9 value shown in >> the x8/x9 pair: >>=20 >> x8: ea325df8 >> x9: ffff0001eec946d0 >>=20 >> which total's to the fault address (value >> in far): >>=20 >> far: ffff0002d8fba4c8 >>=20 >>=20 > Is this the same as bug 264094? >=20 > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264094 Well, the not Cortex-A72 optimized .o stage code vs. the Cortex-A72 optimized .o stage code looks like: (not Cortex-A72 optimized) 3c: 90000009 adrp x9, 0x0 40: f9400248 ldr x8, [x18] 44: f942c508 ldr x8, [x8, #1416] 48: f9400129 ldr x9, [x9] 4c: a9437bfd ldp x29, x30, [sp, #48] 50: f9401508 ldr x8, [x8, #40] 54: f8296900 str x0, [x8, x9] vs. (Cortex-A72 optimized) 3c: f9400248 ldr x8, [x18] 40: f942c508 ldr x8, [x8, #1416] 44: 90000009 adrp x9, 0x0 48: f9400129 ldr x9, [x9] 4c: f9401508 ldr x8, [x8, #40] 50: f8296900 str x0, [x8, x9] 54: a9437bfd ldp x29, x30, [sp, #48] (The x29 lines have a different purpose but I show the sequencing as shown by objdump to show that it is basically an ordering difference at the .o stage.) As for if_epair.kld production the .meta files show: CMD ld -m aarch64elf -warn-common --build-id=3Dsha1 -r -o if_epair.kld = if_epair.o CMD ctfmerge -L VERSION -g -o if_epair.kld if_epair.o CMD :> export_syms CMD awk -f /usr/main-src/sys/conf/kmod_syms.awk if_epair.kld = export_syms | xargs -J% objcopy % if_epair.kld CWD = /usr/obj/BUILDs/main-CA72-nodbg-clang-alt/usr/main-src/arm64.aarch64/sys/G= ENERIC-NODBG-CA72/modules/usr/main-src/sys/modules/if_epair vs. CMD ld -m aarch64elf -warn-common --build-id=3Dsha1 -r -o if_epair.kld = if_epair.o CMD ctfmerge -L VERSION -g -o if_epair.kld if_epair.o CMD :> export_syms CMD awk -f /usr/main-src/sys/conf/kmod_syms.awk if_epair.kld = export_syms | xargs -J% objcopy % if_epair.kld CWD = /usr/obj/BUILDs/main-CA72-nodbg-clang/usr/main-src/arm64.aarch64/sys/GENER= IC-NODBG-CA72/modules/usr/main-src/sys/modules/if_epair It looks to me like the code ordering differences in the .o's may be all that lead to the differing .kld results for setting x9 . If so, it is not good to be that dependent on minor .o stage code generation differences for if things will be operational vs. not. =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Mon Jun 26 19:09:38 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Qqcpq2Cxkz4kXj9 for ; Mon, 26 Jun 2023 19:09:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Qqcpp6c97z4P3l for ; Mon, 26 Jun 2023 19:09:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1687806578; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=W6YBE3WGZc63qnbSLnk+kN2QtD4EAmzbu9nInyQWUus=; b=eQNMYqGSuZ44jJb1OPMHiUTeK8JY50W4qPvFviRNoy4+uT4Uw4xQqehCyVz6XakEqC1ZPT DYF+OJaHsVAjzx3C6pnxqAXPRh5Ju/Sdt+6+CPPuoERNNMWCV/ufCtXsCnh/4Ckp6Gm1kO cadA+WIi4xKMFa8+afqJmYhtU0rvFq+QGh/GsUileh4BWAI5Uuaq70l6Y3s6jw4T6e4b5I 1OAPEJMb9TesLKw6jlHX3O+zIsXK2k+P/GIHCUbjxuctU9jp+CwWMKsGNHFNIHzX1AL13S JHHIyWMkOYSPgufNUHr202L2AuqKYdFoAREXM5ocrGOypNVBv5aRW2s50bC5NQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1687806578; a=rsa-sha256; cv=none; b=AurqNqKu/w/ncH3FRPb+tW91RxjtRoIYa5vFtsbN42d/+696jU6U9rndgRzCC+PMJyqxNI ZVR/e1mBYk444UbxEe1yJeBulPy2JrN1NRB394D1Y4FBarM65Xw4F+k00eubGjIyTrFvSo c0I5hMWyJd/mVq3H2phSO2cgxu2N8Xazvj6iUDeJzYQfUUuF8PVXYv0igqD0c2TEXvuYtL yhdNZRoFhIOjOo1F0C2mGzyVPSfhxDPmIbTCCVvy2/HSeCjXz+WXci/ZiuZJr1UrojIzBD SwRzuCplfWxXvRY/YNd3EiaVI6XfKzDRB+TW59fqKKC2mpz1Bg21khoWALbQOQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Qqcpp5jLczM2C for ; Mon, 26 Jun 2023 19:09:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 35QJ9c2r067292 for ; Mon, 26 Jun 2023 19:09:38 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 35QJ9cx1067291 for freebsd-arm@FreeBSD.org; Mon, 26 Jun 2023 19:09:38 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-arm@FreeBSD.org Subject: [Bug 272229] printf produces bogus output when printing double 0x00000000000000ff with %g Date: Mon, 26 Jun 2023 19:09:38 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: arm X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: fuz@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-arm@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter cc Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D272229 Bug ID: 272229 Summary: printf produces bogus output when printing double 0x00000000000000ff with %g Product: Base System Version: 13.1-RELEASE Hardware: Any OS: Any Status: New Severity: Affects Many People Priority: --- Component: arm Assignee: freebsd-arm@FreeBSD.org Reporter: fuz@FreeBSD.org CC: diizzy@FreeBSD.org Consider this test program: #include int main() { union intfloat { int i; double f; } intf; intf.i =3D 255; printf("%g\n", intf.f); } This should print (e.g. on aarch64): $ cc -o bug bug.c $ ./bug 1.25987e-32 But on armv7 we get instead: $ ./bug e-309 Furthermore, there is an embedded NUL byte in the output: $ ./bug | od -c=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20 0000000 \0 e - 3 0 9 \n=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20 0000007 Preliminary debugging suggests that this could be because dtoa() returns an empty string when vfprintf attempts the conversion. Further debugging is hindered as gdb cannot find debug symbols for dtoa (it seems to expect a so= urce file of different name than the actual file). Among other things, this error causes devel/orc to fail during build. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Jun 26 19:12:41 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4QqctY0jLdz4kZdZ for ; Mon, 26 Jun 2023 19:12:53 +0000 (UTC) (envelope-from titus@edc.ro) Received: from eatlas.ro (eatlas.ro [86.126.82.18]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "eatlas.ro", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4QqctW4gxyz4QYP for ; Mon, 26 Jun 2023 19:12:51 +0000 (UTC) (envelope-from titus@edc.ro) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=edc.ro header.s=mail header.b=i5J1rXP9; spf=pass (mx1.freebsd.org: domain of titus@edc.ro designates 86.126.82.18 as permitted sender) smtp.mailfrom=titus@edc.ro; dmarc=none Received: from mail.edc.ro ([10.1.4.58]) by eatlas.ro (8.16.1/8.16.1) with ESMTPS id 35QJCgK8054679 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NOT) for ; Mon, 26 Jun 2023 22:12:42 +0300 (EEST) (envelope-from titus@edc.ro) Received: from [192.168.1.7] (79-114-94-24.rdsnet.ro [79.114.94.24] (may be forged)) (authenticated bits=0) by mail.edc.ro (8.16.1/8.16.1) with ESMTPSA id 35QJCdxG027226 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Mon, 26 Jun 2023 22:12:39 +0300 (EEST) (envelope-from titus@edc.ro) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=edc.ro; s=mail; t=1687806760; bh=Hgz4LB91j88FCuVAeJFpoddpNWXNtGeYJt9vGHBMC6M=; h=From:Subject:Date:To; b=i5J1rXP9fKco9VrDvab86XFxbtWqwC3rtRszgj7EvoOCg1kq7vJ3WskxNDObgeIEn Trds9vpQXTdlWd3FlUnCxrVHQ2Qo+skFMyZwdP80rNs2QrS1DI6nE3aQIk7ikUIcb5 gWIGxhB9WQFmXoV01M2GqepmSjwDYsYDbjs9CQik= From: titus Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.21\)) Subject: allwinner h616 + serial console glitch Message-Id: Date: Mon, 26 Jun 2023 22:12:41 +0300 To: freebsd-arm@freebsd.org X-Mailer: Apple Mail (2.3445.104.21) X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on ns.edc.ro X-Spamd-Result: default: False [-2.98 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.98)[-0.983]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ip4:86.126.82.18/32]; R_DKIM_ALLOW(-0.20)[edc.ro:s=mail]; MIME_GOOD(-0.10)[text/plain]; MIME_TRACE(0.00)[0:+]; DKIM_TRACE(0.00)[edc.ro:+]; ASN(0.00)[asn:8708, ipnet:86.120.0.0/13, country:RO]; MLMMJ_DEST(0.00)[freebsd-arm@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; DMARC_NA(0.00)[edc.ro]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-arm@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Queue-Id: 4QqctW4gxyz4QYP X-Spamd-Bar: -- X-ThisMailContainsUnwantedMimeParts: N i have started to play / hack support with a h616 (an android tv box in = fact) i managed to get usb, sd, e-mmc, clocks, gpio to work no ethernet and axp/power controller yet but the problem i have besides not having a proper dtb (the android = image extracted one is not exactly usable because of different notation, = device names, etc) is a serial console glitch in the form of not echoing the last character typed you always need to type +1 character to get the desired input so to login you type root\n and then you = get the password prompt so you type n+1 characters to get n characters sent the bug is not present in u-boot/loader just after the kernel started the uart to ttl dongle i use in the pc is good, i tested it with other = boards and works as expected the board does not have a pin header for the connection just holes and i = stucked the wires in the holes without soldering (very flimsy but still = works in u-boot) also rx works ok does anybody know how to fix the serial connection ?= From nobody Mon Jun 26 20:52:59 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Qqg6d3Ph2z4hwmV for ; Mon, 26 Jun 2023 20:53:29 +0000 (UTC) (envelope-from saper@saper.info) Received: from q.saper.info (q.saper.info [IPv6:2605:2700:0:2:a800:ff:fec7:5c61]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature ECDSA (P-384) client-digest SHA384) (Client CN "q.saper.info", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Qqg6d158Nz48jX for ; Mon, 26 Jun 2023 20:53:28 +0000 (UTC) (envelope-from saper@saper.info) Authentication-Results: mx1.freebsd.org; none Received: from q.saper.info (localhost [127.0.0.1]) by q.saper.info (8.16.1/8.16.1) with ESMTPS id 35QKr129043780 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Mon, 26 Jun 2023 20:53:01 GMT (envelope-from saper@saper.info) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=saper.info; s=Sep2014; t=1687812781; bh=YKtCTQexaR90NiVZ/TmBWu99EtE5k+aBTV3Tq7I5RJ0=; h=Date:From:To:cc:Subject:In-Reply-To:References; b=Jh8WURM30EJmechGqpAgngkYFGbh5xWrlEB81GwvyiapXLSSv8B4Ali2oF/fFjSbt LcmFOnS0tyXun8UoFLya98TtgXNOIJmrK0kD5X+BoIZjxYCVkrGadyv9sLsGal0Ljs XwI4xZsGTHRNRaCOlV697LBBmLw8CV+4T7XIEBKQ= Received: from localhost (saper@localhost) by q.saper.info (8.16.1/8.16.1/Submit) with ESMTP id 35QKqxoJ043777; Mon, 26 Jun 2023 20:53:00 GMT (envelope-from saper@saper.info) X-Authentication-Warning: q.saper.info: saper owned process doing -bs Date: Mon, 26 Jun 2023 20:52:59 +0000 From: Marcin Cieslak To: titus cc: freebsd-arm@freebsd.org Subject: Re: allwinner h616 + serial console glitch In-Reply-To: Message-ID: References: List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha-256; boundary="2201072851-316726448-1687812781=:23510" X-Rspamd-Queue-Id: 4Qqg6d158Nz48jX X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:47066, ipnet:2605:2700::/32, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N --2201072851-316726448-1687812781=:23510 Content-Type: text/plain; format=flowed; charset=US-ASCII On Mon, 26 Jun 2023, titus wrote: > i have started to play / hack support with a h616 (an android tv box in fact) > i managed to get usb, sd, e-mmc, clocks, gpio to work > no ethernet and axp/power controller yet > so to login you type root\n and then you get the password prompt > so you type n+1 characters to get n characters sent > does anybody know how to fix the serial connection ? Once you manage to log in, what does "stty -a" say? Marcin --2201072851-316726448-1687812781=:23510 Content-Type: application/pkcs7-signature; name=smime.p7s Content-Transfer-Encoding: BASE64 Content-Description: S/MIME Cryptographic Signature Content-Disposition: attachment; filename=smime.p7s MIIOdgYJKoZIhvcNAQcCoIIOZzCCDmMCAQExDzANBglghkgBZQMEAgEFADAL BgkqhkiG9w0BBwGgggq9MIIEvDCCA6SgAwIBAgIQeEqpEhjRpCYIUTzTZlVD ozANBgkqhkiG9w0BAQsFADBMMSAwHgYDVQQLExdHbG9iYWxTaWduIFJvb3Qg Q0EgLSBSMzETMBEGA1UEChMKR2xvYmFsU2lnbjETMBEGA1UEAxMKR2xvYmFs U2lnbjAeFw0yMDA5MTYwMDAwMDBaFw0yOTAzMTgwMDAwMDBaMFsxCzAJBgNV BAYTAkJFMRkwFwYDVQQKExBHbG9iYWxTaWduIG52LXNhMTEwLwYDVQQDEyhH bG9iYWxTaWduIEdDQyBSMyBQZXJzb25hbFNpZ24gMSBDQSAyMDIwMIIBIjAN BgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAvxvJBqEapaux2/z3J7fFslRO WjKVJ5rCMfWGsg17dmD7NSnG7Spoa8d3htXsls1IMxoO8PyouQajNQqYmlYo xinlqenMNv7CJyEKMOAtglBmD6C/QC7kT+dSx4HfSTs8xmv8veJOldMzF8S/ BEn/tD4w/Dvpg+oXOqDyOiHPTacRFK0QHoq5eEbBmVS8W0rwcaRotO9fGTA+ NjF0My7GLRNK0eMPGh2hcPZURQhXy7wRQ8XFIfEA6kaQHHN22ncnVtwqiTmA wTR+4GNNVinG3KjNZLAVSnGrdCvT2I4Zo19hKy5PX6o7wrVXvMR4zV5VBFwV 6ZDM+xewao7Mup+SbwIDAQABo4IBiTCCAYUwDgYDVR0PAQH/BAQDAgGGMB0G A1UdJQQWMBQGCCsGAQUFBwMCBggrBgEFBQcDBDASBgNVHRMBAf8ECDAGAQH/ AgEAMB0GA1UdDgQWBBSFu/DMxDa1CmJ2o5kuj7s6aq3FUTAfBgNVHSMEGDAW gBSP8Et/qC5FJK5NUPpjmove4t0bvDB6BggrBgEFBQcBAQRuMGwwLQYIKwYB BQUHMAGGIWh0dHA6Ly9vY3NwLmdsb2JhbHNpZ24uY29tL3Jvb3RyMzA7Bggr BgEFBQcwAoYvaHR0cDovL3NlY3VyZS5nbG9iYWxzaWduLmNvbS9jYWNlcnQv cm9vdC1yMy5jcnQwNgYDVR0fBC8wLTAroCmgJ4YlaHR0cDovL2NybC5nbG9i YWxzaWduLmNvbS9yb290LXIzLmNybDBMBgNVHSAERTBDMEEGCSsGAQQBoDIB KDA0MDIGCCsGAQUFBwIBFiZodHRwczovL3d3dy5nbG9iYWxzaWduLmNvbS9y ZXBvc2l0b3J5LzANBgkqhkiG9w0BAQsFAAOCAQEAWWtqju12g524FdD2HwUX U1rSxeM5aSU1cUC1V/xBjXW0IjA7/3/vG2cietPPP/g3lpoQePVJpQAKZml8 1fHwPPivFK9Ja41jJkgqGzkORSC0xYkh2gGeQg1JVaCzcrRzJElRjT442m6F pbLHCebxIHLu0WBNjLZreB6MYMaqdPL6ItbXtD/BU4k517cEuUbczoBFZAra jq7oUBWXuroln5AMnRwVNwgJN4Np0s4kkJ94KepzbFOLzcbnfUB0+xT4foXm bM0GmmcPGOy0qvqEHJsBwDZXDxIk8oqCnnLngi7N94Sn4eTcmpZ9NH2dDN1O TEPVXgRG5X1pBcNtMWG6MDCCBfkwggThoAMCAQICDCKqoJRMYYx5sYJHGzAN BgkqhkiG9w0BAQsFADBbMQswCQYDVQQGEwJCRTEZMBcGA1UEChMQR2xvYmFs U2lnbiBudi1zYTExMC8GA1UEAxMoR2xvYmFsU2lnbiBHQ0MgUjMgUGVyc29u YWxTaWduIDEgQ0EgMjAyMDAeFw0yMzAzMDcxNjExMDlaFw0yNjAzMDcxNjEx MDlaMDwxGTAXBgNVBAMMEHNhcGVyQHNhcGVyLmluZm8xHzAdBgkqhkiG9w0B CQEWEHNhcGVyQHNhcGVyLmluZm8wggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAw ggIKAoICAQC8MB3fTYVrTadH5qE2CIa4VLvlL6QHgDriMRLkTA49SPszYCO0 fZTEpdSw8fc6kK9p2fD63LAfOHeD7jzey5aHBzpIGlxeFkn0Ce2BCYY5yLxK i9byoCwrpLchTR1Itpk1w+zy5E4T9KBTL1+c+w+TKpaIvFLXtjZtz4wQGi0p e/nRkRK9htGG3mETh+APitedl+ImGaI8NK9PELxuSkXnYAvGPpnXir8vbszk tJU1b0TevL/i3Sy6fhOhunZmTo1QDM7Zw4UyVjkQgTvL3y4I0tIrVjlam08x XZeMp+i/Gl51eHGvRVfvdJUJAjrWhrFEp8+2FZouWxWzAlHdd2sRp1AekNdP CeRgHeIF6uNtSseL1grKAjU+4BiixWPp1y1niB0humoQHoub/6fO/mU+//rW l3gTwZNu4FuKgZlfPw+qnvuka0c9dUNIZRCE5z8yXjS8R9yZWirnHNhYxf/e R2y4jaiHzPAjZlZZ2rGx8xVfB2n2JsAicj2+ZxmXlQ1yd5RW1pfxG3cdNNC5 uZ+j4JIN2ElsIjEKmMn9gHdoaEMAy/ENwNiMDBadLnc8qWirq/Ktp2dBSf2y /sH9xMpVyk8wuYjpbCnX4xslAensno5A20MYdKGPRFaItEhNPNbfzc1+4br8 exoXFX1F9ZJK9gGUO2nLbdRycphdyzxzgQIDAQABo4IB2jCCAdYwDgYDVR0P AQH/BAQDAgWgMIGjBggrBgEFBQcBAQSBljCBkzBOBggrBgEFBQcwAoZCaHR0 cDovL3NlY3VyZS5nbG9iYWxzaWduLmNvbS9jYWNlcnQvZ3NnY2NyM3BlcnNv bmFsc2lnbjFjYTIwMjAuY3J0MEEGCCsGAQUFBzABhjVodHRwOi8vb2NzcC5n bG9iYWxzaWduLmNvbS9nc2djY3IzcGVyc29uYWxzaWduMWNhMjAyMDBMBgNV HSAERTBDMEEGCSsGAQQBoDIBKDA0MDIGCCsGAQUFBwIBFiZodHRwczovL3d3 dy5nbG9iYWxzaWduLmNvbS9yZXBvc2l0b3J5LzAJBgNVHRMEAjAAMEkGA1Ud HwRCMEAwPqA8oDqGOGh0dHA6Ly9jcmwuZ2xvYmFsc2lnbi5jb20vZ3NnY2Ny M3BlcnNvbmFsc2lnbjFjYTIwMjAuY3JsMBsGA1UdEQQUMBKBEHNhcGVyQHNh cGVyLmluZm8wHQYDVR0lBBYwFAYIKwYBBQUHAwIGCCsGAQUFBwMEMB8GA1Ud IwQYMBaAFIW78MzENrUKYnajmS6PuzpqrcVRMB0GA1UdDgQWBBTW/RrdlRFR y6MgS7liTThMnQA5ozANBgkqhkiG9w0BAQsFAAOCAQEAAwoUJShHMueocVlD 1+vYJbTTTbk9tabr2L4Iyyy4Btu1d1wwl6d9Yx2N9qaVERWcEeP0aR+NB2B7 xIKl/ZnZVuSxep0Raw4s284a/jSIJlsAi4SJItDCU2VrYJDWxP7MxzZHnzPI MLDoTHXPV18gvYTewoNk5/Yo89Kb0v/GpPTpP2sVdrWLHa4uKUHYrAZ0aByp kNw6lXp6o6DXvXaOd6KDTQN5XhmmHwLnuLceODF1t9gicsZIOY+KAxN6YZ6t EqwN48b4OFMpckDE3fm1iTZRqnEIqUHOKOcoCImkub1woEN0zXDQmLXaZigl uVztWSTM4/fapWLrlHBNxfjs1TGCA30wggN5AgEBMGswWzELMAkGA1UEBhMC QkUxGTAXBgNVBAoTEEdsb2JhbFNpZ24gbnYtc2ExMTAvBgNVBAMTKEdsb2Jh bFNpZ24gR0NDIFIzIFBlcnNvbmFsU2lnbiAxIENBIDIwMjACDCKqoJRMYYx5 sYJHGzANBglghkgBZQMEAgEFAKCB5DAYBgkqhkiG9w0BCQMxCwYJKoZIhvcN AQcBMBwGCSqGSIb3DQEJBTEPFw0yMzA2MjYyMDUyNTlaMC8GCSqGSIb3DQEJ BDEiBCCmQDZfmSzDw0CaHJkog+vP6bOnXnr/T4G5VAZbRkGYcjB5BgkqhkiG 9w0BCQ8xbDBqMAsGCWCGSAFlAwQBKjALBglghkgBZQMEARYwCwYJYIZIAWUD BAECMAoGCCqGSIb3DQMHMA4GCCqGSIb3DQMCAgIAgDANBggqhkiG9w0DAgIB QDAHBgUrDgMCBzANBggqhkiG9w0DAgIBKDANBgkqhkiG9w0BAQEFAASCAgCC jl6lHgHqMx7IBnoEZWtDYzs0zqkr+6i8bgDjVQyxll2jyn1h8JAb1zTh94ru 3frVcWprX/c5fP+bkqQBVVNuH9Gz8URIOuS7Zt2254Etul94TUWcuOW2eLjy JN/d6ctCdHYqKhZ7XQ3p+qXtjD75UzXGMxGxDJdVoK04pfsdjiviEeKpcDV1 BJjDmYeawa/nqt2lz2Fd1wKI51v1cifeddWWzHtAL704zHtjUPyVrbQDq+L0 HPtiwqCzC2PAB2dMHynI0cBtP/W5QdeIeW8JCse3RCURIVAS8OF2Bp981pol bdrqZumvmnmGECw5wawlOJ7JbnhMh/y2YlbddBg8z7ptOfQqTOhY8KcA2qnq T87TdABYAxu6KguVk9U5L6miL+6Yxdbt54G4t0ldwyhGWk2SDvHTqBPhVDL/ iS99q7B8ONNEnuOSzs3iNXCKNuicDnedl+Wxveoy1IXcUPv6SvCn27oCtoX+ u/yN0UYdW63uyOWxg6jwHUoTkTFD3FHgSkUAoObivTZ/mE1gb9XKa5ur3uVG xdvN9r0ZTfX7IsB/Ksu+BgLC636X55B8pOtHBrE4D9NWXgAER+zvpkhfFNIH QR6Jf0t/W0vQqaVABV0G3LuGrZAEdKKsGp2Gs5PZL/irhfyEkInUYqbah89H RzPQ+lVa1Ts+jv6krOnoBg== --2201072851-316726448-1687812781=:23510-- From nobody Tue Jun 27 02:00:08 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4QqnwS2s0cz4hdR9; Tue, 27 Jun 2023 02:00:08 +0000 (UTC) (envelope-from fbsd@www.zefox.net) Received: from www.zefox.net (www.zefox.net [50.1.20.27]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "www.zefox.com", Issuer "www.zefox.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4QqnwR0X17z3pdB; Tue, 27 Jun 2023 02:00:06 +0000 (UTC) (envelope-from fbsd@www.zefox.net) Authentication-Results: mx1.freebsd.org; dkim=none; spf=none (mx1.freebsd.org: domain of fbsd@www.zefox.net has no SPF policy when checking 50.1.20.27) smtp.mailfrom=fbsd@www.zefox.net; dmarc=none Received: from www.zefox.net (localhost [127.0.0.1]) by www.zefox.net (8.17.1/8.15.2) with ESMTPS id 35R209jA080254 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Mon, 26 Jun 2023 19:00:09 -0700 (PDT) (envelope-from fbsd@www.zefox.net) Received: (from fbsd@localhost) by www.zefox.net (8.17.1/8.15.2/Submit) id 35R208dc080253; Mon, 26 Jun 2023 19:00:08 -0700 (PDT) (envelope-from fbsd) Date: Mon, 26 Jun 2023 19:00:08 -0700 From: bob prohaska To: Jamie Landeg-Jones Cc: freebsd-net@freebsd.org, freebsd-arm@freebsd.org Subject: Re: -current dropping ssh connections Message-ID: References: <202306212305.35LN5ITH069587@donotpassgo.dyslexicfish.net> <202306222238.35MMcoQm017939@donotpassgo.dyslexicfish.net> List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <202306222238.35MMcoQm017939@donotpassgo.dyslexicfish.net> X-Spamd-Result: default: False [-1.09 / 15.00]; AUTH_NA(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-0.999]; NEURAL_HAM_SHORT(-0.99)[-0.991]; MID_RHS_WWW(0.50)[]; WWW_DOT_DOMAIN(0.50)[]; MIME_GOOD(-0.10)[text/plain]; R_DKIM_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_SPF_NA(0.00)[no SPF record]; TO_DN_SOME(0.00)[]; ASN(0.00)[asn:7065, ipnet:50.1.16.0/20, country:US]; MIME_TRACE(0.00)[0:+]; MLMMJ_DEST(0.00)[freebsd-net@freebsd.org,freebsd-arm@freebsd.org]; ARC_NA(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; DMARC_NA(0.00)[zefox.net]; RCVD_COUNT_THREE(0.00)[3]; RCVD_TLS_LAST(0.00)[]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Queue-Id: 4QqnwR0X17z3pdB X-Spamd-Bar: - X-ThisMailContainsUnwantedMimeParts: N On Thu, Jun 22, 2023 at 11:38:50PM +0100, Jamie Landeg-Jones wrote: > bob prohaska wrote: > > > That seems worth a try. > > The notion of an ssh escape (~. in this case) finding its way into the data stream is new to me. > > Thinking again, that looks like corruption coming down the ssh connection. > For the ssh escape char to affect anything (note it needs to be preceeded > by a new line) it would have to be sent up the line. > > For an example, assuming ssh has the default escape char, look at the difference between: > > printf 'pwd;\n~.;echo sleeping.; sleep 5' | ssh -tt user@host > > and with the same printf, but no escape char: > > printf 'pwd;\n~.;echo sleeping.; sleep 5' | ssh -tt -e none user@host > > You can see how the former closes the connection due to the \n~. > > (The -tt forces a terminal/interactive session to be set up - normally, as we are > piping input to ssh in this case, the terminal isnt set up, and the escape character > isn't used - it's only recongnised in interactive sesions by default) > > I personally have "EscapeChar none" in my ssh_config, but I suspect this > is probably not the issue here, still, can't hurt to try it! Indeed, connection was dropped with escape character set to none. There does seem to be a some dependence on system load. Connections survive at light or no load and drop when the sshd side is busy. Thanks for writing! bob prohaska From nobody Tue Jun 27 02:12:56 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4QqpC03pGdz4jrfQ for ; Tue, 27 Jun 2023 02:12:44 +0000 (UTC) (envelope-from fbsd@www.zefox.net) Received: from www.zefox.net (www.zefox.net [50.1.20.27]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "www.zefox.com", Issuer "www.zefox.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4QqpBz2G0mz3w32 for ; Tue, 27 Jun 2023 02:12:43 +0000 (UTC) (envelope-from fbsd@www.zefox.net) Authentication-Results: mx1.freebsd.org; dkim=none; spf=none (mx1.freebsd.org: domain of fbsd@www.zefox.net has no SPF policy when checking 50.1.20.27) smtp.mailfrom=fbsd@www.zefox.net; dmarc=none Received: from www.zefox.net (localhost [127.0.0.1]) by www.zefox.net (8.17.1/8.15.2) with ESMTPS id 35R2CvvN080310 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Mon, 26 Jun 2023 19:12:57 -0700 (PDT) (envelope-from fbsd@www.zefox.net) Received: (from fbsd@localhost) by www.zefox.net (8.17.1/8.15.2/Submit) id 35R2CurN080309; Mon, 26 Jun 2023 19:12:56 -0700 (PDT) (envelope-from fbsd) Date: Mon, 26 Jun 2023 19:12:56 -0700 From: bob prohaska To: freebsd-arm@freebsd.org Cc: bob prohaska Subject: -current on armv7 stuck with flashing disk light Message-ID: List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline X-Spamd-Result: default: False [-1.09 / 15.00]; AUTH_NA(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-0.999]; NEURAL_HAM_SHORT(-0.99)[-0.993]; MID_RHS_WWW(0.50)[]; WWW_DOT_DOMAIN(0.50)[]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[freebsd-arm@freebsd.org]; R_DKIM_NA(0.00)[]; R_SPF_NA(0.00)[no SPF record]; ASN(0.00)[asn:7065, ipnet:50.1.16.0/20, country:US]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_COUNT_THREE(0.00)[3]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; FROM_HAS_DN(0.00)[]; DMARC_NA(0.00)[zefox.net]; TO_DN_SOME(0.00)[]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Queue-Id: 4QqpBz2G0mz3w32 X-Spamd-Bar: - X-ThisMailContainsUnwantedMimeParts: N A Pi2 freshly updated to FreeBSD 14.0-CURRENT #41 main-c3e58ace31: Mon Jun 26 17:06:01 PDT 2023 bob@www.zefox.com:/usr/obj/usr/src/arm.armv7/sys/GENERIC arm got stuck with a flashing USB disk LED after starting a -j3 buildworld. No response to debugger escape, had to pull the plug. Reboot with kernel.old, FreeBSD 14.0-CURRENT #40 main-c1cbabe8ae: Tue Jun 20 03:58:47 PDT 2023 bob@www.zefox.com:/usr/obj/usr/src/arm.armv7/sys/GENERIC arm seems ok, I'll try to run buildworld with that. Thanks for reading, bob prohaska From nobody Tue Jun 27 02:38:22 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Qqpms5Psxz4kKBh for ; Tue, 27 Jun 2023 02:38:37 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic310-22.consmr.mail.gq1.yahoo.com (sonic310-22.consmr.mail.gq1.yahoo.com [98.137.69.148]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Qqpmr2gyqz46nB for ; Tue, 27 Jun 2023 02:38:36 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1687833513; bh=4xdC8a2rezo8gUjvzMPW1dnMt6CDUp8nPkuAph9aYxs=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=UyWYQJ2tmjJmI3xh1XJ+9AFhJOLHg5ewYvdyeHOI4qh0RdjyvGCW224dJJq1aVbJif3KCNctehWxcYTlb9EXvT2pzcSalj3S9KmVSCjNLaY2LdylIDzMiYlbCr/iyZLDbo0pjVp9M/kt4eJ2/zcZFuvsF+1LT7XGHo26B63OS3O5wjmhFdSqrax9KjQDeE79O1OXmt92OblK+VQ27Tp7vpezZHkMWNIaRZRas40izyrO1C62fVo/X2mY/vUkpcZw+8fdHesUzQH1oxrcuj1ikEtDDPY7RVTUV1V18HZqbBkdZqHQ1/lr0CCulAn/RBIREeX4NXcS1w9Wv53xMS6JWA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1687833513; bh=UR9lDk9BgHbwN+iJatAfMW+jWtA9MEFk0+Sz4GiHowz=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=LTgyAUDoplYTZv/aZIUlfl50+655lk5qtC8kRV7mrJXayo3g2uPhMWpNoF7duDwtd/cD92kgOBhdFKkomOnGt3LNKGf3BkvtqSi2pGUMQMX57yE9Z5CrdWYOnIQZV9zthRyyGB0yDLXW1gRPaNLFZWTsMSHdklddvo+MY335y798LkaFgPqFXhbR+6T7wS69KIAnmmE6rFchrYTcOIpXOK6yYXRI3LZVtLupaVMIwtnyLh1hEJ92kBeM7tufXidGmKeXe7wLOAv4HXSwJtmxUtqZDEdyTN677N8RlDN6F+SNgwBgCFsNHHV4Aw+oaJgqFtmkvxJBBe4Rj6Wrhf781A== X-YMail-OSG: AG62_oMVM1ktgBXXHD0KRY5HzaqjhhUhdNzEwgz6yZn8UxH9Jr2ZMosAa5VYN2Y IEPQ_4D3NAHVHPi70ANDl2B7TeLtb.Dy9urwksoThKWd..6B3EeTNj_lUOKB14mJEpjhLFel0XlM Dy_RLdib6oOO5acYPfWOsl5k9ZLSzHLiviS2lcoXvUWhYEEZs4vDjSzC5gWYUPjzDBqrzagMmxHX ajlPMDhTF_bjECXPPO.hrSswzEzF2nENb5nXbHZjOdmR9SfUthyMV4HrYWHR3MxROrNFdK42UssW TtvtpUV2AQLtmtuqoPRuhQaub3CvtNnqWUXr3n3LeGk88FjTGmnFkxyS_WG7jPGLce.BPxSZw6zE 8URW2u6qCuyU9u3Voe5EyC7AWxZwdUaQ8L7zryVcFZwmnL.h4ZylDsqtCAfxhwrDa.zoDsLinVMM tnhMcSQVtt2W00.PdGf3O7C9aQBs6GpaoeVtRInx3rRFXyr1IfQBXFyyQsrlpqcXSFfAiGfWnAJu 1eJYZQMOrmtT9AyLd8rd3wiZ7ojhEdAIEwZjtuBWVPWC0xceyQXTfXcQdaoyUR8B8tYugfqacE02 _E.HhBOpq2cBQwligS.A6QaeDUyZ6Xnl2yooWuc4ogMDRz9Qx_jBK_ahlQ4nvX6oW_65plk4aPlx D6PZijHhfYYh520NhZl4HmIcOF5pAUpqyAlOk3Ll9qongai7Kuv4Lei1XBZ.nelwMFSp04h3lKiV V5pmKLRq8k8fbpyLqF36Ecad9M4ngTkaedFdZFh_JEEwuzVF8m867dA8f6j87zA9q8CXPemrRIMN rgwuJ9a8qYuww8ykrqyRA7S0L53utU94w6gJZcxv_Td23FcBDwTbSEVEEJ_U15W8_Jc5FThjlzgi Cpw7IRpoEefSvEnHS4MetQ.YCsI36UVj4XjNqD3ShgS7IpDqxa5F4tngg6Na65g.ISlKydO0QiPt u_iMBe6Wvmmj8uG93makntyBtuejUWqfBNMmoZJBhaoJZjO4VDXlCYOaf_KmJxEf5K.VgfTqL36I 70eipAjtYOAmT.M10eNAno5CtPmGcFOrqSJn0_LWYou3ZrPeF0t7uyNZt02SRRdZ9cwiVuKLHGBH 1cNeq3xLkZ_Jh6O13W7o_t.DyU4mpQis9x67wiX4aWEpofiUYggb57h.UDerPMk5Dd5M78tJPMkN trtWtQyFBImd0LFWQbyIHzJiUh7C1xgWb_.xke8mWU1gwXXU1bO8rlypNCNGvYyBRI9Ume9uf0ZE rhTmfLGNVG5Nzacu4JEo3g.XamVLUc.Uo_wxt5BZJdAiKtELxh0ClnH8.Nzwwqaa9rHouisBLMPj _c.WxQIJSiiaEm_epQu24FjWZjYW0WSAWq89j.6wIXab_tmeb7ER0hNXGptJ1.WZjjvengFF5MFy QEIXi.agw6lcriL.9KJ8G1X6abBGUmoZWu.FaGGS.HYZr57nDjKAp0GjZ2eB5E.6O29TbEOSi6ls 1uA7bUoqlWYPdNi0apuW1w1nWij98q6wnWmDMxHOreAXSfV2Pm7IUrrd1jVXEtRENvbYmu5zG7Yf i4k2O1x1vyUOJ1bPBC9S6V4l0ko2vq30l6otIm0hJyUrQEH3ofZ4RacH9vP7Cz5j7EapiJGfwUZD xpeNltIhMzU0yrEoCG6I5D85xLZ4dU0criTJ9p0QT.qT.FjeQtuAILrBCiQndrDUWoFrpOiwzK4j 7DoOBf.Xzt5qcJ0rN7JGEpjSj17dXv6oy_2QJlKr_veAeRjbUo1eim7cLFbI5e2qOQoRGjeUQyBM qaob4Fi0GhbhVEE1uT7gsTSyZgP3J9OUOgidxQM5UqDbXMjnZiH0rN2tZ7rp598_bmyyNI30_WUA z7rAMUpzpu6qip4.brj4x5xf00WV8AULaA_0hrF6DtmQc25LrSmzJ4esLIBo1ou5vgySCDGqqiFa 6DVqqtrgg8FLwLzAoRB9DDP_FytwUA4cJPSRS_3IrkarS7lqPJF8a5eHa4yNnk_4hhHEZYtdoTI7 2vU.S0lkLsP9t9BavrBGkkBQSNTjqrM.B1iIEtE0yEVie.zPsy2JUVAoYFQ2fQmM9Al58ZwlwTBr yGugRILpu5d5pHi6qPandy1zuCj510A6u_hzV6WfVdI5Y9LdJ9aGEezJtMrRvGMypfuhzEnS06hP EkrMfebrXMcsjLToZjFIe9FJQzsQsFlQmHrmkF.VMNBQTwc.gTLYWKQjMiUOPeD2NeuWEQ_F1_3B vQAfIh44tYCbiR0jjDnDLXEBUAdToELYJmpKTOzEuovNxo1_DKlQWWLszJ2VGeVAuJ7t6hEV8 X-Sonic-MF: X-Sonic-ID: b898712c-975f-410b-ba98-33e73242d793 Received: from sonic.gate.mail.ne1.yahoo.com by sonic310.consmr.mail.gq1.yahoo.com with HTTP; Tue, 27 Jun 2023 02:38:33 +0000 Received: by hermes--production-gq1-6db989bfb-xtcqt (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID efc3bb2baab315678c825661a6154796; Tue, 27 Jun 2023 02:38:33 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.600.7\)) Subject: Re: -current dropping ssh connections From: Mark Millard In-Reply-To: Date: Mon, 26 Jun 2023 19:38:22 -0700 Cc: Jamie Landeg-Jones , freebsd-net@freebsd.org, freebsd-arm@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <601E35C4-CDE1-47A3-B2D2-29501AB5FB93@yahoo.com> References: <202306212305.35LN5ITH069587@donotpassgo.dyslexicfish.net> <202306222238.35MMcoQm017939@donotpassgo.dyslexicfish.net> To: bob prohaska X-Mailer: Apple Mail (2.3731.600.7) X-Rspamd-Queue-Id: 4Qqpmr2gyqz46nB X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On Jun 26, 2023, at 19:00, bob prohaska wrote: > On Thu, Jun 22, 2023 at 11:38:50PM +0100, Jamie Landeg-Jones wrote: >> bob prohaska wrote: >>=20 >>> That seems worth a try. >>> The notion of an ssh escape (~. in this case) finding its way into = the data stream is new to me. >>=20 >> Thinking again, that looks like corruption coming down the ssh = connection. >> For the ssh escape char to affect anything (note it needs to be = preceeded >> by a new line) it would have to be sent up the line. >>=20 >> For an example, assuming ssh has the default escape char, look at the = difference between: >>=20 >> printf 'pwd;\n~.;echo sleeping.; sleep 5' | ssh -tt user@host >>=20 >> and with the same printf, but no escape char: >>=20 >> printf 'pwd;\n~.;echo sleeping.; sleep 5' | ssh -tt -e none user@host >>=20 >> You can see how the former closes the connection due to the \n~. >>=20 >> (The -tt forces a terminal/interactive session to be set up - = normally, as we are >> piping input to ssh in this case, the terminal isnt set up, and the = escape character >> isn't used - it's only recongnised in interactive sesions by default) >>=20 >> I personally have "EscapeChar none" in my ssh_config, but I suspect = this >> is probably not the issue here, still, can't hurt to try it! >=20 > Indeed, connection was dropped with escape character set to none. > There does seem to be a some dependence on system load. Connections > survive at light or no load and drop when the sshd side is busy.=20 So how busy is the disk media (really the USB bus) from somewhat before the failures happen to the failure point? The question applies separately to both systems involved in the ssh session. I'll remind that on a RPi2B v1.1, RPi2B v1.2, or RPi3B* the Ethernet and the 4 USB ports all share the one USB2 path at an internal stage for the USB subsystem, if I remember right. Saturating that USB2 path with data transfer bytes to/from disk media might be able to block other activity long enough to cause the Ethernet communications to have problems for all I know. (Amount of data queued for transfer would be relevant.) This might be a reason to avoid settings for the combination vm.pfault_oom_attempts and vm.pfault_oom_wait to values that could contribute to a sustained period of saturating the USB channel. (I have no detailed knowledge of how the tradeoffs work for the competing uses of the USB channel. So I can not validly claim to know that the above is realistic.) =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Tue Jun 27 02:57:05 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4QqqBW2Zv9z4kd2W for ; Tue, 27 Jun 2023 02:57:23 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic314-21.consmr.mail.gq1.yahoo.com (sonic314-21.consmr.mail.gq1.yahoo.com [98.137.69.84]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4QqqBV6vbDz4JWx for ; Tue, 27 Jun 2023 02:57:22 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1687834641; bh=MbV246HExA5S1HQtUJaup0boVA0vcts0Ejje0zm4+BA=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=lgNYeZMOhKbWxRbP9U0nV6g6L2pxOAjhCh6Mh1yQo18ejSV6mxYmKjXVq9m4vwWxLeU4uctr/fPipo+GYVWvM9zJUqT7lK4gqbRQ3zaO5jK58p7hBHQ3AqToqTNmfSiYadVKpVT7RU2uW2A6JVsi31LGGyHSGo0QK1+qrMqHGGBwuQqqwQUvp34MMfd0AIg4S9tAkxk8F5F1orvOaw/brZ+qxACJafraxo+w1wYwKAIxoOt5WZdlCt1+RCik3Okgz8B4lChGotmJD8RYkyBmY6djzLasWf23t6Mdp9jHJ7frdsn5cV7wGODY0GXGYa2JK4RQyg+pFbnlA0nxKXzSOg== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1687834641; bh=PRUfcpOx4eiEP0ctOlgsxm/uUTBkt13hsBASYhLYy51=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=jeuHLOPXBgQhrfL7Zo1V97++NWQs2hGiiPjcoW66i1JxMXwro8/Otrc/2TyaaDKzbzH1b3P8lzOJEdJHWfP9BwV3tCFngsfaPmXyZHbQ9DjQVG3hXAu2bVon+oLFWvSHC2jhB67iG8kAOA6lWYbOA/PxMNJn1LS5Ug1WVfqZ1Cc5L6yroLZ1DCy7zf4aqADdxkgZZgisDaKJ4fRZJwHTluFx0GtQpbc4zaBHYS/YINWBa3cguTVy1g1xYymUJ02KbKE2e2NfnYnWCNhrY95ks+GS3vOpLTPvW8L8+Vc7s1T2NCzRhHdU20FQGGTYQ/38ZctfVT09H1I2Lkv/Y9Ks/Q== X-YMail-OSG: oQHJyTQVM1kQkxbnzssm4LZ7J3aQUavr_hiBJtXWF9J9Jr7YlGaImjmjUiAdTbQ XE5rXB3vKH.TiQrkdZLRxdccYp3L1HoyIWb0KdIMty2jrQ2reF0FeAizIFSSUoV1cVwVeU03NUEs 0NveCH6YUjKyoo1.xc1ViOW80H7jonwZAWG4.Bat99HCfjQsEZZTB4Yha_1WzjUBZHiu5GPrKtO5 F5ckjqq8UwnzmQVijV9lJMLn7aph6rlkZlxcMiaKLm75rArWKo6lfCrf5Y2T.KtvSav6iIaa6Ua3 hG2fvkyDm9FdavLnGYgH.JVAlx1E2mVf3Oim2lnDpeCd4Mi1qNajLa3cZcEcoY0jWJjzdJCaXHE8 61VwVlseb5g6uXpkWL3srFnVB_al4x8mnIfUzZYvco3t1PVkcikVeSL8f_qxpOIfZaHdn4QdS4a4 HAtB9SXc2zW7q1rNsPhAlXcuWZnDF4HQ99GoQQu3knnBrw4JYXDJp5HxaM07uGd6HS.8oJE4TvWH T3UXZQKOe_8dF.k0tobhCEs4aO62Bi5S5tbJmWbAIyIShktz0AsAwn4mDC6n9AniQj6jHYd2yq6E hCtHg4RdUZJ.5siVZQFhQr9dzTif9x6WMu7QU5.H6i31bvcDsBIQCg6Vg7twWSpD9Vjpnf8gVg9G 5IBAqr6aCcJ4Zbj83lqf0xuy2JrPXv4IdqijSMS8CrXLY1GvjKPdPaoEslbOuEa0nofDnWRBCu3Y oqXo.O.wDQWTQd0xMNFdABBRfczUeJTqY02TR0AO956C_2toEjBeMZiztClEABAiKXS4RG3RH_5C fWR.JXwnElIjTIS5TprlT3LvTj_3t242KLg.bRMAXa11o_01t8i8dLxBNneCWDPgpuaVEYJHKiSm jrwouTIEmHBBjHjSfMhpWDXnt.RdgdgwTClbv3esWAWlZr8151agVsVM7StURGVld5KhYy_Gaotx qDoO1k4wdSV.4C7awvq0cHZCDMQUjbXbQhn82yoEhP8yJC5JqlHvYcNq_b_5JK8_.NArVYmw_Eeu gvI4zmCbfQI5qI3LBgXNEGtoFf_IVJw0Wh5rll0OR0bQ16Jwo2rumlFUsmAE0aKCpPZ8hCr6LGSJ CVfq1l99YuZxZPzifcy3rM_RUfPiqZAT.FK7jDv7xcaLOrzJNkKcQYH_SGSDsUIs_iXBHMXYae2I oagOlbko38S6oT0J6340Ay7wZNher9GQT7Ot1e2NVh_N1n9vI4ts3l7lkEa_Cz_O44SMh8Mr6T.A ESDwHrG9TePnYqiXVB7ezYnubP1f8pPX8JoJ_oFeZ39hJF_1HfUwmHtwoW1X7APTjVDw3EBAbAFS gR8Y0DCzhSPxjWQu4jEqWWnCWXlJXDXwFNR0XYZ6psQDMK3NRu__9zbFPVu0Y.hNwlEIoT9.8Mog kaj8_KXhB11i9l7SI1oYqH6vijsUlNXCfYw50PybgFUu23LPI_qF.F.kJT_LnG6esHWMNlyZqjlo 5S5BgenLgBVROGETn4nPmJJ5_SNFsXYmbcaL.ctNC5dVqjVtgK9FoQq2XW6ufQ0n8zJDSASDQExL hrd1oRq3VKALsnlYQrHGX3LYOTNbX7b3bjZh2NZ6QAJ2DTTE_FGDpnSxKXM8RxUIrZP5UNh1QBJg f9aD3YF0ryGKxvd_1P8rmPeLiizHaSuQ9cDwcfpKdjLKLcckcpAA8S0dWDntHI_CXW5yFqG6wII6 lET6KoWyTLP2PDJghPNCu53N79nbGKO1eCHI5hTMLdDFt0DfQAeXRuFUis.5MxFovnV5VmC3D82v dV1a8hepPEjnwSCqDVk.T_gNj5YT1dDLLIPiWt1x53cQqX7YxmkYCc4xqHdCsz2EDkAtD0_GeXcq ZQmQ_sZ.mxOMrEz72ayMHLjwg30M0rwNKciK7pUVBwSHjeQSa.WU5cHZsl7m6GFNHaybdPrXXNS. Fqk99Atbvfpm5nFNJ9BJwBnC2G82B1pTZ_MErwuRlxT90F_8PR.yigSaxD3KJAZb2lbHX4Q.PR6K 0HTqsvClVno5a51OdRdhftMaRk7BWPgd0O59XembNpBIIAjxhm1rLISFYl4DXPf2RcBsIweWRbGt zk83oJCrL3uQITlCgwvT9z9zab0v0ZfwJEvdhribZt8VhvTs2xaZTW1KaduptRm5U6kaNu5jlsRj Vo6NBjfyG.SIZnjOhceEzU9w49XEvxQlyQX8_v9DVovN7zydiXWjTXvccyvoMsxqpDQFXLqmEipB CX7GLAGHrn9O7mk1xYSI7X2_7hy9GwSpLyAGTH64_oJUZVxnHjdJELGZ5NLzpYtgdqWEgXxdL7A- - X-Sonic-MF: X-Sonic-ID: c5936ebd-6010-412c-bd8e-0343ba900709 Received: from sonic.gate.mail.ne1.yahoo.com by sonic314.consmr.mail.gq1.yahoo.com with HTTP; Tue, 27 Jun 2023 02:57:21 +0000 Received: by hermes--production-gq1-6db989bfb-q69gc (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 78451c7a2bce91ac05568321197638d5; Tue, 27 Jun 2023 02:57:16 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.600.7\)) Subject: Re: -current on armv7 stuck with flashing disk light From: Mark Millard In-Reply-To: Date: Mon, 26 Jun 2023 19:57:05 -0700 Cc: freebsd-arm@freebsd.org Content-Transfer-Encoding: 7bit Message-Id: References: To: bob prohaska X-Mailer: Apple Mail (2.3731.600.7) X-Rspamd-Queue-Id: 4QqqBV6vbDz4JWx X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On Jun 26, 2023, at 19:12, bob prohaska wrote: > A Pi2 freshly updated to > FreeBSD 14.0-CURRENT #41 main-c3e58ace31: Mon Jun 26 17:06:01 PDT 2023 > bob@www.zefox.com:/usr/obj/usr/src/arm.armv7/sys/GENERIC arm > got stuck with a flashing USB disk LED after starting a -j3 buildworld. > No response to debugger escape, had to pull the plug. If I understand right, the LED flashing means the disk had not stopped doing I/O: the system was still running, doing disk activity. (But I do not have a description of what your drive documentation says about how the drive handles the LED and what various patterns/colors may mean.) If the processes associated with processing input that would identify the debugger escape had the kernel stacks involved swapped out to swap space, I doubt that the debugger escape would work until/unless the kernel stacks are brought back into kernel RAM. Avoiding the specific way of losing control is why I have in /etc/sysctl.conf : # # Together this pair avoids swapping out the process kernel stacks. # This avoids processes for interacting with the system from being # hung-up by such. vm.swap_enabled=0 vm.swap_idle_enabled=0 (No claim such is the only way to lose control.) You might be able to get a clue if their was disk I/O going on based on modification times on files you know would have been modified periodically for some time (minutes) before you pulled the plug --but not modified on reboot and later activity. May be a log file that would only be modified by the build that you had been trying to do? (You did not indicate how long you let it run with the status "possibly hung up".) > Reboot with kernel.old, > FreeBSD 14.0-CURRENT #40 main-c1cbabe8ae: Tue Jun 20 03:58:47 PDT 2023 > bob@www.zefox.com:/usr/obj/usr/src/arm.armv7/sys/GENERIC arm > seems ok, I'll try to run buildworld with that. === Mark Millard marklmi at yahoo.com From nobody Tue Jun 27 03:09:14 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4QqqSW3s5zz4hbL1 for ; Tue, 27 Jun 2023 03:09:31 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic311-25.consmr.mail.gq1.yahoo.com (sonic311-25.consmr.mail.gq1.yahoo.com [98.137.65.206]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4QqqST5BSBz4NcB for ; Tue, 27 Jun 2023 03:09:29 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=BgHYYQQZ; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.65.206 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1687835366; bh=pMZNv1R5DbIz10qE3Xd8irfq5E6ut/tyUKNQCCKe0uQ=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=BgHYYQQZKM4zucoa9BEgcraersOy3pD+roCBgJhiZE7TqumsNOT+0UddzvOlhnFThporRHV+yIo4Mhi6EiUb/UWl3h0RV7cXUBPXM9DMQwhPjppKaQtYZ3VKhfeIlj4Ma1sid+R0Y61QVETJp8S+3eCGwwlx1n3J8ywKnvONgaz7wYISmLyuZ5uHioxAOqN8RAVI6dLo6FRnTGqs08XQTSlNlw8J7ODvuTrSqcIEufL5MGpnbHt0lz7VwohZuTQ9qdApZpyc/32VX0hGmgSWhwoPwlq4rBaRSbwytYA/jnd/qew+EoiupSGQq9zqBesrGvJ7obxN+D4xz7k0VIC0Uw== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1687835366; bh=d/e9h+OIKRyppccdH2U9A3sB0S7ekxNC8VWeZtVGWqm=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=TPBrlMP1IjYHRfAIsB82i70MxOI5IylYogMGCLYts12d9OoMcfWw/QE5wcbARft3PdVnAkiY9GeVKcGYayAgzCob1ei+NFQ7vALLhmdrmW5AmAJomaE2WY3FdixrfciXYaxs4Mfm8PpftWKSp6MgIh7923geDF/iYhh822SQeonZZl5O/T0WGJbuaMpKe9oW9jJAs2aL+LZTjL8xyjqtuL9dZPN3DBxNX9EkuMg6okxDqynRx2YtICaeTHqwJlXDwuCagWV67ag1RwyNLvu1wv9ADfiZkfsz2r7WXKOzjxQ4n4PcLiPMzm5/3gtfWiNd93AH2o904QGlnUjd9Ng1JQ== X-YMail-OSG: AEibRGUVM1k3_s.jvefspSS087BHgCfdHhVpnsaPckCfq.dMBB7Nb5tmBy9Bkkk 1ws_RDoNwVTbZnqzl9IA5.Y5wgpx8wkF8t0XzXC1fk_RP_5Jg_puV7YOKpgCLWDjHvAbYED0oMrr xzco2vGFLg9mKm2pSB0rG9O.jYeDDbPtHdyFr8s5ozWdF.RkX6DeatDxkRHa3QKrlAnQeT1z3lDk hrdQuLeWi5lZH.hcfVodNeKofPA9i7ZXeyOd051AOXwcUeTtOV05LKMKL9hJTSskbGeED.MiqgYX PBjN6O.v1yqF6iGvsne6gT2_qxOcoJOfd4euY.tcmXDc3YbItR7r.BKqt4emFTfEqAyS9kMNUvNy z2zYuYRNKwoXSERVPLIxluP8KY_VnqZ8sq_hhbRuWOCzqJyNtScTWLcQLqtpXn9wwunbN34cbYah DYMJzLLnTSSgrtLCGlkb3IX4GQR.I5ZSF.Pq0eIyenuse0i6wZSKMwe_ebv43qjQnOVrpjdUd_YM 0xiQmZKPuLyMMWeb.Hvg88zvqMVJDeWyA.I48pLYb0xLY3mOgAa5wjp01Vd9aQA.nwOs9kLsgw4p L.02AmVeLW7i71JNPUYCXYux0et4cbkbMv1YkF8BcrEwh2l7vP0C.tV7SA0rnz63NFThCkDoG9gQ jXA85CfXhH6ECKawrby4YmQwtEMDaosfSmJGYc7b1AEPpVDGFt1XfY.33.hW4LuELLduHXkVn.gL 5coK43JvE2Mp44LxsWZ8QfCyyrf9aOKPW9HIjneEz8Hsc8SH.7LgFaanCN03g1Xk0NyOXj3G9giz XMoq3dsuhq2bauFKJwIkmtbedC5KWVJPbh.hPZ95qH9UKrkE.YWGP0q8GrDHJQT5g4gFUcfy5yff zIUjLR.1MM7sPyfc_4Fxco9.VDA5qv2uMSb9bydxxqXE8hPVo5Dla7n18c9osOBVEIo.YSDz20o7 fFalfHn1yRYEreFEA4fHnBviB2O4jTRY_0qvTe1aOGNIF17eZ4860FcvvIoezrnPNAGbqpAqyt0g HpWPbkYxcUW4iE7SG7L78VccUQcK3bmXlPrwa2GFEdC.mX4oJWaMlEe2oTWSkYVouMqFqC7pJckd jRwKt4pQI2klf9b4cyiHT.qI_Nf86wjw7RvfUynW_nrGOOyYQ_AYHGi1YfB0m0spKpOqttWJn8C6 WeZrFnjio1bjT_otB9hLSS0YvSZh9StVf2M3hRzNteu7EpuHN6rc.5AkKlWTC6GqnMqKART7rtwq QApj85yGSNWZ2rCHju.Jfau9M7uj.1tYgN3x6VKlE_00ZWlrec9KfNgT19KOC5n9.xhgY1iBJtLZ JKRAb5GrEtUgq9QqTIvzv1S3zeF3OiPw_8ByRj8bHrFLi_5kcUPHGImTC3jfWmMfmF43GFgICiJ2 Lk0rm8t5J5TgULt5Vwys98SDE5_MOykFAyfFs2Yh5ADNBZxkJoow8yQUp20dzjxr3mdBeqtY4LYL gzbOeXDMXZHzbjarkHWLiPwcNUMdr_zY3MzmnsaitUz.XLk8FwmHmHiZDMufLj0Wvd3nNMPCnGgN WXENek47.3aW0RI0s499f2v4MVEEx7f00aCeL0FZbBmdzDSa8hqNThN.zHXTBxT9qdwDRkNFN_uv B3i00_CGESbZdaC9LZjz4kWGqiabUG_RYNS1kkk45.0aesyZ1asnxaofpBNpXKNKXiCyI_vsOupf SaSQMxwFwMFQe7x_QI74gp0vANycN47fZ2aGxCOxpVF74gpiz87cd.gPIfh0Rulj_kx1usGJFeXq 8wrL2h0BxNvJwowzcBN9aYlRiB4gGX1Yt1m0.PlgqdLiH1NThUr6UBkZmK40C80ynzTk5pLSOVXr i2BgUEGXnWO0zIOSryKu_W0QbxCwCvTkq81GFRrDWYBO66jPu03EkdnMRrSTAg6aVAibV10DbjsQ kw51xCNXMF3QUS9w9CqCG5QgS4vnEqBz.xlZNcyIZsVtB2DY1xUGqMVoMa5aWVK4O9KdP_aZfoZa H5fq_YMd1TFZmTDVYYraT8YYCWYAxbWqQt45Qn2wLsOAUFPK_8pK7v0WIEoMWEwE8hCn9lEjlH.M bCZLbJm0gkqNGphzjHYAmpS84qFm6euWRJEpeCw0TfOyu9DlsnFgre7RfqOmw.Zqw8qjtdb23Kqs eANJEbg3qqsqvJP6n0Yf73JMT1BfpR2Q5m6NSSDo5meDj3jPndgwzrVIVbSR3kC2oyJXLlbsgFMw nErF6InPVYLewWPt2OkX1v9bejE6KU56gxZd09R_sKwpIOTdu9QurCb0RTaFlyEOQx1LnTBJYLw- - X-Sonic-MF: X-Sonic-ID: 70621102-ce6b-4935-8ac0-72edf5209633 Received: from sonic.gate.mail.ne1.yahoo.com by sonic311.consmr.mail.gq1.yahoo.com with HTTP; Tue, 27 Jun 2023 03:09:26 +0000 Received: by hermes--production-gq1-6db989bfb-xtcqt (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 943593f931d8ac5e97d5efa5273154cd; Tue, 27 Jun 2023 03:09:25 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.600.7\)) Subject: Re: -current on armv7 stuck with flashing disk light From: Mark Millard In-Reply-To: Date: Mon, 26 Jun 2023 20:09:14 -0700 Cc: freebsd-arm@freebsd.org Content-Transfer-Encoding: 7bit Message-Id: <20D78E37-CC42-4FED-814F-22B0C5B924A0@yahoo.com> References: To: bob prohaska X-Mailer: Apple Mail (2.3731.600.7) X-Spamd-Result: default: False [-3.18 / 15.00]; NEURAL_HAM_LONG(-0.99)[-0.990]; NEURAL_HAM_MEDIUM(-0.96)[-0.958]; NEURAL_HAM_SHORT(-0.74)[-0.737]; MV_CASE(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.206:from]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; MLMMJ_DEST(0.00)[freebsd-arm@freebsd.org]; RCVD_COUNT_THREE(0.00)[3]; FREEMAIL_FROM(0.00)[yahoo.com]; TO_DN_SOME(0.00)[]; RCVD_TLS_LAST(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; FROM_EQ_ENVFROM(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.206:from] X-Rspamd-Queue-Id: 4QqqST5BSBz4NcB X-Spamd-Bar: --- X-ThisMailContainsUnwantedMimeParts: N On Jun 26, 2023, at 19:57, Mark Millard wrote: > On Jun 26, 2023, at 19:12, bob prohaska wrote: > >> A Pi2 freshly updated to >> FreeBSD 14.0-CURRENT #41 main-c3e58ace31: Mon Jun 26 17:06:01 PDT 2023 >> bob@www.zefox.com:/usr/obj/usr/src/arm.armv7/sys/GENERIC arm >> got stuck with a flashing USB disk LED after starting a -j3 buildworld. >> No response to debugger escape, had to pull the plug. > > If I understand right, the LED flashing means the disk > had not stopped doing I/O: the system was still running, > doing disk activity. (But I do not have a description > of what your drive documentation says about how the > drive handles the LED and what various patterns/colors > may mean.) > > If the processes associated with processing input that > would identify the debugger escape had the kernel stacks > involved swapped out to swap space, I doubt that the > debugger escape would work until/unless the kernel > stacks are brought back into kernel RAM. > > Avoiding the specific way of losing control is why I > have in /etc/sysctl.conf : > > # > # Together this pair avoids swapping out the process kernel stacks. > # This avoids processes for interacting with the system from being > # hung-up by such. > vm.swap_enabled=0 > vm.swap_idle_enabled=0 > > (No claim such is the only way to lose control.) If I get a loss of control, then I can infer that it was something other than the kernel stacks being moved to the swap space, presuming no bug has been created in the handling of the assigned values. Without the assignments, there is not as solid of evidence pointing an any specific direction. I prefer to have the evidence. > You might be able to get a clue if their was disk I/O going > on based on modification times on files you know would have > been modified periodically for some time (minutes) before > you pulled the plug --but not modified on reboot and later > activity. May be a log file that would only be modified by > the build that you had been trying to do? > > (You did not indicate how long you let it run with the > status "possibly hung up".) > >> Reboot with kernel.old, >> FreeBSD 14.0-CURRENT #40 main-c1cbabe8ae: Tue Jun 20 03:58:47 PDT 2023 >> bob@www.zefox.com:/usr/obj/usr/src/arm.armv7/sys/GENERIC arm >> seems ok, I'll try to run buildworld with that. > === Mark Millard marklmi at yahoo.com From nobody Tue Jun 27 05:47:00 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4QqtyK2pQmz4kCYj for ; Tue, 27 Jun 2023 05:47:05 +0000 (UTC) (envelope-from titus@edc.ro) Received: from eatlas.ro (eatlas.ro [86.126.82.18]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "eatlas.ro", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4QqtyJ6yhMz3N3V for ; Tue, 27 Jun 2023 05:47:04 +0000 (UTC) (envelope-from titus@edc.ro) Authentication-Results: mx1.freebsd.org; none Received: from mail.edc.ro ([10.1.4.58]) by eatlas.ro (8.16.1/8.16.1) with ESMTPS id 35R5l1n3065738 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NOT); Tue, 27 Jun 2023 08:47:02 +0300 (EEST) (envelope-from titus@edc.ro) Received: from tituss-imac.eatlas.local (eatlas.ro [86.126.82.18]) (authenticated bits=0) by mail.edc.ro (8.16.1/8.16.1) with ESMTPSA id 35R5l0dY037330 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Tue, 27 Jun 2023 08:47:01 +0300 (EEST) (envelope-from titus@edc.ro) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=edc.ro; s=mail; t=1687844821; bh=OMUjNAtxCjNMqWLMWBbcaD5x2+3Rr3olGzrZ0NO8YWI=; h=Subject:From:In-Reply-To:Date:Cc:References:To; b=d8cc5shTefsHwEU+TtBEgBuFXtHTUqggw7RE0+N1JT/luQxs7akYXi8pCCl64/x54 JaWP6uzwIbTHuvMmC5LYN0IYuowNJyy0hrVEQBYtczU5ZI2LXkV81Cm75pzlFRW/gM 1gAsV6a7EhAPYxF0Rmj8pqh1fzCZAdi2/6yrsDi0= Content-Type: text/plain; charset=us-ascii List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.120.23.2.7\)) Subject: Re: allwinner h616 + serial console glitch From: titus In-Reply-To: Date: Tue, 27 Jun 2023 08:47:00 +0300 Cc: freebsd-arm@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: To: Marcin Cieslak X-Mailer: Apple Mail (2.3608.120.23.2.7) X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on ns.edc.ro X-Rspamd-Queue-Id: 4QqtyJ6yhMz3N3V X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:8708, ipnet:86.120.0.0/13, country:RO] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N > # stty -a > speed 115384 baud; 0 rows; 0 columns; > lflags: icanon isig iexten echo echoe -echok echoke -echonl echoctl > -echoprt -altwerase -noflsh -tostop -flusho -pendin = -nokerninfo > -extproc > iflags: -istrip icrnl -inlcr -igncr ixon -ixoff ixany imaxbel -ignbrk > brkint -inpck -ignpar -parmrk > oflags: opost onlcr -ocrnl tab3 -onocr -onlret > cflags: cread cs8 -parenb -parodd hupcl clocal -cstopb -crtscts = -dsrflow > -dtrflow -mdmbuf rtsdtr > cchars: discard =3D ^O; dsusp =3D ^Y; eof =3D ^D; eol =3D ; > eol2 =3D ; erase =3D ^?; erase2 =3D ^H; intr =3D ^C; = kill =3D ^U; > lnext =3D ^V; min =3D 1; quit =3D ^\; reprint =3D ^R; start =3D = ^Q; > status =3D ^T; stop =3D ^S; susp =3D ^Z; time =3D 0; werase =3D = ^W; > On Jun 26, 2023, at 11:52 PM, Marcin Cieslak wrote: >=20 > On Mon, 26 Jun 2023, titus wrote: >=20 >> i have started to play / hack support with a h616 (an android tv box = in fact) >> i managed to get usb, sd, e-mmc, clocks, gpio to work >> no ethernet and axp/power controller yet >=20 >> so to login you type root\n and then = you get the password prompt >> so you type n+1 characters to get n characters sent >=20 >> does anybody know how to fix the serial connection ? >=20 > Once you manage to log in, what does "stty -a" say? >=20 > Marcin From nobody Tue Jun 27 06:34:34 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Qqw101pXzz4hq34; Tue, 27 Jun 2023 06:34:28 +0000 (UTC) (envelope-from fbsd@www.zefox.net) Received: from www.zefox.net (www.zefox.net [50.1.20.27]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "www.zefox.com", Issuer "www.zefox.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Qqw0z5qLYz4134; Tue, 27 Jun 2023 06:34:27 +0000 (UTC) (envelope-from fbsd@www.zefox.net) Authentication-Results: mx1.freebsd.org; none Received: from www.zefox.net (localhost [127.0.0.1]) by www.zefox.net (8.17.1/8.15.2) with ESMTPS id 35R6YZV3080875 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Mon, 26 Jun 2023 23:34:35 -0700 (PDT) (envelope-from fbsd@www.zefox.net) Received: (from fbsd@localhost) by www.zefox.net (8.17.1/8.15.2/Submit) id 35R6YYcl080874; Mon, 26 Jun 2023 23:34:34 -0700 (PDT) (envelope-from fbsd) Date: Mon, 26 Jun 2023 23:34:34 -0700 From: bob prohaska To: Mark Millard Cc: Jamie Landeg-Jones , freebsd-net@freebsd.org, freebsd-arm@freebsd.org Subject: Re: -current dropping ssh connections Message-ID: References: <202306212305.35LN5ITH069587@donotpassgo.dyslexicfish.net> <202306222238.35MMcoQm017939@donotpassgo.dyslexicfish.net> <601E35C4-CDE1-47A3-B2D2-29501AB5FB93@yahoo.com> List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <601E35C4-CDE1-47A3-B2D2-29501AB5FB93@yahoo.com> X-Rspamd-Queue-Id: 4Qqw0z5qLYz4134 X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:7065, ipnet:50.1.16.0/20, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On Mon, Jun 26, 2023 at 07:38:22PM -0700, Mark Millard wrote: > On Jun 26, 2023, at 19:00, bob prohaska wrote: > > > On Thu, Jun 22, 2023 at 11:38:50PM +0100, Jamie Landeg-Jones wrote: > >> bob prohaska wrote: > >> > >>> That seems worth a try. > >>> The notion of an ssh escape (~. in this case) finding its way into the data stream is new to me. > >> > >> Thinking again, that looks like corruption coming down the ssh connection. > >> For the ssh escape char to affect anything (note it needs to be preceeded > >> by a new line) it would have to be sent up the line. > >> > >> For an example, assuming ssh has the default escape char, look at the difference between: > >> > >> printf 'pwd;\n~.;echo sleeping.; sleep 5' | ssh -tt user@host > >> > >> and with the same printf, but no escape char: > >> > >> printf 'pwd;\n~.;echo sleeping.; sleep 5' | ssh -tt -e none user@host > >> > >> You can see how the former closes the connection due to the \n~. > >> > >> (The -tt forces a terminal/interactive session to be set up - normally, as we are > >> piping input to ssh in this case, the terminal isnt set up, and the escape character > >> isn't used - it's only recongnised in interactive sesions by default) > >> > >> I personally have "EscapeChar none" in my ssh_config, but I suspect this > >> is probably not the issue here, still, can't hurt to try it! > > > > Indeed, connection was dropped with escape character set to none. > > There does seem to be a some dependence on system load. Connections > > survive at light or no load and drop when the sshd side is busy. > > So how busy is the disk media (really the USB bus) from > somewhat before the failures happen to the failure point? > The question applies separately to both systems involved > in the ssh session. > I've no quantitative measure. Is there any command I could add to the swap activity logger that can report USB load? > I'll remind that on a RPi2B v1.1, RPi2B v1.2, or RPi3B* > the Ethernet and the 4 USB ports all share the one USB2 > path at an internal stage for the USB subsystem, if I > remember right. > > Saturating that USB2 path with data transfer bytes > to/from disk media might be able to block other activity > long enough to cause the Ethernet communications to have > problems for all I know. (Amount of data queued for > transfer would be relevant.) > > This might be a reason to avoid settings for the > combination vm.pfault_oom_attempts and vm.pfault_oom_wait > to values that could contribute to a sustained period of > saturating the USB channel. > At this point the vm.* settings are default, with no warnings on the serial console apparent.. > (I have no detailed knowledge of how the tradeoffs work > for the competing uses of the USB channel. So I can not > validly claim to know that the above is realistic.) > It is tempting to think USB saturation would account for the trouble. A tool similar to gstat, but for USB as a whole, would be helpful if it exists. It's perhaps notable that the dropped connections are seen in connection with usb-serial adapters more than interactive connections running shells. Thanks for reading! bob prohaska From nobody Tue Jun 27 07:53:30 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4QqxmP0JmLz4k0Cx for ; Tue, 27 Jun 2023 07:53:41 +0000 (UTC) (envelope-from saper@saper.info) Received: from q.saper.info (q.saper.info [IPv6:2605:2700:0:2:a800:ff:fec7:5c61]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature ECDSA (P-384) client-digest SHA384) (Client CN "q.saper.info", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4QqxmN27xCz3CBN for ; Tue, 27 Jun 2023 07:53:40 +0000 (UTC) (envelope-from saper@saper.info) Authentication-Results: mx1.freebsd.org; none Received: from q.saper.info (localhost [127.0.0.1]) by q.saper.info (8.16.1/8.16.1) with ESMTPS id 35R7rVk0049287 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Tue, 27 Jun 2023 07:53:31 GMT (envelope-from saper@saper.info) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=saper.info; s=Sep2014; t=1687852411; bh=zyo1HVu53yAgyt2IzY8xlyZQfOf8YksW/kmmV3dfo9s=; h=Date:From:To:cc:Subject:In-Reply-To:References; b=JdiOew/Q1TQw/A69tzqoE3kOGLttppfSdrnCFOCZSBjCZdyXodyeXUfdf4JSybL0B WoE16XdWfWBp4c5YYH8DkIinmR2ufYErAZH+QzifoW7+QVF6lCRtPCZoblInXJLJeR 4BOztQrZXVNMDwSBicxmvlSoigmE4msTiu4h9Oic= Received: from localhost (saper@localhost) by q.saper.info (8.16.1/8.16.1/Submit) with ESMTP id 35R7rUj9049284; Tue, 27 Jun 2023 07:53:31 GMT (envelope-from saper@saper.info) X-Authentication-Warning: q.saper.info: saper owned process doing -bs Date: Tue, 27 Jun 2023 07:53:30 +0000 From: Marcin Cieslak To: titus cc: freebsd-arm@freebsd.org Subject: Re: allwinner h616 + serial console glitch In-Reply-To: Message-ID: References: List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha-256; boundary="2201072851-830722250-1687852411=:23510" X-Rspamd-Queue-Id: 4QqxmN27xCz3CBN X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:47066, ipnet:2605:2700::/32, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N --2201072851-830722250-1687852411=:23510 Content-Type: text/plain; charset=US-ASCII; format=flowed On Tue, 27 Jun 2023, titus wrote: >> # stty -a >> speed 115384 baud; 0 rows; 0 columns; ^^^^^^^^^^^^ looks like you have a clock problem, either the base UART clock or the divisor are not quite right. Probably you want to have 115200 here, so it is slightly off. (Just guessing, never had such an issue before) Marcin --2201072851-830722250-1687852411=:23510 Content-Type: application/pkcs7-signature; name=smime.p7s Content-Transfer-Encoding: BASE64 Content-Description: S/MIME Cryptographic Signature Content-Disposition: attachment; filename=smime.p7s MIIOdgYJKoZIhvcNAQcCoIIOZzCCDmMCAQExDzANBglghkgBZQMEAgEFADAL BgkqhkiG9w0BBwGgggq9MIIEvDCCA6SgAwIBAgIQeEqpEhjRpCYIUTzTZlVD ozANBgkqhkiG9w0BAQsFADBMMSAwHgYDVQQLExdHbG9iYWxTaWduIFJvb3Qg Q0EgLSBSMzETMBEGA1UEChMKR2xvYmFsU2lnbjETMBEGA1UEAxMKR2xvYmFs U2lnbjAeFw0yMDA5MTYwMDAwMDBaFw0yOTAzMTgwMDAwMDBaMFsxCzAJBgNV BAYTAkJFMRkwFwYDVQQKExBHbG9iYWxTaWduIG52LXNhMTEwLwYDVQQDEyhH bG9iYWxTaWduIEdDQyBSMyBQZXJzb25hbFNpZ24gMSBDQSAyMDIwMIIBIjAN BgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAvxvJBqEapaux2/z3J7fFslRO WjKVJ5rCMfWGsg17dmD7NSnG7Spoa8d3htXsls1IMxoO8PyouQajNQqYmlYo xinlqenMNv7CJyEKMOAtglBmD6C/QC7kT+dSx4HfSTs8xmv8veJOldMzF8S/ BEn/tD4w/Dvpg+oXOqDyOiHPTacRFK0QHoq5eEbBmVS8W0rwcaRotO9fGTA+ NjF0My7GLRNK0eMPGh2hcPZURQhXy7wRQ8XFIfEA6kaQHHN22ncnVtwqiTmA wTR+4GNNVinG3KjNZLAVSnGrdCvT2I4Zo19hKy5PX6o7wrVXvMR4zV5VBFwV 6ZDM+xewao7Mup+SbwIDAQABo4IBiTCCAYUwDgYDVR0PAQH/BAQDAgGGMB0G A1UdJQQWMBQGCCsGAQUFBwMCBggrBgEFBQcDBDASBgNVHRMBAf8ECDAGAQH/ AgEAMB0GA1UdDgQWBBSFu/DMxDa1CmJ2o5kuj7s6aq3FUTAfBgNVHSMEGDAW gBSP8Et/qC5FJK5NUPpjmove4t0bvDB6BggrBgEFBQcBAQRuMGwwLQYIKwYB BQUHMAGGIWh0dHA6Ly9vY3NwLmdsb2JhbHNpZ24uY29tL3Jvb3RyMzA7Bggr BgEFBQcwAoYvaHR0cDovL3NlY3VyZS5nbG9iYWxzaWduLmNvbS9jYWNlcnQv cm9vdC1yMy5jcnQwNgYDVR0fBC8wLTAroCmgJ4YlaHR0cDovL2NybC5nbG9i YWxzaWduLmNvbS9yb290LXIzLmNybDBMBgNVHSAERTBDMEEGCSsGAQQBoDIB KDA0MDIGCCsGAQUFBwIBFiZodHRwczovL3d3dy5nbG9iYWxzaWduLmNvbS9y ZXBvc2l0b3J5LzANBgkqhkiG9w0BAQsFAAOCAQEAWWtqju12g524FdD2HwUX U1rSxeM5aSU1cUC1V/xBjXW0IjA7/3/vG2cietPPP/g3lpoQePVJpQAKZml8 1fHwPPivFK9Ja41jJkgqGzkORSC0xYkh2gGeQg1JVaCzcrRzJElRjT442m6F pbLHCebxIHLu0WBNjLZreB6MYMaqdPL6ItbXtD/BU4k517cEuUbczoBFZAra jq7oUBWXuroln5AMnRwVNwgJN4Np0s4kkJ94KepzbFOLzcbnfUB0+xT4foXm bM0GmmcPGOy0qvqEHJsBwDZXDxIk8oqCnnLngi7N94Sn4eTcmpZ9NH2dDN1O TEPVXgRG5X1pBcNtMWG6MDCCBfkwggThoAMCAQICDCKqoJRMYYx5sYJHGzAN BgkqhkiG9w0BAQsFADBbMQswCQYDVQQGEwJCRTEZMBcGA1UEChMQR2xvYmFs U2lnbiBudi1zYTExMC8GA1UEAxMoR2xvYmFsU2lnbiBHQ0MgUjMgUGVyc29u YWxTaWduIDEgQ0EgMjAyMDAeFw0yMzAzMDcxNjExMDlaFw0yNjAzMDcxNjEx MDlaMDwxGTAXBgNVBAMMEHNhcGVyQHNhcGVyLmluZm8xHzAdBgkqhkiG9w0B CQEWEHNhcGVyQHNhcGVyLmluZm8wggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAw ggIKAoICAQC8MB3fTYVrTadH5qE2CIa4VLvlL6QHgDriMRLkTA49SPszYCO0 fZTEpdSw8fc6kK9p2fD63LAfOHeD7jzey5aHBzpIGlxeFkn0Ce2BCYY5yLxK i9byoCwrpLchTR1Itpk1w+zy5E4T9KBTL1+c+w+TKpaIvFLXtjZtz4wQGi0p e/nRkRK9htGG3mETh+APitedl+ImGaI8NK9PELxuSkXnYAvGPpnXir8vbszk tJU1b0TevL/i3Sy6fhOhunZmTo1QDM7Zw4UyVjkQgTvL3y4I0tIrVjlam08x XZeMp+i/Gl51eHGvRVfvdJUJAjrWhrFEp8+2FZouWxWzAlHdd2sRp1AekNdP CeRgHeIF6uNtSseL1grKAjU+4BiixWPp1y1niB0humoQHoub/6fO/mU+//rW l3gTwZNu4FuKgZlfPw+qnvuka0c9dUNIZRCE5z8yXjS8R9yZWirnHNhYxf/e R2y4jaiHzPAjZlZZ2rGx8xVfB2n2JsAicj2+ZxmXlQ1yd5RW1pfxG3cdNNC5 uZ+j4JIN2ElsIjEKmMn9gHdoaEMAy/ENwNiMDBadLnc8qWirq/Ktp2dBSf2y /sH9xMpVyk8wuYjpbCnX4xslAensno5A20MYdKGPRFaItEhNPNbfzc1+4br8 exoXFX1F9ZJK9gGUO2nLbdRycphdyzxzgQIDAQABo4IB2jCCAdYwDgYDVR0P AQH/BAQDAgWgMIGjBggrBgEFBQcBAQSBljCBkzBOBggrBgEFBQcwAoZCaHR0 cDovL3NlY3VyZS5nbG9iYWxzaWduLmNvbS9jYWNlcnQvZ3NnY2NyM3BlcnNv bmFsc2lnbjFjYTIwMjAuY3J0MEEGCCsGAQUFBzABhjVodHRwOi8vb2NzcC5n bG9iYWxzaWduLmNvbS9nc2djY3IzcGVyc29uYWxzaWduMWNhMjAyMDBMBgNV HSAERTBDMEEGCSsGAQQBoDIBKDA0MDIGCCsGAQUFBwIBFiZodHRwczovL3d3 dy5nbG9iYWxzaWduLmNvbS9yZXBvc2l0b3J5LzAJBgNVHRMEAjAAMEkGA1Ud HwRCMEAwPqA8oDqGOGh0dHA6Ly9jcmwuZ2xvYmFsc2lnbi5jb20vZ3NnY2Ny M3BlcnNvbmFsc2lnbjFjYTIwMjAuY3JsMBsGA1UdEQQUMBKBEHNhcGVyQHNh cGVyLmluZm8wHQYDVR0lBBYwFAYIKwYBBQUHAwIGCCsGAQUFBwMEMB8GA1Ud IwQYMBaAFIW78MzENrUKYnajmS6PuzpqrcVRMB0GA1UdDgQWBBTW/RrdlRFR y6MgS7liTThMnQA5ozANBgkqhkiG9w0BAQsFAAOCAQEAAwoUJShHMueocVlD 1+vYJbTTTbk9tabr2L4Iyyy4Btu1d1wwl6d9Yx2N9qaVERWcEeP0aR+NB2B7 xIKl/ZnZVuSxep0Raw4s284a/jSIJlsAi4SJItDCU2VrYJDWxP7MxzZHnzPI MLDoTHXPV18gvYTewoNk5/Yo89Kb0v/GpPTpP2sVdrWLHa4uKUHYrAZ0aByp kNw6lXp6o6DXvXaOd6KDTQN5XhmmHwLnuLceODF1t9gicsZIOY+KAxN6YZ6t EqwN48b4OFMpckDE3fm1iTZRqnEIqUHOKOcoCImkub1woEN0zXDQmLXaZigl uVztWSTM4/fapWLrlHBNxfjs1TGCA30wggN5AgEBMGswWzELMAkGA1UEBhMC QkUxGTAXBgNVBAoTEEdsb2JhbFNpZ24gbnYtc2ExMTAvBgNVBAMTKEdsb2Jh bFNpZ24gR0NDIFIzIFBlcnNvbmFsU2lnbiAxIENBIDIwMjACDCKqoJRMYYx5 sYJHGzANBglghkgBZQMEAgEFAKCB5DAYBgkqhkiG9w0BCQMxCwYJKoZIhvcN AQcBMBwGCSqGSIb3DQEJBTEPFw0yMzA2MjcwNzUzMzBaMC8GCSqGSIb3DQEJ BDEiBCCJ9vmTYc8SukiJYXm0uk6pVcKLUmwHO+LgMNKpb/zC5jB5BgkqhkiG 9w0BCQ8xbDBqMAsGCWCGSAFlAwQBKjALBglghkgBZQMEARYwCwYJYIZIAWUD BAECMAoGCCqGSIb3DQMHMA4GCCqGSIb3DQMCAgIAgDANBggqhkiG9w0DAgIB QDAHBgUrDgMCBzANBggqhkiG9w0DAgIBKDANBgkqhkiG9w0BAQEFAASCAgA3 oE0k1d0oviLoGZlVgfFaLFKfYeutjBSJO9LyEuBkzrzmyyMN9+yj1F04ecd7 cxY8UV8gLTwDs5rSX5dh/gU4QAOY3WoKSgtdZt6h7yxSNF6E6X0qJkXL8v4T fIk5b9Aa5lxaQ3G5awzR03RdfxIh7mfgWbfvCQf+8Vi82pwNJde/iergEOB2 iBjCBtVwvkcxWs5rOebLKk6wr3A2SENvNVvGDiVei5eTcNzZwbsXvRDEw2oy VgcQ/vmaz37S23PwVc1aRE2scYepz0phXOWnYM1VWIPJATYNDLNqr3zvLKwK ASzBcW5BwKwQ2sDn39TInPyPkF77eRO/br+RcqNLzS4e9+42IULx7MecQK9y JmJ6PX4spVuI6m4WcXzbBzz7iK+J7Awb1uCxZmuZokrwIfUafJorjLin82Wx UxU9r73rbCFtciGAEtRRgU3mMy8fzLI+MynE1htZNtb+IN1AyOCWXgL0o2ct 8/vaBB2Nd6NHwvj3u0W1nSzAc701x1RWduSK64v0eIjnmHdLe7SamZgA8jGm CM2MK/W0A0hnJoE/uuc59HfLuPOO0jev7q8Z8aSk3m+eLtIf5A5uHSxyjaBm XR0i1YjgGjt1yPUTv8OQx/g4NZhCisdl+rQ0ngn1+E61iYCutsjKLPvoiV09 LiRbOWyG8DAjTBKnBoWxhw== --2201072851-830722250-1687852411=:23510-- From nobody Tue Jun 27 09:08:56 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4QqzRK50lTz4kNhD for ; Tue, 27 Jun 2023 09:09:01 +0000 (UTC) (envelope-from titus@edc.ro) Received: from eatlas.ro (eatlas.ro [86.126.82.18]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "eatlas.ro", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4QqzRK1pGlz412H for ; Tue, 27 Jun 2023 09:09:00 +0000 (UTC) (envelope-from titus@edc.ro) Authentication-Results: mx1.freebsd.org; none Received: from mail.edc.ro ([10.1.4.58]) by eatlas.ro (8.16.1/8.16.1) with ESMTPS id 35R98vOU070539 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NOT); Tue, 27 Jun 2023 12:08:57 +0300 (EEST) (envelope-from titus@edc.ro) Received: from tituss-imac.eatlas.local (eatlas.ro [86.126.82.18]) (authenticated bits=0) by mail.edc.ro (8.16.1/8.16.1) with ESMTPSA id 35R98u6c040220 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Tue, 27 Jun 2023 12:08:56 +0300 (EEST) (envelope-from titus@edc.ro) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=edc.ro; s=mail; t=1687856936; bh=Gq2DFpdVG1zzpjLxsHmnWM6Qg2bSdE+HQC/PeoeEAhs=; h=Subject:From:In-Reply-To:Date:Cc:References:To; b=T6Op9mzRO11Vkg7o6mgZw7wYFMCWKXKLa4FyBFsJ/jm+P1QGlXmJS4R11Eo0jkuFt o2UHn+qMAknaqv1ciooHB4MUIRJs8mRghYsmMICqUNu7puGtSNfxDtpbJ8jAcvuivd f/vTzsM09oDqxAPD7cBnV71DSb5k+HXS4L3dPSZs= Content-Type: text/plain; charset=us-ascii List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.120.23.2.7\)) Subject: Re: allwinner h616 + serial console glitch From: titus In-Reply-To: Date: Tue, 27 Jun 2023 12:08:56 +0300 Cc: freebsd-arm@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <1261C333-8E21-4C8B-A002-205043B66506@edc.ro> References: To: Marcin Cieslak X-Mailer: Apple Mail (2.3608.120.23.2.7) X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on ns.edc.ro X-Rspamd-Queue-Id: 4QqzRK1pGlz412H X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:8708, ipnet:86.120.0.0/13, country:RO] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N it may have to with this >=20 > /* UART_BGR_REG Enabling the gate enable weir behavior ... */ > /* CCU_GATE(CLK_BUS_UART0, "bus-uart0", "apb2", 0x90c, 0) */ > /* CCU_GATE(CLK_BUS_UART1, "bus-uart1", "apb2", 0x90c, 1) */ > /* CCU_GATE(CLK_BUS_UART2, "bus-uart2", "apb2", 0x90c, 2) */ > /* CCU_GATE(CLK_BUS_UART3, "bus-uart3", "apb2", 0x90c, 3) */ this is from the ccu_h6.c clock driver i had them enabled for the h616 code (now i commented it out and it = works) thanks for the clock idea > On Jun 27, 2023, at 10:53 AM, Marcin Cieslak wrote: >=20 > On Tue, 27 Jun 2023, titus wrote: >=20 >>> # stty -a >>> speed 115384 baud; 0 rows; 0 columns; >=20 > ^^^^^^^^^^^^ >=20 > looks like you have a clock problem, either the base UART clock or the = divisor > are not quite right. Probably you want to have 115200 here, so it is = slightly off. >=20 > (Just guessing, never had such an issue before) >=20 > Marcin From nobody Tue Jun 27 14:47:26 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Qr6y03H6Qz4l13v; Tue, 27 Jun 2023 14:47:36 +0000 (UTC) (envelope-from jamie@catflap.org) Received: from donotpassgo.dyslexicfish.net (donotpassgo.dyslexicfish.net [IPv6:2001:19f0:7400:8808:123::1]) by mx1.freebsd.org (Postfix) with ESMTP id 4Qr6xz3pZcz3Dqc; Tue, 27 Jun 2023 14:47:34 +0000 (UTC) (envelope-from jamie@catflap.org) Authentication-Results: mx1.freebsd.org; none X-Catflap-Envelope-From: Received: from donotpassgo.dyslexicfish.net (donotpassgo.dyslexicfish.net [209.250.224.51]) by donotpassgo.dyslexicfish.net (8.14.5/8.14.5) with ESMTP id 35RElQKe046969; Tue, 27 Jun 2023 15:47:26 +0100 (BST) (envelope-from jamie@donotpassgo.dyslexicfish.net) Received: (from jamie@localhost) by donotpassgo.dyslexicfish.net (8.14.5/8.14.5/Submit) id 35RElQFl046968; Tue, 27 Jun 2023 15:47:26 +0100 (BST) (envelope-from jamie) From: Jamie Landeg-Jones Message-Id: <202306271447.35RElQFl046968@donotpassgo.dyslexicfish.net> Date: Tue, 27 Jun 2023 15:47:26 +0100 Organization: Dyslexic Fish To: marklmi@yahoo.com, fbsd@www.zefox.net Cc: jamie@catflap.org, freebsd-net@freebsd.org, freebsd-arm@freebsd.org Subject: Re: -current dropping ssh connections References: <202306212305.35LN5ITH069587@donotpassgo.dyslexicfish.net> <202306222238.35MMcoQm017939@donotpassgo.dyslexicfish.net> <601E35C4-CDE1-47A3-B2D2-29501AB5FB93@yahoo.com> In-Reply-To: User-Agent: Heirloom mailx 12.4 7/29/08 List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.2.7 (donotpassgo.dyslexicfish.net [209.250.224.51]); Tue, 27 Jun 2023 15:47:26 +0100 (BST) X-Rspamd-Queue-Id: 4Qr6xz3pZcz3Dqc X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:20473, ipnet:2001:19f0:7400::/38, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N bob prohaska wrote: > It is tempting to think USB saturation would account > for the trouble. A tool similar to gstat, but for > USB as a whole, would be helpful if it exists. Would this do? /usr/ports/sysutils/usbtop From nobody Tue Jun 27 15:09:14 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Qr7Qn03hnz4k8cj; Tue, 27 Jun 2023 15:09:05 +0000 (UTC) (envelope-from fbsd@www.zefox.net) Received: from www.zefox.net (www.zefox.net [50.1.20.27]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "www.zefox.com", Issuer "www.zefox.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Qr7Qm3PcGz3Q3L; Tue, 27 Jun 2023 15:09:04 +0000 (UTC) (envelope-from fbsd@www.zefox.net) Authentication-Results: mx1.freebsd.org; none Received: from www.zefox.net (localhost [127.0.0.1]) by www.zefox.net (8.17.1/8.15.2) with ESMTPS id 35RF9EGT082548 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Tue, 27 Jun 2023 08:09:15 -0700 (PDT) (envelope-from fbsd@www.zefox.net) Received: (from fbsd@localhost) by www.zefox.net (8.17.1/8.15.2/Submit) id 35RF9ED0082547; Tue, 27 Jun 2023 08:09:14 -0700 (PDT) (envelope-from fbsd) Date: Tue, 27 Jun 2023 08:09:14 -0700 From: bob prohaska To: Jamie Landeg-Jones Cc: freebsd-net@freebsd.org, freebsd-arm@freebsd.org Subject: Re: -current dropping ssh connections Message-ID: References: <202306212305.35LN5ITH069587@donotpassgo.dyslexicfish.net> <202306222238.35MMcoQm017939@donotpassgo.dyslexicfish.net> <601E35C4-CDE1-47A3-B2D2-29501AB5FB93@yahoo.com> <202306271447.35RElQFl046968@donotpassgo.dyslexicfish.net> List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <202306271447.35RElQFl046968@donotpassgo.dyslexicfish.net> X-Rspamd-Queue-Id: 4Qr7Qm3PcGz3Q3L X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:7065, ipnet:50.1.16.0/20, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On Tue, Jun 27, 2023 at 03:47:26PM +0100, Jamie Landeg-Jones wrote: > bob prohaska wrote: > > > It is tempting to think USB saturation would account > > for the trouble. A tool similar to gstat, but for > > USB as a whole, would be helpful if it exists. > > Would this do? > > /usr/ports/sysutils/usbtop Yes, thank you! bob prohaska From nobody Tue Jun 27 16:29:03 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Qr9Bq17lcz4kGBC for ; Tue, 27 Jun 2023 16:28:51 +0000 (UTC) (envelope-from fbsd@www.zefox.net) Received: from www.zefox.net (www.zefox.net [50.1.20.27]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "www.zefox.com", Issuer "www.zefox.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Qr9Bp5SyHz4Fqf for ; Tue, 27 Jun 2023 16:28:50 +0000 (UTC) (envelope-from fbsd@www.zefox.net) Authentication-Results: mx1.freebsd.org; none Received: from www.zefox.net (localhost [127.0.0.1]) by www.zefox.net (8.17.1/8.15.2) with ESMTPS id 35RGT47s082823 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Tue, 27 Jun 2023 09:29:04 -0700 (PDT) (envelope-from fbsd@www.zefox.net) Received: (from fbsd@localhost) by www.zefox.net (8.17.1/8.15.2/Submit) id 35RGT4qO082822; Tue, 27 Jun 2023 09:29:04 -0700 (PDT) (envelope-from fbsd) Date: Tue, 27 Jun 2023 09:29:03 -0700 From: bob prohaska To: Mark Millard Cc: freebsd-arm@freebsd.org Subject: Re: -current on armv7 stuck with flashing disk light Message-ID: References: List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Rspamd-Queue-Id: 4Qr9Bp5SyHz4Fqf X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:7065, ipnet:50.1.16.0/20, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On Mon, Jun 26, 2023 at 07:57:05PM -0700, Mark Millard wrote: > On Jun 26, 2023, at 19:12, bob prohaska wrote: > > > A Pi2 freshly updated to > > FreeBSD 14.0-CURRENT #41 main-c3e58ace31: Mon Jun 26 17:06:01 PDT 2023 > > bob@www.zefox.com:/usr/obj/usr/src/arm.armv7/sys/GENERIC arm > > got stuck with a flashing USB disk LED after starting a -j3 buildworld. > > No response to debugger escape, had to pull the plug. > > If I understand right, the LED flashing means the disk > had not stopped doing I/O: the system was still running, > doing disk activity. (But I do not have a description > of what your drive documentation says about how the > drive handles the LED and what various patterns/colors > may mean.) > > If the processes associated with processing input that > would identify the debugger escape had the kernel stacks > involved swapped out to swap space, I doubt that the > debugger escape would work until/unless the kernel > stacks are brought back into kernel RAM. > > Avoiding the specific way of losing control is why I > have in /etc/sysctl.conf : > > # > # Together this pair avoids swapping out the process kernel stacks. > # This avoids processes for interacting with the system from being > # hung-up by such. > vm.swap_enabled=0 > vm.swap_idle_enabled=0 > This combination was tried and didn't seem to have any consistent effect. It's commented out at the moment. > (No claim such is the only way to lose control.) > > You might be able to get a clue if their was disk I/O going > on based on modification times on files you know would have > been modified periodically for some time (minutes) before > you pulled the plug --but not modified on reboot and later > activity. May be a log file that would only be modified by > the build that you had been trying to do? > There are log files for build and disk activity (for a cold hang, no disk activity at all) at http://nemesis.zefox.com/~bob/fbsd/rpi2/20230623/ In this case the top window was via ssh. Lately I've taken to running top on the serial console in hopes that will help distinguish system hangs from USB hangs. > (You did not indicate how long you let it run with the > status "possibly hung up".) > IIRC it was about half an hour. It was already stuck, so I don't know the actual time > > Reboot with kernel.old, > > FreeBSD 14.0-CURRENT #40 main-c1cbabe8ae: Tue Jun 20 03:58:47 PDT 2023 > > bob@www.zefox.com:/usr/obj/usr/src/arm.armv7/sys/GENERIC arm > > seems ok, I'll try to run buildworld with that. The kernel.old -j3 buildworld is still running, no complaints so far. If it succeeds I'll experiment with usbtop. Thanks for writing! From nobody Tue Jun 27 16:47:12 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Qr9cN0npRz4kXLD for ; Tue, 27 Jun 2023 16:47:32 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic303-24.consmr.mail.gq1.yahoo.com (sonic303-24.consmr.mail.gq1.yahoo.com [98.137.64.205]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Qr9cM5Pwhz4MbX for ; Tue, 27 Jun 2023 16:47:31 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1687884449; bh=igKu9cQKhjqWjWBz3UMXf+dBC4pFY8/YZWUcSGoQQFE=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=ULACcVHoo0y3GVmok0l+Ehkhy2tw5lh5a3xQqTasVbmVm4ShcRV5TBkfqgv9gt+gFJonxTpp7uZE01xmtvL3eJN7MX9vn+ifNLXRZ5uLzBh6QmHEHq2OuzJzQTmctIYVL2dNbG5YES5h6rCoxvyhRmgJflY3xQ5c1CS/YDFlexgbo4tvHIIxejEkYiAjcTyvMrL618ecyH1+e3QW7tsRbOFyc6Yt6J0P5+/T6VeMUfEoIcuzHJLMLMODdSenZt1N9syxivACkOdYTjqqGV/XKeM2WmWQXNZpUo+i7JgEmLlggKEf6IFTXlA382gDk1HPEyjiP4NvfTHSLM338+l/xw== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1687884449; bh=0Lh6Ad3VsowgX9YR1HMI7zpt3uiUdV699ArqnwCkUu5=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=oj14t/7CABL1ZC2rc6XmmvzXfYnvpT/AVbj8CqEdJnxGLLMBYiZWYxR/hEx+YJ3g73FKbPwGDGZQc88SCBtdnmor4bJFAva1d5t0/9qNQzg/QPA2ewMRn7pKH8N+jkcKeq50cV1aiiKlrboJnDdSVqt1VSViu5i0kw6Nbcf1RXf1ICMQDAFyzcvFd5yMNJf0L6Dg2d3mms5yUiZf5CprA5anZiEDimbZpAnu2PAayVw8R9kVkgVQECJo2rUHsxAQDYum6cW44zHG0wo7Oly/4T9TdiNs8bhe0KzEm6XcJmQBmpSBZeOUxIutk8/XFoByvR6QYsw6ZnAM9kEMnEXMPw== X-YMail-OSG: xXfKZYYVM1knkklmFIqwEYaj7.jQYDmqFEzg02P1cFwkpSG2JTkVo8WQAeuvN2W nBeV34tLC1BRQdq4EuZKqadFZV3y0Tmm5FyvcV19y2YW4WYI8pvPhir4VVvryW07soxMrXOUkkCX 9GrFYlI7aBMU_6g3iL_OqK92qYNl5hcIEMW57ow0WhQHthK0Pf6X7dE_dgYYuWgnndcR4kBg4KRx EuA4e2PxTG61At2fcyx0yqBvUxPZ0LJpj5tsy3Az_Slp7D2O9H6AXKryvmiqogDoINMlpLz6FPP6 WqLMz5jGXZUTi.BJPAC1UutX9k99AiDcyU9231iu28BCIuXcznBnM.JyTnSpLCUBQEBMaJ.GaoZe sBDQlbMe6tW6bUMcdsXwiduazR5AMkz5YAkdKUdxdGC3Lz4Bnsv_Bi6evtgnRdYdabgAVq8PrUc_ 2psTa8ELoRriK2EgXb_jBevlrp2glzW0W52mW84RXiSabUo4fiH9Nla1KlBJqhvK99W3aQDTNiNN oEWG8G4ROJ2C9TVaW92VA2JzABnN.50vSNBgmkJUb0nEzuOF_U.pIUOeSy7Gj34MZZ45wSFk7zvh 12Ck9HM1XJGg2g1wwbrJKG3HRRZBK4cQObRv9Xo2tRNgVp3YGuwVjbCpwFSb1t8PV.HixPNXg9xc vsYqD2VVbLa3Rfva7D68KaTbDRCV2No9GYN79t7oX8tYX4EmqdBWLa6c0PqD6jAB5Gs6bRfQUPcX O2WA9c8NNxbjCTjop7X88.5pB23wEdkI.fJmiXlEl8vqTz81MRjWzaxCcJk7L.9FLHXLpOaekIUi tR80mq5hA2ZWHRpN6CkS_ix50Z4MqNNME52g7jyQZeGPOSqOAIyz2NqLajNBxPDeXVL_aKLBWdIe orPRHK2255TTArdXjPwcgaVWRobvUtgUrC4h9vrNjD5xL7vsahgsUQCzye3_u5j.eUTGrY9Mez8o xI3MpU8dS6LCebqmLCUlWo_JkVvBKyvCDjtoYCpcqLxR_AryU96WbZK_hGC5zE7w0VuKpXZ_uO_K h8opcHvSoZEytO0V8JJQxyeZiZXAbXUSpQViPR90UOTT936zDTNg8Rb6G3FccpBdXoxhFpryh3.k neMG1qzplOWhdYVYbQtgrq.sf.rsOQEpHj_cb1HZJVCtGZt6PeC4D7sAPQoMzz9JUF0F7tupx1kg H_UGnprQEZgv2AB8gLy7HqkJO29ilRWDrU_TNJzyouJssYEHDUYQaeLGKT7aXXA3nzm_BcEc7MlX QpNLwfEHbBY9SXK9tSfC5hxOF8ZJpMI5rFLJ5LxJ.HovkejwShIWjbSOe0Gl.4Qb8BbkTVNyaNGC u.tyYTuBWhEJ9GbaZDfwAzG7b9X8hXnvq_ZL72F6XwJ3CPJaKbOAXAhOvZDbcyuTaRXGjV2amgAU EIheFSRn_NMb.QYOi5NB4DcuZnjlA_Lv.xzM3GJsrtTT2r74fKclmXy5amQssKBHnIoaLdctQaZc ihMaOxAs51ID0uL0YJq24tkezH9QNuOCDd7KTpUIylTomhN5i2bChZ2FDa6NWV.WFIaBFl2JvQTz AsyqYEs36jYn.KXCsKDo.B32h042ngxXEEb4jyzEdLb9uplfyg42DeAskj6LvCdytNBQUQwcD7M2 HgWvU28DF0Gjlmmoa61pag1j.uNrL_.HKoV.7xwAY0lxU26zRftP1U3U89rWQdP31nJVWznV6vTn GUWQkJ07kppDmhdks8.Sa6HWXeMeExX.Px1D9ZReOLjShJoNb2Vvym3wmkUXbLN_1.46Hofd_xH5 gTxbbi_.P9Qbn9ddcbQMO53kjgURanJEAHyOuQ4o96MxtDHmJ_gU9HnIjKvtQdPLkn0A8OaIr_ku 10AWBsYpBy.TU3RFK2NRiq.UV5Za4JNgW.T0xDRMFgKM0m5vmHR7NFGDa6h8RP0isnUmmilQ.Ocj oJjEEg54hhNehEVHV3_X4Vke3OEGBiCZTtghFyGqy6bZ0SS_6e2PEzBiNyRdOPw1qB.UAXdD7hcq 2Kafcg1fqQqaKvjmhbmotM65y8D_S.7.844uhUpC0hGMtjH.PiRsbrW.a5Hy69XLg3ovcJUbJnY2 1l2tyIFJTne8_Sb1Y_Vada7XzLKrHAVnOu2XtchEJc0nsMSrbrgpVJ7kq6Nqv3g0MZx46esLCO3A oSzSQ5ISniYHMFq_Uj_GrwsS2hxJ5Hz4zvOyC2trKI5H0WBwGBMZL39Rzrbc.kDiTImjMmVIsBPq cY5HfGR_fP7GGyb9AX9CPNRkI1K_J9rUnJe.Qkd6sZ1pfcLdLkcrdhPgKqmSvkOSvpvNSNP9Mlz6 B X-Sonic-MF: X-Sonic-ID: de64ebfd-270e-4549-992e-1d20dcf9b8f1 Received: from sonic.gate.mail.ne1.yahoo.com by sonic303.consmr.mail.gq1.yahoo.com with HTTP; Tue, 27 Jun 2023 16:47:29 +0000 Received: by hermes--production-ne1-7f4ff455bb-kwpfb (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID d0c3128cc2fbefb65301d1d527e97a6d; Tue, 27 Jun 2023 16:47:27 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.600.7\)) Subject: Re: -current on armv7 stuck with flashing disk light From: Mark Millard In-Reply-To: Date: Tue, 27 Jun 2023 09:47:12 -0700 Cc: freebsd-arm@freebsd.org Content-Transfer-Encoding: 7bit Message-Id: References: To: bob prohaska X-Mailer: Apple Mail (2.3731.600.7) X-Rspamd-Queue-Id: 4Qr9cM5Pwhz4MbX X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On Jun 27, 2023, at 09:29, bob prohaska wrote: > On Mon, Jun 26, 2023 at 07:57:05PM -0700, Mark Millard wrote: >> On Jun 26, 2023, at 19:12, bob prohaska wrote: >> >>> A Pi2 freshly updated to >>> FreeBSD 14.0-CURRENT #41 main-c3e58ace31: Mon Jun 26 17:06:01 PDT 2023 >>> bob@www.zefox.com:/usr/obj/usr/src/arm.armv7/sys/GENERIC arm >>> got stuck with a flashing USB disk LED after starting a -j3 buildworld. >>> No response to debugger escape, had to pull the plug. I'm confused. That says "stuck with a flashing USB disk LED". But: http://nemesis.zefox.com/~bob/fbsd/rpi2/20230623/readme says: "the disk had gone to sleep mode. Both LEDs were off" Are these two different examples with variable behavior across the examples? >> If I understand right, the LED flashing means the disk >> had not stopped doing I/O: the system was still running, >> doing disk activity. (But I do not have a description >> of what your drive documentation says about how the >> drive handles the LED and what various patterns/colors >> may mean.) >> >> If the processes associated with processing input that >> would identify the debugger escape had the kernel stacks >> involved swapped out to swap space, I doubt that the >> debugger escape would work until/unless the kernel >> stacks are brought back into kernel RAM. >> >> Avoiding the specific way of losing control is why I >> have in /etc/sysctl.conf : >> >> # >> # Together this pair avoids swapping out the process kernel stacks. >> # This avoids processes for interacting with the system from being >> # hung-up by such. >> vm.swap_enabled=0 >> vm.swap_idle_enabled=0 >> > > This combination was tried and didn't seem to have any consistent > effect. It's commented out at the moment. By not having them, we have no way to know if the relevant kernel stacks had been moved to swap space. Having them is part of problem isolation/identification even when other forms of loss of control happen. The 2 lines serve more than one goal. >> (No claim such is the only way to lose control.) >> >> You might be able to get a clue if their was disk I/O going >> on based on modification times on files you know would have >> been modified periodically for some time (minutes) before >> you pulled the plug --but not modified on reboot and later >> activity. May be a log file that would only be modified by >> the build that you had been trying to do? >> > > There are log files for build and disk activity (for a cold > hang, no disk activity at all) at > http://nemesis.zefox.com/~bob/fbsd/rpi2/20230623/ So this is a different hangup? > In this case the top window was via ssh. Lately I've > taken to running top on the serial console in hopes > that will help distinguish system hangs from USB hangs. If you want to identify system hangs, please put back: vm.swap_enabled=0 vm.swap_idle_enabled=0 otherwise all you may be seeing is the relevant kernel stacks having been moved to swap space. That is not a form of system hang relative to overall activity, leaving more uncertainty about what top no longer displaying updates implies. You can use sysctl to adjust the live context as well. > >> (You did not indicate how long you let it run with the >> status "possibly hung up".) >> > IIRC it was about half an hour. It was already stuck, so I > don't know the actual time No logs or other files with modification times that might indicate if there was activity during that around 0.5 hr? (Timestamps in files can also serve.) >>> Reboot with kernel.old, >>> FreeBSD 14.0-CURRENT #40 main-c1cbabe8ae: Tue Jun 20 03:58:47 PDT 2023 >>> bob@www.zefox.com:/usr/obj/usr/src/arm.armv7/sys/GENERIC arm >>> seems ok, I'll try to run buildworld with that. > > The kernel.old -j3 buildworld is still running, no complaints so far. > If it succeeds I'll experiment with usbtop. === Mark Millard marklmi at yahoo.com From nobody Tue Jun 27 16:59:40 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Qr9tj4nZqz4kjMy for ; Tue, 27 Jun 2023 16:59:57 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic317-20.consmr.mail.gq1.yahoo.com (sonic317-20.consmr.mail.gq1.yahoo.com [98.137.66.146]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Qr9th0YClz3CGd for ; Tue, 27 Jun 2023 16:59:56 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b="geF/Fyme"; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.66.146 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1687885194; bh=rayNNksDHDPBbIDPDXmdHF6OXDYiwCGJQ/+W9Bgr2cE=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=geF/Fymera5WRJgb3f8E+cFw/rXvFpcc0fvzCsc1d0jQQ+aZY56k6RJ3OCnYeiVtRUtbVLsAbHna7qlm3hGUgc+Tg4c46qen5TKuWL8fsNR2WhdmG3yesE2axLYk8aeYFmXf87q5CU369ZUem4oEu7kZOR8uthcha0LsocYqR2R41fzYXBZcgMEKHqiTkWe7cML2I4bQ3k/01rXNjFJSczE4um3EskWUQjNhyWVn/SZHVhHgl12OSitSHSsew83wOWiKtgfk4WW35gpjJ5ChQQmWRmvUMRZgw7pfi4YWme/3fC+O8sHXM2QnnLnbc5c+IFqrDj7mxIBfbhxXP9af+Q== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1687885194; bh=Z7sB7Ir9n7cr5wqZgSdDMRx6bX8Fbfo3rkcY9AoMLqQ=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=eKyx1uFXP6fDNdW7Mk4atLH7yDxIKnEqHVwTg9eZioJ/tIsyTltuyK9PAIK7XJ1+9KdjaXWHpCW12/g9sht1+vZMxK8VlBXiloS2Pud2SsKpm+cAgeLLFy9HuL51WHvYcOrXzrwFWdlH1qf4ot+2ooItfUHSKK0C6ta6RO3L7KNBu8DFNVMvPpobICukJzD8AgPSz0pJKro8X8Ba2OBKjx1V86tBROyq7BffbkQSw1eDqQGyHkIT8nudy4aWbcCCtlp+mrNQRU4XmLbWdVIrNKtTCkhmkwUkj8diqzYWgopBoPbw/+LteDGgGtPEWSOiaYVetbc3jijld0jZMfYl5g== X-YMail-OSG: jqRDE1gVM1nqTNiBA_Nihzr.Powta.WXge_KGdxVMC1F28PJieyaU_e0kXz4Fd3 lYl_OPT1buOiCl8zk2E3jyMy3a8GRIb0A2JPoJ_gTMJvf.FjSKVoL9rF3.J1orqwLlKcCjLP6akH Vyq1iCto4oNcpsqObZ749eNMF_KS9qci9QfXYscjN0cHucJVBcyycKS_d_AkQNai4L4JmkdRmck6 7fntfy74WFzCch5x0KHHrm.pQ2D7sUj5mSLCnvSURvwKd_2G6grFHi2fVS4T0SdOQ.fQN5mLJz1w _CqbW.CXXZmLfO1Cyo.Y0LkAGF1cwCi1bl4EP2h9yrdc.mVNqFKQ3kfGoC4ncb86WxCdERyALYnE UAD11WUCopK2YGq9sVA5yOniyeGcDfDzksEgYDDj9IDyUZ9G_tz3O39lYhpyyQ_XwtSrzZHsx2XQ PgsftROMhC60kphXP2QYr5P4b4voerJin4kJ1OUjjxdMF1QlIgwxUXEg0uM5txiY9sKk3EDnTYXF 6IY_fLVxvirfIPTle0s.pl5szZkYbVcbi36SgNIHWH4gHJtKxu4vBaCuMh.uies1LHsWrn_rhnU. JPSPxsr1wWPtFNtV0kcylvblQlr2opO4JzmcM6hlPBsU9eLp9LAodmSxmlp2f2TTcO8TrdQwQirn Bt7kau.JdKtHw9_QY4cEF1Gc.U2gKy6DpudeSocIN2GWB8Em8wJF_VBw7K0Dlu_aybfzmySahinh eKTslXPWc5j7nfnwDv.YtKkE._2O66NfO72RZpwTOdemYtvRI9krktfnoud592.hjDf6frercqIj MeWnaeA8Q7v0Icm9O1Fx7YgKAqvfelhxHeJ5MbP.8r8NW..N9hDq8w8SBVlyroE3FDdOsPK0L_BP 5NYSpDFqHrW4IolmHERLnHIWa5bqGZ1K0qoYcoij3roq00znyCu4ba2btAk7sPteBXMkj4VmYa.U NwfhdOgi91I5VmVSF.O7TJF2Fxxm4ZIkokvRT7_JCJZ.277IO7HKShQl8R.QdKiiLYMBm3ndTMF9 NaIiB2hd0NNFE9jHHLDCGxiAHrutA3w4srX55XlZzD4aIxmQpTJRA053Sls2JSWvwsTOo8RVMs4P 2q1b6NJhcRK9bCb9n15LnP0JuJsf3pdS.CFW_fqZZZozIwVkHCN33gR_qMg238iR90MpupUkVvJj aUua8Enuq166dR04old9h_YWiUHQDG0kWTB6OM7mG_E_hiZ_avk52QO_rYEdQBHG3jjsnXutwB4_ NfW37.rWg154ZAVeVnDRgBqWhrs9sk7n94o7pVi40Yveq.rj9o3ptq6tXd7HKp_8eJHk7zil8kyj b1WW_sj2MrFI_u6rc8ctQpYpdeWULKgGeYHcqIGUelV3Pcf1uwNAV4c8S0s04i.XJzc785BdP7Hq qnsQf61Jb94kX5DdhbIBjtlDW_cuo6oVgKamrHSgXVXlX_zJYUE8dJlF5ByM2INkzkI8hkBzylaU w9jH2WcnS2NkTmisd0TAJhoINQgd94qbW2cc7PypobWIpdCMwtKq5ndjC4_iVzr54OFrk1Hm6bEU Fw5pXGggsdzewmJqHjdrTbjBdMWGkKeAIzFJHXpCgjXEbsONakYnjCjcYSn.S4qbe9rUw3InEGvf A1nLY2kwg9yG8QaDC3NOVifBBVPVFpbdEToOfQIOjyvhX8pTW5yZrCkV_cCnGrL.vVzDU5VMfgzS dhAr9GT2rX7GU0lYiPWf583KRZv8UL6tzN4.ROVpvRCqgsjg2ntbuD.u1y610Dtsq5D783d7N0Qj qCFyCURWC0Fz_x0D6BGtK2zJojFbwEsl6fn4sc4Neuw0OrnrgPwXDD5pjeN.4Pd_5YkFJ27VLZU. pWQXXG1RMP9UM7ZUgIh3cbZdNg6s7sxEZL46.n90yE_rNNP7ac7OrTyCALIT1tIVEXnJzLlt56sj .emu4NIvafUmdJ6tvkuYy4KoVUYUsAtSlkfEKv3nn9Oh3VmJl5D5Azms1znsHPOGKXfU1qfuMseE C.wXcEYsm2BwcfQo7TUSnYqbDEtEGfw0sT3WoPMefEBSRObVP6YIcpP5hmge6wYgpZGKEuiZq_zQ mywPTOte5FQgNV_LKfkxvKYaTx1wDSRUcHpztxvgDFYNw1py_Ktzi.ER1jGwMUusJH4CB3jElIX7 CJo.QZ6QrQKnIcWlgRsPN..goBXUGRv9zWoHMTSB47UkfZ96TWgKLLdQa6Lp_2E7iPWNkYZ6b1nH jBK6uUcuzeiPhFQOCLrwCx7_yvy2jarYc0j0MbkVhSfo6yIuJ3ID4ZfR5LRSPvLz.CuEwyf21i4I vpQ-- X-Sonic-MF: X-Sonic-ID: 485a7c88-a301-4d18-a420-1bbfe6698aa7 Received: from sonic.gate.mail.ne1.yahoo.com by sonic317.consmr.mail.gq1.yahoo.com with HTTP; Tue, 27 Jun 2023 16:59:54 +0000 Received: by hermes--production-gq1-65744d4b95-w7swl (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 2ae622afe81b2a22df628f7907b70b16; Tue, 27 Jun 2023 16:59:51 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.600.7\)) Subject: Re: -current on armv7 stuck with flashing disk light From: Mark Millard In-Reply-To: Date: Tue, 27 Jun 2023 09:59:40 -0700 Cc: freebsd-arm@freebsd.org Content-Transfer-Encoding: 7bit Message-Id: <066FD282-1637-448C-99FF-BA62718386F0@yahoo.com> References: To: bob prohaska X-Mailer: Apple Mail (2.3731.600.7) X-Spamd-Result: default: False [-0.99 / 15.00]; NEURAL_SPAM_SHORT(0.81)[0.809]; NEURAL_HAM_MEDIUM(-0.75)[-0.750]; NEURAL_HAM_LONG(-0.55)[-0.551]; MV_CASE(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; RCVD_IN_DNSWL_NONE(0.00)[98.137.66.146:from]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RCVD_COUNT_THREE(0.00)[3]; FREEMAIL_FROM(0.00)[yahoo.com]; TO_DN_SOME(0.00)[]; MLMMJ_DEST(0.00)[freebsd-arm@freebsd.org]; DKIM_TRACE(0.00)[yahoo.com:+]; FROM_EQ_ENVFROM(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.66.146:from] X-Rspamd-Queue-Id: 4Qr9th0YClz3CGd X-Spamd-Bar: / X-ThisMailContainsUnwantedMimeParts: N On Jun 27, 2023, at 09:47, Mark Millard wrote: > On Jun 27, 2023, at 09:29, bob prohaska wrote: > >> On Mon, Jun 26, 2023 at 07:57:05PM -0700, Mark Millard wrote: >>> On Jun 26, 2023, at 19:12, bob prohaska wrote: >>> >>>> A Pi2 freshly updated to >>>> FreeBSD 14.0-CURRENT #41 main-c3e58ace31: Mon Jun 26 17:06:01 PDT 2023 >>>> bob@www.zefox.com:/usr/obj/usr/src/arm.armv7/sys/GENERIC arm >>>> got stuck with a flashing USB disk LED after starting a -j3 buildworld. >>>> No response to debugger escape, had to pull the plug. > > I'm confused. > > That says "stuck with a flashing USB disk LED". But: > > http://nemesis.zefox.com/~bob/fbsd/rpi2/20230623/readme > > says: "the disk had gone to sleep mode. Both LEDs were off" > > Are these two different examples with variable behavior > across the examples? > >>> If I understand right, the LED flashing means the disk >>> had not stopped doing I/O: the system was still running, >>> doing disk activity. (But I do not have a description >>> of what your drive documentation says about how the >>> drive handles the LED and what various patterns/colors >>> may mean.) >>> >>> If the processes associated with processing input that >>> would identify the debugger escape had the kernel stacks >>> involved swapped out to swap space, I doubt that the >>> debugger escape would work until/unless the kernel >>> stacks are brought back into kernel RAM. >>> >>> Avoiding the specific way of losing control is why I >>> have in /etc/sysctl.conf : >>> >>> # >>> # Together this pair avoids swapping out the process kernel stacks. >>> # This avoids processes for interacting with the system from being >>> # hung-up by such. >>> vm.swap_enabled=0 >>> vm.swap_idle_enabled=0 >>> >> >> This combination was tried and didn't seem to have any consistent >> effect. It's commented out at the moment. > > By not having them, we have no way to know if the > relevant kernel stacks had been moved to swap space. > Having them is part of problem isolation/identification > even when other forms of loss of control happen. > > The 2 lines serve more than one goal. > >>> (No claim such is the only way to lose control.) >>> >>> You might be able to get a clue if their was disk I/O going >>> on based on modification times on files you know would have >>> been modified periodically for some time (minutes) before >>> you pulled the plug --but not modified on reboot and later >>> activity. May be a log file that would only be modified by >>> the build that you had been trying to do? >>> >> >> There are log files for build and disk activity (for a cold >> hang, no disk activity at all) at >> http://nemesis.zefox.com/~bob/fbsd/rpi2/20230623/ > > So this is a different hangup? j4swapscript.log has internal timestamp pairs: Wed Jun 21 16:34:06 PDT 2023 . . . Fri Jun 23 07:26:10 PDT 2023 It would be interesting to know if "Jun 23 07:26:10" was after the appearent hangup was identified vs. before. >> In this case the top window was via ssh. Lately I've >> taken to running top on the serial console in hopes >> that will help distinguish system hangs from USB hangs. > > If you want to identify system hangs, please > put back: > > vm.swap_enabled=0 > vm.swap_idle_enabled=0 > > otherwise all you may be seeing is the relevant > kernel stacks having been moved to swap space. > That is not a form of system hang relative to > overall activity, leaving more uncertainty about > what top no longer displaying updates implies. > > You can use sysctl to adjust the live context > as well. > >> >>> (You did not indicate how long you let it run with the >>> status "possibly hung up".) >>> >> IIRC it was about half an hour. It was already stuck, so I >> don't know the actual time > > No logs or other files with modification times that > might indicate if there was activity during that > around 0.5 hr? (Timestamps in files can also serve.) > >>>> Reboot with kernel.old, >>>> FreeBSD 14.0-CURRENT #40 main-c1cbabe8ae: Tue Jun 20 03:58:47 PDT 2023 >>>> bob@www.zefox.com:/usr/obj/usr/src/arm.armv7/sys/GENERIC arm >>>> seems ok, I'll try to run buildworld with that. >> >> The kernel.old -j3 buildworld is still running, no complaints so far. >> If it succeeds I'll experiment with usbtop. === Mark Millard marklmi at yahoo.com From nobody Tue Jun 27 17:16:57 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4QrBG70pVNz4f2ZJ for ; Tue, 27 Jun 2023 17:16:47 +0000 (UTC) (envelope-from fbsd@www.zefox.net) Received: from www.zefox.net (www.zefox.net [50.1.20.27]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "www.zefox.com", Issuer "www.zefox.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4QrBG662ywz3M3p for ; Tue, 27 Jun 2023 17:16:46 +0000 (UTC) (envelope-from fbsd@www.zefox.net) Authentication-Results: mx1.freebsd.org; none Received: from www.zefox.net (localhost [127.0.0.1]) by www.zefox.net (8.17.1/8.15.2) with ESMTPS id 35RHGw9h083015 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Tue, 27 Jun 2023 10:16:58 -0700 (PDT) (envelope-from fbsd@www.zefox.net) Received: (from fbsd@localhost) by www.zefox.net (8.17.1/8.15.2/Submit) id 35RHGwSt083014; Tue, 27 Jun 2023 10:16:58 -0700 (PDT) (envelope-from fbsd) Date: Tue, 27 Jun 2023 10:16:57 -0700 From: bob prohaska To: Mark Millard Cc: freebsd-arm@freebsd.org Subject: Re: -current on armv7 stuck with flashing disk light Message-ID: References: <066FD282-1637-448C-99FF-BA62718386F0@yahoo.com> List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <066FD282-1637-448C-99FF-BA62718386F0@yahoo.com> X-Rspamd-Queue-Id: 4QrBG662ywz3M3p X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:7065, ipnet:50.1.16.0/20, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On Tue, Jun 27, 2023 at 09:59:40AM -0700, Mark Millard wrote: > On Jun 27, 2023, at 09:47, Mark Millard wrote: > > > On Jun 27, 2023, at 09:29, bob prohaska wrote: > > > >> On Mon, Jun 26, 2023 at 07:57:05PM -0700, Mark Millard wrote: > >>> On Jun 26, 2023, at 19:12, bob prohaska wrote: > >>> > >>>> A Pi2 freshly updated to > >>>> FreeBSD 14.0-CURRENT #41 main-c3e58ace31: Mon Jun 26 17:06:01 PDT 2023 > >>>> bob@www.zefox.com:/usr/obj/usr/src/arm.armv7/sys/GENERIC arm > >>>> got stuck with a flashing USB disk LED after starting a -j3 buildworld. > >>>> No response to debugger escape, had to pull the plug. > > > > I'm confused. > > > > That says "stuck with a flashing USB disk LED". But: > > > > http://nemesis.zefox.com/~bob/fbsd/rpi2/20230623/readme > > > > says: "the disk had gone to sleep mode. Both LEDs were off" > > > > Are these two different examples with variable behavior > > across the examples? > > Yes, I got mixed up. There have been several failures, some belated and the most recent one which was prompt (with a new kernel). > >>> If I understand right, the LED flashing means the disk > >>> had not stopped doing I/O: the system was still running, > >>> doing disk activity. (But I do not have a description > >>> of what your drive documentation says about how the > >>> drive handles the LED and what various patterns/colors > >>> may mean.) > >>> > >>> If the processes associated with processing input that > >>> would identify the debugger escape had the kernel stacks > >>> involved swapped out to swap space, I doubt that the > >>> debugger escape would work until/unless the kernel > >>> stacks are brought back into kernel RAM. > >>> > >>> Avoiding the specific way of losing control is why I > >>> have in /etc/sysctl.conf : > >>> > >>> # > >>> # Together this pair avoids swapping out the process kernel stacks. > >>> # This avoids processes for interacting with the system from being > >>> # hung-up by such. > >>> vm.swap_enabled=0 > >>> vm.swap_idle_enabled=0 > >>> > >> > >> This combination was tried and didn't seem to have any consistent > >> effect. It's commented out at the moment. > > > > By not having them, we have no way to know if the > > relevant kernel stacks had been moved to swap space. > > Having them is part of problem isolation/identification > > even when other forms of loss of control happen. > > > > The 2 lines serve more than one goal. > > > >>> (No claim such is the only way to lose control.) > >>> > >>> You might be able to get a clue if their was disk I/O going > >>> on based on modification times on files you know would have > >>> been modified periodically for some time (minutes) before > >>> you pulled the plug --but not modified on reboot and later > >>> activity. May be a log file that would only be modified by > >>> the build that you had been trying to do? > >>> > >> > >> There are log files for build and disk activity (for a cold > >> hang, no disk activity at all) at > >> http://nemesis.zefox.com/~bob/fbsd/rpi2/20230623/ > > > > So this is a different hangup? > > j4swapscript.log has internal timestamp pairs: > > Wed Jun 21 16:34:06 PDT 2023 > . . . > Fri Jun 23 07:26:10 PDT 2023 > > It would be interesting to know if "Jun 23 07:26:10" > was after the appearent hangup was identified vs. > before. > > >> In this case the top window was via ssh. Lately I've > >> taken to running top on the serial console in hopes > >> that will help distinguish system hangs from USB hangs. > > > > If you want to identify system hangs, please > > put back: > > > > vm.swap_enabled=0 > > vm.swap_idle_enabled=0 > > They're reinstated now, but I don't want to disturb the system while it seems to be building world acceptably. Sorry for mixing things up! bob prohaska From nobody Wed Jun 28 12:18:28 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4QrgbZ3P4qz4kVLh for ; Wed, 28 Jun 2023 12:18:34 +0000 (UTC) (envelope-from sfaisal@juniper.net) Received: from mx0b-00273201.pphosted.com (mx0b-00273201.pphosted.com [67.231.152.164]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.pphosted.com", Issuer "Thawte RSA CA 2018" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4QrgbX5dk9z4CMN for ; Wed, 28 Jun 2023 12:18:32 +0000 (UTC) (envelope-from sfaisal@juniper.net) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=juniper.net header.s=PPS1017 header.b=HpR2cCWe; dkim=pass header.d=juniper.net header.s=selector1 header.b=Zj5L5vhj; spf=pass (mx1.freebsd.org: domain of sfaisal@juniper.net designates 67.231.152.164 as permitted sender) smtp.mailfrom=sfaisal@juniper.net; dmarc=pass (policy=reject) header.from=juniper.net; arc=pass ("microsoft.com:s=arcselector9901:i=1") Received: from pps.filterd (m0108161.ppops.net [127.0.0.1]) by mx0b-00273201.pphosted.com (8.17.1.19/8.17.1.19) with ESMTP id 35S8ji6g011064 for ; Wed, 28 Jun 2023 05:18:30 -0700 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=juniper.net; h=from : to : cc : subject : date : message-id : references : in-reply-to : content-type : mime-version; s=PPS1017; bh=oj9WfjtM9/O9EmuUkcqP1SZXj6dbUtKKajRmf6x/LBE=; b=HpR2cCWe52pke/RZqXNO7SZL1r2HWyy7XRMYI19PT4C45FAQctiqWhSX3AjBJ0GBiOyz GhLwMaG9B2/op1IYI3TFvwBw7KPffkxfA8osmi5bId1J6xaugydnSVSbp5p6W7TOrn/K AW+tQ+hX5JMqqBv5d+wDoao+lyXwzYFDVClOjuLAuAC818tdKTiOE9GLw+TRCvP5P+Cu wX46L+qNZ24gKEexNB5ytFCA/KyjaHHisBEgFsZ1Bpy5qFarRfFuappllD0TcESTajzo KfszrG2ibhsaPDKypTztLgMd+zPWenzrIkSXUhBwDfoV33yVSDYyHRpMyAZ9lVHvwXN/ 3A== Received: from cy4pr02cu008.outbound.protection.outlook.com (mail-westcentralusazlp17012022.outbound.protection.outlook.com [40.93.6.22]) by mx0b-00273201.pphosted.com (PPS) with ESMTPS id 3rghmsgf56-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Wed, 28 Jun 2023 05:18:30 -0700 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=T7eas/uTWAZEb8V9xMuQSLcDVKqcwN/DIhJKZkq3nR2AnmsS9xC18OLfxs1En8xXs5w2dMrqNKnAfez84L37XdPk8edmfWUix0FIco6yOgUWO0NtOmcGAsFdJuVfzAPq7b1+RpuqX/1r/8rbeFyufT7lB7STeAn1PbVW2izl2QhZpcYZEwWGi0EdSozLlAnrSYnu3sT/Mh3bStiorzQbPNJgbtxiunv/R39MJSyb0rj3FveroDez46bCOnJn0Q0uJAzehmPvHihpaYQcFdDMJ1Ra1hycMUnKlbKKQOmG5n2ckkmtskqopQUSDhI4otwPL/DhwiQOZl5RjBdv8IX3OQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=oj9WfjtM9/O9EmuUkcqP1SZXj6dbUtKKajRmf6x/LBE=; b=LCZfaOdcXVNfWVSRGv3NoJ9hozpHgfvFKoTFtqLG9W7Z8AgEiVTEA4mYq8PwVuMPYHFsNYngqyoekxrfaNDtBq8T0whBzZQX6wcNnwq9O7AERMyXv0S6qu6s6PTEHDi6YluaoRQ0UioyYjUZbHp4uMlZQxSenWrBiACBeZN92vjp61ifxlpn8qyZX9ahshJIl8y3XZ0Fdg+iZ/QDXmp1JMn0Zxu5bXDWR3tV+0NkID7srPd/D1eaTxXrQJiYFKTwuvzEu/KIHhjPrwjHDvhUfyAy9UdCne2ZMwtSnslXMQBd9TSq96KSVx2Fwqn32D4UEJZvZtdQIJSJ2voqmaY0Lw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=juniper.net; dmarc=pass action=none header.from=juniper.net; dkim=pass header.d=juniper.net; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=juniper.net; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=oj9WfjtM9/O9EmuUkcqP1SZXj6dbUtKKajRmf6x/LBE=; b=Zj5L5vhjCLTupUoq9RIhx6vWTnCRe4ug13L4GQyya7wP57mpGENHv4pfGSjP1/dCqueKnCHlCGi6LXYsziEq/d3GKBZxVuGyNw7GZzXKJHwBKygw45w+TQwthhpsdEFSX7X4kdOveYzM96Kc2E3XTJfRFNP+3g8iwIGCy6q7MII= Received: from BYAPR05MB6677.namprd05.prod.outlook.com (2603:10b6:a03:ec::28) by CO1PR05MB8268.namprd05.prod.outlook.com (2603:10b6:303:ff::20) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6521.24; Wed, 28 Jun 2023 12:18:28 +0000 Received: from BYAPR05MB6677.namprd05.prod.outlook.com ([fe80::65c0:5c8:b916:d4e1]) by BYAPR05MB6677.namprd05.prod.outlook.com ([fe80::65c0:5c8:b916:d4e1%4]) with mapi id 15.20.6521.026; Wed, 28 Jun 2023 12:18:28 +0000 From: Sha Faisal To: "freebsd-arm@FreeBSD.org" CC: Steve Kiernan , Mahesh Vardhamanaiah Subject: Re: Kernel crash before login prompt Thread-Topic: Kernel crash before login prompt Thread-Index: AQHZqYguFdDezJe7q0OItnaHAyE0G6+gIhyy Date: Wed, 28 Jun 2023 12:18:28 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-GB, en-US Content-Language: en-IN X-MS-Has-Attach: X-MS-TNEF-Correlator: msip_labels: MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Enabled=True;MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_SiteId=bea78b3c-4cdb-4130-854a-1d193232e5f4;MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_SetDate=2023-06-28T06:17:14.7194767Z;MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_ContentBits=0;MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Method=Standard x-ms-publictraffictype: Email x-ms-traffictypediagnostic: BYAPR05MB6677:EE_|CO1PR05MB8268:EE_ x-ms-office365-filtering-correlation-id: a9056bed-d3fa-41b7-bd1c-08db77d1c769 x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: o6ddVAKnHfg5Wk7fb4/zUhaLAmvYdrLQP20wBsKT5rdTENYRt/LP4mqaAFbKLmjlMJOzOfdEPg14NxwgxMtjeKJYrNs5q4OQmF8Tm/wS+dRKOaatrh/GEh4Q6ZxoEXeasneHpvXi9TV5790ddB8p1BgBt3TOD4OLx93KicYlu+ZSmMFpU3C5PWxrJuPig2HwrzOc2vpDRb3W2wDzdmpS0QaDnUkLKbjfNMUAxSm39XosUbV8p3W71FcowXXBaanaurN6mpnoD7JzmlEwi+UJWkyk5ZQz08oYIPNC5vRaAn+hTeDDY6hCW8sL5oiaLAg/slHFDN5TV7WQlKFgDfm0vT1K+FsmJ9adlpZCKgoeMq+uLtQINx/MxmqWKxRpQpvu7wdyGuQk5IAM1exjZE+ZjLeL3Lz8ZqndorVCvJ+IOrbh5icFQ4Axb+pfEuLQPp+SMHz0M/KjUwVGXAVcQ0jiZwmWDwB8BqJEqPdzFfrDPfPfc5O9zabJaUkg9QPgZoR8uQ0GzMLA1MI/tFDyRyjTWHBWTPXaleP/o2Ap2+GRSyPfFpR9WEVfdYOoI8xYh4ZCMNZ/Smbfsfs4wAUBpOpAAauyWxVRTfNzwP03g0DNX60ZfMTqQSJB2bgsHOXjpbeYvUZH00N+ADkrbzPHk/zSucWzqIUpuNOPkX9iDtpj1fg= x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:BYAPR05MB6677.namprd05.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230028)(4636009)(346002)(39860400002)(396003)(136003)(376002)(366004)(451199021)(33656002)(38100700002)(5660300002)(86362001)(41300700001)(91956017)(66476007)(6916009)(8936002)(66446008)(8676002)(38070700005)(64756008)(66556008)(316002)(4326008)(122000001)(66946007)(76116006)(55016003)(478600001)(107886003)(52536014)(2940100002)(186003)(6506007)(71200400001)(9686003)(4744005)(26005)(7696005)(54906003)(2906002)(83380400001);DIR:OUT;SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?5guB69DOYVQ6h//BlhU78ZFnLEI8OdPvzJSl/WpN4Rsx/EOruB8XWy411PeA?= =?us-ascii?Q?zg1oJ1cyAfklB5C324AvqG1WlnBUFWvXfNk2DVivVuC2UDdeD72br1ALUT9A?= =?us-ascii?Q?YfH9NO4Ct4wLpdl/u2jTrSdMzG3g9H1nz+DHoI2aHFtECc3021iJuwNmzVOd?= =?us-ascii?Q?uLM9YX2fY+JWGRxNFjtivr+6leA4UPZPnsXuq4wYlyhoCaGXANd/PwqHBxiV?= =?us-ascii?Q?3D9DWYDtuzHVG3vI7YHjUVfECalcYsBmDUGSnSs+OMg9wzlnGe+NJ6mQsNcp?= =?us-ascii?Q?nN8s1ICKOPpM6GT8jJzX2vlBGeO1x+swqI/S0wnLyX9d3y+Zu5T4eQaElZuS?= =?us-ascii?Q?oOZ8DMcX3Xk3hzf6qLwXoVog/F6vl3UNt3voVPmziBe7z4trGz1u2tlhFplY?= =?us-ascii?Q?bmjybCmmRHBO+ambESH9cP8UYp4paUWpn1YVXT+txid0sYtd0mdlT/X8V6dt?= =?us-ascii?Q?dYjS46pZ39/t1WpxfWJ+6OVbH4vQudMEV+ShkZ62zkzVoE0buWzQyuQ+f0ps?= =?us-ascii?Q?/O3ezI+hTqibzh1Hd38Efn6gPVMN7peKSKtvhla57ZrSYwmSrzEMha1jftyf?= =?us-ascii?Q?Jvn8kYP/LDktsDAWIdxxvUuFgMWHqH5j7H1LikUtst8nwa9quht0mq3nxKrA?= =?us-ascii?Q?2K1UYjyN+0QuZPDPDZYZwSGiH08/tEta25AbvFkI1lXlufp2lumApMptsSFm?= =?us-ascii?Q?HcuJgDaSzyjRp1OfMjThGUvRki2E6bU2PRz9pKPdBHQcVtP1TfeF5i4j4Ekt?= =?us-ascii?Q?gghydmYg9jQN351GaRMY+jKZzhLYm1SfoBUc58XSOLaIFgrCA0t6h0NjUzOT?= =?us-ascii?Q?Hun8Ma9xFM4P5QnBkuPHf1qqRCwZfgFX0Ad0CI1oayfBawP7DKuARDUZxRBC?= =?us-ascii?Q?PXpD360Wk2kz6w8othQcPQqjcpm6R9CAZLERk2hdgXWY0MA0R3ggMPwKUKDt?= =?us-ascii?Q?mgiA6cdAXVkhEbBOiCjel6Cg7TCSqSc/L8DhnAq8PZFlDyOChJZ1QQCkphBg?= =?us-ascii?Q?RLCABIHsQ8v2O/zjiVebm88CKYsw1I1+qi/Yv6A/dF+ofH1eNheMoCflZ8QU?= =?us-ascii?Q?MazuKdidHpxthl/qCxzRyPFa5jpyPG2fYMH0qDBLfb659x1kHtL7gu7BxhwI?= =?us-ascii?Q?0AtqdsI8cG8uYiIetosY4ZpyzCuGkC5lWdVVn8GPdvZsnIya/HpDOkW8k7P/?= =?us-ascii?Q?oBJRy76QlgowP/GC9p4/V5yyi+B4WtVpSDKxJptNMk4xIRIAa3STu6ca77wt?= =?us-ascii?Q?/VYhx2IaC7bXiTiSkLXeQhM1jUoQ/GgIbmMxa6PKictxFTDQOh+GqnwUZAqL?= =?us-ascii?Q?LgK4RgEYaG1qTiplca/cO8gBcnvxjD1XR6YhqaC0LU3VAsFR4GJG+Oma/oFc?= =?us-ascii?Q?rYaHJcA80dU1RDq9ffAXtNo3ieCbW81fp/Qv3l0eV+cpaOytJBBs34GP1Xbw?= =?us-ascii?Q?fVybYI9OitnI279wItWPxzwBTk782y3cVF409Rd1Hyz8SRRpF3ISkg2XAFw/?= =?us-ascii?Q?YhWGxR29db7xUn+/Z6G+PiNmWLXt+ufEMwQEr5cCm408xQTTL/HpHKKPAMdy?= =?us-ascii?Q?svn7BkJ5CDZlQuOa8w/T/FF9URgEaKM1bKYTPFuoFb89TMtYwAWvXpV2bE4D?= =?us-ascii?Q?uQ=3D=3D?= Content-Type: multipart/alternative; boundary="_000_BYAPR05MB6677A86EDDAEDBE5E0DD6266B724ABYAPR05MB6677namp_" List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: juniper.net X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: BYAPR05MB6677.namprd05.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: a9056bed-d3fa-41b7-bd1c-08db77d1c769 X-MS-Exchange-CrossTenant-originalarrivaltime: 28 Jun 2023 12:18:28.0459 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: bea78b3c-4cdb-4130-854a-1d193232e5f4 X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: ACnJAOJe8t0bswMPAi9CBukwC8UYBq5nz01juPIINYERJKDouGtfV8HZq19jtlLMlUbQNYambnXX+9Fn/4v63w== X-MS-Exchange-Transport-CrossTenantHeadersStamped: CO1PR05MB8268 X-Proofpoint-GUID: 21pSAUPxfkiaElnvuttJCVHLM1PSJHfF X-Proofpoint-ORIG-GUID: 21pSAUPxfkiaElnvuttJCVHLM1PSJHfF X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.254,Aquarius:18.0.957,Hydra:6.0.591,FMLib:17.11.176.26 definitions=2023-06-28_08,2023-06-27_01,2023-05-22_02 X-Proofpoint-Spam-Details: rule=outbound_spam_notspam policy=outbound_spam score=0 mlxscore=0 malwarescore=0 priorityscore=1501 clxscore=1011 mlxlogscore=233 bulkscore=0 impostorscore=0 lowpriorityscore=0 suspectscore=0 phishscore=0 adultscore=0 spamscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2305260000 definitions=main-2306280109 X-Spamd-Result: default: False [-4.96 / 15.00]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-0.998]; NEURAL_HAM_SHORT(-0.86)[-0.858]; DMARC_POLICY_ALLOW(-0.50)[juniper.net,reject]; R_DKIM_ALLOW(-0.20)[juniper.net:s=PPS1017,juniper.net:s=selector1]; R_SPF_ALLOW(-0.20)[+ip4:67.231.152.164]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[67.231.152.164:from]; MLMMJ_DEST(0.00)[freebsd-arm@FreeBSD.org]; ASN(0.00)[asn:22843, ipnet:67.231.152.0/24, country:US]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_IN_DNSWL_NONE(0.00)[40.93.6.22:received]; TO_MATCH_ENVRCPT_SOME(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-arm@freebsd.org]; RCVD_COUNT_FIVE(0.00)[5]; DKIM_TRACE(0.00)[juniper.net:+]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_EQ_ADDR_SOME(0.00)[] X-Rspamd-Queue-Id: 4QrgbX5dk9z4CMN X-Spamd-Bar: ---- X-ThisMailContainsUnwantedMimeParts: N --_000_BYAPR05MB6677A86EDDAEDBE5E0DD6266B724ABYAPR05MB6677namp_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hello FreeBSD team, We have upgraded our FreeBSD kernel from 12 to main branch and with latest = main branch one of our boxes with Broadcom iProc Northstar2 BCM5871X SoC (Quad-core ARM Cortex-A57 64-bit 2GH= z ARMv8-A CPU architecture) is crashing at mtx_spin_lock_flags(), with data= _abort exception. Sometimes the exception is raised at DPCPCU_PTR() functions. Has anyone tried to boot freeBSD14 on the above mentioned BCM SoC? Please share your inputs and comment Regards Faisal Juniper Business Use Only --_000_BYAPR05MB6677A86EDDAEDBE5E0DD6266B724ABYAPR05MB6677namp_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

 

Hello FreeBSD team,

 

We have upgraded ou= r FreeBSD kernel from 12 to main branch and with latest main branch one of = our boxes with

Broadcom iProc N= orthstar2 BCM5871X SoC (Qu= ad-core ARM Cortex-A57 64-bit 2GHz ARMv8-A CPU architecture) is crashing at mtx_sp= in_lock_flags(), with data_abort exception.

Sometimes the excep= tion is raised at DPCPCU_PTR() functions.

 

Has anyone tried to= boot freeBSD14 on the above mentioned BCM SoC? 

 

Please share your i= nputs and comment

 

Regards

Faisal


Juniper Business Use Only

--_000_BYAPR05MB6677A86EDDAEDBE5E0DD6266B724ABYAPR05MB6677namp_-- From nobody Wed Jun 28 15:16:36 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4QrlYR1HB4z4kmB4 for ; Wed, 28 Jun 2023 15:16:59 +0000 (UTC) (envelope-from bounce.x5nw2t6e30=oevmwiaxjzbd=mxibued336@em790814.fubar.geek.nz) Received: from e2i947.smtp2go.com (e2i947.smtp2go.com [103.2.143.179]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4QrlYQ3RX6z436h for ; Wed, 28 Jun 2023 15:16:57 +0000 (UTC) (envelope-from bounce.x5nw2t6e30=oevmwiaxjzbd=mxibued336@em790814.fubar.geek.nz) Authentication-Results: mx1.freebsd.org; none Received: from [10.99.243.232] (helo=morbo.fubar.geek.nz) by smtpcorp.com with esmtpsa (TLS1.3:ECDHE_X25519__RSA_PSS_RSAE_SHA256__AES_256_GCM:256) (Exim 4.96-S2G) (envelope-from ) id 1qEWuX-9EWc9B-36; Wed, 28 Jun 2023 15:16:50 +0000 Received: from smtpclient.apple (cpc91210-cmbg18-2-0-cust37.5-4.cable.virginm.net [81.102.44.38]) by morbo.fubar.geek.nz (Postfix) with ESMTPSA id D5B371D1E4; Wed, 28 Jun 2023 15:16:46 +0000 (UTC) From: Andrew Turner Message-Id: Content-Type: multipart/alternative; boundary="Apple-Mail=_97373922-34CE-48C8-99BD-378F95FF3BF5" List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.500.231\)) Subject: Re: Kernel crash before login prompt Date: Wed, 28 Jun 2023 16:16:36 +0100 In-Reply-To: Cc: "freebsd-arm@FreeBSD.org" , Steve Kiernan , Mahesh Vardhamanaiah To: Sha Faisal References: X-Mailer: Apple Mail (2.3731.500.231) X-smtpcorp-track: 1qEWIb9EWc9U36.nJ7gkFBB98kdu DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=smtpservice.net; i=@smtpservice.net; q=dns/txt; s=a1-4; t=1687965415; h=feedback-id : x-smtpcorp-track : date : message-id : to : subject : from : reply-to : sender : list-unsubscribe; bh=SbMLzyYrUyHjUQEHAEOEtIxIKgKk5x5sNbF0jRJcGKM=; b=1nD75cHvGwOerG6mdetU3U5SW5159C750xqfs4lq07GqIfqIEtYPH+sR1uwq4RArv0t1F qunkXbWmubQdbNZZTWtvLM1y5ku37M8LG8cT60KwanzZEVc6F8Vuig9SGGJclIkbZ1fOvK6 VPTJb8h0zzpswD6P69eP8lUlADp9SQqLT5SSo0Hgx5OVazFnXdSXJK3dhypOGUZGJbe7OMA +6mvjJ+fPgVMuAPGGgnLvXARJ/vJD2dKYvBOg/EHCHP6D/LCRSeB/3eCrUPMnyBb64f06cO DE1HTB55xTl/y2YIVLBH+GwDsSYQWNyat9+tMN2jue2tVDNYKoMzJGRdv1Gg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=fubar.geek.nz; i=@fubar.geek.nz; q=dns/txt; s=s790814; t=1687965415; h=from : subject : to : message-id : date; bh=SbMLzyYrUyHjUQEHAEOEtIxIKgKk5x5sNbF0jRJcGKM=; b=eJfi44x4OdMiBrxQU25OQBU+wAsrpQX325IwtrCEA/sfyPeTAXg5NABmuWAmk5uV4sqlB qKeLtUWfsDgWfuyUTU+kClCd1r8XyAmFRKB3MVzFVjOHMjLkj1FP5gWUyRZzthMjkVi0uH/ Z75rtcnBshsUeYq3BuDwFm9Y6IdJyfp2sS0t9XPNAaHwLDxvoEX5+mqqRAmoaMrOAJ34SIF Q10AzaR0s1wVAEKyrK/U0T2w/6bcCvbylMBvr4zi9dRgsnqyclBrooJcvdpVWmDyNK2R+lk O15HaNcFnA9QIeNm7EE4vBpwe06GjpGtOBSiGhahIqlJWzihOEG5HGOm53Pw== X-Rspamd-Queue-Id: 4QrlYQ3RX6z436h X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:23352, ipnet:103.2.140.0/22, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N --Apple-Mail=_97373922-34CE-48C8-99BD-378F95FF3BF5 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 > On 28 Jun 2023, at 13:18, Sha Faisal wrote: >=20 > =20 > Hello FreeBSD team, > =20 > We have upgraded our FreeBSD kernel from 12 to main branch and with = latest main branch one of our boxes with > Broadcom iProc Northstar2 BCM5871X SoC (Quad-core ARM Cortex-A57 = 64-bit 2GHz ARMv8-A CPU architecture) is crashing at = mtx_spin_lock_flags(), with data_abort exception. > Sometimes the exception is raised at DPCPCU_PTR() functions. > =20 > Has anyone tried to boot freeBSD14 on the above mentioned BCM SoC?=20 > =20 > Please share your inputs and comment I don=E2=80=99t know of any issues with either of these, and don=E2=80=99t= know of anyone running FreeBSD on this SoC. Can you provide more details on what is failing, e.g. the boot log? Andrew --Apple-Mail=_97373922-34CE-48C8-99BD-378F95FF3BF5 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8
On 28 Jun = 2023, at 13:18, Sha Faisal <sfaisal@juniper.net> wrote:

 
Hello FreeBSD = team,
 
We have upgraded our FreeBSD kernel from 12 = to main branch and with latest main branch one of our boxes = with
Broadcom = iProc Northstar2 BCM5871X SoC (Quad-core ARM Cortex-A57 64-bit 2GHz = ARMv8-A CPU architecture) is crashing at mtx_spin_lock_flags(), with = data_abort exception.
Sometimes the exception is raised at = DPCPCU_PTR() functions.
 
Has anyone tried to boot freeBSD14 on the = above mentioned BCM SoC? 
 
Please share your inputs and = comment

I don=E2=80=99t know of any issues with either of these, and = don=E2=80=99t know of anyone running FreeBSD on this = SoC.

Can you provide more details on what is = failing, e.g. the boot = log?

Andrew

= --Apple-Mail=_97373922-34CE-48C8-99BD-378F95FF3BF5-- From nobody Wed Jun 28 18:45:28 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4QrrB71r4dz4klS6 for ; Wed, 28 Jun 2023 18:45:35 +0000 (UTC) (envelope-from sfaisal@juniper.net) Received: from mx0a-00273201.pphosted.com (mx0a-00273201.pphosted.com [208.84.65.16]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.pphosted.com", Issuer "Thawte RSA CA 2018" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4QrrB65l11z4HJ3 for ; Wed, 28 Jun 2023 18:45:34 +0000 (UTC) (envelope-from sfaisal@juniper.net) Authentication-Results: mx1.freebsd.org; none Received: from pps.filterd (m0108156.ppops.net [127.0.0.1]) by mx0a-00273201.pphosted.com (8.17.1.19/8.17.1.19) with ESMTP id 35SGC9t8015695; Wed, 28 Jun 2023 11:45:31 -0700 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=juniper.net; h=from : to : cc : subject : date : message-id : references : in-reply-to : content-type : mime-version; s=PPS1017; bh=Wob3/0io7fvemyniosS646KVnqdWUfmqae6p0Z2Oxgc=; b=GbV+iA3Qo8r/lkYQLsE7qo635o0kfeNmSxPZ+uKTcV7T9kp2IIz+ZX7Ja8BZgaHttBAF aoXASyJNPOD3OY6u7gwQRYrli+4lk4cR5VsA/GHh9ZJxJXn31igfkXGtOllw9oDezpl+ MsPmHzpWDxwaC3MWNBYIGsb4MJp2cIugP503q42z1YxN8bn3orDvn95l7tgWwGmpDOIj FRNqS0Eqmmunr98bJ7H1FvGf00HCWAmmQm1mIHPPwN53gEUX0n0TGeuILhOvu0884NX2 r9WYLouG+DMVNGHOKwoO2ox4wE2s/Lx6TpU/st0KpFyHYtsfqZf3ErN5T7z4LI/b+h/L Gg== Received: from cy4pr02cu007.outbound.protection.outlook.com (mail-westcentralusazlp17011015.outbound.protection.outlook.com [40.93.6.15]) by mx0a-00273201.pphosted.com (PPS) with ESMTPS id 3rgr610ajs-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Wed, 28 Jun 2023 11:45:31 -0700 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=b5CCCSmBzQ9h426v0U/UV2ZrUVnuWd/XGYNEqruEI9zB+zpNbWtGaVtyh8qqYikX1HadtapynZ1NIzs2SI0vnaVAKp+iJUBKkQ+CE+BnWyp2gwyJT7dNHh5m3AIq5nrgXIIdH7zg7XVRIFGNORjfB2t0MFwviTUnSLlS4B0UaVS80nMiKhld4gB3SZAGK495QCPOppnxTmn68FrL92397H0jIa8PF63Zv3+apBdIx74iyKVNp+8nvR1GW10I4asW7QOpMYPhKV3FK8hD5osKk16jIx4edpMjmk3VHXWM1MXKCov+6PkVOYzx/90RhF/NXtLQ32EF/X+q89r26+aQXg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=Wob3/0io7fvemyniosS646KVnqdWUfmqae6p0Z2Oxgc=; b=axMH8fj6klK/65HPz/1Vg1sT0nfdROOyVSoDhal+lhzQas8eHHhffVqK7ZOQIALiNmgpcZdAuz1DglTq0yIbE0R1X7oKR27eq9tREph2zL4gDORj5ylkr9ZZ5HUJq2HKvR4zbJQVNxlxDrjkens8j5IAoIi9AucmoWj1OffpbdtMFh+85WicuDijgHNloeB++7xqpTzuVjUJPL1XB4Gkmy5Uhsu+44kVSQEoEWp+bJGMKEe3mS177NIyHxChX6mDg3wZ4Nm5vV4rAH4lSAMuw8fKRxlDK3/9v393XiZ/jr5wGIbrOG5IbteH1r1ol/3NmvOzH98SGsvB+FoG//i2+A== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=juniper.net; dmarc=pass action=none header.from=juniper.net; dkim=pass header.d=juniper.net; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=juniper.net; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=Wob3/0io7fvemyniosS646KVnqdWUfmqae6p0Z2Oxgc=; b=RJA32uwFHLinLhM8EmzOTLGttVEwoxsl6lYdiwEQu88wCk2iGXjSTIRCqdsTLm20XiUQ88Hz9WLwVzfnhn23p1ZGhEpiziO1UrkFQdnbYPTUZfeUUmbXWR+t5y2m07ER0EkbvsiQc81libtfVd1Yz+z9XFfcQlhCGZxKO7Wf3wk= Received: from BYAPR05MB6677.namprd05.prod.outlook.com (2603:10b6:a03:ec::28) by DS0PR05MB9079.namprd05.prod.outlook.com (2603:10b6:8:cd::17) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6521.23; Wed, 28 Jun 2023 18:45:29 +0000 Received: from BYAPR05MB6677.namprd05.prod.outlook.com ([fe80::65c0:5c8:b916:d4e1]) by BYAPR05MB6677.namprd05.prod.outlook.com ([fe80::65c0:5c8:b916:d4e1%4]) with mapi id 15.20.6521.026; Wed, 28 Jun 2023 18:45:28 +0000 From: Sha Faisal To: Andrew Turner CC: "freebsd-arm@FreeBSD.org" , Steve Kiernan , Mahesh Vardhamanaiah Subject: Re: Kernel crash before login prompt Thread-Topic: Kernel crash before login prompt Thread-Index: AQHZqYguFdDezJe7q0OItnaHAyE0G6+gIhyygAAx4gCAADjn4Q== Date: Wed, 28 Jun 2023 18:45:28 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-GB, en-US Content-Language: en-IN X-MS-Has-Attach: yes X-MS-TNEF-Correlator: msip_labels: MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Enabled=True;MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_SiteId=bea78b3c-4cdb-4130-854a-1d193232e5f4;MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_SetDate=2023-06-28T18:40:15.4579718Z;MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_ContentBits=0;MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Method=Standard x-ms-publictraffictype: Email x-ms-traffictypediagnostic: BYAPR05MB6677:EE_|DS0PR05MB9079:EE_ x-ms-office365-filtering-correlation-id: a2d74d7f-3530-4f3e-4cc1-08db7807d7f4 x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: EZK8ucJjOkEpdES5OaDHbeJFnu6Zw7t5Qwtl+zR/Ln+YOjydcJQ/FtX+Td9fqZiGnTiInFDtLfdNual7JMh8LOtnNjeH62o5ER/4fl83QO99RCYmwd7BgEr3BSyj/vyPxmWXmUMc1RBmOCsDE8zXytuaB6NGlYSspYDtIJtsws+kHoLNOeGkmLP1UBedZa0Ts/r/zSQIxucT3yUSUw4WmKnLGJU9OGZw7qh+HqjLJ9CQa04besj0BHgARrh1tHKFyQ+v1t55qadgI+2AtBGXdCTuNJoKt1+Js3EmZxxQe63HFQ5EVoBoxP2ge9WxPduClxdLwfxhpBvLSJ2EQuiaCw+gvcnC8RFqcKO6dm7r/x/MCYAiQVmCyfMcCDxytGHijWO6xciSg9aZhtp8uCGl+GxnL/Ij0zlZXzLSkIV7U9T/WmTV5CINLgp/C/OuhM3Q2iNJ8aSniWzM7faPnChj+7EYsaYA4s+LXf6448xawzj82fGIqUvFJL1Y/rb4YtDISVtXlQSFqHBZv3cQz1Iv7pBjDvs9RxdODAiGSuZq4CDqZ61GQTXc9nQ19/LylqCKT5R4lRZGGdhMGclr+ZDxHpqfH9K8nnoeo2d8zWgu4Gw= x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:BYAPR05MB6677.namprd05.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230028)(4636009)(346002)(376002)(396003)(136003)(39860400002)(366004)(451199021)(52536014)(478600001)(107886003)(2906002)(54906003)(7696005)(26005)(83380400001)(186003)(9686003)(53546011)(6506007)(71200400001)(86362001)(41300700001)(33656002)(38100700002)(5660300002)(4326008)(66946007)(122000001)(66556008)(316002)(55016003)(76116006)(9326002)(8936002)(91956017)(66476007)(6916009)(64756008)(8676002)(38070700005)(99936003)(66446008);DIR:OUT;SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?Windows-1252?Q?jucxB1+/+dBwPZa4OzJzeJaxoMmUQPD5uIeiKa9+nwxK1PxM8ofWgYZQ?= =?Windows-1252?Q?k8d/f0cAwV2PXye5ECJSocE9jOw6HCTQG0ruVZCaX1p1ehLn5sYZMLkT?= =?Windows-1252?Q?cnxtjzPBRi5E0IMQKvZwlWozatTN3YC+3AtoYWfhQopg6JJ/wb6OgWVK?= =?Windows-1252?Q?fgF4aUexsJIKOwiAVY3rR4xkEmG8ylMbLK3fm7/h6VcQyWyzNI+WOvLv?= =?Windows-1252?Q?zSZcnSLcPFcslJ4b8KbpZd2TLVCSccIzXVPtFkcUER4jgzzx9QCcx0oN?= =?Windows-1252?Q?y8gOjU1NjVC/CRjUt9brmez1k1Z6in3rn7Lb8lTSL+X2Moi6TfJI+P8g?= =?Windows-1252?Q?rbl4CkaFSfLeaQGR4N8S9hVLr7r8cEBpkJpKBgumg6Qq6Nicj9N7QqxZ?= =?Windows-1252?Q?/64STgKWNhQauDoHVD+nbX+XiDPP58oEa6/gkTbks0LrfYal8ETEBDTH?= =?Windows-1252?Q?etK6+Yd6Xg883sMI700ulRDRhSx9YAaaFc7heNIcl8lcpv3+tf2uERYT?= =?Windows-1252?Q?/WR9JNEWtyYclr+2pU6KF6LvFBjBfXqhhV8sTPSyVqi2BboGAgGfzTk/?= =?Windows-1252?Q?qi0XX8zK/Og/X4SL+dYB+C+NciuzBxreiTz0plZLid0uPWN2Oe1IkKhS?= =?Windows-1252?Q?ZAs9E9NPjJyG9RxWQBG9C7Ls2hPMD4KKhEJv/s97aRxlHWBz0hSvE59W?= =?Windows-1252?Q?Ow/jhQbqyp8Qiyiej+gSOM6X85qWvaUfWfTgMyNwg8nMIzHGDa51mjRK?= =?Windows-1252?Q?BhawmLfVgjeKG6PSdBL8qnssFIKIA6SXOVaKlZgezlRnwK/pcHldWHvc?= =?Windows-1252?Q?hLQJRK1062hlZ1ARPAz9+p0psR24cvYkbEaKbIUNE/i04UvWchxenAtt?= =?Windows-1252?Q?TdWC/FA3w97y34/7tgak82NwOPLim3GeJ782xIZp+tnb1HylUbNQzJBT?= =?Windows-1252?Q?w/Sg9Y+e+KsiWFpJV5cT2UIgyBUr+9WPdkWhl7G+b2UKFTpNz13JQVEZ?= =?Windows-1252?Q?O2jxQRqaipD1YtpUtLTOy1R3ygtAvaEFCPZvlGTHylRq763RRTrKnFEc?= =?Windows-1252?Q?5n23dWemWMBnqiHflwcxtx2vfcknOCkYMNtRHd4Gr0wqBH04O4iBUxom?= =?Windows-1252?Q?xIfNZjODwIT1uHubaK3PPBSlRaBdkVJizRgm3pS7HgLHjBfMbL2FRCDb?= =?Windows-1252?Q?blC1IQvtOFA5PfZLuQqFt3vSzffkTl6CMMLcy1hqn0q0IBHbWH+VOFnE?= =?Windows-1252?Q?Cs/jSNuApuhQ0haCTarTxxnNv6GBmZNPRdMyvZzMJJ7Ego7TbnakVn84?= =?Windows-1252?Q?0YH1oSyuiAoW/CNz/Q4mgO9D3BybBxrvnoxBwz1u5SsPs3vvpa7N4qEu?= =?Windows-1252?Q?PjGFyV9iLkdYP9+3+0wXgwCsWebXqNqdxu+Ig9sK6fPrvtTeIgS92LSv?= =?Windows-1252?Q?GS/SZrYP9rYsd1JXvppzo8BPCdinCZrilloQTAvSt2rQl6C4SLu+2MqP?= =?Windows-1252?Q?7lg1I6V7V8OHoCLSVKN9KqOEa7LcRRboHIHxSnMXxMkwfso/3iZxL12E?= =?Windows-1252?Q?e1rEfz7rwuWfkxeVOeOPrqSKzNbBEvzONiz3QBcMjtyOa8kXkBUDRJFG?= =?Windows-1252?Q?5Bey/Gcro7Pmn6ftLFxElUwoC6xmGFooqwg7eLK4ecuLaXhk8ci7pGZk?= =?Windows-1252?Q?mU6d5pFLgXuNgkc7SvF8XGNiJkz2VndlTNioJydVZvf6IGHGB5lJmg?= =?Windows-1252?Q?=3D=3D?= Content-Type: multipart/mixed; boundary="_004_BYAPR05MB6677E63414F88873FF17174BB724ABYAPR05MB6677namp_" List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: juniper.net X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: BYAPR05MB6677.namprd05.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: a2d74d7f-3530-4f3e-4cc1-08db7807d7f4 X-MS-Exchange-CrossTenant-originalarrivaltime: 28 Jun 2023 18:45:28.5897 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: bea78b3c-4cdb-4130-854a-1d193232e5f4 X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: Vlgw++7qSF6uF/kovq1HMsNozlRpaq6yMj2hRp2EjbnLvNNSxejA6f5TLctBSIhrhvF31yKwgxIMczmva4RjYg== X-MS-Exchange-Transport-CrossTenantHeadersStamped: DS0PR05MB9079 X-Proofpoint-ORIG-GUID: zJotUiX7vkEq24DA4HVyN1q2pfvPmUwt X-Proofpoint-GUID: zJotUiX7vkEq24DA4HVyN1q2pfvPmUwt X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.254,Aquarius:18.0.957,Hydra:6.0.591,FMLib:17.11.176.26 definitions=2023-06-28_13,2023-06-27_01,2023-05-22_02 X-Proofpoint-Spam-Details: rule=outbound_spam_notspam policy=outbound_spam score=0 malwarescore=0 suspectscore=0 mlxlogscore=999 impostorscore=0 mlxscore=0 adultscore=0 spamscore=0 priorityscore=1501 clxscore=1011 lowpriorityscore=0 phishscore=0 bulkscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2305260000 definitions=main-2306280167 X-Rspamd-Queue-Id: 4QrrB65l11z4HJ3 X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:26211, ipnet:208.84.65.0/24, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N --_004_BYAPR05MB6677E63414F88873FF17174BB724ABYAPR05MB6677namp_ Content-Type: multipart/alternative; boundary="_000_BYAPR05MB6677E63414F88873FF17174BB724ABYAPR05MB6677namp_" --_000_BYAPR05MB6677E63414F88873FF17174BB724ABYAPR05MB6677namp_ Content-Type: text/plain; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable Hello Andrew, Attached is the boot log, also at the end I have pasted the remote gdb bac= ktrace Regards faisal Juniper Business Use Only From: Andrew Turner Date: Wednesday, 28 June 2023 at 20:47 To: Sha Faisal Cc: freebsd-arm@FreeBSD.org , Steve Kiernan , Mahesh Vardhamanaiah Subject: Re: Kernel crash before login prompt [External Email. Be cautious of content] On 28 Jun 2023, at 13:18, Sha Faisal wrote: Hello FreeBSD team, We have upgraded our FreeBSD kernel from 12 to main branch and with latest = main branch one of our boxes with Broadcom iProc Northstar2 BCM5871X SoC (Quad-core ARM Cortex-A57 64-bit 2GH= z ARMv8-A CPU architecture) is crashing at mtx_spin_lock_flags(), with data= _abort exception. Sometimes the exception is raised at DPCPCU_PTR() functions. Has anyone tried to boot freeBSD14 on the above mentioned BCM SoC? Please share your inputs and comment I don=92t know of any issues with either of these, and don=92t know of anyo= ne running FreeBSD on this SoC. Can you provide more details on what is failing, e.g. the boot log? Andrew --_000_BYAPR05MB6677E63414F88873FF17174BB724ABYAPR05MB6677namp_ Content-Type: text/html; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable

Hello Andrew,

Attached is the boot log,  also at the end I have pasted the r= emote gdb backtrace

 

Regards

faisal

 


Juniper Business Use Only

From: Andrew Turner= <andrew@fubar.geek.nz>
Date: Wednesday, 28 June 2023 at 20:47
To: Sha Faisal <sfaisal@juniper.net>
Cc: freebsd-arm@FreeBSD.org <freebsd-arm@FreeBSD.org>, Steve K= iernan <stevek@juniper.net>, Mahesh Vardhamanaiah <maheshmv@junipe= r.net>
Subject: Re: Kernel crash before login prompt

<= span style=3D"font-size:10.5pt;font-family:"Lato",sans-serif;colo= r:black">[External Email. Be cautious of content]

 

 

On 28 Jun 2023, at = 13:18, Sha Faisal <sfaisal@juniper.net> wrote:

 

 

Hell= o FreeBSD team,

&nbs= p;

We h= ave upgraded our FreeBSD kernel from 12 to main branch and with latest main= branch one of our boxes with

B= roadcom iProc Northstar2 BCM5871X SoC (Quad-core ARM Cortex-A57 64-bit 2GHz ARMv8-A C= PU architecture) is crashing at mtx_spin_lock_flags(), with data_abort exception.

Some= times the exception is raised at DPCPCU_PTR() functions.

&nbs= p;

Has = anyone tried to boot freeBSD14 on the above mentioned BCM SoC? =

&nbs= p;

Plea= se share your inputs and comment

 

I don=92t know of a= ny issues with either of these, and don=92t know of anyone running FreeBSD = on this SoC.

 

Can you provide mor= e details on what is failing, e.g. the boot log?

 

Andrew

 

--_000_BYAPR05MB6677E63414F88873FF17174BB724ABYAPR05MB6677namp_-- --_004_BYAPR05MB6677E63414F88873FF17174BB724ABYAPR05MB6677namp_ Content-Type: application/rtf; name="main_kernel_crash.rtf" Content-Description: main_kernel_crash.rtf Content-Disposition: attachment; filename="main_kernel_crash.rtf"; size=19281; creation-date="Wed, 28 Jun 2023 18:45:26 GMT"; modification-date="Wed, 28 Jun 2023 18:45:26 GMT" Content-Transfer-Encoding: base64 e1xydGYxXGFuc2lcYW5zaWNwZzEyNTJcY29jb2FydGYyNjM5Clxjb2NvYXRleHRzY2FsaW5nMFxj b2NvYXBsYXRmb3JtMHtcZm9udHRibFxmMFxmbmlsXGZjaGFyc2V0MCBNZW5sby1SZWd1bGFyO30K e1xjb2xvcnRibDtccmVkMjU1XGdyZWVuMjU1XGJsdWUyNTU7XHJlZDBcZ3JlZW4wXGJsdWUwO1xy ZWQxNzBcZ3JlZW4xNzFcYmx1ZTM3O1xyZWQ1NlxncmVlbjE4NVxibHVlMTk5OwpccmVkNTdcZ3Jl ZW4xOTJcYmx1ZTM4O1xyZWQ4NlxncmVlbjMyXGJsdWUyNDQ7fQp7XCpcZXhwYW5kZWRjb2xvcnRi bDs7XGNzZ3JheVxjMDtcY3NzcmdiXGM3MjMzMVxjNzE2ODJcYzE4NTk5O1xjc3NyZ2JcYzI1NTQ2 XGM3NzAwN1xjODIwMjM7Clxjc3NyZ2JcYzI1NzA2XGM3Nzk2M1xjMTk1NTc7XGNzc3JnYlxjNDE2 ODFcYzI1OTU4XGM5NjY0ODt9ClxwYXBlcncxMTkwMFxwYXBlcmgxNjg0MFxtYXJnbDE0NDBcbWFy Z3IxNDQwXHZpZXd3MzQzNjBcdmlld2gxODUyMFx2aWV3a2luZDAKXHBhcmRcdHg1NjBcdHgxMTIw XHR4MTY4MFx0eDIyNDBcdHgyODAwXHR4MzM2MFx0eDM5MjBcdHg0NDgwXHR4NTA0MFx0eDU2MDBc dHg2MTYwXHR4NjcyMFxwYXJkaXJuYXR1cmFsXHBhcnRpZ2h0ZW5mYWN0b3IwCgpcZjBcZnMzOCBc Y2YyIFxDb2NvYUxpZ2F0dXJlMCAtLS08PEJPT1Q+Pi0tLVwKR0RCOiBkZWJ1ZyBwb3J0czogdWFy dFwKR0RCOiBjdXJyZW50IHBvcnQ6IHVhcnRcCktEQjogZGVidWdnZXIgYmFja2VuZHM6IGRkYiBn ZGJcCktEQjogY3VycmVudCBiYWNrZW5kOiBkZGJcCldBUk5JTkc6IENhbm5vdCBmaW5kIGZyZWVi c2QsZHRzLXZlcnNpb24gcHJvcGVydHksIGNhbm5vdCBjaGVjayBEVEIgY29tcGxpYW5jZVwKQ29w eXJpZ2h0IChjKSAxOTk4LTIwMjMgSnVuaXBlciBOZXR3b3JrcywgSW5jLlwKQ29weXJpZ2h0IChj KSAxOTkyLTIwMjMgVGhlIEZyZWVCU0QgUHJvamVjdC5cCkNvcHlyaWdodCAoYykgMTk3OSwgMTk4 MCwgMTk4MywgMTk4NiwgMTk4OCwgMTk4OSwgMTk5MSwgMTk5MiwgMTk5MywgMTk5NFwKCVRoZSBS ZWdlbnRzIG9mIHRoZSBVbml2ZXJzaXR5IG9mIENhbGlmb3JuaWEuIEFsbCByaWdodHMgcmVzZXJ2 ZWQuXApGcmVlQlNEIGlzIGEgcmVnaXN0ZXJlZCB0cmFkZW1hcmsgb2YgVGhlIEZyZWVCU0QgRm91 bmRhdGlvbi5cCkZyZWVCU0QgMTQuMC1DVVJSRU5UICMxNiBtYWluLW4yNjMxMzAtMjYyYmJmNjg0 YjMtZGlydHk6IFdlZCBKdW4gMjggMDM6MDY6MDEgUERUIDIwMjNcCiAgICBzZmFpc2FsQHN2bC1i c2R4LTAyOi9iL3NmYWlzYWwvc3RhYmxlX21haW4vb2JqL2FybTY0L2p1bmlwZXIva2VybmVscy9K TlBSLUFSTTY0LVdJVC9rZXJuZWwgYXJtNjRcCkp1bmlwZXIgY2xhbmcgdmVyc2lvbiAxMy4wLjEg KGdpdEBlbmctZ2l0bGFiLmp1bmlwZXIubmV0OnRvb2xzLXRvdC9sbHZtIGQ2YzU5MzEwZWU0ZDVj MWM2NDllODM4MGJiZWQ0ZjBlZjZhNjU4MGIpXApXQVJOSU5HOiBXSVRORVNTIG9wdGlvbiBlbmFi bGVkLCBleHBlY3QgcmVkdWNlZCBwZXJmb3JtYW5jZS5cClZUOiBpbml0IHdpdGhvdXQgZHJpdmVy LlwKbW9kdWxlIGNwbGQgYWxyZWFkeSBwcmVzZW50IVwKbW9kdWxlIGNyeXB0byBhbHJlYWR5IHBy ZXNlbnQhXApsaW5rX2VsZjogc3ltYm9sIGlwdjRfaXBzZWNfc3VwcG9ydCB1bmRlZmluZWRcCktM RCBmaWxlIG5ldHN0YWNrLmtvIC0gY291bGQgbm90IGZpbmFsaXplIGxvYWRpbmdcCktMRCBmaWxl IGlmbGliLmtvIC0gY2Fubm90IGZpbmQgZGVwZW5kZW5jeSAibmV0c3RhY2siXApLTEQgZmlsZSBt aWlidXMua28gLSBjYW5ub3QgZmluZCBkZXBlbmRlbmN5ICJuZXRzdGFjayJcCktMRCBmaWxlIGlw cm9jX21kaW9fbXV4LmtvIC0gY2Fubm90IGZpbmQgZGVwZW5kZW5jeSAibWlpYnVzIlwKS0xEIGZp bGUgaWZfZ21hYy5rbyAtIGNhbm5vdCBmaW5kIGRlcGVuZGVuY3kgIm5ldHN0YWNrIlwKcmVhbCBt ZW1vcnkgID0gNDI5NDkyMjI0MCAoNDA5NSBNQilcCmF2YWlsIG1lbW9yeSA9IDQxMjQ5ODMyOTYg KDM5MzMgTUIpXApGcmVlQlNEL1NNUDogTXVsdGlwcm9jZXNzb3IgU3lzdGVtIERldGVjdGVkOiAx IENQVXNcCmFyYzRyYW5kb206IFdBUk5JTkc6IGluaXRpYWwgc2VlZGluZyBieXBhc3NlZCB0aGUg Y3J5cHRvZ3JhcGhpYyByYW5kb20gZGV2aWNlIGJlY2F1c2UgaXQgd2FzIG5vdCB5ZXQgc2VlZGVk IGFuZCB0aGUga25vYiAnYnlwYXNzX2JlZm9yZV9zZWVkaW5nJyB3YXMgZW5hYmxlZC5cClNlY3Vy aXR5IHBvbGljeSBsb2FkZWQ6IE1BQy92ZXJpZXhlYyAobWFjX3ZlcmlleGVjKVwKTUFDL3Zlcmll eGVjIGZpbmdlcnByaW50IG1vZHVsZSBsb2FkZWQ6IFNIQTI1NlwKTUFDL3ZlcmlleGVjIGZpbmdl cnByaW50IG1vZHVsZSBsb2FkZWQ6IFNIQTM4NFwKTUFDL3ZlcmlleGVjIGZpbmdlcnByaW50IG1v ZHVsZSBsb2FkZWQ6IFNIQTFcCnJhbmRvbTogZW50cm9weSBkZXZpY2UgZXh0ZXJuYWwgaW50ZXJm YWNlXApNQVAgZmRhZjAwMDAgbW9kZSAyIHBhZ2VzIDFcCk1BUCBmZmZjNzAwMCBtb2RlIDIgcGFn ZXMgMVwKbW9kdWxlX3JlZ2lzdGVyX2luaXQ6IE1PRF9MT0FEIChlZmlydCwgMHhmZmZmMDAwMDAw MDZkNTU0LCAwKSBlcnJvciA2XApvZndidXMwOiA8T3BlbiBGaXJtd2FyZSBEZXZpY2UgVHJlZT5c CnNpbXBsZWJ1czA6IDxGbGF0dGVuZWQgZGV2aWNlIHRyZWUgc2ltcGxlIGJ1cz4gb24gb2Z3YnVz MFwKY2xrX2ZpeGVkMDogPEZpeGVkIGNsb2NrPiBvbiBzaW1wbGVidXMwXApjbGtfZml4ZWQxOiA8 Rml4ZWQgZmFjdG9yIGNsb2NrPiBvbiBzaW1wbGVidXMwXApjbGtfZml4ZWQxOiBDYW5ub3QgRkRU IHBhcmFtZXRlcnMuXApkZXZpY2VfYXR0YWNoOiBjbGtfZml4ZWQxIGF0dGFjaCByZXR1cm5lZCA2 XApjbGtfZml4ZWQxOiA8Rml4ZWQgZmFjdG9yIGNsb2NrPiBvbiBzaW1wbGVidXMwXApjbGtfZml4 ZWQxOiBDYW5ub3QgRkRUIHBhcmFtZXRlcnMuXApkZXZpY2VfYXR0YWNoOiBjbGtfZml4ZWQxIGF0 dGFjaCByZXR1cm5lZCA2XApjbGtfZml4ZWQxOiA8Rml4ZWQgZmFjdG9yIGNsb2NrPiBvbiBzaW1w bGVidXMwXApjbGtfZml4ZWQxOiBDYW5ub3QgRkRUIHBhcmFtZXRlcnMuXApkZXZpY2VfYXR0YWNo OiBjbGtfZml4ZWQxIGF0dGFjaCByZXR1cm5lZCA2XApjbGtfZml4ZWQxOiA8Rml4ZWQgZmFjdG9y IGNsb2NrPiBvbiBzaW1wbGVidXMwXApjbGtfZml4ZWQxOiBDYW5ub3QgRkRUIHBhcmFtZXRlcnMu XApkZXZpY2VfYXR0YWNoOiBjbGtfZml4ZWQxIGF0dGFjaCByZXR1cm5lZCA2XApwc2NpMDogPEFS TSBQb3dlciBTdGF0ZSBDby1vcmRpbmF0aW9uIEludGVyZmFjZSBEcml2ZXI+IG9uIG9md2J1czBc CmNsa19maXhlZDE6IDxGaXhlZCBmYWN0b3IgY2xvY2s+IG9uIHNpbXBsZWJ1czBcCmNsa19maXhl ZDE6IENhbm5vdCBGRFQgcGFyYW1ldGVycy5cCmRldmljZV9hdHRhY2g6IGNsa19maXhlZDEgYXR0 YWNoIHJldHVybmVkIDZcCmNsa19maXhlZDE6IDxGaXhlZCBmYWN0b3IgY2xvY2s+IG9uIHNpbXBs ZWJ1czBcCmNsa19maXhlZDE6IENhbm5vdCBGRFQgcGFyYW1ldGVycy5cCmRldmljZV9hdHRhY2g6 IGNsa19maXhlZDEgYXR0YWNoIHJldHVybmVkIDZcCmNsa19maXhlZDE6IDxGaXhlZCBmYWN0b3Ig Y2xvY2s+IG9uIHNpbXBsZWJ1czBcCmNsa19maXhlZDE6IENhbm5vdCBGRFQgcGFyYW1ldGVycy5c CmRldmljZV9hdHRhY2g6IGNsa19maXhlZDEgYXR0YWNoIHJldHVybmVkIDZcCmNsa19maXhlZDE6 IDxGaXhlZCBmYWN0b3IgY2xvY2s+IG9uIHNpbXBsZWJ1czBcCmNsa19maXhlZDE6IENhbm5vdCBG RFQgcGFyYW1ldGVycy5cCmRldmljZV9hdHRhY2g6IGNsa19maXhlZDEgYXR0YWNoIHJldHVybmVk IDZcCmJjbWNydTA6IDxCcm9hZGNvbSBCQ001NlhYWCBjcnU+IG1lbSAweDY2MGUwMDAwLTB4NjYw ZTBmZmYgb24gc2ltcGxlYnVzMFwKY2xrX2ZpeGVkMTogPEZpeGVkIGZhY3RvciBjbG9jaz4gb24g c2ltcGxlYnVzMFwKY2xrX2ZpeGVkMTogQ2Fubm90IEZEVCBwYXJhbWV0ZXJzLlwKZGV2aWNlX2F0 dGFjaDogY2xrX2ZpeGVkMSBhdHRhY2ggcmV0dXJuZWQgNlwKY2xrX2ZpeGVkMTogPEZpeGVkIGZh Y3RvciBjbG9jaz4gb24gc2ltcGxlYnVzMFwKY2xrX2ZpeGVkMTogQ2Fubm90IEZEVCBwYXJhbWV0 ZXJzLlwKZGV2aWNlX2F0dGFjaDogY2xrX2ZpeGVkMSBhdHRhY2ggcmV0dXJuZWQgNlwKZ2ljMDog PEFSTSBHZW5lcmljIEludGVycnVwdCBDb250cm9sbGVyPiBtZW0gMHg2NTIxMDAwMC0weDY1MjEw ZmZmLDB4NjUyMjAwMDAtMHg2NTIyMGZmZiwweDY1MjQwMDAwLTB4NjUyNDFmZmYsMHg2NTI2MDAw MC0weDY1MjYwZmZmIGlycSA1NiBvbiBzaW1wbGVidXMwXApnaWMwOiBwbiAweDIsIGFyY2ggMHgy LCByZXYgMHgxLCBpbXBsZW1lbnRlciAweDQzYiBpcnFzIDUxMlwKZ2ljdjJtMDogPEFSTSBHZW5l cmljIEludGVycnVwdCBDb250cm9sbGVyIE1TSS9NU0lYPiBtZW0gMC0weGZmZiBvbiBnaWMwXApn aWN2Mm0xOiA8QVJNIEdlbmVyaWMgSW50ZXJydXB0IENvbnRyb2xsZXIgTVNJL01TSVg+IG1lbSAw eDEwMDAwLTB4MTBmZmYgb24gZ2ljMFwKZ2ljdjJtMjogPEFSTSBHZW5lcmljIEludGVycnVwdCBD b250cm9sbGVyIE1TSS9NU0lYPiBtZW0gMHgyMDAwMC0weDIwZmZmIG9uIGdpYzBcCmdpY3YybTM6 IDxBUk0gR2VuZXJpYyBJbnRlcnJ1cHQgQ29udHJvbGxlciBNU0kvTVNJWD4gbWVtIDB4MzAwMDAt MHgzMGZmZiBvbiBnaWMwXApnaWN2Mm00OiA8QVJNIEdlbmVyaWMgSW50ZXJydXB0IENvbnRyb2xs ZXIgTVNJL01TSVg+IG1lbSAweDQwMDAwLTB4NDBmZmYgb24gZ2ljMFwKZ2ljdjJtNTogPEFSTSBH ZW5lcmljIEludGVycnVwdCBDb250cm9sbGVyIE1TSS9NU0lYPiBtZW0gMHg1MDAwMC0weDUwZmZm IG9uIGdpYzBcCmdpY3YybTY6IDxBUk0gR2VuZXJpYyBJbnRlcnJ1cHQgQ29udHJvbGxlciBNU0kv TVNJWD4gbWVtIDB4NjAwMDAtMHg2MGZmZiBvbiBnaWMwXApnaWN2Mm03OiA8QVJNIEdlbmVyaWMg SW50ZXJydXB0IENvbnRyb2xsZXIgTVNJL01TSVg+IG1lbSAweDcwMDAwLTB4NzBmZmYgb24gZ2lj MFwKY2xrX2ZpeGVkMTogPEZpeGVkIGZhY3RvciBjbG9jaz4gb24gc2ltcGxlYnVzMFwKY2xrX2Zp eGVkMTogQ2Fubm90IEZEVCBwYXJhbWV0ZXJzLlwKZGV2aWNlX2F0dGFjaDogY2xrX2ZpeGVkMSBh dHRhY2ggcmV0dXJuZWQgNlwKY2xrX2ZpeGVkMTogPEZpeGVkIGZhY3RvciBjbG9jaz4gb24gc2lt cGxlYnVzMFwKY2xrX2ZpeGVkMTogQ2Fubm90IEZEVCBwYXJhbWV0ZXJzLlwKZGV2aWNlX2F0dGFj aDogY2xrX2ZpeGVkMSBhdHRhY2ggcmV0dXJuZWQgNlwKcGwzMzAwOiA8QVJNIFByaW1lQ2VsbCBE TUEgQ29udHJvbGxlciAoUEwzMzApPiBtZW0gMHg2MTM2MDAwMC0weDYxMzYwZmZmIGlycSAxMywx NCwxNSwxNiwxNywxOCwxOSwyMCwyMSBvbiBzaW1wbGVidXMwXApncGlvMDogPEJyb2FkY29tIEJD TTU2WFhYIEdQSU8gY29udHJvbGxlcj4gbWVtIDB4NjYwYTAwMDAtMHg2NjBhMDA0ZiBpcnEgNjMg b24gc2ltcGxlYnVzMFwKZ3Bpb2J1czA6IDxHUElPIGJ1cz4gb24gZ3BpbzBcCmdlbmVyaWNfdGlt ZXIwOiA8QVJNdjggR2VuZXJpYyBUaW1lcj4gaXJxIDAsMSwyLDMgb24gb2Z3YnVzMFwKVGltZWNv dW50ZXIgIkFSTSBNUENvcmUgVGltZWNvdW50ZXIiIGZyZXF1ZW5jeSAyNTAwMDAwMCBIeiBxdWFs aXR5IDEwMDBcCkV2ZW50IHRpbWVyICJBUk0gTVBDb3JlIEV2ZW50dGltZXIiIGZyZXF1ZW5jeSAy NTAwMDAwMCBIeiBxdWFsaXR5IDEwMDBcCmNsa19maXhlZDE6IDxGaXhlZCBmYWN0b3IgY2xvY2s+ IG9uIHNpbXBsZWJ1czBcCmNsa19maXhlZDE6IENhbm5vdCBGRFQgcGFyYW1ldGVycy5cCmRldmlj ZV9hdHRhY2g6IGNsa19maXhlZDEgYXR0YWNoIHJldHVybmVkIDZcCmNsa19maXhlZDE6IDxGaXhl ZCBmYWN0b3IgY2xvY2s+IG9uIHNpbXBsZWJ1czBcCmNsa19maXhlZDE6IENhbm5vdCBGRFQgcGFy YW1ldGVycy5cCmRldmljZV9hdHRhY2g6IGNsa19maXhlZDEgYXR0YWNoIHJldHVybmVkIDZcCmNs a19maXhlZDE6IDxGaXhlZCBmYWN0b3IgY2xvY2s+IG9uIHNpbXBsZWJ1czBcCmNsa19maXhlZDE6 IENhbm5vdCBGRFQgcGFyYW1ldGVycy5cCmRldmljZV9hdHRhY2g6IGNsa19maXhlZDEgYXR0YWNo IHJldHVybmVkIDZcCmNsa19maXhlZDE6IDxGaXhlZCBmYWN0b3IgY2xvY2s+IG9uIHNpbXBsZWJ1 czBcCmNsa19maXhlZDE6IENhbm5vdCBGRFQgcGFyYW1ldGVycy5cCmRldmljZV9hdHRhY2g6IGNs a19maXhlZDEgYXR0YWNoIHJldHVybmVkIDZcCmNsa19maXhlZDE6IDxGaXhlZCBmYWN0b3IgY2xv Y2s+IG9uIHNpbXBsZWJ1czBcCmNsa19maXhlZDE6IENhbm5vdCBGRFQgcGFyYW1ldGVycy5cCmRl dmljZV9hdHRhY2g6IGNsa19maXhlZDEgYXR0YWNoIHJldHVybmVkIDZcCmNsa19maXhlZDE6IDxG aXhlZCBmYWN0b3IgY2xvY2s+IG9uIHNpbXBsZWJ1czBcCmNsa19maXhlZDE6IENhbm5vdCBGRFQg cGFyYW1ldGVycy5cCmRldmljZV9hdHRhY2g6IGNsa19maXhlZDEgYXR0YWNoIHJldHVybmVkIDZc CmNwdWxpc3QwOiA8T3BlbiBGaXJtd2FyZSBDUFUgR3JvdXA+IG9uIG9md2J1czBcCmNwdTA6IDxP cGVuIEZpcm13YXJlIENQVT4gb24gY3B1bGlzdDBcCnBtdTA6IDxQZXJmb3JtYW5jZSBNb25pdG9y aW5nIFVuaXQ+IGlycSA0LDUsNiw3IG9uIG9md2J1czBcCnBtdTA6IE1pc3NpbmcgdmFsdWUgaW4g aW50ZXJydXB0IGFmZmluaXR5IHByb3BlcnR5XApkZXZpY2VfYXR0YWNoOiBwbXUwIGF0dGFjaCBy ZXR1cm5lZCA2XApwY2liMDogPEJyb2FkY29tIGlQcm9jIFBDSWUgUkMgZHJpdmVyPiBtZW0gMHgy MDAyMDAwMC0weDIwMDIwZmZmIG9uIG9md2J1czBcCnBjaTA6IDxPRlcgUENJIGJ1cz4gb24gcGNp YjBcCnBjaWIxOiA8UENJLVBDSSBicmlkZ2U+IGlycSA4NCBhdCBkZXZpY2UgMC4wIG9uIHBjaTBc CnBjaWIwOiBmYWlsZWQgdG8gcmVzZXJ2ZSByZXNvdXJjZSBmb3IgcGNpYjFcCnBjaWIxOiBmYWls ZWQgdG8gYWxsb2NhdGUgaW5pdGlhbCBtZW1vcnkgd2luZG93OiAwLTB4ZmZmZmZcCnBjaWIwOiBm YWlsZWQgdG8gcmVzZXJ2ZSByZXNvdXJjZSBmb3IgcGNpYjFcCnBjaWIxOiBmYWlsZWQgdG8gYWxs b2NhdGUgaW5pdGlhbCBwcmVmZXRjaCB3aW5kb3c6IDAtMHhmZmZmZlwKcGNpMTogPFBDSSBidXM+ IG9uIHBjaWIxXApwY2kxOiA8bWVtb3J5PiBhdCBkZXZpY2UgMC4wIChubyBkcml2ZXIgYXR0YWNo ZWQpXApwY2liMjogPEJyb2FkY29tIGlQcm9jIFBDSWUgUkMgZHJpdmVyPiBtZW0gMHg1MDAyMDAw MC0weDUwMDIwZmZmIG9uIG9md2J1czBcCnBjaTI6IDxPRlcgUENJIGJ1cz4gb24gcGNpYjJcCnBj aWIzOiA8UENJLVBDSSBicmlkZ2U+IGlycSA4NSBhdCBkZXZpY2UgMC4wIG9uIHBjaTJcCnBjaWIy OiBmYWlsZWQgdG8gcmVzZXJ2ZSByZXNvdXJjZSBmb3IgcGNpYjNcCnBjaWIzOiBmYWlsZWQgdG8g YWxsb2NhdGUgaW5pdGlhbCBtZW1vcnkgd2luZG93OiAwLTB4ZmZmZmZcCnBjaWIyOiBmYWlsZWQg dG8gcmVzZXJ2ZSByZXNvdXJjZSBmb3IgcGNpYjNcCnBjaWIzOiBmYWlsZWQgdG8gYWxsb2NhdGUg aW5pdGlhbCBwcmVmZXRjaCB3aW5kb3c6IDAtMHhmZmZmZlwKcGNpMzogPFBDSSBidXM+IG9uIHBj aWIzXApwY2liMjogZmFpbGVkIHRvIHJlc2VydmUgcmVzb3VyY2UgZm9yIHBjaWIzXApwY2liMjog ZmFpbGVkIHRvIHJlc2VydmUgcmVzb3VyY2UgZm9yIHBjaWIzXApwY2liMjogZmFpbGVkIHRvIHJl c2VydmUgcmVzb3VyY2UgZm9yIHBjaWIzXApwY2liMjogZmFpbGVkIHRvIHJlc2VydmUgcmVzb3Vy Y2UgZm9yIHBjaWIzXApwY2liMjogZmFpbGVkIHRvIHJlc2VydmUgcmVzb3VyY2UgZm9yIHBjaWIz XApwY2kzOiA8bmV0d29yaywgZXRoZXJuZXQ+IGF0IGRldmljZSAwLjAgKG5vIGRyaXZlciBhdHRh Y2hlZClcCnBjaTM6IDxuZXR3b3JrLCBldGhlcm5ldD4gYXQgZGV2aWNlIDAuMSAobm8gZHJpdmVy IGF0dGFjaGVkKVwKY2xrX2ZpeGVkMTogPEZpeGVkIGZhY3RvciBjbG9jaz4gb24gc2ltcGxlYnVz MFwKY2xrX2ZpeGVkMTogQ2Fubm90IEZEVCBwYXJhbWV0ZXJzLlwKZGV2aWNlX2F0dGFjaDogY2xr X2ZpeGVkMSBhdHRhY2ggcmV0dXJuZWQgNlwKY2xrX2ZpeGVkMTogPEZpeGVkIGZhY3RvciBjbG9j az4gb24gc2ltcGxlYnVzMFwKY2xrX2ZpeGVkMTogQ2Fubm90IEZEVCBwYXJhbWV0ZXJzLlwKZGV2 aWNlX2F0dGFjaDogY2xrX2ZpeGVkMSBhdHRhY2ggcmV0dXJuZWQgNlwKYmNtX25zMl91c2JwaHkw OiA8QnJvYWRjb20gTlMyIFVTQjIgUEhZPiBtZW0gMHg2NjAwMDk2MC0weDY2MDAwOTgzLDB4Njcw MTI4MDAtMHg2NzAxMjgwMywweDY1MDFkMTQ4LTB4NjUwMWQxNGIsMHg2NjRkMDcwMC0weDY2NGQw NzAzIGRpc2FibGVkIG9uIHNpbXBsZWJ1czBcCmlpY2hiMDogPEJyb2FkY29tIGlQcm9jIFNNQnVz IENvbnRyb2xsZXI+IG1lbSAweDY2MDgwMDAwLTB4NjYwODAwZmYgaXJxIDYxIG9uIHNpbXBsZWJ1 czBcCmlpY2J1czA6IDxPRlcgSTJDIGJ1cz4gb24gaWljaGIwXAppaWMwOiA8STJDIGdlbmVyaWMg SS9PPiBvbiBpaWNidXMwXApkczEzcnRjMDogPERhbGxhcy9NYXhpbSBEUzEzNDEgUlRDPiBhdCBh ZGRyIDB4ZDAgb24gaWljYnVzMFwKZ3Bpb2MwOiA8R1BJTyBjb250cm9sbGVyPiBvbiBncGlvMFwK aWljaGIxOiA8QnJvYWRjb20gaVByb2MgU01CdXMgQ29udHJvbGxlcj4gbWVtIDB4NjYwYjAwMDAt MHg2NjBiMDBmZiBpcnEgNjQgb24gc2ltcGxlYnVzMFwKaWljYnVzMTogPE9GVyBJMkMgYnVzPiBv biBpaWNoYjFcCmlpYzE6IDxJMkMgZ2VuZXJpYyBJL08+IG9uIGlpY2J1czFcCmlpY2J1czE6IDx1 bmtub3duIGNhcmQ+IGF0IGFkZHIgMHhkMFwKaWljYnVzMTogPHVua25vd24gY2FyZD4gYXQgYWRk ciAweGVhXAp1YXJ0MDogPDE2NzUwIG9yIGNvbXBhdGlibGU+IG1lbSAweDY2MTEwMDAwLTB4NjYx MTAwZmYgaXJxIDY2IG9uIHNpbXBsZWJ1czBcCnVhcnQwOiBjb25zb2xlICg0OTUyMyxuLDgsMSlc CnVhcnQxOiA8MTY3NTAgb3IgY29tcGF0aWJsZT4gbWVtIDB4NjYxMjAwMDAtMHg2NjEyMDBmZiBp cnEgNjcgb24gc2ltcGxlYnVzMFwKdWFydDI6IDwxNjc1MCBvciBjb21wYXRpYmxlPiBtZW0gMHg2 NjEzMDAwMC0weDY2MTMwMGZmIGlycSA2OCBvbiBzaW1wbGVidXMwXApzcGkwOiA8UEwwMjIgU1BJ L1NTUCBjb250cm9sbGVyPiBtZW0gMHg2NjE4MDAwMC0weDY2MTgwZmZmIGlycSA2OSBvbiBzaW1w bGVidXMwXApzcGlidXMwOiA8T0ZXIFNQSSBidXM+IG9uIHNwaTBcCmNwbGQwOiA8SnVuaXBlciBD UExEIG92ZXIgc3BpYnVzIGZvciBpUHJvYz4gYXQgY3MgNiBtb2RlIDMgb24gc3BpYnVzMFwKc3Bp YnVzMTogPE9GVyBTUEkgYnVzPiBvbiBjcGxkMFwKYWQ5NTIzMDogPEFuYWxvZyBEZXZpY2UgQUQ5 NTIzPiBhdCBjcyAzIG1vZGUgMCBvbiBzcGlidXMxXApiaXRzMDogPEJJVFMgZHMyNjUwMyBkcml2 ZXI+IGF0IGNzIDIgbW9kZSAwIG9uIHNwaWJ1czFcCmJwbTA6IDxKdW5pcGVyIEJQTSBhY2Nlc3Mg b3ZlciBzcGlidXM+IGF0IGNzIDQgbW9kZSAwIG9uIHNwaWJ1czFcCnNwaTE6IDxQTDAyMiBTUEkv U1NQIGNvbnRyb2xsZXI+IG1lbSAweDY2MTkwMDAwLTB4NjYxOTBmZmYgaXJxIDcwIG9uIHNpbXBs ZWJ1czBcCnNwaWJ1czI6IDxPRlcgU1BJIGJ1cz4gb24gc3BpMVwKZHBsbDA6IDxKdW5pcGVyIGRw bGwgb3ZlciBzcGlidXMgZm9yIGlQcm9jPiBhdCBjcyA2IG1vZGUgMyBvbiBzcGlidXMyXApiY21y bmcwOiA8QnJvYWRjb20gUkJHMjAwIFJORz4gbWVtIDB4NjYyMjAwMDAtMHg2NjIyMDAyNyBvbiBz aW1wbGVidXMwXApyYW5kb206IHJlZ2lzdGVyaW5nIGZhc3Qgc291cmNlIEJyb2FkY29tIFJCRzIw MCBSTkdcCmlwcm9jX3NkaGNpMDogPEJyb2FkY29tIGlQcm9jIFNESENJIGNvbnRyb2xsZXI+IG1l bSAweDY2NDIwMDAwLTB4NjY0MjAwZmYgaXJxIDc0IG9uIHNpbXBsZWJ1czBcCm1tYzA6IDxNTUMv U0QgYnVzPiBvbiBpcHJvY19zZGhjaTBcCnNwaTI6IDxCcm9hZGNvbSBCQ001NlhYWCBTUEk+IG1l bSAweDY2NDcwMDAwLTB4NjY0NzBmZmYgaXJxIDc3IG9uIHNpbXBsZWJ1czBcCnNwaWJ1czM6IDxP RlcgU1BJIGJ1cz4gb24gc3BpMlwKbXgyNWwwOiA8TTI1UHh4IEZsYXNoIEZhbWlseT4gYXQgY3Mg MCBtb2RlIDAgb24gc3BpYnVzM1wKbXgyNWwwOiBkZXZpY2UgdHlwZSBzMjVmbDUxMnMsIHNpemUg NjU1MzZLIGluIDEwMjQgc2VjdG9ycyBvZiA2NEssIGVyYXNlIHNpemUgNjRLXAplaGNpMDogPEdl bmVyaWMgRUhDSSBDb250cm9sbGVyPiBtZW0gMHg2NjRjMDAwMC0weDY2NGMwMGZmIGlycSA4MiBv biBzaW1wbGVidXMwXAp1c2J1czA6IEVIQ0kgdmVyc2lvbiAxLjBcCnVzYnVzMCBvbiBlaGNpMFwK b2FtY3RsMDogPE9BTSBDb250cm9sIHVzaW5nIENSTVUgZm9yIGlQcm9jPiBtZW0gMHg2NTAyNDAw MC0weDY1MDI0ZmZmIG9uIHNpbXBsZWJ1czBcCnN5c2Nvbl9nZW5lcmljX2RldjE6IENhbm5vdCBh bGxvY2F0ZSBtZW1vcnkgcmVzb3VyY2VcCmRldmljZV9hdHRhY2g6IHN5c2Nvbl9nZW5lcmljX2Rl djEgYXR0YWNoIHJldHVybmVkIDZcCmJjbV9pZG0wOiA8QnJvYWRjb20gSVBST0MgSURNIEJ1cyBt b25pdG9yPiBvbiBvZndidXMwXAppZG1fbW9uaXRvcjA6IDxJRE0gTW9uaXRvciByZWdpb24+IG1l bSAweDIxMDA0OTAwLTB4MjEwMDRhZmYgaXJxIDg4IG9uIGJjbV9pZG0wXAppZG1fbW9uaXRvcjE6 IDxJRE0gTW9uaXRvciByZWdpb24+IG1lbSAweDIxMDA1OTAwLTB4MjEwMDVhZmYgaXJxIDg5IG9u IGJjbV9pZG0wXAppZG1fbW9uaXRvcjI6IDxJRE0gTW9uaXRvciByZWdpb24+IG1lbSAweDIxMDA2 OTAwLTB4MjEwMDZhZmYgaXJxIDkwIG9uIGJjbV9pZG0wXAppZG1fbW9uaXRvcjM6IDxJRE0gTW9u aXRvciByZWdpb24+IG1lbSAweDIxMDA3OTAwLTB4MjEwMDdhZmYgaXJxIDkxIG9uIGJjbV9pZG0w XAppZG1fbW9uaXRvcjQ6IDxJRE0gTW9uaXRvciByZWdpb24+IG1lbSAweDIxMDA4OTAwLTB4MjEw MDhhZmYgaXJxIDkyIG9uIGJjbV9pZG0wXAppZG1fbW9uaXRvcjU6IDxJRE0gTW9uaXRvciByZWdp b24+IG1lbSAweDIxMDA5OTAwLTB4MjEwMDlhZmYgaXJxIDkzIG9uIGJjbV9pZG0wXAppZG1fbW9u aXRvcjY6IDxJRE0gTW9uaXRvciByZWdpb24+IG1lbSAweDUxMDA0OTAwLTB4NTEwMDRhZmYgaXJx IDk0IG9uIGJjbV9pZG0wXAppZG1fbW9uaXRvcjc6IDxJRE0gTW9uaXRvciByZWdpb24+IG1lbSAw eDUxMDA1OTAwLTB4NTEwMDVhZmYgaXJxIDk1IG9uIGJjbV9pZG0wXAppZG1fbW9uaXRvcjg6IDxJ RE0gTW9uaXRvciByZWdpb24+IG1lbSAweDUxMDA2OTAwLTB4NTEwMDZhZmYgaXJxIDk2IG9uIGJj bV9pZG0wXAppZG1fbW9uaXRvcjk6IDxJRE0gTW9uaXRvciByZWdpb24+IG1lbSAweDUxMDA3OTAw LTB4NTEwMDdhZmYgaXJxIDk3IG9uIGJjbV9pZG0wXAppZG1fbW9uaXRvcjEwOiA8SURNIE1vbml0 b3IgcmVnaW9uPiBtZW0gMHg1MTAwODkwMC0weDUxMDA4YWZmIGlycSA5OCBvbiBiY21faWRtMFwK aWRtX21vbml0b3IxMTogPElETSBNb25pdG9yIHJlZ2lvbj4gbWVtIDB4NTEwMDk5MDAtMHg1MTAw OWFmZiBpcnEgOTkgb24gYmNtX2lkbTBcCmlkbV9tb25pdG9yMTI6IDxJRE0gTW9uaXRvciByZWdp b24+IG1lbSAweDYwZTAwOTAwLTB4NjBlMDBhZmYgaXJxIDEwMCBvbiBiY21faWRtMFwKaWRtX21v bml0b3IxMzogPElETSBNb25pdG9yIHJlZ2lvbj4gbWVtIDB4NjBlMDE5MDAtMHg2MGUwMWFmZiBp cnEgMTAxIG9uIGJjbV9pZG0wXAppZG1fbW9uaXRvcjE0OiA8SURNIE1vbml0b3IgcmVnaW9uPiBt ZW0gMHg2MGUwMjkwMC0weDYwZTAyYWZmIGlycSAxMDIgb24gYmNtX2lkbTBcCmlkbV9tb25pdG9y MTU6IDxJRE0gTW9uaXRvciByZWdpb24+IG1lbSAweDYwZTA1OTAwLTB4NjBlMDVhZmYgaXJxIDEw MyBvbiBiY21faWRtMFwKaWRtX21vbml0b3IxNjogPElETSBNb25pdG9yIHJlZ2lvbj4gbWVtIDB4 NjEwOTE5MDAtMHg2MTA5MWFmZiBpcnEgMTA0IG9uIGJjbV9pZG0wXAppZG1fbW9uaXRvcjE3OiA8 SURNIE1vbml0b3IgcmVnaW9uPiBtZW0gMHg2MTA5MjkwMC0weDYxMDkyYWZmIGlycSAxMDUgb24g YmNtX2lkbTBcCmlkbV9tb25pdG9yMTg6IDxJRE0gTW9uaXRvciByZWdpb24+IG1lbSAweDYxNDAw OTAwLTB4NjE0MDBhZmYgaXJxIDEwNiBvbiBiY21faWRtMFwKaWRtX21vbml0b3IxOTogPElETSBN b25pdG9yIHJlZ2lvbj4gbWVtIDB4NjE0MDE5MDAtMHg2MTQwMWFmZiBpcnEgMTA3IG9uIGJjbV9p ZG0wXAppZG1fbW9uaXRvcjIwOiA8SURNIE1vbml0b3IgcmVnaW9uPiBtZW0gMHg2MTQwMjkwMC0w eDYxNDAyYWZmIGlycSAxMDggb24gYmNtX2lkbTBcCmlkbV9tb25pdG9yMjE6IDxJRE0gTW9uaXRv ciByZWdpb24+IG1lbSAweDYxNDA0OTAwLTB4NjE0MDRhZmYgaXJxIDEwOSBvbiBiY21faWRtMFwK aWRtX21vbml0b3IyMjogPElETSBNb25pdG9yIHJlZ2lvbj4gbWVtIDB4NjE0MDY5MDAtMHg2MTQw NmFmZiBpcnEgMTEwIG9uIGJjbV9pZG0wXAppZG1fbW9uaXRvcjIzOiA8SURNIE1vbml0b3IgcmVn aW9uPiBtZW0gMHg2MTQwNzkwMC0weDYxNDA3YWZmIGlycSAxMTEgb24gYmNtX2lkbTBcCmlkbV9t b25pdG9yMjQ6IDxJRE0gTW9uaXRvciByZWdpb24+IG1lbSAweDYxNDBjOTAwLTB4NjE0MGNhZmYg aXJxIDExMiBvbiBiY21faWRtMFwKaWRtX21vbml0b3IyNTogPElETSBNb25pdG9yIHJlZ2lvbj4g bWVtIDB4NjE0MGU5MDAtMHg2MTQwZWFmZiBpcnEgMTEzIG9uIGJjbV9pZG0wXAppZG1fbW9uaXRv cjI2OiA8SURNIE1vbml0b3IgcmVnaW9uPiBtZW0gMHg2MTQwZjkwMC0weDYxNDBmYWZmIGlycSAx MTQgb24gYmNtX2lkbTBcCmlkbV9tb25pdG9yMjc6IDxJRE0gTW9uaXRvciByZWdpb24+IG1lbSAw eDY1MzcxOTAwLTB4NjUzNzFhZmYgaXJxIDExNSBvbiBiY21faWRtMFwKaWRtX21vbml0b3IyODog PElETSBNb25pdG9yIHJlZ2lvbj4gbWVtIDB4NjUzNzI5MDAtMHg2NTM3MmFmZiBpcnEgMTE2IG9u IGJjbV9pZG0wXAppZG1fbW9uaXRvcjI5OiA8SURNIE1vbml0b3IgcmVnaW9uPiBtZW0gMHg2NTM3 MzkwMC0weDY1MzczYWZmIGlycSAxMTcgb24gYmNtX2lkbTBcCmlkbV9tb25pdG9yMzA6IDxJRE0g TW9uaXRvciByZWdpb24+IG1lbSAweDY1Mzc0OTAwLTB4NjUzNzRhZmYgaXJxIDExOCBvbiBiY21f aWRtMFwKaWRtX21vbml0b3IzMTogPElETSBNb25pdG9yIHJlZ2lvbj4gbWVtIDB4NjUzNzU5MDAt MHg2NTM3NWFmZiBpcnEgMTE5IG9uIGJjbV9pZG0wXAppZG1fbW9uaXRvcjMyOiA8SURNIE1vbml0 b3IgcmVnaW9uPiBtZW0gMHg2NTM3NjkwMC0weDY1Mzc2YWZmIGlycSAxMjAgb24gYmNtX2lkbTBc CmlkbV9tb25pdG9yMzM6IDxJRE0gTW9uaXRvciByZWdpb24+IG1lbSAweDY1Mzc3OTAwLTB4NjUz NzdhZmYgaXJxIDEyMSBvbiBiY21faWRtMFwKaWRtX21vbml0b3IzNDogPElETSBNb25pdG9yIHJl Z2lvbj4gbWVtIDB4NjUzNzg5MDAtMHg2NTM3OGFmZiBpcnEgMTIyIG9uIGJjbV9pZG0wXAppZG1f bW9uaXRvcjM1OiA8SURNIE1vbml0b3IgcmVnaW9uPiBtZW0gMHg2NTM3OTkwMC0weDY1Mzc5YWZm IGlycSAxMjMgb24gYmNtX2lkbTBcCmlkbV9tb25pdG9yMzY6IDxJRE0gTW9uaXRvciByZWdpb24+ IG1lbSAweDY1MzdhOTAwLTB4NjUzN2FhZmYgaXJxIDEyNCBvbiBiY21faWRtMFwKaWRtX21vbml0 b3IzNzogPElETSBNb25pdG9yIHJlZ2lvbj4gbWVtIDB4NjcwMDU5MDAtMHg2NzAwNWFmZiBpcnEg MTI1IG9uIGJjbV9pZG0wXAppZG1fbW9uaXRvcjM4OiA8SURNIE1vbml0b3IgcmVnaW9uPiBtZW0g MHg2NzAxNTkwMC0weDY3MDE1YWZmIGlycSAxMjggb24gYmNtX2lkbTBcCmlkbV9tb25pdG9yMzk6 IDxJRE0gTW9uaXRvciByZWdpb24+IG1lbSAweDY3MDE2OTAwLTB4NjcwMTZhZmYgaXJxIDEyOSBv biBiY21faWRtMFwKaWRtX21vbml0b3I0MDogPElETSBNb25pdG9yIHJlZ2lvbj4gbWVtIDB4Njcw MTc5MDAtMHg2NzAxN2FmZiBpcnEgMTMwIG9uIGJjbV9pZG0wXAppZG1fbW9uaXRvcjQxOiA8SURN IE1vbml0b3IgcmVnaW9uPiBtZW0gMHg2NzAxOTkwMC0weDY3MDE5YWZmIGlycSAxMzIgb24gYmNt X2lkbTBcCmlkbV9tb25pdG9yNDI6IDxJRE0gTW9uaXRvciByZWdpb24+IG1lbSAweDY3MDIwOTAw LTB4NjcwMjBhZmYgaXJxIDEzNSBvbiBiY21faWRtMFwKaWRtX21vbml0b3I0MzogPElETSBNb25p dG9yIHJlZ2lvbj4gbWVtIDB4NjcwMjE5MDAtMHg2NzAyMWFmZiBpcnEgMTM2IG9uIGJjbV9pZG0w XAppZG1fbW9uaXRvcjQ0OiA8SURNIE1vbml0b3IgcmVnaW9uPiBtZW0gMHg2NzAyMjkwMC0weDY3 MDIyYWZmIGlycSAxMzcgb24gYmNtX2lkbTBcCmlkbV9tb25pdG9yMTA6IEVycm9yIGRldGVjdGVk IGZvciBkZXZpY2UgbW9uaXRvciBwY2llXzFfYXBidFwKaWRtX21vbml0b3IxNDogRXJyb3IgZGV0 ZWN0ZWQgZm9yIGRldmljZSBtb25pdG9yIG5pY19heGkyYXBiX3NcCmlkbV9tb25pdG9yMzE6IEVy cm9yIGRldGVjdGVkIGZvciBkZXZpY2UgbW9uaXRvciBzY3JfZGRyX3NcCmlkbV9tb25pdG9yNDE6 IEVycm9yIGRldGVjdGVkIGZvciBkZXZpY2UgbW9uaXRvciBoc19hcGJzXApGYXRhbCBkYXRhIGFi b3J0OlwKICB4MDogMWJmZjAwMjAxYzY4MTgzOFwKICB4MTogICAgICAgICAgICAgICAgMFwKICB4 MjogZmZmZjAwMDAwMDQ5ZWViMyAobm90aWZ5LnByZWZpeCArIGFjNilcCiAgeDM6ICAgICAgICAg ICAgICA1MWJcCiAgeDQ6IGZmZmYwMDAwMDA0Mjc2OTggKGNhbV9zdGF0dXNfdGFibGUgKyBlZTkw KVwKICB4NTogZmZmZjAwMDAwMmYwY2RjOCAoX2VuZCArIDEwYjNkYzgpXAogIHg2OiBmZmZmMDAw MDAyZjBjMTAwIChfZW5kICsgMTBiMzEwMClcCiAgeDc6ICAgICAgICAgICAgICAgIDBcCiAgeDg6 IGZmZmYwMDAwMDA2OGZhYzAgKGluaXRzdGFjayArIDdhYzApXAogIHg5OiAgICAgICAgICAgICAg ICAxXAogeDEwOiBmZmZmMDAwMDAwNjhmYWMwIChpbml0c3RhY2sgKyA3YWMwKVwKIHgxMTogICAg ICAgICAgICAgICAxMFwKIHgxMjogICAgICAgICAgICAgICAgMFwKIHgxMzogICAgICAgICAgICAg ICAgMFwKIHgxNDogICAgICAgICAgICAgICAgMFwKIHgxNTogICAgICAgICAgICAgICAgYVwKIHgx NjogZmZmZjAwMDAwMDY4ZjU0ZCAoaW5pdHN0YWNrICsgNzU0ZClcCiB4MTc6IGZmZmYwMDAwMDA2 OGY1NGMgKGluaXRzdGFjayArIDc1NGMpXAogeDE4OiBmZmZmMDAwMDAwNjhmNjQwIChpbml0c3Rh Y2sgKyA3NjQwKVwKIHgxOTogZmZmZjAwMDA0MWNiZDYyMCAoX2VuZCArIDNmZTY0NjIwKVwKIHgy MDogICAgICAgICAgICAgICAgNFwKIHgyMTogMWJmZjAwMjAxYzY4MTgzOFwKIHgyMjogMWJmZjAw MjAxYzY4MTgyMFwKIHgyMzogZmZmZjAwMDAwMDY5MDBiNCAoeHNvZnRjICsgMjQpXAogeDI0OiBm ZmZmMDAwMDQxY2EzMjgwIChfZW5kICsgM2ZlNGEyODApXAogeDI1OiBmZmZmYTAwMDAwMjNiODYw XAogeDI2OiBmZmZmMDAwMDAwNjhmYWMwIChpbml0c3RhY2sgKyA3YWMwKVwKIHgyNzogICAgICAg ICAgICAgICAgMVwKIHgyODogICAgICAgICAgICAgICAgMFwKIHgyOTogZmZmZjAwMDAwMDY4ZjY1 MCAoaW5pdHN0YWNrICsgNzY1MClcCiAgc3A6IGZmZmYwMDAwMDA2OGY2NDBcCiAgbHI6IGZmZmYw MDAwMDAyMjQ0ZTAgKHNjaGVkX2FkZCArIDFjYylcCiBlbHI6IGZmZmYwMDAwMDAxY2E2ZTAgKF9f bXR4X2xvY2tfc3Bpbl9mbGFncyArIDIwKVwKc3BzcjogICAgICAgICAyMDAwMDJjNVwKIGZhcjog MWJmZjAwMjAxYzY4MTgzOFwKIGVzcjogMDAwMDAwMDA5NjAwMDAwNFwKcGFuaWM6IHZtX2ZhdWx0 IGZhaWxlZDogZmZmZjAwMDAwMDFjYTZlMCBlcnJvciAxXApjcHVpZCA9IDBcCnRpbWUgPSAxXApL REI6IHN0YWNrIGJhY2t0cmFjZTpcCmRiX3RyYWNlX3NlbGYoKSBhdCBkYl90cmFjZV9zZWxmXApk Yl90cmFjZV9zZWxmX3dyYXBwZXIoKSBhdCBkYl90cmFjZV9zZWxmX3dyYXBwZXIrMHgzMFwKdnBh bmljKCkgYXQgdnBhbmljKzB4MjNjXApwYW5pYygpIGF0IHBhbmljKzB4NDRcCmRhdGFfYWJvcnQo KSBhdCBkYXRhX2Fib3J0KzB4MzNjXApoYW5kbGVfZWwxaF9zeW5jKCkgYXQgaGFuZGxlX2VsMWhf c3luYysweDEwXAotLS0gZXhjZXB0aW9uLCBlc3IgMHhmZmZmMDAwMDAwNjhmNTRkXAoobnVsbCko KSBhdCAwXApLREI6IGVudGVyOiBwYW5pY1wKWyB0aHJlYWQgcGlkIDAgdGlkIDEwMDAwMCBdXApT dG9wcGVkIGF0ICAgICAga2RiX2VudGVyKzB4NDA6IHVuZGVmaW5lZCAgICAgICBmOTA0OTI3ZlwK ZGI+IGJ0XApcClwKXApcJzk3XCc5N1wnOTdcJzk3XCc5N1wnOTdcJzk3XCc5N1wnOTcgUmVtb3Rl IEdEQiBcJzk3XCc5N1wnOTdcJzk3XCc5N1wnOTdcJzk3XCc5N1wnOTdcJzk3XCc5N1wnOTdcJzk3 XCc5N1wnOTdcJzk3XCc5N1wnOTdcJzk3XApcClxwYXJkXHR4NTYwXHR4MTEyMFx0eDE2ODBcdHgy MjQwXHR4MjgwMFx0eDMzNjBcdHgzOTIwXHR4NDQ4MFx0eDUwNDBcdHg1NjAwXHR4NjE2MFx0eDY3 MjBccGFyZGlybmF0dXJhbFxwYXJ0aWdodGVuZmFjdG9yMAoKXGZzMzQgKGtnZGIpIGJ0XAojMCAg XGNmMyBrZGJfZW50ZXJcY2YyICAoXGNmNCB3aHlcY2YyID08b3B0aW1pemVkIG91dD4sIFxjZjQg bXNnXGNmMiA9PG9wdGltaXplZCBvdXQ+KSBhdCBcY2Y1IC9iL3NmYWlzYWwvc3RhYmxlX21haW4v c3JjL3N5cy9rZXJuL3N1YnJfa2RiLmNcY2YyIDo1NDlcCiMxICBcY2Y2IDB4ZmZmZjAwMDAwMDFm MGExOFxjZjIgIGluIFxjZjMgdnBhbmljXGNmMiAgKFxjZjQgZm10XGNmMiA9MHhmZmZmMDAwMDAw NDkzNWM4ICJ2bV9mYXVsdCBmYWlsZWQ6ICVseCBlcnJvciAlZCIsIFxjZjQgYXBcY2YyID0uLi4p XAogICAgYXQgXGNmNSAvYi9zZmFpc2FsL3N0YWJsZV9tYWluL3NyYy9zeXMva2Vybi9rZXJuX3No dXRkb3duLmNcY2YyIDo5NjhcCiMyICBcY2Y2IDB4ZmZmZjAwMDAwMDFmMDZjY1xjZjIgIGluIFxj ZjMgcGFuaWNcY2YyICAoXGNmNCBmbXRcY2YyID08dW5hdmFpbGFibGU+KSBhdCBcY2Y1IC9iL3Nm YWlzYWwvc3RhYmxlX21haW4vc3JjL3N5cy9rZXJuL2tlcm5fc2h1dGRvd24uY1xjZjIgOjg5OVwK IzMgIFxjZjYgMHhmZmZmMDAwMDAwM2YyMGZjXGNmMiAgaW4gXGNmMyBkYXRhX2Fib3J0XGNmMiAg KFxjZjQgdGRcY2YyID0weGZmZmYwMDAwMDA4MWE2YTAgPHRocmVhZDBfc3Q+LCBcY2Y0IGZyYW1l XGNmMiA9MHhmZmZmMDAwMDAwNjhmNGEwLCBcY2Y0IGVzclxjZjIgPTI1MTY1ODI0MDQsIFxjZjQg ZmFyXGNmMiA9PG9wdGltaXplZCBvdXQ+LCBcY2Y0IGxvd2VyXGNmMiA9MClcCiAgICBhdCBcY2Y1 IC9iL3NmYWlzYWwvc3RhYmxlX21haW4vc3JjL3N5cy9hcm02NC9hcm02NC90cmFwLmNcY2YyIDo0 MDBcCiM0ICBcdWwgPHNpZ25hbCBoYW5kbGVyIGNhbGxlZD5cdWxub25lIFwKIzUgIFxjZjYgMHhm ZmZmMDAwMDAwMWNhNmUwXGNmMiAgaW4gXGNmMyBfX210eF9sb2NrX3NwaW5fZmxhZ3NcY2YyICAo XGNmNCBjXGNmMiA9MHg5NjAwMDAwNCwgXGNmNCBvcHRzXGNmMiA9NDc2NTgzOTkyLCBcCiAgICBc Y2Y0IGZpbGVcY2YyID0weDFiZmYwMDIwMWM2ODE4MzggPGVycm9yOiBDYW5ub3QgYWNjZXNzIG1l bW9yeSBhdCBhZGRyZXNzIDB4MWJmZjAwMjAxYzY4MTgzOD4sIFxjZjQgbGluZVxjZjIgPTApIGF0 IFxjZjUgL2Ivc2ZhaXNhbC9zdGFibGVfbWFpbi9zcmMvc3lzL2tlcm4va2Vybl9tdXRleC5jXGNm MiA6MzMxXApCYWNrdHJhY2Ugc3RvcHBlZDogQ2Fubm90IGFjY2VzcyBtZW1vcnkgYXQgYWRkcmVz cyAweDlcCihrZ2RiKSBmcmFtZSA1XAojNSAgXGNmNiAweGZmZmYwMDAwMDAxY2E2ZTBcY2YyICBp biBcY2YzIF9fbXR4X2xvY2tfc3Bpbl9mbGFnc1xjZjIgIChcY2Y0IGNcY2YyID0weDk2MDAwMDA0 LCBcY2Y0IG9wdHNcY2YyID00NzY1ODM5OTIsIFwKICAgIFxjZjQgZmlsZVxjZjIgPTB4MWJmZjAw MjAxYzY4MTgzOCA8ZXJyb3I6IENhbm5vdCBhY2Nlc3MgbWVtb3J5IGF0IGFkZHJlc3MgMHgxYmZm MDAyMDFjNjgxODM4PiwgXGNmNCBsaW5lXGNmMiA9MCkgYXQgXGNmNSAvYi9zZmFpc2FsL3N0YWJs ZV9tYWluL3NyYy9zeXMva2Vybi9rZXJuX211dGV4LmNcY2YyIDozMzFcCjMzMSAgICAgICAgICAg ICBLQVNTRVJUKG0tPm10eF9sb2NrICE9IE1UWF9ERVNUUk9ZRUQsXAooa2dkYikgZnJhbWUgM1wK IzMgIFxjZjYgMHhmZmZmMDAwMDAwM2YyMGZjXGNmMiAgaW4gXGNmMyBkYXRhX2Fib3J0XGNmMiAg KFxjZjQgdGRcY2YyID0weGZmZmYwMDAwMDA4MWE2YTAgPHRocmVhZDBfc3Q+LCBcY2Y0IGZyYW1l XGNmMiA9MHhmZmZmMDAwMDAwNjhmNGEwLCBcY2Y0IGVzclxjZjIgPTI1MTY1ODI0MDQsIFxjZjQg ZmFyXGNmMiA9PG9wdGltaXplZCBvdXQ+LCBcY2Y0IGxvd2VyXGNmMiA9MClcCiAgICBhdCBcY2Y1 IC9iL3NmYWlzYWwvc3RhYmxlX21haW4vc3JjL3N5cy9hcm02NC9hcm02NC90cmFwLmNcY2YyIDo0 MDBcCjQwMCAgICAgICAgICAgICAgICAgICAgICAgICAgICAgcGFuaWMoInZtX2ZhdWx0IGZhaWxl ZDogJWx4IGVycm9yICVkIixcCihrZ2RiKSBwIC94ICpmcmFtZVwKJDIgPSBce1xjZjQgdGZfc3Bc Y2YyICA9IDB4ZmZmZjAwMDAwMDY4ZjY0MCwgXGNmNCB0Zl9sclxjZjIgID0gMHhmZmZmMDAwMDAw MjI0NGUwLCBcY2Y0IHRmX2VsclxjZjIgID0gMHhmZmZmMDAwMDAwMWNhNmUwLCBcY2Y0IHRmX3Nw c3JcY2YyICA9IDB4MjAwMDAyYzUsIFxjZjQgdGZfZXNyXGNmMiAgPSAweDk2MDAwMDA0LCBcCiAg XGNmNCB0Zl9mYXJcY2YyICA9IDB4MWJmZjAwMjAxYzY4MTgzOCwgXGNmNCB0Zl94XGNmMiAgPSBc ezB4MWJmZjAwMjAxYzY4MTgzOCwgMHgwLCAweGZmZmYwMDAwMDA0OWVlYjMsIDB4NTFiLCAweGZm ZmYwMDAwMDA0Mjc2OTgsIDB4ZmZmZjAwMDAwMmYwY2RjOCwgMHhmZmZmMDAwMDAyZjBjMTAwLCBc CiAgICAweDAsIDB4ZmZmZjAwMDAwMDY4ZmFjMCwgMHgxLCAweGZmZmYwMDAwMDA2OGZhYzAsIDB4 MTAsIDB4MCwgMHgwLCAweDAsIDB4YSwgMHhmZmZmMDAwMDAwNjhmNTRkLCAweGZmZmYwMDAwMDA2 OGY1NGMsIDB4ZmZmZjAwMDAwMDY4ZjY0MCwgXAogICAgMHhmZmZmMDAwMDQxY2JkNjIwLCAweDQs IDB4MWJmZjAwMjAxYzY4MTgzOCwgMHgxYmZmMDAyMDFjNjgxODIwLCAweGZmZmYwMDAwMDA2OTAw YjQsIDB4ZmZmZjAwMDA0MWNhMzI4MCwgMHhmZmZmYTAwMDAwMjNiODYwLCAweGZmZmYwMDAwMDA2 OGZhYzAsIDB4MSwgXAogICAgMHgwLCAweGZmZmYwMDAwMDA2OGY2NTBcfVx9XAooa2dkYilcClxw YXJkXHR4NTYwXHR4MTEyMFx0eDE2ODBcdHgyMjQwXHR4MjgwMFx0eDMzNjBcdHgzOTIwXHR4NDQ4 MFx0eDUwNDBcdHg1NjAwXHR4NjE2MFx0eDY3MjBccGFyZGlybmF0dXJhbFxwYXJ0aWdodGVuZmFj dG9yMAoKXGZzMzggXAp9 --_004_BYAPR05MB6677E63414F88873FF17174BB724ABYAPR05MB6677namp_-- From nobody Wed Jun 28 18:46:21 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4QrrC141PDz4klWW for ; Wed, 28 Jun 2023 18:46:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4QrrC06bWgz4Hgs for ; Wed, 28 Jun 2023 18:46:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1687977980; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=CsvMpPrAWJqOYxcDJ+zp1NLIRiWeNDhjq6HJjXvfhJs=; b=RO9fZ07dV1am1DKkHKlMRlhxzZk3Vsu2Kjh1aTwG2dXMbHEWqxPB12biU0pCC+SpIsgEqB IcenQOil/8gfYzG0uuwpH9Yg3lytAfPiUxFDeTQfY2/t4H79ksw28WoGctctIhOwokWpeM L9pfF5a1wxYwn297kuBXChTvS4uS8679awAiAv+dpsrTMVwnDCdhXxOViAsQVI0qF21UGP KgmW5rydQgjkaFvjoKnV5M44oMpixMwmKxQtBpOUM+hfzYqwKB2e2ySqxlRxQHu0MsK2Ft RoPXh2RptMC6c89HVegX3L+eQbEAA1VqNCHRaZajz3++F3GCsUwUQ1CABoDtrw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1687977980; a=rsa-sha256; cv=none; b=RBw4jvDmVXMUGtd1euOFp8xDYshskwAdRqltZKeeh+iqGzQ3Sh7vEK978lJXpKgnGFShLN /Hq88bodL3T4mVhOkkN65/Q8VeIhbfvcDmiRuh58HkqNIu+rwnjfj8qME6HYnugIRmK/EX 5c0ulRVV5xegqmwknu+fVNU3xA6q39bSXQwQkDXpCNeEB7POHDo/RTDIDaeFzniFE7WXjD QgXm7U6R8SrRfazhTprmsF9c1Tnumu29cK3MIsXC9+3Aqg+2fHY/hdPCNYQhlL4Oxrre13 vHr22HDjrIuaZiTgIRtOI3fK84wIxV70n4R+Ay1FoHetPVSO7OCITLh+hQ+EaA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4QrrC05Z34zlSM for ; Wed, 28 Jun 2023 18:46:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 35SIkKhN038842 for ; Wed, 28 Jun 2023 18:46:20 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 35SIkKp0038841 for freebsd-arm@FreeBSD.org; Wed, 28 Jun 2023 18:46:20 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-arm@FreeBSD.org Subject: [Bug 271992] backport fix for LLVM bug 61396 Date: Wed, 28 Jun 2023 18:46:21 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: dim@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-arm@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D271992 Dimitry Andric changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Open |Closed Resolution|--- |FIXED --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Jun 29 09:54:13 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4QsDM64TWxz4k70x for ; Thu, 29 Jun 2023 09:54:42 +0000 (UTC) (envelope-from bounce.mvfh9z6e30=tw0noqyn395k=mi1dl7pipr@em790814.fubar.geek.nz) Received: from e2i947.smtp2go.com (e2i947.smtp2go.com [103.2.143.179]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4QsDM61Ht9z4X0d for ; Thu, 29 Jun 2023 09:54:41 +0000 (UTC) (envelope-from bounce.mvfh9z6e30=tw0noqyn395k=mi1dl7pipr@em790814.fubar.geek.nz) Authentication-Results: mx1.freebsd.org; none Received: from [10.99.243.232] (helo=morbo.fubar.geek.nz) by smtpcorp.com with esmtpsa (TLS1.3:ECDHE_X25519__RSA_PSS_RSAE_SHA256__AES_256_GCM:256) (Exim 4.96-S2G) (envelope-from ) id 1qEoM9-9EHYoT-1F; Thu, 29 Jun 2023 09:54:29 +0000 Received: from smtpclient.apple (cpc91210-cmbg18-2-0-cust37.5-4.cable.virginm.net [81.102.44.38]) by morbo.fubar.geek.nz (Postfix) with ESMTPSA id EF14E1D823; Thu, 29 Jun 2023 09:54:23 +0000 (UTC) From: Andrew Turner Message-Id: <6537067F-670A-4B52-87FA-FF2DBAD68120@fubar.geek.nz> Content-Type: multipart/alternative; boundary="Apple-Mail=_4AFE4AD1-DA71-469C-8382-828AA47F5A47" List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.500.231\)) Subject: Re: Kernel crash before login prompt Date: Thu, 29 Jun 2023 10:54:13 +0100 In-Reply-To: Cc: "freebsd-arm@FreeBSD.org" , Steve Kiernan , Mahesh Vardhamanaiah To: Sha Faisal References: X-Mailer: Apple Mail (2.3731.500.231) X-smtpcorp-track: 1qEou99EHYoT1F.nYTlklbL05WiW DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=smtpservice.net; i=@smtpservice.net; q=dns/txt; s=a1-4; t=1688032478; h=feedback-id : x-smtpcorp-track : date : message-id : to : subject : from : reply-to : sender : list-unsubscribe; bh=GI/cffR6Zar2pvl+y/FgDrMbDDVXDHVn7PrxkttRLRM=; b=zoVXkPYWFM/yt1bkanoQXm69S7LxAkQuaUON42uxZnvf3cazRw5lIapWS0qFs7tiIOhkA q9mVtvyXh0nUtBwx3aSsChm345xTvhWqY7FKRn907rBxahuZGMxdc/z3QV4iwY0z1Gn6ESA WOMNFvKCuDxbx4ZmM8s+T6Hc4KusELFsh5keGNevNrkivHQ4PXg2SRG7IRk3n+bWuZD57g1 AjtxjIvDfU5sMruQP+fe08gAJVjwRRU8VKQCjUc+eOYikhz8HSfYHcSxkF26JmXVeKgknFX Qil8mvxN0Q2asxYOqUfxqgwJrf1oDX+nJ8KCHrCGrVdVXAZOJos/Fz/UyHdA== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=fubar.geek.nz; i=@fubar.geek.nz; q=dns/txt; s=s790814; t=1688032478; h=from : subject : to : message-id : date; bh=GI/cffR6Zar2pvl+y/FgDrMbDDVXDHVn7PrxkttRLRM=; b=lmTCLRFc36hjIlxndEvdy2UX8RUQuau9D2xI5uSIWJvLoKBSe5uv9zLo4sTx9FwPx6Kyr xfuaJurt6SPRdtlmLB+mdXw24A622h0QHZUwkdtayC3qrZ/dhDJQlaLnfz9VdCPyTWfpO3y FhXcru61LHRMDIZV6JPV5y2r8PvuhEw8h+v4DFR83YM4PsN0Coxpp89Os7yrEhY6GMpXwsc 94/aEG0wNssSl7tPzE72f6XeuAaPbR7rBgYiVKzmeNLQ4EVCCAzYU1Qx0JK3Jzdp7jGMjF6 y66uwjytDu/Rjq6y7WXG2Fomz3ac/vxmEfLikhnwoGlSWUMCXVVJnJtUcgbA== X-Rspamd-Queue-Id: 4QsDM61Ht9z4X0d X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:23352, ipnet:103.2.140.0/22, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N --Apple-Mail=_4AFE4AD1-DA71-469C-8382-828AA47F5A47 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 It looks like that exception is due to DPCPU_ID_PTR calculating an = invalid pointer. Can you print the contents of the dpcpu_off array, and the addresses of = __start_set_pcpu and pcpu_entry_tdq. Andrew > On 28 Jun 2023, at 19:45, Sha Faisal wrote: >=20 > Hello Andrew, > Attached is the boot log, also at the end I have pasted the remote = gdb backtrace > =20 > Regards > faisal > =20 >=20 >=20 > Juniper Business Use Only >=20 > From: Andrew Turner > > Date: Wednesday, 28 June 2023 at 20:47 > To: Sha Faisal > > Cc: freebsd-arm@FreeBSD.org = >, Steve = Kiernan >, Mahesh = Vardhamanaiah > > Subject: Re: Kernel crash before login prompt >=20 > [External Email. Be cautious of content] > =20 > =20 > On 28 Jun 2023, at 13:18, Sha Faisal wrote: > =20 > =20 > Hello FreeBSD team, > =20 > We have upgraded our FreeBSD kernel from 12 to main branch and with = latest main branch one of our boxes with > Broadcom iProc Northstar2 BCM5871X SoC (Quad-core ARM Cortex-A57 = 64-bit 2GHz ARMv8-A CPU architecture) is crashing at = mtx_spin_lock_flags(), with data_abort exception. > Sometimes the exception is raised at DPCPCU_PTR() functions. > =20 > Has anyone tried to boot freeBSD14 on the above mentioned BCM SoC?=20 > =20 > Please share your inputs and comment > =20 > I don=E2=80=99t know of any issues with either of these, and don=E2=80=99= t know of anyone running FreeBSD on this SoC. > =20 > Can you provide more details on what is failing, e.g. the boot log? > =20 > Andrew > =20 =EF=BF=BC --Apple-Mail=_4AFE4AD1-DA71-469C-8382-828AA47F5A47 Content-Type: multipart/mixed; boundary="Apple-Mail=_6E0B10FA-A382-44DA-8A43-DD44CF5E2297" --Apple-Mail=_6E0B10FA-A382-44DA-8A43-DD44CF5E2297 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8
It looks = like that exception is due to DPCPU_ID_PTR calculating an invalid = pointer.

Can you print the contents of = the dpcpu_off array, and the addresses of __start_set_pcpu and = pcpu_entry_tdq.

Andrew

On 28 Jun 2023, at 19:45, Sha Faisal = <sfaisal@juniper.net> wrote:

Hello Andrew,
Attached is the boot log,  also at the = end I have pasted the remote gdb backtrace
 
Regards
faisal
 


Juniper Business Use = Only

From: Andrew Turner <andrew@fubar.geek.nz>
Da= te: Wednesday, 28 = June 2023 at 20:47
To: Sha Faisal <sfaisal@juniper.net>
Cc:<= span class=3D"Apple-converted-space"> freebsd-arm@FreeBSD.org <freebsd-arm@FreeBSD.org>, = Steve Kiernan <stevek@juniper.net>, Mahesh = Vardhamanaiah <maheshmv@juniper.net>
Su= bject: Re: Kernel = crash before login prompt

[External Email. Be cautious of = content]
 
 
On 28 Jun 2023, at 13:18, Sha Faisal <sfaisal@juniper.net> = wrote:
 

 

Hello = FreeBSD team,

 

We have upgraded our FreeBSD kernel from 12 = to main branch and with latest main branch one of our boxes = with
Broadcom iProc Northstar2 BCM5871X = SoC (Quad-core ARM Cortex-A57 64-bit 2GHz ARMv8-A CPU = architecture) is crashing at mtx_spin_lock_flags(), with data_abort = exception.
Sometimes the exception is raised at = DPCPCU_PTR() functions.

 

Has anyone tried to boot freeBSD14 on the = above mentioned BCM SoC? 

 

Please share your inputs and = comment
 
I don=E2=80=99t know of any issues with = either of these, and don=E2=80=99t know of anyone running FreeBSD on = this SoC.
 
Can you provide more = details on what is failing, e.g. the boot = log?
 
Andrew
 
= --Apple-Mail=_6E0B10FA-A382-44DA-8A43-DD44CF5E2297 Content-Disposition: attachment; filename=main_kernel_crash.rtf Content-Type: text/rtf; x-unix-mode=0644; name="main_kernel_crash.rtf" Content-Transfer-Encoding: 7bit {\rtf1\ansi\ansicpg1252\cocoartf2639 \cocoatextscaling0\cocoaplatform0{\fonttbl\f0\fnil\fcharset0 Menlo-Regular;} {\colortbl;\red255\green255\blue255;\red0\green0\blue0;\red170\green171\blue37;\red56\green185\blue199; \red57\green192\blue38;\red86\green32\blue244;} {\*\expandedcolortbl;;\csgray\c0;\cssrgb\c72331\c71682\c18599;\cssrgb\c25546\c77007\c82023; \cssrgb\c25706\c77963\c19557;\cssrgb\c41681\c25958\c96648;} \paperw11900\paperh16840\margl1440\margr1440\vieww34360\viewh18520\viewkind0 \pard\tx560\tx1120\tx1680\tx2240\tx2800\tx3360\tx3920\tx4480\tx5040\tx5600\tx6160\tx6720\pardirnatural\partightenfactor0 \f0\fs38 \cf2 \CocoaLigature0 ---<>---\ GDB: debug ports: uart\ GDB: current port: uart\ KDB: debugger backends: ddb gdb\ KDB: current backend: ddb\ WARNING: Cannot find freebsd,dts-version property, cannot check DTB compliance\ Copyright (c) 1998-2023 Juniper Networks, Inc.\ Copyright (c) 1992-2023 The FreeBSD Project.\ Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994\ The Regents of the University of California. All rights reserved.\ FreeBSD is a registered trademark of The FreeBSD Foundation.\ FreeBSD 14.0-CURRENT #16 main-n263130-262bbf684b3-dirty: Wed Jun 28 03:06:01 PDT 2023\ sfaisal@svl-bsdx-02:/b/sfaisal/stable_main/obj/arm64/juniper/kernels/JNPR-ARM64-WIT/kernel arm64\ Juniper clang version 13.0.1 (git@eng-gitlab.juniper.net:tools-tot/llvm d6c59310ee4d5c1c649e8380bbed4f0ef6a6580b)\ WARNING: WITNESS option enabled, expect reduced performance.\ VT: init without driver.\ module cpld already present!\ module crypto already present!\ link_elf: symbol ipv4_ipsec_support undefined\ KLD file netstack.ko - could not finalize loading\ KLD file iflib.ko - cannot find dependency "netstack"\ KLD file miibus.ko - cannot find dependency "netstack"\ KLD file iproc_mdio_mux.ko - cannot find dependency "miibus"\ KLD file if_gmac.ko - cannot find dependency "netstack"\ real memory = 4294922240 (4095 MB)\ avail memory = 4124983296 (3933 MB)\ FreeBSD/SMP: Multiprocessor System Detected: 1 CPUs\ arc4random: WARNING: initial seeding bypassed the cryptographic random device because it was not yet seeded and the knob 'bypass_before_seeding' was enabled.\ Security policy loaded: MAC/veriexec (mac_veriexec)\ MAC/veriexec fingerprint module loaded: SHA256\ MAC/veriexec fingerprint module loaded: SHA384\ MAC/veriexec fingerprint module loaded: SHA1\ random: entropy device external interface\ MAP fdaf0000 mode 2 pages 1\ MAP fffc7000 mode 2 pages 1\ module_register_init: MOD_LOAD (efirt, 0xffff00000006d554, 0) error 6\ ofwbus0: \ simplebus0: on ofwbus0\ clk_fixed0: on simplebus0\ clk_fixed1: on simplebus0\ clk_fixed1: Cannot FDT parameters.\ device_attach: clk_fixed1 attach returned 6\ clk_fixed1: on simplebus0\ clk_fixed1: Cannot FDT parameters.\ device_attach: clk_fixed1 attach returned 6\ clk_fixed1: on simplebus0\ clk_fixed1: Cannot FDT parameters.\ device_attach: clk_fixed1 attach returned 6\ clk_fixed1: on simplebus0\ clk_fixed1: Cannot FDT parameters.\ device_attach: clk_fixed1 attach returned 6\ psci0: on ofwbus0\ clk_fixed1: on simplebus0\ clk_fixed1: Cannot FDT parameters.\ device_attach: clk_fixed1 attach returned 6\ clk_fixed1: on simplebus0\ clk_fixed1: Cannot FDT parameters.\ device_attach: clk_fixed1 attach returned 6\ clk_fixed1: on simplebus0\ clk_fixed1: Cannot FDT parameters.\ device_attach: clk_fixed1 attach returned 6\ clk_fixed1: on simplebus0\ clk_fixed1: Cannot FDT parameters.\ device_attach: clk_fixed1 attach returned 6\ bcmcru0: mem 0x660e0000-0x660e0fff on simplebus0\ clk_fixed1: on simplebus0\ clk_fixed1: Cannot FDT parameters.\ device_attach: clk_fixed1 attach returned 6\ clk_fixed1: on simplebus0\ clk_fixed1: Cannot FDT parameters.\ device_attach: clk_fixed1 attach returned 6\ gic0: mem 0x65210000-0x65210fff,0x65220000-0x65220fff,0x65240000-0x65241fff,0x65260000-0x65260fff irq 56 on simplebus0\ gic0: pn 0x2, arch 0x2, rev 0x1, implementer 0x43b irqs 512\ gicv2m0: mem 0-0xfff on gic0\ gicv2m1: mem 0x10000-0x10fff on gic0\ gicv2m2: mem 0x20000-0x20fff on gic0\ gicv2m3: mem 0x30000-0x30fff on gic0\ gicv2m4: mem 0x40000-0x40fff on gic0\ gicv2m5: mem 0x50000-0x50fff on gic0\ gicv2m6: mem 0x60000-0x60fff on gic0\ gicv2m7: mem 0x70000-0x70fff on gic0\ clk_fixed1: on simplebus0\ clk_fixed1: Cannot FDT parameters.\ device_attach: clk_fixed1 attach returned 6\ clk_fixed1: on simplebus0\ clk_fixed1: Cannot FDT parameters.\ device_attach: clk_fixed1 attach returned 6\ pl3300: mem 0x61360000-0x61360fff irq 13,14,15,16,17,18,19,20,21 on simplebus0\ gpio0: mem 0x660a0000-0x660a004f irq 63 on simplebus0\ gpiobus0: on gpio0\ generic_timer0: irq 0,1,2,3 on ofwbus0\ Timecounter "ARM MPCore Timecounter" frequency 25000000 Hz quality 1000\ Event timer "ARM MPCore Eventtimer" frequency 25000000 Hz quality 1000\ clk_fixed1: on simplebus0\ clk_fixed1: Cannot FDT parameters.\ device_attach: clk_fixed1 attach returned 6\ clk_fixed1: on simplebus0\ clk_fixed1: Cannot FDT parameters.\ device_attach: clk_fixed1 attach returned 6\ clk_fixed1: on simplebus0\ clk_fixed1: Cannot FDT parameters.\ device_attach: clk_fixed1 attach returned 6\ clk_fixed1: on simplebus0\ clk_fixed1: Cannot FDT parameters.\ device_attach: clk_fixed1 attach returned 6\ clk_fixed1: on simplebus0\ clk_fixed1: Cannot FDT parameters.\ device_attach: clk_fixed1 attach returned 6\ clk_fixed1: on simplebus0\ clk_fixed1: Cannot FDT parameters.\ device_attach: clk_fixed1 attach returned 6\ cpulist0: on ofwbus0\ cpu0: on cpulist0\ pmu0: irq 4,5,6,7 on ofwbus0\ pmu0: Missing value in interrupt affinity property\ device_attach: pmu0 attach returned 6\ pcib0: mem 0x20020000-0x20020fff on ofwbus0\ pci0: on pcib0\ pcib1: irq 84 at device 0.0 on pci0\ pcib0: failed to reserve resource for pcib1\ pcib1: failed to allocate initial memory window: 0-0xfffff\ pcib0: failed to reserve resource for pcib1\ pcib1: failed to allocate initial prefetch window: 0-0xfffff\ pci1: on pcib1\ pci1: at device 0.0 (no driver attached)\ pcib2: mem 0x50020000-0x50020fff on ofwbus0\ pci2: on pcib2\ pcib3: irq 85 at device 0.0 on pci2\ pcib2: failed to reserve resource for pcib3\ pcib3: failed to allocate initial memory window: 0-0xfffff\ pcib2: failed to reserve resource for pcib3\ pcib3: failed to allocate initial prefetch window: 0-0xfffff\ pci3: on pcib3\ pcib2: failed to reserve resource for pcib3\ pcib2: failed to reserve resource for pcib3\ pcib2: failed to reserve resource for pcib3\ pcib2: failed to reserve resource for pcib3\ pcib2: failed to reserve resource for pcib3\ pci3: at device 0.0 (no driver attached)\ pci3: at device 0.1 (no driver attached)\ clk_fixed1: on simplebus0\ clk_fixed1: Cannot FDT parameters.\ device_attach: clk_fixed1 attach returned 6\ clk_fixed1: on simplebus0\ clk_fixed1: Cannot FDT parameters.\ device_attach: clk_fixed1 attach returned 6\ bcm_ns2_usbphy0: mem 0x66000960-0x66000983,0x67012800-0x67012803,0x6501d148-0x6501d14b,0x664d0700-0x664d0703 disabled on simplebus0\ iichb0: mem 0x66080000-0x660800ff irq 61 on simplebus0\ iicbus0: on iichb0\ iic0: on iicbus0\ ds13rtc0: at addr 0xd0 on iicbus0\ gpioc0: on gpio0\ iichb1: mem 0x660b0000-0x660b00ff irq 64 on simplebus0\ iicbus1: on iichb1\ iic1: on iicbus1\ iicbus1: at addr 0xd0\ iicbus1: at addr 0xea\ uart0: <16750 or compatible> mem 0x66110000-0x661100ff irq 66 on simplebus0\ uart0: console (49523,n,8,1)\ uart1: <16750 or compatible> mem 0x66120000-0x661200ff irq 67 on simplebus0\ uart2: <16750 or compatible> mem 0x66130000-0x661300ff irq 68 on simplebus0\ spi0: mem 0x66180000-0x66180fff irq 69 on simplebus0\ spibus0: on spi0\ cpld0: at cs 6 mode 3 on spibus0\ spibus1: on cpld0\ ad95230: at cs 3 mode 0 on spibus1\ bits0: at cs 2 mode 0 on spibus1\ bpm0: at cs 4 mode 0 on spibus1\ spi1: mem 0x66190000-0x66190fff irq 70 on simplebus0\ spibus2: on spi1\ dpll0: at cs 6 mode 3 on spibus2\ bcmrng0: mem 0x66220000-0x66220027 on simplebus0\ random: registering fast source Broadcom RBG200 RNG\ iproc_sdhci0: mem 0x66420000-0x664200ff irq 74 on simplebus0\ mmc0: on iproc_sdhci0\ spi2: mem 0x66470000-0x66470fff irq 77 on simplebus0\ spibus3: on spi2\ mx25l0: at cs 0 mode 0 on spibus3\ mx25l0: device type s25fl512s, size 65536K in 1024 sectors of 64K, erase size 64K\ ehci0: mem 0x664c0000-0x664c00ff irq 82 on simplebus0\ usbus0: EHCI version 1.0\ usbus0 on ehci0\ oamctl0: mem 0x65024000-0x65024fff on simplebus0\ syscon_generic_dev1: Cannot allocate memory resource\ device_attach: syscon_generic_dev1 attach returned 6\ bcm_idm0: on ofwbus0\ idm_monitor0: mem 0x21004900-0x21004aff irq 88 on bcm_idm0\ idm_monitor1: mem 0x21005900-0x21005aff irq 89 on bcm_idm0\ idm_monitor2: mem 0x21006900-0x21006aff irq 90 on bcm_idm0\ idm_monitor3: mem 0x21007900-0x21007aff irq 91 on bcm_idm0\ idm_monitor4: mem 0x21008900-0x21008aff irq 92 on bcm_idm0\ idm_monitor5: mem 0x21009900-0x21009aff irq 93 on bcm_idm0\ idm_monitor6: mem 0x51004900-0x51004aff irq 94 on bcm_idm0\ idm_monitor7: mem 0x51005900-0x51005aff irq 95 on bcm_idm0\ idm_monitor8: mem 0x51006900-0x51006aff irq 96 on bcm_idm0\ idm_monitor9: mem 0x51007900-0x51007aff irq 97 on bcm_idm0\ idm_monitor10: mem 0x51008900-0x51008aff irq 98 on bcm_idm0\ idm_monitor11: mem 0x51009900-0x51009aff irq 99 on bcm_idm0\ idm_monitor12: mem 0x60e00900-0x60e00aff irq 100 on bcm_idm0\ idm_monitor13: mem 0x60e01900-0x60e01aff irq 101 on bcm_idm0\ idm_monitor14: mem 0x60e02900-0x60e02aff irq 102 on bcm_idm0\ idm_monitor15: mem 0x60e05900-0x60e05aff irq 103 on bcm_idm0\ idm_monitor16: mem 0x61091900-0x61091aff irq 104 on bcm_idm0\ idm_monitor17: mem 0x61092900-0x61092aff irq 105 on bcm_idm0\ idm_monitor18: mem 0x61400900-0x61400aff irq 106 on bcm_idm0\ idm_monitor19: mem 0x61401900-0x61401aff irq 107 on bcm_idm0\ idm_monitor20: mem 0x61402900-0x61402aff irq 108 on bcm_idm0\ idm_monitor21: mem 0x61404900-0x61404aff irq 109 on bcm_idm0\ idm_monitor22: mem 0x61406900-0x61406aff irq 110 on bcm_idm0\ idm_monitor23: mem 0x61407900-0x61407aff irq 111 on bcm_idm0\ idm_monitor24: mem 0x6140c900-0x6140caff irq 112 on bcm_idm0\ idm_monitor25: mem 0x6140e900-0x6140eaff irq 113 on bcm_idm0\ idm_monitor26: mem 0x6140f900-0x6140faff irq 114 on bcm_idm0\ idm_monitor27: mem 0x65371900-0x65371aff irq 115 on bcm_idm0\ idm_monitor28: mem 0x65372900-0x65372aff irq 116 on bcm_idm0\ idm_monitor29: mem 0x65373900-0x65373aff irq 117 on bcm_idm0\ idm_monitor30: mem 0x65374900-0x65374aff irq 118 on bcm_idm0\ idm_monitor31: mem 0x65375900-0x65375aff irq 119 on bcm_idm0\ idm_monitor32: mem 0x65376900-0x65376aff irq 120 on bcm_idm0\ idm_monitor33: mem 0x65377900-0x65377aff irq 121 on bcm_idm0\ idm_monitor34: mem 0x65378900-0x65378aff irq 122 on bcm_idm0\ idm_monitor35: mem 0x65379900-0x65379aff irq 123 on bcm_idm0\ idm_monitor36: mem 0x6537a900-0x6537aaff irq 124 on bcm_idm0\ idm_monitor37: mem 0x67005900-0x67005aff irq 125 on bcm_idm0\ idm_monitor38: mem 0x67015900-0x67015aff irq 128 on bcm_idm0\ idm_monitor39: mem 0x67016900-0x67016aff irq 129 on bcm_idm0\ idm_monitor40: mem 0x67017900-0x67017aff irq 130 on bcm_idm0\ idm_monitor41: mem 0x67019900-0x67019aff irq 132 on bcm_idm0\ idm_monitor42: mem 0x67020900-0x67020aff irq 135 on bcm_idm0\ idm_monitor43: mem 0x67021900-0x67021aff irq 136 on bcm_idm0\ idm_monitor44: mem 0x67022900-0x67022aff irq 137 on bcm_idm0\ idm_monitor10: Error detected for device monitor pcie_1_apbt\ idm_monitor14: Error detected for device monitor nic_axi2apb_s\ idm_monitor31: Error detected for device monitor scr_ddr_s\ idm_monitor41: Error detected for device monitor hs_apbs\ Fatal data abort:\ x0: 1bff00201c681838\ x1: 0\ x2: ffff00000049eeb3 (notify.prefix + ac6)\ x3: 51b\ x4: ffff000000427698 (cam_status_table + ee90)\ x5: ffff000002f0cdc8 (_end + 10b3dc8)\ x6: ffff000002f0c100 (_end + 10b3100)\ x7: 0\ x8: ffff00000068fac0 (initstack + 7ac0)\ x9: 1\ x10: ffff00000068fac0 (initstack + 7ac0)\ x11: 10\ x12: 0\ x13: 0\ x14: 0\ x15: a\ x16: ffff00000068f54d (initstack + 754d)\ x17: ffff00000068f54c (initstack + 754c)\ x18: ffff00000068f640 (initstack + 7640)\ x19: ffff000041cbd620 (_end + 3fe64620)\ x20: 4\ x21: 1bff00201c681838\ x22: 1bff00201c681820\ x23: ffff0000006900b4 (xsoftc + 24)\ x24: ffff000041ca3280 (_end + 3fe4a280)\ x25: ffffa0000023b860\ x26: ffff00000068fac0 (initstack + 7ac0)\ x27: 1\ x28: 0\ x29: ffff00000068f650 (initstack + 7650)\ sp: ffff00000068f640\ lr: ffff0000002244e0 (sched_add + 1cc)\ elr: ffff0000001ca6e0 (__mtx_lock_spin_flags + 20)\ spsr: 200002c5\ far: 1bff00201c681838\ esr: 0000000096000004\ panic: vm_fault failed: ffff0000001ca6e0 error 1\ cpuid = 0\ time = 1\ KDB: stack backtrace:\ db_trace_self() at db_trace_self\ db_trace_self_wrapper() at db_trace_self_wrapper+0x30\ vpanic() at vpanic+0x23c\ panic() at panic+0x44\ data_abort() at data_abort+0x33c\ handle_el1h_sync() at handle_el1h_sync+0x10\ --- exception, esr 0xffff00000068f54d\ (null)() at 0\ KDB: enter: panic\ [ thread pid 0 tid 100000 ]\ Stopped at kdb_enter+0x40: undefined f904927f\ db> bt\ \ \ \ \'97\'97\'97\'97\'97\'97\'97\'97\'97 Remote GDB \'97\'97\'97\'97\'97\'97\'97\'97\'97\'97\'97\'97\'97\'97\'97\'97\'97\'97\'97\ \ \pard\tx560\tx1120\tx1680\tx2240\tx2800\tx3360\tx3920\tx4480\tx5040\tx5600\tx6160\tx6720\pardirnatural\partightenfactor0 \fs34 (kgdb) bt\ #0 \cf3 kdb_enter\cf2 (\cf4 why\cf2 =, \cf4 msg\cf2 =) at \cf5 /b/sfaisal/stable_main/src/sys/kern/subr_kdb.c\cf2 :549\ #1 \cf6 0xffff0000001f0a18\cf2 in \cf3 vpanic\cf2 (\cf4 fmt\cf2 =0xffff0000004935c8 "vm_fault failed: %lx error %d", \cf4 ap\cf2 =...)\ at \cf5 /b/sfaisal/stable_main/src/sys/kern/kern_shutdown.c\cf2 :968\ #2 \cf6 0xffff0000001f06cc\cf2 in \cf3 panic\cf2 (\cf4 fmt\cf2 =) at \cf5 /b/sfaisal/stable_main/src/sys/kern/kern_shutdown.c\cf2 :899\ #3 \cf6 0xffff0000003f20fc\cf2 in \cf3 data_abort\cf2 (\cf4 td\cf2 =0xffff00000081a6a0 , \cf4 frame\cf2 =0xffff00000068f4a0, \cf4 esr\cf2 =2516582404, \cf4 far\cf2 =, \cf4 lower\cf2 =0)\ at \cf5 /b/sfaisal/stable_main/src/sys/arm64/arm64/trap.c\cf2 :400\ #4 \ul \ulnone \ #5 \cf6 0xffff0000001ca6e0\cf2 in \cf3 __mtx_lock_spin_flags\cf2 (\cf4 c\cf2 =0x96000004, \cf4 opts\cf2 =476583992, \ \cf4 file\cf2 =0x1bff00201c681838 , \cf4 line\cf2 =0) at \cf5 /b/sfaisal/stable_main/src/sys/kern/kern_mutex.c\cf2 :331\ Backtrace stopped: Cannot access memory at address 0x9\ (kgdb) frame 5\ #5 \cf6 0xffff0000001ca6e0\cf2 in \cf3 __mtx_lock_spin_flags\cf2 (\cf4 c\cf2 =0x96000004, \cf4 opts\cf2 =476583992, \ \cf4 file\cf2 =0x1bff00201c681838 , \cf4 line\cf2 =0) at \cf5 /b/sfaisal/stable_main/src/sys/kern/kern_mutex.c\cf2 :331\ 331 KASSERT(m->mtx_lock != MTX_DESTROYED,\ (kgdb) frame 3\ #3 \cf6 0xffff0000003f20fc\cf2 in \cf3 data_abort\cf2 (\cf4 td\cf2 =0xffff00000081a6a0 , \cf4 frame\cf2 =0xffff00000068f4a0, \cf4 esr\cf2 =2516582404, \cf4 far\cf2 =, \cf4 lower\cf2 =0)\ at \cf5 /b/sfaisal/stable_main/src/sys/arm64/arm64/trap.c\cf2 :400\ 400 panic("vm_fault failed: %lx error %d",\ (kgdb) p /x *frame\ $2 = \{\cf4 tf_sp\cf2 = 0xffff00000068f640, \cf4 tf_lr\cf2 = 0xffff0000002244e0, \cf4 tf_elr\cf2 = 0xffff0000001ca6e0, \cf4 tf_spsr\cf2 = 0x200002c5, \cf4 tf_esr\cf2 = 0x96000004, \ \cf4 tf_far\cf2 = 0x1bff00201c681838, \cf4 tf_x\cf2 = \{0x1bff00201c681838, 0x0, 0xffff00000049eeb3, 0x51b, 0xffff000000427698, 0xffff000002f0cdc8, 0xffff000002f0c100, \ 0x0, 0xffff00000068fac0, 0x1, 0xffff00000068fac0, 0x10, 0x0, 0x0, 0x0, 0xa, 0xffff00000068f54d, 0xffff00000068f54c, 0xffff00000068f640, \ 0xffff000041cbd620, 0x4, 0x1bff00201c681838, 0x1bff00201c681820, 0xffff0000006900b4, 0xffff000041ca3280, 0xffffa0000023b860, 0xffff00000068fac0, 0x1, \ 0x0, 0xffff00000068f650\}\}\ (kgdb)\ \pard\tx560\tx1120\tx1680\tx2240\tx2800\tx3360\tx3920\tx4480\tx5040\tx5600\tx6160\tx6720\pardirnatural\partightenfactor0 \fs38 \ } --Apple-Mail=_6E0B10FA-A382-44DA-8A43-DD44CF5E2297 Content-Transfer-Encoding: 7bit Content-Type: text/html; charset=us-ascii

--Apple-Mail=_6E0B10FA-A382-44DA-8A43-DD44CF5E2297-- --Apple-Mail=_4AFE4AD1-DA71-469C-8382-828AA47F5A47-- From nobody Thu Jun 29 13:26:24 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4QsK3j3JFwz4kNCk for ; Thu, 29 Jun 2023 13:26:41 +0000 (UTC) (envelope-from sfaisal@juniper.net) Received: from mx0a-00273201.pphosted.com (mx0a-00273201.pphosted.com [208.84.65.16]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.pphosted.com", Issuer "Thawte RSA CA 2018" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4QsK3h5871z4Px9 for ; Thu, 29 Jun 2023 13:26:40 +0000 (UTC) (envelope-from sfaisal@juniper.net) Authentication-Results: mx1.freebsd.org; none Received: from pps.filterd (m0108156.ppops.net [127.0.0.1]) by mx0a-00273201.pphosted.com (8.17.1.19/8.17.1.19) with ESMTP id 35T8HaSo016244; Thu, 29 Jun 2023 06:26:38 -0700 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=juniper.net; h=from : to : cc : subject : date : message-id : references : in-reply-to : content-type : mime-version; s=PPS1017; bh=olSKOorg1TscHudNYjnfs/OIyN7//P/CMKG9TFHSy34=; b=YQ79uLsrPlpSyVmVBs6oi9Zw5iG8RtKYFVYpHQmLxKZqX7adJJC6/jfQWIfiDdr9qHSw RyMCSUm/f6Pe9fSQtTB3BxyvaLw3EAkNN4GqY4iLJ5gvtCERtlNDjKyCKru5yORGLEL7 V7zjbjwPiXNSA0kfYwFsUuci/KYCZJVxTjtLJrlQ6fMyEYxOrBjf80E68agHITpeKv61 nmy1PvUFYUgKum6Wu3KaUwQZXMyFGirRODj04mmio3g8ZXknOWFZhCATWssxMVQLukSR Sl0HJyr3ISINo6CAJlsSfkcblwWJ0/HouPT/CbdVI6cr3OOifOOEn2nplovUBe4ReflG 6A== Received: from dm4pr02cu002.outbound.protection.outlook.com (mail-centralusazlp17013032.outbound.protection.outlook.com [40.93.13.32]) by mx0a-00273201.pphosted.com (PPS) with ESMTPS id 3rgr6125qj-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Thu, 29 Jun 2023 06:26:38 -0700 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=EDqKC8tiP7646bGz7o4gAv3Tb2k4TpWM5T8uNrepmacr179OqaFRJi6rlCy9TQJUQWPzZm2hkXdI/dG/nfzkAKjoP/6HfWnvAOOLIXcj7OiQh2mldMy9gaRzIZxHQUGUBfU1G11JDvZnXxqCrzNDEsqjNYlU3tdcvt58UoWjklb1O/W5cYgNt9ydcqCW6BZ0YLwpvLkHeFid6EkCYPb4vbEjMvlOBLXcD/GCt2f4kaJNqLo3vX7UJ9Oi27tkXewo9nuZeoAgUEH+XDPrycQb7q/owIFMsmLzpZ6ulys3Ci9ATAimQnh3TynffBbzN9de65EdXm2xaeVBZxfJp5uD/g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=olSKOorg1TscHudNYjnfs/OIyN7//P/CMKG9TFHSy34=; b=ALHmF7Eil62AKIJSh9HSkKc6LpCRh0NtH9tX6ueTMW8nGSyTPlQ9PwrBgTQxbhM0R36Qr2GsCY/hyjGNs5adxBX/mBv+z0yrZtyh4t2jEZ74xgSYLVnXkBZho7FcHslJX8wMvLJpTHlzPXh3CvCM3mlb6537FG+P9ykCC+couainBrA83skHtakLdL44MbwmU54Ef6xYJuyjxXZWwbxN8qMSv/MV4KEYRqH+v3WOPiIVRYqvMSe813OVUOp5ddBWzkXObHtVGb6x5/vSZZ4GyKKXoToMSA1ordlXBfliHrqfq/M0KJtW2WnBTIR79eOlMh93ucXeri/eEtQEm/dc2A== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=juniper.net; dmarc=pass action=none header.from=juniper.net; dkim=pass header.d=juniper.net; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=juniper.net; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=olSKOorg1TscHudNYjnfs/OIyN7//P/CMKG9TFHSy34=; b=Lr54u3dwBs428ceatUeI8K0IO+zVZyMkGQVhNFIKbuH75qrpZ46HOrWARRzWRhGVNIR3dbeGIKLH+kY0pm0dTKAeVHbzNrKv2GkX9g2kqSeWbxLkKv84Z8vi+J79G68h3aNFSAMKh6cBp2zP3PFXf9sIOvtDZ3UbUyM9Wn9KN9Y= Received: from BYAPR05MB6677.namprd05.prod.outlook.com (2603:10b6:a03:ec::28) by PH0PR05MB8107.namprd05.prod.outlook.com (2603:10b6:510:74::24) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6544.15; Thu, 29 Jun 2023 13:26:24 +0000 Received: from BYAPR05MB6677.namprd05.prod.outlook.com ([fe80::65c0:5c8:b916:d4e1]) by BYAPR05MB6677.namprd05.prod.outlook.com ([fe80::65c0:5c8:b916:d4e1%4]) with mapi id 15.20.6521.026; Thu, 29 Jun 2023 13:26:24 +0000 From: Sha Faisal To: Andrew Turner CC: "freebsd-arm@FreeBSD.org" , Steve Kiernan , Mahesh Vardhamanaiah Subject: Re: Kernel crash before login prompt Thread-Topic: Kernel crash before login prompt Thread-Index: AQHZqYguFdDezJe7q0OItnaHAyE0G6+gIhyygAAx4gCAADjn4YAA/1uAgAA2tE0= Date: Thu, 29 Jun 2023 13:26:24 +0000 Message-ID: References: <6537067F-670A-4B52-87FA-FF2DBAD68120@fubar.geek.nz> In-Reply-To: <6537067F-670A-4B52-87FA-FF2DBAD68120@fubar.geek.nz> Accept-Language: en-GB, en-US Content-Language: en-IN X-MS-Has-Attach: X-MS-TNEF-Correlator: msip_labels: MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Enabled=True;MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_SiteId=bea78b3c-4cdb-4130-854a-1d193232e5f4;MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_SetDate=2023-06-29T13:09:59.7835565Z;MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_ContentBits=0;MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Method=Standard x-ms-publictraffictype: Email x-ms-traffictypediagnostic: BYAPR05MB6677:EE_|PH0PR05MB8107:EE_ x-ms-office365-filtering-correlation-id: 9ee076ad-a0a8-450e-4b5f-08db78a46f6a x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: 5wSlN2MKdnYPZSOctsxZ7wYfA0+us+xgCNrhAg91Q4a9ydwWsBS7B8huofbsiYQlwxxUO180FmbeMg0Hjcp7vZ30+4STg10aPC0jfL9LvpuxoCkp7jv+bWPcxhC1rAkAqH33/k47QFVj3RvSTwVAlShxGdZ2JvuMhVcOaxzR4QHmQEYuMe7ffUDDVd4oLp37BtvuQhuhdIh+Ja4tLEfStPh+2IHhOQmmVqe+73x7Kuih6USKSFQh/CwhHgxcR+xZY2QYDZsjyteBXlFF3SNLpf3Uo/IrEgBfTXyN45gIO5H2Vi+qAUqoioAM9zz3kKQ9knIzU/5nlZlYdY3E6SquJffN/9iLu9wnL6p+rGd+ISJJjlP+C9H+yzpjHjrBD0+X0bPLQvhJsa9sZGaqVlrHMXHY5oKiNrLfYQOxbmaENevk5/y5yMqpPudcECysyAPpvADrTe+j3MicmSlZjhIqbNrQLrkhQ4XmYAPgx0cMu70UbugXh74XGcee9N306W8hbOgAMed7it6arVvHva4DlDJ4rM+056B2/HFwJ39QQenJ7k9M57/FuU1pfWw0u9z9e95cKRdsxJ6bk+gC7y5PslL3ZhzaQM9VtzLRjWEvOBih3tsTMaAQqTkm653nHZyYEp//bpck2A/NtZn26yUkyVa1VQsrD2WpTPdggNxHmio= x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:BYAPR05MB6677.namprd05.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230028)(4636009)(136003)(346002)(39860400002)(366004)(396003)(376002)(451199021)(7696005)(38100700002)(53546011)(71200400001)(107886003)(83380400001)(122000001)(6506007)(26005)(186003)(9686003)(55016003)(54906003)(41300700001)(38070700005)(86362001)(316002)(2906002)(66556008)(33656002)(91956017)(66476007)(64756008)(66446008)(66946007)(76116006)(6916009)(4326008)(5660300002)(52536014)(8676002)(8936002)(478600001);DIR:OUT;SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?Windows-1252?Q?m/pzmtF/oIo65XGYjYTjD3xcD+R3LRbwX7KW4LBGAPtBfcHJRfjYXgjH?= =?Windows-1252?Q?nmCqHTpmTbTHnCEaB+5eTdcV9Ds2p67K/Zly3NUCfANDk/LUYna4FxR0?= =?Windows-1252?Q?362Q4IvECWokKuDnVPKDuG1kWiiUURmfwMUmP8977kTlbEcw8OfbPN/d?= =?Windows-1252?Q?YrBvhn2a1rS97nkN74qtLQI5No0WrXB0i8BMqWx9Qdg8Au8LpWBqBRc1?= =?Windows-1252?Q?fLmIcmhSHJ73zbPbEtqjWRbIgh5H4zapwm1xR1w7+JfqGjA4Py3o7gFC?= =?Windows-1252?Q?caxdYsD6yPDbo7krTzuc0AwvCmtBdVldIVU1ZtjVemsR3mHUcg5VXjwl?= =?Windows-1252?Q?JHKDs0utiH8tPXycUfg82lMIcx7DVyXm1VxE4Bhn6hHSmSoNb8j4o1MW?= =?Windows-1252?Q?La6Ov5JnQsLrwQCRaOegJYildy/zn5zWVIkcNnXw+gQITK9FsXgxVOTT?= =?Windows-1252?Q?zVra2Y4v+Hda4RkssO4Y50hCvaHNnTn493mPMzFZHME6b7Ydha3XfttO?= =?Windows-1252?Q?VH5AMnzAFvbs8dU1MXV8ZWhQL+yzGL68m3FPAnMo6rQQdpJp2+dks5xa?= =?Windows-1252?Q?EWpxrEYFdPeMGapHQL+PfOjZBfoIj1OY+EMQQnj0uRqy1tHm5yUGyfP1?= =?Windows-1252?Q?Rs9J2Xo/yoFmVj8mMnFe1vVTOsn2EUlnfmwSTjWpuHBC4lBygejHDGAS?= =?Windows-1252?Q?knCJQpaXjGCyr43h61PK4/SDmU10RQYoCxoBvDAj1yaUhHaahL4yZkna?= =?Windows-1252?Q?leMyL9VBTiP1Jc+Hzc26SMNyR2Y+pjInTsoqafXD/BpFJ5CatIzc11a1?= =?Windows-1252?Q?IQJ/WoybvOJ0kL76rjGSdkI88PiyigMp3lFb4rO+nj0Yg3Kt8KhIkR7L?= =?Windows-1252?Q?8Ve29sEIwaTRJdibaNOnJLzLIONLIAIQNEw49EX5O6FCwNvXPd+wqySG?= =?Windows-1252?Q?PRZklhuoRinzDLJY6hDPYPVTsXYULcdb9xWAIgeqW8JM4/l+Ie1mHTyn?= =?Windows-1252?Q?4sCIHg3E5DgYnwWrxDUAPz05UKAfkXJivQX6bNMieW8kUhtqR+MCKAqo?= =?Windows-1252?Q?4nVm/v7vuFHb+18wQkoni27K5pfDQ6GMGONNh6yYC4o0fuUxD8GjxNjH?= =?Windows-1252?Q?z8LoNW+H6doAOXxwnJO8YUKH1ZQUB1UzqwlMRAWu82hH6pT6hUpRM/5m?= =?Windows-1252?Q?DLKmhukE/Cmmsbslcq/x+6Vve18C0NtrVqRVXRAmhHYA7TgT+UlqatbW?= =?Windows-1252?Q?jLlTLLcmAunmdYiXFHB5APUp5+BN0o1MN6YR4GluJvBk60xeVhjnMa0J?= =?Windows-1252?Q?y0GvtjTIkRCHQRC3I/MMriO/FyQmsG/km+r0ZRx8jSAzMw+KnCkDU+XH?= =?Windows-1252?Q?H09iGaI0AKVSoLlAfHyx96fcUUoPbovpRGoskyKCKuGSDTZogGK/VTeR?= =?Windows-1252?Q?jB3e/j95HQp/7M+ARINaPeExPAxLLiHL4W+l9EtheVZlW1VR4h3IlUE9?= =?Windows-1252?Q?J8zu2sauioGVV4CaOE7LZb0gd0RQQzJCEL5rc6/dItDPNj3YmU5d03HV?= =?Windows-1252?Q?qm375mDAfy3CL6FRcDsyE6iIzYW98L99oUHfIE1KpGAIg1yGq+Xp1ZvC?= =?Windows-1252?Q?DgGXUwiOIXnrv81pNRMB2RNTuJdegzHUiXLsrosiiKug8wYztoid/QTb?= =?Windows-1252?Q?8/w+7wFg6QKZKAezKS6D62lzhX2MFIbLc4TldAtYskhWzU3jwB5B5Q?= =?Windows-1252?Q?=3D=3D?= Content-Type: multipart/alternative; boundary="_000_BYAPR05MB667764EF552E113B08FD1222B725ABYAPR05MB6677namp_" List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: juniper.net X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: BYAPR05MB6677.namprd05.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 9ee076ad-a0a8-450e-4b5f-08db78a46f6a X-MS-Exchange-CrossTenant-originalarrivaltime: 29 Jun 2023 13:26:24.2172 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: bea78b3c-4cdb-4130-854a-1d193232e5f4 X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: HutPSFyGXWohVCNbXIWxl2WKaw0sBreu1hMVeHxVOSXEOkjRH7BhV0yhdRjVKX/wcFlHmpwl3kBB1Lxh8huK5Q== X-MS-Exchange-Transport-CrossTenantHeadersStamped: PH0PR05MB8107 X-Proofpoint-ORIG-GUID: tdKLPPVV_vPNjp_0gr3Pc1qitVcBQtxi X-Proofpoint-GUID: tdKLPPVV_vPNjp_0gr3Pc1qitVcBQtxi X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.254,Aquarius:18.0.957,Hydra:6.0.591,FMLib:17.11.176.26 definitions=2023-06-29_03,2023-06-27_01,2023-05-22_02 X-Proofpoint-Spam-Details: rule=outbound_spam_notspam policy=outbound_spam score=0 malwarescore=0 suspectscore=0 mlxlogscore=721 impostorscore=0 mlxscore=0 adultscore=0 spamscore=0 priorityscore=1501 clxscore=1015 lowpriorityscore=0 phishscore=0 bulkscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2305260000 definitions=main-2306290120 X-Rspamd-Queue-Id: 4QsK3h5871z4Px9 X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:26211, ipnet:208.84.65.0/24, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N --_000_BYAPR05MB667764EF552E113B08FD1222B725ABYAPR05MB6677namp_ Content-Type: text/plain; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable Below are the values you asked for Just after dpcpu_init() in initarm() --------In initarm and pcpup->pc_dynamic =3D 0x2886480 --------In initarm and dpcpu_off[0] =3D 0x2886480 --------In initarm and DPCPU_START =3D 0xffff000000681b80 --------In initarm and DPCPU_STOP =3D 0xffff000000687300 --------In initarm and DPCPU_BYTES =3D 0x5780 --------In initarm and DPCPU_SIZE =3D 0x6000 --------In initarm and PAGE_SIZE =3D 0x1000 --------In initarm and pcpu =3D 0xffff00000095bd80 --------In initarm and pcpu_entry_timerstate is 0xffff00000068ac80---- --------In initarm and __start_set_pcpu is 0---- --------In initarm and pcpu_entry_tdq is 0xffff00000068ac80---- ---<>--- Below are after it crashes on db prompt: db> p __start_set_pcpu ffff000000681b80 db> p __stop_set_pcpu ffff000000687300 db> show dpcpu_off dpcpu_off[ 0] =3D 0x2886480 (+ DPCPU_START =3D 0xffff000002f08000) db> p pcpu_entry_tdq ffff000000681c80 Regards Faisal Juniper Business Use Only From: owner-freebsd-arm@freebsd.org on beha= lf of Andrew Turner Date: Thursday, 29 June 2023 at 15:27 To: Sha Faisal Cc: freebsd-arm@FreeBSD.org , Steve Kiernan , Mahesh Vardhamanaiah Subject: Re: Kernel crash before login prompt [External Email. Be cautious of content] It looks like that exception is due to DPCPU_ID_PTR calculating an invalid = pointer. Can you print the contents of the dpcpu_off array, and the addresses of __s= tart_set_pcpu and pcpu_entry_tdq. Andrew On 28 Jun 2023, at 19:45, Sha Faisal wrote: Hello Andrew, Attached is the boot log, also at the end I have pasted the remote gdb bac= ktrace Regards faisal Juniper Business Use Only From: Andrew Turner > Date: Wednesday, 28 June 2023 at 20:47 To: Sha Faisal > Cc: freebsd-arm@FreeBSD.org >, Steve Kiernan >, Mahesh Vardhamanaiah > Subject: Re: Kernel crash before login prompt [External Email. Be cautious of content] On 28 Jun 2023, at 13:18, Sha Faisal wrote: Hello FreeBSD team, We have upgraded our FreeBSD kernel from 12 to main branch and with latest = main branch one of our boxes with Broadcom iProc Northstar2 BCM5871X SoC (Quad-core ARM Cortex-A57 64-bit 2GH= z ARMv8-A CPU architecture) is crashing at mtx_spin_lock_flags(), with data= _abort exception. Sometimes the exception is raised at DPCPCU_PTR() functions. Has anyone tried to boot freeBSD14 on the above mentioned BCM SoC? Please share your inputs and comment I don=92t know of any issues with either of these, and don=92t know of anyo= ne running FreeBSD on this SoC. Can you provide more details on what is failing, e.g. the boot log? Andrew --_000_BYAPR05MB667764EF552E113B08FD1222B725ABYAPR05MB6677namp_ Content-Type: text/html; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable

Below are the values you asked for

 

 

Just after dpcpu_init() in initarm()

 

--------In initarm and pcpup->pc_dynamic =3D 0x2886480

--------In initarm and dpcpu_off[0] =3D 0x2886480=

--------In initarm and DPCPU_START =3D 0xffff000000681b80

--------In initarm and DPCPU_STOP =3D 0xffff000000687300=

--------In initarm and DPCPU_BYTES =3D 0x5780

--------In initarm and DPCPU_SIZE =3D 0x6000

--------In initarm and PAGE_SIZE =3D 0x1000

--------In initarm and pcpu =3D 0xffff00000095bd80

--------In initarm and pcpu_entry_timerstate is 0xffff00000068ac80-= ---

--------In initarm and __start_set_pcpu is 0----<= /p>

--------In initarm and pcpu_entry_tdq is 0xffff00000068ac80----

---<<BOOT>>---

 

 

Below are after it crashes on db prompt:

 

db> p __start_set_pcpu
ffff000000681b80
db> p __stop_set_pcpu
ffff000000687300
db>  show dpcpu_off
dpcpu_off[ 0] =3D 0x2886480 (+ DPCPU_START =3D 0xffff000002f08000)

db> p pcpu_entry_tdq

ffff000000681c80

 

Regards

Faisal

 

 


Juniper Business Use Only

From: owner-freebsd= -arm@freebsd.org <owner-freebsd-arm@freebsd.org> on behalf of Andrew = Turner <andrew@fubar.geek.nz>
Date: Thursday, 29 June 2023 at 15:27
To: Sha Faisal <sfaisal@juniper.net>
Cc: freebsd-arm@FreeBSD.org <freebsd-arm@FreeBSD.org>, Steve K= iernan <stevek@juniper.net>, Mahesh Vardhamanaiah <maheshmv@junipe= r.net>
Subject: Re: Kernel crash before login prompt

<= span style=3D"font-size:10.5pt;font-family:"Lato",sans-serif;colo= r:black">[External Email. Be cautious of content]

 

It looks like that = exception is due to DPCPU_ID_PTR calculating an invalid pointer.<= /o:p>

 

Can you print the c= ontents of the dpcpu_off array, and the addresses of __start_set_pcpu = and pcpu_entry_tdq.

 

Andrew



On 28 Jun 2023, at = 19:45, Sha Faisal <sfaisal@juniper.net> wrote:

 

Hello Andrew,

Attached is the boo= t log,  also at the end I have pasted the remote gdb backtrace<= o:p>

 <= /o:p>

Regards=

faisal<= /o:p>

 <= /o:p>

 

Juniper Business Use Only

From: Andrew Turner <andrew@fubar.geek.nz>
Date: Wednesday, = 28 June 2023 at 20:47
To: Sha Faisal &l= t;sfaisal@juniper.net>
Cc: freebsd-arm@FreeBSD.org <freebsd-arm@FreeBSD.org>, Steve Kiernan <stevek@juniper.net>, Mahesh Vardhamanaiah <maheshmv@= juniper.net>
Subject: Re: Kern= el crash before login prompt

 

<= span style=3D"font-size:10.5pt;font-family:"Lato",sans-serif;colo= r:black">[External Email. Be cautious of content]

 <= /o:p>

 <= /o:p>

On 28 Jun 2023, at = 13:18, Sha Faisal <sfaisal@juniper.net> wrote:

 <= /o:p>

 

Hell= o FreeBSD team,

 

We h= ave upgraded our FreeBSD kernel from 12 to main branch and with latest main= branch one of our boxes with

B= roadcom iProc Northstar2 BCM5871X SoC (Quad-core ARM Cortex-A57 64-bit 2GHz ARMv8-A C= PU architecture) is crashing at mtx_spin_lock_flags(), with data_abort exception.

Some= times the exception is raised at DPCPCU_PTR() functions.<= /p>

 

Has = anyone tried to boot freeBSD14 on the above mentioned BCM SoC? =

 

Plea= se share your inputs and comment

 <= /o:p>

I don=92t know of a= ny issues with either of these, and don=92t know of anyone running FreeBSD = on this SoC.

 <= /o:p>

Can you provide mor= e details on what is failing, e.g. the boot log?

 <= /o:p>

Andrew<= /o:p>

 <= /o:p>

 

--_000_BYAPR05MB667764EF552E113B08FD1222B725ABYAPR05MB6677namp_-- From nobody Thu Jun 29 14:47:41 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4QsLsN5Xjpz4k09p for ; Thu, 29 Jun 2023 14:47:52 +0000 (UTC) (envelope-from bounce.5stpl07e30=noqh5raliksn=n88d5rp79y@em790814.fubar.geek.nz) Received: from e2i947.smtp2go.com (e2i947.smtp2go.com [103.2.143.179]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4QsLsN0zF3z3rL3 for ; Thu, 29 Jun 2023 14:47:51 +0000 (UTC) (envelope-from bounce.5stpl07e30=noqh5raliksn=n88d5rp79y@em790814.fubar.geek.nz) Authentication-Results: mx1.freebsd.org; none Received: from [10.99.243.232] (helo=morbo.fubar.geek.nz) by smtpcorp.com with esmtpsa (TLS1.3:ECDHE_X25519__RSA_PSS_RSAE_SHA256__AES_256_GCM:256) (Exim 4.96-S2G) (envelope-from ) id 1qEsvx-4XkxS4-1Z; Thu, 29 Jun 2023 14:47:45 +0000 Received: from webmail.fubar.geek.nz (calculon.fubar.geek.nz [162.55.43.65]) by morbo.fubar.geek.nz (Postfix) with ESMTPSA id CF16F1D8F1; Thu, 29 Jun 2023 14:47:41 +0000 (UTC) List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Date: Thu, 29 Jun 2023 15:47:41 +0100 From: andrew@fubar.geek.nz To: Sha Faisal Cc: "freebsd-arm@FreeBSD.org" , Steve Kiernan , Mahesh Vardhamanaiah Subject: Re: Kernel crash before login prompt In-Reply-To: References: <6537067F-670A-4B52-87FA-FF2DBAD68120@fubar.geek.nz> Message-ID: X-Sender: andrew@fubar.geek.nz Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-smtpcorp-track: 1qEsvx4bkxS41Z.nlXQkYie_lm-X DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=smtpservice.net; i=@smtpservice.net; q=dns/txt; s=a1-4; t=1688050068; h=feedback-id : x-smtpcorp-track : date : message-id : to : subject : from : reply-to : sender : list-unsubscribe; bh=5vBBdfZ/HPH1McqKbi64bm5JFoi1/DeSsm1qGBJHsYU=; b=wHtXKL/g+VHJTTDATWFRL4mGqkt5Ddeoj+NSpphYiKi5T3bqLW+LTlmTfa9xtG55VtoA0 nPyYvLJfqjMYqDUM+O4cuEo379eByKePMDlzICY1EqpAEdvzY62Le6UAukjVbgIwIKz60oV J1qeKJE8Ku8oWm0flfQ8bIw+QVCUfyYwNvglOLEzdjNOnreZKGqGcIjhFOjzr6bXD47DaPF 0epvzVNTLp+NRojV/kMgndyjAB3cRoF4Lyue+IxTXn0zZGJAJ3/d/8Uqm+Iqevq03xTi3R4 FZlh9fTYbnzcAgE/ua7Wkgjajr3uYOg9yQfrVGQabImWr0OpK455hNcPG/PQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=fubar.geek.nz; i=@fubar.geek.nz; q=dns/txt; s=s790814; t=1688050068; h=from : subject : to : message-id : date; bh=5vBBdfZ/HPH1McqKbi64bm5JFoi1/DeSsm1qGBJHsYU=; b=YoGQC2rPYkLrrDFSnc5Dd6X3WvrtHBMoDR6FYkIyRYr9nURJMR38uUG8DQO8ZeONtaGN2 RBXkZTaglH3gADd4TC0qa5tlwtuzj4NRpCsIk3rDuc8q4yZzxXzAXE7SrBvvuHz2GJhrKeZ jDeEBK8fZdaHCAaK0Y4uQY6kQp2ptaxGd5CQlkRJKChZYnrGiFuDxJ4ba5p6GIr6NEW46eO 3tx+VfiJto6e4lkivn1RjwpoLmNdyWFNIJr/vAuaUKn/v3h0vsiu0Ouva8JrDkZwio3ifTd cUx9NfbeIT4PCIent3Nu+hJhHiWPvTe5RbESroa1X+2L1tEOvchk/ZW1ns3w== X-Rspamd-Queue-Id: 4QsLsN0zF3z3rL3 X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:23352, ipnet:103.2.140.0/22, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N Can you find out which function 0xffff0000002244dc is from (i.e. the caller of __mtx_lock_spin_flags)? It looks like it is in sched_pickcpu, but it also looks like sched_pickcpu should return before calling __mtx_lock_spin_flags based on the boot log. Andrew On 2023-06-29 14:26, Sha Faisal wrote: > Below are the values you asked for > > Just after dpcpu_init() in initarm() > > --------In initarm and pcpup->pc_dynamic = 0x2886480 > > --------In initarm and dpcpu_off[0] = 0x2886480 > > --------In initarm and DPCPU_START = 0xffff000000681b80 > > --------In initarm and DPCPU_STOP = 0xffff000000687300 > > --------In initarm and DPCPU_BYTES = 0x5780 > > --------In initarm and DPCPU_SIZE = 0x6000 > > --------In initarm and PAGE_SIZE = 0x1000 > > --------In initarm and pcpu = 0xffff00000095bd80 > > --------In initarm and pcpu_entry_timerstate is 0xffff00000068ac80---- > > > --------In initarm and __start_set_pcpu is 0---- > > --------In initarm and pcpu_entry_tdq is 0xffff00000068ac80---- > > ---<>--- > > Below are after it crashes on db prompt: > > db> p __start_set_pcpu > ffff000000681b80 > db> p __stop_set_pcpu > ffff000000687300 > db> show dpcpu_off > dpcpu_off[ 0] = 0x2886480 (+ DPCPU_START = 0xffff000002f08000) > > db> p pcpu_entry_tdq > > ffff000000681c80 > > Regards > > Faisal > > Juniper Business Use Only > From: owner-freebsd-arm@freebsd.org > on behalf of Andrew Turner > Date: Thursday, 29 June 2023 at 15:27 > To: Sha Faisal > Cc: freebsd-arm@FreeBSD.org , Steve Kiernan > , Mahesh Vardhamanaiah > Subject: Re: Kernel crash before login prompt > > [External Email. Be cautious of content] > > It looks like that exception is due to DPCPU_ID_PTR calculating an > invalid pointer. > > Can you print the contents of the dpcpu_off array, and the addresses > of __start_set_pcpu and pcpu_entry_tdq. > > Andrew > >> On 28 Jun 2023, at 19:45, Sha Faisal wrote: >> >> Hello Andrew, >> >> Attached is the boot log, also at the end I have pasted the remote >> gdb backtrace >> >> Regards >> >> faisal >> >> Juniper Business Use Only >> >> From: Andrew Turner >> Date: Wednesday, 28 June 2023 at 20:47 >> To: Sha Faisal >> Cc: freebsd-arm@FreeBSD.org , Steve Kiernan >> , Mahesh Vardhamanaiah >> Subject: Re: Kernel crash before login prompt >> >> [External Email. Be cautious of content] >> >>> On 28 Jun 2023, at 13:18, Sha Faisal wrote: >>> >>> Hello FreeBSD team, >>> >>> We have upgraded our FreeBSD kernel from 12 to main branch and >>> with latest main branch one of our boxes with >>> >>> Broadcom iProc Northstar2 BCM5871X SoC (Quad-core ARM Cortex-A57 >>> 64-bit 2GHz ARMv8-A CPU architecture) is crashing at >>> mtx_spin_lock_flags(), with data_abort exception. >>> >>> Sometimes the exception is raised at DPCPCU_PTR() functions. >>> >>> Has anyone tried to boot freeBSD14 on the above mentioned BCM SoC? >>> >>> >>> Please share your inputs and comment >> >> I don’t know of any issues with either of these, and don’t know >> of anyone running FreeBSD on this SoC. >> >> Can you provide more details on what is failing, e.g. the boot log? >> >> Andrew From nobody Thu Jun 29 15:03:18 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4QsMCR6J0lz4k8xl for ; Thu, 29 Jun 2023 15:03:31 +0000 (UTC) (envelope-from sfaisal@juniper.net) Received: from mx0b-00273201.pphosted.com (mx0b-00273201.pphosted.com [67.231.152.164]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.pphosted.com", Issuer "Thawte RSA CA 2018" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4QsMCR1TWRz3wB6 for ; Thu, 29 Jun 2023 15:03:31 +0000 (UTC) (envelope-from sfaisal@juniper.net) Authentication-Results: mx1.freebsd.org; none Received: from pps.filterd (m0108162.ppops.net [127.0.0.1]) by mx0b-00273201.pphosted.com (8.17.1.19/8.17.1.19) with ESMTP id 35TC7LQX016184; Thu, 29 Jun 2023 08:03:29 -0700 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=juniper.net; h=from : to : cc : subject : date : message-id : references : in-reply-to : content-type : mime-version; s=PPS1017; bh=i4trQ+6x0+kX3l4U2wcXUu19lcMHzT40xenstsTnxBE=; b=nKRCUbkBy1QJjmzaLdbYb1OTYIzDI13khu4ebfFgCu3rtPNpT6gn9JaGmxb3AFqYd7v5 w4riFNqGCaj+0MZAM8HNIn0TtOywE70puIeEGjZox8Hpwr+a6ZjBs55QO2fyu1+M3Ru8 l+XAjT6U4KB3xBdZv9BP+/u3vATEcaTrB1LrDacctp9tK+WVx8QsYhfQILdg397K9Gqs tsBsj54jcc5LXKc/Tbc12VuFAbHya5zrdhHbSvB4jTcTUsvvoNSoda6t8AX+ft/RfvFT ddm8eODoAwb5NrEu7DFGxg6SrksGidAJmwgGQxsyAxvIY42uCMGmxW0le4OzZCielwTw hA== Received: from dm4pr02cu002.outbound.protection.outlook.com (mail-centralusazlp17013030.outbound.protection.outlook.com [40.93.13.30]) by mx0b-00273201.pphosted.com (PPS) with ESMTPS id 3rgucga32v-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Thu, 29 Jun 2023 08:03:29 -0700 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=VLRLhaWL0VRB6ShEhSBYeZWJ7pZZeEH5dZL7kooHG9vxxtFqrmxKSIx+DhNvEmNT17d7UsimKIuMZzNpGOtFGAg8pFtKTJfqDOnvs7r2RDOrvRoiMqp2dZrQtZRncgj8QaaZN9os61VdHJUycPIX28NDaE85dADUMUBAt5Pcxe1IZ/mNqOYhgmACCuQAy93k61xeXHsizuBgWvu5kSJx9MGksTjdnFIa0XlYyMybAdnPd4MfRhVC7337l6N87o1KDDrKf6xyjEWta/FbN9yChg3Gf3+8gFQsUrhnFBLHFcgYJfbUjc6KtDNNUKggJfZ35Z7dc4eQjaEapp1h3pcJuQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=i4trQ+6x0+kX3l4U2wcXUu19lcMHzT40xenstsTnxBE=; b=B/dKQmyB/OmvPdpBqwore1Ih/Clq2Kxz1jcwyz68fxicU+kEjh7cwcjqNFqfuKl++C4P2uU4IkmR+6oOPsCgAUwa+/v+niICAQfHQo8vGy/gIllCeJn+DIPT53aPDdrln6ySXnXRSDvTixuG26COP8mEwr1eCadVMPJYofwsqXJxxI5XuAiTgkAvR5JpN4/6c81yqpL728nn8GVbY1MTZCSaWr6QVMvK1AIMzdCv0oiYy7HLLslyuDg4wzesw1Ak3byGC+m9lYpc2MHlo5v9SBfHS2pIVWDTucoo2YKqoias51os08ydvanGCE0xzmNOuHEaWtU0oZLFDzrGfyKrCQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=juniper.net; dmarc=pass action=none header.from=juniper.net; dkim=pass header.d=juniper.net; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=juniper.net; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=i4trQ+6x0+kX3l4U2wcXUu19lcMHzT40xenstsTnxBE=; b=YET1qdz4k0ElPYnDjpgyh7xkuvgeiXKXGDAFVf9t6iH/n4X8cvNlC3LLrXHCvLCi8hhr0OAC6wWyPp88ZeyK5ANZoGk512dp6MFY1tRmioYV3Dkgp4OfTQLdN65MDuYJsJW1kl/Q9+1Gqhi+QR+4yOVeGSHean/FTFPshl01C6E= Received: from BYAPR05MB6677.namprd05.prod.outlook.com (2603:10b6:a03:ec::28) by DS7PR05MB7240.namprd05.prod.outlook.com (2603:10b6:5:2d0::22) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6521.24; Thu, 29 Jun 2023 15:03:18 +0000 Received: from BYAPR05MB6677.namprd05.prod.outlook.com ([fe80::65c0:5c8:b916:d4e1]) by BYAPR05MB6677.namprd05.prod.outlook.com ([fe80::65c0:5c8:b916:d4e1%4]) with mapi id 15.20.6521.026; Thu, 29 Jun 2023 15:03:18 +0000 From: Sha Faisal To: "andrew@fubar.geek.nz" CC: "freebsd-arm@FreeBSD.org" , Steve Kiernan , Mahesh Vardhamanaiah , Amit Verma Subject: Re: Kernel crash before login prompt Thread-Topic: Kernel crash before login prompt Thread-Index: AQHZqYguFdDezJe7q0OItnaHAyE0G6+gIhyygAAx4gCAADjn4YAA/1uAgAA2tE2AABtLgIAAA7fp Date: Thu, 29 Jun 2023 15:03:18 +0000 Message-ID: References: <6537067F-670A-4B52-87FA-FF2DBAD68120@fubar.geek.nz> In-Reply-To: Accept-Language: en-GB, en-US Content-Language: en-IN X-MS-Has-Attach: X-MS-TNEF-Correlator: msip_labels: MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Enabled=True;MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_SiteId=bea78b3c-4cdb-4130-854a-1d193232e5f4;MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_SetDate=2023-06-29T15:00:58.4583509Z;MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_ContentBits=0;MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Method=Standard x-ms-publictraffictype: Email x-ms-traffictypediagnostic: BYAPR05MB6677:EE_|DS7PR05MB7240:EE_ x-ms-office365-filtering-correlation-id: 898b30a5-097a-4369-c38f-08db78b1f8c6 x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: 2BFWZ3eP42fr0q5ObXPkUEQxAb75hFHevlJQScfJrGL52jevnQDHiTzd7lhQEdHFF/CpyIdvUFykMluxX3KHijxwggOy+gCwN9i/5UT2UmyuYYOh0mqbQv9HQgBv0l/7QjjCcWWsH7MpEgxwlmzMXqPlsr71o0SXum7gWsghntVbm9TvycsmHxrtWwAhI34YrGindDbLl70uulMNfNtNCIJ9oZaIqee/YHwGIeksZrychccynsOSR/O3jHy5S6Lc1K1ONB7C+vLNObg/OFUXo/Jnnjixm74FC1HQ4BuPOxYvotQKf5Jlz2Bl6HNiuZxqpBS9rfSCK/fOUhncn5ZdTVHIe113Udz1X5H1MbRrJRPJqRQV42/7kdbExu+UGBBUjlm2dthqCVEYOP1VaSK+rXAyb7Ym5X+HvBdOLkxyqFFXM+FsEw4rAVAzBdEtIa2nNqkK3H4nDzp27bG1DfHcyrG5zW59OzcE66EtarTXQwu1t0oZdEmJ2FyGsHcY3IVxc9eY9yucdDJEE2fQs0Is5SsJi4Gby37QZYltN4zfV4Camx9ShGNcfB1DP2fg8ODaxXDa3se7miYshSCp+n/yOwVOdjLD/ewQwdXnWb8g45gmTHIjFwRch18UoUKywJkRBtuMnqfS78ATU3NmybzhEAQOxObXmdGwauS1QoChgds= x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:BYAPR05MB6677.namprd05.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230028)(4636009)(376002)(39860400002)(346002)(396003)(366004)(136003)(451199021)(76116006)(91956017)(66476007)(66946007)(66556008)(107886003)(66446008)(478600001)(64756008)(6916009)(54906003)(4326008)(83380400001)(38100700002)(122000001)(86362001)(55016003)(8936002)(41300700001)(53546011)(9326002)(2906002)(8676002)(9686003)(71200400001)(186003)(26005)(7696005)(33656002)(316002)(38070700005)(52536014)(5660300002)(6506007);DIR:OUT;SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?Windows-1252?Q?Sbu9ELMZNNHkE6cZdoXfWnZ7jW5IfWMinpqrXdV+ZICdNqb1vaPUhiZg?= =?Windows-1252?Q?cThwcCsd2Qi+E8Que6AKBZkXGyebcJzewgf6rjyVtUd6vwnx04SVhCkn?= =?Windows-1252?Q?2ueJ+hC0/kZ7+DdclkEFyUf5V9eEQkN+y+AFb2qkOhL54yHPGitga+BP?= =?Windows-1252?Q?fKyfsvG+EbrbT6LGVQ5g0qQg/raXPuNwP9gq1H/GOjzTv33RnOqAFISx?= =?Windows-1252?Q?gBY/HKUIx7WGbTPo+XVmMSCv7oNrzFpxuohUS1PgePa0S3MdBX93EKSU?= =?Windows-1252?Q?8JltfXPw9vsUHG9Y8aqy4HuCC9PDh1z7KRk2ZpZ7adVp9n50vzh/fKQe?= =?Windows-1252?Q?nFJHwLIYknEKEn4+c9e8pYiIdv0TnzEdBgzY2WACgdT6pFNsVo2Sz5Pn?= =?Windows-1252?Q?bWWiJpGZdOZQ5pGIlMXzLApPjQIHUwt6gA35eCuwZ8fBWLuskDk8lmn1?= =?Windows-1252?Q?1oQHbQwDdtDUPa3LiAmZiC7NYXCF18CiHtlGXuWi8i24h7i0mhuYM10P?= =?Windows-1252?Q?44f2qe22J4DEwAmSUKuT1Z3Izhx2QDhosWMnx+qZ7EMnDY5dz8cC7uey?= =?Windows-1252?Q?jGtExjIcS6aY13fEo8s7LLXKCsinlCvvWFk93fMGahwkYJ7G5FKkWlvi?= =?Windows-1252?Q?OE2RcnJDLsi0Eem3KE1HNnMdjqZXJkR5aafyANhvg1M5neUQycj//AH6?= =?Windows-1252?Q?eKwYIUNiQX2pJwk7HP5PP6qxOKui7r3t36WAgE6pcjxMiwL6ze5xLucm?= =?Windows-1252?Q?cPQ2eiFQHPkF2Da2yhZvIPPP5YuFKhn2XX9wgkQTgjwvvpKNVd455W4E?= =?Windows-1252?Q?FAzSSCs+j6inht136K0x6ioE8Em474YiP//y5P7HFHbM+dL7FKG8pJnC?= =?Windows-1252?Q?481MYkY3wdMYRkJKleAgNRb1L1Zce5jWfUehoZ7G0Bj/YJy4J1u71BFy?= =?Windows-1252?Q?6uJD55JmCY113DjnftU8nPg1NKkPIMTUNy4F8WobLZElx+Hh2Z8UPnlP?= =?Windows-1252?Q?tM6iAO6NJIs74CipPPaqvfW0toB/xHd3XRddwfWELCpY1tNXV2r3QudP?= =?Windows-1252?Q?2noPy21uvaEjZWovtlDqNcCSGUDoYSV+h2/YqzDEoaxgKaOWhE68JlT5?= =?Windows-1252?Q?fCh8gtwrZ7ot3JycUIKzJCpDFu0LysZiAKLzkTI3Ma/p9mj0mQYGFi+C?= =?Windows-1252?Q?HStEgiqujS7JzGFHeBa8HKaj6bOyiMFe2ZopspK5TvWDdpjbyTL8+lEf?= =?Windows-1252?Q?AyV6TZZde8aWv5baRxxSukHd1cT/fKKrX4Xr0O3+1a+1iVDbrdOdwoWE?= =?Windows-1252?Q?9mM6J6GMEOmv6zTvosTML1TBCxrR24qQMrUbjBKhPX88X+jqzoil1edm?= =?Windows-1252?Q?CgjoXJxnOajhtWd8hP3M/72hja/T407hhkIukl/cyDD88qPQntqOASG9?= =?Windows-1252?Q?lUSG/JAGCoRRZ0iBjLLq/2vONZr06PKtkNXJdGMhGO3RfanawGW572KN?= =?Windows-1252?Q?GdBLcNUrFxJwvEWMeI0ho/WlW3FJfWC8O5NIYlWeUaGeBaScYw8H7xMO?= =?Windows-1252?Q?/MYdwnd6fP7smhPdrDjrxmIgu8dWVUjBapAV4X26ypW7hVr9rnuULXh3?= =?Windows-1252?Q?vqepuV3ZH+XK2O2KyIOVq3T35nTFcmxHVkHfsGdHIH9twTD/tVgrnZe5?= =?Windows-1252?Q?0HLJslG1s0GQxQ9Mxbvxao1ClDhSQHCVTENbyndYlG2WTcU1L8LCww?= =?Windows-1252?Q?=3D=3D?= Content-Type: multipart/alternative; boundary="_000_BYAPR05MB6677AED54B7EA054E7B8C170B725ABYAPR05MB6677namp_" List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: juniper.net X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: BYAPR05MB6677.namprd05.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 898b30a5-097a-4369-c38f-08db78b1f8c6 X-MS-Exchange-CrossTenant-originalarrivaltime: 29 Jun 2023 15:03:18.0859 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: bea78b3c-4cdb-4130-854a-1d193232e5f4 X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: tXAiNsC2RwrlPW2y5gI67uyL9j4g+bnWpGgTdn4omc4K+FlorRS7J4fcFimQJLf+nqGOmdDRWb3DOL3zNnvr+A== X-MS-Exchange-Transport-CrossTenantHeadersStamped: DS7PR05MB7240 X-Proofpoint-ORIG-GUID: Xcjl8um4Bc6p1FZm5cLWbHfxgOxv97dX X-Proofpoint-GUID: Xcjl8um4Bc6p1FZm5cLWbHfxgOxv97dX X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.254,Aquarius:18.0.957,Hydra:6.0.591,FMLib:17.11.176.26 definitions=2023-06-29_03,2023-06-27_01,2023-05-22_02 X-Proofpoint-Spam-Details: rule=outbound_spam_notspam policy=outbound_spam score=0 spamscore=0 adultscore=0 priorityscore=1501 phishscore=0 mlxscore=0 lowpriorityscore=0 clxscore=1015 impostorscore=0 mlxlogscore=787 bulkscore=0 malwarescore=0 suspectscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2305260000 definitions=main-2306290136 X-Rspamd-Queue-Id: 4QsMCR1TWRz3wB6 X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:22843, ipnet:67.231.152.0/24, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N --_000_BYAPR05MB6677AED54B7EA054E7B8C170B725ABYAPR05MB6677namp_ Content-Type: text/plain; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable Hello Andrew, The addr2line for the address points to, [sfaisal@svl-bsdx-02 /b/sfaisal/stable_main/src]$ addr2line -e ../obj/arm64= /juniper/kernels/JNPR-ARM64-WIT/kernel/kernel.full -f 0xffff0000002244dc sched_add /b/sfaisal/stable_main/src/sys/kern/sched_ule.c:1309 Sched_setcpu is the exact function which calls TDQ_LOCK(__mtx_lock_spin_fla= gs) , and sched_setcpu is an inline called from sched_add() Regards Faisal Juniper Business Use Only From: andrew@fubar.geek.nz Date: Thursday, 29 June 2023 at 20:17 To: Sha Faisal Cc: freebsd-arm@FreeBSD.org , Steve Kiernan , Mahesh Vardhamanaiah Subject: Re: Kernel crash before login prompt [External Email. Be cautious of content] Can you find out which function 0xffff0000002244dc is from (i.e. the caller of __mtx_lock_spin_flags)? It looks like it is in sched_pickcpu, but it also looks like sched_pickcpu should return before calling __mtx_lock_spin_flags based on the boot log. Andrew On 2023-06-29 14:26, Sha Faisal wrote: > Below are the values you asked for > > Just after dpcpu_init() in initarm() > > --------In initarm and pcpup->pc_dynamic =3D 0x2886480 > > --------In initarm and dpcpu_off[0] =3D 0x2886480 > > --------In initarm and DPCPU_START =3D 0xffff000000681b80 > > --------In initarm and DPCPU_STOP =3D 0xffff000000687300 > > --------In initarm and DPCPU_BYTES =3D 0x5780 > > --------In initarm and DPCPU_SIZE =3D 0x6000 > > --------In initarm and PAGE_SIZE =3D 0x1000 > > --------In initarm and pcpu =3D 0xffff00000095bd80 > > --------In initarm and pcpu_entry_timerstate is 0xffff00000068ac80---- > > > --------In initarm and __start_set_pcpu is 0---- > > --------In initarm and pcpu_entry_tdq is 0xffff00000068ac80---- > > ---<>--- > > Below are after it crashes on db prompt: > > db> p __start_set_pcpu > ffff000000681b80 > db> p __stop_set_pcpu > ffff000000687300 > db> show dpcpu_off > dpcpu_off[ 0] =3D 0x2886480 (+ DPCPU_START =3D 0xffff000002f08000) > > db> p pcpu_entry_tdq > > ffff000000681c80 > > Regards > > Faisal > > Juniper Business Use Only > From: owner-freebsd-arm@freebsd.org > on behalf of Andrew Turner > Date: Thursday, 29 June 2023 at 15:27 > To: Sha Faisal > Cc: freebsd-arm@FreeBSD.org , Steve Kiernan > , Mahesh Vardhamanaiah > Subject: Re: Kernel crash before login prompt > > [External Email. Be cautious of content] > > It looks like that exception is due to DPCPU_ID_PTR calculating an > invalid pointer. > > Can you print the contents of the dpcpu_off array, and the addresses > of __start_set_pcpu and pcpu_entry_tdq. > > Andrew > >> On 28 Jun 2023, at 19:45, Sha Faisal wrote: >> >> Hello Andrew, >> >> Attached is the boot log, also at the end I have pasted the remote >> gdb backtrace >> >> Regards >> >> faisal >> >> Juniper Business Use Only >> >> From: Andrew Turner >> Date: Wednesday, 28 June 2023 at 20:47 >> To: Sha Faisal >> Cc: freebsd-arm@FreeBSD.org , Steve Kiernan >> , Mahesh Vardhamanaiah >> Subject: Re: Kernel crash before login prompt >> >> [External Email. Be cautious of content] >> >>> On 28 Jun 2023, at 13:18, Sha Faisal wrote: >>> >>> Hello FreeBSD team, >>> >>> We have upgraded our FreeBSD kernel from 12 to main branch and >>> with latest main branch one of our boxes with >>> >>> Broadcom iProc Northstar2 BCM5871X SoC (Quad-core ARM Cortex-A57 >>> 64-bit 2GHz ARMv8-A CPU architecture) is crashing at >>> mtx_spin_lock_flags(), with data_abort exception. >>> >>> Sometimes the exception is raised at DPCPCU_PTR() functions. >>> >>> Has anyone tried to boot freeBSD14 on the above mentioned BCM SoC? >>> >>> >>> Please share your inputs and comment >> >> I don=92t know of any issues with either of these, and don=92t know >> of anyone running FreeBSD on this SoC. >> >> Can you provide more details on what is failing, e.g. the boot log? >> >> Andrew --_000_BYAPR05MB6677AED54B7EA054E7B8C170B725ABYAPR05MB6677namp_ Content-Type: text/html; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable

Hello Andrew,

 

The addr2line for the address points to,

 

[sfaisal@svl-b= sdx-02 /b/sfaisal/stable_main/src]$ addr2line -e ../obj/arm64/juniper/kerne= ls/JNPR-ARM64-WIT/kernel/kernel.full -f 0xffff0000002244dc

sched_add=

/b/sfaisal/sta= ble_main/src/sys/kern/sched_ule.c:1309

 

 

Sched_setcpu is the exact function which calls TDQ_LOCK(__mtx_lock_spin_flags) , and sc= hed_setcpu is an inline called from sched_add()

 

Regards

Faisal

 


Juniper Business Use Only

From: andrew@fubar.= geek.nz <andrew@fubar.geek.nz>
Date: Thursday, 29 June 2023 at 20:17
To: Sha Faisal <sfaisal@juniper.net>
Cc: freebsd-arm@FreeBSD.org <freebsd-arm@freebsd.org>, Steve K= iernan <stevek@juniper.net>, Mahesh Vardhamanaiah <maheshmv@junipe= r.net>
Subject: Re: Kernel crash before login prompt

[External Email. Be= cautious of content]


Can you find out which function 0xffff0000002244dc is from (i.e. the
caller of __mtx_lock_spin_flags)? It looks like it is in sched_pickcpu,
but it also looks like sched_pickcpu should return before calling
__mtx_lock_spin_flags based on the boot log.

Andrew

On 2023-06-29 14:26, Sha Faisal wrote:
> Below are the values you asked for
>
> Just after dpcpu_init() in initarm()
>
> --------In initarm and pcpup->pc_dynamic =3D 0x2886480
>
> --------In initarm and dpcpu_off[0] =3D 0x2886480
>
> --------In initarm and DPCPU_START =3D 0xffff000000681b80
>
> --------In initarm and DPCPU_STOP =3D 0xffff000000687300
>
> --------In initarm and DPCPU_BYTES =3D 0x5780
>
> --------In initarm and DPCPU_SIZE =3D 0x6000
>
> --------In initarm and PAGE_SIZE =3D 0x1000
>
> --------In initarm and pcpu =3D 0xffff00000095bd80
>
> --------In initarm and pcpu_entry_timerstate is 0xffff00000068ac80----=
>
>
> --------In initarm and __start_set_pcpu is 0----
>
> --------In initarm and pcpu_entry_tdq is 0xffff00000068ac80----
>
> ---<<BOOT>>---
>
> Below are after it crashes on db prompt:
>
> db> p __start_set_pcpu
> ffff000000681b80
> db> p __stop_set_pcpu
> ffff000000687300
> db>  show dpcpu_off
> dpcpu_off[ 0] =3D 0x2886480 (+ DPCPU_START =3D 0xffff000002f08000)
>
> db> p pcpu_entry_tdq
>
> ffff000000681c80
>
> Regards
>
> Faisal
>
>  Juniper Business Use Only
>  From: owner-freebsd-arm@freebsd.org <owner-freebsd-arm@freebs= d.org>
> on behalf of Andrew Turner <andrew@fubar.geek.nz>
> Date: Thursday, 29 June 2023 at 15:27
> To: Sha Faisal <sfaisal@juniper.net>
> Cc: freebsd-arm@FreeBSD.org <freebsd-arm@FreeBSD.org>, Steve Kie= rnan
> <stevek@juniper.net>, Mahesh Vardhamanaiah <maheshmv@juniper.= net>
> Subject: Re: Kernel crash before login prompt
>
> [External Email. Be cautious of content]
>
> It looks like that exception is due to DPCPU_ID_PTR calculating an
> invalid pointer.
>
> Can you print the contents of the dpcpu_off array, and the addresses > of __start_set_pcpu and pcpu_entry_tdq.
>
> Andrew
>
>> On 28 Jun 2023, at 19:45, Sha Faisal <sfaisal@juniper.net> w= rote:
>>
>> Hello Andrew,
>>
>> Attached is the boot log,  also at the end I have pasted the = remote
>> gdb backtrace
>>
>> Regards
>>
>> faisal
>>
>> Juniper Business Use Only
>>
>> From: Andrew Turner <andrew@fubar.geek.nz>
>> Date: Wednesday, 28 June 2023 at 20:47
>> To: Sha Faisal <sfaisal@juniper.net>
>> Cc: freebsd-arm@FreeBSD.org <freebsd-arm@FreeBSD.org>, Steve= Kiernan
>> <stevek@juniper.net>, Mahesh Vardhamanaiah <maheshmv@juni= per.net>
>> Subject: Re: Kernel crash before login prompt
>>
>> [External Email. Be cautious of content]
>>
>>> On 28 Jun 2023, at 13:18, Sha Faisal <sfaisal@juniper.net&g= t; wrote:
>>>
>>> Hello FreeBSD team,
>>>
>>> We have upgraded our FreeBSD kernel from 12 to main branch and=
>>> with latest main branch one of our boxes with
>>>
>>> Broadcom iProc Northstar2 BCM5871X SoC (Quad-core ARM Cortex-A= 57
>>> 64-bit 2GHz ARMv8-A CPU architecture) is crashing at
>>> mtx_spin_lock_flags(), with data_abort exception.
>>>
>>> Sometimes the exception is raised at DPCPCU_PTR() functions. >>>
>>> Has anyone tried to boot freeBSD14 on the above mentioned BCM = SoC?
>>>
>>>
>>> Please share your inputs and comment
>>
>> I don=92t know of any issues with either of these, and don=92t kno= w
>> of anyone running FreeBSD on this SoC.
>>
>> Can you provide more details on what is failing, e.g. the boot log= ?
>>
>> Andrew

--_000_BYAPR05MB6677AED54B7EA054E7B8C170B725ABYAPR05MB6677namp_-- From nobody Thu Jun 29 15:18:40 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4QsMYB72Lqz4kL56 for ; Thu, 29 Jun 2023 15:18:54 +0000 (UTC) (envelope-from bounce.od7iu07e30=2cjeaz2fxt7s=1lq34w5px4@em790814.fubar.geek.nz) Received: from e2i947.smtp2go.com (e2i947.smtp2go.com [103.2.143.179]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4QsMYB5pGlz41V1 for ; Thu, 29 Jun 2023 15:18:54 +0000 (UTC) (envelope-from bounce.od7iu07e30=2cjeaz2fxt7s=1lq34w5px4@em790814.fubar.geek.nz) Authentication-Results: mx1.freebsd.org; none Received: from [10.99.243.232] (helo=morbo.fubar.geek.nz) by smtpcorp.com with esmtpsa (TLS1.3:ECDHE_X25519__RSA_PSS_RSAE_SHA256__AES_256_GCM:256) (Exim 4.96-S2G) (envelope-from ) id 1qEtPv-4Xm5DB-3C; Thu, 29 Jun 2023 15:18:44 +0000 Received: from webmail.fubar.geek.nz (calculon.fubar.geek.nz [162.55.43.65]) by morbo.fubar.geek.nz (Postfix) with ESMTPSA id 86BBC1D987; Thu, 29 Jun 2023 15:18:41 +0000 (UTC) List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Date: Thu, 29 Jun 2023 16:18:40 +0100 From: andrew@fubar.geek.nz To: Sha Faisal Cc: "freebsd-arm@FreeBSD.org" , Steve Kiernan , Mahesh Vardhamanaiah , Amit Verma Subject: Re: Kernel crash before login prompt In-Reply-To: References: <6537067F-670A-4B52-87FA-FF2DBAD68120@fubar.geek.nz> Message-ID: <1327534fa4a1da584a3a38b194999595@fubar.geek.nz> X-Sender: andrew@fubar.geek.nz Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit X-smtpcorp-track: 1qEtev4bX5DU3C.nbDSkPHNGc4hs DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=smtpservice.net; i=@smtpservice.net; q=dns/txt; s=a1-4; t=1688051932; h=feedback-id : x-smtpcorp-track : date : message-id : to : subject : from : reply-to : sender : list-unsubscribe; bh=qXWGmvtHF3GfHlYVXlzPLdHNsINjbXysAHiZ2YnUA0c=; b=kHyl8eoosS7V6V6KlwAUALruh1m8PZ/tcgyNRXRev8jKao43Q96AjJYsyQMFv1BQinO1j sZxIHk5Es5CYj9H57f3jwR1UaWnXquPaLs7K+R/HiLILR02oJWSGmS7Dna5XnPTSmacNZWU ROkaT+wTl1tLmyZMcZbA/Bc7OoIbhfVMkEoGNrKvXxLoySeebRQSlb/5XSJ/YCn4RF/jkU8 2OBZyEwrRukHtOjbR03mKdZd60Ysw29UL/4wdT8ozABMxYX7gcF6mqymFDzvamrYmL5iEBN A+n++ets8aJ82o6s+WqtzTyXDyCoPhA03JFy/lzHBhidZZU6v27kXUyzu/CA== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=fubar.geek.nz; i=@fubar.geek.nz; q=dns/txt; s=s790814; t=1688051932; h=from : subject : to : message-id : date; bh=qXWGmvtHF3GfHlYVXlzPLdHNsINjbXysAHiZ2YnUA0c=; b=OLoPRs58l0DGzLp5YuD22iARilm4t9WSv9O4pdQA9SSoBdBfiavyGisYGbd1gGZwaxN2S YJ2j8Sqm/U37tF9G8x6m2uzra5lPtnyOes9b7d7WLV83YZ6Khf5t5V6LS4saP56fujqvy+M Fyk3wXnN5NhDVnJQwow7vtv3bp4ZdNfZM8FmCzEhCR1kFw1T9lc1PyziBZ++iU358X+IYvg dprqS38FmJUBlvovx3gYyHgevJAxstITyMrcHDyvTPZTRtn4g1gXmWpv+lgY2Ij0Zm1RUWm 8F0Tep9mWTBBq6PtFhKAJgVqTPllqq8ID+w0ctb24gfzXiZCTT5QvlNulTjg== X-Rspamd-Queue-Id: 4QsMYB5pGlz41V1 X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:23352, ipnet:103.2.140.0/22, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On 2023-06-29 16:03, Sha Faisal wrote: > Hello Andrew, > > The addr2line for the address points to, > > [sfaisal@svl-bsdx-02 /b/sfaisal/stable_main/src]$ addr2line -e > ../obj/arm64/juniper/kernels/JNPR-ARM64-WIT/kernel/kernel.full -f > 0xffff0000002244dc > > sched_add > > /b/sfaisal/stable_main/src/sys/kern/sched_ule.c:1309 > > Sched_setcpu is the exact function which calls > TDQ_LOCK(__mtx_lock_spin_flags) , and sched_setcpu is an inline called > from sched_add() What cpu is being passed in to sched_setcpu? Andrew From nobody Thu Jun 29 15:44:58 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4QsN7R0yjKz4kc1f for ; Thu, 29 Jun 2023 15:45:07 +0000 (UTC) (envelope-from sfaisal@juniper.net) Received: from mx0a-00273201.pphosted.com (mx0a-00273201.pphosted.com [208.84.65.16]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.pphosted.com", Issuer "Thawte RSA CA 2018" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4QsN7P6rk8z47V3 for ; Thu, 29 Jun 2023 15:45:05 +0000 (UTC) (envelope-from sfaisal@juniper.net) Authentication-Results: mx1.freebsd.org; none Received: from pps.filterd (m0108156.ppops.net [127.0.0.1]) by mx0a-00273201.pphosted.com (8.17.1.19/8.17.1.19) with ESMTP id 35TFcCED009996; Thu, 29 Jun 2023 08:45:03 -0700 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=juniper.net; h=from : to : cc : subject : date : message-id : references : in-reply-to : content-type : mime-version; s=PPS1017; bh=hI3siLXyJ6e3wN0p9XB7GOB+6BApOB44UOTgBUt5GF4=; b=cLGBFyclmxfClbtD3hGc3BbUDGIBW/sL54XciX1G+rYxy93s/hEOCQEMCLJ09sWGoVtl HJjdBlRthE+cV2d7UvzGVWbvQgZrHL/Bap+u6d8P/Nw0hsLrBaQFhz0MpNNNbpEjg3vz I6kv0qV2VuHhbMdefr2icMs9u+xqLekqPHf1GiS2oWKKu2vYRz6fxM368+FHoiRJv8Sc ySJ7y/dE38QQiQ5LKRfIMIVKohBIsIegc1Am4ZmwUTc+b3Ufz0dKORNH8+vQEr+Tf61g PINZS6g/FYZ79feQ4bSbGGgX31rG4s3tXUEAwWr0ywdontlSNwuHg38sO6YO8ZXO+thl mA== Received: from cy4pr02cu007.outbound.protection.outlook.com (mail-westcentralusazlp17011016.outbound.protection.outlook.com [40.93.6.16]) by mx0a-00273201.pphosted.com (PPS) with ESMTPS id 3rhcs800cm-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Thu, 29 Jun 2023 08:45:03 -0700 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=W7XXdm/ZrHWb0gyBVpN2jmMOZER63cYJjR8d3J6YwC1WeE5FNift22QLGowiqybpqmwMmKWxebTfF6wotHAIFVzC+gRr/SqYTtU7QyhR9A0e6kliEaya8IDtuGTqjrO1pGyEEYSeGZksUnjHpCxLC9qPzO2eDNLgssLfGVq46RNDgDd4zQK56KNvN6B1WKPRcgNmAugPFO0pMw5Q5boIwru2Appi9QVOINj1Yfc6hUyQlfGIE2NTZWNXpcbpdtyQP4QvyzNy5ICHGiSocz1Ua+kImYkm9CEDcbnVYJ6wmILIMbPUzKN67EP4k+wxSBVvM5CEruydgD8oELhk3BGShw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=hI3siLXyJ6e3wN0p9XB7GOB+6BApOB44UOTgBUt5GF4=; b=ezc58JsNdBlMzVRQ7euHgeg5H/nkyWEBlEfYCqnHJiq72lCZdpdqxSaSq9UhUChrUASw51MVt9j+a8JXadAlj2fdiNk5xaaKKsxesYxBEEMG7G3UVwmjqG75dxx4WZiFXNLyqdDZY9OyQbhVPBkEmG/Gv6GdMPIFS09+54NItqzvCRlUjCOqlNKkZaYWqaQAV93lnFgcg1qJXDzJxRHKO/KkW86252yG6qlfMNmKIavnLO+He8bQNg6j1atYSgnpSKV8OVgegdlmskfgFI7DmlAQW1gr1jmSAD2uv6wNPC92c9PZksyQdLjp/9dG/fohWtbsVVZQEg+RiaZ4ZILIXg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=juniper.net; dmarc=pass action=none header.from=juniper.net; dkim=pass header.d=juniper.net; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=juniper.net; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=hI3siLXyJ6e3wN0p9XB7GOB+6BApOB44UOTgBUt5GF4=; b=bvzpuTvAQ0vfSRlz29rntHvnCG7MRgxViGq/GlkB3fsmgVSrXlWuXUaKyjUyfNhWD+wj2t2jowb9Oz1vDlC9Jr95FTZRO4ppMHxrKtr2BTbd9xbRddz/66WMdAMmYPgxcrt+uN3dEo7JECehNoFWUZxphqGEl+0NCmguPPrNcIU= Received: from BYAPR05MB6677.namprd05.prod.outlook.com (2603:10b6:a03:ec::28) by SJ0PR05MB8150.namprd05.prod.outlook.com (2603:10b6:a03:390::10) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6521.23; Thu, 29 Jun 2023 15:44:59 +0000 Received: from BYAPR05MB6677.namprd05.prod.outlook.com ([fe80::65c0:5c8:b916:d4e1]) by BYAPR05MB6677.namprd05.prod.outlook.com ([fe80::65c0:5c8:b916:d4e1%4]) with mapi id 15.20.6521.026; Thu, 29 Jun 2023 15:44:58 +0000 From: Sha Faisal To: "andrew@fubar.geek.nz" CC: "freebsd-arm@FreeBSD.org" , Steve Kiernan , Mahesh Vardhamanaiah , Amit Verma Subject: Re: Kernel crash before login prompt Thread-Topic: Kernel crash before login prompt Thread-Index: AQHZqYguFdDezJe7q0OItnaHAyE0G6+gIhyygAAx4gCAADjn4YAA/1uAgAA2tE2AABtLgIAAA7fpgAAE8QCAAAatgA== Date: Thu, 29 Jun 2023 15:44:58 +0000 Message-ID: References: <6537067F-670A-4B52-87FA-FF2DBAD68120@fubar.geek.nz> <1327534fa4a1da584a3a38b194999595@fubar.geek.nz> In-Reply-To: <1327534fa4a1da584a3a38b194999595@fubar.geek.nz> Accept-Language: en-GB, en-US Content-Language: en-IN X-MS-Has-Attach: X-MS-TNEF-Correlator: msip_labels: MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Enabled=True;MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_SiteId=bea78b3c-4cdb-4130-854a-1d193232e5f4;MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_SetDate=2023-06-29T15:42:33.4997511Z;MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_ContentBits=0;MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Method=Standard x-ms-publictraffictype: Email x-ms-traffictypediagnostic: BYAPR05MB6677:EE_|SJ0PR05MB8150:EE_ x-ms-office365-filtering-correlation-id: 7e7a6e13-7e8d-474b-3245-08db78b7cb3e x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: qOuQjuc8b1gM8t5gszAeDx3xKwyvCHoZ7yU7S/iqz8mn4/exXhAK+EOB5YQR9l9tf0pSL4o/IOLx51/5uPP+U7JXyhhJvpqxpWkU+6ePEeZ2nNyN5obfbiUZQdXtbrwoTzUO5NpjQrK5uzlFGIOJeQVWORPNwE10rk3Ayy5eaC9o3oAEI41cedsXNe0dGr4rXA1gz2dzu2RAiryd5IIjwG9AfvY0hiu1utsKfCX5ZvG1y29Z4ueENKeNzmw97tCTz0PlMLREMt93F3UsKe2QyNS3ZPj5/2UdLx8idys3dm1rljyK6NtqnVthS7HWC2Dn4I49uyzbU8IhW+b5wNiAQsgRN7suKP671/l8OHtEDZqpA0MpQlzKHebX3rIjSgaOb9PiFulTAlrDlpLz7EjDFTcONCnEnuzH8OiwU+QM8pHiK7KX0S2pNpfhvsOcrCs6/UnltUr5QgKMSwGaz5MNc0bQaKj+2XEJS+Xpk+aJKceCSv/Xl1rc5ev1BySk+F9dSI/aDbCwqhAIox3x4NWxoLoNqdlHQscdUCgVgn+Sy0a714dEohePCbqJAkvgsRcr98WTCXnvQO3N2P3iHbuVURMzO1pld/2XCl3mcp3y8ZCnm4W8G49qi/XXElpgH4A3BiAlNvoKUMvT99hAfGsPbRX551lmCTMs/J4SdSwuzKc= x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:BYAPR05MB6677.namprd05.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230028)(4636009)(396003)(366004)(376002)(136003)(39860400002)(346002)(451199021)(66946007)(54906003)(7696005)(64756008)(186003)(91956017)(2906002)(9686003)(26005)(107886003)(66446008)(33656002)(6916009)(6506007)(71200400001)(66476007)(4326008)(52536014)(76116006)(316002)(66556008)(41300700001)(8676002)(5660300002)(122000001)(38100700002)(8936002)(478600001)(86362001)(55016003)(38070700005)(83380400001)(53546011);DIR:OUT;SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?Windows-1252?Q?/6ECVxSjouRws3hs/wL9yqQ9Z2Ee3+HZmhCNOFaZ67u7Rxqc9M6YR+aD?= =?Windows-1252?Q?e9AqytPlQMsXlQsB1lNVeOdALsEcAj0bisadlPf93hJC/PRdq9AE/mo5?= =?Windows-1252?Q?uXBraIERyq3rLe0liy1+1E4jBFRUlRWvnt5Jxw1/kDp5/UJSge5YSpru?= =?Windows-1252?Q?RvPEmdYnz2FECeXd2/1mh7E4gc4nqjugBhDQtZ/6UASAM9Jk3hWIqYo/?= =?Windows-1252?Q?Nt0rBkaxfJJcKmDecSxiObSAtBd0OUTX3joD0CGwo50nFp01fZAEk46K?= =?Windows-1252?Q?mFN7+Avc90IZbXxSZhV57a4n6EkUz7a7S7i8ffe5GX3dLSj6+QQ4Kz7M?= =?Windows-1252?Q?HdTaSLViImtR+BdQiEqqO2cRUWDNB0vu4X5c4XWNJ+0GyKIvYl3hwBQF?= =?Windows-1252?Q?ja2ElKc7L3/lwuy4R550e+ImHa3s3YeVPtgDaHWOa1TmPBsymLMSUvbL?= =?Windows-1252?Q?evIvmppPct6H4Vz8VSL10lWz9bQKlwS8hjY5k85jhbCgQ/D76qolcT1O?= =?Windows-1252?Q?MOB424oQ3D8M/DfwDMO+xdbLyW9Q2a0SHOAox38i8YKRzVtFkMD6Qc7+?= =?Windows-1252?Q?SGm8TwhM29lMUkpgzWeamh6TU1enHW91Wdfffa3kkRZ8AQE4YQ4aT2xR?= =?Windows-1252?Q?OQzYKpOA8NrsAXF6FJ2fWP9SgBIYOX0Of2oq7nLGjLKrh68je6oOMPNV?= =?Windows-1252?Q?PL9IjR8HATGki+ZhLIyekJxksjhYG49+6Zqc9LPiEvzzeW2S4peB1KGs?= =?Windows-1252?Q?zujTlWY/TgIEQxtaExEwXALCgd+vTwYBgzJ9R2GoggQeb3FLQlTGcLNA?= =?Windows-1252?Q?7y8Hnn979mOoBz9Klr4KMeftgTeX/f++VsjvKdNFnsmlR/boVGmk6fgH?= =?Windows-1252?Q?Ay0LkPiavpMzdiq5nJcTvLXz3hdJZjl4f2RDKi3EsEoiFWixusXaIAi0?= =?Windows-1252?Q?JUKDhphPjiAvN8YEVzk97bitmD+vtmZbObAxKKWca6SYgWQBpCin1Lof?= =?Windows-1252?Q?65ufmashRMe4HQD48BdtLGUDOj3ylsDR0T4F5ATQ5rZOOrPhx3FL8O74?= =?Windows-1252?Q?4g48h6fpDkxe/vDnUmMJgcy1hGRZ0a4PGJ+mbqQE92+nepfCCJwKHDao?= =?Windows-1252?Q?6KCJK6tAGsJBAqjD2Ffdh5K91C10Unkk6X3ACko3hRuumk54FXE8pCcM?= =?Windows-1252?Q?enBrrCSbWN5AcXhl0KjrJLgPQ8yEWy6YLamWsEF+sfhbqieilu7dk8mP?= =?Windows-1252?Q?hoeP5XV4ns3meOmKxEPb6bVfcHskF015PZoJcWWJ93y9Dv/0xXMBqKSR?= =?Windows-1252?Q?b37CQPvEFai9tH/n2ARwJ+074h8bIx4M+38qJtqfcMWkBuZZRle/nmCa?= =?Windows-1252?Q?v+ldTioAOL/1ZPv+glBNHbmb9LzpSkoPZr2Y9dF1CxX4TEKxF9otDYhq?= =?Windows-1252?Q?Ig50ShXYA7ZKftCkRkWOGnO75GGrZEeV0R2kmdOT0Kqv8ylOJLhAShVr?= =?Windows-1252?Q?urQ/EvPUQDFWCM7bv6H53HhDLdE3QPsIUP9AXRMXKZh3IfPCc2TLsw8g?= =?Windows-1252?Q?cQp0Kw57/+sGupplJh0ClQWiizkvisXcm3uJVAuVL2oDRDNPNzTUFUxm?= =?Windows-1252?Q?pIhNkGMuhyqrnUbM+9J47Z627R/CS3SMYhsWWh/MQC15ZRtpQwddWMt3?= =?Windows-1252?Q?m+/UQikoaprZTNvtFhrHnJ+SHuS/9LjP8yxqeIqjFVOqDG+0bnOHQw?= =?Windows-1252?Q?=3D=3D?= Content-Type: multipart/alternative; boundary="_000_BYAPR05MB6677FCD23054EF4D9CA0E4EAB725ABYAPR05MB6677namp_" List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: juniper.net X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: BYAPR05MB6677.namprd05.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 7e7a6e13-7e8d-474b-3245-08db78b7cb3e X-MS-Exchange-CrossTenant-originalarrivaltime: 29 Jun 2023 15:44:58.6800 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: bea78b3c-4cdb-4130-854a-1d193232e5f4 X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: Vwf3OaHrkAt2FEBD5CvNPbObumKWb5Yx4VBBGA70IFbp1lwf9IIz4ejrUhuyHpygYxLpOYCkP2603GINGo/8nA== X-MS-Exchange-Transport-CrossTenantHeadersStamped: SJ0PR05MB8150 X-Proofpoint-GUID: j54Z4CRMfksPlM2Q_2oAslRx8liAgPzD X-Proofpoint-ORIG-GUID: j54Z4CRMfksPlM2Q_2oAslRx8liAgPzD X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.254,Aquarius:18.0.957,Hydra:6.0.591,FMLib:17.11.176.26 definitions=2023-06-29_03,2023-06-27_01,2023-05-22_02 X-Proofpoint-Spam-Details: rule=outbound_spam_notspam policy=outbound_spam score=0 priorityscore=1501 bulkscore=0 clxscore=1015 malwarescore=0 phishscore=0 impostorscore=0 spamscore=0 mlxlogscore=912 suspectscore=0 mlxscore=0 adultscore=0 lowpriorityscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2305260000 definitions=main-2306290142 X-Rspamd-Queue-Id: 4QsN7P6rk8z47V3 X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:26211, ipnet:208.84.65.0/24, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N --_000_BYAPR05MB6677FCD23054EF4D9CA0E4EAB725ABYAPR05MB6677namp_ Content-Type: text/plain; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable The SoC has 4 CPU=92s, but we have restricted it to only one by disabling o= ther 3. So the cpu value should be 0, I can confirm, with a print, because we are n= ot getting the function frame for the functions calling __mtx_lock_spin_fla= gs Regards Faisal Juniper Business Use Only From: andrew@fubar.geek.nz Date: Thursday, 29 June 2023 at 20:49 To: Sha Faisal Cc: freebsd-arm@FreeBSD.org , Steve Kiernan , Mahesh Vardhamanaiah , Amit Verma Subject: Re: Kernel crash before login prompt [External Email. Be cautious of content] On 2023-06-29 16:03, Sha Faisal wrote: > Hello Andrew, > > The addr2line for the address points to, > > [sfaisal@svl-bsdx-02 /b/sfaisal/stable_main/src]$ addr2line -e > ../obj/arm64/juniper/kernels/JNPR-ARM64-WIT/kernel/kernel.full -f > 0xffff0000002244dc > > sched_add > > /b/sfaisal/stable_main/src/sys/kern/sched_ule.c:1309 > > Sched_setcpu is the exact function which calls > TDQ_LOCK(__mtx_lock_spin_flags) , and sched_setcpu is an inline called > from sched_add() What cpu is being passed in to sched_setcpu? Andrew --_000_BYAPR05MB6677FCD23054EF4D9CA0E4EAB725ABYAPR05MB6677namp_ Content-Type: text/html; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable

The SoC has 4 CPU=92s, but we have restricted it to only one by dis= abling other 3.

 

So the cpu value should be 0, I can confirm, with a print, because = we are not getting the function frame for the functions calling __mtx_lock_= spin_flags

 

Regards

Faisal

 


Juniper Business Use Only

From: andrew@fubar.= geek.nz <andrew@fubar.geek.nz>
Date: Thursday, 29 June 2023 at 20:49
To: Sha Faisal <sfaisal@juniper.net>
Cc: freebsd-arm@FreeBSD.org <freebsd-arm@freebsd.org>, Steve K= iernan <stevek@juniper.net>, Mahesh Vardhamanaiah <maheshmv@junipe= r.net>, Amit Verma <amitv@juniper.net>
Subject: Re: Kernel crash before login prompt

[External Email. Be= cautious of content]


On 2023-06-29 16:03, Sha Faisal wrote:
> Hello Andrew,
>
> The addr2line for the address points to,
>
> [sfaisal@svl-bsdx-02 /b/sfaisal/stable_main/src]$ addr2line -e
> ../obj/arm64/juniper/kernels/JNPR-ARM64-WIT/kernel/kernel.full -f
> 0xffff0000002244dc
>
> sched_add
>
> /b/sfaisal/stable_main/src/sys/kern/sched_ule.c:1309
>
> Sched_setcpu is the exact function which calls
> TDQ_LOCK(__mtx_lock_spin_flags) , and sched_setcpu is an inline called=
> from sched_add()

What cpu is being passed in to sched_setcpu?

Andrew

--_000_BYAPR05MB6677FCD23054EF4D9CA0E4EAB725ABYAPR05MB6677namp_-- From nobody Thu Jun 29 16:11:07 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4QsNjk27gjz4ksfj for ; Thu, 29 Jun 2023 16:11:22 +0000 (UTC) (envelope-from ekimyekim@gmail.com) Received: from mail-lj1-x22c.google.com (mail-lj1-x22c.google.com [IPv6:2a00:1450:4864:20::22c]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4QsNjj5BX5z4J9n for ; Thu, 29 Jun 2023 16:11:21 +0000 (UTC) (envelope-from ekimyekim@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20221208 header.b=n6TOHOqd; spf=pass (mx1.freebsd.org: domain of ekimyekim@gmail.com designates 2a00:1450:4864:20::22c as permitted sender) smtp.mailfrom=ekimyekim@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-lj1-x22c.google.com with SMTP id 38308e7fff4ca-2b69e6cce7dso13254601fa.2 for ; Thu, 29 Jun 2023 09:11:21 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1688055080; x=1690647080; h=to:subject:message-id:date:from:mime-version:from:to:cc:subject :date:message-id:reply-to; bh=D228KXEufVMSiVghoX73sbk0kfjdA5vie+zsmEoBrxQ=; b=n6TOHOqdoxci/OE1cJdmjYy8xKuSBccHa8iBSAtQQWfjubczkZP6ZmRDNFVrTFz4Vv aigRC1nzCWlfiMwLmDDn+/LysvmAmIxt1qUqW2vSU3yBHGTS7eiDjtz7q4k4HAx82/iz Zz9WW4j4pRxcwJf/MOYqC0gWTs8jtzsqcTkuLeAJ9omj0kZAMWw7yeMeFSqesXx8UcIR 03R9a6iAii5NKz+ntH7Q5XvekEg3N1eiU+Df56+ozSDHczecpq69iAKbzEpkzKkdoZau d5PM9EM/0SjocLJ3P2erC8/rQIKmF/4IZ7D5qzt5aJqIz2flsalHuuxKIYqDtUX62vMd lS0A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1688055080; x=1690647080; h=to:subject:message-id:date:from:mime-version:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=D228KXEufVMSiVghoX73sbk0kfjdA5vie+zsmEoBrxQ=; b=imWiFcgVYOYuaqLsKko1La2/1NerrtI8bZVw0CADf+aVkSXfm5aSk90mn2iVbRJcTa kvxrqF4lyU7exMJaty/17yhUs8nHEoaqXdEjcQbSmzpbkHWo8zH1Hg99uJiQtnqKWcoC 1fPB/7N3uC7yOYT0TyzOe/UsAJYC2l9nqszP6t1MMuK5EoACo2D3UBmbN1QZxL+CpN06 GjY2iXJP+Emxj5B9dTnqdmTITbxpHWohWsDn3KXpKhh4zVH0nlCezBcGw0x9QZ07TKrE IFlaGiN/Fgc5vYbl5zprTcKIfbmdMGVK3aHFyfLSXOAe5XxUhWN4X2cfdN2rltKYLluL IloQ== X-Gm-Message-State: ABy/qLbuyDYarAH3FFChZR09NI1n/kP464el869Cr47yRgqSGuNr/mny RAzichRSwrNlaBgLwz2Jedq8/EM7A50TKrhrt0bdUZtg X-Google-Smtp-Source: APBJJlGi1lhDpQ+h1yErA15ZYAfHkhQ2IQzhEFxHrMZnKXZVMkBq08rVAKyEo1fMGuFs4ES5TUwZoDtD+2eP79PxlnA= X-Received: by 2002:a05:651c:104a:b0:2b1:edfe:8171 with SMTP id x10-20020a05651c104a00b002b1edfe8171mr142909ljm.36.1688055079558; Thu, 29 Jun 2023 09:11:19 -0700 (PDT) List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 From: Michael P Date: Thu, 29 Jun 2023 09:11:07 -0700 Message-ID: Subject: cancelling subscription To: freebsd-arm@freebsd.org Content-Type: multipart/alternative; boundary="00000000000060e58905ff46f306" X-Spamd-Result: default: False [-2.03 / 15.00]; NEURAL_HAM_SHORT(-0.99)[-0.995]; NEURAL_HAM_LONG(-0.89)[-0.885]; NEURAL_SPAM_MEDIUM(0.85)[0.850]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20221208]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; MLMMJ_DEST(0.00)[freebsd-arm@freebsd.org]; ARC_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::22c:from]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MID_RHS_MATCH_FROMTLD(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FREEMAIL_FROM(0.00)[gmail.com]; FROM_HAS_DN(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; PREVIOUSLY_DELIVERED(0.00)[freebsd-arm@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; TO_DN_NONE(0.00)[]; RCVD_TLS_LAST(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-Rspamd-Queue-Id: 4QsNjj5BX5z4J9n X-Spamd-Bar: -- X-ThisMailContainsUnwantedMimeParts: N --00000000000060e58905ff46f306 Content-Type: text/plain; charset="UTF-8" Hello, I subscribed to this mailing list not long ago, thinking it was a list supporting FreeBSD on the Raspberry Pi. I find that it is not what I was looking for. I get emails constantly that are of no use to me. How do I unsubscribe from this list? Thanks, Michael Carmody ekimyekim@gmail.com --00000000000060e58905ff46f306 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hello,

I subscribed to this mailing lis= t not long ago, thinking it was a list supporting FreeBSD on the Raspberry = Pi.=C2=A0 I find that it is not what I was looking for. I get emails consta= ntly that are of no use to me.

How do I unsubscrib= e from this list?

Thanks,
Michael Carmod= y
--00000000000060e58905ff46f306-- From nobody Thu Jun 29 17:18:40 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4QsQCn2Tzbz4kLt4 for ; Thu, 29 Jun 2023 17:19:01 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic312-24.consmr.mail.gq1.yahoo.com (sonic312-24.consmr.mail.gq1.yahoo.com [98.137.69.205]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4QsQCm6kG6z3kTd for ; Thu, 29 Jun 2023 17:19:00 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1688059137; bh=pPXmHcEjZ6ZGjZRBZL8brbZ+atNDv/nJ+MnmnbuZeew=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=KDsVOVZZZgsWZEe9U39r8Q9KnpyJrSSuOmNGdrOTz7vKhghVjq5B24FKwaWw+7afGd+BcbM3U+44WxKPlVC/L1zTzoOb8WdXNI789CbDBwwjuyo9TxUOSrHRZR9ny1HmmGTifBNLSKwcVUGN7caTmahBxmeatfHn1nHVElppPEBLoX2fwKiEsXWzSiQA5/xu/y/T2OduUcN1Ek6G5JEUvKPYYh99vtUJrgmqJx74j8JYhntNKQYE+oQ+DrTqcQrOELnc6t8jyukATE2tsxnWpkh8u7hqhVcszVB+4lU1n6eUE+3SAqKK5T9JlrW39zDJZRb/3NG2IhToApy6Cod4lQ== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1688059137; bh=hkxX9C3p1Bl2GVc2H1nRBLHUyHmY+1shjN/yw85ETAY=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=GSABQLqbTR+O4TW/2M9SGW0D3+Yb6mWFwESJlKzjpj+EBlJlT8LajeI9MBFoXcNxZ4eWXGET8+OOYtUg2G34im+rOBF91Zrr8cqqpvn4Zw3jsdfj7iN+EVBh5W9/FAfh17/N6iPoVNY6eMe+ImR6LZoCCeohikciQ+g4NmrTJPVeRVMMw7fiuCKXmZf7ZNJje6gv63C5QzNExywYK8wxxA52C3k1CLEeEngPyj8iVB0ildxy+smuYbmk7w4oMzVl9Fb3XxtOA1YJKkN4VLiNaAlkaLpUPAgdjqaYaW1M8djC5f9JTynyLjruiFYLNjuTl6FKOKn4T1Rl7aK0gtmFuw== X-YMail-OSG: HShR.McVM1nyEJtAVVxZ65hg7gNkniDbBL0w54_hD.OJT3HlLpJURGCVMNuwwAu EXDattD4ccROAoDg88b0hKgLCW2JGyAUwnDaJLi5m6qEGYgElwrmsBX3RkJifbJcedv3YKaiTCMV ICnXJXJfMSXNVFb6rUTlWYq_Aqoa1F.OxXYKqRHuirm8oMmVi1_zhxcI.Gqa65dFCs7J_uzyAwWC S90cUGxQgkkHtkKkf0ZgGwGT0vXrtekXe1j5wa21sYnm036I0_xd3qZ1HPgYsPDUaknP3IuuZmJI 1ZLxROTuq_Jq5RJ7x4fIAUeKaHWsDpHPtZgm1X_KFkjH8L45Ff7rYH8AIDcxuSJ2IcLEfRuKne5N M8iNAphMeGjiBeoXvTKWrHjOXpPkLUjGN_umATKojn4YpCKOcSqt2fv2o2Cdoi61Hj0LWlWXJh_q XE971HWp0Dovba99JBxleWv7RTAB8z077Gn5WVyjZXl_90iZURSTgcjoem2v6gA6ZEJARbZgsJa2 jSxg6L4qB2MaGqZNUnk9u.DehWj4eVnfR4IwSt6ojqfWEFACLKffL0I2LO3Lfh8tAuqRAzHyP44y 7274LZmjez9qKZaMTYVdBWD6ojQKti_Lb2k2OcUpzZLuSg2aN5no0ifJGGB8Aym0C.P.09xmSV5c _70rjVCkXGTXFK3dYfFPNn62Wc_R.Ivf2ZZ4Qd3zbJuklph7RmHRu36xDhvh9lwtB29f6mdAd6YC PRKTymZWE6um9xDbg2xF2IWKR9KEFkF6d2wvJ26fIymT_Zkomx2tG8NfNLsu5KasFYFOUVA8hdFY AQPiVPNh2iX1BOZS7uv0JfehSA.qgOFpryz.psJBN5oc_8hn4mWuC7uCp2oz3VRDcqaN4WXV5TOw Bqgx0Z7Nd1aNF6QD_7hwhDZlQTKKYKktK_cPU1xsDhVT.3eI4jgXO0b9r5oSXpaqvEc2LJapFpwE v4rPwMYFkbiHG9hEszAm4q3HI68hJiBQXxz.LzTDd525fwDQ56PWubphcxgYYhHIlg7HJyLJ4icH 53HdqXhtpFYLlgbwnjVCJDXNnAy6BzUgb1s4Oh_I3X2S9D6PQN2BPEFVxuFjJwAExPNrDdg7UjSi b9WdjaRkQJmgHSirsCle1rJ9I3YighXDJ6Rd76BLcFj.ohzvuOEO_tsIZjc2jjPjWNpTmhGkHzuS CHjyvTD_ns_VIB2QoBD3JMWXt3iSJ0mavKNxBDwQXrCArsOPcCaoV5TZCqt4K2KGHRLdbbXjda8l pHXfe6ee20bpZg50xvykCeOrRHHK29eAgVGJXjF4eAaV5jxzjqfOnwbZXjx27he.nK46rnXoPJ9b 2WIBabI1qMUV4rnaTK1K_RbfFny6qftiB3vDNFE8s_0p.5objpoqMIuMdlWuyJknH8eTj7ceBGgg AE69y0fX5GLuUQyAtk5IjucF4L5s28_ARItSA2ydSi4gsRgBnQIBE3TDhfzintU1BZ8ARQG_hnFl IpdZ2pXy9vI3uDcn2urOp3GKbSBKDdabC0pAKMp1WSq1_HDHsQQg1RwJzXLAOHVYNTK0O6XEExGY 4amFMfaw4xXTumXnHAKIpnEnuBlQ04z3QGjyl8_6ydIgv.BiI3kKmtkK3F3V_UMna_RInCfoWYY5 kxr3XtC3Jq1wQ0zbtq5tTbQaQRM71qwHjtOwbKOyp3G6wGZFgHELNAhWxbeKgXDYQuO4ygqWVytB PufdOXZDyLurQKc0yuMCWG7H4jPJFWGikr3TqOAzf.bjpF8gDzrCWuABCd7i4tFG1znaQ0MK4M9w RrVMIr9f0dofbgR.KZbVMKBibP_2mxTBQ1AGoLoKplEioRPLQDHCo.yn8Bn0xHtK77bW3QDO0amO oiyU0upEPNOrcHGfDBCdNmpvzsxFwXr78ljziJHrnq.0Bb972WWTQ3ggAWoQ9THCWk1Xj5HgybLP DkUaL0ExyFT2Y0QBTq1ldVM66HauC_NwIJEx9GtrUeqnSe11LauX.TjWFxuAN_9oHSfX.DcOKK6O Tp7FcjphKo4UUfM6hcRSGuOmmEviQIOV7rYx6Ysa20sbez385cf0m6yZAhQZ4TLgvXrJ1jiHNdO6 1eag9vEDVJCon3LtXDGo2sq473Rxj7Ivses8.ail6andIRZuhG.DD6lUFWPb1mQ7UuhJ6YgxSI4C rkkbJKl.X6ifPscDvKn6x9.Ac7xiUhYnLKo5bdMMMOIa5FycVaD5kICgux6IgwsXjnsJQ2byKi7_ JV09iqWkRb3erFWiQRlGa471ZMemRT88nPnR68eWh3Fd39jAD.wntgE392.8hwajONPoAunpfNVp C X-Sonic-MF: X-Sonic-ID: dd796f8f-c84a-4086-843d-db3d2c73c053 Received: from sonic.gate.mail.ne1.yahoo.com by sonic312.consmr.mail.gq1.yahoo.com with HTTP; Thu, 29 Jun 2023 17:18:57 +0000 Received: by hermes--production-bf1-5d96b4b9f-lngg9 (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID e07b988fd8796165bca18dcc5614ccd0; Thu, 29 Jun 2023 17:18:52 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.600.7\)) Subject: Re: cancelling subscription From: Mark Millard In-Reply-To: Date: Thu, 29 Jun 2023 10:18:40 -0700 Cc: freebsd-arm@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <2B6B8CF6-D9B4-4E02-8C02-C1174879736B@yahoo.com> References: To: Michael P X-Mailer: Apple Mail (2.3731.600.7) X-Rspamd-Queue-Id: 4QsQCm6kG6z3kTd X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On Jun 29, 2023, at 09:11, Michael P wrote: Hello, > I subscribed to this mailing list not long ago, thinking it was a list = supporting FreeBSD on the Raspberry Pi. I find that it is not what I = was looking for. I get emails constantly that are of no use to me. freebsd-arm is the primary list that spans such. None are limited to RPi*'s. So, probably, no FreeBSD list meets your criteria. > How do I unsubscribe from this list? https://lists.freebsd.org/subscription/freebsd-arm has both the various subscribe links and the various unsubscribe links, as well as a user input and buttons for such. =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Thu Jun 29 17:35:18 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4QsQZh1D8vz4kX6m for ; Thu, 29 Jun 2023 17:35:24 +0000 (UTC) (envelope-from sfaisal@juniper.net) Received: from mx0b-00273201.pphosted.com (mx0b-00273201.pphosted.com [67.231.152.164]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.pphosted.com", Issuer "Thawte RSA CA 2018" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4QsQZg1dXRz3pk2 for ; Thu, 29 Jun 2023 17:35:23 +0000 (UTC) (envelope-from sfaisal@juniper.net) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=juniper.net header.s=PPS1017 header.b=nxkXcTo0; dkim=pass header.d=juniper.net header.s=selector1 header.b=iWCooHaK; spf=pass (mx1.freebsd.org: domain of sfaisal@juniper.net designates 67.231.152.164 as permitted sender) smtp.mailfrom=sfaisal@juniper.net; dmarc=pass (policy=reject) header.from=juniper.net; arc=pass ("microsoft.com:s=arcselector9901:i=1") Received: from pps.filterd (m0108160.ppops.net [127.0.0.1]) by mx0b-00273201.pphosted.com (8.17.1.19/8.17.1.19) with ESMTP id 35TGKo3x003627; Thu, 29 Jun 2023 10:35:22 -0700 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=juniper.net; h=from : to : cc : subject : date : message-id : references : in-reply-to : content-type : mime-version; s=PPS1017; bh=BundBgXJyY7d3oYsi2Z2uq+TCUaYWAIs7KXzAfcFwAA=; b=nxkXcTo0AAR61Y1xPPR8tDEY9dnkSeFp3X9U5T25E4f55PqNaps8ZJ+/Tj/BD7miJSH6 1z4u6xIfsBg32CWfNJcQl19gPZBwjSEzBvwwvG9kyKK63HCegotpF1Z1wGxSusPYsuDw lW46l6sZkOF/9p+nLM6UsfhbS+eg1pfmDl64qRUa/GBTu2QyeNTheVMFjI5n9ecNoDxj pE3Q9f7A3y922vgkzgzN+P6MD915c652DzlT4txQiVsveuMrGAIjCicsKJ27ZgCTG2uV vakVEfK0Pl4mn7YUmsisDD1v/rm+bngzwd42fkekWZOebytl+bWruxM4e6s3qr2EIdqB cQ== Received: from bl0pr02cu006.outbound.protection.outlook.com (mail-eastusazlp17013033.outbound.protection.outlook.com [40.93.11.33]) by mx0b-00273201.pphosted.com (PPS) with ESMTPS id 3rh2229s0k-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Thu, 29 Jun 2023 10:35:21 -0700 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=jHrPJmIl+S7rii7CunBhDkBn0G81mpZYnjgJanmtOpVk4YSbgJk6G2R0eef5tbR/lEqAlkXxxubtUZwkZxewFZbG8Ry/Fe32mQVNonT4v0MK3u1fhH5PBYeAPyHs5Hsf00Hn8uV47YfbICjV5QfG4xQYwhdlc2whK7NihUAyBz7Uu4gb8iv+5RjEN5iaPoYH4WbcfX29Z6jGd538GbepyiM0vGOQ0WKQ3br6lNqBPV4NjSSCyZYhagii+GEyG/u+lWP971uVhz91x+j/7eu1WTyiBv/6VgvujTPVJj1154u1htsam6npEyLx53tV4eDHlxDl5P2KzPmgpJLko5bwwQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=BundBgXJyY7d3oYsi2Z2uq+TCUaYWAIs7KXzAfcFwAA=; b=OGg39c9PKV+K7R6kxOiZQvioih+1OsaS0c+Nw25QsWGXLuOBM57eC6TweMEsocH1XVZJnWrFCVk2NmDfmoV8thuz8pZgGoUP3VVaDqmI7hi83SBSrlKVJdFtTb+Sh/RfJHavup+pQsH/84yDKYbjzr9T2gJu6rLT2uXWzvSqRukRyooZo9KmW2fTMqhM5Seo7n5YGhXEAa59REWGWjR7o7T8+1QvASRNVE30ZPSmvSW3wqEK8Jv3FudG1wp4WdjAsLdV7rPU9UsWoM7VlqZcc62h3PbDAIZSMOEpegNEaYVSCJbeMlvZ6JpylKJzJNavfBF0VyFPvKr51Fa6mJDkhg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=juniper.net; dmarc=pass action=none header.from=juniper.net; dkim=pass header.d=juniper.net; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=juniper.net; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=BundBgXJyY7d3oYsi2Z2uq+TCUaYWAIs7KXzAfcFwAA=; b=iWCooHaKTMvblUyRWe5ZjTQ9PQYvEj58HXZ+gDkxJJrDvafw9BZiIvbwnvKYhJmK0DCQ7oCHRsLEEvRJ9ci1huBZnhAnpMCWXBEF6OzgKpgGQdukPh8qI7LGesI/aGlIDlWgW24cRiEaIBj6+zQbeLvmtYgA7RYO5oleI6dbwGw= Received: from BYAPR05MB6677.namprd05.prod.outlook.com (2603:10b6:a03:ec::28) by PH7PR05MB9353.namprd05.prod.outlook.com (2603:10b6:510:1a7::16) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6521.21; Thu, 29 Jun 2023 17:35:19 +0000 Received: from BYAPR05MB6677.namprd05.prod.outlook.com ([fe80::65c0:5c8:b916:d4e1]) by BYAPR05MB6677.namprd05.prod.outlook.com ([fe80::65c0:5c8:b916:d4e1%4]) with mapi id 15.20.6521.026; Thu, 29 Jun 2023 17:35:18 +0000 From: Sha Faisal To: "andrew@fubar.geek.nz" CC: "freebsd-arm@FreeBSD.org" , Steve Kiernan , Mahesh Vardhamanaiah , Amit Verma Subject: Re: Kernel crash before login prompt Thread-Topic: Kernel crash before login prompt Thread-Index: AQHZqYguFdDezJe7q0OItnaHAyE0G6+gIhyygAAx4gCAADjn4YAA/1uAgAA2tE2AABtLgIAAA7fpgAAE8QCAAAatgIAAHk8C Date: Thu, 29 Jun 2023 17:35:18 +0000 Message-ID: References: <6537067F-670A-4B52-87FA-FF2DBAD68120@fubar.geek.nz> <1327534fa4a1da584a3a38b194999595@fubar.geek.nz> In-Reply-To: Accept-Language: en-GB, en-US Content-Language: en-IN X-MS-Has-Attach: yes X-MS-TNEF-Correlator: msip_labels: MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Enabled=True;MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_SiteId=bea78b3c-4cdb-4130-854a-1d193232e5f4;MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_SetDate=2023-06-29T15:42:33.4997511Z;MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_ContentBits=0;MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Method=Standard x-ms-publictraffictype: Email x-ms-traffictypediagnostic: BYAPR05MB6677:EE_|PH7PR05MB9353:EE_ x-ms-office365-filtering-correlation-id: d822bdbb-cc6a-47c8-d429-08db78c7352c x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: U9KFJ1PbPMNLGPMGhMgjfIKwvBvr0+qY++mQSGG9A3qJHzRfgINKrZlC60yznjDSDPjU9q9+7nJmgxqNHb5YSq1xXc0Smdft01OPMPUora+O0c7SYNA1En/vR2yLSBD9YXEprbngX7gIPIyLET9Ua4XQ5KI4hET2rH+Gs/8wru6YMxOmpyu2Wow2IayMU6tNTdXl6bLuk85E0uvqqbpHTXJ6HzhsVRW0zdM7kTT2zwGPu5EWSzQzldBOiV7z/kjGJASDmCLz4V6XvvZFKAnEgV1ctJooiLqJcsEmLDrzbELvI8ipAjH7yR28ibL7lAPR6WXokA99hxzxHxFzYCFUsoFpBi0jP8dFkitRUXLxIZEXtx/70Ds2Rrwhx79UjjY13ydvtQe6PO/BoDmuRMxNsDbykRVbfpwnNAxg7ilHyFStsUXoQxBYH3PPLjukd5DnLBPfkCLnIUVNKbBoCE9qQjMBlLfSCaOzyiWzoufJ6AzWtiFtvUR2IMy5icGwLK/ATDBYk1SeKgyHIiwerO7+tIEOFhhU/KaYYH7BUt74rq1RbHVSuyaiq3c+R7HujQR3M8C/jTfweBsSeiKMHy05qBxa4KDauas86gZfzcORThA= x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:BYAPR05MB6677.namprd05.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230028)(4636009)(136003)(376002)(346002)(39860400002)(366004)(396003)(451199021)(83380400001)(71200400001)(52536014)(316002)(7696005)(8676002)(4326008)(8936002)(9326002)(41300700001)(33656002)(54906003)(55016003)(122000001)(86362001)(99936003)(38100700002)(9686003)(64756008)(66556008)(66446008)(5660300002)(66946007)(66476007)(6916009)(478600001)(2906002)(2940100002)(91956017)(186003)(76116006)(26005)(38070700005)(107886003)(53546011)(6506007);DIR:OUT;SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?Windows-1252?Q?FgGdO8Q56W76obuEuhj30AI3WZS1SQxCacFriUXK21nBhE4YeKtcrXZf?= =?Windows-1252?Q?6Df2RONzftZTHdcgWg4qnKQ9R7KvhiFBkSlsQx8Kj8ws3UrFO2y4xg4r?= =?Windows-1252?Q?QLIn7pHjBUF3bjmH0sfdp1Xnq57qO1Qe1WsMre7wK8qJzSJE4lhrzYZZ?= =?Windows-1252?Q?qKaOKpQOT1Y/soYO2bXBDdnd05C2ZNjaLyO6qTvmWtuGfnYaDYbKKiyK?= =?Windows-1252?Q?Pns6LyE69PLttHncXG7Riw6peWHxYVssx1oHFLYK5cJcK1TeBjaedXxD?= =?Windows-1252?Q?G3us59IFbLGa2elquMsPRjKZo87mr9JfBYqDjOp285t0Eu+lBNk7AMcG?= =?Windows-1252?Q?QftKk6uzTJ77FhCfIEd9//wWIX7g59oqKijEgXKn9UvSWDSodGxXHrMw?= =?Windows-1252?Q?yv+2yjFIZVZ7Flp2XZaLG+81uG3MXvSVwBgTrhKbB81RF3udNSRyozRa?= =?Windows-1252?Q?R90HsX4JgxmQUMJK1uYmOHheY2+qPs6uQaRrGy6vAIMA35lKV5X897kv?= =?Windows-1252?Q?xvQaRU4Qos7HsEA4vax2pwjc7fRXq4Fz2IP2Ij85kmlivhONUGdGeHWY?= =?Windows-1252?Q?mMOsKlE/vzprNnh4lZlK6XoTEjnhLJaRHavtbcEi37lF04anL4l0lU+w?= =?Windows-1252?Q?znhyABgUDmUTooUOT3dCe5vf2XdiGNv6RwTLt92Wn3mwwbnVnqiqA0mA?= =?Windows-1252?Q?pEg6jsopmeQPROmB3fa4NP3WTEl8FGHs4cqS7aF6Awa+W3BFLph2D0RY?= =?Windows-1252?Q?0p+J3laJeCNo/6mCPL/Hw2CLHY3J6Hj9nmQVMfR2W9hm0YUwnNKvvrEe?= =?Windows-1252?Q?sxZwYIyGBTUUmYCp8macnkssUTpqdbsObeY6xmcYzStlS0QZWg6vbRhE?= =?Windows-1252?Q?fJgoml/xeGHVJAb27nmyNEm66ohbWkF7phyHC6iaZnsS4blGyNSaSHJU?= =?Windows-1252?Q?AxwDhGyWXu4bKeSBbkTuxSN79HYYyBCbfLRYjjdWioowSwUvnJ74UQm0?= =?Windows-1252?Q?Q1eh6pcKGfwt9f5JyWLenxnJ3vmnOCSJaB9KmLoISYEcsCib1raMNeEl?= =?Windows-1252?Q?VMMe7Wj1b1p8Xk+XG0R7fn9+q4txhZkY4PeJgVrGHh68kDdftvZ38ANu?= =?Windows-1252?Q?KOAR4gFEZMIg98y4rMXg5neVjjrAgGI0T7shNiXmi+8Duy5dbrZ6WLHI?= =?Windows-1252?Q?Tpc8o5ImBfULl6QHdb59PccTNDYK4+RUot82ZMjTkL1R03lT/U9tkc6O?= =?Windows-1252?Q?waBShsP38Xtg81vS+f3RPWjAUUAxxZG1c31K+aBWhueEhlsxtdbDNSxg?= =?Windows-1252?Q?/OxCaIJMsCM2C7mUsDlwsx4Ok0ao+mBH5gZjTDKTW0681PcG/FcEj+ZG?= =?Windows-1252?Q?jmRnhGD9A5Gkc/21FvGoG2DI5yQvsg20OG2nqQu9YZ6P0Gr6zv1ujkJd?= =?Windows-1252?Q?/BDRyWjm7weZRS7tgBw+vKYDq497hi9Z410H8Ws7GbhNi7AlVYdeNWJU?= =?Windows-1252?Q?RoL/i7xfaBeOeiCf9nr+JVXlk5YxFH61fMxpHoY3kzjP+oEy6ypv4X0w?= =?Windows-1252?Q?zOy941VE5v3QqaVbPr/b0EIgv6zFBmj5ZV3ZlWjlMq78ewcXENEXMJsu?= =?Windows-1252?Q?sJu7FsLYcXHPJh8bZLWBXyDXVY9rMIHWGn4KKaAEKLuK1ILQA6zoHTfo?= =?Windows-1252?Q?kvJi2vpYcFr4VXWphn6vcWrsfaKZdO+z2qS1je2eVu15Fj2ZAOV/3g?= =?Windows-1252?Q?=3D=3D?= Content-Type: multipart/mixed; boundary="_004_BYAPR05MB6677FCA278A0C5FED1B9B423B725ABYAPR05MB6677namp_" List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: juniper.net X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: BYAPR05MB6677.namprd05.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: d822bdbb-cc6a-47c8-d429-08db78c7352c X-MS-Exchange-CrossTenant-originalarrivaltime: 29 Jun 2023 17:35:18.8812 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: bea78b3c-4cdb-4130-854a-1d193232e5f4 X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: QbqsuB6DF1fqnrw/ExQcc1hYRB2t+8UhfLn/7qvCb2pFMGWY4/y3K1b3Nueq7Ajx4pH8wW5CKmqVjmh0VV82gw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: PH7PR05MB9353 X-Proofpoint-GUID: Irtwr1xxdAVwKz6_ni0og9ZwwZMubKrb X-Proofpoint-ORIG-GUID: Irtwr1xxdAVwKz6_ni0og9ZwwZMubKrb X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.254,Aquarius:18.0.957,Hydra:6.0.591,FMLib:17.11.176.26 definitions=2023-06-29_05,2023-06-27_01,2023-05-22_02 X-Proofpoint-Spam-Details: rule=outbound_spam_notspam policy=outbound_spam score=0 mlxscore=0 mlxlogscore=999 clxscore=1015 phishscore=0 malwarescore=0 lowpriorityscore=0 impostorscore=0 spamscore=0 adultscore=0 bulkscore=0 priorityscore=1501 suspectscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2305260000 definitions=main-2306290159 X-Spamd-Result: default: False [-5.05 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.95)[-0.945]; DMARC_POLICY_ALLOW(-0.50)[juniper.net,reject]; R_DKIM_ALLOW(-0.20)[juniper.net:s=PPS1017,juniper.net:s=selector1]; R_SPF_ALLOW(-0.20)[+ip4:67.231.152.164]; MIME_GOOD(-0.10)[multipart/mixed,multipart/alternative,text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[67.231.152.164:from]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~,4:~]; ASN(0.00)[asn:22843, ipnet:67.231.152.0/24, country:US]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MLMMJ_DEST(0.00)[freebsd-arm@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[40.93.11.33:received]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCPT_COUNT_FIVE(0.00)[5]; RCVD_COUNT_FIVE(0.00)[5]; DKIM_TRACE(0.00)[juniper.net:+]; FROM_HAS_DN(0.00)[]; HAS_ATTACHMENT(0.00)[]; TO_DN_SOME(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[] X-Rspamd-Queue-Id: 4QsQZg1dXRz3pk2 X-Spamd-Bar: ----- X-ThisMailContainsUnwantedMimeParts: N --_004_BYAPR05MB6677FCA278A0C5FED1B9B423B725ABYAPR05MB6677namp_ Content-Type: multipart/alternative; boundary="_000_BYAPR05MB6677FCA278A0C5FED1B9B423B725ABYAPR05MB6677namp_" --_000_BYAPR05MB6677FCA278A0C5FED1B9B423B725ABYAPR05MB6677namp_ Content-Type: text/plain; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable Hello Andrew, We enabled all the 4cpu=92s and attached is the log, Just before the crash we are observing cpu =3D -65536 in sched_add, attache= d is the complete log for your reference. -----In sched_add and td =3D 0xffff000041db6260, cpu=3D-65536, flags =3D 0x= 4 Regards Faisal Juniper Business Use Only From: Sha Faisal Date: Thursday, 29 June 2023 at 21:15 To: andrew@fubar.geek.nz Cc: freebsd-arm@FreeBSD.org , Steve Kiernan , Mahesh Vardhamanaiah , Amit Verma Subject: Re: Kernel crash before login prompt The SoC has 4 CPU=92s, but we have restricted it to only one by disabling o= ther 3. So the cpu value should be 0, I can confirm, with a print, because we are n= ot getting the function frame for the functions calling __mtx_lock_spin_fla= gs Regards Faisal From: andrew@fubar.geek.nz Date: Thursday, 29 June 2023 at 20:49 To: Sha Faisal Cc: freebsd-arm@FreeBSD.org , Steve Kiernan , Mahesh Vardhamanaiah , Amit Verma Subject: Re: Kernel crash before login prompt [External Email. Be cautious of content] On 2023-06-29 16:03, Sha Faisal wrote: > Hello Andrew, > > The addr2line for the address points to, > > [sfaisal@svl-bsdx-02 /b/sfaisal/stable_main/src]$ addr2line -e > ../obj/arm64/juniper/kernels/JNPR-ARM64-WIT/kernel/kernel.full -f > 0xffff0000002244dc > > sched_add > > /b/sfaisal/stable_main/src/sys/kern/sched_ule.c:1309 > > Sched_setcpu is the exact function which calls > TDQ_LOCK(__mtx_lock_spin_flags) , and sched_setcpu is an inline called > from sched_add() What cpu is being passed in to sched_setcpu? Andrew --_000_BYAPR05MB6677FCA278A0C5FED1B9B423B725ABYAPR05MB6677namp_ Content-Type: text/html; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable

Hello Andrew,

We enabled all the 4cpu=92s and attached is the log,

Just before the crash we are observing cpu =3D -65536 in sched_add,= attached is the complete log for your reference.

 

-----In sched_add and td =3D 0xffff000041db6260, cpu=3D-65536, flag= s =3D 0x4

 

Regards

Faisal

 


Juniper Business Use Only

From: Sha Faisal &l= t;sfaisal@juniper.net>
Date: Thursday, 29 June 2023 at 21:15
To: andrew@fubar.geek.nz <andrew@fubar.geek.nz>
Cc: freebsd-arm@FreeBSD.org <freebsd-arm@freebsd.org>, Steve K= iernan <stevek@juniper.net>, Mahesh Vardhamanaiah <maheshmv@junipe= r.net>, Amit Verma <amitv@juniper.net>
Subject: Re: Kernel crash before login prompt

The SoC has 4 CPU=92s, but we have restricted it to only one by dis= abling other 3.

 

So the cpu value should be 0, I can confirm, with a print, because = we are not getting the function frame for the functions calling __mtx_lock_= spin_flags

 

Regards

Faisal

 

From: andrew@fubar.geek.n= z <andrew@fubar.geek.nz>
Date: Thursday, 29 June 2023 at 20:49
To: Sha Faisal <sfaisal@juniper.net>
Cc: freebsd-arm@FreeBSD.org <freebsd-arm@freebsd.org>, Steve K= iernan <stevek@juniper.net>, Mahesh Vardhamanaiah <maheshmv@junipe= r.net>, Amit Verma <amitv@juniper.net>
Subject: Re: Kernel crash before login prompt

[External Email. Be= cautious of content]


On 2023-06-29 16:03, Sha Faisal wrote:
> Hello Andrew,
>
> The addr2line for the address points to,
>
> [sfaisal@svl-bsdx-02 /b/sfaisal/stable_main/src]$ addr2line -e
> ../obj/arm64/juniper/kernels/JNPR-ARM64-WIT/kernel/kernel.full -f
> 0xffff0000002244dc
>
> sched_add
>
> /b/sfaisal/stable_main/src/sys/kern/sched_ule.c:1309
>
> Sched_setcpu is the exact function which calls
> TDQ_LOCK(__mtx_lock_spin_flags) , and sched_setcpu is an inline called=
> from sched_add()

What cpu is being passed in to sched_setcpu?

Andrew

--_000_BYAPR05MB6677FCA278A0C5FED1B9B423B725ABYAPR05MB6677namp_-- --_004_BYAPR05MB6677FCA278A0C5FED1B9B423B725ABYAPR05MB6677namp_ Content-Type: application/rtf; name="main_kernel_crash_2.rtf" Content-Description: main_kernel_crash_2.rtf Content-Disposition: attachment; filename="main_kernel_crash_2.rtf"; size=25356; creation-date="Thu, 29 Jun 2023 17:35:17 GMT"; modification-date="Thu, 29 Jun 2023 17:35:17 GMT" Content-Transfer-Encoding: base64 e1xydGYxXGFuc2lcYW5zaWNwZzEyNTJcY29jb2FydGYyNjM5Clxjb2NvYXRleHRzY2FsaW5nMFxj b2NvYXBsYXRmb3JtMHtcZm9udHRibFxmMFxmbmlsXGZjaGFyc2V0MCBNZW5sby1SZWd1bGFyO30K e1xjb2xvcnRibDtccmVkMjU1XGdyZWVuMjU1XGJsdWUyNTU7XHJlZDBcZ3JlZW4wXGJsdWUwO30K e1wqXGV4cGFuZGVkY29sb3J0Ymw7O1xjc2dyYXlcYzA7fQpccGFwZXJ3MTE5MDBccGFwZXJoMTY4 NDBcbWFyZ2wxNDQwXG1hcmdyMTQ0MFx2aWV3dzM4MjAwXHZpZXdoMTgwMjBcdmlld2tpbmQwClxw YXJkXHR4NTYwXHR4MTEyMFx0eDE2ODBcdHgyMjQwXHR4MjgwMFx0eDMzNjBcdHgzOTIwXHR4NDQ4 MFx0eDUwNDBcdHg1NjAwXHR4NjE2MFx0eDY3MjBccGFyZGlybmF0dXJhbFxwYXJ0aWdodGVuZmFj dG9yMAoKXGYwXGZzMzggXGNmMiBcQ29jb2FMaWdhdHVyZTAgQm9vdGluZyBmcm9tIG5vbi1yZWNv dmVyeSBzbmFwc2hvdCBuZXdvcyAuLi5cClZlcmlmaWVkIC9ib290L21hbmlmZXN0IHNpZ25lZCBi eSBQYWNrYWdlRGV2ZWxvcG1lbnRFQ1AyNTZfMjAyM1wKfFwKVmVyaWZpZWQgL3BhY2thZ2VzL3Nl dHMvbmV3b3MvYm9vdC9vcy1jcnlwdG8vLi4vbWFuaWZlc3Qgc2lnbmVkIGJ5IFBhY2thZ2VEZXZl bG9wbWVudEVDUDI1Nl8yMDIzXApWZXJpZmllZCAvcGFja2FnZXMvc2V0cy9uZXdvcy9ib290L29z LWtlcm5lbC8uLi9tYW5pZmVzdCBzaWduZWQgYnkgUGFja2FnZURldmVsb3BtZW50RUNQMjU2XzIw MjNcClZlcmlmaWVkIC9wYWNrYWdlcy9zZXRzL25ld29zL2Jvb3Qvb3MtbW9kdWxlcy1uZXQvLi4v bWFuaWZlc3Qgc2lnbmVkIGJ5IFBhY2thZ2VEZXZlbG9wbWVudEVDUDI1Nl8yMDIzXApWZXJpZmll ZCAvcGFja2FnZXMvc2V0cy9uZXdvcy9ib290L25ldHN0YWNrLy4uL21hbmlmZXN0IHNpZ25lZCBi eSBQYWNrYWdlRGV2ZWxvcG1lbnRFQ1AyNTZfMjAyM1wKL3BhY2thZ2VzL3NldHMvbmV3b3MvYm9v dC9vcy1rZXJuZWwva2VybmVsIHRleHQ9MHgyYTggdGV4dD0weDQxODFhMCB0ZXh0PTB4MTQyMzRj IGRhdGE9MHgxMmI4NTAgZGF0YT0weDArMHgxN2NkMDAwIHN5bXM9WzB4OCsweGFjZTc4KzB4OCsw eDk4ODZkXVwKVmVyaWZpZWQgL3BhY2thZ2VzL3NldHMvbmV3b3MvYm9vdC9vcy1rZXJuZWwva2Vy bmVsXAovcGFja2FnZXMvc2V0cy9uZXdvcy9ib290L29zLWtlcm5lbC9hY3gtNzEwLmR0YiBzaXpl PTB4NWZkNVwKVmVyaWZpZWQgL3BhY2thZ2VzL3NldHMvbmV3b3MvYm9vdC9vcy1rZXJuZWwvYWN4 LTcxMC5kdGJcCi9wYWNrYWdlcy9zZXRzL25ld29zL2Jvb3Qvb3MtY3J5cHRvL2NyeXB0by5rbyB0 ZXh0PTB4MTFkM2MgdGV4dD0weDJkYTY0IGRhdGE9MHgxYzg4KzB4MTE4IHN5bXM9WzB4OCsweDU3 OTArMHg4KzB4MzUyN11cClZlcmlmaWVkIC9wYWNrYWdlcy9zZXRzL25ld29zL2Jvb3Qvb3MtY3J5 cHRvL2NyeXB0by5rb1wKL3BhY2thZ2VzL3NldHMvbmV3b3MvYm9vdC9vcy1rZXJuZWwvY29udGVu dHMuaXpvIHNpemU9MHg5Y2Q2MDBcClZlcmlmaWVkIC9wYWNrYWdlcy9zZXRzL25ld29zL2Jvb3Qv b3Mta2VybmVsL2NvbnRlbnRzLml6b1wKL3BhY2thZ2VzL3NldHMvbmV3b3MvYm9vdC9vcy1rZXJu ZWwvaXByb2NfbWRpb19tdXgua28gdGV4dD0weDE0MDIgdGV4dD0weDdhYyBkYXRhPTB4NGYwIHN5 bXM9WzB4OCsweGE4MCsweDgrMHg3N2FdXApWZXJpZmllZCAvcGFja2FnZXMvc2V0cy9uZXdvcy9i b290L29zLWtlcm5lbC9pcHJvY19tZGlvX211eC5rb1wKL3BhY2thZ2VzL3NldHMvbmV3b3MvYm9v dC9vcy1tb2R1bGVzLW5ldC9pZmxpYi5rbyB0ZXh0PTB4ODllMyB0ZXh0PTB4ZDRkYyBkYXRhPTB4 MTQxOCsweDg4IHN5bXM9WzB4OCsweDMyZDArMHg4KzB4MjJlMF1cClZlcmlmaWVkIC9wYWNrYWdl cy9zZXRzL25ld29zL2Jvb3Qvb3MtbW9kdWxlcy1uZXQvaWZsaWIua29cCi9wYWNrYWdlcy9zZXRz L25ld29zL2Jvb3Qvb3MtbW9kdWxlcy1uZXQvbWlpYnVzLmtvIHRleHQ9MHhhYjg4IHRleHQ9MHgx NTI3OCBkYXRhPTB4M2JhMCBzeW1zPVsweDgrMHg2MzYwKzB4OCsweDNhZDBdXApWZXJpZmllZCAv cGFja2FnZXMvc2V0cy9uZXdvcy9ib290L29zLW1vZHVsZXMtbmV0L21paWJ1cy5rb1wKL3BhY2th Z2VzL3NldHMvbmV3b3MvYm9vdC9vcy1tb2R1bGVzLW5ldC9pZl9nbWFjLmtvIHRleHQ9MHgzYzAw IHRleHQ9MHg5M2MwIGRhdGE9MHg4NTMwKzB4NCBzeW1zPVsweDgrMHgxZDcwKzB4OCsweDE1NjNd XApWZXJpZmllZCAvcGFja2FnZXMvc2V0cy9uZXdvcy9ib290L29zLW1vZHVsZXMtbmV0L2lmX2dt YWMua29cCi9wYWNrYWdlcy9zZXRzL25ld29zL2Jvb3QvbmV0c3RhY2svbmV0c3RhY2sua28gdGV4 dD0weDcxNjI4IHRleHQ9MHgxMjNjYzggZGF0YT0weDFmMzU4KzB4MTRjNzggc3ltcz1bMHg4KzB4 MmIwOTgrMHg4KzB4MWM1MzZdXApWZXJpZmllZCAvcGFja2FnZXMvc2V0cy9uZXdvcy9ib290L25l dHN0YWNrL25ldHN0YWNrLmtvXApCb290aW5nIFsvcGFja2FnZXMvc2V0cy9uZXdvcy9ib290L29z LWtlcm5lbC9rZXJuZWxdLi4uICAgICAgICAgICAgICAgXApVc2luZyBEVEIgZnJvbSBsb2FkZWQg ZmlsZSAnL3BhY2thZ2VzL3NldHMvbmV3b3MvYm9vdC9vcy1rZXJuZWwvYWN4LTcxMC5kdGInLlwK LS0tLS0tLS1JbiBpbml0YXJtIGFuZCBLRVJOQkFTRSA9IDB4ZmZmZjAwMDAwMDAwMDAwMCwgYWJw LT5rZXJuX2RlbHRhID0gMHhmZmZlZmZmZjBjODAwMDAwLCBsYXN0YWRkciA9IDB4ZmZmZjAwMDAw MmNmZDAwMFwKLS0tLS0tLS1JbiBpbml0YXJtIGFuZCBwY3B1cC0+cGNfZHluYW1pYyA9IDB4Mjg4 NjQ4MFwKLS0tLS0tLS1JbiBpbml0YXJtIGFuZCBkcGNwdV9vZmZbMF0gPSAweDI4ODY0ODBcCi0t LS0tLS0tSW4gaW5pdGFybSBhbmQgZHBjcHVfb2ZmWzFdID0gMFwKLS0tLS0tLS1JbiBpbml0YXJt IGFuZCBEUENQVV9TVEFSVCA9IDB4ZmZmZjAwMDAwMDY4MWI4MFwKLS0tLS0tLS1JbiBpbml0YXJt IGFuZCBEUENQVV9TVE9QID0gMHhmZmZmMDAwMDAwNjg3MzAwXAotLS0tLS0tLUluIGluaXRhcm0g YW5kIERQQ1BVX0JZVEVTID0gMHg1NzgwXAotLS0tLS0tLUluIGluaXRhcm0gYW5kIERQQ1BVX1NJ WkUgPSAweDYwMDBcCi0tLS0tLS0tSW4gaW5pdGFybSBhbmQgUEFHRV9TSVpFID0gMHgxMDAwXAot LS0tLS0tLUluIGluaXRhcm0gYW5kIHBjcHVwID0gMHhmZmZmMDAwMDAwOTViZDgwXAotLS0tLS0t LUluIGluaXRhcm0gYW5kIGxhc3RhZGRyID0gMHhmZmZmMDAwMDAyY2ZkMDAwXAotLS0tLS0tLUlu IGluaXRhcm0gYW5kIHBjcHVfZW50cnlfdGltZXJzdGF0ZSBpcyAweGZmZmYwMDAwMDA2OGFjODAt LS0tXAotLS0tLS0tLUluIGluaXRhcm0gYW5kIHRpbWVyc3RhdGUgaXMgMHhmZmZmMDAwMDAyZjA4 MDA4LS0tLVwKLS0tLS0tLS1JbiBpbml0YXJtIGFuZCBfX3N0YXJ0X3NldF9wY3B1IGlzIDAtLS0t XAotLS0tLS0tLUluIGluaXRhcm0gYW5kIHBjcHVfZW50cnlfdGRxIGlzIDB4ZmZmZjAwMDAwMDY4 YWM4MC0tLS1cCi0tLTw8Qk9PVD4+LS0tXApHREI6IGRlYnVnIHBvcnRzOiB1YXJ0XApHREI6IGN1 cnJlbnQgcG9ydDogdWFydFwKS0RCOiBkZWJ1Z2dlciBiYWNrZW5kczogZGRiIGdkYlwKS0RCOiBj dXJyZW50IGJhY2tlbmQ6IGRkYlwKV0FSTklORzogQ2Fubm90IGZpbmQgZnJlZWJzZCxkdHMtdmVy c2lvbiBwcm9wZXJ0eSwgY2Fubm90IGNoZWNrIERUQiBjb21wbGlhbmNlXApDb3B5cmlnaHQgKGMp IDE5OTgtMjAyMyBKdW5pcGVyIE5ldHdvcmtzLCBJbmMuXApDb3B5cmlnaHQgKGMpIDE5OTItMjAy MyBUaGUgRnJlZUJTRCBQcm9qZWN0LlwKQ29weXJpZ2h0IChjKSAxOTc5LCAxOTgwLCAxOTgzLCAx OTg2LCAxOTg4LCAxOTg5LCAxOTkxLCAxOTkyLCAxOTkzLCAxOTk0XAoJVGhlIFJlZ2VudHMgb2Yg dGhlIFVuaXZlcnNpdHkgb2YgQ2FsaWZvcm5pYS4gQWxsIHJpZ2h0cyByZXNlcnZlZC5cCkZyZWVC U0QgaXMgYSByZWdpc3RlcmVkIHRyYWRlbWFyayBvZiBUaGUgRnJlZUJTRCBGb3VuZGF0aW9uLlwK RnJlZUJTRCAxNC4wLUNVUlJFTlQgIzIyIG1haW4tbjI2MzEzMC0yNjJiYmY2ODRiMy1kaXJ0eTog VGh1IEp1biAyOSAwOTo0ODozNCBQRFQgMjAyM1wKICAgIHNmYWlzYWxAc3ZsLWJzZHgtMDI6L2Iv c2ZhaXNhbC9zdGFibGVfbWFpbi9vYmovYXJtNjQvanVuaXBlci9rZXJuZWxzL0pOUFItQVJNNjQt V0lUL2tlcm5lbCBhcm02NFwKSnVuaXBlciBjbGFuZyB2ZXJzaW9uIDEzLjAuMSAoZ2l0QGVuZy1n aXRsYWIuanVuaXBlci5uZXQ6dG9vbHMtdG90L2xsdm0gZDZjNTkzMTBlZTRkNWMxYzY0OWU4Mzgw YmJlZDRmMGVmNmE2NTgwYilcCldBUk5JTkc6IFdJVE5FU1Mgb3B0aW9uIGVuYWJsZWQsIGV4cGVj dCByZWR1Y2VkIHBlcmZvcm1hbmNlLlwKVlQ6IGluaXQgd2l0aG91dCBkcml2ZXIuXAptb2R1bGUg Y3BsZCBhbHJlYWR5IHByZXNlbnQhXAptb2R1bGUgY3J5cHRvIGFscmVhZHkgcHJlc2VudCFcCmxp bmtfZWxmOiBzeW1ib2wgaXB2NF9pcHNlY19zdXBwb3J0IHVuZGVmaW5lZFwKS0xEIGZpbGUgbmV0 c3RhY2sua28gLSBjb3VsZCBub3QgZmluYWxpemUgbG9hZGluZ1wKS0xEIGZpbGUgaWZsaWIua28g LSBjYW5ub3QgZmluZCBkZXBlbmRlbmN5ICJuZXRzdGFjayJcCktMRCBmaWxlIG1paWJ1cy5rbyAt IGNhbm5vdCBmaW5kIGRlcGVuZGVuY3kgIm5ldHN0YWNrIlwKS0xEIGZpbGUgaXByb2NfbWRpb19t dXgua28gLSBjYW5ub3QgZmluZCBkZXBlbmRlbmN5ICJtaWlidXMiXApLTEQgZmlsZSBpZl9nbWFj LmtvIC0gY2Fubm90IGZpbmQgZGVwZW5kZW5jeSAibmV0c3RhY2siXApyZWFsIG1lbW9yeSAgPSA0 Mjk0OTIyMjQwICg0MDk1IE1CKVwKYXZhaWwgbWVtb3J5ID0gNDEyNDcxNzA1NiAoMzkzMyBNQilc ClN0YXJ0aW5nIENQVSAxICgxKVwKTk9USUNFOiAgQ1BVIDEgaXMgdHVybmVkIG9uIHdpdGggMHg3 YmZiIVwKSU5GTzogICAgbnMyX3B3cl9kb21haW5fb24sIGNwdToxXApJTkZPOiAgICBTZXR0aW5n IHVwIEdJQyBmb3Igc2Vjb25kYXJ5IGNvcmVzXApTdGFydGluZyBDUFUgMiAoMilcCk5PVElDRTog IENQVSAyIGlzIHR1cm5lZCBvbiB3aXRoIDB4N2JmYiFcCklORk86ICAgIG5zMl9wd3JfZG9tYWlu X29uLCBjcHU6MlwKSU5GTzogICAgU2V0dGluZyB1cCBHSUMgZm9yIHNlY29uZGFyeSBjb3Jlc1wK U3RhcnRpbmcgQ1BVIDMgKDMpXApOT1RJQ0U6ICBDUFUgMyBpcyB0dXJuZWQgb24gd2l0aCAweDdi ZmIhXApJTkZPOiAgICBuczJfcHdyX2RvbWFpbl9vbiwgY3B1OjNcCklORk86ICAgIFNldHRpbmcg dXAgR0lDIGZvciBzZWNvbmRhcnkgY29yZXNcCkZyZWVCU0QvU01QOiBNdWx0aXByb2Nlc3NvciBT eXN0ZW0gRGV0ZWN0ZWQ6IDQgQ1BVc1wKYXJjNHJhbmRvbTogV0FSTklORzogaW5pdGlhbCBzZWVk aW5nIGJ5cGFzc2VkIHRoZSBjcnlwdG9ncmFwaGljIHJhbmRvbSBkZXZpY2UgYmVjYXVzZSBpdCB3 YXMgbm90IHlldCBzZWVkZWQgYW5kIHRoZSBrbm9iICdieXBhc3NfYmVmb3JlX3NlZWRpbmcnIHdh cyBlbmFibGVkLlwKU2VjdXJpdHkgcG9saWN5IGxvYWRlZDogTUFDL3ZlcmlleGVjIChtYWNfdmVy aWV4ZWMpXApNQUMvdmVyaWV4ZWMgZmluZ2VycHJpbnQgbW9kdWxlIGxvYWRlZDogU0hBMjU2XApN QUMvdmVyaWV4ZWMgZmluZ2VycHJpbnQgbW9kdWxlIGxvYWRlZDogU0hBMzg0XApNQUMvdmVyaWV4 ZWMgZmluZ2VycHJpbnQgbW9kdWxlIGxvYWRlZDogU0hBMVwKLS0tLS1JbiBzY2hlZF9hZGQgYW5k IHRkID0gMHhmZmZmMDAwMDQxYjgyYzQwLCBjcHU9MCwgZmxhZ3MgPSAweDBcCi0tLS0tLS1JbiBz Y2hlZF9zZXRjcHUgLS0tLS0tXAotLS0tLUluIHNjaGVkX2FkZCBhbmQgdGQgPSAweGZmZmYwMDAw NDFiODA2MjAsIGNwdT0wLCBmbGFncyA9IDB4MFwKLS0tLS0tLUluIHNjaGVkX3NldGNwdSAtLS0t LS1cCi0tLS0tSW4gc2NoZWRfYWRkIGFuZCB0ZCA9IDB4ZmZmZjAwMDA0MWI4MDAwMCwgY3B1PTAs IGZsYWdzID0gMHgwXAotLS0tLS0tSW4gc2NoZWRfc2V0Y3B1IC0tLS0tLVwKLS0tLS1JbiBzY2hl ZF9hZGQgYW5kIHRkID0gMHhmZmZmMDAwMDQxZDc5MDAwLCBjcHU9MCwgZmxhZ3MgPSAweDBcCi0t LS0tLS1JbiBzY2hlZF9zZXRjcHUgLS0tLS0tXAotLS0tLUluIHNjaGVkX2FkZCBhbmQgdGQgPSAw eGZmZmYwMDAwNDFkNzg4ODAsIGNwdT0wLCBmbGFncyA9IDB4MFwKLS0tLS0tLUluIHNjaGVkX3Nl dGNwdSAtLS0tLS1cCi0tLS0tSW4gc2NoZWRfYWRkIGFuZCB0ZCA9IDB4ZmZmZjAwMDA0MWQ3N2M0 MCwgY3B1PTAsIGZsYWdzID0gMHgwXAotLS0tLS0tSW4gc2NoZWRfc2V0Y3B1IC0tLS0tLVwKLS0t LS1JbiBzY2hlZF9hZGQgYW5kIHRkID0gMHhmZmZmMDAwMDQxZDc3NjIwLCBjcHU9MCwgZmxhZ3Mg PSAweDBcCi0tLS0tLS1JbiBzY2hlZF9zZXRjcHUgLS0tLS0tXAotLS0tLUluIHNjaGVkX2FkZCBh bmQgdGQgPSAweGZmZmYwMDAwNDFiODMyNjAsIGNwdT0wLCBmbGFncyA9IDB4MFwKLS0tLS0tLUlu IHNjaGVkX3NldGNwdSAtLS0tLS1cCi0tLS0tSW4gc2NoZWRfYWRkIGFuZCB0ZCA9IDB4ZmZmZjAw MDA0MWQ3YzI2MCwgY3B1PTAsIGZsYWdzID0gMHgwXAotLS0tLS0tSW4gc2NoZWRfc2V0Y3B1IC0t LS0tLVwKLS0tLS1JbiBzY2hlZF9hZGQgYW5kIHRkID0gMHhmZmZmMDAwMDQxZDdiYzQwLCBjcHU9 MCwgZmxhZ3MgPSAweDBcCi0tLS0tLS1JbiBzY2hlZF9zZXRjcHUgLS0tLS0tXApyYW5kb206IGVu dHJvcHkgZGV2aWNlIGV4dGVybmFsIGludGVyZmFjZVwKLS0tLS1JbiBzY2hlZF9hZGQgYW5kIHRk ID0gMHhmZmZmMDAwMDQxZDc5YzQwLCBjcHU9MCwgZmxhZ3MgPSAweDBcCi0tLS0tLS1JbiBzY2hl ZF9zZXRjcHUgLS0tLS0tXAotLS0tLUluIHNjaGVkX2FkZCBhbmQgdGQgPSAweGZmZmYwMDAwNDFk Nzk2MjAsIGNwdT0wLCBmbGFncyA9IDB4MFwKLS0tLS0tLUluIHNjaGVkX3NldGNwdSAtLS0tLS1c Ci0tLS0tSW4gc2NoZWRfYWRkIGFuZCB0ZCA9IDB4ZmZmZjAwMDA0MWQ3ZjYyMCwgY3B1PTAsIGZs YWdzID0gMHgwXAotLS0tLS0tSW4gc2NoZWRfc2V0Y3B1IC0tLS0tLVwKTUFQIGZkYWYwMDAwIG1v ZGUgMiBwYWdlcyAxXApNQVAgZmZmYzcwMDAgbW9kZSAyIHBhZ2VzIDFcCm1vZHVsZV9yZWdpc3Rl cl9pbml0OiBNT0RfTE9BRCAoZWZpcnQsIDB4ZmZmZjAwMDAwMDA2ZDU1NCwgMCkgZXJyb3IgNlwK LS0tLS1JbiBzY2hlZF9hZGQgYW5kIHRkID0gMHhmZmZmMDAwMDQxZDdmMDAwLCBjcHU9MCwgZmxh Z3MgPSAweDBcCi0tLS0tLS1JbiBzY2hlZF9zZXRjcHUgLS0tLS0tXAotLS0tLUluIHNjaGVkX2Fk ZCBhbmQgdGQgPSAweGZmZmYwMDAwNDFkN2U4ODAsIGNwdT0wLCBmbGFncyA9IDB4MFwKLS0tLS0t LUluIHNjaGVkX3NldGNwdSAtLS0tLS1cCi0tLS0tSW4gc2NoZWRfYWRkIGFuZCB0ZCA9IDB4ZmZm ZjAwMDA0MWQ3ZTI2MCwgY3B1PTAsIGZsYWdzID0gMHgwXAotLS0tLS0tSW4gc2NoZWRfc2V0Y3B1 IC0tLS0tLVwKLS0tLS1JbiBzY2hlZF9hZGQgYW5kIHRkID0gMHhmZmZmMDAwMDQxZDdkYzQwLCBj cHU9MCwgZmxhZ3MgPSAweDBcCi0tLS0tLS1JbiBzY2hlZF9zZXRjcHUgLS0tLS0tXAotLS0tLUlu IHNjaGVkX2FkZCBhbmQgdGQgPSAweGZmZmYwMDAwNDFkN2Q2MjAsIGNwdT0wLCBmbGFncyA9IDB4 MFwKLS0tLS0tLUluIHNjaGVkX3NldGNwdSAtLS0tLS1cCi0tLS0tSW4gc2NoZWRfYWRkIGFuZCB0 ZCA9IDB4ZmZmZjAwMDA0MWQ3ZDAwMCwgY3B1PTAsIGZsYWdzID0gMHgwXAotLS0tLS0tSW4gc2No ZWRfc2V0Y3B1IC0tLS0tLVwKLS0tLS1JbiBzY2hlZF9hZGQgYW5kIHRkID0gMHhmZmZmMDAwMDQx ZDdjODgwLCBjcHU9MCwgZmxhZ3MgPSAweDBcCi0tLS0tLS1JbiBzY2hlZF9zZXRjcHUgLS0tLS0t XAotLS0tLUluIHNjaGVkX2FkZCBhbmQgdGQgPSAweGZmZmYwMDAwNDFkODg4ODAsIGNwdT0wLCBm bGFncyA9IDB4MFwKLS0tLS0tLUluIHNjaGVkX3NldGNwdSAtLS0tLS1cCi0tLS0tSW4gc2NoZWRf YWRkIGFuZCB0ZCA9IDB4ZmZmZjAwMDA0MWQ4ODI2MCwgY3B1PTAsIGZsYWdzID0gMHgwXAotLS0t LS0tSW4gc2NoZWRfc2V0Y3B1IC0tLS0tLVwKLS0tLS1JbiBzY2hlZF9hZGQgYW5kIHRkID0gMHhm ZmZmMDAwMDQxZDg3YzQwLCBjcHU9MCwgZmxhZ3MgPSAweDBcCi0tLS0tLS1JbiBzY2hlZF9zZXRj cHUgLS0tLS0tXAotLS0tLUluIHNjaGVkX2FkZCBhbmQgdGQgPSAweGZmZmYwMDAwNDFkODc2MjAs IGNwdT0wLCBmbGFncyA9IDB4MFwKLS0tLS0tLUluIHNjaGVkX3NldGNwdSAtLS0tLS1cCm9md2J1 czA6IDxPcGVuIEZpcm13YXJlIERldmljZSBUcmVlPlwKc2ltcGxlYnVzMDogPEZsYXR0ZW5lZCBk ZXZpY2UgdHJlZSBzaW1wbGUgYnVzPiBvbiBvZndidXMwXApjbGtfZml4ZWQwOiA8Rml4ZWQgY2xv Y2s+IG9uIHNpbXBsZWJ1czBcCmNsa19maXhlZDE6IDxGaXhlZCBmYWN0b3IgY2xvY2s+IG9uIHNp bXBsZWJ1czBcCmNsa19maXhlZDE6IENhbm5vdCBGRFQgcGFyYW1ldGVycy5cCmRldmljZV9hdHRh Y2g6IGNsa19maXhlZDEgYXR0YWNoIHJldHVybmVkIDZcCmNsa19maXhlZDE6IDxGaXhlZCBmYWN0 b3IgY2xvY2s+IG9uIHNpbXBsZWJ1czBcCmNsa19maXhlZDE6IENhbm5vdCBGRFQgcGFyYW1ldGVy cy5cCmRldmljZV9hdHRhY2g6IGNsa19maXhlZDEgYXR0YWNoIHJldHVybmVkIDZcCmNsa19maXhl ZDE6IDxGaXhlZCBmYWN0b3IgY2xvY2s+IG9uIHNpbXBsZWJ1czBcCmNsa19maXhlZDE6IENhbm5v dCBGRFQgcGFyYW1ldGVycy5cCmRldmljZV9hdHRhY2g6IGNsa19maXhlZDEgYXR0YWNoIHJldHVy bmVkIDZcCmNsa19maXhlZDE6IDxGaXhlZCBmYWN0b3IgY2xvY2s+IG9uIHNpbXBsZWJ1czBcCmNs a19maXhlZDE6IENhbm5vdCBGRFQgcGFyYW1ldGVycy5cCmRldmljZV9hdHRhY2g6IGNsa19maXhl ZDEgYXR0YWNoIHJldHVybmVkIDZcCnBzY2kwOiA8QVJNIFBvd2VyIFN0YXRlIENvLW9yZGluYXRp b24gSW50ZXJmYWNlIERyaXZlcj4gb24gb2Z3YnVzMFwKY2xrX2ZpeGVkMTogPEZpeGVkIGZhY3Rv ciBjbG9jaz4gb24gc2ltcGxlYnVzMFwKY2xrX2ZpeGVkMTogQ2Fubm90IEZEVCBwYXJhbWV0ZXJz LlwKZGV2aWNlX2F0dGFjaDogY2xrX2ZpeGVkMSBhdHRhY2ggcmV0dXJuZWQgNlwKY2xrX2ZpeGVk MTogPEZpeGVkIGZhY3RvciBjbG9jaz4gb24gc2ltcGxlYnVzMFwKY2xrX2ZpeGVkMTogQ2Fubm90 IEZEVCBwYXJhbWV0ZXJzLlwKZGV2aWNlX2F0dGFjaDogY2xrX2ZpeGVkMSBhdHRhY2ggcmV0dXJu ZWQgNlwKY2xrX2ZpeGVkMTogPEZpeGVkIGZhY3RvciBjbG9jaz4gb24gc2ltcGxlYnVzMFwKY2xr X2ZpeGVkMTogQ2Fubm90IEZEVCBwYXJhbWV0ZXJzLlwKZGV2aWNlX2F0dGFjaDogY2xrX2ZpeGVk MSBhdHRhY2ggcmV0dXJuZWQgNlwKY2xrX2ZpeGVkMTogPEZpeGVkIGZhY3RvciBjbG9jaz4gb24g c2ltcGxlYnVzMFwKY2xrX2ZpeGVkMTogQ2Fubm90IEZEVCBwYXJhbWV0ZXJzLlwKZGV2aWNlX2F0 dGFjaDogY2xrX2ZpeGVkMSBhdHRhY2ggcmV0dXJuZWQgNlwKYmNtY3J1MDogPEJyb2FkY29tIEJD TTU2WFhYIGNydT4gbWVtIDB4NjYwZTAwMDAtMHg2NjBlMGZmZiBvbiBzaW1wbGVidXMwXApjbGtf Zml4ZWQxOiA8Rml4ZWQgZmFjdG9yIGNsb2NrPiBvbiBzaW1wbGVidXMwXApjbGtfZml4ZWQxOiBD YW5ub3QgRkRUIHBhcmFtZXRlcnMuXApkZXZpY2VfYXR0YWNoOiBjbGtfZml4ZWQxIGF0dGFjaCBy ZXR1cm5lZCA2XApjbGtfZml4ZWQxOiA8Rml4ZWQgZmFjdG9yIGNsb2NrPiBvbiBzaW1wbGVidXMw XApjbGtfZml4ZWQxOiBDYW5ub3QgRkRUIHBhcmFtZXRlcnMuXApkZXZpY2VfYXR0YWNoOiBjbGtf Zml4ZWQxIGF0dGFjaCByZXR1cm5lZCA2XApnaWMwOiA8QVJNIEdlbmVyaWMgSW50ZXJydXB0IENv bnRyb2xsZXI+IG1lbSAweDY1MjEwMDAwLTB4NjUyMTBmZmYsMHg2NTIyMDAwMC0weDY1MjIwZmZm LDB4NjUyNDAwMDAtMHg2NTI0MWZmZiwweDY1MjYwMDAwLTB4NjUyNjBmZmYgaXJxIDU2IG9uIHNp bXBsZWJ1czBcCmdpYzA6IHBuIDB4MiwgYXJjaCAweDIsIHJldiAweDEsIGltcGxlbWVudGVyIDB4 NDNiIGlycXMgNTEyXApnaWN2Mm0wOiA8QVJNIEdlbmVyaWMgSW50ZXJydXB0IENvbnRyb2xsZXIg TVNJL01TSVg+IG1lbSAwLTB4ZmZmIG9uIGdpYzBcCmdpY3YybTE6IDxBUk0gR2VuZXJpYyBJbnRl cnJ1cHQgQ29udHJvbGxlciBNU0kvTVNJWD4gbWVtIDB4MTAwMDAtMHgxMGZmZiBvbiBnaWMwXApn aWN2Mm0yOiA8QVJNIEdlbmVyaWMgSW50ZXJydXB0IENvbnRyb2xsZXIgTVNJL01TSVg+IG1lbSAw eDIwMDAwLTB4MjBmZmYgb24gZ2ljMFwKZ2ljdjJtMzogPEFSTSBHZW5lcmljIEludGVycnVwdCBD b250cm9sbGVyIE1TSS9NU0lYPiBtZW0gMHgzMDAwMC0weDMwZmZmIG9uIGdpYzBcCmdpY3YybTQ6 IDxBUk0gR2VuZXJpYyBJbnRlcnJ1cHQgQ29udHJvbGxlciBNU0kvTVNJWD4gbWVtIDB4NDAwMDAt MHg0MGZmZiBvbiBnaWMwXApnaWN2Mm01OiA8QVJNIEdlbmVyaWMgSW50ZXJydXB0IENvbnRyb2xs ZXIgTVNJL01TSVg+IG1lbSAweDUwMDAwLTB4NTBmZmYgb24gZ2ljMFwKZ2ljdjJtNjogPEFSTSBH ZW5lcmljIEludGVycnVwdCBDb250cm9sbGVyIE1TSS9NU0lYPiBtZW0gMHg2MDAwMC0weDYwZmZm IG9uIGdpYzBcCmdpY3YybTc6IDxBUk0gR2VuZXJpYyBJbnRlcnJ1cHQgQ29udHJvbGxlciBNU0kv TVNJWD4gbWVtIDB4NzAwMDAtMHg3MGZmZiBvbiBnaWMwXApjbGtfZml4ZWQxOiA8Rml4ZWQgZmFj dG9yIGNsb2NrPiBvbiBzaW1wbGVidXMwXApjbGtfZml4ZWQxOiBDYW5ub3QgRkRUIHBhcmFtZXRl cnMuXApkZXZpY2VfYXR0YWNoOiBjbGtfZml4ZWQxIGF0dGFjaCByZXR1cm5lZCA2XApjbGtfZml4 ZWQxOiA8Rml4ZWQgZmFjdG9yIGNsb2NrPiBvbiBzaW1wbGVidXMwXApjbGtfZml4ZWQxOiBDYW5u b3QgRkRUIHBhcmFtZXRlcnMuXApkZXZpY2VfYXR0YWNoOiBjbGtfZml4ZWQxIGF0dGFjaCByZXR1 cm5lZCA2XApwbDMzMDA6IDxBUk0gUHJpbWVDZWxsIERNQSBDb250cm9sbGVyIChQTDMzMCk+IG1l bSAweDYxMzYwMDAwLTB4NjEzNjBmZmYgaXJxIDEzLDE0LDE1LDE2LDE3LDE4LDE5LDIwLDIxIG9u IHNpbXBsZWJ1czBcCmdwaW8wOiA8QnJvYWRjb20gQkNNNTZYWFggR1BJTyBjb250cm9sbGVyPiBt ZW0gMHg2NjBhMDAwMC0weDY2MGEwMDRmIGlycSA2MyBvbiBzaW1wbGVidXMwXApncGlvYnVzMDog PEdQSU8gYnVzPiBvbiBncGlvMFwKZ2VuZXJpY190aW1lcjA6IDxBUk12OCBHZW5lcmljIFRpbWVy PiBpcnEgMCwxLDIsMyBvbiBvZndidXMwXApUaW1lY291bnRlciAiQVJNIE1QQ29yZSBUaW1lY291 bnRlciIgZnJlcXVlbmN5IDI1MDAwMDAwIEh6IHF1YWxpdHkgMTAwMFwKRXZlbnQgdGltZXIgIkFS TSBNUENvcmUgRXZlbnR0aW1lciIgZnJlcXVlbmN5IDI1MDAwMDAwIEh6IHF1YWxpdHkgMTAwMFwK Y2xrX2ZpeGVkMTogPEZpeGVkIGZhY3RvciBjbG9jaz4gb24gc2ltcGxlYnVzMFwKY2xrX2ZpeGVk MTogQ2Fubm90IEZEVCBwYXJhbWV0ZXJzLlwKZGV2aWNlX2F0dGFjaDogY2xrX2ZpeGVkMSBhdHRh Y2ggcmV0dXJuZWQgNlwKY2xrX2ZpeGVkMTogPEZpeGVkIGZhY3RvciBjbG9jaz4gb24gc2ltcGxl YnVzMFwKY2xrX2ZpeGVkMTogQ2Fubm90IEZEVCBwYXJhbWV0ZXJzLlwKZGV2aWNlX2F0dGFjaDog Y2xrX2ZpeGVkMSBhdHRhY2ggcmV0dXJuZWQgNlwKY2xrX2ZpeGVkMTogPEZpeGVkIGZhY3RvciBj bG9jaz4gb24gc2ltcGxlYnVzMFwKY2xrX2ZpeGVkMTogQ2Fubm90IEZEVCBwYXJhbWV0ZXJzLlwK ZGV2aWNlX2F0dGFjaDogY2xrX2ZpeGVkMSBhdHRhY2ggcmV0dXJuZWQgNlwKY2xrX2ZpeGVkMTog PEZpeGVkIGZhY3RvciBjbG9jaz4gb24gc2ltcGxlYnVzMFwKY2xrX2ZpeGVkMTogQ2Fubm90IEZE VCBwYXJhbWV0ZXJzLlwKZGV2aWNlX2F0dGFjaDogY2xrX2ZpeGVkMSBhdHRhY2ggcmV0dXJuZWQg NlwKY2xrX2ZpeGVkMTogPEZpeGVkIGZhY3RvciBjbG9jaz4gb24gc2ltcGxlYnVzMFwKY2xrX2Zp eGVkMTogQ2Fubm90IEZEVCBwYXJhbWV0ZXJzLlwKZGV2aWNlX2F0dGFjaDogY2xrX2ZpeGVkMSBh dHRhY2ggcmV0dXJuZWQgNlwKY2xrX2ZpeGVkMTogPEZpeGVkIGZhY3RvciBjbG9jaz4gb24gc2lt cGxlYnVzMFwKY2xrX2ZpeGVkMTogQ2Fubm90IEZEVCBwYXJhbWV0ZXJzLlwKZGV2aWNlX2F0dGFj aDogY2xrX2ZpeGVkMSBhdHRhY2ggcmV0dXJuZWQgNlwKY3B1bGlzdDA6IDxPcGVuIEZpcm13YXJl IENQVSBHcm91cD4gb24gb2Z3YnVzMFwKY3B1MDogPE9wZW4gRmlybXdhcmUgQ1BVPiBvbiBjcHVs aXN0MFwKY3B1MTogPE9wZW4gRmlybXdhcmUgQ1BVPiBvbiBjcHVsaXN0MFwKY3B1MjogPE9wZW4g RmlybXdhcmUgQ1BVPiBvbiBjcHVsaXN0MFwKY3B1MzogPE9wZW4gRmlybXdhcmUgQ1BVPiBvbiBj cHVsaXN0MFwKcG11MDogPFBlcmZvcm1hbmNlIE1vbml0b3JpbmcgVW5pdD4gaXJxIDQsNSw2LDcg b24gb2Z3YnVzMFwKcGNpYjA6IDxCcm9hZGNvbSBpUHJvYyBQQ0llIFJDIGRyaXZlcj4gbWVtIDB4 MjAwMjAwMDAtMHgyMDAyMGZmZiBvbiBvZndidXMwXApwY2kwOiA8T0ZXIFBDSSBidXM+IG9uIHBj aWIwXApwY2liMTogPFBDSS1QQ0kgYnJpZGdlPiBpcnEgODQgYXQgZGV2aWNlIDAuMCBvbiBwY2kw XApwY2liMDogZmFpbGVkIHRvIHJlc2VydmUgcmVzb3VyY2UgZm9yIHBjaWIxXApwY2liMTogZmFp bGVkIHRvIGFsbG9jYXRlIGluaXRpYWwgbWVtb3J5IHdpbmRvdzogMC0weGZmZmZmXApwY2liMDog ZmFpbGVkIHRvIHJlc2VydmUgcmVzb3VyY2UgZm9yIHBjaWIxXApwY2liMTogZmFpbGVkIHRvIGFs bG9jYXRlIGluaXRpYWwgcHJlZmV0Y2ggd2luZG93OiAwLTB4ZmZmZmZcCnBjaTE6IDxQQ0kgYnVz PiBvbiBwY2liMVwKcGNpMTogPG1lbW9yeT4gYXQgZGV2aWNlIDAuMCAobm8gZHJpdmVyIGF0dGFj aGVkKVwKcGNpYjI6IDxCcm9hZGNvbSBpUHJvYyBQQ0llIFJDIGRyaXZlcj4gbWVtIDB4NTAwMjAw MDAtMHg1MDAyMGZmZiBvbiBvZndidXMwXApwY2kyOiA8T0ZXIFBDSSBidXM+IG9uIHBjaWIyXApw Y2liMzogPFBDSS1QQ0kgYnJpZGdlPiBpcnEgODUgYXQgZGV2aWNlIDAuMCBvbiBwY2kyXApwY2li MjogZmFpbGVkIHRvIHJlc2VydmUgcmVzb3VyY2UgZm9yIHBjaWIzXApwY2liMzogZmFpbGVkIHRv IGFsbG9jYXRlIGluaXRpYWwgbWVtb3J5IHdpbmRvdzogMC0weGZmZmZmXApwY2liMjogZmFpbGVk IHRvIHJlc2VydmUgcmVzb3VyY2UgZm9yIHBjaWIzXApwY2liMzogZmFpbGVkIHRvIGFsbG9jYXRl IGluaXRpYWwgcHJlZmV0Y2ggd2luZG93OiAwLTB4ZmZmZmZcCnBjaTM6IDxQQ0kgYnVzPiBvbiBw Y2liM1wKcGNpYjI6IGZhaWxlZCB0byByZXNlcnZlIHJlc291cmNlIGZvciBwY2liM1wKcGNpYjI6 IGZhaWxlZCB0byByZXNlcnZlIHJlc291cmNlIGZvciBwY2liM1wKcGNpYjI6IGZhaWxlZCB0byBy ZXNlcnZlIHJlc291cmNlIGZvciBwY2liM1wKcGNpYjI6IGZhaWxlZCB0byByZXNlcnZlIHJlc291 cmNlIGZvciBwY2liM1wKcGNpYjI6IGZhaWxlZCB0byByZXNlcnZlIHJlc291cmNlIGZvciBwY2li M1wKcGNpMzogPG5ldHdvcmssIGV0aGVybmV0PiBhdCBkZXZpY2UgMC4wIChubyBkcml2ZXIgYXR0 YWNoZWQpXApwY2kzOiA8bmV0d29yaywgZXRoZXJuZXQ+IGF0IGRldmljZSAwLjEgKG5vIGRyaXZl ciBhdHRhY2hlZClcCmNsa19maXhlZDE6IDxGaXhlZCBmYWN0b3IgY2xvY2s+IG9uIHNpbXBsZWJ1 czBcCmNsa19maXhlZDE6IENhbm5vdCBGRFQgcGFyYW1ldGVycy5cCmRldmljZV9hdHRhY2g6IGNs a19maXhlZDEgYXR0YWNoIHJldHVybmVkIDZcCmNsa19maXhlZDE6IDxGaXhlZCBmYWN0b3IgY2xv Y2s+IG9uIHNpbXBsZWJ1czBcCmNsa19maXhlZDE6IENhbm5vdCBGRFQgcGFyYW1ldGVycy5cCmRl dmljZV9hdHRhY2g6IGNsa19maXhlZDEgYXR0YWNoIHJldHVybmVkIDZcCmJjbV9uczJfdXNicGh5 MDogPEJyb2FkY29tIE5TMiBVU0IyIFBIWT4gbWVtIDB4NjYwMDA5NjAtMHg2NjAwMDk4MywweDY3 MDEyODAwLTB4NjcwMTI4MDMsMHg2NTAxZDE0OC0weDY1MDFkMTRiLDB4NjY0ZDA3MDAtMHg2NjRk MDcwMyBkaXNhYmxlZCBvbiBzaW1wbGVidXMwXAppaWNoYjA6IDxCcm9hZGNvbSBpUHJvYyBTTUJ1 cyBDb250cm9sbGVyPiBtZW0gMHg2NjA4MDAwMC0weDY2MDgwMGZmIGlycSA2MSBvbiBzaW1wbGVi dXMwXAppaWNidXMwOiA8T0ZXIEkyQyBidXM+IG9uIGlpY2hiMFwKaWljMDogPEkyQyBnZW5lcmlj IEkvTz4gb24gaWljYnVzMFwKZHMxM3J0YzA6IDxEYWxsYXMvTWF4aW0gRFMxMzQxIFJUQz4gYXQg YWRkciAweGQwIG9uIGlpY2J1czBcCmdwaW9jMDogPEdQSU8gY29udHJvbGxlcj4gb24gZ3BpbzBc CmlpY2hiMTogPEJyb2FkY29tIGlQcm9jIFNNQnVzIENvbnRyb2xsZXI+IG1lbSAweDY2MGIwMDAw LTB4NjYwYjAwZmYgaXJxIDY0IG9uIHNpbXBsZWJ1czBcCmlpY2J1czE6IDxPRlcgSTJDIGJ1cz4g b24gaWljaGIxXAppaWMxOiA8STJDIGdlbmVyaWMgSS9PPiBvbiBpaWNidXMxXAppaWNidXMxOiA8 dW5rbm93biBjYXJkPiBhdCBhZGRyIDB4ZDBcCmlpY2J1czE6IDx1bmtub3duIGNhcmQ+IGF0IGFk ZHIgMHhlYVwKdWFydDA6IDwxNjc1MCBvciBjb21wYXRpYmxlPiBtZW0gMHg2NjExMDAwMC0weDY2 MTEwMGZmIGlycSA2NiBvbiBzaW1wbGVidXMwXAp1YXJ0MDogY29uc29sZSAoNDk1MjMsbiw4LDEp XAp1YXJ0MTogPDE2NzUwIG9yIGNvbXBhdGlibGU+IG1lbSAweDY2MTIwMDAwLTB4NjYxMjAwZmYg aXJxIDY3IG9uIHNpbXBsZWJ1czBcCnVhcnQyOiA8MTY3NTAgb3IgY29tcGF0aWJsZT4gbWVtIDB4 NjYxMzAwMDAtMHg2NjEzMDBmZiBpcnEgNjggb24gc2ltcGxlYnVzMFwKc3BpMDogPFBMMDIyIFNQ SS9TU1AgY29udHJvbGxlcj4gbWVtIDB4NjYxODAwMDAtMHg2NjE4MGZmZiBpcnEgNjkgb24gc2lt cGxlYnVzMFwKc3BpYnVzMDogPE9GVyBTUEkgYnVzPiBvbiBzcGkwXApjcGxkMDogPEp1bmlwZXIg Q1BMRCBvdmVyIHNwaWJ1cyBmb3IgaVByb2M+IGF0IGNzIDYgbW9kZSAzIG9uIHNwaWJ1czBcCnNw aWJ1czE6IDxPRlcgU1BJIGJ1cz4gb24gY3BsZDBcCmFkOTUyMzA6IDxBbmFsb2cgRGV2aWNlIEFE OTUyMz4gYXQgY3MgMyBtb2RlIDAgb24gc3BpYnVzMVwKYml0czA6IDxCSVRTIGRzMjY1MDMgZHJp dmVyPiBhdCBjcyAyIG1vZGUgMCBvbiBzcGlidXMxXApicG0wOiA8SnVuaXBlciBCUE0gYWNjZXNz IG92ZXIgc3BpYnVzPiBhdCBjcyA0IG1vZGUgMCBvbiBzcGlidXMxXApzcGkxOiA8UEwwMjIgU1BJ L1NTUCBjb250cm9sbGVyPiBtZW0gMHg2NjE5MDAwMC0weDY2MTkwZmZmIGlycSA3MCBvbiBzaW1w bGVidXMwXApzcGlidXMyOiA8T0ZXIFNQSSBidXM+IG9uIHNwaTFcCmRwbGwwOiA8SnVuaXBlciBk cGxsIG92ZXIgc3BpYnVzIGZvciBpUHJvYz4gYXQgY3MgNiBtb2RlIDMgb24gc3BpYnVzMlwKYmNt cm5nMDogPEJyb2FkY29tIFJCRzIwMCBSTkc+IG1lbSAweDY2MjIwMDAwLTB4NjYyMjAwMjcgb24g c2ltcGxlYnVzMFwKcmFuZG9tOiByZWdpc3RlcmluZyBmYXN0IHNvdXJjZSBCcm9hZGNvbSBSQkcy MDAgUk5HXAppcHJvY19zZGhjaTA6IDxCcm9hZGNvbSBpUHJvYyBTREhDSSBjb250cm9sbGVyPiBt ZW0gMHg2NjQyMDAwMC0weDY2NDIwMGZmIGlycSA3NCBvbiBzaW1wbGVidXMwXAotLS0tLUluIHNj aGVkX2FkZCBhbmQgdGQgPSAweGZmZmYwMDAwNDFkYjVjNDAsIGNwdT0wLCBmbGFncyA9IDB4MFwK LS0tLS0tLUluIHNjaGVkX3NldGNwdSAtLS0tLS1cCm1tYzA6IDxNTUMvU0QgYnVzPiBvbiBpcHJv Y19zZGhjaTBcCnNwaTI6IDxCcm9hZGNvbSBCQ001NlhYWCBTUEk+IG1lbSAweDY2NDcwMDAwLTB4 NjY0NzBmZmYgaXJxIDc3IG9uIHNpbXBsZWJ1czBcCnNwaWJ1czM6IDxPRlcgU1BJIGJ1cz4gb24g c3BpMlwKbXgyNWwwOiA8TTI1UHh4IEZsYXNoIEZhbWlseT4gYXQgY3MgMCBtb2RlIDAgb24gc3Bp YnVzM1wKLS0tLS1JbiBzY2hlZF9hZGQgYW5kIHRkID0gMHhmZmZmMDAwMDQxZGI1NjIwLCBjcHU9 MCwgZmxhZ3MgPSAweDBcCi0tLS0tLS1JbiBzY2hlZF9zZXRjcHUgLS0tLS0tXApteDI1bDA6IGRl dmljZSB0eXBlIHMyNWZsNTEycywgc2l6ZSA2NTUzNksgaW4gMTAyNCBzZWN0b3JzIG9mIDY0Sywg ZXJhc2Ugc2l6ZSA2NEtcCmVoY2kwOiA8R2VuZXJpYyBFSENJIENvbnRyb2xsZXI+IG1lbSAweDY2 NGMwMDAwLTB4NjY0YzAwZmYgaXJxIDgyIG9uIHNpbXBsZWJ1czBcCnVzYnVzMDogRUhDSSB2ZXJz aW9uIDEuMFwKdXNidXMwIG9uIGVoY2kwXAotLS0tLUluIHNjaGVkX2FkZCBhbmQgdGQgPSAweGZm ZmYwMDAwNDFkYTA4ODAsIGNwdT0wLCBmbGFncyA9IDB4MFwKLS0tLS0tLUluIHNjaGVkX3NldGNw dSAtLS0tLS1cCi0tLS0tSW4gc2NoZWRfYWRkIGFuZCB0ZCA9IDB4ZmZmZjAwMDA0MWRhMDI2MCwg Y3B1PTAsIGZsYWdzID0gMHgwXAotLS0tLS0tSW4gc2NoZWRfc2V0Y3B1IC0tLS0tLVwKLS0tLS1J biBzY2hlZF9hZGQgYW5kIHRkID0gMHhmZmZmMDAwMDZiZmMzMjYwLCBjcHU9MCwgZmxhZ3MgPSAw eDBcCi0tLS0tLS1JbiBzY2hlZF9zZXRjcHUgLS0tLS0tXAotLS0tLUluIHNjaGVkX2FkZCBhbmQg dGQgPSAweGZmZmYwMDAwNmJmYzJjNDAsIGNwdT0wLCBmbGFncyA9IDB4MFwKLS0tLS0tLUluIHNj aGVkX3NldGNwdSAtLS0tLS1cCi0tLS0tSW4gc2NoZWRfYWRkIGFuZCB0ZCA9IDB4ZmZmZjAwMDA2 YmZjMjYyMCwgY3B1PTAsIGZsYWdzID0gMHgwXAotLS0tLS0tSW4gc2NoZWRfc2V0Y3B1IC0tLS0t LVwKb2FtY3RsMDogPE9BTSBDb250cm9sIHVzaW5nIENSTVUgZm9yIGlQcm9jPiBtZW0gMHg2NTAy NDAwMC0weDY1MDI0ZmZmIG9uIHNpbXBsZWJ1czBcCnN5c2Nvbl9nZW5lcmljX2RldjE6IENhbm5v dCBhbGxvY2F0ZSBtZW1vcnkgcmVzb3VyY2VcCmRldmljZV9hdHRhY2g6IHN5c2Nvbl9nZW5lcmlj X2RldjEgYXR0YWNoIHJldHVybmVkIDZcCmJjbV9pZG0wOiA8QnJvYWRjb20gSVBST0MgSURNIEJ1 cyBtb25pdG9yPiBvbiBvZndidXMwXAppZG1fbW9uaXRvcjA6IDxJRE0gTW9uaXRvciByZWdpb24+ IG1lbSAweDIxMDA0OTAwLTB4MjEwMDRhZmYgaXJxIDg4IG9uIGJjbV9pZG0wXAppZG1fbW9uaXRv cjE6IDxJRE0gTW9uaXRvciByZWdpb24+IG1lbSAweDIxMDA1OTAwLTB4MjEwMDVhZmYgaXJxIDg5 IG9uIGJjbV9pZG0wXAppZG1fbW9uaXRvcjI6IDxJRE0gTW9uaXRvciByZWdpb24+IG1lbSAweDIx MDA2OTAwLTB4MjEwMDZhZmYgaXJxIDkwIG9uIGJjbV9pZG0wXAppZG1fbW9uaXRvcjM6IDxJRE0g TW9uaXRvciByZWdpb24+IG1lbSAweDIxMDA3OTAwLTB4MjEwMDdhZmYgaXJxIDkxIG9uIGJjbV9p ZG0wXAppZG1fbW9uaXRvcjQ6IDxJRE0gTW9uaXRvciByZWdpb24+IG1lbSAweDIxMDA4OTAwLTB4 MjEwMDhhZmYgaXJxIDkyIG9uIGJjbV9pZG0wXAppZG1fbW9uaXRvcjU6IDxJRE0gTW9uaXRvciBy ZWdpb24+IG1lbSAweDIxMDA5OTAwLTB4MjEwMDlhZmYgaXJxIDkzIG9uIGJjbV9pZG0wXAppZG1f bW9uaXRvcjY6IDxJRE0gTW9uaXRvciByZWdpb24+IG1lbSAweDUxMDA0OTAwLTB4NTEwMDRhZmYg aXJxIDk0IG9uIGJjbV9pZG0wXAppZG1fbW9uaXRvcjc6IDxJRE0gTW9uaXRvciByZWdpb24+IG1l bSAweDUxMDA1OTAwLTB4NTEwMDVhZmYgaXJxIDk1IG9uIGJjbV9pZG0wXAppZG1fbW9uaXRvcjg6 IDxJRE0gTW9uaXRvciByZWdpb24+IG1lbSAweDUxMDA2OTAwLTB4NTEwMDZhZmYgaXJxIDk2IG9u IGJjbV9pZG0wXAppZG1fbW9uaXRvcjk6IDxJRE0gTW9uaXRvciByZWdpb24+IG1lbSAweDUxMDA3 OTAwLTB4NTEwMDdhZmYgaXJxIDk3IG9uIGJjbV9pZG0wXAppZG1fbW9uaXRvcjEwOiA8SURNIE1v bml0b3IgcmVnaW9uPiBtZW0gMHg1MTAwODkwMC0weDUxMDA4YWZmIGlycSA5OCBvbiBiY21faWRt MFwKaWRtX21vbml0b3IxMTogPElETSBNb25pdG9yIHJlZ2lvbj4gbWVtIDB4NTEwMDk5MDAtMHg1 MTAwOWFmZiBpcnEgOTkgb24gYmNtX2lkbTBcCmlkbV9tb25pdG9yMTI6IDxJRE0gTW9uaXRvciBy ZWdpb24+IG1lbSAweDYwZTAwOTAwLTB4NjBlMDBhZmYgaXJxIDEwMCBvbiBiY21faWRtMFwKaWRt X21vbml0b3IxMzogPElETSBNb25pdG9yIHJlZ2lvbj4gbWVtIDB4NjBlMDE5MDAtMHg2MGUwMWFm ZiBpcnEgMTAxIG9uIGJjbV9pZG0wXAppZG1fbW9uaXRvcjE0OiA8SURNIE1vbml0b3IgcmVnaW9u PiBtZW0gMHg2MGUwMjkwMC0weDYwZTAyYWZmIGlycSAxMDIgb24gYmNtX2lkbTBcCmlkbV9tb25p dG9yMTU6IDxJRE0gTW9uaXRvciByZWdpb24+IG1lbSAweDYwZTA1OTAwLTB4NjBlMDVhZmYgaXJx IDEwMyBvbiBiY21faWRtMFwKaWRtX21vbml0b3IxNjogPElETSBNb25pdG9yIHJlZ2lvbj4gbWVt IDB4NjEwOTE5MDAtMHg2MTA5MWFmZiBpcnEgMTA0IG9uIGJjbV9pZG0wXAppZG1fbW9uaXRvcjE3 OiA8SURNIE1vbml0b3IgcmVnaW9uPiBtZW0gMHg2MTA5MjkwMC0weDYxMDkyYWZmIGlycSAxMDUg b24gYmNtX2lkbTBcCmlkbV9tb25pdG9yMTg6IDxJRE0gTW9uaXRvciByZWdpb24+IG1lbSAweDYx NDAwOTAwLTB4NjE0MDBhZmYgaXJxIDEwNiBvbiBiY21faWRtMFwKaWRtX21vbml0b3IxOTogPElE TSBNb25pdG9yIHJlZ2lvbj4gbWVtIDB4NjE0MDE5MDAtMHg2MTQwMWFmZiBpcnEgMTA3IG9uIGJj bV9pZG0wXAppZG1fbW9uaXRvcjIwOiA8SURNIE1vbml0b3IgcmVnaW9uPiBtZW0gMHg2MTQwMjkw MC0weDYxNDAyYWZmIGlycSAxMDggb24gYmNtX2lkbTBcCmlkbV9tb25pdG9yMjE6IDxJRE0gTW9u aXRvciByZWdpb24+IG1lbSAweDYxNDA0OTAwLTB4NjE0MDRhZmYgaXJxIDEwOSBvbiBiY21faWRt MFwKaWRtX21vbml0b3IyMjogPElETSBNb25pdG9yIHJlZ2lvbj4gbWVtIDB4NjE0MDY5MDAtMHg2 MTQwNmFmZiBpcnEgMTEwIG9uIGJjbV9pZG0wXAppZG1fbW9uaXRvcjIzOiA8SURNIE1vbml0b3Ig cmVnaW9uPiBtZW0gMHg2MTQwNzkwMC0weDYxNDA3YWZmIGlycSAxMTEgb24gYmNtX2lkbTBcCmlk bV9tb25pdG9yMjQ6IDxJRE0gTW9uaXRvciByZWdpb24+IG1lbSAweDYxNDBjOTAwLTB4NjE0MGNh ZmYgaXJxIDExMiBvbiBiY21faWRtMFwKaWRtX21vbml0b3IyNTogPElETSBNb25pdG9yIHJlZ2lv bj4gbWVtIDB4NjE0MGU5MDAtMHg2MTQwZWFmZiBpcnEgMTEzIG9uIGJjbV9pZG0wXAppZG1fbW9u aXRvcjI2OiA8SURNIE1vbml0b3IgcmVnaW9uPiBtZW0gMHg2MTQwZjkwMC0weDYxNDBmYWZmIGly cSAxMTQgb24gYmNtX2lkbTBcCmlkbV9tb25pdG9yMjc6IDxJRE0gTW9uaXRvciByZWdpb24+IG1l bSAweDY1MzcxOTAwLTB4NjUzNzFhZmYgaXJxIDExNSBvbiBiY21faWRtMFwKaWRtX21vbml0b3Iy ODogPElETSBNb25pdG9yIHJlZ2lvbj4gbWVtIDB4NjUzNzI5MDAtMHg2NTM3MmFmZiBpcnEgMTE2 IG9uIGJjbV9pZG0wXAppZG1fbW9uaXRvcjI5OiA8SURNIE1vbml0b3IgcmVnaW9uPiBtZW0gMHg2 NTM3MzkwMC0weDY1MzczYWZmIGlycSAxMTcgb24gYmNtX2lkbTBcCmlkbV9tb25pdG9yMzA6IDxJ RE0gTW9uaXRvciByZWdpb24+IG1lbSAweDY1Mzc0OTAwLTB4NjUzNzRhZmYgaXJxIDExOCBvbiBi Y21faWRtMFwKaWRtX21vbml0b3IzMTogPElETSBNb25pdG9yIHJlZ2lvbj4gbWVtIDB4NjUzNzU5 MDAtMHg2NTM3NWFmZiBpcnEgMTE5IG9uIGJjbV9pZG0wXAppZG1fbW9uaXRvcjMyOiA8SURNIE1v bml0b3IgcmVnaW9uPiBtZW0gMHg2NTM3NjkwMC0weDY1Mzc2YWZmIGlycSAxMjAgb24gYmNtX2lk bTBcCmlkbV9tb25pdG9yMzM6IDxJRE0gTW9uaXRvciByZWdpb24+IG1lbSAweDY1Mzc3OTAwLTB4 NjUzNzdhZmYgaXJxIDEyMSBvbiBiY21faWRtMFwKaWRtX21vbml0b3IzNDogPElETSBNb25pdG9y IHJlZ2lvbj4gbWVtIDB4NjUzNzg5MDAtMHg2NTM3OGFmZiBpcnEgMTIyIG9uIGJjbV9pZG0wXApp ZG1fbW9uaXRvcjM1OiA8SURNIE1vbml0b3IgcmVnaW9uPiBtZW0gMHg2NTM3OTkwMC0weDY1Mzc5 YWZmIGlycSAxMjMgb24gYmNtX2lkbTBcCmlkbV9tb25pdG9yMzY6IDxJRE0gTW9uaXRvciByZWdp b24+IG1lbSAweDY1MzdhOTAwLTB4NjUzN2FhZmYgaXJxIDEyNCBvbiBiY21faWRtMFwKaWRtX21v bml0b3IzNzogPElETSBNb25pdG9yIHJlZ2lvbj4gbWVtIDB4NjcwMDU5MDAtMHg2NzAwNWFmZiBp cnEgMTI1IG9uIGJjbV9pZG0wXAppZG1fbW9uaXRvcjM4OiA8SURNIE1vbml0b3IgcmVnaW9uPiBt ZW0gMHg2NzAxNTkwMC0weDY3MDE1YWZmIGlycSAxMjggb24gYmNtX2lkbTBcCmlkbV9tb25pdG9y Mzk6IDxJRE0gTW9uaXRvciByZWdpb24+IG1lbSAweDY3MDE2OTAwLTB4NjcwMTZhZmYgaXJxIDEy OSBvbiBiY21faWRtMFwKaWRtX21vbml0b3I0MDogPElETSBNb25pdG9yIHJlZ2lvbj4gbWVtIDB4 NjcwMTc5MDAtMHg2NzAxN2FmZiBpcnEgMTMwIG9uIGJjbV9pZG0wXAppZG1fbW9uaXRvcjQxOiA8 SURNIE1vbml0b3IgcmVnaW9uPiBtZW0gMHg2NzAxOTkwMC0weDY3MDE5YWZmIGlycSAxMzIgb24g YmNtX2lkbTBcCmlkbV9tb25pdG9yNDI6IDxJRE0gTW9uaXRvciByZWdpb24+IG1lbSAweDY3MDIw OTAwLTB4NjcwMjBhZmYgaXJxIDEzNSBvbiBiY21faWRtMFwKaWRtX21vbml0b3I0MzogPElETSBN b25pdG9yIHJlZ2lvbj4gbWVtIDB4NjcwMjE5MDAtMHg2NzAyMWFmZiBpcnEgMTM2IG9uIGJjbV9p ZG0wXAppZG1fbW9uaXRvcjQ0OiA8SURNIE1vbml0b3IgcmVnaW9uPiBtZW0gMHg2NzAyMjkwMC0w eDY3MDIyYWZmIGlycSAxMzcgb24gYmNtX2lkbTBcCmlkbV9tb25pdG9yMTA6IEVycm9yIGRldGVj dGVkIGZvciBkZXZpY2UgbW9uaXRvciBwY2llXzFfYXBidFwKaWRtX21vbml0b3IxNDogRXJyb3Ig ZGV0ZWN0ZWQgZm9yIGRldmljZSBtb25pdG9yIG5pY19heGkyYXBiX3NcCmlkbV9tb25pdG9yMzE6 IEVycm9yIGRldGVjdGVkIGZvciBkZXZpY2UgbW9uaXRvciBzY3JfZGRyX3NcCmlkbV9tb25pdG9y NDE6IEVycm9yIGRldGVjdGVkIGZvciBkZXZpY2UgbW9uaXRvciBoc19hcGJzXAotLS0tLUluIHNj aGVkX2FkZCBhbmQgdGQgPSAweGZmZmYwMDAwNDFkYjYyNjAsIGNwdT0tNjU1MzYsIGZsYWdzID0g MHg0XAotLS0tLS0tSW4gc2NoZWRfc2V0Y3B1IC0tLS0tLVwKRmF0YWwgZGF0YSBhYm9ydDpcCiAg eDA6IDFiZmYwMDIwMWM2ODFjYjhcCiAgeDE6ICAgICAgICAgICAgICAgIDBcCiAgeDI6IGZmZmYw MDAwMDA0OWYzMDUgKG5vdGlmeS5wcmVmaXggKyBhYzYpXAogIHgzOiAgICAgICAgICAgICAgNTFl XAogIHg0OiBmZmZmMDAwMDAwNDI3OGQzIChjYW1fc3RhdHVzX3RhYmxlICsgZWYwYilcCiAgeDU6 IGZmZmYwMDAwMDJmMDhkYzggKF9lbmQgKyAxMGIzZGM4KVwKICB4NjogZmZmZjAwMDAwMmYwODEw MCAoX2VuZCArIDEwYjMxMDApXAogIHg3OiAgICAgICAgICAgICAgICAwXAogIHg4OiBmZmZmMDAw MDAwNjhiYWMwIChpbml0c3RhY2sgKyAzYWMwKVwKICB4OTogICAgICAgICAgICAgICAgMVwKIHgx MDogZmZmZjAwMDAwMDY4YmFjMCAoaW5pdHN0YWNrICsgM2FjMClcCiB4MTE6IGZmZmYwMDAwMDAz YzMwYWMgKGdldF9jbnR4Y3QgKyAwKVwKIHgxMjogNjYwMDBhMmQyZDJkMmQyZFwKIHgxMzogICBm ZjAxMDAwMDAwMDAwMFwKIHgxNDogICAgICAgICAgICAgICAgMFwKIHgxNTogICAgICAgICAgICAg ICAgMFwKIHgxNjogICAgICAgICAgICAgICAgMFwKIHgxNzogICAgICAgICAgICAgICAgMFwKIHgx ODogZmZmZjAwMDAwMDY4YjY0MCAoaW5pdHN0YWNrICsgMzY0MClcCiB4MTk6IGZmZmYwMDAwNDFk YjYyNjAgKF9lbmQgKyAzZmY2MTI2MClcCiB4MjA6ICAgICAgICAgICAgICAgIDRcCiB4MjE6IDFi ZmYwMDIwMWM2ODFjYjhcCiB4MjI6IDFiZmYwMDIwMWM2ODFjYTBcCiB4MjM6IGZmZmYwMDAwMDA2 OGMwYjQgKHhzb2Z0YyArIDI0KVwKIHgyNDogZmZmZjAwMDA0MWQ5OTI4MCAoX2VuZCArIDNmZjQ0 MjgwKVwKIHgyNTogZmZmZmEwMDAwMDI3Mjg2MFwKIHgyNjogZmZmZjAwMDAwMDY4YmFjMCAoaW5p dHN0YWNrICsgM2FjMClcCiB4Mjc6ICAgICAgICAgICAgICAgIDFcCiB4Mjg6ICAgICAgICAgICAg ICAgIDBcCiB4Mjk6IGZmZmYwMDAwMDA2OGI2NTAgKGluaXRzdGFjayArIDM2NTApXAogIHNwOiBm ZmZmMDAwMDAwNjhiNjQwXAogIGxyOiBmZmZmMDAwMDAwMjI0NTE0IChzY2hlZF9hZGQgKyAyMDAp XAogZWxyOiBmZmZmMDAwMDAwMWNhNmUwIChfX210eF9sb2NrX3NwaW5fZmxhZ3MgKyAyMClcCnNw c3I6ICAgICAgICAgMjAwMDAyYzVcCiBmYXI6IDFiZmYwMDIwMWM2ODFjYjhcCiBlc3I6IDAwMDAw MDAwOTYwMDAwMDRcCnBhbmljOiB2bV9mYXVsdCBmYWlsZWQ6IGZmZmYwMDAwMDAxY2E2ZTAgZXJy b3IgMVwKY3B1aWQgPSAwXAp0aW1lID0gMVwKS0RCOiBzdGFjayBiYWNrdHJhY2U6XApkYl90cmFj ZV9zZWxmKCkgYXQgZGJfdHJhY2Vfc2VsZlwKZGJfdHJhY2Vfc2VsZl93cmFwcGVyKCkgYXQgZGJf dHJhY2Vfc2VsZl93cmFwcGVyKzB4MzBcCnZwYW5pYygpIGF0IHZwYW5pYysweDIzY1wKcGFuaWMo KSBhdCBwYW5pYysweDQ0XApkYXRhX2Fib3J0KCkgYXQgZGF0YV9hYm9ydCsweDMzY1wKaGFuZGxl X2VsMWhfc3luYygpIGF0IGhhbmRsZV9lbDFoX3N5bmMrMHgxMFwKLS0tIGV4Y2VwdGlvbiwgZXNy IDBcCihudWxsKSgpIGF0IDBcCktEQjogZW50ZXI6IHBhbmljXApbIHRocmVhZCBwaWQgMCB0aWQg MTAwMDAwIF1cClN0b3BwZWQgYXQgICAgICBrZGJfZW50ZXIrMHg0MDogdW5kZWZpbmVkICAgICAg IGY5MDQ5MjdmXApkYj4gYnRcClRyYWNpbmcgcGlkIDAgdGlkIDEwMDAwMCB0ZCAweGZmZmYwMDAw MDA4MTY2YTBcCmRiX3RyYWNlX3NlbGYoKSBhdCBkYl90cmFjZV9zZWxmXApkYl9zdGFja190cmFj ZSgpIGF0IGRiX3N0YWNrX3RyYWNlKzB4MTFjXApkYl9jb21tYW5kKCkgYXQgZGJfY29tbWFuZCsw eDJiNFwKZGJfY29tbWFuZF9sb29wKCkgYXQgZGJfY29tbWFuZF9sb29wKzB4NTRcCmRiX3RyYXAo KSBhdCBkYl90cmFwKzB4ZjhcCmtkYl90cmFwKCkgYXQga2RiX3RyYXArMHgyMGNcCmhhbmRsZV9l bDFoX3N5bmMoKSBhdCBoYW5kbGVfZWwxaF9zeW5jKzB4MTBcCi0tLSBleGNlcHRpb24sIGVzciAw XApjcmVhdGVfcGFnZXRhYmxlcygpIGF0IGNyZWF0ZV9wYWdldGFibGVzKzB4NDNcCmRiPiBzaG93 ID9cClN1YmNvbW1hbmQgcmVxdWlyZWQ7IGF2YWlsYWJsZSBzdWJjb21tYW5kczpcCmFjdGl2ZSAg ICAgICAgICBhbGwgICAgICAgICAgICAgYWxsY2hhaW5zICAgICAgIGFsbGxvY2tzXAphbGxwY3B1 ICAgICAgICAgYWxscm1hbiAgICAgICAgIGJhZHN0YWNrcyAgICAgICBiaW9cCmJyZWFrcyAgICAg ICAgICBidWZmZXIgICAgICAgICAgYnVmcXVldWVzICAgICAgIGNhbGxvdXRcCmNhbGxvdXRfbGFz dCAgICBjZGV2ICAgICAgICAgICAgY2xvY2tzb3VyY2UgICAgIGNvbmlmaGtcCmNwdXNldHMgICAg ICAgICBjcnlwdG8gICAgICAgICAgZGV2aWNlICAgICAgICAgIGRldm1hcFwKZG9tYWluICAgICAg ICAgIGRvbWFpbnNldHMgICAgICBkcGNwdV9vZmYgICAgICAgZmZzXApmaWxlICAgICAgICAgICAg ZmlsZXMgICAgICAgICAgIGZyZWVwYWdlcyAgICAgICBnZW9tXApnaWMgICAgICAgICAgICAgaW50 ciAgICAgICAgICAgIGludHJjbnQgICAgICAgICBpcnFzXAprdHIgICAgICAgICAgICAgbG9jayAg ICAgICAgICAgIGxvY2tjaGFpbiAgICAgICBsb2NrZWRidWZzXApsb2NrZWR2bm9kcyAgICAgbG9j a3MgICAgICAgICAgIGxvY2t0cmVlICAgICAgICBtYWxsb2NcCm1hcCAgICAgICAgICAgICBtb3Vu dCAgICAgICAgICAgbXNnYnVmICAgICAgICAgIG9iamVjdFwKcGFnZSAgICAgICAgICAgIHBhZ2Vx ICAgICAgICAgICBwYW5pYyAgICAgICAgICAgcGNpZXJyXApwY2lyZWdzICAgICAgICAgcGNwdSAg ICAgICAgICAgIHBjdHJpZW5vZGUgICAgICBwZ2luZm9cCnBncnBkdW1wICAgICAgICBwaHlzbWVt ICAgICAgICAgcHJpc29uICAgICAgICAgIHByb2NcCnByb2N2bSAgICAgICAgICBwcm90b3N3ICAg ICAgICAgcmFkaXhub2RlICAgICAgIHJhbmdlc2V0XApyZWdpc3RlcnMgICAgICAgcm1hbiAgICAg ICAgICAgIHJtYW5zICAgICAgICAgICBzZF9hbGxpbm9kZWRlcHNcCnNkX2FsbG9jZGlyZWN0ICBz ZF9hbGxvY2luZGlyICAgc2RfaW5vZGVkZXAgICAgIHNkX21rZGlyXApzZF9ta2Rpcl9saXN0ICAg c2Rfd29ya2hlYWQgICAgIHNkX3dvcmtsaXN0ICAgICBzbGVlcGNoYWluXApzbGVlcHEgICAgICAg ICAgc2xlZXBxdWV1ZSAgICAgIHNvY2tidWYgICAgICAgICBzb2NrZXRcCnNwZWNpYWxyZWdzICAg ICBzeXNpbml0ICAgICAgICAgdGhyZWFkICAgICAgICAgIHRocmVhZHNcCnRpbWVjb3VudGVyICAg ICB0bXBmcyAgICAgICAgICAgdHR5ICAgICAgICAgICAgIHR1cm5zdGlsZVwKdW1hICAgICAgICAg ICAgIHVtYWNhY2hlICAgICAgICB1bnBjYiAgICAgICAgICAgdm1lbVwKdm1lbWR1bXAgICAgICAg IHZtb2NoayAgICAgICAgICB2bW9wYWcgICAgICAgICAgdm5vZGVcCnZub2RlYnVmcyAgICAgICB2 cGF0aCAgICAgICAgICAgdnRvcCAgICAgICAgICAgIHdhdGNoZXNcCndpdG5lc3NcClRoZSBmb2xs b3dpbmcgaGF2ZSBzdWJjb21tYW5kczsgYXBwZW5kICJoZWxwIiB0byBsaXN0IChlLmcuICJzaG93 IGhlbHAiKTpcCmFjdGl2ZSAgICAgICAgICBhbGxcCmRiPiBzaG93IGFsbHBjcHVcCkN1cnJlbnQg Q1BVOiAwXApcCmNwdWlkICAgICAgICA9IDBcCmR5bmFtaWMgcGNwdSA9IDB4Mjg4NjQ4MFwKY3Vy dGhyZWFkICAgID0gMHhmZmZmMDAwMDAwODE2NmEwOiBwaWQgMCB0aWQgMTAwMDAwIGNyaXRuZXN0 IDEgInN3YXBwZXIiXApjdXJwY2IgICAgICAgPSAweGZmZmYwMDAwMDA2OGJiNDBcCmZwY3VydGhy ZWFkICA9IG5vbmVcCmlkbGV0aHJlYWQgICA9IDB4ZmZmZjAwMDA0MWI4MjAwMDogdGlkIDEwMDAw MyAiaWRsZTogY3B1MCJcCnNwaW4gbG9ja3MgaGVsZDpcClwKY3B1aWQgICAgICAgID0gMVwKZHlu YW1pYyBwY3B1ID0gMHg0MTM5MzY4MFwKY3VydGhyZWFkICAgID0gbm9uZVwKY3VycGNiICAgICAg ID0gMFwKZnBjdXJ0aHJlYWQgID0gbm9uZVwKaWRsZXRocmVhZCAgID0gMHhmZmZmMDAwMDQxYjgx ODgwOiB0aWQgMTAwMDA0ICJpZGxlOiBjcHUxIlwKc3BpbiBsb2NrcyBoZWxkOlwKXApjcHVpZCAg ICAgICAgPSAyXApkeW5hbWljIHBjcHUgPSAweDQxMzllNjgwXApjdXJ0aHJlYWQgICAgPSBub25l XApjdXJwY2IgICAgICAgPSAwXApmcGN1cnRocmVhZCAgPSBub25lXAppZGxldGhyZWFkICAgPSAw eGZmZmYwMDAwNDFiODEyNjA6IHRpZCAxMDAwMDUgImlkbGU6IGNwdTIiXApzcGluIGxvY2tzIGhl bGQ6XAogICAgICAgIFwKY3B1aWQgICAgICAgID0gM1wKZHluYW1pYyBwY3B1ID0gMHg0MTNhOTY4 MFwKY3VydGhyZWFkICAgID0gbm9uZVwKY3VycGNiICAgICAgID0gMFwKZnBjdXJ0aHJlYWQgID0g bm9uZVwKaWRsZXRocmVhZCAgID0gMHhmZmZmMDAwMDQxYjgwYzQwOiB0aWQgMTAwMDA2ICJpZGxl OiBjcHUzIlwKc3BpbiBsb2NrcyBoZWxkOlwKICAgICAgICBcCmRiPiAgICAgXAp9 --_004_BYAPR05MB6677FCA278A0C5FED1B9B423B725ABYAPR05MB6677namp_-- From nobody Fri Jun 30 05:03:25 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Qsjrp3JJQz4kdc0 for ; Fri, 30 Jun 2023 05:03:38 +0000 (UTC) (envelope-from ekimyekim@gmail.com) Received: from mail-lj1-x235.google.com (mail-lj1-x235.google.com [IPv6:2a00:1450:4864:20::235]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Qsjrp2wQ5z3wCP for ; Fri, 30 Jun 2023 05:03:38 +0000 (UTC) (envelope-from ekimyekim@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-lj1-x235.google.com with SMTP id 38308e7fff4ca-2b6985de215so23644891fa.2 for ; Thu, 29 Jun 2023 22:03:38 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1688101417; x=1690693417; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=e7SnlQH7E6Nt8Y6NZd3TA9+Y2me8bxAqAm2oiDotxY8=; b=rpFiY9hDEf5tt/J9S8u2y2gTm8vdu32jIxpMnUKJOZCJ+J7F9auGLzIcTLbjzGWpds hmMCXaQfjPqEh2Swzvci0+uFswmS8edCdKnN3wh4GbSphQYeBYa8mgmx4OC4XYYeljBt EhcRX6mUiEJgC6nk3LESBZPAxZFQwC2B7QGT8eQzqV7atG029I2zJ3UwFhlahDzZHGtd vAN8nHRRR/ar+D8IEuH6eXUzp1yZOWszXcLIN06ylLov24u2OEBq9d3QU/rS9lBifoEA e6VtptXFfTUgcGmL0QSK9J8P3vsU3TvVJYreegSLmEsdv8inAdIybOb5c+gzFU6TwA2o BfzQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1688101417; x=1690693417; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=e7SnlQH7E6Nt8Y6NZd3TA9+Y2me8bxAqAm2oiDotxY8=; b=E8E5jYO5dmIsyLpfEcf7mJgn3cuM0pt9AtDOp2p8Y5sFmcDMFeVAXXwhc7DDKT1VxI 4nDlc67+JNi8ySQCvUqFMet21BfHjN7SuUdF4Uw1Qq2p5bnuZNCIJTCFHnA0nfyigyUf SJ7aJ1V7hiNWWjuzpisjnchB09rATYvdSkuavtARacQRG/lS9vKQ825AddrCFOVCnuFt 0heoWA16FDN1VKo+LAD0XUFiaqWU3sfEnA0wNj5Nhbo42WaTtJm3vWmmH1SsCYPtDE66 4cS4u+iHFBPerPTSxiq2QcPTjzWG8EdxFDMkT3YGV40MKGv95Uwt3W2FPnY2xkwdXSUA h8Hw== X-Gm-Message-State: ABy/qLaJcrTmOrgpWg6WALrPmf8uMW3xx7at8QoKeHtILo3vxwfL6MDu n3U9izzvQG5x7p8FwHsFt06CoZXxHU70q5aOUDVfoqyCKJA= X-Google-Smtp-Source: APBJJlG59x1Vxcr6BL5szK4G7ItOQgPPq82DVMJHntFQ7Iauv1kua3UdrTdZ40ejUmovvgIdyun43SA8CC6QzfImKAY= X-Received: by 2002:a2e:9059:0:b0:2b6:9f95:46d9 with SMTP id n25-20020a2e9059000000b002b69f9546d9mr1115367ljg.46.1688101416742; Thu, 29 Jun 2023 22:03:36 -0700 (PDT) List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 References: <2B6B8CF6-D9B4-4E02-8C02-C1174879736B@yahoo.com> In-Reply-To: <2B6B8CF6-D9B4-4E02-8C02-C1174879736B@yahoo.com> From: Michael P Date: Thu, 29 Jun 2023 22:03:25 -0700 Message-ID: Subject: Re: cancelling subscription To: Mark Millard Cc: freebsd-arm@freebsd.org Content-Type: multipart/alternative; boundary="0000000000004a35cc05ff51bd60" X-Rspamd-Queue-Id: 4Qsjrp2wQ5z3wCP X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N --0000000000004a35cc05ff51bd60 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Thank you! On Thu, Jun 29, 2023 at 10:18=E2=80=AFAM Mark Millard w= rote: > On Jun 29, 2023, at 09:11, Michael P wrote: > > Hello, > > > I subscribed to this mailing list not long ago, thinking it was a list > supporting FreeBSD on the Raspberry Pi. I find that it is not what I was > looking for. I get emails constantly that are of no use to me. > > freebsd-arm is the primary list that spans such. None are > limited to RPi*'s. So, probably, no FreeBSD list meets your > criteria. > > > How do I unsubscribe from this list? > > https://lists.freebsd.org/subscription/freebsd-arm > > has both the various subscribe links and the various unsubscribe > links, as well as a user input and buttons for such. > > =3D=3D=3D > Mark Millard > marklmi at yahoo.com > > --0000000000004a35cc05ff51bd60 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Thank=C2=A0you!=C2=A0

On Thu, Jun 29, 2023 at 10:18=E2= =80=AFAM Mark Millard <marklmi@yaho= o.com> wrote:
On Jun 29, 2023, at 09:11, Michael P <ekimyekim@gmail.com> wrote:

Hello,

> I subscribed to this mailing list not long ago, thinking it was a list= supporting FreeBSD on the Raspberry Pi.=C2=A0 I find that it is not what I= was looking for. I get emails constantly that are of no use to me.

freebsd-arm is the primary list that spans such. None are
limited to RPi*'s. So, probably, no FreeBSD list meets your
criteria.

> How do I unsubscribe from this list?

https://lists.freebsd.org/subscription/freebsd-arm=

has both the various subscribe links and the various unsubscribe
links, as well as a user input and buttons for such.

=3D=3D=3D
Mark Millard
marklmi at yahoo.com

--0000000000004a35cc05ff51bd60-- From nobody Fri Jun 30 10:55:47 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4QssgW4Rwbz4k2rJ for ; Fri, 30 Jun 2023 10:56:07 +0000 (UTC) (envelope-from bounce.0ob2vd7e30=qrp3nja9gs5h=qzqyo1xtw5@em790814.fubar.geek.nz) Received: from e2i947.smtp2go.com (e2i947.smtp2go.com [103.2.143.179]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4QssgS0Mscz3pHM for ; Fri, 30 Jun 2023 10:56:03 +0000 (UTC) (envelope-from bounce.0ob2vd7e30=qrp3nja9gs5h=qzqyo1xtw5@em790814.fubar.geek.nz) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=smtpservice.net header.s=a1-4 header.b="0/qpMZvs"; dkim=pass header.d=fubar.geek.nz header.s=s790814 header.b=J6Mjfwb6; spf=pass (mx1.freebsd.org: domain of "bounce.0ob2vd7e30=qrp3nja9gs5h=qzqyo1xtw5@em790814.fubar.geek.nz" designates 103.2.143.179 as permitted sender) smtp.mailfrom="bounce.0ob2vd7e30=qrp3nja9gs5h=qzqyo1xtw5@em790814.fubar.geek.nz"; dmarc=pass (policy=none) header.from=fubar.geek.nz Received: from [10.99.243.232] (helo=morbo.fubar.geek.nz) by smtpcorp.com with esmtpsa (TLS1.3:ECDHE_X25519__RSA_PSS_RSAE_SHA256__AES_256_GCM:256) (Exim 4.96-S2G) (envelope-from ) id 1qFBn6-9EVQFc-2D; Fri, 30 Jun 2023 10:55:52 +0000 Received: from webmail.fubar.geek.nz (calculon.fubar.geek.nz [162.55.43.65]) by morbo.fubar.geek.nz (Postfix) with ESMTPSA id D6E611DEF3; Fri, 30 Jun 2023 10:55:47 +0000 (UTC) List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Date: Fri, 30 Jun 2023 11:55:47 +0100 From: andrew@fubar.geek.nz To: Mahesh Vardhamanaiah Cc: Sha Faisal , "freebsd-arm@FreeBSD.org" , Steve Kiernan , Amit Verma Subject: Re: Kernel crash before login prompt In-Reply-To: References: <6537067F-670A-4B52-87FA-FF2DBAD68120@fubar.geek.nz> <1327534fa4a1da584a3a38b194999595@fubar.geek.nz> Message-ID: <2bf93ae22548705e689e0bdd47f9d7db@fubar.geek.nz> X-Sender: andrew@fubar.geek.nz Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit X-smtpcorp-track: 1qFUn69EVQFc2D.nXS5kqWXjMVr3 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=smtpservice.net; i=@smtpservice.net; q=dns/txt; s=a1-4; t=1688122559; h=feedback-id : x-smtpcorp-track : date : message-id : to : subject : from : reply-to : sender : list-unsubscribe; bh=fJYmevv7cSOh+uG8gEI2pzAisNOv0iWicNnJ28bah/I=; b=0/qpMZvsXgT7y7eIdTHIXq7z7TREvQ4aUTl5u1U4tkEi4wPB7cixr78vqK7QhP635qkBN 6B/SY9dmOR04HfVgbNLCwXSkVQCkx31rPRgmquvcoQp3jd6YzHe3oLzF6YeKiQ2grmzYxvG Hi3tm6xR+Jwxsl91kfW7zraeT44+v+s1FLTXJXhNI2zfFi0Zuk6/O7UGr4P1LlbfsJKGaiY jrC60iXqBDQnfsCPQCGjfpldXdHzfuztyId0PTIcNjLDNnFMyN0Lga5Aah/XT9ZJlyDI2j8 VrCuXo3xNHyLKtp0NBdpdCjkWJzMdIeCAO+NsiSiTr/LYUWDQM77Nauepslw== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=fubar.geek.nz; i=@fubar.geek.nz; q=dns/txt; s=s790814; t=1688122559; h=from : subject : to : message-id : date; bh=fJYmevv7cSOh+uG8gEI2pzAisNOv0iWicNnJ28bah/I=; b=J6Mjfwb6y6v52PWjakJJ59et6xVeLBhyNFybiyjZRF41YfesH9LOJB2KLhydo19o3Fb7F UdHOGVXqMgjuiRy4LzI6ysEyBZ/spBqMjxyDbW5WI+HljS4KihIz/eHE+beW2yW9AgNm8A4 2PfSoqAmX4PVGxWGTTU4p4XF3s0gEWA/YoX6OcWK2W/uzUdIZ1OD/jbeu/K6NgvghwPx4H1 s6DAytYIHosWR3rrBwHLdkhGHDBeykWWMQiAkZe69jKQEUiYtYHNUYRKpjn48VUJCpqPrB8 Sda4eobtkB2MRZybYLxrmuhsaJS3zi4i8CoSOZOPeirex0/3UDmwWvnp/Igg== X-Spamd-Result: default: False [-3.47 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.77)[-0.773]; DMARC_POLICY_ALLOW(-0.50)[fubar.geek.nz,none]; FORGED_SENDER(0.30)[andrew@fubar.geek.nz,bounce.0ob2vd7e30=qrp3nja9gs5h=qzqyo1xtw5@em790814.fubar.geek.nz]; R_SPF_ALLOW(-0.20)[+ip4:103.2.140.0/22]; R_DKIM_ALLOW(-0.20)[smtpservice.net:s=a1-4,fubar.geek.nz:s=s790814]; MIME_GOOD(-0.10)[text/plain]; ASN(0.00)[asn:23352, ipnet:103.2.140.0/22, country:US]; MLMMJ_DEST(0.00)[freebsd-arm@freebsd.org]; FROM_NO_DN(0.00)[]; MIME_TRACE(0.00)[0:+]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_TLS_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; DKIM_TRACE(0.00)[smtpservice.net:+,fubar.geek.nz:+]; TO_DN_SOME(0.00)[]; RCPT_COUNT_FIVE(0.00)[5]; ARC_NA(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; FROM_NEQ_ENVFROM(0.00)[andrew@fubar.geek.nz,bounce.0ob2vd7e30=qrp3nja9gs5h=qzqyo1xtw5@em790814.fubar.geek.nz] X-Rspamd-Queue-Id: 4QssgS0Mscz3pHM X-Spamd-Bar: --- X-ThisMailContainsUnwantedMimeParts: N On 2023-06-30 10:48, Mahesh Vardhamanaiah wrote: > Hi Andrew, > > We are observing that self is getting -65536 at line 1329 in > sched_pickcpu() before panic. What is the disassembly around reading the cpuid? It looks like it is getting 0xffff0000 when it should be zero. > > From the code flow > > sched_add [1](struct thread [2] *td [3], int flags [4])-> > sched_pickcpu()->PCPU_GET > > as below > > static int > > 1321 [5] sched_pickcpu [6](struct thread [2] *td [3], int flags [4]) > > 1322 [7] { > > 1323 [8] struct cpu_group [9] *cg [10], *ccg; > > 1324 [11] struct td_sched [12] *ts [13]; > > 1325 [14] struct tdq [15] *tdq [15]; > > 1326 [16] cpuset_t [17] *mask [18]; > > 1327 [19] int cpu [20], pri, r [21], self [22], intr; > > 1328 [23] > > 1329 [24] self [22] = PCPU_GET [25](cpuid [26]); > > PCPU_GET is defined differently in Freebsd14 compared to Freebsd12 but > I am unable to dump the pcpup in db> prompt is it proper ? > > Is it expected to be a global ? You can print all pcpu structs with "show allpcpu". Andrew