From nobody Thu Mar 16 18:53:29 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4PcxHY747bz3ySQ3 for ; Thu, 16 Mar 2023 18:53:45 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic312-24.consmr.mail.gq1.yahoo.com (sonic312-24.consmr.mail.gq1.yahoo.com [98.137.69.205]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4PcxHY4QVNz44kq for ; Thu, 16 Mar 2023 18:53:45 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1678992823; bh=GoywMVloqBckF92m/uvVjO1To8ZQlUuNF4gd4NcvXE8=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=Z+4yvx6NH5VXwmyCymV3GRwHWEwcGyBCUv574zAGW2YIeDNWFbA3LBtGvQAABSFdLbo8h4OtO3PeerPP2lZoC5XDkp+4n3vK0tLUg2BQMt/9VLkCQ3osAenbgzYCpFpR9Q7t6UvdG+ZTQW3bGqJXoQfuBw3s7GuFv8X0gncE+9Taf1hSxVuaBAEjXsxGsCAzLdbMudsKqgTxtmTLp5ZvvXuPCBK3mPTjmgiPYwU9Vmt+tfScOPk070njMRe4SxwlT01SJnAhul+bw+sIxtksL74a6Q+HdIpDQHQaT/V2O4XhCl+nXvX5edoLfsTY/He6RqigA/pdLO2x7m9j4j6bIA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1678992823; bh=ZDvzocVsIA5wbWJ+3JB//grzqYfYohwgdPDQz17irr3=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=S8pzeoVvhgTF7W5ncL/GJi+lOHvLSiUxst6AaV31IRwzRVOjFra7R2p7p3tVrptLEupYsWDOR5nZDzZ/ngTnrZzWZ/9Hw2DHU6KI8IpB1aVzTIIBM9rmJUodGdgyQqLGz6h9zmnz3J/az7EPIvrkxfkoQbSZK4FHj+heOra5o5sXpYLv7OcoJ0zfhH+qo16q92Iyy2nDlh/BJQNMyxIMmMX80gCwakrCnh/dhbfO6+56YPkolyupsvL32rtSsqlFks0/xqoGiERueeFLdi3TI7shVtcAauM53ELe712eDcJTtPZUtz0xjcrPkktajjpRgcxavYWES8zl9fuUQKVkOw== X-YMail-OSG: HODab9cVM1k89ZDyN7iZTjlz_U2w2o2Ui8JXBfQVgVaNlMKKTwKt_.gCJIRhiYv QkVEe2u5yRCuWtEZvOgLT5qUB.C4Ne2FRCcbk160NoqZnzVpdviwEtqluZ7OCCCxAH2iOEjvR1Zn X.6L0DjUtMRn2B3VuPRLspoVV1Kzoe7wCMtYSuvw0lvLZndaY.Nc96OqKRGRjMDoaIY8fXVg5z2f AJdPXuJ96LH_sWIwcHp0zdah7MbcmQAcoL6cnfgI800iMD8ikOA6hfsUj4TBZHMx8oEJ5doaruBS xPkvDShLZMV_fEm4b62D2q98NgkJerho..yX5ol_OY16xF.Qq.uSPHTeuq4Nhcsj3WV8gLrVRKbd 8peNQWNHPrDb_M_rHwE0N2L_OM4NQjU7BXSaZhCYhzLoI8Tc4BPrSmZ93PJ9yIMkKvQ5wKzZmL2u F87WcymJH.m0_Gks6Nn_N9MTLYPebgytkEShCWrxL7iMmpE.AnnuHghsIFhDDpBqnf9Y6dNUBbUh PSvDwQX68MP_Vqo1CYgI9Ign6PeuY8Lzh7YY.hzfZVPrKH53etWP9IyW.KMne7DIHsIzmJRV.VU1 OE7Sf24GCEBgGKX7DzAn5P_FkCmed6u00YjSprEd8f8g15zHQp6_grarah4eiKSOLtKUMJRuRm12 4JuRs7FP_C0IGJz3PygGyGjr7vx9SRLgHBFdIQI3jiHgR.ysONCkKyyBoDYMd01WC02MEAqit3I0 bBauWbhHW1rB9PrsyoleZSJq2F7v5BPDpkjqJkkKUIEre5neCRlmBaWdig1FfswSjaOQZyyKr3EL 2Gq.BfqScPp0Kh1sEcyg78vVIDNjKhoizfE5QxR0TAuLDxobxif81BszcOFK0RYGjVy9tcKh6.3W h6_weIASW5wi4256N5HYd58WwTd8mpad194WhGYb9wrfkUxdn4qgXdsyaiTq4dpLKEN80Akrpmtl fja0B66jeow__NR97CT99PPamTNolmjAmaajM4jZahd94tHMsyZs5p.UoL0ZR.UOPwCxeCNKkwrR or5odE0dD1AwLSJAIg1y5ziiKnBgn9xP03ibT8_Omk7rn.2Nm4BX4CzZFeSN7q7lpnWthiMJeAsz iPgJOTcQ0LJry2FR7vtq24GF1Szivmrx2qXRNHqP9NNf4r.njF6EVbIw4sPhrx4zd51gQXox9Hpk 7ygUAjo1qR4tYYnrrqts.s.ONm36Cte3NnbOfUsBrouBs5m6Mmo.C79FR5FzgY9Oqs_auU_JH6pe am77QUa9_rWGJ7EFKZEbcNefk1rvMBCb2cAj3M4lfS_ETOuNg7lsQqyLKC_NWOw5UBFA9M5udA8T sQi5Xqx5kMRJtUE0CZFHD4i.OECZ6z3n9eNEF4VNHyPe4J6cGhkmAQiJ4cn4ozTzfBH5hskBa2Q8 Gf75AwInphxC7yekWLJ9QMS7vext1j1qBwGD0OgeWlKqMPc8O5dXGZ6a7Q7iLnxfSw0PgY2QoyUv CigOMEZ85ad6FH1A3Lye8iFeaHNCJ8yJ_is2.XLE.pMOjRqMsgEvLcYcJeZ3JGhS2jeqoynzEM9B uzrNvs6riFae4vdC_GOg7M3opsvb34tycqLLXa02jr6GVQb9FOiuceSCcg4PMlHFsjx.kqBe8S2e DcE92oaHxawAr9w3CeFmCJBrPTQMq.SbF9XqHtlD7s6bQ_0RCxgxpR8FUv31uRLEtWXf8NRfCD_c SWfVSdljj2EpZFDweprwm9zo3xgyCMA1ilBz7AZ7G5UexMkDmkOxhmHzyR_us__UjetNtyF2VQJF UHyqqlf0TKwCFAj0scot1OEQdOmpKL.Z77Q8wm3IRLh6vUxvsJJrk63JFrn88up3II7VSZKa2Ox6 NDLBmSE19a5QPNMztDNQ2hVGy_GZkBSAK.YtLzC3FFvrHDP6vhosiQUNax47O7nrVBk79g40KLxc QEJ235QQSlbQ6KGaddl8tYc7CmuSgQj9zDbuP3vAg2P9I2XXefmqeJE4tMSFwOE8_suFbpWKZSVH J9vAJsnQ07smDWRfmPgkaf_88JjCzze5L9krh6Pj9tDFcyqnbG9nb1pUPw.dLQX408F.A.5UNCl5 kqR8m470Kfq68o0A.oVc2BgIrdyEBC.9s404bGRQHvYVre.QkzIzIHkBY7lc.vWEypPey2uO4v.T afaMJEuuVmPjASKIPsFlEiSd6r7P7Ag96rrczVYJcN7K9KUO_yFz80ucqXk9d23FBEOp9ZIIU7qe m1234aReGvisJyIHN7St7sf5AnJ9KPw9YQqq31S6Kz269HKCZJhsvvyQhdlr6C7les5i4QsyQCGS cyQ-- X-Sonic-MF: X-Sonic-ID: 398da7a4-49d4-4d32-b2c9-1283600a6ced Received: from sonic.gate.mail.ne1.yahoo.com by sonic312.consmr.mail.gq1.yahoo.com with HTTP; Thu, 16 Mar 2023 18:53:43 +0000 Received: by hermes--production-gq1-6cf7749bc8-72cjd (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 7cfa9dd4bbd77afefeff7bad1ddb9244; Thu, 16 Mar 2023 18:53:40 +0000 (UTC) Content-Type: text/plain; charset=utf-8 List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.400.51.1.1\)) Subject: Re: git: 3473f2832284 - main - Switch the arm64 VM_MEMATTR_DEVICE to nGnRE From: Mark Millard In-Reply-To: <402C0A31-BAE8-4A2C-87DB-C52813D62F5F@fubar.geek.nz> Date: Thu, 16 Mar 2023 11:53:29 -0700 Cc: freebsd-arm Content-Transfer-Encoding: quoted-printable Message-Id: References: <202303161646.32GGkB3A022273@gitrepo.freebsd.org> <402C0A31-BAE8-4A2C-87DB-C52813D62F5F@fubar.geek.nz> To: Andrew Turner X-Mailer: Apple Mail (2.3731.400.51.1.1) X-Rspamd-Queue-Id: 4PcxHY4QVNz44kq X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On Mar 16, 2023, at 09:53, Andrew Turner wrote: > I=E2=80=99ve pushed a change to relax the default device memory type = on arm64. This is now equivalent to the device memory type used on arm. >=20 > Because of this I expect most devices to just work, however if you are = seeing strange issues you can set kern.force_nonposted=3D1 in = loader.conf to revert to the previous memory type globally, or = hint...force_nonposted=3D1 to disable it for a specific = device. For example to disable it for xhci0 you would use = hint.xhci.0.force_nonposted=3D1. >=20 > If you do find this fixes an issue please report it so we can fix the = driver. A probably unfortunate issue relative to some types of testing is that drm-515-kmod and drm-510-kmod fail to build for aarch64 (arm64). (drm-510-kmod might not be reasonable for aarch64 for alll I know.) The current problem for drm-515-kmod is lack of in_interrupt via lack of sufficient #include use (that provides the macro definition involved): error: call to undeclared function 'in_interrupt' (I'm guessing that amd64 works only via some amd64 specific header polution that aarch64 does not get.) My vague understanding of issues that exist in Linux land may suggest that Cortex-A72's may have additional issues shown via video card use. An example is the video-related activity for the HoneyComb to avoid the issues. > Andrew >=20 >> Begin forwarded message: >>=20 >> From: Andrew Turner >> Subject: git: 3473f2832284 - main - Switch the arm64 = VM_MEMATTR_DEVICE to nGnRE >> Date: 16 March 2023 at 16:46:11 GMT >> To: src-committers@FreeBSD.org, dev-commits-src-all@FreeBSD.org, = dev-commits-src-main@FreeBSD.org >>=20 >> The branch main has been updated by andrew: >>=20 >> URL: = https://cgit.FreeBSD.org/src/commit/?id=3D3473f283228401ba585044ac6dea8c8e= b27237a5 >>=20 >> commit 3473f283228401ba585044ac6dea8c8eb27237a5 >> Author: Andrew Turner >> AuthorDate: 2023-03-16 15:36:06 +0000 >> Commit: Andrew Turner >> CommitDate: 2023-03-16 16:45:42 +0000 >>=20 >> Switch the arm64 VM_MEMATTR_DEVICE to nGnRE >>=20 >> Move device memory to a weaker type. The new device memory type = allows >> the system to acknowledge a write to a device before the write has >> completed. This is inline with VM_MEMATTR_DEVICE on armv6/armv7. >>=20 >> Sponsored by: Arm Ltd >> Differential Revision: https://reviews.freebsd.org/D38945 >> --- >> sys/arm64/include/vm.h | 6 +----- >> 1 file changed, 1 insertion(+), 5 deletions(-) >>=20 >> diff --git a/sys/arm64/include/vm.h b/sys/arm64/include/vm.h >> index e479aab52e26..a8c1ea97b513 100644 >> --- a/sys/arm64/include/vm.h >> +++ b/sys/arm64/include/vm.h >> @@ -36,11 +36,7 @@ >> #define VM_MEMATTR_WRITE_THROUGH 3 >> #define VM_MEMATTR_DEVICE_nGnRE 4 >>=20 >> -/* >> - * VM_MEMATTR_DEVICE can be changed to VM_MEMATTR_DEVICE_nGnRE when >> - * the PCI drivers use VM_MEMATTR_DEVICE_NP for their config space. >> - */ >> -#define VM_MEMATTR_DEVICE VM_MEMATTR_DEVICE_nGnRnE >> +#define VM_MEMATTR_DEVICE VM_MEMATTR_DEVICE_nGnRE >> #define VM_MEMATTR_DEVICE_NP VM_MEMATTR_DEVICE_nGnRnE >>=20 >> #ifdef _KERNEL >>=20 >=20 =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Sun Mar 19 01:59:17 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4PfLgQ5jsMz3yYNc for ; Sun, 19 Mar 2023 02:00:50 +0000 (UTC) (envelope-from warlock@phouka1.phouka.net) Received: from phouka1.phouka.net (phouka1.phouka.net [107.170.196.116]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "phouka.net", Issuer "Go Daddy Secure Certificate Authority - G2" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4PfLgP1S0Zz4NrP; Sun, 19 Mar 2023 02:00:49 +0000 (UTC) (envelope-from warlock@phouka1.phouka.net) Authentication-Results: mx1.freebsd.org; dkim=none; spf=none (mx1.freebsd.org: domain of warlock@phouka1.phouka.net has no SPF policy when checking 107.170.196.116) smtp.mailfrom=warlock@phouka1.phouka.net; dmarc=none Received: from phouka1.phouka.net (localhost [127.0.0.1]) by phouka1.phouka.net (8.17.1/8.17.1) with ESMTPS id 32J1xHhR002941 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Sat, 18 Mar 2023 18:59:17 -0700 (PDT) (envelope-from warlock@phouka1.phouka.net) Received: (from warlock@localhost) by phouka1.phouka.net (8.17.1/8.17.1/Submit) id 32J1xHbZ002940; Sat, 18 Mar 2023 18:59:17 -0700 (PDT) (envelope-from warlock) Date: Sat, 18 Mar 2023 18:59:17 -0700 From: John Kennedy To: Mark Millard Cc: Mike Karels , Mitchell Horne , freebsd-arm Subject: Re: reboot broken on RPi4 on main [breaks at git: e6cf1a0826c9 - main - physmem: add ram0 pseudo-driver] Message-ID: References: <9EA91B94-87E4-47B8-A4E2-60D556E64276@yahoo.com> <4FCD4987-6DAF-4889-B684-B6E464F41144@yahoo.com> <5E055A77-24DB-44D3-89F8-5113555283EA@karels.net> List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Spamd-Result: default: False [-1.48 / 15.00]; AUTH_NA(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-0.999]; NEURAL_HAM_SHORT(-0.68)[-0.679]; FORGED_SENDER(0.30)[warlock@phouka.net,warlock@phouka1.phouka.net]; MIME_GOOD(-0.10)[text/plain]; MID_RHS_MATCH_FROMTLD(0.00)[]; MLMMJ_DEST(0.00)[freebsd-arm@freebsd.org]; R_SPF_NA(0.00)[no SPF record]; FREEMAIL_TO(0.00)[yahoo.com]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; ASN(0.00)[asn:14061, ipnet:107.170.192.0/18, country:US]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; TO_DN_ALL(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; RCVD_COUNT_THREE(0.00)[3]; DMARC_NA(0.00)[phouka.net]; FROM_NEQ_ENVFROM(0.00)[warlock@phouka.net,warlock@phouka1.phouka.net] X-Rspamd-Queue-Id: 4PfLgP1S0Zz4NrP X-Spamd-Bar: - X-ThisMailContainsUnwantedMimeParts: N I'm not exactly sure when it got fix (it doesn't always hang, just almost always), but the last 2-3 reboots have succeeded without having to power cycle the pi. aee2f11bf4b was Ok (~3/18), 896516e54a8 is where I figured I couldn't be THAT lucky (~3/18) and maybe fixed as early as 6d33121337a (~3/15) or 626d1e4a82e (~3/13). I didn't see anything specifically call it out. From nobody Sun Mar 19 05:07:35 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4PfQqC1sGxz3ylLw for ; Sun, 19 Mar 2023 05:07:51 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic316-8.consmr.mail.gq1.yahoo.com (sonic316-8.consmr.mail.gq1.yahoo.com [98.137.69.32]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4PfQqB6V9dz3KbH for ; Sun, 19 Mar 2023 05:07:50 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1679202468; bh=acInzbLvbOn5Jkyx22MNeyBEFrxocie2c5OZhpxWR4w=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=RNsgEem+2DpHwvI+GVvjZ1seUOwBsKl3m/n/dqMaNJ2JsNdW1U/XCP9pefwx+KTsWYnCBBQ7N/mZjh7UfvVe/bMTPUHTjKhcuIaP9AE9JcWVpm1+ekh6jS7cQ9N9lSB+KJF9oBW8xbEUiogg67dT+dEQKRG9VMeEb+ARaTogCfIU9u363CyOua8yfgRo8Lm0koeyuuaWZztudda61hupRtVJh7z6U+0rdYqkeQ4Z0LFRE3MyHn6gCpEeHTnYlbxbHj37WqCW6oy6A3M7dCpMcshzz3lVd8ANQwM4NjW27wZxwC0mtAiNGPQaPfiFx9CR1HdAEZnbTL00VJz8OYZDZg== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1679202468; bh=cJFjrCRK4ZvPGCiUJpBlulq3jnFgbWOoQPTgQ2inISC=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=aQL/j5QdvkhE4THDGIM/wvJG0LVnee377Q6HS1KQmLw8LH/C03zJp1gjmcg/s+8WqkvHCp5ZusTros6jODva5VZl/Sq026E5gbm0Y7+48ZQBY5jlou3MxmUsDbV64+hCT9Yf0Yk2upx2CPg8uGHuRreQLUaRPSRWl8bzPITa32VSQ3Gb7laokDg2sEHeUFI42jm3m12x8GhvJZlsZ9Cgy3IJw0ty1Plutv3gyO7UfBIDi/bsQASpWI4dvlqZ0CaIk3YOC275IxV/nHz9iih6x2dE2S6RKyy71c6WxT1NGDlXi/izrXorgnVF+OWjdqWVaBkGNxUQld3px8kVs2IOAQ== X-YMail-OSG: mQFBfccVM1liJ0e9po.FZDMp0C13inQY1c9W0cQxF5sa.8ZttC_hJoq8u6YVDRE NxmEFeI8LztYW1TsiuhxKvaMoSxmktMZ_2ZQhO1B.s_PMQlsRvcMp4Mc4bFvXmXlorULbbUjGL_n GQWn3owqtsqZQJRL0Ue3FblaLQx6SSTrHIecJKuXm87b87IESbvXYNlASNNfB_vvyVMhYPQvkQsW nCHSZZPeIwtiCidJAqA1kVD4e2syE4faIa20UKNFd_2LfT4phjZHWIePjXa3PepnOvpC4ER1VjrT JWMUpw3Ct1uRFMOchMgSP2GwXenDgd7XOKn6wjEWZXtnKrVUn2ABRL_Qiw_sI4ymUqwjjxLcEeW2 .3dCVDsikL6wSudEz1t0wxZCbGNOGxicrjEBqxwQUlvJf_FzLffY7ROFk9AWRC46kdKippq_NmtF rgK.pNNCq8Jn2VRJ523AI7t_wnJa1VuEHb.2TzkpnncyGU1VRcKdcGL6iJ4FB_WOV.CUYJDopI9p E5N8mUVTFRMFb7jNFIpsHo8AAV4GzZ_qRPzzotci6Tlvu060uteIPeCwiU2L2zVS7q2u7yToRBn3 jbVNuex31DfwfHowSLOptF271MHL0G4IcFqRW63ToeFfteaNBo5yVUW2FJZV7eqvd6TJbCiV05yK bzsYnKuFdi7Fnc2GQW.V2YDbiF7hZyhP5EVFi6Ds79qj8x6yZ.Zl3UzxeW3cnN3oBLPU7Q4laLQE _yMm8Nb6qdxrrGsOuvw_ezPN2G09.kqop.PUn_IAeexvkCY3147whx.riyhJ3vyz39g4uDqSxvWb yxrQszzQVGg4AeTdi_Xxzrqo.feNRd_0LlLASpzQLTQZWoiPU7Y7nqfy_POu2h5nKqtQOgqtpsmh VYcCDZ9S01mm_aUmXvuYUek89kHvHdWWJE7x56qNX7pfXTXef856nqQGF_sKy8K5tv_lSvQAA3KH 9HFlHOSNH9puCadIi.NytCFEO6b2UBHLUuPDFidbAhoSqttZ_NWyeMYAIbx8c3dJCcrxCOU7Yh8G V27MSiGD70_QRmVx6mZrH4T8zDkSjKAD.zCq9AjJln5dNG9O1G.Px0Gey2jqE3MVN_q20owNKAJS KbzUK9QTNbpblLesFjeBP8KMcNiC_L3nPJ0wyuWhqe9QD.gXGxwUMGQ5bpMVCKM5afx0gsIEPAi5 Uu154DTCUocDFGllSnWjNGyGvQlOUd3PIYExrROetCxmdNbMR_KH_7gpdXMqMCT29S28zVH3urbn 3c6BWWNDYPD7vJuTp6q8dCorvDrsxOrzEgNWqCSfxksUpyTbfaK1kHSemLMUDVlyw8kwXByciBXp yWDQC.WlXfaCKw0iIHTwZVbUHm5Ytkr2VhHzafOiDVt_NO_U0_0nLXMPWxmqSPazVPlNStZnPYiz 9NvxlDdAEgyH7AQHQekzgzDt868OoPYDFYTHntfBJbi7YS.pge4O9OiVG9Nlyc9XQStDmehbGBrU t30QmHMZsGj78JiSD.h7vDCvUjfZE.6Z0ycTmTmFlRaJ_R6f_Fmn4HA4vVu_huWX40ru8r6Pcj9p UsjkpS3k.91FepC_KDuqUcjaKawAmSzf5qbvsbP47MRnbKaS.ocBQW47oidDJQkV.Xdx_rkU4gKI 6mzDrUXgL54pE4St2n4N7HRK27J..Ud7M1z7a.pM5Ehha7g9Vtn8qUhii_0tvKLDFG6bh9kTW9Es cq8XXMi.jCNsovGU3ScohW4L2mdU31jGgt10pwAah5FTSfqbIXqy2t.bwsy8SgfGBn2OOkBiDGnZ cg59RwabP8H_QLVA1f0zcKvM3js2D7OUlrLHX7Ibz.xid725ng9CtPHRwK6mT4NL3cxXze1TDBFx qLkvavfINf3ZOebTugBgmRvQqy0NDiCHYDAjS_VvU_d_vmk5ha1Jf38Zq3G8zNWljgevOnQbEjFr 66X0..6gOw_qC.tXpkZRI1AFzlmDnQepF7Fex6h1LwzxHl1KUw57nv4Pd_qwwAlLZoO67GJXARBu jFdvU96Ck_2_gBKGPTNNcVvtOa5IkjCJwHoKwDZtwK7Z42SXUvtQ3dzCOjlUIW3pgenpSewVlhnb .W7bRW9Ooca2A8A5IoFrog68BMmbOncdKwi.C13yCmxWaycmJUfeMieTnartd9PchdNhDJLVUwrN vVbIEz_Kk8Ax32vAXlTnrSuOcgqcbWDmM.xwuvlZy46YW6SNLr.hHfWKiMs.7rPBIpK4gQ_P4IYA cvz_._P1LmdRGayAgXeCqQe679ep4bvEV1rAdKBkncQeOO3b3bvgJu6tomUcFW.IuYBkANY.grmg TfjI- X-Sonic-MF: X-Sonic-ID: c2ee1b7f-6d1c-4d5a-a3b2-5db0405f46dc Received: from sonic.gate.mail.ne1.yahoo.com by sonic316.consmr.mail.gq1.yahoo.com with HTTP; Sun, 19 Mar 2023 05:07:48 +0000 Received: by hermes--production-gq1-6cf7749bc8-ldcgc (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 3a603d1bda8baec6d2922143d51a8f0b; Sun, 19 Mar 2023 05:07:46 +0000 (UTC) Content-Type: text/plain; charset=utf-8 List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.400.51.1.1\)) Subject: Re: reboot broken on RPi4 on main [breaks at git: e6cf1a0826c9 - main - physmem: add ram0 pseudo-driver] From: Mark Millard In-Reply-To: Date: Sat, 18 Mar 2023 22:07:35 -0700 Cc: Mike Karels , Mitchell Horne , freebsd-arm Content-Transfer-Encoding: quoted-printable Message-Id: <65762DBE-6E45-4C4C-B258-FDD1E91B3A0F@yahoo.com> References: <9EA91B94-87E4-47B8-A4E2-60D556E64276@yahoo.com> <4FCD4987-6DAF-4889-B684-B6E464F41144@yahoo.com> <5E055A77-24DB-44D3-89F8-5113555283EA@karels.net> To: John Kennedy X-Mailer: Apple Mail (2.3731.400.51.1.1) X-Rspamd-Queue-Id: 4PfQqB6V9dz3KbH X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On Mar 18, 2023, at 18:59, John Kennedy wrote: > I'm not exactly sure when it got fix (it doesn't always hang, just = almost > always), but the last 2-3 reboots have succeeded without having to = power cycle > the pi. >=20 > aee2f11bf4b was Ok (~3/18), 896516e54a8 is where I figured I couldn't = be > THAT lucky (~3/18) and maybe fixed as early as 6d33121337a (~3/15) or > 626d1e4a82e (~3/13). I didn't see anything specifically call it out. Wed, 15 Mar 2023 . . . =E2=80=A2 git: 8937bd37d07c - main - arm64: limit EFI excluded = regions to physical memory types Mitchell Horne Described in part via it fixing the RPi4B example: QUOTE Since physmem's ram0 device will reserve bus memory resources for its owned ranges, this was preventing attachment of the watchdog device on the RPI4B. END QUOTE =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Sun Mar 19 21:00:48 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Pfqyn0VXGz3yh0j for ; Sun, 19 Mar 2023 21:00:49 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Pfqym5nyMz3r9b for ; Sun, 19 Mar 2023 21:00:48 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1679259648; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=I2DkejkGNAyFztaPYQwuiPUU+er7sYTUnVj5b+lOFVM=; b=udQb3f38g2NgtdLaec+JpUAjkSltrYPBIA1ILjk2/DB43fs/Ah5Z8JYXGjk9pLm2CgItaE aioj+V3z51HZAU4NhyKCPlmAT1gp18VQGqr10lLKiTDrizaefs9CXWAgrgasD5iojgPGJh wsxDphMrPK51U9H9fe2tqssNCAEjexWINEb0uuMBIptc5k0b3YVgH5K//LOefpPYuuKdh+ DqB9WKx1LiU3uNZhxJP0fIHO9VY4IZ7TTb/xaaV98foDk6t0GyjLRzLnr1kMDk/8Gbudsy taI4rtYCOP7y9xRpzIB0CPP/0oJsZJrgKNGdchrwQzltCPf6Czj9KIeEFgZXhA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1679259648; a=rsa-sha256; cv=none; b=xnMotuhVCVwv69uPmC2TIEoo3UFs6nwsrrJ/p3c7Lki4nENcLvnC7LfdVkM4FoXpwhR21W 1M9aZSp9zoKrEiCHM6S4kpt56OioFjq98BDB49FNJZbnIF75tZRYlI0jzfGeYy9HvfXFde s/roe2gBfI1kC06jEcXlU8+hJjCK/TPNk9iEgyj8/GTSE2O5vexRZ71zrrOVuNmtFPMg8q +4OjfL053c6xiXa4O4q7+Z4N56J3vX3UDvuVCR6V9qx7bQTpCioZReaVkRUMxq/CASaGXH +0xiZnjfG47MyGEXM6XxksqcSVl6Xw+SJNgLxv/YxlUTY/ilh13OjIJXe2C4IQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Pfqym4vWMz13mV for ; Sun, 19 Mar 2023 21:00:48 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 32JL0mMm045992 for ; Sun, 19 Mar 2023 21:00:48 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 32JL0m6s045991 for freebsd-arm@FreeBSD.org; Sun, 19 Mar 2023 21:00:48 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202303192100.32JL0m6s045991@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: freebsd-arm@FreeBSD.org Subject: Problem reports for freebsd-arm@FreeBSD.org that need special attention Date: Sun, 19 Mar 2023 21:00:48 +0000 List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16792596482.2Fece.41353" Content-Transfer-Encoding: 7bit X-ThisMailContainsUnwantedMimeParts: N --16792596482.2Fece.41353 Date: Sun, 19 Mar 2023 21:00:48 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 238576 | Raspberry Pi 3B+ "shutdown -p" does not shut off Open | 257670 | mpr(4): SAS3008 PCI-Express Fusion-MPT SAS-3: Fat 2 problems total for which you should take action. --16792596482.2Fece.41353 Date: Sun, 19 Mar 2023 21:00:48 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    238576 | Raspberry Pi 3B+ "shutdown -p" does not shut off 
Open        |    257670 | mpr(4): SAS3008 PCI-Express Fusion-MPT SAS-3: Fat

2 problems total for which you should take action.
--16792596482.2Fece.41353-- From nobody Mon Mar 20 20:06:50 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4PgQkJ4K2xz409xN for ; Mon, 20 Mar 2023 20:07:04 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-ed1-x530.google.com (mail-ed1-x530.google.com [IPv6:2a00:1450:4864:20::530]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4PgQkH1m84z3FvL for ; Mon, 20 Mar 2023 20:07:03 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdimp-com.20210112.gappssmtp.com header.s=20210112 header.b=8PZN6Epn; spf=none (mx1.freebsd.org: domain of wlosh@bsdimp.com has no SPF policy when checking 2a00:1450:4864:20::530) smtp.mailfrom=wlosh@bsdimp.com; dmarc=none Received: by mail-ed1-x530.google.com with SMTP id ek18so51526727edb.6 for ; Mon, 20 Mar 2023 13:07:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20210112.gappssmtp.com; s=20210112; t=1679342821; h=to:subject:message-id:date:from:mime-version:from:to:cc:subject :date:message-id:reply-to; bh=nnMh9e7mCtu6OlRT9gf/YYVukeT0Lvp8y2wHT2u3ek8=; b=8PZN6EpnU6rl8JApXsXRi5qs0XAyC5Z5eybqCt0NS3MQ5G81sdqH6IghXAQAvmqwHa M9S5GMkKAospG7exCLGjAU8sx7DqFl24tv2XVdjyn6SQm8IlXgUh3l/IwEq6IWjL5qfK DmySBdeMaqQe3XQJVQXMxAC6CccGiGCXKalgMpHxlthorAjJTdn56IDPjVovIjA4xauV jsQu1YXbtBPnP3BK7hZmqjbQG8+qlxYKAPJRBJ0UI/wgi8lj8CfX6KiaZJMoDFVbG3q1 bWy5rU2Dn0IjjN64xlzN0lYAdLe48r8btIcbKQO5P4f+Vepkpn00Hr3NQsmwr3J5Aprg gutg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; t=1679342821; h=to:subject:message-id:date:from:mime-version:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=nnMh9e7mCtu6OlRT9gf/YYVukeT0Lvp8y2wHT2u3ek8=; b=VmfDUda0qgEfQlLvyPA4kLFzmHuzkelXiotNajqCEtyW87g0WpeNahSrpL2BnecYTY bjB2SbhFmzfhxXrZx3W74tSW8grrEAQzFA/kvlCe+d93VPtjsDy6fpgyPgLPj4w0QtI+ 6XQgdUscDDU9cn4CoKQ/H/bMThsop3LtGvogjJ45jTrM7TL23Kow7bJD1pahOHLFIDlc CdXFWaidY43Hzlnb+AwniojSos9ngBa+y3o90q3BbAO7ZCsj100i7NigxvNOKmIForAp DRCkiGUOQfJXQxA53HRRSNMvFxqG6cEC9Ifxu0qzy047lno7QFpDoaSqX5w0XyDvKcnV w4kQ== X-Gm-Message-State: AO0yUKV8VPEvnzZtTIbVpPqFToUbzqZ6WXvUhOJVvfLExjKX9IiQ9zDW kDm9GLablVGeIBVn4VD2ObxmbgpSIE737hcmTETcTi/FDg6T+Kozm7VQHw== X-Google-Smtp-Source: AK7set9+2gBhhReWV35OmGWxBEwY9LtL7VUH86wo8YKF6lROqr17kn6b4m8nIVkJEJQODBpk+SSWNL2Y+H9PBKqJ25A= X-Received: by 2002:a17:906:6a08:b0:931:ce20:db6e with SMTP id qw8-20020a1709066a0800b00931ce20db6emr173778ejc.2.1679342821585; Mon, 20 Mar 2023 13:07:01 -0700 (PDT) List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 From: Warner Losh Date: Mon, 20 Mar 2023 14:06:50 -0600 Message-ID: Subject: Poudriere friendly armv7 relases To: "freebsd-arm@freebsd.org" Content-Type: multipart/alternative; boundary="000000000000564a8205f75a7845" X-Spamd-Result: default: False [-3.00 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.998]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20210112.gappssmtp.com:s=20210112]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; MLMMJ_DEST(0.00)[freebsd-arm@freebsd.org]; R_SPF_NA(0.00)[no SPF record]; ARC_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; TO_DN_EQ_ADDR_ALL(0.00)[]; DKIM_TRACE(0.00)[bsdimp-com.20210112.gappssmtp.com:+]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::530:from]; PREVIOUSLY_DELIVERED(0.00)[freebsd-arm@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; DMARC_NA(0.00)[bsdimp.com]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4PgQkH1m84z3FvL X-Spamd-Bar: -- X-ThisMailContainsUnwantedMimeParts: N --000000000000564a8205f75a7845 Content-Type: text/plain; charset="UTF-8" Greetings, Since it looks like we're going to retain at least armv7 for FreeBSD 14 (armv6 has been nominated for deprecation, but if it isn't deprecated, all this applies to it). I'd like to start making at least the base.tgz, etc available for armv7. This would allow us to create armv7 poduriere jails without building from source. Is there some reason we're not doing this today? I know ISOs don't make a lot of sense in the arm ecosystem, but having these artifacts would enable poudriere binary install support. Comments? Warner --000000000000564a8205f75a7845 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Greetings,

Since it looks like we'r= e going to retain at least armv7 for FreeBSD 14 (armv6 has been nominated f= or deprecation, but if it isn't deprecated, all this applies to it).

I'd like to start making at least the base.tgz, = etc available for armv7. This would allow us to create armv7 poduriere jail= s without building from source.

Is there some reas= on we're not doing this today? I know ISOs don't make a lot of sens= e in the arm ecosystem, but having these artifacts would enable poudriere b= inary install support.

Comments?

Warner

--000000000000564a8205f75a7845-- From nobody Mon Mar 20 20:11:39 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4PgQqq0rLtz40B6D for ; Mon, 20 Mar 2023 20:11:51 +0000 (UTC) (envelope-from fuz@fuz.su) Received: from fuz.su (fuz.su [IPv6:2001:41d0:8:e508::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "fuz.su", Issuer "fuz.su" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4PgQqp56JQz3HFg for ; Mon, 20 Mar 2023 20:11:50 +0000 (UTC) (envelope-from fuz@fuz.su) Authentication-Results: mx1.freebsd.org; none Received: from fuz.su (localhost [127.0.0.1]) by fuz.su (8.16.1/8.16.1) with ESMTPS id 32KKBeEN059556 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Mon, 20 Mar 2023 21:11:40 +0100 (CET) (envelope-from fuz@fuz.su) Received: (from fuz@localhost) by fuz.su (8.16.1/8.16.1/Submit) id 32KKBdS0059555; Mon, 20 Mar 2023 21:11:39 +0100 (CET) (envelope-from fuz) Date: Mon, 20 Mar 2023 21:11:39 +0100 From: Robert Clausecker To: Warner Losh Cc: freebsd-arm@freebsd.org Subject: Re: Poudriere friendly armv7 relases Message-ID: References: List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="6YjYwGDJ2odkQAR7" Content-Disposition: inline In-Reply-To: X-Rspamd-Queue-Id: 4PgQqp56JQz3HFg X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:16276, ipnet:2001:41d0::/32, country:FR] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N --6YjYwGDJ2odkQAR7 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable > I'd like to start making at least the base.tgz, etc available for armv7. > This would allow us to create armv7 poduriere jails without building from > source. >=20 > Is there some reason we're not doing this today? I know ISOs don't make a > lot of sense in the arm ecosystem, but having these artifacts would enable > poudriere binary install support. I completely agree and have long wondered why the distribution sets weren't available for all architectures. They are useful for all sorts of things, such as installing systems with bsdinstall from other machines. Robert Clausecker. --=20 () ascii ribbon campaign - for an 8-bit clean world=20 /\ - against html email - against proprietary attachments --6YjYwGDJ2odkQAR7 Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQKTBAABCgB9FiEExWcBrcoFY7LMaPxvWXxDScqS3gUFAmQYvfdfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldEM1 NjcwMUFEQ0EwNTYzQjJDQzY4RkM2RjU5N0M0MzQ5Q0E5MkRFMDUACgkQWXxDScqS 3gUx3Q//UvRkQpUlUBnJ1fjTFSE6wve+tI0xwOKhalGP/mWekzAVtHt2grgd/CQu /f01gRRAiwd9kocK3UfLXbK5XkY2uTdaGesQMgs5RvjpfeAchnhKGpe3a2D0GYYh MjJW6Tqm9Bym92tpG1G3hVwFWQYj3/w4gRsrougqL1nb23edTQNJqiZFXNzl3Ev9 V0sVKj9MycAG5nrMpxHAwHl1U8GfdG105ZGWSp4Hv5w9oZNzaP4V8ZfbsclTNSEH 3bctYy6sAO3nLnis2ev4Tos48Y0TnltCvvDnmtZq96h3CBMlFnxUNfpjZ3E9vowP SI66V//EJb1wYj/qdo1aAa3KKdRBpU0A0zMyozkDfP8jobrsmMGWOlDL3zNTmUm4 MCeaj3Yfjj2IqOVCMqNz0B0VmVeHLahRlYt7gJXQmZSHTHp2uO+MJqOHGra8qbG6 upG4zPqynmftrSzC9NO0yeT2TmOjtAElizikdi6KzQzOJP/1T9yYj9WP0yhp7obu HhzeYwxjvzr9hfuTaQq8E7rh94Cyyx+NETTGJhLA/43S3+LR+CKWSOr2J+bolepP spEAL8vUdn94lwAuOHqV7HlvUxEp9sv2vvn38dts1a8ryyM9FIOE1fdC9lCkWu1v afSy69OtYa94uuR9r6hkZSezHmWBmmYqUVWmEXPIlSE1HJhmdfM= =1Dto -----END PGP SIGNATURE----- --6YjYwGDJ2odkQAR7-- From nobody Mon Mar 20 20:23:44 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4PgR5Y4HgCz40C5n for ; Mon, 20 Mar 2023 20:23:45 +0000 (UTC) (envelope-from mhorne@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4PgR5Y3pJ0z3N3Z; Mon, 20 Mar 2023 20:23:45 +0000 (UTC) (envelope-from mhorne@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1679343825; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=FTbBiFKUKBWjhaMtSRy5D7w0phAsTeZpzHyqchVidH8=; b=mUYrDfN78NVOOBWbmIhwKIaK+qqNY3fVnnMTlLQaHfcedg704XWtpibr2ke2SPIgrE44AY qB9aDHPtm5xv9yf5JhJEhSj2HZl25oi2d45y7KbhqoGtKy+Tih4p34/9mTwKu9Vt76PUCd cWu8EcvdERuC2oCbUahP6jmqvz61SMZ/gMZXQcBO9K7d3uC1iPlmmjPUtCuGH/o44M80I/ efY6Sy00arorBIf7QPeLfYYy04QBRnGCfZ4vcqnrS7syIDFrluS8egstmTjr2PhKdh9R2z +bkxx9lJ+R2xCqR/r+NrzGl9NCZqSWX5kc0LB9A6Kkr6Ls/ZK0xkavyPcyfHqw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1679343825; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=FTbBiFKUKBWjhaMtSRy5D7w0phAsTeZpzHyqchVidH8=; b=jRQO1TkHOFn9FzLoEHCXXPAQDaNeWY38Q9vlPKedVr836f41uTlgPZKFDtNXMmUQWCXn/M oYDKUiO+dzysBnx2qDSsZae89JiOSyULwrKrdGwCNX/jiE5nOFbaDLMJ+lUvy8rrBYPIrn FRPrK1XFwu4A3ILXQWKcT+RXrPmclYFF+lVB6XLQo67hLtoVrlvEEIiI+cQRz8ItBLlXuz mDcJKAunH4o2KASp3TLe723IFn5JkYNMaxrkd7+Twk1rvbSUTPC1iwqQWCanvjY+6RY71h mGmaOKXqIFsgSasVXiR2nRBGC2ztJN39OPsK01w2mB1bug+ek4VyvgADog/qaA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1679343825; a=rsa-sha256; cv=none; b=wTN7qrCmPuaYB+D/ooRzxtN1YQUYABLognKac9brmDeu8gLRvJCXuMaHb+a5hqWxrz1Xhp fiwKq56VaHfvSGomq95GHfvityKRtJzY+BohvT9Ab4E84z23ayQfLgkEoOQsVUgXv6mEXV BMZbzzbWxdLyipxxBPGvHKsKGjRKUuuZqSX6SXP4da+fYksJtw7x8oOKrnJd4VICBNgy67 qHaGDbOo0YgvBYWHvMhnjbGSSuDds3SYguP/V/ip4hhIm4YTLoB9XnnaoJRKgVcR7PVVST YDS0HrdZlGxYx0yxYD9Pic6LIh8jI3yrhqDSOw8Ab2pF/80ZzdQrArQUeZOlyw== Received: from [192.168.1.151] (host-173-212-76-127.public.eastlink.ca [173.212.76.127]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: mhorne) by smtp.freebsd.org (Postfix) with ESMTPSA id 4PgR5Y1ddszJFj; Mon, 20 Mar 2023 20:23:45 +0000 (UTC) (envelope-from mhorne@freebsd.org) Message-ID: <98a658ac-fadc-0ac3-4c31-ecbf22f5ba12@freebsd.org> Date: Mon, 20 Mar 2023 17:23:44 -0300 List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.9.0 Subject: Re: Poudriere friendly armv7 relases Content-Language: en-CA To: Warner Losh , "freebsd-arm@freebsd.org" References: From: Mitchell Horne In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-ThisMailContainsUnwantedMimeParts: N On 3/20/23 17:06, Warner Losh wrote: > Greetings, > > Since it looks like we're going to retain at least armv7 for FreeBSD 14 > (armv6 has been nominated for deprecation, but if it isn't deprecated, > all this applies to it). > > I'd like to start making at least the base.tgz, etc available for armv7. > This would allow us to create armv7 poduriere jails without building > from source. > > Is there some reason we're not doing this today? I know ISOs don't make > a lot of sense in the arm ecosystem, but having these artifacts would > enable poudriere binary install support. > > Comments? > I more-or-less proposed this in https://reviews.freebsd.org/D29923. See the discussion that follows. Basically this is in re@'s hands and you should make some noise in their direction. Cheers, Mitchell > Warner > From nobody Mon Mar 20 20:25:52 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4PgR8D5Jm3z40C95 for ; Mon, 20 Mar 2023 20:26:04 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-ed1-x52a.google.com (mail-ed1-x52a.google.com [IPv6:2a00:1450:4864:20::52a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4PgR8D4ntWz3Nh9 for ; Mon, 20 Mar 2023 20:26:04 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-ed1-x52a.google.com with SMTP id h8so51685181ede.8 for ; Mon, 20 Mar 2023 13:26:04 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20210112.gappssmtp.com; s=20210112; t=1679343963; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=Lj3wsXF9a08I10AfRw7+SWAPlQl+ZwcGWvpUSMCZFOQ=; b=mVCJx93lj1zt9346krGFPRqP4PaWwLZmpqTJ9xc3gh9stUFcizKeavlOIdR6I8GyHX NmnIr5al/bdA2KKqGVk/B+klObTqzKvE9DYKIMhywxkc3TOHFbGpu4r8dSc2jEMhNF9O GG10AK7sp5ZMAKa/YtRO5JdXuwRxBxeUmvILREFjYXXKcoOMKigLK6X7NFc+OPfpa7p0 vnCaI5fp5rS0cpaWcTFjmjaLnuYVYTff86y0FggqebSVp/QFcf5vA0JqNm6pOQzll/l2 OwtiH3UH3l1s9FfHzDJi2V47iK76Rmrrcuc6PgJsH0LZgEj+QlxYeWD+pNzz75cOTZOI NAsw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; t=1679343963; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=Lj3wsXF9a08I10AfRw7+SWAPlQl+ZwcGWvpUSMCZFOQ=; b=kfsLPU1AYBm9JPJzIIPrPNIFFxaEtoYCr6dDbT493h9sLvEb4N9C+luNabWWiJwATx hfuEunmfPkL5zkK0VUuyyRSauc9pWfuT1Q4amfRYHfJJoGoFq7iB8MjEIKoBlX47+y5D gOILTdNkTPAUMTALaq3+4alU8mSS4/HRE4yOjQnT4YhQdSVUEcjqF4SUZch2ZrrlwhVJ r5Mkf6pBZFTFZFD1eJONJGIGcntgaWm5/UxTRETtbpUf/4ZZ3TTk7zbNFUnTNsfwAoOe /4MJKANgKX7XzzBAx1U1m416F6QSRmWpd5vTJQj0JKNH2TcCXMBRNuob0HU08baFTSML dJUQ== X-Gm-Message-State: AO0yUKU/c4CYHPtizAb62bCoz57sykPfJaejUKgjy20C2fzTCM7cn+g3 FgckVx/WmhZaQLXT8+lgCJBXP7qkKlG7yL46upCr/4fW1j+ZYJh9vhITZw== X-Google-Smtp-Source: AK7set+pe6m+NqHmgs0vAJ3p5xar6Lhlzs4WepjbBRiaFGrLjwAdMl8I9vaXwKzMlPnXk5KjMvHu/YMDgBLDK5vaemM= X-Received: by 2002:a17:907:7da7:b0:8b1:3298:c587 with SMTP id oz39-20020a1709077da700b008b13298c587mr188534ejc.2.1679343963261; Mon, 20 Mar 2023 13:26:03 -0700 (PDT) List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 References: <98a658ac-fadc-0ac3-4c31-ecbf22f5ba12@freebsd.org> In-Reply-To: <98a658ac-fadc-0ac3-4c31-ecbf22f5ba12@freebsd.org> From: Warner Losh Date: Mon, 20 Mar 2023 14:25:52 -0600 Message-ID: Subject: Re: Poudriere friendly armv7 relases To: Mitchell Horne Cc: "freebsd-arm@freebsd.org" Content-Type: multipart/alternative; boundary="00000000000062db6205f75abc50" X-Rspamd-Queue-Id: 4PgR8D4ntWz3Nh9 X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N --00000000000062db6205f75abc50 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Mon, Mar 20, 2023 at 2:23=E2=80=AFPM Mitchell Horne = wrote: > > > On 3/20/23 17:06, Warner Losh wrote: > > Greetings, > > > > Since it looks like we're going to retain at least armv7 for FreeBSD 14 > > (armv6 has been nominated for deprecation, but if it isn't deprecated, > > all this applies to it). > > > > I'd like to start making at least the base.tgz, etc available for armv7= . > > This would allow us to create armv7 poduriere jails without building > > from source. > > > > Is there some reason we're not doing this today? I know ISOs don't make > > a lot of sense in the arm ecosystem, but having these artifacts would > > enable poudriere binary install support. > > > > Comments? > > > > I more-or-less proposed this in https://reviews.freebsd.org/D29923. See > the discussion that follows. Basically this is in re@'s hands and you > should make some noise in their direction. > Ah, that's why I thought it was tied to .iso creation :). Maybe the right thing is to just do it for 14 and let the fallout happen and be worked through :) Warner --00000000000062db6205f75abc50 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


=
On Mon, Mar 20, 2023 at 2:23=E2=80=AF= PM Mitchell Horne <mhorne@freebsd.= org> wrote:


On 3/20/23 17:06, Warner Losh wrote:
> Greetings,
>
> Since it looks like we're going to retain at least armv7 for FreeB= SD 14
> (armv6 has been nominated for deprecation, but if it isn't depreca= ted,
> all this applies to it).
>
> I'd like to start making at least the base.tgz, etc available for = armv7.
> This would allow us to create armv7 poduriere jails without building <= br> > from source.
>
> Is there some reason we're not doing this today? I know ISOs don&#= 39;t make
> a lot of sense in the arm ecosystem, but having these artifacts would =
> enable poudriere binary install support.
>
> Comments?
>

I more-or-less proposed this in https://reviews.freebsd.org/D29923= . See
the discussion that follows. Basically this is in re@'s hands and you <= br> should make some noise in their direction.

<= div>Ah, that's why I thought it was tied to .iso creation :). Maybe the= right thing is to just do it for 14 and let the fallout happen and be work= ed through :)

Warner=C2=A0
--00000000000062db6205f75abc50-- From nobody Mon Mar 20 20:28:47 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4PgRCR6r38z40C6W for ; Mon, 20 Mar 2023 20:28:51 +0000 (UTC) (envelope-from gjb@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [96.47.72.132]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "freefall.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4PgRCR6Kqsz3P6L; Mon, 20 Mar 2023 20:28:51 +0000 (UTC) (envelope-from gjb@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1679344131; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=7fqEoVfeGptCgZSf0MPr21xGLDcvoz+vMe3X47uBlQQ=; b=aSNhsbm+CZcUeiyqkGVrATbpflsKQwtzh1wxdQar487sNlB6P7DFJd1wrHTWV106CJe/kJ kFduSNd5Mc1L/zH3K4PMJ/x/UdlPCbvWrMD8OoU5w1yPdEJl02oOLCpVOhSiXg3uUDmOkU gcoalBVbfnDfILxdF86vA+QC2bf8Yj+iLYLyDUM/asJy942XL8KoYzQ3snMj5gng1nrHE8 IguDoMGm20AoONxrM79i5O+WGMTbnsAYF0+RfCD1/ER6UZj2lVJ8EApnGAVhhjvX92G4pL gmaai3ZdUo8RB1h+lGdjj1A6NV1uChK0C5iHcPhKDOdirZxZmN4m+1dm7lIR5A== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1679344131; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=7fqEoVfeGptCgZSf0MPr21xGLDcvoz+vMe3X47uBlQQ=; b=Yn/Wx91Ge6W5KIJdADUi8kQ6Ez0TZjj4D3BTVx+O9gir52Uw5AB7l4SmTmE77O0Ew9iUwT UpkMWg0opa4RRGQbb00GhIU7htC8pM8W3pui5paCXj0eox/VYdiDqKftqBWjl/ycrdpN7T 1vwbk78rV7LdadQnGbYqfZPxCeDPiAB+zkgWEcmXcrlGeWNOfSSusWL325NlDnO6fCUVL1 99P42OGA+gRDgZsBd5lYG46RgYsOhxL4iRzjUchyuKXlaa7cMseUsP/RsUECFK+reWfcMk paXKyMKOOtMvThDIqWdahdmud2KS84eOiTmegAdO8tQqXMV0/8mRPsRmwC5HSw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1679344131; a=rsa-sha256; cv=none; b=cSdClIfae0E8oNaipvkFsJ7WXY/BQsxEacOf7fexVuHl1WUGrdJhFKvPUq4v3/A1b3AJxi GzfJipSrMaJYLH2fTymjhzNNchqLqI728n9sgh50+HPzVTfjxJevTvRP9PS0dGYqkzZ6yi gVGRw7SW6ghU8hPhO7zKVhwPHkzMoctzlehcPO+7cbUJcT1k39aBecLtI4mTBk+SplUUdz ArK3oSsO5e1k60vDPyVNiBHlMI7EmS0oZfmSXfterdhwsSgbn8HKekF77pAxx3dZZ/D0x0 C3OM4DIovy/4jZTdm+9RjBmOBXGUJktSJUUTQoSxRcNhsrgRGPqi8GIee7letw== Received: from FreeBSD.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by freefall.freebsd.org (Postfix) with ESMTPS id 769741FE3; Mon, 20 Mar 2023 20:28:51 +0000 (UTC) (envelope-from gjb@freebsd.org) Date: Mon, 20 Mar 2023 20:28:47 +0000 From: Glen Barber To: Warner Losh Cc: "freebsd-arm@freebsd.org" Subject: Re: Poudriere friendly armv7 relases Message-ID: <20230320202847.GW2347@FreeBSD.org> References: List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="nKvJs6ze6az+4fwY" Content-Disposition: inline In-Reply-To: X-ThisMailContainsUnwantedMimeParts: N --nKvJs6ze6az+4fwY Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Mar 20, 2023 at 02:06:50PM -0600, Warner Losh wrote: > Greetings, >=20 > Since it looks like we're going to retain at least armv7 for FreeBSD 14 > (armv6 has been nominated for deprecation, but if it isn't deprecated, all > this applies to it). >=20 > I'd like to start making at least the base.tgz, etc available for armv7. > This would allow us to create armv7 poduriere jails without building from > source. >=20 > Is there some reason we're not doing this today? I know ISOs don't make a > lot of sense in the arm ecosystem, but having these artifacts would enable > poudriere binary install support. >=20 > Comments? >=20 Several. :) I have looked into this in the past, and mhorne@ had even added some environment knobs to the way armv7 is built, however I later realized that it was not 1:1 compatible with how base.txz, etc., are generated for other architectures. 1) For other architectures, base.txz is result of the 'ftp' target in /usr/src/release. 2) armv7 does not have an 'ftp' target. (Well, it does not *disallow* it, and probably should at the immediate moment, but it does blow up.) 3) Most importantly, and the reason I stopped looking further into this, we cannot run native armv7 binaries on an amd64 system (at least, last I was aware). Particularly, we can only actually use what is listed in kern.supported_archs, at least without falling back to some sort of emulation or wrapper support (such as qemu or the like). Back when armv6 and armv7 support was added using shell scripts instead of hooking into release/Makefile, having a base.txz did not make much sense because there were different environment variables that were passed into the resulting output, some of which affected the loader output, etc., specifically with regard to u-boot. I am not sure if this is still an issue or a concern, however. That said, I can take a look and see if we can package base.txz for armv7, however I would like to do some archaeology work here to be sure that the resultant output is not going to have unexpected behavior because of the userland not matching 100% the target SoC. Glen --nKvJs6ze6az+4fwY Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEjRJAPC5sqwhs9k2jAxRYpUeP4pMFAmQYwfoACgkQAxRYpUeP 4pMCAg//TF2TPj6eopV92pUr60s7zVyaFu7Q4uZt2BbiL9n+T8y7N8BHpRFATV6v IuXc8VkJvxf3OxO7LWT88EYuPiKjCXuyjfAf33YIg4luLooO7pJ9cvPCD0YZulXT xk5NeN+FUEDQjzUhhf28M8NDo0bhTC4j6xcV2KulwJyMShJH5lapBIsX4jBNEaOW dcCXwV56d7CFTW8op3oEs3662MLlfME2i5l4WPymPCsOgT4yjcoBeu1Ijm8y5anW suUEonFd4KH03yCsWiicWAG2dlQYT+jxczjbkxuSHDzcX9oEBTQhoM597BKvj0J1 iNL90Bimn40PYNPzyPL/BvlP+lb+Y5etPGLj/M/cmiD/HYOMKs9TJBSurhgTjopT lZwCdBSamauZrZEQqRAyIYO4q18K9HVG+YschlwOtbjPYjVqClZWMW144uH2KmUa cimhr4ZQ1y9OiAAmroUsRedhTy27wyJiLPJaw0ksJlo6gFJKip4WFq3UZaCVs5PC iwkuRs7k0773sjhqSPdePM4hS7VOb4BFUH7yn5bIEVywWSBipJ5H9vYPZLBQO42f RECz/Pqw9wxG5IRiKCPeEQu4UaaQODMbAmKhevHRTHXFdelQvUMaor/qxJS/oDyg AzaOTA7uvG0WipF4P1kmOA8Ct8irj/HzHXmy+D1rSNU6sk1pTWs= =74uP -----END PGP SIGNATURE----- --nKvJs6ze6az+4fwY-- From nobody Mon Mar 20 20:32:12 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4PgRHM0v2vz40CdY for ; Mon, 20 Mar 2023 20:32:15 +0000 (UTC) (envelope-from gjb@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "freefall.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4PgRHM0KjCz3QdS; Mon, 20 Mar 2023 20:32:15 +0000 (UTC) (envelope-from gjb@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1679344335; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=2HEn8KrKwz4pWCOGABlJujvxhmbt4LvmfjM1j8dOp/U=; b=RMxt1rR3OoIZvnW7ROOjlm7Bdw5VegwUpGrfw9NNfxgeDmTH1WTKRvVRPTPIyIZoBtRbhh szM9jzDaehfXUF1IhGdjphvC8diGwuBewhqF0sdvdj72aTXpjH7jcGjwU9QMzK6uVVEe6r 1lI+zmrXE7Rq8ETnN6V5Db2RXC6QYdJK6WJFwhzWAf0KUilOSyG+45kVeo7nwIrd4HObNV iLOxn5mlxc9YYAhsyUtPHNI6jVl43T7WTVF35hqvUeM0LWC4/pqgDshVnH5Uf2viq9Jmr3 t+sDEb8m3zl4+fNmXokTYxsAJ3yRN40jiEaV3PDwdlnPM7Tj4L9qKQoiesacxg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1679344335; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=2HEn8KrKwz4pWCOGABlJujvxhmbt4LvmfjM1j8dOp/U=; b=xZdqfLUU2Wr4y85FNLeTTfsVUu/CwoGCf99YxQKpFzhjFVPtzbSkoiaXKUixw9cANkOdeK YYzNp66ZfaZm9cdnLhdnib3FFikAugQCpbuCyYZBoVTiAf3okf5BCzy2HM+9Ww46zqUFQc moiKwGrOF3+l9aIZc4fRSjyT2h4hILqajYY9vLA218CYp+jN422wy9GjW8Ff24/xrh0Fu6 fsy4D1pS0jD5skQnNoNsrwjyMKXVDE+v+SMNDZn9ivp6rMqADmXFMvUNqtEOM+qXcJzrcY vEMf2wwR/d7Lkwwo4YYhwDWl/5RBmANVov13YOygOpzLe5wIF2+q7qdWAgKLvg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1679344335; a=rsa-sha256; cv=none; b=a5pBXKrVImm4ddpN1loa37QFR8T3ZolQnhcl4IbrzzvVvLjGgGx3AjtGW4kS8IVkgFXfBA +L7wzJopD17oheK5u8CCTLqEhDeX4Nsad90sSFL56xRkQi91N9PZNoOjKiq7F1M5hIotCH E6fEqPNAzDGt8d5/RqVesfG61Ut///xGDAk7ku1h2DgfxAUL2YDXES/IgjwoAZsg7pR7Eu a/tCxxDRD/d0c7Y0O4qYzgHDM6OtVsRBuWktKgaOqgMtEYoWj+erNEcZj19FmCwtTrm5pa eUtyVGtrhz2Lgxd+87M5MWoua1sR1CKmelOx/Zosbiv/QzxTyVjxP5YbcfYRhg== Received: from FreeBSD.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by freefall.freebsd.org (Postfix) with ESMTPS id ABD512305; Mon, 20 Mar 2023 20:32:14 +0000 (UTC) (envelope-from gjb@freebsd.org) Date: Mon, 20 Mar 2023 20:32:12 +0000 From: Glen Barber To: Warner Losh Cc: Mitchell Horne , "freebsd-arm@freebsd.org" Subject: Re: Poudriere friendly armv7 relases Message-ID: <20230320203212.GX2347@FreeBSD.org> References: <98a658ac-fadc-0ac3-4c31-ecbf22f5ba12@freebsd.org> List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="4nn+A2p41ba1mxGd" Content-Disposition: inline In-Reply-To: X-ThisMailContainsUnwantedMimeParts: N --4nn+A2p41ba1mxGd Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Mar 20, 2023 at 02:25:52PM -0600, Warner Losh wrote: > On Mon, Mar 20, 2023 at 2:23=E2=80=AFPM Mitchell Horne wrote: >=20 > > > > > > On 3/20/23 17:06, Warner Losh wrote: > > > Greetings, > > > > > > Since it looks like we're going to retain at least armv7 for FreeBSD = 14 > > > (armv6 has been nominated for deprecation, but if it isn't deprecated, > > > all this applies to it). > > > > > > I'd like to start making at least the base.tgz, etc available for arm= v7. > > > This would allow us to create armv7 poduriere jails without building > > > from source. > > > > > > Is there some reason we're not doing this today? I know ISOs don't ma= ke > > > a lot of sense in the arm ecosystem, but having these artifacts would > > > enable poudriere binary install support. > > > > > > Comments? > > > > > > > I more-or-less proposed this in https://reviews.freebsd.org/D29923. See > > the discussion that follows. Basically this is in re@'s hands and you > > should make some noise in their direction. > > >=20 > Ah, that's why I thought it was tied to .iso creation :). Maybe the right > thing is to just do it for 14 and let the fallout happen and be worked > through :) >=20 It is only tied into ISO creation in the sense of "that is where the bootonly.iso fetches the sets to extract" sense. In this case, I am not sure if the chicken or the egg came first. Glen --4nn+A2p41ba1mxGd Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEjRJAPC5sqwhs9k2jAxRYpUeP4pMFAmQYwswACgkQAxRYpUeP 4pPnuQ/9GEhM4AfYdL2W/Kf9++k3cBeGsM/AHrUkKlKPBqNO9D017kjy3zvh05rH NGwvEicn3nukVy6BTKwAiYKb8/tkerJrHkYTRYPPsePEBskC0vwKNetKtdms+zOc Z2XkHTPK6e+kP3K6DVK3h3gHPiw+URTpyw8661Jef9KQcqTX7onTiRne6z0jVM8o noZUqV3Jq31qS3rTmZNdNMz6KCs8If2Rn9jOsky2FQju+1LhIFNdgnTD96aLjST6 GNaX/rfc1QVSKNqKYfL/kiPU4J/168VWb5wZUuKH2+WtXusmBlSZHJt2KnI3LJCY /lq2Lh4RQXOA3pP7xO9kkMuqpkXcJCIiM/VxZoyZdDpNVlBYzcX1Ft/xzgoBP0U/ 3d5aT0Rkm3gPm8JqTbz3RNX4o1BlxCtIMuOixHc8Q8bifbv1DYOpc467PRPG7s5V NIgd2F/yb9ufmVdlOY21/ylrGmR4Cbe63b5AWDA4Ua/qSxLdAU/gsPDKdkYlTH3Z 8zcsnrjjDDGzFBbvHhV0G25SQPx1Z2d9W+EewJpwsGgJq4lTe6MOdsY+taDCv1+Q bfvHb8Zrz3M8bH/X+E8DPFdIaiJaty+Wwi8GTq5a+b3HKfKFD66py31Acm+kAXQr O0OTueIaqqNfkOcS67EaoHY/1K/hxt9Zow1zkMI3nIyBqBInz94= =2t3Z -----END PGP SIGNATURE----- --4nn+A2p41ba1mxGd-- From nobody Mon Mar 20 20:38:34 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4PgRQt6M5kz40DJq for ; Mon, 20 Mar 2023 20:38:46 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-ed1-x52f.google.com (mail-ed1-x52f.google.com [IPv6:2a00:1450:4864:20::52f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4PgRQt5Vr9z3jX5 for ; Mon, 20 Mar 2023 20:38:46 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-ed1-x52f.google.com with SMTP id x3so51774936edb.10 for ; Mon, 20 Mar 2023 13:38:46 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20210112.gappssmtp.com; s=20210112; t=1679344725; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=tsC+OQOp5V2yJ1f/bWqX08JrD3mOJHVLLq7JiwfcqGk=; b=aCOTYemyWTDym3fbk0qQWkdxMBEgxY+uOhDG0gi8PiBCmfzIkC4tnEqzUQqvj9fitI 2JxBYJNg301xROiPGkRwBhRhpsbFt3R/YhBhsCYC02sWGRwn0vg6flvLmNIwZGSipihL o9yyqbq6iixTZnrArd6f8jhO6IqaNgwaU1/8gMVQtxJ0kFO+MRa7XvDMJfWwfuW8ygMG 18mj2yH8HG4lGAlRC6yGBMdcyctQvc7O4d/jfpaPlqe23gMf7MR+wzCWOXJFgR3ERsT4 ab2xBACW1sfE/UyTt+Hu9LNKQaQfQWoGxzDeoxEth4uhFij/xve0Xu5+0R1M7J65k9NR UI6Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; t=1679344725; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=tsC+OQOp5V2yJ1f/bWqX08JrD3mOJHVLLq7JiwfcqGk=; b=FXc+43ZZu64hKYBn8GtQQenxJZgzwqRizw/P7gL6HZ2FU3Dvo1/9uBXtLIyKaV5VM2 ABv2tK8CS6D89m0f5dgVRCoIpBvclCxMK86BBCtTxW4bfI7a8EIfMIABYUIAoq7hHwU8 /lUul4j3EsLzjrAaJOPNrP6xCGiE3e1VobKbAvznqHt8Djp4cTEX0m28PVzau+rhMNNK /YOOaIdKZHhyAxe1JX7eDVXp/8/Gh/m3Fv5Hqs/DTa6hI7YUvfuvyZW0UL27rtoyj7JY ZoJWYXHJLOCdV+bltzbA6XwJ7AR1sXF2esaRD3J9jEL44ATlk225/f7v0SS0Pv4ej55I R79w== X-Gm-Message-State: AO0yUKUHOh0DDaSTBO4n+nF7FZDtn7pa3D+FiuGn30iTe4+imCrZaH5d nlw74mhWTeB0kq95eWxflN/L2XEvTuzlAGzy96GCYBt7R22c4T59zDniWg== X-Google-Smtp-Source: AK7set+D432yaVSYQrL9Ne146fQGDmhY5wZb3zh+geRgNvMLPIgRanLBNyfcihohIf/C/A7C4vOuSb8YDn0WXvGDZio= X-Received: by 2002:a50:ce45:0:b0:4fb:80cf:898b with SMTP id k5-20020a50ce45000000b004fb80cf898bmr435842edj.7.1679344725069; Mon, 20 Mar 2023 13:38:45 -0700 (PDT) List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 References: <20230320202847.GW2347@FreeBSD.org> In-Reply-To: <20230320202847.GW2347@FreeBSD.org> From: Warner Losh Date: Mon, 20 Mar 2023 14:38:34 -0600 Message-ID: Subject: Re: Poudriere friendly armv7 relases To: Glen Barber Cc: "freebsd-arm@freebsd.org" Content-Type: multipart/alternative; boundary="000000000000cb296f05f75ae901" X-Rspamd-Queue-Id: 4PgRQt5Vr9z3jX5 X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N --000000000000cb296f05f75ae901 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Mon, Mar 20, 2023 at 2:28=E2=80=AFPM Glen Barber wrote= : > On Mon, Mar 20, 2023 at 02:06:50PM -0600, Warner Losh wrote: > > Greetings, > > > > Since it looks like we're going to retain at least armv7 for FreeBSD 14 > > (armv6 has been nominated for deprecation, but if it isn't deprecated, > all > > this applies to it). > > > > I'd like to start making at least the base.tgz, etc available for armv7= . > > This would allow us to create armv7 poduriere jails without building fr= om > > source. > > > > Is there some reason we're not doing this today? I know ISOs don't make= a > > lot of sense in the arm ecosystem, but having these artifacts would > enable > > poudriere binary install support. > > > > Comments? > > > > Several. :) > > I have looked into this in the past, and mhorne@ had even added some > environment knobs to the way armv7 is built, however I later realized > that it was not 1:1 compatible with how base.txz, etc., are generated > for other architectures. > > 1) For other architectures, base.txz is result of the 'ftp' target in > /usr/src/release. > > 2) armv7 does not have an 'ftp' target. (Well, it does not *disallow* > it, and probably should at the immediate moment, but it does blow > up.) > > 3) Most importantly, and the reason I stopped looking further into this, > we cannot run native armv7 binaries on an amd64 system (at least, > last I was aware). Particularly, we can only actually use what is > listed in kern.supported_archs, at least without falling back to some > sort of emulation or wrapper support (such as qemu or the like). > actually we can. We can run them with bsd-user on amd64, and we can run them on the arm64 hardware that has 32-bit support. This came up in connection with my GSOC project to upstream everything, using armv7 as the touchstone for success: the students that have looked into it have had to build from sources. > Back when armv6 and armv7 support was added using shell scripts instead > of hooking into release/Makefile, having a base.txz did not make much > sense because there were different environment variables that were > passed into the resulting output, some of which affected the loader > output, etc., specifically with regard to u-boot. I am not sure if this > is still an issue or a concern, however. > Yea, we've moved on from the ubldr needing a specific load address. That was more for armv4 and armv5 boards we removed the support for. Some of this bled over into armv7, but can safely be ignored now. > That said, I can take a look and see if we can package base.txz for > armv7, however I would like to do some archaeology work here to be sure > that the resultant output is not going to have unexpected behavior > because of the userland not matching 100% the target SoC. > These days, everything FreeBSD builds is identical on supported harndware. We assume the boards can do UEFI after whatever weird thing they need to get that going, and all that crazy has been relegated to the uboot ports, and no longer intrudes into how we build stand (though some crazy people might build stand for such platforms, it's so niche (eg a couple of routers that don't run our binaries ever) at this point that we shouldn't worry about it for releases). We've evolved to a point where the benefit for being able to build poudrier= e jails from release artifacts out-weights the couple of users being slightly inconvenienced on their legacy platforms (and it hasn't been clear those platforms will ever be updated to 14). Warner --000000000000cb296f05f75ae901 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


=
On Mon, Mar 20, 2023 at 2:28=E2=80=AF= PM Glen Barber <gjb@freebsd.org&g= t; wrote:
On Mon= , Mar 20, 2023 at 02:06:50PM -0600, Warner Losh wrote:
> Greetings,
>
> Since it looks like we're going to retain at least armv7 for FreeB= SD 14
> (armv6 has been nominated for deprecation, but if it isn't depreca= ted, all
> this applies to it).
>
> I'd like to start making at least the base.tgz, etc available for = armv7.
> This would allow us to create armv7 poduriere jails without building f= rom
> source.
>
> Is there some reason we're not doing this today? I know ISOs don&#= 39;t make a
> lot of sense in the arm ecosystem, but having these artifacts would en= able
> poudriere binary install support.
>
> Comments?
>

Several.=C2=A0 :)

I have looked into this in the past, and mhorne@ had even added some
environment knobs to the way armv7 is built, however I later realized
that it was not 1:1 compatible with how base.txz, etc., are generated
for other architectures.

1) For other architectures, base.txz is result of the 'ftp' target = in
=C2=A0 =C2=A0/usr/src/release.

2) armv7 does not have an 'ftp' target.=C2=A0 (Well, it does not *d= isallow*
=C2=A0 =C2=A0it, and probably should at the immediate moment, but it does b= low
=C2=A0 =C2=A0up.)

3) Most importantly, and the reason I stopped looking further into this, =C2=A0 =C2=A0we cannot run native armv7 binaries on an amd64 system (at lea= st,
=C2=A0 =C2=A0last I was aware).=C2=A0 Particularly, we can only actually us= e what is
=C2=A0 =C2=A0listed in kern.supported_archs, at least without falling back = to some
=C2=A0 =C2=A0sort of emulation or wrapper support (such as qemu or the like= ).

actually we can. We can run them wit= h=C2=A0bsd-user on amd64, and we
can run them on the arm64 hardwa= re that has 32-bit support. This came
up in connection with my GS= OC project to upstream everything, using
armv7 as the touchstone = for success: the students that have looked into
it have had to bu= ild from sources.
=C2=A0
Back when armv6 and armv7 support was added using shell scripts instead
of hooking into release/Makefile, having a base.txz did not make much
sense because there were different environment variables that were
passed into the resulting output, some of which affected the loader
output, etc., specifically with regard to u-boot.=C2=A0 I am not sure if th= is
is still an issue or a concern, however.

Yea, we've moved on from the ubldr needing a specific load address.
That was more for armv4 and armv5 boards we removed the support
for. Some of this bled over into armv7, but can safely be ignored n= ow.
=C2=A0
That said, I can take a look and see if we can package base.txz for
armv7, however I would like to do some archaeology work here to be sure
that the resultant output is not going to have unexpected behavior
becau= se of the userland not matching 100% the target SoC.
<= br>
These days, everything FreeBSD builds is identical on support= ed harndware.
We assume the boards can do UEFI after whatever wei= rd thing they
need to get that going, and all that crazy has been= relegated to the
uboot ports, and no longer intrudes into how we= build stand (though some
crazy people might build stand for such= platforms, it's so niche (eg a couple
of routers that don= 9;t run our binaries ever) at this point that we shouldn't worry
<= div>about it for releases).

We've evolved to a= point where the benefit for being able to build poudriere
jails = from release artifacts out-weights the couple of users being slightly
=
inconvenienced=C2=A0on their legacy platforms (and it hasn't been = clear those
platforms will ever be updated to 14).

=
Warner
--000000000000cb296f05f75ae901-- From nobody Mon Mar 20 20:47:53 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4PgRdR67WQz40F1T for ; Mon, 20 Mar 2023 20:47:55 +0000 (UTC) (envelope-from gjb@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [96.47.72.132]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "freefall.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4PgRdR3xN0z3kYH; Mon, 20 Mar 2023 20:47:55 +0000 (UTC) (envelope-from gjb@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1679345275; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=0itrvlllmldSkMRhLCURn6+myZnb8V0z45NNt7wDnn8=; b=NjZMO3O5b4TG55EzFN6iXBTL+iYsr3QQ5pL+VWr1yEMmlmcrMlHRukDpGh8C6Ld20bhnIt aWrPACW/hf0q/OuXred6cu023UGjuU1gngFS+G6yjssm1WHBK7Dm5twJ06Z/Tn0avbxXZE O/1nbCHbTm1SLN3SBf+32K6Q3BrGgMsggPNkIOyhUeqq6con4UQh/JLZJrkxG2wSdLpkUE EMwBNJErbwRm+n0l0lxBfnCnWSpxffvRFvrS0/ImbEdpdPJlsp2jJft417mXeVJ2hZGLjO ffLTU/K8jLcUdjpSkfe4CUZ/4cemkFPk4q+TAgSqtvsD18uI7dJinruaGkemug== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1679345275; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=0itrvlllmldSkMRhLCURn6+myZnb8V0z45NNt7wDnn8=; b=Nu1SiLovxg8MHI+lB6Dxtf0IJceO0b68bVFgA33ZCKo7BMkqlPtz6MYJL/7BiRG+zUINOx NZilAeAlQJoyiRsDtJ54YGH5pX0GTk8iL/rjE4zekSr0+8A4TRj0vxuwKxx4gpTY135kPS T1cwEEOnkVefjBgsYtux2Q98UMSyIZ/gpwY1EfSLFLVeB1D/+9phIAQIqIwLx66LuMD6ce i1cZTZs0uwJ3X22mlIBtqVgGJLQrm9ywfT1Fj4l1TkjYVTOnGG6qLnj1Aee/Esgbam9vyE 5mZpsGnEyfvJrRnFgivrWhPQ/lYlF0JY6julcLXXVtp1oXAUUg9blWxhzUjCBA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1679345275; a=rsa-sha256; cv=none; b=rnlSDHyIbsTs/sRoJmirdPREsm9Ex6KzRxSuKOrqNKBByT1T1qi35vItJkXhzFVdTZP3Qh N4fKVEp4W++HLQnBxXNSapt9AMTXsdbFClYxHqtd0wNoo1R+towVhbKjspMU5kfhdOPY8U UQlAXN148nAcSRz6XFDL5I51bWbb7O01mseIbnToUBDzyWI/++JnyFth957NmB9iap5c7U AquwqDYPca4ipt5LQlBDvylfXTK9kdlAo1YTJJbcY6xFDSlRFHyjieG7upVEd0Lv8ZLLXH RPWMUzq8oPkd2IcfuFkGVZtd8EZAQfPwGWnQM1ltL5Wd3FgIzEKj95S7LPYu8A== Received: from FreeBSD.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by freefall.freebsd.org (Postfix) with ESMTPS id 16E312441; Mon, 20 Mar 2023 20:47:55 +0000 (UTC) (envelope-from gjb@freebsd.org) Date: Mon, 20 Mar 2023 20:47:53 +0000 From: Glen Barber To: Warner Losh Cc: "freebsd-arm@freebsd.org" Subject: Re: Poudriere friendly armv7 relases Message-ID: <20230320204753.GY2347@FreeBSD.org> References: <20230320202847.GW2347@FreeBSD.org> List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="yBbBYFH0ZHvzMoI/" Content-Disposition: inline In-Reply-To: X-ThisMailContainsUnwantedMimeParts: N --yBbBYFH0ZHvzMoI/ Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Mar 20, 2023 at 02:38:34PM -0600, Warner Losh wrote: > On Mon, Mar 20, 2023 at 2:28=E2=80=AFPM Glen Barber wro= te: > > That said, I can take a look and see if we can package base.txz for > > armv7, however I would like to do some archaeology work here to be sure > > that the resultant output is not going to have unexpected behavior > > because of the userland not matching 100% the target SoC. > > >=20 > These days, everything FreeBSD builds is identical on supported harndware. > We assume the boards can do UEFI after whatever weird thing they > need to get that going, and all that crazy has been relegated to the > uboot ports, and no longer intrudes into how we build stand (though some > crazy people might build stand for such platforms, it's so niche (eg a > couple > of routers that don't run our binaries ever) at this point that we > shouldn't worry > about it for releases). >=20 > We've evolved to a point where the benefit for being able to build poudri= ere > jails from release artifacts out-weights the couple of users being slight= ly > inconvenienced on their legacy platforms (and it hasn't been clear those > platforms will ever be updated to 14). >=20 Ok, let's discuss this further after 13.2 is done. Note, we're about a month from the start of the 14.0 cycle, but it sounds to me that once a solution is in place, things should "just work" from that point. Glen --yBbBYFH0ZHvzMoI/ Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEjRJAPC5sqwhs9k2jAxRYpUeP4pMFAmQYxngACgkQAxRYpUeP 4pM3iA/9EYvMYINM3Kpy18V20uVkjeoNzX1UTWZxRmqGzQhv04l7A8IWAoLPCW8D N6OFBcm4VlrMVleJ7KjZafC8cdwpHUbr7fg/0/YEs//HU5nhPe87YqzoVJYtwxGL 1EhJ0Shc2YqZC5sYvrV9qbunw6b+SsSoPgQ9BSj+CFTjf5DDY6iM5zOWsBo2f8j7 XrzBQxpYarYrKrbxlDwbZmGpQ7ObMZz08AeUuPx+bs1QzmT8hnflNLsdhGzBAQWy 2L9QR6EkuPcV8z6nE/UtsxM1s4Cgb7bSWjhtwe/QgEsBDwyBRRhtZSXox2/+1RRO CJYPTczICCv/TIuZDbpSPeZP9eDfRY1bwDwvM+LqPlevTSpHNTiJmqlt4T48O28z jZxl3sJ91xkPUeFk3DxscpX7a+QB9Q8bBww9mIyipCis7OLCRoF5fiuvnr1Wkckw RVrl9M4l9wHfYcH+8nKr39EAEKlPX8gAip3eUa6S3QwXrDMPakOQEc8PFU46BsvS YOd3HII6rRjcNpt5hebVBMyQjXsUBvSAP6l7cnBASQCPmfEKWbm3DVMKDXfk+Jro kJCnMb005MCMhOV/ii5FhQ2ppQN87M5PtGXssDqO9Y3nyRDAaxe/KNW+YRYFQmVD DcdJi2taG1i1Q4wR3pnYWq35Vhnl/aNTogEc65+uv5JgTjQD9Zs= =eDuW -----END PGP SIGNATURE----- --yBbBYFH0ZHvzMoI/-- From nobody Mon Mar 20 20:51:27 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4PgRjr5NJ2z40FDh for ; Mon, 20 Mar 2023 20:51:44 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic306-20.consmr.mail.gq1.yahoo.com (sonic306-20.consmr.mail.gq1.yahoo.com [98.137.68.83]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4PgRjr2zbJz3nXV for ; Mon, 20 Mar 2023 20:51:44 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1679345502; bh=SBhheDfqoSoa15GxFMd43jNGV8UyjUQGZagAvcJyQ9M=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=CuzG94hKHmzB2xkNNl98vMoCuhK7jVTFqUDVL+kmRAOA34moLsOO9z5z0tYkFtpBEdVqDE3yAZ4NCV9YC7a9UZP2fD1ynr1R/DgoDa8BSvSJQy33TY7BTmAgI4WGkwmpT0D/pBnJ/aH37c0JcrMAo1klCt1zAgTayptpgDMiY9iRCtQy9/b7ZyF2EalkQQWTnUvIOiBZ3dSCgG/bll6oWN7lm7JHV34/Co9rICIgtvWTnDYdjI0vNcX/41wWw4qkPB7Cq+qfIM3mLlnBW5XpAkrpK0af6j1t37XuPx+fpRKwHdws+MqIPIov90m3MTaRQtFpmcA1QlDEJRdVq8tOjQ== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1679345502; bh=ui4k01sCmOCUaIrzR4RLrdc5r2aeRkqv/cm0tWbydvO=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=SIJB8tuCKr7nfT9MAKk+WZ7IMJO44DltpdetCIXbjjsneOd7mfrqahh6CWhFonpAXZUUHG5LzMvBF/geYQNPckAfvLZ+DXIXKUWsH7yRnneDBs6Zy+X64isGgBZMoK9XC1KA6p/1lD05LqBcdfqRqNJe6cPlS8CjxL7n0CEnlBEDjQKxewzn2c70oncqjUnTDbihwfHUNItwGB6zH06oOTuGhwKS0nOqPBlOjYzwXsTjK0bnbrmxdS69WK+CqQ+NQOANPP5oBa/5POcQIyBOpkg3+aBT1G8xWLK+IvcGfiALDOEuBkQA3OosWuX9GWZ8doVZxlZjcyWN/dIF9i4qFA== X-YMail-OSG: pyjfiyIVM1mkI7MmEGMu6t_EUGLHe_oW6GuWhZWxn4vFCpVliOrbT6KndWnGOzQ hW45cenbmTRl.6kZG7gqSB1B2a1gaVT5xOTZR1RdsL7VPN4kkcx5__FeV_MeWtIRyhn0ArmzV9Xk JBQTXqZmYJMMI9QKx.GSds5.P6vhzoiw.uYbQnVqtR5ryWyz3jTb1jyQ4oS2yXqfpAbWDXK30he5 qLvg01kmGbD5kf2srwpVhKG9Kea1OjVLROIGWUN3wtlRdMAYmAGjIgw_pJx7fj30Fgfcsj94A8Fo KxT6iH1Qt1sNt9c5p8cUlQQUSI4azwOMw3h.Wy3cNNlJCtIieZX3JomJIw4HJSkF2AVUqiWdbPkF FJyPhmJSuo7wZy6SblMRXlY9NLWQxtPaeWGCjieiDqDro_uyiqgzZkNogt1QNPSB.0._IOkEADLl w4dw5qX7EdXKza1lGa_8K0tK1BuzysO0PZaK0T.pi4gkMi2b6krv4f2mdrEY9jwRdg2Q.8YTJV9M xr4s8JEBiFrx0.DqijC9POId2YhRIHc_GO6Pa0dt4Dyv1eOhzn3Nvw8YPD8m55S38IXtJqzIrAqo Zu40KI9oU5kkOO3xhq_tutrbVp_7tdUg5J3GGW7sWzWnEIHam2qmECVietncKJJsToA.4kKuPMIJ 9kXKk6ZeZbbfsLfAHdlRJksCN5WtDuXk2wctEn82pSigbarZKZPyTbsrNRGVXjhLe8GLj1iU_wWU .hjIbBO.R7dcp98brNXDsz4I7IWPG_Xo9WbJOU7aQ54uAjqZISZGeQgUukLASreoX48tUoQndayn r86Fhiy_X3cb1Sy9PyTE1VwfWWPcfalkE792U.YXt1EDIt6beEzvpgH6aaoceSHujd3S4L4hLUHN .KU5D7YU.nKs4cQV68PuFOANFhl3_rs2bCiKKYih7Ra0LzqgCO9RG1RRF_0ZalvhMZ59iTWsDxIo p_moVe5GE07MG21ImiTkNXxK34tz2GEgWWSTG_AtsO4GZw0kMLFDpogbX0RFCawCUIVkq5pSKNpL JhYBucJ6bBuZcno39ynCMKeqp7wfvxGRtJMCim0tio_CADvs_1V7._3n_uif00G7ahy2.RFRbrko u5Q1swcWB12vEsi7Ig8YNdB65iHp4tbvqbSj9KqHHvIcMjBAmXax.p7xK7kJJXCin92WSWoEl97. ilbipbZ7K4K4CiSPskDQIqz5TP5n5NqZm4m5qDwScyeknS83LHIV.yTeoVMnlFNPbizTTuQGkjhj UosaQVOdXmvz_mJ1BlfXm_koW9kSsprnp24FPwVGFXDtfmks8HwgpI7NTydutza.AOR3Hpn2MZDv Vf9c5pMg2znpvF8DCxGSFjobdmserg3rT43CF.GROctYbddES98beOdcZBCkOyF4TGRfIVofnVuh nr.qmwNMMtoJ7DOAw1.6mdpLPRzYhBduog2Czp3Y0GDcY05Kry8DiTq7aLLiqIpmlO0yAeMDY7z0 MyWDEN5CWP2Ftc2saPv8IOKX7HCG09rNa4VLZ2YPZL9Zw3K2ISUULyI2ohQKUi1R4b_LgKOOvQH1 Dfu1zcRvbVIj21ZblsCo5PCGe5ng3GH4LjqiMJiLmAv3azRVw6YZfGJLfRlXiJiTLDfISyuvV2t0 MTI.1K3e1LZir_Ed2oqZJIJgkRIRQ5X.JAeQrwX5qsYZgkT.B.MXjxYmwVcFEgCeYzYya1aZlIqW ur9RNSEBYmzkPTuflilqckYyukVijD4Fj5KxABIyYJO3_AM9XASOfysjeYcUtivuYN5o99n0PXdy 5gR6DN.LZLUoODccuPUwAD1tk8Us4c8hIEx25ozfFI_k6nY9aXtTlCfhPrf.1gBXGp59x6k8Xgeo pgbc0rrNzvC5YIerJxOlWFiJnwAdSEUIBxQ0CWeq9XJIUqgYwN4dz08FwmSkqzv0g0VZO17zjh9r 8CsYIWeLe3h5rc5kv2qJ4pJ1v7HE5PShTYRy9uUjDn4nulnzTy97aJaT88wxoRlCG.rTT8xoFxOa NTyJO1Wie1v75rrpW84au.lcnP7ZufGIRQZB4GzOAvae3XAQu8NmipqIRd.PJIS.t3QhjJwAJjEA t_MYZzDys.QADGbi8QbXX8gcHCwYXUdiXSYv7RycEdR2udfzokgewCkuETKD5MF7T.fMtVxyEfDA P7Mori1aZmrpkQWeETUHbqGtrrbVW0bvIUn1YjpaErt.aFy8XedXa04k1OHybh1RE64IQhy9eT7j pe9_OEZ4UleZZ93aj2mRu8pgqQRbsOJc61GsJCYoNqFknQW7.mOmtcbU4MKt8iYcBeA1xvwHrAw- - X-Sonic-MF: X-Sonic-ID: 327faff9-ae07-4b9f-bd7d-9987095b2f60 Received: from sonic.gate.mail.ne1.yahoo.com by sonic306.consmr.mail.gq1.yahoo.com with HTTP; Mon, 20 Mar 2023 20:51:42 +0000 Received: by hermes--production-gq1-6cf7749bc8-g5z7v (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 66719f9c39054892c53e39d536b7fd5c; Mon, 20 Mar 2023 20:51:38 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.400.51.1.1\)) Subject: Re: Poudriere friendly armv7 relases From: Mark Millard In-Reply-To: <20230320202847.GW2347@FreeBSD.org> Date: Mon, 20 Mar 2023 13:51:27 -0700 Cc: Warner Losh , "freebsd-arm@freebsd.org" Content-Transfer-Encoding: quoted-printable Message-Id: <477846FC-FC56-4A2E-B2BD-FB98500B0F7F@yahoo.com> References: <20230320202847.GW2347@FreeBSD.org> To: Glen Barber X-Mailer: Apple Mail (2.3731.400.51.1.1) X-Rspamd-Queue-Id: 4PgRjr2zbJz3nXV X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On Mar 20, 2023, at 13:28, Glen Barber wrote: > On Mon, Mar 20, 2023 at 02:06:50PM -0600, Warner Losh wrote: >> Greetings, >>=20 >> Since it looks like we're going to retain at least armv7 for FreeBSD = 14 >> (armv6 has been nominated for deprecation, but if it isn't = deprecated, all >> this applies to it). >>=20 >> I'd like to start making at least the base.tgz, etc available for = armv7. >> This would allow us to create armv7 poduriere jails without building = from >> source. >>=20 >> Is there some reason we're not doing this today? I know ISOs don't = make a >> lot of sense in the arm ecosystem, but having these artifacts would = enable >> poudriere binary install support. >>=20 >> Comments? >>=20 >=20 > Several. :) >=20 > I have looked into this in the past, and mhorne@ had even added some > environment knobs to the way armv7 is built, however I later realized > that it was not 1:1 compatible with how base.txz, etc., are generated > for other architectures. >=20 > 1) For other architectures, base.txz is result of the 'ftp' target in > /usr/src/release. >=20 > 2) armv7 does not have an 'ftp' target. (Well, it does not *disallow* > it, and probably should at the immediate moment, but it does blow > up.) >=20 > 3) Most importantly, and the reason I stopped looking further into = this, > we cannot run native armv7 binaries on an amd64 system (at least, > last I was aware). Does chroot and the like count for your purpose? armv7 packages are built without qemu or the like's involvement: default 131releng-armv7 on ampere3 quarterly 131releng-armv7 on ampere1 default main-armv7 on ampere2 This has been going on since 2022-Aug or so. I personally build for armv7 on a HoneyComb and have done so on a RPi4B in the past. (This is both system builds and package builds.) Basically all these machines support AArch32 in addition to AArch64: # sysctl kern.supported_archs kern.supported_archs: aarch64 armv7 > Particularly, we can only actually use what is > listed in kern.supported_archs, The ampere*'s should list armv7 in addition to aach64. (I've no access of my own to directly validate but given that ports are turned into packages . . .) > at least without falling back to some > sort of emulation or wrapper support (such as qemu or the like). Should not be needed, presuming access to have jobs run on one or more ampere* systems. > Back when armv6 and armv7 support was added using shell scripts = instead > of hooking into release/Makefile, having a base.txz did not make much > sense because there were different environment variables that were > passed into the resulting output, some of which affected the loader > output, etc., specifically with regard to u-boot. I am not sure if = this > is still an issue or a concern, however. QUOTE author Emmanuel Vadot 2021-05-11 18:27:14 +0000 committer Emmanuel Vadot 2021-05-11 20:22:54 +0000 commit 0d6e5081eb0080c4703f1c5cc69c34f38d9149b7 (patch) tree a22f954f3003c1361f4ea5a411e92759a80c9089 /sysutils/u-boot-master parent c5fd1c2e186abb2e3209fa48d75d8dcdcda63f06 (diff) download ports-0d6e5081eb0080c4703f1c5cc69c34f38d9149b7.tar.gz ports-0d6e5081eb0080c4703f1c5cc69c34f38d9149b7.zip sysutils/u-boot-*: Remove ubldr support We have been using loader.efi on armv7 for a long time now. Remove = support for booting with ubldr and the needed patches that were never = upstreamed. While here add CONFIG_EFI_GRUB_ARM32_WORKAROUND=3Dy in the = Fragment as it's needed to have the cache flushed for us when loader.efi = is started.=20 END QUOTE So: before 2021-Jun. > That said, I can take a look and see if we can package base.txz for > armv7, however I would like to do some archaeology work here to be = sure > that the resultant output is not going to have unexpected behavior > because of the userland not matching 100% the target SoC. =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Mon Mar 20 21:03:53 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4PgRzv6pYCz40GK3 for ; Mon, 20 Mar 2023 21:03:55 +0000 (UTC) (envelope-from gjb@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [96.47.72.132]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "freefall.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4PgRzv6KYGz3pN8; Mon, 20 Mar 2023 21:03:55 +0000 (UTC) (envelope-from gjb@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1679346235; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=uX7XAAMsVirGdJWfXYbZZC2EIHf9EiO+3BhieFGyRvM=; b=eRgTJHDNL7ko2CP6aqugyMhfj1j+sh2ZgKzhydgCpcXJ1bPyWk3GAt9VwH9ILXYxj0p24z tIf6HakIKWj3f9JKpxjCnAK+/jHb2/KObe2KHVecZnXpgZpYK6/Hhp4HjN1V09ZBIhzput gO+nc3yZe/UkvMLH2laRzpiQS+sW3SaD/BNwpKwHTDVxaUE7XXKjNKl8cm1c/b/gyioa+a cQk3La1ynBMEaSAnnehCurCAZWQveJGysJFOs6bCQnmQnHpUniNMo+g3PCnGBlIM6WtJbR xhWRriTmWl/uYLDScMaI8vY3iQruzCZhUhsClZAbGrtd2gdpiDMRSmt7Qlo4Nw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1679346235; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=uX7XAAMsVirGdJWfXYbZZC2EIHf9EiO+3BhieFGyRvM=; b=U8Ez3QXHt7CXXZklF7IyiYycb+5CT40nVxGHsj1S9t1Z67a+QoXQjFKnLIGu4VsBVEsd5z 02IQoJY022Aq1ykl7AxIjHI6Oyj96uUcv4hOjg4Qm+aN4c0nXKTQi19MFlOXylq5UGIGLH IOIT1vdJdtJl4bN9jsckqmETZnzPW0hhfxtMLDxHwfKOO2t/u7DfTRxiRjTCaVK0tEpnB8 T/o3tiRnFffAgo34eRmt32OfcAB/QBGUFkiZ0tDhQppN3Jbx2T9GSA+2ckwWQJJjBTTZ4F tlJRoU2IQnyYHCY0GGNROdehw+ism808ppBZawzopffBXBK9M0J5JO7x2RFqJg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1679346235; a=rsa-sha256; cv=none; b=pgO+3QnpuXi0oXJ+K0MMke5FceMpvciBc69s8du6vpwfpbqw51RpkNlFYDEL5Wh9scjf4O N2/JrBlOnd/xHoGiXTBtZkhcqg+hP8Sw85JuEoy6YqbzR+NPHYl7ALab+qJyW/Jwh7m/RS H/HqgjLv1nZJq1Hm4rjRThiijydmELzHPaqu0tLCIbNpkVEfH5pTqXHblKXSjjjScsXBDu OeBoPLDulPfzXrp2p53juSh9Nq7+TFWZ5aT8cjqEICmHsYg8BLkj7IfCX+kGlCoe1vf1/w PZyo2XmUsfbX+3wvqRH92u1OYALZuB7aFh+0EQutulASzw09xUU+SfUZCFvOjg== Received: from FreeBSD.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by freefall.freebsd.org (Postfix) with ESMTPS id 997572646; Mon, 20 Mar 2023 21:03:55 +0000 (UTC) (envelope-from gjb@freebsd.org) Date: Mon, 20 Mar 2023 21:03:53 +0000 From: Glen Barber To: Mark Millard Cc: Warner Losh , "freebsd-arm@freebsd.org" Subject: Re: Poudriere friendly armv7 relases Message-ID: <20230320210353.GZ2347@FreeBSD.org> References: <20230320202847.GW2347@FreeBSD.org> <477846FC-FC56-4A2E-B2BD-FB98500B0F7F@yahoo.com> List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="+9WMDU/RdULAIC7Q" Content-Disposition: inline In-Reply-To: <477846FC-FC56-4A2E-B2BD-FB98500B0F7F@yahoo.com> X-ThisMailContainsUnwantedMimeParts: N --+9WMDU/RdULAIC7Q Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Mar 20, 2023 at 01:51:27PM -0700, Mark Millard wrote: > On Mar 20, 2023, at 13:28, Glen Barber wrote: >=20 > > On Mon, Mar 20, 2023 at 02:06:50PM -0600, Warner Losh wrote: > >> Greetings, > >>=20 > >> Since it looks like we're going to retain at least armv7 for FreeBSD 14 > >> (armv6 has been nominated for deprecation, but if it isn't deprecated,= all > >> this applies to it). > >>=20 > >> I'd like to start making at least the base.tgz, etc available for armv= 7. > >> This would allow us to create armv7 poduriere jails without building f= rom > >> source. > >>=20 > >> Is there some reason we're not doing this today? I know ISOs don't mak= e a > >> lot of sense in the arm ecosystem, but having these artifacts would en= able > >> poudriere binary install support. > >>=20 > >> Comments? > >>=20 > >=20 > > Several. :) > >=20 > > I have looked into this in the past, and mhorne@ had even added some > > environment knobs to the way armv7 is built, however I later realized > > that it was not 1:1 compatible with how base.txz, etc., are generated > > for other architectures. > >=20 > > 1) For other architectures, base.txz is result of the 'ftp' target in > > /usr/src/release. > >=20 > > 2) armv7 does not have an 'ftp' target. (Well, it does not *disallow* > > it, and probably should at the immediate moment, but it does blow > > up.) > >=20 > > 3) Most importantly, and the reason I stopped looking further into this, > > we cannot run native armv7 binaries on an amd64 system (at least, > > last I was aware). >=20 > Does chroot and the like count for your purpose? >=20 > armv7 packages are built without qemu or the like's > involvement: >=20 > default 131releng-armv7 on ampere3 > quarterly 131releng-armv7 on ampere1 > default main-armv7 on ampere2 >=20 > This has been going on since 2022-Aug or so. >=20 These are natively built on arm64 hardware. > I personally build for armv7 on a HoneyComb > and have done so on a RPi4B in the past. (This > is both system builds and package builds.) >=20 > Basically all these machines support AArch32 > in addition to AArch64: >=20 > # sysctl kern.supported_archs > kern.supported_archs: aarch64 armv7 >=20 >=20 > > Particularly, we can only actually use what is > > listed in kern.supported_archs, >=20 > The ampere*'s should list armv7 in addition to aach64. > (I've no access of my own to directly validate but > given that ports are turned into packages . . .) >=20 aarch64 and armv7 are indeed listed. > > at least without falling back to some > > sort of emulation or wrapper support (such as qemu or the like). >=20 > Should not be needed, presuming access to have > jobs run on one or more ampere* systems. >=20 The release build machines are (by design) kept separate from the rest of the infrastructure within which we operate. (Same for the package builders, as well.) > > Back when armv6 and armv7 support was added using shell scripts instead > > of hooking into release/Makefile, having a base.txz did not make much > > sense because there were different environment variables that were > > passed into the resulting output, some of which affected the loader > > output, etc., specifically with regard to u-boot. I am not sure if this > > is still an issue or a concern, however. >=20 > QUOTE > author Emmanuel Vadot 2021-05-11 18:27:14 +0000 > committer Emmanuel Vadot 2021-05-11 20:22:54 +0000 > commit 0d6e5081eb0080c4703f1c5cc69c34f38d9149b7 (patch) > tree a22f954f3003c1361f4ea5a411e92759a80c9089 /sysutils/u-boot-master > parent c5fd1c2e186abb2e3209fa48d75d8dcdcda63f06 (diff) > download ports-0d6e5081eb0080c4703f1c5cc69c34f38d9149b7.tar.gz > ports-0d6e5081eb0080c4703f1c5cc69c34f38d9149b7.zip >=20 > sysutils/u-boot-*: Remove ubldr support >=20 > We have been using loader.efi on armv7 for a long time now. Remove suppor= t for booting with ubldr and the needed patches that were never upstreamed.= While here add CONFIG_EFI_GRUB_ARM32_WORKAROUND=3Dy in the Fragment as it'= s needed to have the cache flushed for us when loader.efi is started.=20 > END QUOTE >=20 >=20 > So: before 2021-Jun. >=20 Noted. Thank you for looking. > > That said, I can take a look and see if we can package base.txz for > > armv7, however I would like to do some archaeology work here to be sure > > that the resultant output is not going to have unexpected behavior > > because of the userland not matching 100% the target SoC. >=20 >=20 Glen --+9WMDU/RdULAIC7Q Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEjRJAPC5sqwhs9k2jAxRYpUeP4pMFAmQYyjkACgkQAxRYpUeP 4pMl3RAAivYlZa9fiQER7fgm2aDENndsoTQF7C6QefBXKMbJr+kvhcT9MsQasjlM tttcf6Ri8YHYvltSTV134OPCr8ykYu8FWurR0JCEjN2yLqiiLuKui+tTvnFfrY1h HNpRWF67MD9g7C4hhgUoRhjysIiq30km4WfFoagKXZwEOflQ9BeTsbZEOz/qSTvr ZE1LEhakSA83g0SszlNeezS/LSTI4IHJph2EvFfm4vE3W4Hr5yncxftbyE9WakLL wv7HqEuTlmp57YRsbnbp+BND5f4mmKC6FT5A2jVwfGu8Fg+gw3y9SkKex2ipQ/RZ +A9XGjjEWemrut9hiyeOofABUXYI5QXg09cPxQTdoAUzWz0XxkKtC+QYPW6srKHm QZ5UN8zSp8cHkEWwndsISyzPdgqcNLHDC38czzN3H+ej9fcT627TWjwYoU7THSGp nN8DH3lqu9u90TDJ7zo5eB48+6/ewT0ngBzMEFDJhrtIE7rjjxvzax1357of6GrL +h1vE5D6lLZNzgdUSsWDUeja8cD0vw4LBGeVz5+QH5H4bankZFNaQwhkFY9+upvo fMrE2iDwjq2GOJfaSSwnErZOr0LYhx8csWRM5FOhs8o5kbAykzSadm76PnqKQjJ8 Iq6Ch37rLEYy5kNnOizV8eSukKglJ7oV6KNSNxyvpT/kR7J7B3U= =tILT -----END PGP SIGNATURE----- --+9WMDU/RdULAIC7Q-- From nobody Mon Mar 20 21:23:08 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4PgSQJ1nWTz40HYs for ; Mon, 20 Mar 2023 21:23:20 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-ed1-x52e.google.com (mail-ed1-x52e.google.com [IPv6:2a00:1450:4864:20::52e]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4PgSQJ1JmVz3rBm for ; Mon, 20 Mar 2023 21:23:20 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-ed1-x52e.google.com with SMTP id x3so52190562edb.10 for ; Mon, 20 Mar 2023 14:23:20 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20210112.gappssmtp.com; s=20210112; t=1679347399; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=krGsrHy52kGjYd3npJM9b93BYuOaI2+x8TfhGrmorFU=; b=mQi1m8/SsQwN3wBmM4KBPevGfU7znXFKeyK+f3gX9OJNv78wdUtl/En1PyRfkS1v3+ rPaq4K49Ka1scqcaIdKtqH5ZW/nxPW23jPSV3I4usGwzrM2uCGWyUljGkvJQewrIM6CF EfBBvkaLBCvTyCoGowNWYXFYQ/fsQHbB6vb//zZgX/+tK9rR02g0B7kWPK+c/j/hehcZ vjyYOcWxZDH2+VeM6dMQKuHmCzEJzaTKNBavn0Tk2MPjnY9g6UqsQFi3eDm5ljYlhypV wajHfvY352We3nfocf604Z4VeH4+cDdA4QL97XW6iEMNnT7fZY0sH8iyCiibcHTDRQzR k3nw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; t=1679347399; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=krGsrHy52kGjYd3npJM9b93BYuOaI2+x8TfhGrmorFU=; b=etjBpjGbK7iFYS7FT76tcHeg7kziBHiEs4b5Sghgp7fTC8W1blpCfG04p0R014hurg 8t7bn0eTzYc9x8j/Xpr1BUnAKV1mH/J9mSD6FelRwLSb6Kchl/kyPdKLtfW4TwsGdRVq N5cYUO0UrEaduj1o1ONEcpE/0B7pdP50MI6F4Nl3O89KRKWqnCppIPGvcdaD+gPADyJD KkSW7JFfgma5d8oCn5Ng+7GPgSkvqvsAdIWJVyG2uBZ/6OZVxKr8o39P7pd0uxj+RKaU SKRQjxWC+ihXsO+9O8PxrYHJkAF9IeAucaz9kL7Zg6+9o7FUO8ljH9UjfOj+i+abo4kl uPrQ== X-Gm-Message-State: AO0yUKVsyVU+l7l2CK6scndaBpExR+QCtrSJ2tqwzZcA42Vum9D4lwrj y4h5LbBzsIOdLGjtFbYhixmI/OB0KDafA6zzfYlGsA== X-Google-Smtp-Source: AK7set/BzOZGI010l8Cu/Tk8cZ5d5Vp4mHULZIrW63SDzKdJjvwSRD6PqZBNZZ5X6jPOmTOq1JOxwdbLgK04F1GXC1E= X-Received: by 2002:a17:906:c413:b0:92f:7c42:863d with SMTP id u19-20020a170906c41300b0092f7c42863dmr246878ejz.2.1679347399082; Mon, 20 Mar 2023 14:23:19 -0700 (PDT) List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 References: <20230320202847.GW2347@FreeBSD.org> <477846FC-FC56-4A2E-B2BD-FB98500B0F7F@yahoo.com> In-Reply-To: <477846FC-FC56-4A2E-B2BD-FB98500B0F7F@yahoo.com> From: Warner Losh Date: Mon, 20 Mar 2023 15:23:08 -0600 Message-ID: Subject: Re: Poudriere friendly armv7 relases To: Mark Millard Cc: Glen Barber , "freebsd-arm@freebsd.org" Content-Type: multipart/alternative; boundary="0000000000002d559505f75b8952" X-Rspamd-Queue-Id: 4PgSQJ1JmVz3rBm X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N --0000000000002d559505f75b8952 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Mon, Mar 20, 2023 at 2:51=E2=80=AFPM Mark Millard wr= ote: > On Mar 20, 2023, at 13:28, Glen Barber wrote: > > > On Mon, Mar 20, 2023 at 02:06:50PM -0600, Warner Losh wrote: > >> Greetings, > >> > >> Since it looks like we're going to retain at least armv7 for FreeBSD 1= 4 > >> (armv6 has been nominated for deprecation, but if it isn't deprecated, > all > >> this applies to it). > >> > >> I'd like to start making at least the base.tgz, etc available for armv= 7. > >> This would allow us to create armv7 poduriere jails without building > from > >> source. > >> > >> Is there some reason we're not doing this today? I know ISOs don't mak= e > a > >> lot of sense in the arm ecosystem, but having these artifacts would > enable > >> poudriere binary install support. > >> > >> Comments? > >> > > > > Several. :) > > > > I have looked into this in the past, and mhorne@ had even added some > > environment knobs to the way armv7 is built, however I later realized > > that it was not 1:1 compatible with how base.txz, etc., are generated > > for other architectures. > > > > 1) For other architectures, base.txz is result of the 'ftp' target in > > /usr/src/release. > > > > 2) armv7 does not have an 'ftp' target. (Well, it does not *disallow* > > it, and probably should at the immediate moment, but it does blow > > up.) > > > > 3) Most importantly, and the reason I stopped looking further into this= , > > we cannot run native armv7 binaries on an amd64 system (at least, > > last I was aware). > > Does chroot and the like count for your purpose? > > armv7 packages are built without qemu or the like's > involvement: > > default 131releng-armv7 on ampere3 > quarterly 131releng-armv7 on ampere1 > default main-armv7 on ampere2 > > This has been going on since 2022-Aug or so. > > I personally build for armv7 on a HoneyComb > and have done so on a RPi4B in the past. (This > is both system builds and package builds.) > True, but I want bsd-user's armv7 working and upstreamed... it will make doing riscv64, which doesn't have this, easier to support next. > Basically all these machines support AArch32 > in addition to AArch64: > > # sysctl kern.supported_archs > kern.supported_archs: aarch64 armv7 > > > > Particularly, we can only actually use what is > > listed in kern.supported_archs, > > The ampere*'s should list armv7 in addition to aach64. > (I've no access of my own to directly validate but > given that ports are turned into packages . . .) > > > at least without falling back to some > > sort of emulation or wrapper support (such as qemu or the like). > > Should not be needed, presuming access to have > jobs run on one or more ampere* systems. > > > Back when armv6 and armv7 support was added using shell scripts instead > > of hooking into release/Makefile, having a base.txz did not make much > > sense because there were different environment variables that were > > passed into the resulting output, some of which affected the loader > > output, etc., specifically with regard to u-boot. I am not sure if thi= s > > is still an issue or a concern, however. > > QUOTE > author Emmanuel Vadot 2021-05-11 18:27:14 +0000 > committer Emmanuel Vadot 2021-05-11 20:22:54 +0000 > commit 0d6e5081eb0080c4703f1c5cc69c34f38d9149b7 (patch) > tree a22f954f3003c1361f4ea5a411e92759a80c9089 /sysutils/u-boot-master > parent c5fd1c2e186abb2e3209fa48d75d8dcdcda63f06 (diff) > download ports-0d6e5081eb0080c4703f1c5cc69c34f38d9149b7.tar.gz > ports-0d6e5081eb0080c4703f1c5cc69c34f38d9149b7.zip > > sysutils/u-boot-*: Remove ubldr support > > We have been using loader.efi on armv7 for a long time now. Remove suppor= t > for booting with ubldr and the needed patches that were never upstreamed. > While here add CONFIG_EFI_GRUB_ARM32_WORKAROUND=3Dy in the Fragment as it= 's > needed to have the cache flushed for us when loader.efi is started. > END QUOTE > > > So: before 2021-Jun. > Yes.. but there's still some customers that use it.... and I'm saying that they are niche enough at this point to not care :) Warner > > That said, I can take a look and see if we can package base.txz for > > armv7, however I would like to do some archaeology work here to be sure > > that the resultant output is not going to have unexpected behavior > > because of the userland not matching 100% the target SoC. > > > =3D=3D=3D > Mark Millard > marklmi at yahoo.com > > --0000000000002d559505f75b8952 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


=
On Mon, Mar 20, 2023 at 2:51=E2=80=AF= PM Mark Millard <marklmi@yahoo.com<= /a>> wrote:
O= n Mar 20, 2023, at 13:28, Glen Barber <gjb@freebsd.org> wrote:

> On Mon, Mar 20, 2023 at 02:06:50PM -0600, Warner Losh wrote:
>> Greetings,
>>
>> Since it looks like we're going to retain at least armv7 for F= reeBSD 14
>> (armv6 has been nominated for deprecation, but if it isn't dep= recated, all
>> this applies to it).
>>
>> I'd like to start making at least the base.tgz, etc available = for armv7.
>> This would allow us to create armv7 poduriere jails without buildi= ng from
>> source.
>>
>> Is there some reason we're not doing this today? I know ISOs d= on't make a
>> lot of sense in the arm ecosystem, but having these artifacts woul= d enable
>> poudriere binary install support.
>>
>> Comments?
>>
>
> Several.=C2=A0 :)
>
> I have looked into this in the past, and mhorne@ had even added some > environment knobs to the way armv7 is built, however I later realized<= br> > that it was not 1:1 compatible with how base.txz, etc., are generated<= br> > for other architectures.
>
> 1) For other architectures, base.txz is result of the 'ftp' ta= rget in
>=C2=A0 =C2=A0/usr/src/release.
>
> 2) armv7 does not have an 'ftp' target.=C2=A0 (Well, it does n= ot *disallow*
>=C2=A0 =C2=A0it, and probably should at the immediate moment, but it do= es blow
>=C2=A0 =C2=A0up.)
>
> 3) Most importantly, and the reason I stopped looking further into thi= s,
>=C2=A0 =C2=A0we cannot run native armv7 binaries on an amd64 system (at= least,
>=C2=A0 =C2=A0last I was aware).

Does chroot and the like count for your purpose?

armv7 packages are built without qemu or the like's
involvement:

default=C2=A0 =C2=A0131releng-armv7 on ampere3
quarterly 131releng-armv7 on ampere1
default=C2=A0 =C2=A0main-armv7=C2=A0 =C2=A0 =C2=A0 on ampere2

This has been going on since 2022-Aug or so.

I personally build for armv7 on a HoneyComb
and have done so on a RPi4B in the past. (This
is both system builds and package builds.)

<= div>True, but I want bsd-user's armv7 working and upstreamed... it will= make doing riscv64, which
doesn't have this, easier to suppo= rt next.
=C2=A0
Basically all these machines support AArch32
in addition to AArch64:

# sysctl kern.supported_archs
kern.supported_archs: aarch64 armv7


> Particularly, we can only actually use what is
>=C2=A0 =C2=A0listed in kern.supported_archs,

The ampere*'s should list armv7 in addition to aach64.
(I've no access of my own to directly validate but
given that ports are turned into packages . . .)

> at least without falling back to some
>=C2=A0 =C2=A0sort of emulation or wrapper support (such as qemu or the = like).

Should=C2=A0 not be needed, presuming access to have
jobs run on one or more ampere* systems.

> Back when armv6 and armv7 support was added using shell scripts instea= d
> of hooking into release/Makefile, having a base.txz did not make much<= br> > sense because there were different environment variables that were
> passed into the resulting output, some of which affected the loader > output, etc., specifically with regard to u-boot.=C2=A0 I am not sure = if this
> is still an issue or a concern, however.

QUOTE
author Emmanuel Vadot <manu@FreeBSD.org> 2021-05-11 18:27:14 +0000 committer Emmanuel Vadot <manu@FreeBSD.org> 2021-05-11 20:22:54 +0000=
commit 0d6e5081eb0080c4703f1c5cc69c34f38d9149b7 (patch)
tree a22f954f3003c1361f4ea5a411e92759a80c9089 /sysutils/u-boot-master
parent c5fd1c2e186abb2e3209fa48d75d8dcdcda63f06 (diff)
download ports-0d6e5081eb0080c4703f1c5cc69c34f38d9149b7.tar.gz
ports-0d6e5081eb0080c4703f1c5cc69c34f38d9149b7.zip

sysutils/u-boot-*: Remove ubldr support

We have been using loader.efi on armv7 for a long time now. Remove support = for booting with ubldr and the needed patches that were never upstreamed. W= hile here add CONFIG_EFI_GRUB_ARM32_WORKAROUND=3Dy in the Fragment as it= 9;s needed to have the cache flushed for us when loader.efi is started. END QUOTE


So: before 2021-Jun.

Yes.. but there= 9;s still some customers that use it.... and I'm saying that they are n= iche enough at this point to not care :)

Warner
=C2=A0
> That said, I can take a look and see if we can package base.txz for > armv7, however I would like to do some archaeology work here to be sur= e
> that the resultant output is not going to have unexpected behavior
> because of the userland not matching 100% the target SoC.


=3D=3D=3D
Mark Millard
marklmi at yahoo.com

--0000000000002d559505f75b8952-- From nobody Mon Mar 20 21:24:36 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4PgSS04kyJz40HZB for ; Mon, 20 Mar 2023 21:24:48 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-ed1-x533.google.com (mail-ed1-x533.google.com [IPv6:2a00:1450:4864:20::533]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4PgSS033SYz3rm7 for ; Mon, 20 Mar 2023 21:24:48 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-ed1-x533.google.com with SMTP id h8so52236530ede.8 for ; Mon, 20 Mar 2023 14:24:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20210112.gappssmtp.com; s=20210112; t=1679347487; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=SK0zLKhGtwhqFMaeuPvJUXD+dzCek3DSh1/qWtx13hg=; b=flaLeRNBYGgJO3KSeVXWjYDtRGSKmQc/XvtH/PR5Y5UevTelhx0mmIB/8jOANSs8i2 w8pyhjPwA5mIGTTPwSMy/0Ep708wuHalSYgM0gZ7Alg7ef+m/7L0tfM5BUx+K/stMKa+ ThgdSHAIymxZQPGaB7itql/Z6gaH1z1lW4gIjV7piLhVzTIYC9JjL0Zpu9Fu0L7OP9ow gyw3xU0F+EIr69h29Dln4L/g60WixOYxVTo18rt+i5uZNlEppqSKUpAHjc0htW22dC0o tNHD9EYWn027SKCUNPFwNjIaqP1pPRqSMfVdOeayVRMY8CPlZYh7QmaEGKqpSczFJ7Tq UB/g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; t=1679347487; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=SK0zLKhGtwhqFMaeuPvJUXD+dzCek3DSh1/qWtx13hg=; b=Kf+r36KRmj13jyY9T31aKGk/8wkbZLmZVEBavf4vrFSik6uEuMHPVlMT5y8AqX35LS KhLuuaRHzf/5XKKZVQ3nOUlWJJmio/51je7CYBjZGsf5t/Aebqtu5m3elncEir7aWONy J3+6B7PnKd/8QkdQDIjc+O/JfBfra25jfiuWqOmI8ftvWg4ubuMSTBcsHlAYLfg944op QJ5mMkJc1eGIaINja8kxJKFKVrXKVlY6qo2BKkpGrFTGVPLKay27EK7qRyZsmdyEoLgC 6QbXgAQC+j2MtX3ZrQxE+jpRM6hjn/foRF5Xq8Bv62WqErho+nspbJt0I7zBSUGO2pRx 9Djg== X-Gm-Message-State: AO0yUKUyyUP1zYuFZwl4U9FEX7yQkE3tWimB6bzYrYywQ8EF2HY4hfjH wJqet+G15PWi9zAEJNiv2Cb/KvS7vIg4mRKMoSK5Kw== X-Google-Smtp-Source: AK7set/KFA1Z/TIeUaSjs/O3F4ALYtzeL3fPsvEM/9h7r6OL47RBkf8ii40V8Y6LZ5AuSk6pVICfSNOGnwuvjZ0jL8U= X-Received: by 2002:a17:907:7d87:b0:931:f8b1:4474 with SMTP id oz7-20020a1709077d8700b00931f8b14474mr251589ejc.2.1679347487210; Mon, 20 Mar 2023 14:24:47 -0700 (PDT) List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 References: <20230320202847.GW2347@FreeBSD.org> <477846FC-FC56-4A2E-B2BD-FB98500B0F7F@yahoo.com> <20230320210353.GZ2347@FreeBSD.org> In-Reply-To: <20230320210353.GZ2347@FreeBSD.org> From: Warner Losh Date: Mon, 20 Mar 2023 15:24:36 -0600 Message-ID: Subject: Re: Poudriere friendly armv7 relases To: Glen Barber Cc: Mark Millard , "freebsd-arm@freebsd.org" Content-Type: multipart/alternative; boundary="0000000000006e129005f75b8efb" X-Rspamd-Queue-Id: 4PgSS033SYz3rm7 X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N --0000000000006e129005f75b8efb Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Mon, Mar 20, 2023 at 3:03=E2=80=AFPM Glen Barber wrote= : > On Mon, Mar 20, 2023 at 01:51:27PM -0700, Mark Millard wrote: > > On Mar 20, 2023, at 13:28, Glen Barber wrote: > > > > > On Mon, Mar 20, 2023 at 02:06:50PM -0600, Warner Losh wrote: > > >> Greetings, > > >> > > >> Since it looks like we're going to retain at least armv7 for FreeBSD > 14 > > >> (armv6 has been nominated for deprecation, but if it isn't > deprecated, all > > >> this applies to it). > > >> > > >> I'd like to start making at least the base.tgz, etc available for > armv7. > > >> This would allow us to create armv7 poduriere jails without building > from > > >> source. > > >> > > >> Is there some reason we're not doing this today? I know ISOs don't > make a > > >> lot of sense in the arm ecosystem, but having these artifacts would > enable > > >> poudriere binary install support. > > >> > > >> Comments? > > >> > > > > > > Several. :) > > > > > > I have looked into this in the past, and mhorne@ had even added some > > > environment knobs to the way armv7 is built, however I later realized > > > that it was not 1:1 compatible with how base.txz, etc., are generated > > > for other architectures. > > > > > > 1) For other architectures, base.txz is result of the 'ftp' target in > > > /usr/src/release. > > > > > > 2) armv7 does not have an 'ftp' target. (Well, it does not *disallow= * > > > it, and probably should at the immediate moment, but it does blow > > > up.) > > > > > > 3) Most importantly, and the reason I stopped looking further into > this, > > > we cannot run native armv7 binaries on an amd64 system (at least, > > > last I was aware). > > > > Does chroot and the like count for your purpose? > > > > armv7 packages are built without qemu or the like's > > involvement: > > > > default 131releng-armv7 on ampere3 > > quarterly 131releng-armv7 on ampere1 > > default main-armv7 on ampere2 > > > > This has been going on since 2022-Aug or so. > > > > These are natively built on arm64 hardware. > I should have pointed out that my requested change is useful for this as well. Independent of my desire to have it for cross builds, is the need for this setup to be installed w/o building from source. Warner > > I personally build for armv7 on a HoneyComb > > and have done so on a RPi4B in the past. (This > > is both system builds and package builds.) > > > > Basically all these machines support AArch32 > > in addition to AArch64: > > > > # sysctl kern.supported_archs > > kern.supported_archs: aarch64 armv7 > > > > > > > Particularly, we can only actually use what is > > > listed in kern.supported_archs, > > > > The ampere*'s should list armv7 in addition to aach64. > > (I've no access of my own to directly validate but > > given that ports are turned into packages . . .) > > > > aarch64 and armv7 are indeed listed. > > > > at least without falling back to some > > > sort of emulation or wrapper support (such as qemu or the like). > > > > Should not be needed, presuming access to have > > jobs run on one or more ampere* systems. > > > > The release build machines are (by design) kept separate from the rest > of the infrastructure within which we operate. (Same for the package > builders, as well.) > > > > Back when armv6 and armv7 support was added using shell scripts inste= ad > > > of hooking into release/Makefile, having a base.txz did not make much > > > sense because there were different environment variables that were > > > passed into the resulting output, some of which affected the loader > > > output, etc., specifically with regard to u-boot. I am not sure if > this > > > is still an issue or a concern, however. > > > > QUOTE > > author Emmanuel Vadot 2021-05-11 18:27:14 +0000 > > committer Emmanuel Vadot 2021-05-11 20:22:54 +0000 > > commit 0d6e5081eb0080c4703f1c5cc69c34f38d9149b7 (patch) > > tree a22f954f3003c1361f4ea5a411e92759a80c9089 /sysutils/u-boot-master > > parent c5fd1c2e186abb2e3209fa48d75d8dcdcda63f06 (diff) > > download ports-0d6e5081eb0080c4703f1c5cc69c34f38d9149b7.tar.gz > > ports-0d6e5081eb0080c4703f1c5cc69c34f38d9149b7.zip > > > > sysutils/u-boot-*: Remove ubldr support > > > > We have been using loader.efi on armv7 for a long time now. Remove > support for booting with ubldr and the needed patches that were never > upstreamed. While here add CONFIG_EFI_GRUB_ARM32_WORKAROUND=3Dy in the > Fragment as it's needed to have the cache flushed for us when loader.efi = is > started. > > END QUOTE > > > > > > So: before 2021-Jun. > > > > Noted. Thank you for looking. > > > > That said, I can take a look and see if we can package base.txz for > > > armv7, however I would like to do some archaeology work here to be su= re > > > that the resultant output is not going to have unexpected behavior > > > because of the userland not matching 100% the target SoC. > > > > > > Glen > > --0000000000006e129005f75b8efb Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


=
On Mon, Mar 20, 2023 at 3:03=E2=80=AF= PM Glen Barber <gjb@freebsd.org&g= t; wrote:
On Mon= , Mar 20, 2023 at 01:51:27PM -0700, Mark Millard wrote:
> On Mar 20, 2023, at 13:28, Glen Barber <gjb@freebsd.org> wrote:
>
> > On Mon, Mar 20, 2023 at 02:06:50PM -0600, Warner Losh wrote:
> >> Greetings,
> >>
> >> Since it looks like we're going to retain at least armv7 = for FreeBSD 14
> >> (armv6 has been nominated for deprecation, but if it isn'= t deprecated, all
> >> this applies to it).
> >>
> >> I'd like to start making at least the base.tgz, etc avail= able for armv7.
> >> This would allow us to create armv7 poduriere jails without b= uilding from
> >> source.
> >>
> >> Is there some reason we're not doing this today? I know I= SOs don't make a
> >> lot of sense in the arm ecosystem, but having these artifacts= would enable
> >> poudriere binary install support.
> >>
> >> Comments?
> >>
> >
> > Several.=C2=A0 :)
> >
> > I have looked into this in the past, and mhorne@ had even added s= ome
> > environment knobs to the way armv7 is built, however I later real= ized
> > that it was not 1:1 compatible with how base.txz, etc., are gener= ated
> > for other architectures.
> >
> > 1) For other architectures, base.txz is result of the 'ftp= 9; target in
> >=C2=A0 =C2=A0/usr/src/release.
> >
> > 2) armv7 does not have an 'ftp' target.=C2=A0 (Well, it d= oes not *disallow*
> >=C2=A0 =C2=A0it, and probably should at the immediate moment, but = it does blow
> >=C2=A0 =C2=A0up.)
> >
> > 3) Most importantly, and the reason I stopped looking further int= o this,
> >=C2=A0 =C2=A0we cannot run native armv7 binaries on an amd64 syste= m (at least,
> >=C2=A0 =C2=A0last I was aware).
>
> Does chroot and the like count for your purpose?
>
> armv7 packages are built without qemu or the like's
> involvement:
>
> default=C2=A0 =C2=A0131releng-armv7 on ampere3
> quarterly 131releng-armv7 on ampere1
> default=C2=A0 =C2=A0main-armv7=C2=A0 =C2=A0 =C2=A0 on ampere2
>
> This has been going on since 2022-Aug or so.
>

These are natively built on arm64 hardware.

=
I should have pointed out that my requested change is useful for this = as well.
Independent of my desire to have it for cross builds, is= the need for this setup
to be installed w/o building from source= .

Warner
=C2=A0
> I personally build for armv7 on a HoneyComb
> and have done so on a RPi4B in the past. (This
> is both system builds and package builds.)
>
> Basically all these machines support AArch32
> in addition to AArch64:
>
> # sysctl kern.supported_archs
> kern.supported_archs: aarch64 armv7
>
>
> > Particularly, we can only actually use what is
> >=C2=A0 =C2=A0listed in kern.supported_archs,
>
> The ampere*'s should list armv7 in addition to aach64.
> (I've no access of my own to directly validate but
> given that ports are turned into packages . . .)
>

aarch64 and armv7 are indeed listed.

> > at least without falling back to some
> >=C2=A0 =C2=A0sort of emulation or wrapper support (such as qemu or= the like).
>
> Should=C2=A0 not be needed, presuming access to have
> jobs run on one or more ampere* systems.
>

The release build machines are (by design) kept separate from the rest
of the infrastructure within which we operate.=C2=A0 (Same for the package<= br> builders, as well.)

> > Back when armv6 and armv7 support was added using shell scripts i= nstead
> > of hooking into release/Makefile, having a base.txz did not make = much
> > sense because there were different environment variables that wer= e
> > passed into the resulting output, some of which affected the load= er
> > output, etc., specifically with regard to u-boot.=C2=A0 I am not = sure if this
> > is still an issue or a concern, however.
>
> QUOTE
> author Emmanuel Vadot <manu@FreeBSD.org> 2021-05-11 18:27:14 +00= 00
> committer Emmanuel Vadot <manu@FreeBSD.org> 2021-05-11 20:22:54 = +0000
> commit 0d6e5081eb0080c4703f1c5cc69c34f38d9149b7 (patch)
> tree a22f954f3003c1361f4ea5a411e92759a80c9089 /sysutils/u-boot-master<= br> > parent c5fd1c2e186abb2e3209fa48d75d8dcdcda63f06 (diff)
> download ports-0d6e5081eb0080c4703f1c5cc69c34f38d9149b7.tar.gz
> ports-0d6e5081eb0080c4703f1c5cc69c34f38d9149b7.zip
>
> sysutils/u-boot-*: Remove ubldr support
>
> We have been using loader.efi on armv7 for a long time now. Remove sup= port for booting with ubldr and the needed patches that were never upstream= ed. While here add CONFIG_EFI_GRUB_ARM32_WORKAROUND=3Dy in the Fragment as = it's needed to have the cache flushed for us when loader.efi is started= .
> END QUOTE
>
>
> So: before 2021-Jun.
>

Noted.=C2=A0 Thank you for looking.

> > That said, I can take a look and see if we can package base.txz f= or
> > armv7, however I would like to do some archaeology work here to b= e sure
> > that the resultant output is not going to have unexpected behavio= r
> > because of the userland not matching 100% the target SoC.
>
>

Glen

--0000000000006e129005f75b8efb-- From nobody Tue Mar 21 15:14:21 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4PgwBQ0rwjz40Qfc for ; Tue, 21 Mar 2023 15:14:38 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic301-21.consmr.mail.gq1.yahoo.com (sonic301-21.consmr.mail.gq1.yahoo.com [98.137.64.147]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4PgwBP4XtBz3PvD for ; Tue, 21 Mar 2023 15:14:37 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1679411675; bh=sMFE3Zsv/k52rUZGHtXaU1lT3X4o7yQ9e2xRIYrhWbU=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=BtU4ngxr/h9TRoLUjQmL6d3jj0zBpeEo9rmBPgOAUMJrOkvvy5zUo3VTLwCI/Ow1bDLJtmdzr61Fp3ocmYzEPQc6MKpknEYU3ZOLtVFuk8sJIj1lTVeDqOADvA7KA7nUzDVHcDdU+s+uV5ODxApDzUcZMCBHa2colIyVx534HrH081W/nzZy5ZWRMw2IBELo1oHA5pyQ9sCqSHshkzc3Mwx8nlR5poCLpaNxSPaGHrwzIBFJ/W3beetswlN0CPvpQgwLmQyCgIf3vLy6G9gSXC8kSWqsoyTvYxKCDlPFcxy1too5GWOAvmAncl/lfihcLAy0xPAZ0X1ygwotoZen1Q== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1679411675; bh=1KJBm6b53Refnc5ZrmRWtYUDRCRt5oBsvhcA1YeOWib=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=nPBGOw1xiSc3CVM9TVfooQWFwE2Rw7kSa5JzpwDQqOj6fRUcfe8toPORe1cWKWWFdxUcl1CCrVngQ1FOyXY0o16ffrd98gayVwKtDeuznXRXZYOxgOl3FL06wogk7uuDZIB8DpDNPUdu9mB4wmO7YErPmSMKcyno8EkigKew7FDg3WGQ/eJqOuZooksHVfTMQywPR15ETngOm9aPaho2S//mwC4O2UA+4v0UW+HhRu8X/mY9Rl3RkDUvv/oPVNxKsaCJT42beUQAolH8OloJNP91BHipyFUugkTEyLBsLLdBRSLVC6efP0Yhaw9vi5TZow9bN+Zh6+ZeE2AQJ52CUw== X-YMail-OSG: gSBunvMVM1nWngT7PXB9Yix63dPzYYA7R1Fggfn07S8PMutGHcuBrjvJS6hHeIs 668C.obLjkDwi7DLbcXA0xN7FYiSFLkrNhlR.X0K18L34TLmQtYZGN9nK.0.oVUfN8Q6YNxdbsb0 l_A0.NBjcTlbOE0ErGjoLV4MNypxUb8e6WoTmLBup56YxBJaxJ7i6VnCarDjwUmso89VDzLIkMbY .womwPx_pPw8L.vaOaNeYyL6VJRCOhfAWecSgyt6mfKtzQZqcNEatqtbtTwI.XLx2Ltyq8.dHlr. FW0jn9efN7IUFpe7cxg1IsViJdqaEKUClw2L_wSBoMUpmKW000kVgCnbOKdjjHzDFF9aiDqbi70z XQZZvBOLnW_.n20aYzYr5nN7crgFpFGW90rbkhvSadGQYu.OKtitgc2QBni2K.wdy6xPUxAc0dh3 PYWvnjIEg8MJGzLACLbfuufIKKx2KxID_QOXqFG7FGS03ONyirC9v13FrEWHWAbGYfhG2ElNmIlY PaVvuUIFjZMsVCaX2IK.bJg.vp4gGaSrKNDgiS7e0ZfX2WupEVeaKoubssC6q0bDDEGk672R4U6h uRmezRlaFbxkcKd_zNt3vpA1Ei.Mwk.OQnkY7MnsPqtR9JedjFyYv3ym9gp7aNKDYh3oSO2D52mr tCLz2J2HLuOKFTEMMwBOHRmuCL0bklrVJziZ2cGX4k_f3p_cpKH88FfpyUwi1ueGmTOY83xLY2nx 0yWDG_sTsVyeweh4fZ4s1zQ07XZrzWYafd47iF7lJ9n3XRQ_6n83vcS5Q7YIoHVi2tyEHTT3hwAO C38zl1S.UQJgc5NYqctBFTkbqzFEuwRwc2dKfcRQv6glrEWDVhA6qi2v9DntuwBzcogekn.ns6Ps LtDwXWnbZO4TVmUOsgGuFYHs62XnGATekwdhunsLIUSIKgJyojsEdVoTsliTry.3YFt7EFAXC_EZ YbXPEXCPkT0nOw6y0_qH5B.fX9SR.GJdjN3SH8iUpKTB3gfUETRbpSkgf8JMwbGvkQYkKR.Fzx5j V9CGB9kJD2y35CnHWbb.PX8WC8JY9qs.swiM6TrafX.qW.uYrJb60SHhwar_XwME_YL8Lh91XT0_ wBZOo_4Iuu99lhHjfFHTHNCg.jMHfNFiV4wvtg97X8sLOA6X60p4RYDhIuXBapHxetf4lKxJ2_F9 DcgLqZjqpH7h0XGPq_oI3hjXoxyLm3CW8ouF.fUweH.JQgX2bYzEQAKti3IBaYtYTaSFYXo4sMeX p7U8tuU_l8FfM_VmeeiY.zrYF1q8Vscfnxo076g_UbfyO9l2TEhvqrmD1fpNHkRHBq03tRfCSCf_ 8apBo6itaTD0v7OmXhBoujsWr1yloG7oRUzip8muU3brEfrS.YWOucyExck2qnRwXWKmCp_pqOs3 B27kW_MVgkjudRPRw1RV36YBjbhrnb8O0O3JEeMo7ouKOEPXLIAiNZs5cm_32JfIAIL1pXsRlbdA Znp9AOGIHifWDRvXnsZZC9HIbTE1zhMG679c5SJ11N4ff7dqeQuWpjTekg0FhEhrlWleSiMjOIeX w5ADoRL70WMOEWFVGa5PsNcBbL4I0.JdD_lrpe3oJWB4ZJSckOcKpNVAzl9Ui3qwATZ_Ah5sdwWM rUjeRqZUWeRWXNK.FKhV9nV_4EZyGLarwtjFQSPCx4zbAmaHv4heb1CZA23_BMW6QLp5_lWkqNRC 9TWO70.cN7aE_iMu6iz0IFt.YmTGGpHOTLZdVSrXQm1OPUwxrVtAC6sD6G6iTLrWZrJtkZSai9ow si8mld9DjVS0TNNktTSv.Lngx4vIj368r3RSugPgYU74Aqz.EaB5yOYP3jRGzCf_EM9Rl.xexxS4 XlfnLttIt2YsWKNRsPhdM2IFhHnd9w7kAgNdKykALr9Ye6E296.e4wvxh7GPkuXw5OGHLnG0lqPl eROhkWusk40sTWSqPA8XvNxMpHf1Ucr2J_uzZ_nNDB_RbT7On5sY6YhlhThTsPSJeeSBVZhnKTY5 gAGqZdC6sTkK_cWcxDsPU66F7I_hib5bL0i9zVK7WLg2UeKpNelU.miF0KIGZJOfNqQKIrA29Ni6 7shQeOnpprzx6JpG4ZiDpO71IFsCzY5yEmTVF8lAEs9.zkZ0w5TBrSV_0sJR19b9GLNJ_q6SyXfb osPTV3ulWe2.26OhIBS_Xmsu6XugzCLkuhJC4OcOyGfJJCYNNwDHMX6V8AipYJQcetuF6qenTLY5 Uyt.1IKdPxzql.MH2eb1CVuRqiUusicBP3wSjMXQGGbcBUXsWRm5A12quWC5AvjeotzWyxauanbq KUg-- X-Sonic-MF: X-Sonic-ID: 1b34c3ec-a683-422f-bf5a-de880c5edb6c Received: from sonic.gate.mail.ne1.yahoo.com by sonic301.consmr.mail.gq1.yahoo.com with HTTP; Tue, 21 Mar 2023 15:14:35 +0000 Received: by hermes--production-ne1-759c9b8c64-z75s7 (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 134c1a88c1446311bd66a77df38c3543; Tue, 21 Mar 2023 15:14:34 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.400.51.1.1\)) Subject: Re: Poudriere friendly armv7 relases From: Mark Millard In-Reply-To: <20230320210353.GZ2347@FreeBSD.org> Date: Tue, 21 Mar 2023 08:14:21 -0700 Cc: Warner Losh , "freebsd-arm@freebsd.org" Content-Transfer-Encoding: quoted-printable Message-Id: <21A0E9ED-DBA4-409D-BCD2-86E7FCFD2E83@yahoo.com> References: <20230320202847.GW2347@FreeBSD.org> <477846FC-FC56-4A2E-B2BD-FB98500B0F7F@yahoo.com> <20230320210353.GZ2347@FreeBSD.org> To: Glen Barber X-Mailer: Apple Mail (2.3731.400.51.1.1) X-Rspamd-Queue-Id: 4PgwBP4XtBz3PvD X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On Mar 20, 2023, at 14:03, Glen Barber wrote: > On Mon, Mar 20, 2023 at 01:51:27PM -0700, Mark Millard wrote: >> On Mar 20, 2023, at 13:28, Glen Barber wrote: >>=20 >>> On Mon, Mar 20, 2023 at 02:06:50PM -0600, Warner Losh wrote: >>>> Greetings, >>>>=20 >>>> Since it looks like we're going to retain at least armv7 for = FreeBSD 14 >>>> (armv6 has been nominated for deprecation, but if it isn't = deprecated, all >>>> this applies to it). >>>>=20 >>>> I'd like to start making at least the base.tgz, etc available for = armv7. >>>> This would allow us to create armv7 poduriere jails without = building from >>>> source. >>>>=20 >>>> Is there some reason we're not doing this today? I know ISOs don't = make a >>>> lot of sense in the arm ecosystem, but having these artifacts would = enable >>>> poudriere binary install support. >>>>=20 >>>> Comments? >>>>=20 >>>=20 >>> Several. :) >>>=20 >>> I have looked into this in the past, and mhorne@ had even added some >>> environment knobs to the way armv7 is built, however I later = realized >>> that it was not 1:1 compatible with how base.txz, etc., are = generated >>> for other architectures. >>>=20 >>> 1) For other architectures, base.txz is result of the 'ftp' target = in >>> /usr/src/release. >>>=20 >>> 2) armv7 does not have an 'ftp' target. (Well, it does not = *disallow* >>> it, and probably should at the immediate moment, but it does blow >>> up.) >>>=20 >>> 3) Most importantly, and the reason I stopped looking further into = this, >>> we cannot run native armv7 binaries on an amd64 system (at least, >>> last I was aware). >>=20 >> Does chroot and the like count for your purpose? >>=20 >> armv7 packages are built without qemu or the like's >> involvement: >>=20 >> default 131releng-armv7 on ampere3 >> quarterly 131releng-armv7 on ampere1 >> default main-armv7 on ampere2 >>=20 >> This has been going on since 2022-Aug or so. >>=20 >=20 > These are natively built on arm64 hardware. >=20 >> I personally build for armv7 on a HoneyComb >> and have done so on a RPi4B in the past. (This >> is both system builds and package builds.) >>=20 >> Basically all these machines support AArch32 >> in addition to AArch64: >>=20 >> # sysctl kern.supported_archs >> kern.supported_archs: aarch64 armv7 >>=20 >>=20 >>> Particularly, we can only actually use what is >>> listed in kern.supported_archs, >>=20 >> The ampere*'s should list armv7 in addition to aach64. >> (I've no access of my own to directly validate but >> given that ports are turned into packages . . .) >>=20 >=20 > aarch64 and armv7 are indeed listed. >=20 >>> at least without falling back to some >>> sort of emulation or wrapper support (such as qemu or the like). >>=20 >> Should not be needed, presuming access to have >> jobs run on one or more ampere* systems. >>=20 >=20 > The release build machines are (by design) kept separate from the rest > of the infrastructure within which we operate. (Same for the package > builders, as well.) >=20 >>> Back when armv6 and armv7 support was added using shell scripts = instead >>> of hooking into release/Makefile, having a base.txz did not make = much >>> sense because there were different environment variables that were >>> passed into the resulting output, some of which affected the loader >>> output, etc., specifically with regard to u-boot. I am not sure if = this >>> is still an issue or a concern, however. >>=20 >> QUOTE >> author Emmanuel Vadot 2021-05-11 18:27:14 +0000 >> committer Emmanuel Vadot 2021-05-11 20:22:54 +0000 >> commit 0d6e5081eb0080c4703f1c5cc69c34f38d9149b7 (patch) >> tree a22f954f3003c1361f4ea5a411e92759a80c9089 /sysutils/u-boot-master >> parent c5fd1c2e186abb2e3209fa48d75d8dcdcda63f06 (diff) >> download ports-0d6e5081eb0080c4703f1c5cc69c34f38d9149b7.tar.gz >> ports-0d6e5081eb0080c4703f1c5cc69c34f38d9149b7.zip >>=20 >> sysutils/u-boot-*: Remove ubldr support >>=20 >> We have been using loader.efi on armv7 for a long time now. Remove = support for booting with ubldr and the needed patches that were never = upstreamed. While here add CONFIG_EFI_GRUB_ARM32_WORKAROUND=3Dy in the = Fragment as it's needed to have the cache flushed for us when loader.efi = is started.=20 >> END QUOTE >>=20 >>=20 >> So: before 2021-Jun. >>=20 >=20 > Noted. Thank you for looking. >=20 >>> That said, I can take a look and see if we can package base.txz for >>> armv7, however I would like to do some archaeology work here to be = sure >>> that the resultant output is not going to have unexpected behavior >>> because of the userland not matching 100% the target SoC. >>=20 >>=20 >=20 I do not know why it took me so long to think of it, but artifacts.ci.freebsd..org already has examples of *.txz files ( base-dbg.txz base.txz doc.txz kernel-dbg.txz kernel.txz tests.txz MANIFEST ), such as seen at: = https://artifact.ci.freebsd.org/snapshot/main/daa0b64a226031d5f753f96cd5a6= fb3234cdd8b1/arm/armv7/ = https://artifact.ci.freebsd.org/snapshot/14.0-CURRENT/daa0b64a226031d5f753= f96cd5a6fb3234cdd8b1/arm/armv7/ = https://artifact.ci.freebsd.org/snapshot/stable-13/854424168f8e939894aa5fc= ffeec5201c4265542/arm/armv7/ = https://artifact.ci.freebsd.org/snapshot/13.2-STABLE/854424168f8e939894aa5= fcffeec5201c4265542/arm/armv7/ = https://artifact.ci.freebsd.org/snapshot/stable-12/7812b9ef0dc15118a4df783= 36982cfb67d59f49a/arm/armv7/ = https://artifact.ci.freebsd.org/snapshot/12.3-STABLE/7812b9ef0dc15118a4df7= 8336982cfb67d59f49a/arm/armv7/ So there is a known, exmaple way to produce such files for armv7 , at least ones sufficient for artifacts.ci.freebsd.org . =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Tue Mar 21 16:41:44 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Pgy794Gjyz40Vs8 for ; Tue, 21 Mar 2023 16:41:57 +0000 (UTC) (envelope-from tomek@cedro.info) Received: from mail-qv1-xf35.google.com (mail-qv1-xf35.google.com [IPv6:2607:f8b0:4864:20::f35]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Pgy791kJvz3pN1 for ; Tue, 21 Mar 2023 16:41:57 +0000 (UTC) (envelope-from tomek@cedro.info) Authentication-Results: mx1.freebsd.org; none Received: by mail-qv1-xf35.google.com with SMTP id m16so2861369qvi.12 for ; Tue, 21 Mar 2023 09:41:57 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cedro.info; s=google; t=1679416916; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=610a25+/sSQCnCypOSTriAcNv8qkd92PgOwBKweuuzE=; b=dVujrs7LsQkkQdeIt8TO3icgpTbQc3ZKfL+0OVmSWzan2Z4ET+f6501hugZGSAH3gC SNlN6X7dlKlbXURbijoJ20IonIbSc1C94CEesbJGKzzHqW0Ml/yyeQz3VGCv1Bgg+Kxp cwiWaubbMmiYz6NlSpgG3ysEgQPaLpFtOAsBQ44akkdgqGKnkvyobLmy+G3YSMY98Ds2 CW4FAvJVacsTtowFL6Ly8dyZfw4wUaKXbfkCobeaZrUNueTK7/nP/dxayUWokFjaRHVJ lZ+eVwO/ihrfTABvPR86V4y+hZEUR71VcbywKpPa9wOqx0Z8ZgbMsTSuBki2VUXCCmHI 3ufA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; t=1679416916; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=610a25+/sSQCnCypOSTriAcNv8qkd92PgOwBKweuuzE=; b=OhXmqMXGsIhZygNbpGgeI+MCDTTnZHDxI3MdfjFNvmw2pqSPCB4vdOFtOmuRMOZl+3 GIC7TX6eUxh1lf8817J6ArqFdV7VZ2T5VkRn4HfGtoR21iI5KhY3vyDJC1rt4iLYwz8X TZyFFCnOrhN7Ux03YDWNW6iHD3N+VFPsJyQqqUBG9HnvtJLtzBl3yttDJaMRMNIr0CBI /HU/9wsM/qvPQZ1C9N8IjMbMGMXUB3P5Z6Om0LjO18gFCHQzUz1FjFtrimNZut70EjQH bQHaZ2Wb1/OxSlI8+DOpUcq3upY9spYdy5PbSX1LAhBs5Vnej3JhKkp0Hd/NMrVK8gd7 EfDA== X-Gm-Message-State: AO0yUKUZYLiIRLPHgsXqUvsMzt7j0ZJT0CLB63nmNbyeLeldRSbgXLD+ 1rPw0ZMWs38LCQxgJftEsVPk0DeL/5sO+ii/0MM= X-Google-Smtp-Source: AK7set+z8YQsiK/HtDt6djInAN7II1Xogbe9ITFCDJ9PEOSDPiEUMPJvSjhZT7/Z+9N0UGXfs99Zeg== X-Received: by 2002:a05:6214:20e9:b0:57e:866e:ba1b with SMTP id 9-20020a05621420e900b0057e866eba1bmr1017076qvk.24.1679416916144; Tue, 21 Mar 2023 09:41:56 -0700 (PDT) Received: from mail-yb1-f174.google.com (mail-yb1-f174.google.com. [209.85.219.174]) by smtp.gmail.com with ESMTPSA id t10-20020a37aa0a000000b0074683c45f6csm4791074qke.1.2023.03.21.09.41.55 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Tue, 21 Mar 2023 09:41:55 -0700 (PDT) Received: by mail-yb1-f174.google.com with SMTP id z83so17907188ybb.2 for ; Tue, 21 Mar 2023 09:41:55 -0700 (PDT) X-Received: by 2002:a05:6902:150b:b0:b1d:d57:fbef with SMTP id q11-20020a056902150b00b00b1d0d57fbefmr1919698ybu.11.1679416915435; Tue, 21 Mar 2023 09:41:55 -0700 (PDT) List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Tomek CEDRO Date: Tue, 21 Mar 2023 17:41:44 +0100 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Poudriere friendly armv7 relases To: Warner Losh Cc: "freebsd-arm@freebsd.org" Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4Pgy791kJvz3pN1 X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On Mon, Mar 20, 2023 at 9:07=E2=80=AFPM Warner Losh wrote: > Greetings, > Since it looks like we're going to retain at least armv7 for FreeBSD 14 (= armv6 has been nominated for deprecation, but if it isn't deprecated, all t= his applies to it). > I'd like to start making at least the base.tgz, etc available for armv7. = This would allow us to create armv7 poduriere jails without building from s= ource. > Is there some reason we're not doing this today? I know ISOs don't make a= lot of sense in the arm ecosystem, but having these artifacts would enable= poudriere binary install support. > Comments? > Warner This is a great idea to have pkg on ARM.. and very soon on RISC-V hopefully= :-) --=20 CeDeROM, SQ7MHZ, http://www.tomek.cedro.info From nobody Tue Mar 21 23:29:26 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Ph79R6zn9z40yHb for ; Tue, 21 Mar 2023 23:29:31 +0000 (UTC) (envelope-from fbsd@www.zefox.net) Received: from www.zefox.net (www.zefox.net [50.1.20.27]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "www.zefox.com", Issuer "www.zefox.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Ph79Q3qbfz4LX4 for ; Tue, 21 Mar 2023 23:29:30 +0000 (UTC) (envelope-from fbsd@www.zefox.net) Authentication-Results: mx1.freebsd.org; dkim=none; spf=none (mx1.freebsd.org: domain of fbsd@www.zefox.net has no SPF policy when checking 50.1.20.27) smtp.mailfrom=fbsd@www.zefox.net; dmarc=none Received: from www.zefox.net (localhost [127.0.0.1]) by www.zefox.net (8.17.1/8.15.2) with ESMTPS id 32LNTRTB037595 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Tue, 21 Mar 2023 16:29:27 -0700 (PDT) (envelope-from fbsd@www.zefox.net) Received: (from fbsd@localhost) by www.zefox.net (8.17.1/8.15.2/Submit) id 32LNTQB3037594; Tue, 21 Mar 2023 16:29:26 -0700 (PDT) (envelope-from fbsd) Date: Tue, 21 Mar 2023 16:29:26 -0700 From: bob prohaska To: freebsd-arm@freebsd.org Cc: fbsd@www.zefox.net Subject: Persuading ssh -X to work from a RasPiOS system Message-ID: <20230321232926.GA37569@www.zefox.net> List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline X-Spamd-Result: default: False [-1.10 / 15.00]; AUTH_NA(1.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.998]; WWW_DOT_DOMAIN(0.50)[]; MID_RHS_WWW(0.50)[]; MIME_GOOD(-0.10)[text/plain]; R_DKIM_NA(0.00)[]; MLMMJ_DEST(0.00)[freebsd-arm@freebsd.org]; MIME_TRACE(0.00)[0:+]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:7065, ipnet:50.1.16.0/20, country:US]; RCPT_COUNT_TWO(0.00)[2]; RCVD_COUNT_THREE(0.00)[3]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; FROM_HAS_DN(0.00)[]; DMARC_NA(0.00)[zefox.net]; TO_DN_NONE(0.00)[]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Queue-Id: 4Ph79Q3qbfz4LX4 X-Spamd-Bar: - X-ThisMailContainsUnwantedMimeParts: N After a recent round of upgrades to both FreeBSD-current and RasPiOS64 it developed that running ssh -X [freebsd hostname] gets me logged in, but issuing xterm -sb reports xterm: Xt error: Can't open display: xterm: DISPLAY is not set After looking at the man page I repeated the experiment using ssh -Y to open the connection, with the same result. The X server side has X11Forwarding yes in /etc/ssh/sshd_config, I haven't tampered with anything yet on the FreeBSD side. The display server is on a local subnet connecting via router to a public address, but that didn't cause any problems before. All addressing is IPV4. Any hints what might be wrong? I haven't tried this experiment in a while, so it's unclear which side is causing the trouble. Thanks for reading, bob prohaska From nobody Tue Mar 21 23:41:08 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Ph7RM4vY2z410C2 for ; Tue, 21 Mar 2023 23:41:35 +0000 (UTC) (envelope-from darius@dons.net.au) Received: from midget.dons.net.au (2403-5800-5200-4700-225-90ff-fe47-39b4.ip6.aussiebb.net [IPv6:2403:5800:5200:4700:225:90ff:fe47:39b4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature ECDSA (P-384) client-digest SHA384) (Client CN "dons.net.au", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Ph7RL6gNVz4MPH for ; Tue, 21 Mar 2023 23:41:34 +0000 (UTC) (envelope-from darius@dons.net.au) Authentication-Results: mx1.freebsd.org; none Received: from smtpclient.apple (2403-5800-5200-4700-b945-7a79-ec56-773f.ip6.aussiebb.net [IPv6:2403:5800:5200:4700:b945:7a79:ec56:773f]) (authenticated bits=0) by midget.dons.net.au (8.17.1/8.15.2) with ESMTPSA id 32LNfIWF068804 (version=TLSv1.2 cipher=ECDHE-ECDSA-AES256-GCM-SHA384 bits=256 verify=NO); Wed, 22 Mar 2023 10:11:19 +1030 (ACDT) (envelope-from darius@dons.net.au) X-Authentication-Warning: midget.dons.net.au: Host 2403-5800-5200-4700-b945-7a79-ec56-773f.ip6.aussiebb.net [IPv6:2403:5800:5200:4700:b945:7a79:ec56:773f] claimed to be smtpclient.apple Content-Type: text/plain; charset=us-ascii List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.400.51.1.1\)) Subject: Re: Persuading ssh -X to work from a RasPiOS system From: "Daniel O'Connor" In-Reply-To: <20230321232926.GA37569@www.zefox.net> Date: Wed, 22 Mar 2023 10:11:08 +1030 Cc: freebsd-arm@freebsd.org Content-Transfer-Encoding: 7bit Message-Id: References: <20230321232926.GA37569@www.zefox.net> To: bob prohaska X-Mailer: Apple Mail (2.3731.400.51.1.1) X-Spam-Status: No, score=0.40 X-Rspamd-Server: midget.dons.net.au X-Rspamd-Queue-Id: 4Ph7RL6gNVz4MPH X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:4764, ipnet:2403:5800::/27, country:AU] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N > On 22 Mar 2023, at 09:59, bob prohaska wrote: > After a recent round of upgrades to both FreeBSD-current and RasPiOS64 > it developed that running > ssh -X [freebsd hostname] > gets me logged in, but issuing > xterm -sb > reports > xterm: Xt error: Can't open display: > xterm: DISPLAY is not set 'DISPLAY is not set' is saying that ssh hasn't done the forwarding. If you run 'xterm' before you login to FreeBSD, does it work? Perhaps you don't have an X server (eg you could be using Wayland I guess) -- Daniel O'Connor "The nice thing about standards is that there are so many of them to choose from." -- Andrew Tanenbaum From nobody Wed Mar 22 00:59:57 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Ph9B32y8Jz414Fd for ; Wed, 22 Mar 2023 01:00:11 +0000 (UTC) (envelope-from fbsd@www.zefox.net) Received: from www.zefox.net (www.zefox.net [50.1.20.27]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "www.zefox.com", Issuer "www.zefox.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Ph9B31FPNz3D3V for ; Wed, 22 Mar 2023 01:00:10 +0000 (UTC) (envelope-from fbsd@www.zefox.net) Authentication-Results: mx1.freebsd.org; none Received: from www.zefox.net (localhost [127.0.0.1]) by www.zefox.net (8.17.1/8.15.2) with ESMTPS id 32M0xwvS037843 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Tue, 21 Mar 2023 17:59:58 -0700 (PDT) (envelope-from fbsd@www.zefox.net) Received: (from fbsd@localhost) by www.zefox.net (8.17.1/8.15.2/Submit) id 32M0xvCo037842; Tue, 21 Mar 2023 17:59:57 -0700 (PDT) (envelope-from fbsd) Date: Tue, 21 Mar 2023 17:59:57 -0700 From: bob prohaska To: "Daniel O'Connor" Cc: freebsd-arm@freebsd.org Subject: Re: Persuading ssh -X to work from a RasPiOS system Message-ID: <20230322005957.GA37774@www.zefox.net> References: <20230321232926.GA37569@www.zefox.net> List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Rspamd-Queue-Id: 4Ph9B31FPNz3D3V X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:7065, ipnet:50.1.16.0/20, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On Wed, Mar 22, 2023 at 10:11:08AM +1030, Daniel O'Connor wrote: > > > > On 22 Mar 2023, at 09:59, bob prohaska wrote: > > After a recent round of upgrades to both FreeBSD-current and RasPiOS64 > > it developed that running > > ssh -X [freebsd hostname] > > gets me logged in, but issuing > > xterm -sb > > reports > > xterm: Xt error: Can't open display: > > xterm: DISPLAY is not set > > 'DISPLAY is not set' is saying that ssh hasn't done the forwarding. > > If you run 'xterm' before you login to FreeBSD, does it work? > Somewhat to my surprise, xterm isn't recognized as a command on the RasPiOS end. The default terminal emulator is lxterminal, but I thought xterm would still be recognized. Evidently not. > Perhaps you don't have an X server (eg you could be using Wayland I guess) > The RasPiOS system boots to the command line and the windowing system is started up using startx. The man page for startx seems to imply that the Pi is using some flavor of X, but I'm not sure which one. Xwayland is available, but not installed. Thanks for writing, bob prohaska From nobody Wed Mar 22 01:02:07 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Ph9Dl1wQkz414Qp for ; Wed, 22 Mar 2023 01:02:31 +0000 (UTC) (envelope-from darius@dons.net.au) Received: from midget.dons.net.au (2403-5800-5200-4700-225-90ff-fe47-39b4.ip6.aussiebb.net [IPv6:2403:5800:5200:4700:225:90ff:fe47:39b4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature ECDSA (P-384) client-digest SHA384) (Client CN "dons.net.au", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Ph9Dk5Cf5z3FGT for ; Wed, 22 Mar 2023 01:02:30 +0000 (UTC) (envelope-from darius@dons.net.au) Authentication-Results: mx1.freebsd.org; none Received: from smtpclient.apple (2403-5800-5200-4700-b945-7a79-ec56-773f.ip6.aussiebb.net [IPv6:2403:5800:5200:4700:b945:7a79:ec56:773f]) (authenticated bits=0) by midget.dons.net.au (8.17.1/8.15.2) with ESMTPSA id 32M12HVA072484 (version=TLSv1.2 cipher=ECDHE-ECDSA-AES256-GCM-SHA384 bits=256 verify=NO); Wed, 22 Mar 2023 11:32:17 +1030 (ACDT) (envelope-from darius@dons.net.au) X-Authentication-Warning: midget.dons.net.au: Host 2403-5800-5200-4700-b945-7a79-ec56-773f.ip6.aussiebb.net [IPv6:2403:5800:5200:4700:b945:7a79:ec56:773f] claimed to be smtpclient.apple Content-Type: text/plain; charset=us-ascii List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.400.51.1.1\)) Subject: Re: Persuading ssh -X to work from a RasPiOS system From: "Daniel O'Connor" In-Reply-To: <20230322005957.GA37774@www.zefox.net> Date: Wed, 22 Mar 2023 11:32:07 +1030 Cc: freebsd-arm@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <5DC85526-F029-4B39-B680-015E33E2F68F@dons.net.au> References: <20230321232926.GA37569@www.zefox.net> <20230322005957.GA37774@www.zefox.net> To: bob prohaska X-Mailer: Apple Mail (2.3731.400.51.1.1) X-Spam-Status: No, score=0.40 X-Rspamd-Server: midget.dons.net.au X-Rspamd-Queue-Id: 4Ph9Dk5Cf5z3FGT X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:4764, ipnet:2403:5800::/27, country:AU] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N > On 22 Mar 2023, at 11:29, bob prohaska wrote: > On Wed, Mar 22, 2023 at 10:11:08AM +1030, Daniel O'Connor wrote: >>=20 >>> On 22 Mar 2023, at 09:59, bob prohaska wrote: >>> After a recent round of upgrades to both FreeBSD-current and = RasPiOS64 >>> it developed that running=20 >>> ssh -X [freebsd hostname]=20 >>> gets me logged in, but issuing >>> xterm -sb >>> reports >>> xterm: Xt error: Can't open display:=20 >>> xterm: DISPLAY is not set >>=20 >> 'DISPLAY is not set' is saying that ssh hasn't done the forwarding. >>=20 >> If you run 'xterm' before you login to FreeBSD, does it work? >>=20 > Somewhat to my surprise, xterm isn't recognized as a command > on the RasPiOS end. The default terminal emulator is lxterminal, > but I thought xterm would still be recognized. Evidently not.=20 >=20 >> Perhaps you don't have an X server (eg you could be using Wayland I = guess) >>=20 >=20 > The RasPiOS system boots to the command line and the windowing > system is started up using startx. The man page for startx seems > to imply that the Pi is using some flavor of X, but I'm not sure > which one. Xwayland is available, but not installed.=20 OK, seems strange it wouldn't work then. You could try "ssh -vvvvvX user@freebsdhost" and see if there are = messages about X11 forwarding. =20 -- Daniel O'Connor "The nice thing about standards is that there are so many of them to choose from." -- Andrew Tanenbaum From nobody Wed Mar 22 03:43:02 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4PhDp32fK9z41DLd for ; Wed, 22 Mar 2023 03:43:07 +0000 (UTC) (envelope-from carlj@peak.org) Received: from mail.nrtc.syn-alias.com (mail.nrtc.syn-alias.com [129.213.214.220]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4PhDp22vWRz3kC1 for ; Wed, 22 Mar 2023 03:43:06 +0000 (UTC) (envelope-from carlj@peak.org) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of carlj@peak.org designates 129.213.214.220 as permitted sender) smtp.mailfrom=carlj@peak.org; dmarc=pass (policy=none) header.from=peak.org X-Authed-Username: Y2FybGpAcGVhay5vcmc= Received: from [199.58.99.70] ([199.58.99.70:41053] helo=bay.localnet) by mail.peak.org (envelope-from ) (ecelerity 4.4.0.19839 r(msys-ecelerity:tags/4.4.0.0^0)) with ESMTPA id 49/D4-32506-9497A146; Tue, 21 Mar 2023 23:43:05 -0400 Received: from carlj by bay.localnet with local (Exim 4.95 (FreeBSD)) (envelope-from ) id 1pepNO-000Gsg-Ji for freebsd-arm@freebsd.org; Tue, 21 Mar 2023 20:43:02 -0700 From: Carl Johnson To: freebsd-arm@freebsd.org Subject: Re: Persuading ssh -X to work from a RasPiOS system References: <20230321232926.GA37569@www.zefox.net> Date: Tue, 21 Mar 2023 20:43:02 -0700 In-Reply-To: <20230321232926.GA37569@www.zefox.net> (bob prohaska's message of "Tue, 21 Mar 2023 16:29:26 -0700") Message-ID: <86wn39cuyh.fsf@bay.localnet> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.2 (berkeley-unix) List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Content-Type: text/plain X-Vade-Verdict: clean X-Vade-Analysis-1: gggruggvucftvghtrhhoucdtuddrgedvhedrvdeguddgieehucetufdoteggodetrfdotffvucfrrhho X-Vade-Analysis-2: fhhilhgvmecuufgjpfetvefqtfdppfftvfevpdfgpfggqdfptffvvedpqfgfvfenuceurghilhhouhht X-Vade-Analysis-3: mecufedtudenucenucfjughrpefhvffufhffjgfkfgggtgesthdttddttdertdenucfhrhhomhepvegr X-Vade-Analysis-4: rhhlucflohhhnhhsohhnuceotggrrhhljhesphgvrghkrdhorhhgqeenucggtffrrghtthgvrhhnpeel X-Vade-Analysis-5: heejtdekgffgveeifefhhfdvuddtueelgeeljeffvddthfeuteehueetueeuheenucffohhmrghinhep X-Vade-Analysis-6: iigvfhhogidrnhgvthenucfkphepudelledrheekrdelledrjedtnecuvehluhhsthgvrhfuihiivgep X-Vade-Analysis-7: tdenucfrrghrrghmpehinhgvthepudelledrheekrdelledrjedtpdhhvghlohepsggrhidrlhhotggr X-Vade-Analysis-8: lhhnvghtpdhmrghilhhfrhhomheptggrrhhljhesphgvrghkrdhorhhgpdhrtghpthhtohepfhhrvggv X-Vade-Analysis-9: sghsugdqrghrmhesfhhrvggvsghsugdrohhrghdpmhhtrghhohhsthepshhmthhptdefrdhnrhhttgdr X-Vade-Analysis-10: vghmrghilhdqrghshhdurdhshihntgdrlhgrnhdpnhgspghrtghpthhtohepuddpihhspghnrgepthhr X-Vade-Analysis-11: uhgvpdgruhhthhgpuhhsvghrpegtrghrlhhjsehpvggrkhdrohhrgh X-Vade-Client: NRTC X-Spamd-Result: default: False [-3.78 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-0.999]; NEURAL_HAM_LONG(-0.99)[-0.993]; NEURAL_HAM_SHORT(-0.99)[-0.990]; DMARC_POLICY_ALLOW(-0.50)[peak.org,none]; R_SPF_ALLOW(-0.20)[+ip4:129.213.214.220]; MIME_GOOD(-0.10)[text/plain]; R_DKIM_NA(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[129.213.214.220:from]; RCVD_TLS_LAST(0.00)[]; MLMMJ_DEST(0.00)[freebsd-arm@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:31898, ipnet:129.213.208.0/21, country:US]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; RCPT_COUNT_ONE(0.00)[1]; ARC_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; FROM_HAS_DN(0.00)[]; TO_DN_NONE(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[129.213.214.220:from] X-Rspamd-Queue-Id: 4PhDp22vWRz3kC1 X-Spamd-Bar: --- X-ThisMailContainsUnwantedMimeParts: N bob prohaska writes: > After a recent round of upgrades to both FreeBSD-current and RasPiOS64 > it developed that running > ssh -X [freebsd hostname] > gets me logged in, but issuing > xterm -sb > reports > xterm: Xt error: Can't open display: > xterm: DISPLAY is not set > > After looking at the man page I repeated the experiment > using > ssh -Y > to open the connection, with the same result. > > The X server side has > X11Forwarding yes > in /etc/ssh/sshd_config, I haven't tampered with anything > yet on the FreeBSD side. > > The display server is on a local subnet connecting via > router to a public address, but that didn't cause any > problems before. All addressing is IPV4. > > Any hints what might be wrong? I haven't tried this > experiment in a while, so it's unclear which side is > causing the trouble. > > Thanks for reading, > > bob prohaska Is there any chance you are using ControlPersist? That defaults to off, so you would have to enable it in your ssh config file, or via command line options. If you have it enabled then you would still be running your original ssh instead of a new one. In that case you would have to run 'ssh -O exit ' to exit from your original ssh before running ssh -X or ssh -Y. Just another possibility to look into. -- Carl Johnson carlj@peak.org From nobody Wed Mar 22 16:09:46 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4PhYMs6VVnz411KK for ; Wed, 22 Mar 2023 16:10:01 +0000 (UTC) (envelope-from fbsd@www.zefox.net) Received: from www.zefox.net (www.zefox.net [50.1.20.27]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "www.zefox.com", Issuer "www.zefox.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4PhYMs0XDgz3KcT for ; Wed, 22 Mar 2023 16:10:00 +0000 (UTC) (envelope-from fbsd@www.zefox.net) Authentication-Results: mx1.freebsd.org; none Received: from www.zefox.net (localhost [127.0.0.1]) by www.zefox.net (8.17.1/8.15.2) with ESMTPS id 32MG9lTM040747 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Wed, 22 Mar 2023 09:09:47 -0700 (PDT) (envelope-from fbsd@www.zefox.net) Received: (from fbsd@localhost) by www.zefox.net (8.17.1/8.15.2/Submit) id 32MG9lXl040746; Wed, 22 Mar 2023 09:09:47 -0700 (PDT) (envelope-from fbsd) Date: Wed, 22 Mar 2023 09:09:46 -0700 From: bob prohaska To: "Daniel O'Connor" Cc: freebsd-arm@freebsd.org Subject: Re: Persuading ssh -X to work from a RasPiOS system Message-ID: <20230322160946.GA40692@www.zefox.net> References: <20230321232926.GA37569@www.zefox.net> <20230322005957.GA37774@www.zefox.net> <5DC85526-F029-4B39-B680-015E33E2F68F@dons.net.au> List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <5DC85526-F029-4B39-B680-015E33E2F68F@dons.net.au> X-Rspamd-Queue-Id: 4PhYMs0XDgz3KcT X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:7065, ipnet:50.1.16.0/20, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On Wed, Mar 22, 2023 at 11:32:07AM +1030, Daniel O'Connor wrote: > > You could try "ssh -vvvvvX user@freebsdhost" and see if there are messages about X11 forwarding. > Ahh, that gives a hint, maybe: ssh -vvvvvY user@freebsdhost ........ [long list of authentication negotiations] ...... debug1: Authentication succeeded (keyboard-interactive). ...... debug1: Requesting X11 forwarding with authentication spoofing. debug2: channel 0: request x11-req confirm 1 debug3: send packet: type 98 debug2: fd 3 setting TCP_NODELAY debug3: ssh_packet_set_tos: set IP_TOS 0x10 debug2: client_session2_setup: id 0 debug2: channel 0: request pty-req confirm 1 debug3: send packet: type 98 debug1: Sending environment. debug3: Ignored env SHELL debug3: Ignored env COLORTERM [long list of environment variables ignored] There is nothing I recognize as an error among the authentication negotiations, only absence of files needed for things other than keyboard-interactive. Since that works, it's unclear why the various env variables are being ignored. It appears that ssh -X behaves exactly as ssh -Y, at least to visual inspection. As I read them, the man pages seem to imply -X should no longer work, but -Y should behave exactly as -X once did. Am I mistaken on this? Thanks for writing! bob prohaska From nobody Wed Mar 22 16:17:50 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4PhYXr20F2z411Tj for ; Wed, 22 Mar 2023 16:17:48 +0000 (UTC) (envelope-from fbsd@www.zefox.net) Received: from www.zefox.net (www.zefox.net [50.1.20.27]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "www.zefox.com", Issuer "www.zefox.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4PhYXr0Pj0z3LCl for ; Wed, 22 Mar 2023 16:17:47 +0000 (UTC) (envelope-from fbsd@www.zefox.net) Authentication-Results: mx1.freebsd.org; none Received: from www.zefox.net (localhost [127.0.0.1]) by www.zefox.net (8.17.1/8.15.2) with ESMTPS id 32MGHpGt040774 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Wed, 22 Mar 2023 09:17:51 -0700 (PDT) (envelope-from fbsd@www.zefox.net) Received: (from fbsd@localhost) by www.zefox.net (8.17.1/8.15.2/Submit) id 32MGHptK040773; Wed, 22 Mar 2023 09:17:51 -0700 (PDT) (envelope-from fbsd) Date: Wed, 22 Mar 2023 09:17:50 -0700 From: bob prohaska To: Carl Johnson Cc: freebsd-arm@freebsd.org Subject: Re: Persuading ssh -X to work from a RasPiOS system Message-ID: <20230322161750.GB40692@www.zefox.net> References: <20230321232926.GA37569@www.zefox.net> <86wn39cuyh.fsf@bay.localnet> List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <86wn39cuyh.fsf@bay.localnet> X-Rspamd-Queue-Id: 4PhYXr0Pj0z3LCl X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:7065, ipnet:50.1.16.0/20, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On Tue, Mar 21, 2023 at 08:43:02PM -0700, Carl Johnson wrote: > > Is there any chance you are using ControlPersist? That defaults to off, > so you would have to enable it in your ssh config file, or via command > line options. Certainly not on purpose. Never touched the config files on either end. But, there were several build/install cycles on the FreeBSD end and at least a couple of apt-upgrade cycles on the RasPiOS end, any of which could have changed defaults. The FreeBSD end now reports: FreeBSD 14.0-CURRENT #39 main-ea6d169266: Sun Mar 19 23:10:56 PDT 2023 and the RasPiOS end reports Linux raspberrypi 6.1.19-v8+ #1637 SMP PREEMPT Tue Mar 14 11:11:47 GMT 2023 Just for clarity, I'm logged in on the RasPiOS end, trying to use it as an X terminal for the FreeBSD headless host. Thanks for writing! bob prohaska From nobody Wed Mar 22 16:38:38 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4PhZ151y07z412xC for ; Wed, 22 Mar 2023 16:38:49 +0000 (UTC) (envelope-from soumar@soudny.net) Received: from schrodinger.soudny.net (schrodinger.soudny.net [IPv6:2a02:2b88:2:1::6dc8:130]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4PhZ140CJTz3jf1 for ; Wed, 22 Mar 2023 16:38:47 +0000 (UTC) (envelope-from soumar@soudny.net) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of soumar@soudny.net designates 2a02:2b88:2:1::6dc8:130 as permitted sender) smtp.mailfrom=soumar@soudny.net; dmarc=none Received: from [10.0.0.2] (77.118.228.10.wireless.dyn.drei.com [77.118.228.10]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature ECDSA (P-256) server-digest SHA256) (No client certificate requested) (Authenticated sender: soumar@soudny.net) by schrodinger.soudny.net (Postfix) with ESMTPSA id A01DF21E86 for ; Wed, 22 Mar 2023 17:38:39 +0100 (CET) Message-ID: <51a736f9-1cee-d855-6104-b14b5b44fea7@soudny.net> Date: Wed, 22 Mar 2023 17:38:38 +0100 List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.9.0 Reply-To: soumar@soudny.net Subject: Re: Persuading ssh -X to work from a RasPiOS system To: freebsd-arm@freebsd.org References: <20230321232926.GA37569@www.zefox.net> <86wn39cuyh.fsf@bay.localnet> <20230322161750.GB40692@www.zefox.net> Content-Language: en-US From: Marek Soudny Organization: soudny.net In-Reply-To: <20230322161750.GB40692@www.zefox.net> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spamd-Result: default: False [-3.14 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.84)[-0.844]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; R_DKIM_NA(0.00)[]; ARC_NA(0.00)[]; DMARC_NA(0.00)[soudny.net]; FROM_EQ_ENVFROM(0.00)[]; MLMMJ_DEST(0.00)[freebsd-arm@freebsd.org]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:197019, ipnet:2a02:2b88::/32, country:CZ]; HAS_REPLYTO(0.00)[soumar@soudny.net]; TO_DN_NONE(0.00)[]; HAS_ORG_HEADER(0.00)[]; FROM_HAS_DN(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; TO_MATCH_ENVRCPT_ALL(0.00)[]; REPLYTO_ADDR_EQ_FROM(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-arm@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; RCVD_TLS_ALL(0.00)[] X-Rspamd-Queue-Id: 4PhZ140CJTz3jf1 X-Spamd-Bar: --- X-ThisMailContainsUnwantedMimeParts: N Hello Bob, On 22. 03. 23 17:17, bob prohaska wrote: > Certainly not on purpose. Never touched the config files on either > Thanks for writing! > > bob prohaska Just to be sure - do you have xauth package installed on the remote (FreeBSD) host? Marek From nobody Wed Mar 22 16:40:51 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4PhZ3n3fh6z412m6 for ; Wed, 22 Mar 2023 16:41:09 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic309-21.consmr.mail.gq1.yahoo.com (sonic309-21.consmr.mail.gq1.yahoo.com [98.137.65.147]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4PhZ3n0Vt5z3k9v for ; Wed, 22 Mar 2023 16:41:08 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1679503267; bh=f3tiTD+/qmutA3NRV0Mc5W7s72V/0jLt00JARsOv4Ms=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=oT6onJGpcgKy5eIcxR1CX5zXaZAc5NxpTGeKnBKIK4C8pk9WY8EhtdN80Ib0QVby+4s/zLTEFA4l6yQCeDUFRA25w+6xSexgcsVt5uFQXhaasQN1VIGxEBKwhEpk6sbkiy7yx7kLQE+bhbcQZxO7SNsZ9SNj8xQKmvwL+gMwW++tbL8F08K7NKD1G/Y8N+Js3loAKAqYOFyO6GElzWzD5vo4NK9wG5nCyFft7c50NJ/m5tQi7L6sl6r5NjdC+qcATiveM8DnHFVob/ALQ6MAJgbmrIpLZfQFvmGMlrQHJprpyuIndWuNSD1oolpGP5koBYRVJDgeW0Fzcv+KqA7DwQ== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1679503267; bh=y6RDF1aIiGdafBnp/89rI1y7Sx6hgjyB88xY+HaC9iB=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=VE1DpSxHx1sLVsV0wJD81mqKK8zc8rEE+gGwCV/KbUaketM6b1UqnJBvxe/IMDKGCNkeJrwHocE+FSuutPaK+vj3oTqXygbKewl4l7mdy/xlK+20mX+6/TpvNUBOPQVfux4GqWw8aRwZPR+zIBOwKPr8IzKm7FXuePUIhTtQTSoUG34idXKlRWcPXX4cYEehN8ID6yvoRz9c2bVaKsBSro2IKZPDQu5O5F1yniMZwObYuAT3FZnK6EpHy1g5fYk3/TYfXqDbnq+L9SckZWJ5w6Mtm+sM5GYTG1FE8WY1y4JGCED1u58rQC0NOLJP85p6KTrx32tyOW8fggvay+9FKA== X-YMail-OSG: g.VYcrgVM1lHkMegWI1eQi8NNjR_AUW0UhUhmcxym26XJyXJ0L6Eo5ZaaRGLNym ZtGg0hjh.0Qdk67OIx9tMom__fNQdDJvyTShrSuVlp6SDgumrt8cPgrKt5L1sGMh95IyDjvUI3Dt 6JM11t4dwkXWGTso96q1.j0QLhHJCG_b9Sifcu3wFmDCo7_jmS_7GwKnw_Mu3SXc.71qyixc2Nlk 8_Mn5DfkmYYCGKiu9tt8t6r1kvVOG.n06teBt0t.vdfUvwF8MUc.9Z7RUwxquAd4vg6Tzuiv_jiy KJZVis2ZlBADoKEydBTit_lzEjht0dnEkAU17YNjy1oqOiYDv0ko5GfXhcgGatAvPLbSdmcAor0p YArjHf4xW6dy8cbmgFCA4Hwdj3uk4pyXDKwCEoRnbwgcb.oQUqUGfYfJUwOrBWcM77xJwzuc_YdQ NYJmHyhjSOUR8qggMYKwiygzSVGHDEbzK3PyeNdqIZuOFpygUgBu__Tj62DI.xLoLcTEaxlKGezY mKlKbPu8kUZ8mRZNKkhn_xVysDIF3d2l2mE1OfzhG_2AwYWi1uc8Cfvn7.ia5iqIZHUtBEujbTpS 2BvJS6zlU3Pfiyxwtal4DU7jaf2BS9cNhLupdS8INWWUeX.A9DPbZ1bSYK0rBlaUaOny8sP_dz3l MreL4U7GBImeNGXY32FgqaULHG4dWYC.vWZNEFUISFoC2aIPriyORANTq7S0mAxdJBKuxo.xVp0n 6JHbLLP0tSD_Vz6jy5aUIJuoyYPdbzw8eNUDwi1t5soZsSNwNpYPZgqYcum7pad8_dCs6HehzgJB pMoYYMMKqh29oKyoCBkwA1bkiRv4pnYai3IUm9i8.Fl5PsZvH4aZwE8PmURlmMBOOCt5.1OggJ7V SOtfVbNtRaEZRhMPl0grKscYMMZlybFBQAnPrQ9uDAQ92x8UC3v1uTXMZR.xCb07KXYdAVhCHrUB Z0uOmz2d2i.IC.BrYjPUARMRDdSZQWLW0UnrzpniB3ythQPKzaJ1GCwTmueF0m7nEy_hSleaI1PZ B.shT5pxS0HlISoL.GLA4FAARozl.q0NEWeVVcvEFVRCe9XyN5JlgsHvWbH.6gnJEQLFniPeMXXM _EvjnoXdC2JEJ81_eT1xupgEMp8fpBuaD_ZQTp.uzBbtMdNVOzjVVmawLtH23GSga1Ux0SC5ZQA6 98QLXKflJjN0DBerBt2HG32Isjgen3hXZPu_fIVcUL8LlXzmsNCkpEZNt8YXSbBnIWZ.RjCeyZ2W jrdPetBVzp2M2MccsOOjrVExPzi5cwMj862MzN8l_JNJxHABv8qo6KHel0jihKBySDwSDot9qMSN f1bpuKXnBUGDrmmx7dz9wYUX96g5faMnHodNvQmYWwXU_ALxwy0nvD2YWe74Ro3MWhQhQLEtP4WW mowHA_xoailwZiDNRpomg4laVzoRIqNTIEqUWgRzdxBeFswIXa4_N33ATaPIuIuFuuWdf246pyeL gcliodMcQbzYi8lAlmYQAQHcwmA7pIMLokdh6Qn0agfrUFGsxS7VDBK1gJqw7JvQ9qpbDZqL63j3 U0WzKqQ5c03SrwQ93_569X6A0xekuL0IyvzUwy6hm1g3QXmIaV6y_DC4QFtJYvY.0RQl7o3gq5lR JVbYqfmRq698BHh0hLJODrfY106ayiqbZlpMzGbm0bpgmWG4JBLt_uXc0ijQcKIyfFQs918_Vojm D15UYnuLprI38pcRQoj9w4W2LKRSMWw_7d4MJaoxrbqC5HMVhQ1HDT40vhjGmWGdr31toG192PEK yvkZRAFqGIvRR.NG5pBGLUJu38cybqeAG8GaWkJFsKkGn5F5Fspq11b0wSy__M9BVJDhNzlJNkHL u0MOvJiz6pOOO8axKsGH.pxAU05wbc0fpwk4bDIvcXSI8OwQwM1yLN4dBDZPd0IX9xNrLQaoyeQ4 3UkZS2gfZYXf6uZzp0McqYN29SYmee6B2blLVzORxroOg7JBSxcLLn97RUZHEGThxzWBF7aEX5eK Ni_wBzcXpOF8lCN511XYHPuSTZo0cW8sMMQjqFK.3wazTvMK8UoafLHB415MqnLvKmjuWwQXHmsU D0I9BI2ZOnUUlWw4EWGTd76Z5klHhDoqa9w226Wk1maIsq0fI3VXQM3r6zv3ufKZu5hftUQocR3W 0J9MWsycP7MvcHGQ8y7neRF.HF31Vn.mzAHD.8x5N_GZkXNtwrL6cZnHWboJSuar43Vn47kALyPr HkwLFDQMBjJ_YL_Hi0GTFjk7APo9H75DOBnvbnLoVkjPltDPYqy7jmXczSIets8WXcVkJbPpFi8a t X-Sonic-MF: X-Sonic-ID: 8332d581-8329-4e30-9e3f-56883c871a02 Received: from sonic.gate.mail.ne1.yahoo.com by sonic309.consmr.mail.gq1.yahoo.com with HTTP; Wed, 22 Mar 2023 16:41:07 +0000 Received: by hermes--production-gq1-6cf7749bc8-72cjd (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 0904dc297934ef8742f7efe924b92fbb; Wed, 22 Mar 2023 16:41:02 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.400.51.1.1\)) Subject: Re: Persuading ssh -X to work from a RasPiOS system From: Mark Millard In-Reply-To: <20230322161750.GB40692@www.zefox.net> Date: Wed, 22 Mar 2023 09:40:51 -0700 Cc: freebsd-arm Content-Transfer-Encoding: quoted-printable Message-Id: <75C8EFDB-2276-4BD8-80F2-60340CC85EA9@yahoo.com> References: <20230321232926.GA37569@www.zefox.net> <86wn39cuyh.fsf@bay.localnet> <20230322161750.GB40692@www.zefox.net> To: bob prohaska X-Mailer: Apple Mail (2.3731.400.51.1.1) X-Rspamd-Queue-Id: 4PhZ3n0Vt5z3k9v X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On Mar 22, 2023, at 09:17, bob prohaska wrote: > On Tue, Mar 21, 2023 at 08:43:02PM -0700, Carl Johnson wrote: >>=20 >> Is there any chance you are using ControlPersist? That defaults to = off, >> so you would have to enable it in your ssh config file, or via = command >> line options. =20 >=20 > Certainly not on purpose. Never touched the config files on either > end. But, there were several build/install cycles on the FreeBSD end > and at least a couple of apt-upgrade cycles on the RasPiOS end, any > of which could have changed defaults. >=20 > The FreeBSD end now reports: > FreeBSD 14.0-CURRENT #39 main-ea6d169266: Sun Mar 19 23:10:56 PDT 2023 That reports information about the kernel, no the world/user-space. FreeBSD uname has a option that gives a clue about user-space ( -U for the ABI version number ) but linux does not. > and the RasPiOS end reports > Linux raspberrypi 6.1.19-v8+ #1637 SMP PREEMPT Tue Mar 14 11:11:47 GMT = 2023 That is just about the linux kernel. # more /etc/os-release=20 PRETTY_NAME=3D"Debian GNU/Linux 11 (bullseye)" NAME=3D"Debian GNU/Linux" VERSION_ID=3D"11" VERSION=3D"11 (bullseye)" VERSION_CODENAME=3Dbullseye ID=3Ddebian HOME_URL=3D"https://www.debian.org/" SUPPORT_URL=3D"https://www.debian.org/support" BUG_REPORT_URL=3D"https://bugs.debian.org/" # uname -a Linux raspiOS64 6.1.19-v8+ #1637 SMP PREEMPT Tue Mar 14 11:11:47 GMT = 2023 aarch64 GNU/Linux I'll note that having 6.1.19 of the linux kernel is far more recent than a standard Debian GNU/Linux 11 (bullseye) distribution . . . https://distrowatch.com/table.php?distribution=3Ddebian reports "11 bullseye" as having 5.10.46 for its standard kernel. > Just for clarity, I'm logged in on the RasPiOS end, trying to use it > as an X terminal for the FreeBSD headless host. =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Wed Mar 22 17:16:33 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4PhZrh2TnDz414vK for ; Wed, 22 Mar 2023 17:16:36 +0000 (UTC) (envelope-from void@f-m.fm) Received: from out1-smtp.messagingengine.com (out1-smtp.messagingengine.com [66.111.4.25]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4PhZrg5z8Yz3ptQ for ; Wed, 22 Mar 2023 17:16:35 +0000 (UTC) (envelope-from void@f-m.fm) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm2 header.b=JPL1ZzdS; dkim=pass header.d=messagingengine.com header.s=fm2 header.b=mGMkfM7n; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 66.111.4.25 as permitted sender) smtp.mailfrom=void@f-m.fm; dmarc=pass (policy=none) header.from=f-m.fm Received: from compute6.internal (compute6.nyi.internal [10.202.2.47]) by mailout.nyi.internal (Postfix) with ESMTP id B660F5C00B6 for ; Wed, 22 Mar 2023 13:16:35 -0400 (EDT) Received: from mailfrontend2 ([10.202.2.163]) by compute6.internal (MEProxy); Wed, 22 Mar 2023 13:16:35 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:content-type:date:date:from:from:in-reply-to :in-reply-to:message-id:mime-version:references:reply-to:sender :subject:subject:to:to; s=fm2; t=1679505395; x=1679591795; bh=Ve 193lWqFAIUxplNjWBVplbMJuGytb40V9NV4pA2IKM=; b=JPL1ZzdSx5fR4MN5M5 INcoN7OEysmG0GRdIylyyA2+uc/gwWYsN/MxGVDCNQfJmbfwqx76an/ejgZ9UB4r XEFnSTIMFPb3JIRdjiErFoOpnJivan/YVSmWl3qaLSFu2C94WLje/to91RmQmapM 5HjxeloZWJkj7IGNye1Q0TyUhlglUV0TcxcH8fHIIiUJkvlQWSNzPomaQui+jPxq nSSC9y5d1uIcll8aC7cmNrjc77/EtnoYSVLvzeHO/SmSEKajt97IyOFUB4oDingK cgVX05/iC0YvUIjLRCIz2sxrL9OOYjz4cAKgiz3Zl0E5lPcQ7L9csFJyNTJacCFK j75w== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:content-type:date:date :feedback-id:feedback-id:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:sender:subject :subject:to:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm2; t=1679505395; x=1679591795; bh=Ve193lWqFAIUx plNjWBVplbMJuGytb40V9NV4pA2IKM=; b=mGMkfM7nJWyAJWQbPcYuNFpxtir8Y VwsNiiB6W953VT4m4QzD3J0rf4UgqnpnEVBCdnLBLTn3CqG2xZSpH+pDyj0hnXVd FCKiLd1sUplQdMeFKtxqctVtFQNMXK9kVehd7qom5uw3juAMf9clRhKmP4qkPy08 VqZtJSIdAciaBHPti3NhxPQIS0lufMsD/sNyoO+QBsE4NGvMFziih9iiLF8d3vOh 09RonP2lOw/uLm7i/v2U4HVL4dswEL6Fr1KYFuWxrejFhztEVBOaDxX3JlrTK2Zq YoeVGD14S5lhu3IXbOZpc8EKi0OjGcTu2lhmFs8TtyfZNmeb6UOAjwarw== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvhedrvdegvddguddttdcutefuodetggdotefrod ftvfcurfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfgh necuuegrihhlohhuthemuceftddtnecunecujfgurhepfffhvffukfhfgggtuggjsehttd ertddttddvnecuhfhrohhmpehvohhiugcuoehvohhiugesfhdqmhdrfhhmqeenucggtffr rghtthgvrhhnpeekleduvdelhfeileefgffghfffkedtheellefgudfgvdegkeejjedutd ehhefgueenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhm pehvohhiugesfhdqmhdrfhhm X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Wed, 22 Mar 2023 13:16:35 -0400 (EDT) Date: Wed, 22 Mar 2023 17:16:33 +0000 From: void To: freebsd-arm@freebsd.org Subject: Re: FYI: upcoming 13.2-RELEASE vs. 8 GiByte RPi4B's based on U-Boot 2023.01 recently in use, given UEFI style booting Message-ID: Mail-Followup-To: freebsd-arm@freebsd.org References: <2B3378B0-A506-4A90-80D4-734AAA5EE774.ref@yahoo.com> <2B3378B0-A506-4A90-80D4-734AAA5EE774@yahoo.com> List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline In-Reply-To: <2B3378B0-A506-4A90-80D4-734AAA5EE774@yahoo.com> X-Spamd-Result: default: False [-4.46 / 15.00]; DWL_DNSWL_LOW(-1.00)[messagingengine.com:dkim]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-0.95)[-0.948]; NEURAL_HAM_SHORT(-0.81)[-0.814]; MID_RHS_NOT_FQDN(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm2,messagingengine.com:s=fm2]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.25:c]; MIME_GOOD(-0.10)[text/plain]; RWL_MAILSPIKE_GOOD(-0.10)[66.111.4.25:from]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.25:from]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; PREVIOUSLY_DELIVERED(0.00)[freebsd-arm@freebsd.org]; ARC_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:19151, ipnet:66.111.4.0/24, country:US]; RCVD_COUNT_THREE(0.00)[4]; TO_DN_NONE(0.00)[]; FREEMAIL_FROM(0.00)[f-m.fm]; MLMMJ_DEST(0.00)[freebsd-arm@freebsd.org]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Rspamd-Queue-Id: 4PhZrg5z8Yz3ptQ X-Spamd-Bar: ---- X-ThisMailContainsUnwantedMimeParts: N On Sat, Feb 18, 2023 at 04:44:09PM -0800, Mark Millard wrote: >This is an FYI about 8 GiByte RPI4B coverage by 13.2-RELEASE. >(The existing snapshots and such show the issue now --but I'm >noting the 13.2-RELEASE consequences for as things are.) Thanks for the heads-up. I saw this only after encountering the proble; I should have looked here first ;) Can the issue be sidestepped using materials working at the moment with 13.1R-p6 ? The VC_BUILD_ID_TIME for start4.elf is Feb 25 2021. I was thinking of taking eg: FreeBSD-14.0-CURRENT-arm64-aarch64-RPI-20230316-cee09bda03c8-261544.img mounting the msdos partition with mdconfig, removing what's there and copying over the known-to-be-working contents of /boot/efi on the 13.1 system? additionally, how can I stop the msdos partition being clobbered on the working system in some future freebsd-update of the working 13.1-p6 system? -- From nobody Wed Mar 22 17:42:41 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4PhbQm05dQz416By for ; Wed, 22 Mar 2023 17:42:40 +0000 (UTC) (envelope-from fbsd@www.zefox.net) Received: from www.zefox.net (www.zefox.net [50.1.20.27]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "www.zefox.com", Issuer "www.zefox.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4PhbQl5Yf9z3tfM for ; Wed, 22 Mar 2023 17:42:39 +0000 (UTC) (envelope-from fbsd@www.zefox.net) Authentication-Results: mx1.freebsd.org; none Received: from www.zefox.net (localhost [127.0.0.1]) by www.zefox.net (8.17.1/8.15.2) with ESMTPS id 32MHggSx040941 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Wed, 22 Mar 2023 10:42:42 -0700 (PDT) (envelope-from fbsd@www.zefox.net) Received: (from fbsd@localhost) by www.zefox.net (8.17.1/8.15.2/Submit) id 32MHgfZI040940; Wed, 22 Mar 2023 10:42:41 -0700 (PDT) (envelope-from fbsd) Date: Wed, 22 Mar 2023 10:42:41 -0700 From: bob prohaska To: Marek Soudny Cc: freebsd-arm@freebsd.org Subject: Re: Persuading ssh -X to work from a RasPiOS system Message-ID: <20230322174241.GA40929@www.zefox.net> References: <20230321232926.GA37569@www.zefox.net> <86wn39cuyh.fsf@bay.localnet> <20230322161750.GB40692@www.zefox.net> <51a736f9-1cee-d855-6104-b14b5b44fea7@soudny.net> List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <51a736f9-1cee-d855-6104-b14b5b44fea7@soudny.net> X-Rspamd-Queue-Id: 4PhbQl5Yf9z3tfM X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:7065, ipnet:50.1.16.0/20, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On Wed, Mar 22, 2023 at 05:38:38PM +0100, Marek Soudny wrote: > Hello Bob, > > On 22. 03. 23 17:17, bob prohaska wrote: > > Certainly not on purpose. Never touched the config files on either > > Thanks for writing! > > > > bob prohaska > > Just to be sure - do you have xauth package installed on the remote > (FreeBSD) host? > A correspondent on comp.sys.raspberry-pi pointed out that X11Forwarding defaults to NO and that was apparently the trouble. Setting the sshd config file to allow x11 forwarding on the FreeBSD host solved the problem. Thanks to all who replied! bob prohaska > From nobody Wed Mar 22 17:48:59 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4PhbZN0dlWz416Fk for ; Wed, 22 Mar 2023 17:49:16 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic317-20.consmr.mail.gq1.yahoo.com (sonic317-20.consmr.mail.gq1.yahoo.com [98.137.66.146]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4PhbZM55wTz3vjS for ; Wed, 22 Mar 2023 17:49:15 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1679507354; bh=o7jBlPcQafCt9HnqCagPyhMpWg7aM2hVRMVeysZus74=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=WtWeroSepzjiOIw+wKmz5B9sxPgYenq5Kb7XIO4ZoKOJBDA7TAlnqQdjY+nMmgp6R8xdw7vpJYcFjuWHoYwPVJ3ZsZC3Fdu7PSTTJOTWdzt6KE+B6KX5lBCag42rNcntbQFYcXo8NSF1zedHO6w+cMKSCTjx4sadSHD2o33Poj51TpeJCR6zxrQCSbiAjE7u1xTGSFHgSwf5W3YxTMwpwCQnYmPS8NLGSf6E74KMiJyzOtszxy14Su4Wq/VkPpG6W43foYDFyHIIECDKfp9Uidtgd0Ckvi6a13W/1l1thYqD62Wstma+TLcfczrOkDrcjAIbqGDawr6Nn/7gzJxVTA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1679507354; bh=+z1Ps/Y12D6ugGssfyaB0xZzVJTW7RwKOLF2jE2kg1O=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=V+os6mhQrGdncx53XOC6130HRWtNV6f6HcwbP9NkPDp8v0Aw2W3S0IAVJNohk9AFUB63yNXvjkNLBJ0LqgPHqaCh4EYOMKd0NA6LS55wrAdr9xWcylkWTreZ38jbRHta4KwmoaAPrMh+0OJV9VJkzmuibHS5rWJWjVL/zBjjw1CzTFtffqRZjERbWCThPAQeqbO6sxCCPSR/cI2/Zuuh98nI4GBR+7+YuMvwg8rWMMTs8bopT7/tyQqMpuDezis+y9eY6mzNRlw0yTL9BW483rVMGFc4H29OnoLLKvmkIExJcUB0Y31DLg/vKWVER77QLkMAW8d1Zk+3SbO3DiVVJQ== X-YMail-OSG: Lpv0q2YVM1nDZUwMesRwDpCiRF7T6R4C7I5sd7GJC6CwgxYdMPRv7oqJmhJSFMI btpiiPvIvAtIpM25Lojn6XOXyo7ClpK2rrCdHjaxqbfaSnrSuArqSCU0b4TUniGepI.jE5DwNdR4 RcSsobjCkEjLEJ.pYax45EZR3UoJnZV1zygX1psuJt4JyPd2DpuqD42WyJEWKeBgD.DRHoPb6YWW zCZqcaUN0IEmckW_blCIzVSwzi7NndIkIeR9BsEeroRbhHqnn7LEzHb14DFtcOsuwYsWE3e8dBhI 4ZRlsT.7jJlwhIE5v_pXsZ4sI74JpyOYMvFnPrCyJXtL6kmTz0ZlRIphIP0RM8g75H92cui8mAWP j8_l4yUcYJIL0FXMJ5kPL1UwZzrl8KfUOLbz.83BR2dCT8HNXkhE4CLUBy7iFoJ_QNh8MjED7Idc J6hzXOOwZzPCTwnOiIkcv1beWJlX9krisuROtRXWRrXiWYwpdvW1PjtbS786fzqcdwXOwKa563zE 2MKMIG3Encalxzt8pL6KR0NbAmXYXG6yuSKeGZl9zQnhCV7WRdtojnZIRf7BguX74k3QrwWo2CaA 4JQtRlTFcWsVjoG5Nhwyhbow4T0firDFYjbJ1USV_gxyx2EnQv_jZDNTmWDtOwapkh7cKlTo8_sb v3MTvIi8D6FLZVnkkOslcgx6OnTpqDUpVzfXR.br2t4gWsk6wZvSQQpsWSFr5Z2hb6fLh_F_1hAG GydcVaX5FIo5TEUnCsPFynEfmU2PXpgBY0obpNouakkrS4iTm2Ma2HTqQIGbV4kRhC9iWpL1Uw9H FBvfGFodCCA8gNSIsjZxviZWlSztKVur3ICznjJ0qEJVxrbMAVdpij32NdsotjLq07TkpNEk47ib gDHfNK4UMpFViCsxNQqLAfWoejr.H6Nl6bTXZMZ2ATME8yMFYG4gcyTBJ3KNGrBtyws_wmNYSoHF xyooMkScmXpeJMq5flZ7MYW7z5xndfxL8p_KJHh23HLA8T8hUwM.kPgba7.aH0xugvEurJKaUJRL rj9mXDuhQcQpXUO0FjAvGgdnfr6tkAeMCiXY3UoAfPEzZc1TORN3KL.f5s9fGGtCn3K3lxckEk60 LN69.YxhdXOeoO5JamXYjm.W4UiVacvDouciwCwzBaNqLUYEHSYf.d0IDIMwblLnAfi9Hr3GO8Ji FiC_.Cv0VeSZ.tBNjeOi1mr7mUYG5Vbs2bBuK4XwVhg.gdVqdyo0wG2iEnEMiX6NqwRq7_LOgWx7 0CwuLR7ytOKU3iRW1TfKAU0SbYcSTMZfLKBwBxUBM1bsyE97G21hZV7P_2lM0eUFmN1B2DxtjwLV CcCtgFiz4kpHDCk48v_xQ6I8nawFrT2xs.09uK04QI8ZmTJ0do6Qnw6NMTVynjA2Qae6E2xnuCTd TQ7I4pQHvmLCxwxfNsSQbke2irilFV6EllE3BOpiFR9bNCM_76qqGlQ9Bk_Nxe4L9xwXrKmG587c B9AlmKu765jkMnb2hnDYOI.RovHlx4t0l.46PhXoufb5Mi_E1du0kkE2u9tM6qVfHew.41WPZDHs ZXnfHj9jkb3xaTQfdHYxbuF77hbhhUIs3rR4CVlRP78kzIYCtbpIizo9U4knX2pw1jeNZvUv4Txi fflB_IlHP8esuZFspK5ioYWoRtXW1gM.QUE9VSRIKVuin4qcjFl3grX7gjW7Wsp5hidJPpwV0yJo P.pfhOJ14SfjkGFJV9mCR0ENxJYhnnU5qreRkZjcckc_.gfdNikb.9mgOK6spsjUhAewIYUiDsZW MmqYALsGZ2Nl7P4fn335kb9UC4jIXcHDxWz_xbYOb_jyg0SR0ZcXK4GlpaCr5EjEjV2O9rtDu_qe ndaGwYBHEdpzwGD8NtbNm3tDAIHAAcRaTv3EeaHqtc0Uq4O8TJrIWU8F0iVmFgP8gvbHWCHz..1j NnSuSMtA8JbRYngH2MTLevQKlGrU_.vluVEQaAMG8sbub3eYyEFy5YlOPijkP8RGBR7vWZlqNM2x 1rZh7zh5C2xoGOTO8kTQvlB7cH4xby14U6dyyrNxQWCwWGy5hfQPY6nprMqfICftccabLBsq.wRh 6iptqxIe5tggCa3SpBjzTuIsXGR2dkPwDCV6Mjz_HyQB9BERpmPgJrHQVxFoAWOCthQhVtOU1wxr HHsiPcTtCg.xEOLSNzfnQ9NRFgwvLZ5DXGK2rTfg8ENz6umiwNrzLNfff2VXhJn9aEUn2zQWdfGj m3omttZRpq6TAwRKKkSEjqRNWSE33FxfGsqDnRuMYhIkBOUMgJuUPuiTyIAfxGa4qbJflq7.I_pZ 8E9h0 X-Sonic-MF: X-Sonic-ID: bdbf80dd-5dfb-4c89-8969-3ff8cef0b243 Received: from sonic.gate.mail.ne1.yahoo.com by sonic317.consmr.mail.gq1.yahoo.com with HTTP; Wed, 22 Mar 2023 17:49:14 +0000 Received: by hermes--production-gq1-6cf7749bc8-w8vjj (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID b79cf7132b50d25ebd107b15177139d2; Wed, 22 Mar 2023 17:49:10 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.400.51.1.1\)) Subject: Re: FYI: upcoming 13.2-RELEASE vs. 8 GiByte RPi4B's based on U-Boot 2023.01 recently in use, given UEFI style booting From: Mark Millard In-Reply-To: Date: Wed, 22 Mar 2023 10:48:59 -0700 Cc: freebsd-arm@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <2B3378B0-A506-4A90-80D4-734AAA5EE774.ref@yahoo.com> <2B3378B0-A506-4A90-80D4-734AAA5EE774@yahoo.com> To: void X-Mailer: Apple Mail (2.3731.400.51.1.1) X-Rspamd-Queue-Id: 4PhbZM55wTz3vjS X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On Mar 22, 2023, at 10:16, void wrote: > On Sat, Feb 18, 2023 at 04:44:09PM -0800, Mark Millard wrote: >> This is an FYI about 8 GiByte RPI4B coverage by 13.2-RELEASE. >> (The existing snapshots and such show the issue now --but I'm >> noting the 13.2-RELEASE consequences for as things are.) >=20 > Thanks for the heads-up. I saw this only after encountering the = proble; > I should have looked here first ;) >=20 > Can the issue be sidestepped using materials working at the moment = with > 13.1R-p6 ? The VC_BUILD_ID_TIME for start4.elf is Feb 25 2021. I was > thinking of taking eg: >=20 > = FreeBSD-14.0-CURRENT-arm64-aarch64-RPI-20230316-cee09bda03c8-261544.img >=20 > mounting the msdos partition with mdconfig, removing what's there and > copying over the known-to-be-working contents of /boot/efi on the 13.1 > system? >=20 > additionally, how can I stop the msdos partition being clobbered on = the > working system in some future freebsd-update of the working 13.1-p6 > system? As of at least: = http://ftp3.freebsd.org/pub/FreeBSD/releases/ISO-IMAGES/13.2/FreeBSD-13.2-= RC3-arm64-aarch64-RPI.img.xz # uname -apKU # Booted on a "C0T" 8GiBYte RPi4B FreeBSD generic 13.2-RC3 FreeBSD 13.2-RC3 = releng/13.2-n254599-d9bf9d73203f GENERIC arm64 aarch64 1302001 1302001 FreeBSD-13.2-RC3-arm64-aarch64-RPI.img boots 8 GiByte RPi4B's just fine. This is because: # strings /boot/msdos/u-boot.bin | grep "U-Boot 20" U-Boot 2022.10 (Mar 17 2023 - 05:44:18 +0000) So it appears that the FreeBSD-13.2-RC3-arm64-aarch64-RPI.img builds are using the previous U-Boot version that did not have the problem that 2023.01 has. For reference: # strings /boot/msdos/start4.elf | grep VC_BUILD_ID_ VC_BUILD_ID_USER: dom VC_BUILD_ID_TIME: 12:10:40 VC_BUILD_ID_VARIANT: start VC_BUILD_ID_TIME: Feb 25 2021 VC_BUILD_ID_BRANCH: bcm2711_2 VC_BUILD_ID_HOSTNAME: buildbot VC_BUILD_ID_PLATFORM: raspberrypi_linux VC_BUILD_ID_VERSION: 564e5f9b852b23a330b1764bcf0b2d022a20afd0 (clean) It is not the RPi* firmware vintage that drives the 8 GiByte related boot failure: it is just 2023.01 of U-Boot. So only the u-boot.bin needs to be replaced, nothing else. But there are RPi* firmware vintage issues around: main [so: 14] and stable/13 have had the FreeBSD kernel fixed to allow recent RPi* firmware to boot. But releng/13.2 and before do not have that fix and so can not have RPi* firmware much more recent than is now FreeBBSD-standard ( sysutils/rpi-firmware ). This likely means that sysutils/rpi-firmware will be frozen until releng/13.3 (so: about another year). Note: I do not use freebsd-update to upgrade systems. But I've expect it to only do FreeBSD material, not RPi* firmware or U-Boot, just like bsd-install does not deal with any non-FreeBSD aspects of things. =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Wed Mar 22 23:35:21 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4PhlFp3vs6z41Sdp for ; Wed, 22 Mar 2023 23:35:26 +0000 (UTC) (envelope-from void@f-m.fm) Received: from out5-smtp.messagingengine.com (out5-smtp.messagingengine.com [66.111.4.29]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4PhlFn4c2Sz3y01 for ; Wed, 22 Mar 2023 23:35:25 +0000 (UTC) (envelope-from void@f-m.fm) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm2 header.b=BIMRjXR6; dkim=pass header.d=messagingengine.com header.s=fm2 header.b=iZSJFHPk; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 66.111.4.29 as permitted sender) smtp.mailfrom=void@f-m.fm; dmarc=pass (policy=none) header.from=f-m.fm Received: from compute2.internal (compute2.nyi.internal [10.202.2.46]) by mailout.nyi.internal (Postfix) with ESMTP id 7B7595C00E9 for ; Wed, 22 Mar 2023 19:35:24 -0400 (EDT) Received: from mailfrontend2 ([10.202.2.163]) by compute2.internal (MEProxy); Wed, 22 Mar 2023 19:35:24 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:content-type:date:date:from:from:in-reply-to :in-reply-to:message-id:mime-version:references:reply-to:sender :subject:subject:to:to; s=fm2; t=1679528124; x=1679614524; bh=BG hkkYverxzMwfO/bD8qEhQ9NSQdziyufTz62rbwAN0=; b=BIMRjXR6jQhs0Io3YZ +udYuxVTi/hKPoACUpj0ASaoRGIuv3r370BNb6zYC+/BAulcJf+QCGhsgI+j8taF 0rAvhdnY6x2jeHCX8Hseqny/visLH45QIPChRIRX7BiBFWKBkkpDQw9VfI3flXb5 w2KbPccfAtH1gxMbx7ok6+YYCBZj7BxmAGYn94z00YrH3tefZS4ZabuQc6h5vr2/ EqPLSBgLkKg+2eYE4N6dcPm+QczCPv3D9Gqf6nPLOygap+koBRQZR7nCYCRaLfIF 00upWv8Gub1+45m3POwcksR1p9sfr7Mj94CP8A+A/uZkkiVcCN3cIz8OaZOAMEue Gqkg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:content-type:date:date :feedback-id:feedback-id:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:sender:subject :subject:to:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm2; t=1679528124; x=1679614524; bh=BGhkkYverxzMw fO/bD8qEhQ9NSQdziyufTz62rbwAN0=; b=iZSJFHPkFpd0rsdUzdGcfqvcE9oeD n8ZXfuPednLxanYehZ40nFYIBOQbS7tZb5QCH4J76uRyWYXLBR4Km3CLOSN4w/gs +J/w1/OBDgBp3DllARPPbCLpWCIjvAARx/oIdAbqPbn+VH1qJ+pnSWEdNVpotC64 BAmPSbwHOgwfgRutxQcsibwYxjHUHPHnw+NbWw8cVLLB4PtrxHltGlpJcZQ2lS65 9pqZ3Xt0/fGkEd/FUHDBUMqCjheJ/jDCuacr/m10EIAdmlkaHbnp6pXhSwOenTDw bAEpIs5y06o7thly1wKsYb8FqXINCikYOJq4XDsystdf5al5wd1xoSHpA== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvhedrvdegfedgudduucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpeffhffvuffkfhggtggujgesthdtre dttddtvdenucfhrhhomhepvhhoihguuceovhhoihgusehfqdhmrdhfmheqnecuggftrfgr thhtvghrnhepkeeluddvlefhieelfefggffhffektdehleelgfdugfdvgeekjeejuddthe ehgfeunecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomhep vhhoihgusehfqdhmrdhfmh X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Wed, 22 Mar 2023 19:35:23 -0400 (EDT) Date: Wed, 22 Mar 2023 23:35:21 +0000 From: void To: freebsd-arm@freebsd.org Subject: Re: FYI: upcoming 13.2-RELEASE vs. 8 GiByte RPi4B's based on U-Boot 2023.01 recently in use, given UEFI style booting Message-ID: Mail-Followup-To: freebsd-arm@freebsd.org References: <2B3378B0-A506-4A90-80D4-734AAA5EE774.ref@yahoo.com> <2B3378B0-A506-4A90-80D4-734AAA5EE774@yahoo.com> List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline In-Reply-To: X-Spamd-Result: default: False [-4.60 / 15.00]; DWL_DNSWL_LOW(-1.00)[messagingengine.com:dkim]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.996]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; MID_RHS_NOT_FQDN(0.50)[]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.29]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm2,messagingengine.com:s=fm2]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.29:from]; PREVIOUSLY_DELIVERED(0.00)[freebsd-arm@freebsd.org]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; TO_MATCH_ENVRCPT_ALL(0.00)[]; ARC_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:19151, ipnet:66.111.4.0/24, country:US]; RCVD_COUNT_THREE(0.00)[4]; TO_DN_NONE(0.00)[]; FREEMAIL_FROM(0.00)[f-m.fm]; MLMMJ_DEST(0.00)[freebsd-arm@freebsd.org]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Rspamd-Queue-Id: 4PhlFn4c2Sz3y01 X-Spamd-Bar: ---- X-ThisMailContainsUnwantedMimeParts: N On Wed, Mar 22, 2023 at 10:48:59AM -0700, Mark Millard wrote: >It is not the RPi* firmware vintage that drives the >8 GiByte related boot failure: it is just 2023.01 of >U-Boot. > >So only the u-boot.bin needs to be replaced, nothing >else. I wasn't aware of the detail, and not knowledgeable enough of the issue so my "remedy" was a simplistic "the stuff in this msdos partition worked, the other didn't" :D and thats why I replaced everything with the exception of efi/* I transferred the files on the msdos partition of the running 13.1-p6 system to the msdos partition of the main-n261544-cee09bda03c8 image, wrote the image to usb then booted to it, then ran bsdinstall to install it to external usb3 hd (zfs), tried to boot *that* and failed (it still wouldn't boot from the hd because the installer still doesn't populate the msdos partition of the hd with the full contents of the msdos bit of the install medium). So booted back to the usb key again, plugged in the hd after it fully booted, mounted the msdos partition of the hd onto /mnt and copied all of /boot/msdos/* to it *except* /boot/msdos/efi. Powered down, booted directly to the hd. So now this rpi4 now has 13.1-p6 vintage msdos bits running main-n261544-cee09bda03c8. >But there are RPi* firmware vintage issues around: >main [so: 14] and stable/13 have had the FreeBSD kernel >fixed to allow recent RPi* firmware to boot. what was fixed in the kernel? >But releng/13.2 and before do not have that fix and so >can not have RPi* firmware much more recent than is now >FreeBBSD-standard ( sysutils/rpi-firmware ). This likely >means that sysutils/rpi-firmware will be frozen until >releng/13.3 (so: about another year). I try not to mess with the firmware if I can help it. >Note: I do not use freebsd-update to upgrade systems. But >I've expect it to only do FreeBSD material, not RPi* >firmware or U-Boot, just like bsd-install does not deal >with any non-FreeBSD aspects of things. that's what my expectation is too. The reason to use freebsd-update was to have a stable reference system. -- From nobody Thu Mar 23 00:21:34 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4PhmHR0H2Wz40GkJ for ; Thu, 23 Mar 2023 00:21:55 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic301-20.consmr.mail.gq1.yahoo.com (sonic301-20.consmr.mail.gq1.yahoo.com [98.137.64.146]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4PhmHQ4y6Zz42sc for ; Thu, 23 Mar 2023 00:21:54 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1679530912; bh=twNFWEPfwGTyz/Rk9G7ObSpOjqxCbXskGzql8crLDJ4=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=KYEQKvcELQXH0OqzqdnntO2cIhnm1v4+G4b3MTnE7rxDqSxuBJqq5T5C2UpPjUnfMLP5qInN1ezDc3VWEWB3Bb/KDhu5SDlEX2Y47sY5qI/d7Ir0qiaR3Y4v70H+RcgqfoTCApIZQw99bVLNZtZu+fWwsveMZRLCK1i+SrkKsumS1y68V33fQf8OKe/GTON85NOyyURCi/n8dpNLR0hkqsu+vm8sxoT64+gvGG5AHtRqHn9LiXbfNyzEg3xbBKbYwVaUwnA4jvxSmTQEEGW01JkHh2+2wg+C5lf45NKQm5mdD3e99YEUrE1AuFa1vniu/psUo/+8UEreHBNjZZDocQ== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1679530912; bh=N+f75RKnMiAS25BxXomBbAy96noILw/wBWclPtBrXjp=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=ds4jQmVAmDI70MXdiUPYJcNY5+7V4rEdEg9kFhJttMuhhiLczkkjDTIbdPzET7bp99/zv0g8Epq2r5GbLWJmk5dPD6TPXqVgvm7yRlxQs8+2Mqy3+b9vvhzr9ou5JSFUnImzeqrtz598ahdM4oO3A9xlrwALOjRb9fIAVwHsqo9+T7dZgT9YkWnLYx/qHeaESUWT6LGZFNRxeWTdnu/wgcHS/5ZYlABHFvPf3d4Pf4akoIjgFsQycYg/7XtFF98o2bnFBApjoSbW8O96kfpvqgDOIjpgVNvZKaW/hEYeBQQN3g6YiHRuOCIec7Gh9/T5iJRNcIzSOfpJFZvr7LJFPQ== X-YMail-OSG: AysjI8QVM1k_r68V3zoYkp.L1uBLZv.nwDKg1md9lKhaP.XzxOJUPoePDJFtW.P kkAAaNTxrxSXJBiunSUDNWfXsqIKPmd865PMzv93549ev66SD3UC.TwGdklaO69WGJHSOsNE6gUc y3JfQk1bj3uFoDPlNzU9gJuttiidGsxgxspnol2EizqPAHqR8OAavFb1tyyTF7qm2VNFxiiede0O WCTn2Rlacw6EvfK1iPDQlMTmGjguuN5DUihlPTCbKEWcv35u4othNk9_QJtlZ8Ms0gMS3IYfwwSg OKfUL7eiNFU2WZdlfbq9hwEi5SHlP3G_yVa7fsAXTZgovZYf8UQNhE3iHD4KfFiOvoz1vRbxRV.e ZxbpAn6d8DwFeYOYvCvwB.I9OvXC8A72LPGE3aUl8hLGKJ43HmcDBxTSrf_C6lrxj59Vn5R8ezNW 92xcKq.YX4zRQriygxquoDxKk1HMpttQ4sm4zUEtwZAERW8TaGldQbs3gnNixtPxlCtMdB6VFSqB UA1IhvThYYCGFlcOYh7N.ewHFduF87Lijv_N1UYQVILd2wBX.mEvtmPSJZ4SyIGvaW7fV6GaER.6 _HetbK93.nJjBA.GyNYpYJv.pcNinZOdhMERFo.et4XmYc_ijO6KGmY3aONmsVKXorUr7bTSYe5t cuXUd0RBvHoK1eRMGOf2dmnwzMORgvAFT0cxIt_Q_gM.fOK3IVDv5aTSvdwgxGZXS7QY_CTABI8L WArZzlaOGvEDt.JytVE8R.bNJWz7pcaT31tw1SVL0hVjWnEUifL5Sc4td1Ls.g0idnnGbD9ebj.7 5Ops.mUAcrgwTPZ517T09Zxtxot2N4nIwipR1r4VDqf.F_gUOGijKbakffLSl6xqNHcBKpI6Q0VA bl.ajy9fWGKyOFnrnz73ZCD1iFbmM1U5AJ9cxfGkcY0oPxy2rAPnkU5y8LNQIi8ZoDqDKkqgWxfq b2puARNS6vGcqAQAci_xAml2ujfMa32kqCqwCzBGivMNc83WfanjNSdOYUbChic9Cg_qvOR6GPRH iowzg0aW3ECZ6O7tkT..x28zF9GefnHhW5hEH7JUpTbKUzf9fKbsWn.0DgbxzWYT.BStqgk8m8U0 80S50OSEHU1sTM.l8ypHwMop2F5GXJlJJ6WGTkgf3jR6UUuyK.BboDwPbvLX_FOGLTRvdZVDScxn QtFB.EvSm8dfZVAJgjr__Ly9azlgqLWUOkJvHSHHxnWEmegjulIbFll5OLwWValGmD0VcXaOdjBg Mn_rCs84XUBJDnVR3Cjg4uAS1aQrmyKL.etbiAvWeeYOKpAYaGSdiSQp7.QClvcOI25b8V33jMdE k8_sjAWW590fg3DRV3J_wWBrPPNcJttmF4wdfU4RybFBaxBGY1az1bc69YUVD3PTk7G_SY9W7WBu Mf8hMNQkyxkmNh39ETru0R3ECXAyBNvu1rj.GIrGMbtp4lHJ8iGdrJnAc3IFCCcUfXmZ1FRpLc3i JAD_WtTTUE1m73shDfZCgY1nXDp9_dBcn_aevl3u5pKjX4Pt5n0M9SEIdjNLF0l7Fqa0Vk5CIs6t 2UMNnHLz31jfkWVOTFVtK9O4cmOamdZLgr6L7m37wiv2ojm1PPLOt21lcw1bKyIjNc4ROrdcpsOE 3XV3UU9oCdqDfnnLictaPbZwEzeLhQ0QzTj9G7S.haQ6pv4LXCtVEolo5EAaaFNqZhk3NuCxqdNk IG81aaTD_6USg57Qoo2iJgteLf_IUDBgfJLSW7WQsW2sVjUx0P8mTgHJjhu9IlQfoUl89aJV16ae _kWkm2SPffFdLLnnd46Cn.sieS7XtQsL1CFYluQjGEHco4M8DniA10qFsROzpdWowBrZbp_vr27Y iNJE8jRALym3Wkl5UdfTqVX6cuyXB1GVvrGO.A9n9vI7efkUThSgcAJXNCQg1WNVNK7J6WcBhMWx dcJPS00NfcanNU5EgZg_Hfa8NjNiQvdq.KUBz6pU4XSBbQshdv9n.W7cwHwp29WpQZX1yjfdezaZ AriJJ6a9ySakR6Pze0lhfMvr7m_0SkVDobgJ5oEy4xlYsVCNOURzMsDuEmWyk3bY3VeLmqNUqwoV CdujpPN00QC7Ujf_Z_wPHbvNEcTXnC3qrYVTtUUk2FBz3y4MKd0TDnOSeyeYuOvkuOBW35oBFm11 X.xenhEOOKCOiljPdO1il40Z8TWVLh_MQTTPmy2x_OClBWeEdmi8UGyvxWc5f6mU42eHwvqx1Ju7 Lkq7kM2fZX29FTFkgiE1HSI.OB.xg_RKSjQWqPVGDrg.mFserfgw4AGnisX37YTaYs4hMhfzOlpK c X-Sonic-MF: X-Sonic-ID: d33ffd17-4005-430e-9e00-a564fa3bde36 Received: from sonic.gate.mail.ne1.yahoo.com by sonic301.consmr.mail.gq1.yahoo.com with HTTP; Thu, 23 Mar 2023 00:21:52 +0000 Received: by hermes--production-bf1-777648578f-286lr (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 14bfd560fe9521bcd7a59ea9d3148cc2; Thu, 23 Mar 2023 00:21:47 +0000 (UTC) Content-Type: text/plain; charset=utf-8 List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.400.51.1.1\)) Subject: Re: FYI: upcoming 13.2-RELEASE vs. 8 GiByte RPi4B's based on U-Boot 2023.01 recently in use, given UEFI style booting From: Mark Millard In-Reply-To: Date: Wed, 22 Mar 2023 17:21:34 -0700 Cc: freebsd-arm@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <6F23BAB6-079B-444B-A689-230BCDB0A1E5@yahoo.com> References: <2B3378B0-A506-4A90-80D4-734AAA5EE774.ref@yahoo.com> <2B3378B0-A506-4A90-80D4-734AAA5EE774@yahoo.com> To: void X-Mailer: Apple Mail (2.3731.400.51.1.1) X-Rspamd-Queue-Id: 4PhmHQ4y6Zz42sc X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On Mar 22, 2023, at 16:35, void wrote: > On Wed, Mar 22, 2023 at 10:48:59AM -0700, Mark Millard wrote: >=20 >> It is not the RPi* firmware vintage that drives the >> 8 GiByte related boot failure: it is just 2023.01 of >> U-Boot. >>=20 >> So only the u-boot.bin needs to be replaced, nothing >> else. >=20 > I wasn't aware of the detail, and not knowledgeable enough of the = issue > so my "remedy" was a simplistic "the stuff in this msdos partition > worked, the other didn't" :D and thats why I replaced everything with > the exception of efi/* >=20 > I transferred the files on the msdos partition of the running 13.1-p6 > system to the msdos partition of the main-n261544-cee09bda03c8 image, > wrote the image to usb then booted to it, then ran bsdinstall to = install > it to external usb3 hd (zfs), tried to boot *that* and failed (it = still wouldn't boot from the hd because the installer still doesn't = populate the msdos partition of the hd with the full contents of the = msdos bit of the install medium). So booted back to the usb key again, = plugged in > the hd after it fully booted, mounted the msdos partition of the hd = onto > /mnt and copied all of /boot/msdos/* to it *except* /boot/msdos/efi. > Powered down, booted directly to the hd. >=20 > So now this rpi4 now has 13.1-p6 vintage msdos bits running = main-n261544-cee09bda03c8. The RPi* firmware FreeBSD uses dates back to 2021-03-05 when 1.20210303 was checked in. It has been a long time since that update. To my knowledge, each 13.1-RELEASE-p? still uses the exact same RPi* firmware as 13.1-RELEASE : only FreeBSD material is updated by -p? updates. So the U-Boot also has not been been updated in any 13.1-RELEASE-p? as far as I know. Similarly for armstub8-gic.bin and armstub8.bin (which are distinct from RPi* firmware and from u-Boot, despite how FreeBSD bundles them). Snapshots and 13.2-??? are another matter for U-Boot. >=20 >> But there are RPi* firmware vintage issues around: >> main [so: 14] and stable/13 have had the FreeBSD kernel >> fixed to allow recent RPi* firmware to boot. >=20 > what was fixed in the kernel? (I forgot to mention the recent reboot issue and its fix, as well.) Using main (which happended first): The kernel crash for modern RPi* firmware (the basic problem has existed since the beginning but was exposed by .dtb file changes in more modern firmware): Fri, 24 Feb 2023 . . . =E2=80=A2 git: 9873b1716970 - main - bcm_dma: attach at an earlier = bus pass Mitchell Horne=20 =E2=80=A2 git: 07ccf71451d7 - main - bcm_dma: don't dereference NULL = softc Mitchell Horne The reboot issue fix (only an issue for main [so: 14]): Wed, 15 Mar 2023 . . . =E2=80=A2 git: 8937bd37d07c - main - arm64: limit EFI excluded = regions to physical memory types Mitchell Horne >> But releng/13.2 and before do not have that fix and so >> can not have RPi* firmware much more recent than is now >> FreeBBSD-standard ( sysutils/rpi-firmware ). This likely >> means that sysutils/rpi-firmware will be frozen until >> releng/13.3 (so: about another year). >=20 > I try not to mess with the firmware if I can help it. >=20 >> Note: I do not use freebsd-update to upgrade systems. But >> I've expect it to only do FreeBSD material, not RPi* >> firmware or U-Boot, just like bsd-install does not deal >> with any non-FreeBSD aspects of things. >=20 > that's what my expectation is too. The reason to use freebsd-update = was > to have a stable reference system. =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Thu Mar 23 07:20:26 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4PhxZL4GgMz40ylj for ; Thu, 23 Mar 2023 07:20:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4PhxZL22xcz3njt for ; Thu, 23 Mar 2023 07:20:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1679556026; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=SF3UFpR9c6oEKbzor2fDY/UPK3em74O7tZr4Y0fQ820=; b=gnGvjy9hFFCaYld7FHpZnPqMj1Y63/RePkEo1YSGFM0SyQ1kMW2CueDhi7pfVu1csJ5W+w +iMLszg/AKIRKfnEgZogvPHhNe2fbOa/bmm9AYM429wCZNo6pFS3LdnWPZZgL5g2+ZYdtJ ZySoQwNoCzX0ZB8x1xmx8kjssVaSMZHUgxHeClOIs4O58Rs6gMG7xFlXhnXroafKvyHKMe 3Jac4Pu3+IbWRmFzbVnPg4VxQCR8npx9B2KL+D4JE7Wi48D2NPzpdGMOvWDBsr6wdw0a7d VmEalMb9vxMDoudA0CFxY44XPaPvRbxgHO9vU9HuRkIStJsFzCAtoD1buxrbPA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1679556026; a=rsa-sha256; cv=none; b=fwz5fMtmkS7MVir6wIKukLEGG9yMtKvT7Gc0XV8syd7c3fJex0Qi4AwwQAVh6p43aDmP6b nEz6S96XbGnhczCZmCSlMhzV5uxNgORMI1sHaWA6Dqk9/RKRAqWa2QwtyajKegaiKu6ozV 1c7XS5Nqorm4Ppe34gy7S9q3hRqibof8Tr/NDzgdKLy4UPr5FQUruemxhBpP2gunehpAfc DFbNT9Zhly/fDBgtMG1FUZbH6ZKcDv49Voio9PRJbHCU6+yJ0088/4Ir+CGj8w3Yw+1fai zLKV+VsZHf89obOK38nsDKSzKE8vNDPVtwC+o04t6mt/s8lCQj3mVh64ihBc5A== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4PhxZL17j3zRZ8 for ; Thu, 23 Mar 2023 07:20:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 32N7KQqj044010 for ; Thu, 23 Mar 2023 07:20:26 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 32N7KQJt044009 for freebsd-arm@FreeBSD.org; Thu, 23 Mar 2023 07:20:26 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-arm@FreeBSD.org Subject: [Bug 270415] ram0 pseudo-driver breaks ARM64 on Hyper-V on CURRENT Date: Thu, 23 Mar 2023 07:20:26 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: arm X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: weh@microsoft.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-arm@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D270415 Bug ID: 270415 Summary: ram0 pseudo-driver breaks ARM64 on Hyper-V on CURRENT Product: Base System Version: CURRENT Hardware: arm64 OS: Any Status: New Severity: Affects Some People Priority: --- Component: arm Assignee: freebsd-arm@FreeBSD.org Reporter: weh@microsoft.com The patch physmem: add ram0 pseudo-driver (commit e6cf1a0826c9d7f229e41224ec7b783501636528) causes panic when booting arm64 FreeBSD on Hyper-V. Panic stack looks like Booting [/boot/kernel/kernel]...=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 |No valid device tree blob found! WARNING! Trying to fire up the kernel, but no device tree blob found! EFI framebuffer information: addr, size=C2=A0=C2=A0=C2=A0=C2=A0 0x40000000, 0x800000 dimensions=C2=A0=C2=A0=C2=A0=C2=A0 1024 x 768 stride=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 1024 masks=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 0x00ff0000, 0x0= 000ff00, 0x000000ff, 0xff000000 ---<>--- GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb Copyright (c) 1992-2023 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 =C2=A0=C2=A0=C2=A0 The Regents of the University of California. All rights = reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 14.0-CURRENT #13 main-n260755-e6cf1a0826c9-dirty: Mon Mar=C2=A0 6 1= 0:21:42 UTC 2023 =C2=A0=C2=A0=C2=A0 root@fbsd13-nvme-test:/data/ws/obj/data/ws/main/arm64.aa= rch64/sys/GENERIC arm64 FreeBSD clang version 15.0.7 (https://github.com/llvm/llvm-project.git llvmorg-15.0.7-0-g8dfdcc7b7bf6) WARNING: WITNESS option enabled, expect reduced performance. SRAT: Ignoring memory at addr 0x1c0000000 SRAT: Ignoring memory at addr 0x1000000000 SRAT: Ignoring memory at addr 0x10000000000 SRAT: Ignoring memory at addr 0x20000000000 SRAT: Ignoring memory at addr 0x40000000000 SRAT: Ignoring memory at addr 0x80000000000 SRAT: Ignoring memory at addr 0x100000000000 SRAT: Ignoring memory at addr 0x200000000000 SRAT: Ignoring memory at addr 0x400000000000 SRAT: Ignoring memory at addr 0x800000000000 VT(efifb): resolution 1024x768 module scmi already present! module firmware already present! real memory=C2=A0 =3D 4294799360 (4095 MB) avail memory =3D 4155047936 (3962 MB) Starting CPU 1 (1) FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs arc4random: WARNING: initial seeding bypassed the cryptographic random devi= ce because it was not yet seeded and the knob 'bypass_before_seeding' was enab= led. random: entropy device external interface MAP 3ec84000 mode 2 pages 41 MAP 3fd2d000 mode 2 pages 48 MAP 3fd5d000 mode 2 pages 36 MAP effed000 mode 0 pages 1 kbd0 at kbdmux0 acpi0: acpi0: Could not update all GPEs: AE_NOT_CONFIGURED psci0: on acpi0 gic0: iomem 0xffff0000-0x10000ffff,0xeffee000-0xf000dfff,0xf000e000-0xf002dfff on acpi0 generic_timer0: irq 4,5,6 on acpi0 Timecounter "ARM MPCore Timecounter" frequency 25000000 Hz quality 1000 Event timer "ARM MPCore Eventtimer" frequency 25000000 Hz quality 1000 efirtc0: efirtc0: registered as a time-of-day clock, resolution 1.000000s panic: ram_attach: resource 7 failed to attach cpuid =3D 0 time =3D 1 KDB: stack backtrace: db_trace_self() at db_trace_self db_trace_self_wrapper() at db_trace_self_wrapper+0x30 vpanic() at vpanic+0x13c panic() at panic+0x44 ram_attach() at ram_attach+0x1ac device_attach() at device_attach+0x3f8 device_probe_and_attach() at device_probe_and_attach+0x7c bus_generic_new_pass() at bus_generic_new_pass+0xfc bus_generic_new_pass() at bus_generic_new_pass+0xac bus_set_pass() at bus_set_pass+0x4c mi_startup() at mi_startup+0x1fc virtdone() at virtdone+0x6c KDB: enter: panic [ thread pid 0 tid 100000 ] Stopped at=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 kdb_enter+0x44: undefined=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0 f906c27f db> --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Mar 23 14:06:17 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Pj6Zn0dNLz41Nxc for ; Thu, 23 Mar 2023 14:06:25 +0000 (UTC) (envelope-from 010701870ecab258-069e4aaf-c018-42d4-bf68-933a970b24d7-000000@eu-central-1.amazonses.com) Received: from b224-8.smtp-out.eu-central-1.amazonses.com (b224-8.smtp-out.eu-central-1.amazonses.com [69.169.224.8]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Pj6Zk68yKz4X3F for ; Thu, 23 Mar 2023 14:06:22 +0000 (UTC) (envelope-from 010701870ecab258-069e4aaf-c018-42d4-bf68-933a970b24d7-000000@eu-central-1.amazonses.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=cyclaero.com header.s=ez3m2wtglgbm5wj4q3hdyvc7qtjtqmlb header.b=Gx+SO98t; dkim=pass header.d=amazonses.com header.s=sokbgaaqhfgd6qjht2wmdajpuuanpimv header.b=Vmhojh+H; spf=pass (mx1.freebsd.org: domain of 010701870ecab258-069e4aaf-c018-42d4-bf68-933a970b24d7-000000@eu-central-1.amazonses.com designates 69.169.224.8 as permitted sender) smtp.mailfrom=010701870ecab258-069e4aaf-c018-42d4-bf68-933a970b24d7-000000@eu-central-1.amazonses.com; dmarc=none DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/simple; s=ez3m2wtglgbm5wj4q3hdyvc7qtjtqmlb; d=cyclaero.com; t=1679580377; h=From:Content-Type:Content-Transfer-Encoding:Mime-Version:Subject:Message-Id:Date:To; bh=NauibjQRuDJds6nmVHIcqcV2zScCAqi8OkZNpzYaZx4=; b=Gx+SO98tZYrSig7LAkqqWOUCnH6jBUG6BdaDDl1YWk5WaiVuFlDFtNKV5y6FR/4y EO47ZWLhTVzyV2DduYhVlZxPq8hdGUnvfpxfN3c+ex1mVPImelfIzkDfiUSL5oiVzRO PESGXUUN+QG7TgehHG57OAaExGQ591cylRyuc3T32JpQBPS0Sjtm8ARvM+9V0WbkVxW 3r0+9IjocOin8Qzs+ZgU9y7QVxzHJ3AdOXN2I+1SoFW5NSrk16tEdGI+bMgaEnjuX+O tpPQL+WMNuHZjcvop2xLh6lPaEre4WGkGXvxkKv0F9PKA1ZLFcIF/Yuduj4K7uIBgr+ uIZ+KCTEMg== DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/simple; s=sokbgaaqhfgd6qjht2wmdajpuuanpimv; d=amazonses.com; t=1679580377; h=From:Content-Type:Content-Transfer-Encoding:Mime-Version:Subject:Message-Id:Date:To:Feedback-ID; bh=NauibjQRuDJds6nmVHIcqcV2zScCAqi8OkZNpzYaZx4=; b=Vmhojh+HcJm7tpD3AiRuHCQ+p+qEOJ0MoDS6qmFcVQ/sPEVVLP7QyEOclSC/5Jla 04nhy2Vl2W7aSZP9OKOBWQ5XVz7kL6JWXQnMurFPgFXEM40GFjoYL/Sn8nSe5MoMzxA 3ihipP3SI805TW9QvaI6sOkgXt5BN2ZyDfo+TixE= From: "Dr. Rolf Jansen" Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.15\)) Subject: Would FreeBSD run on an Orange Pi Zero 2 (Allwinner H616) Message-ID: <010701870ecab258-069e4aaf-c018-42d4-bf68-933a970b24d7-000000@eu-central-1.amazonses.com> Date: Thu, 23 Mar 2023 14:06:17 +0000 To: freebsd-arm X-Mailer: Apple Mail (2.3445.104.15) Feedback-ID: 1.eu-central-1.i3TZMOZE/rJo3HQG0qvfyolMxXljeCj2Qj8Jp3rxK3c=:AmazonSES X-SES-Outgoing: 2023.03.23-69.169.224.8 X-Spamd-Result: default: False [-1.68 / 15.00]; FROM_NAME_HAS_TITLE(1.00)[dr]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-0.996]; NEURAL_HAM_SHORT(-0.98)[-0.985]; MV_CASE(0.50)[]; FORGED_SENDER(0.30)[freebsd-rj@cyclaero.com,010701870ecab258-069e4aaf-c018-42d4-bf68-933a970b24d7-000000@eu-central-1.amazonses.com]; R_SPF_ALLOW(-0.20)[+ip4:69.169.224.0/20]; R_DKIM_ALLOW(-0.20)[cyclaero.com:s=ez3m2wtglgbm5wj4q3hdyvc7qtjtqmlb,amazonses.com:s=sokbgaaqhfgd6qjht2wmdajpuuanpimv]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[freebsd-arm@freebsd.org]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:16509, ipnet:69.169.224.0/23, country:US]; RWL_MAILSPIKE_POSSIBLE(0.00)[69.169.224.8:from]; RCVD_COUNT_ZERO(0.00)[0]; ARC_NA(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[cyclaero.com:+,amazonses.com:+]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[69.169.224.8:from]; DMARC_NA(0.00)[cyclaero.com]; FROM_NEQ_ENVFROM(0.00)[freebsd-rj@cyclaero.com,010701870ecab258-069e4aaf-c018-42d4-bf68-933a970b24d7-000000@eu-central-1.amazonses.com]; RCPT_COUNT_ONE(0.00)[1]; DWL_DNSWL_NONE(0.00)[amazonses.com:dkim] X-Rspamd-Queue-Id: 4Pj6Zk68yKz4X3F X-Spamd-Bar: - X-ThisMailContainsUnwantedMimeParts: N Hello, For a new project I bought an Orange Pi Zero 2, is it worth trying = FreeBSD with it. I don=E2=80=99t need graphics and wireless, only = ethernet. http://www.orangepi.org/orangepiwiki/index.php/Orange_Pi_Zero_2 Any insights would be appreciated. Best regards Rolf= From nobody Fri Mar 24 07:46:32 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4PjZ6S5Jssz41Dcr for ; Fri, 24 Mar 2023 07:46:56 +0000 (UTC) (envelope-from sparvu@kronometrix.org) Received: from mail.kronometrix.org (mail.kronometrix.org [79.134.105.182]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mail.kronometrix.org", Issuer "Sectigo RSA Domain Validation Secure Server CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4PjZ6R6Lphz4JD1 for ; Fri, 24 Mar 2023 07:46:55 +0000 (UTC) (envelope-from sparvu@kronometrix.org) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of sparvu@kronometrix.org designates 79.134.105.182 as permitted sender) smtp.mailfrom=sparvu@kronometrix.org; dmarc=none Received: from smtpclient.apple (176-93-250-66.bb.dnainternet.fi [176.93.250.66]) (authenticated bits=0) by mail.kronometrix.org (8.17.1/8.16.1) with ESMTPSA id 32O7klDv008632 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO) for ; Fri, 24 Mar 2023 07:46:48 GMT (envelope-from sparvu@kronometrix.org) X-Authentication-Warning: mail.kronometrix.org: Host 176-93-250-66.bb.dnainternet.fi [176.93.250.66] claimed to be smtpclient.apple From: Stefan Parvu Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.400.51.1.1\)) Subject: RBPI3/4 onboard Wifi status Message-Id: Date: Fri, 24 Mar 2023 09:46:32 +0200 To: freebsd-arm X-Mailer: Apple Mail (2.3731.400.51.1.1) X-Spamd-Result: default: False [-2.80 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+a]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[freebsd-arm@freebsd.org]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:16302, ipnet:79.134.96.0/19, country:FI]; MIME_TRACE(0.00)[0:+]; TO_DN_ALL(0.00)[]; DMARC_NA(0.00)[kronometrix.org]; RCPT_COUNT_ONE(0.00)[1]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FROM_HAS_DN(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-arm@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; HAS_XAW(0.00)[]; RCVD_TLS_ALL(0.00)[] X-Rspamd-Queue-Id: 4PjZ6R6Lphz4JD1 X-Spamd-Bar: -- X-ThisMailContainsUnwantedMimeParts: N Hi, Do we have any progress with onboard Wifi chip working on RBPI 3 or 4 ? In our internal tests FreeBSD seems stable enough for RBPI 3 but the missing Wifi is a problem. No USB dongles are possible. This was reported a bit long time ago, during 2020. Thank you, Stefan From nobody Fri Mar 24 14:53:43 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4PjlZv3CwJz41g0W for ; Fri, 24 Mar 2023 14:53:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4PjlZv1DGjz4DXW for ; Fri, 24 Mar 2023 14:53:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1679669623; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=p8S11XMFmSjXCosp9Lp8VOqQuCCiYzHNRKpSH8a2j1Q=; b=DGsFobHc+htqoNQk5tPIrdVSfdxzj89f9iGHf2+pQHtsaSE3s4GMgUY6leJ+h7/pvNgFor rKzOCnM6s/2ErJC7lrinBiaNZw92uJnhv7342wxMwxb9I3RjzeK7m8X4nQiUVy0jUD8qwt v2bMVV8zPufcmdLloHSaqv8PD8WjIHcfP7pdqA5htLOUsF2CTy9BTyJSL8d8NxJ6ftmQYR 1/eIXxh8t/43ptn8SIy+sEOR09NZCWgbrMe8wxO1Lv2NqkMSfy0dgC72B0dO+W2CNiObPJ STUgFthUycpt/dKi1B9ir7pNW+ABrSAZSMTOd/KpgQY3WeQPsRbiDqt5BbGG/Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1679669623; a=rsa-sha256; cv=none; b=dsCeetC9fsA01uZoZbrS1JtQOkXLzKbR47j0ccTlpUqfRpXKktLXapnnLsYDHCDwAj27Ak aaJsCPuGDn7m37hzEGfjez4zspR1OYePHzderJclHXH6K1QLA/Oue8+UI55V/Gejju5CuU Zt4oofbQsQ+28BlfioaujnLfbIzy+K3EXt0B+Epyo3jqZyfShxsg0L3JJ7UHX63dF8O3st nUOxipw38bu8U+bQNyga0qm+TR0EZ2c4u8gopaWt8shflCYvHgbo139Kg4hPKqUnPrkd4E q/ErAqtP7d+I3PRUBgGUd7uR3PGXIHrlo6/WSD70AQ57wbl4JGNBYgvEjeWsSQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4PjlZv0HBtzMYM for ; Fri, 24 Mar 2023 14:53:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 32OErgMo080817 for ; Fri, 24 Mar 2023 14:53:42 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 32OErguR080816 for freebsd-arm@FreeBSD.org; Fri, 24 Mar 2023 14:53:42 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-arm@FreeBSD.org Subject: [Bug 270430] gpart crashes when used in a VM on Apple Silicon Date: Fri, 24 Mar 2023 14:53:43 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: arm X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: feld@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-arm@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D270430 Bug ID: 270430 Summary: gpart crashes when used in a VM on Apple Silicon Product: Base System Version: 13.1-RELEASE Hardware: Any OS: Any Status: New Severity: Affects Only Me Priority: --- Component: arm Assignee: freebsd-arm@FreeBSD.org Reporter: feld@FreeBSD.org If you try to execute the gpart command on an M1 Mac using the Parallels hypervisor which supports ARM guests you receive this error which breaks the ability to install: gpart: Cannot get GEOM tree: Illegal byte sequence --=20 You are receiving this mail because: You are the assignee for the bug.=