From owner-freebsd-arm@freebsd.org Sun Apr 18 00:05:30 2021 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id DF5425E76CC for ; Sun, 18 Apr 2021 00:05:30 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic311-25.consmr.mail.gq1.yahoo.com (sonic311-25.consmr.mail.gq1.yahoo.com [98.137.65.206]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FN9FP4Hq0z3kX4 for ; Sun, 18 Apr 2021 00:05:28 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1618704326; bh=YXOnka1/kc9V0vbSNVLhLrn7sMYsOkt+3aWyQTBijHG=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=Lr04u3scqATSDHxJS6U5v2YeqQXxZl5KbmQaEakGyvwpRpo+tTSLm616VgLJoVw4FrDZldMShloO3KAkarNZpyhDksdppV5uwIjlh4AU4QBgM4UnVas8rEFmWRjpLaTMTYUI8ZPON9TOpKY4JdL3OTZr5P2pijV7Is95j7zJQ75YS8+qaOn+3oFbXO5Lblg60KOZgH/LzpQTLcJA4NypK0UaW+aBFcvMQFWq7evcoGg1fwd3yarxqw4EtDxTskwigWNFim5OehKbJDvQgD1E2Ard+B748fIrARxQrOrDzorrDIyIcqY8ZMDDM1+/gZNiFr0DESqGZpn0S1XenjBomg== X-YMail-OSG: A7xkQkAVM1l0Kcp8EMLb5v3mocm87H6PB9m3lf_PD33GKCK5fFaVDD2BJw72N86 SN_Oxa1ugrHvONr3MHhlNmHZZKMeEaAIb8obluRbS6RlRCNDNZa0hYsGi1UWW5aLew0rBE4aYrPv qj6cEqesPG7HvvaaSBHgaanjbVTsRDZqB5G6hKhDrGbiX2kzLVqqK90.PozPC2mwwcRqFNZtEREH UtOndjZVsPD9IOisVFh4LqdIXGrGvt9O3gDd5Sa0ztVDPm_vexlGa8A2FVGWRwBJ2n3aTAWEaQ_V Qt3wOG3CNEXZPiYYHWQhKOLqDcbZInya01lKJ7syjQIhGfZLCW7zCo.Uq4eoVG8tm3Idj9v2guSz iAX7xXZZB3BMcci_TcIaftLaRs47J7UJB5UR4EDFqWNAWjx544nzK6jSB76oBuWqf2O60marnN_Q Hw3RdU2aZStoldOcyNYBXc2rfMciLyj8O8ltun7PcbhoEHVLCJRn2nnB9x6aTT3QQAntcFyvJ9ii nyD.CwGrMwHEvCXO_L8HTzYeN2bekXIeRWWV1RApRFVHJyJxzcBFY0iM0a.AN.tM9zuoudVRchAl UZgRV09YT4n1jpxSreQ4EAw69AFo3xvqCnhMokP8FWCasDbO.sGYwMwXVaHiilG142wDYyIOQWiL 6Nv5A9pWblYoztgXdlxzMHUwv11vSBzUnx3CUKUXtf7s.A7QJnKiAt3T9a_mlryewsNhxPyzn2LJ ZzW2zatfgoY8Zeov0jV9YTflMuVwydDpvHP5JrZUzpSDJaA9C6OBsr3ndZYEEjQTzsgREUtfRglg HR.fzJqx_qSn2IEOMtiNUdXiTnplWqAgMid79BGpUsD8EXmp5EDtTUKl2_zHe.Ku0ZrZgmmr5fO7 cvdkYIpdRgkFeSkJh.5wilCqyUUVOGhZcO1CKCSIzM4Jb7cG6sF3MvQA2U3.hrEqbls6euP2zfuE 7yqng7ij9Hok6aWScXoHCPasRlSSAoe6_LSq_dIDV0eAT7ZoTi1.oZ9pTMsvDLth4fB1q6ypyq1I ggjGMAmd51_0_AZJZNZHRv0vMLnt1nrxGeaMALk7vT9AZlq66edY1qXk_ZCECz6ZCwDTx.f.S9w_ haa5wrPUxBn0mk.XXlHyj8j6aB.iHrhfwuuA9wSgtCRpqWjvuFbS64kYxkKkwkV_N_1f0iO7EFTd vWRkY3hVoj0spBGv59MpB9az0_XmeLIDX3MXSPf58SX4Yt7FhaLr74QftBjaZq6mCaCd1KM39BQr V2HXC05joEw00Qc62KdCDXjLl8s.yrTqKkvbhopkhrwX7X100qFJZN0n_DMiaCtF2ybbjyRMIdwu tYK0YImBerN65NU4Z7JhCch_W3FZ5RQeZyj_M7AREmAepbrtj4EOSQJ2JgmySCtBzhlEAub_xMh5 kGU_BItRq6Frh3_7JNXW2SJVZE5Ysm5PIS6oHUh086UgRa1xFcJqC_MG5NMVTyk8rov_hI43ORGq cKGfc2O_4lWVOLjR2dUBMQOvYVGJZ9y1alBQBRWCNa9XpFev1YyVNp3wR84Yssv5wccrzdw2g3js CoABq0Q4w48_FFx7Zd8d0uJYrivofs5Hg4bd73WgfXRZyJsgfQm7QwDyOCv8YrrU7OeTuTRpg9Qo hw6IsZ1P2E_mhTvLDhcJ7yk.9o7qjaYEZNLuh6EOE_88cHqKFEJTffRcIit92AAt_K0dQqDem21. wIPP0Q.jja6T8gmghNYTHUGj6SrbUhyBlduvrRepkTOdVd7gc3EaVkayUwfgl0yzQgGk28qf4EFV ehsqD4yEZePdnMeF4lXGeZmIBmpk3jag7aMD3gVZj6ZmSqJauLhwK0LmZqYl8KDy1W99mtJVXxjN E39PACmHgaTdDaOzU3Xjzx0qY6sDUp6q7lIZXsjR.sYNyvRKFJ61l9J2Hu4bQ7uNIZGgUOuzRgqM WRCR_joBY6_sWgNy9gH0xUeAdtlCyRjD4ifrwuKy90QMivnO.huizSbt_vfPlQBuSbkX_kz.GKPv 2D8jFrZ4Mj.HHukepNKKsv6CDijd0355txq4nHT2OAXzZX6EkjaG3Tv1MoZmSsjH7qRGD1H9iQvV k7J9EypxOef_bxJBFpx72JAMRjmOcQ4BIFRfp3AItlp5ki6r_hVplMbqSBuqbchjtZpMPkT5WhVR uQZEELxZo7AlpvuBtHAo5Na81arxIHGZSTubD8hFOUjKLETTWwVxrAMe3LQiSAkP63xNwMmCrxM3 UKiETcmRNQUvdLN50B1qNXbEa05g.yh5lTbaAu0o0DVV41S988hgBg1XsSFLMnl8SGyN0anWb0dg RxuFugMJTkKiwTM5.oYA6LfZSpvLoYXDkHIJw_csYaQ1tTaE04Jvr2JWzE4ofIIFAGirfXI.kqOI WyrFGe1lmkKumgs4WXzq7ycR1z2YKB6wE.uaOZQMj0J7V5DVMVCXwZfkpjLEcPN6DSR3q0OAQ8JC 2lMCs9BhbYx9nWAndgajIxsja2p672h4bgonF2VqN6F6mL0LWgKvYejY3xqi94KXxG1ZeeUplTeG B4ZssJH4saJ70pLUgFASn5EsnmtRLgEA3Pkym_d3fd1HzFTFu5A4oaVxGSt540FleyZaq1skgb.7 niMJRrUx5uWj6IlpISv56nzq6VTscMCvWbhSxY_wSHn0QHGSU71jKOMF.DRPDOrp3yFdCoP0HpPt FPeQGySjTUQF9TzmP7wXondd4jBLjwMJATc4kR217dmbnJ0asTOtVK6kLAzwt7A-- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic311.consmr.mail.gq1.yahoo.com with HTTP; Sun, 18 Apr 2021 00:05:26 +0000 Received: by kubenode513.mail-prod1.omega.bf1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 32e1081d5ce91d6e591ceb594afddbec; Sun, 18 Apr 2021 00:05:24 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: [Bug 255080] U-Boot build for Raspberry Pi 4 (arm64) does not boot from MicroSD card slot [U-Boot timeframe problem] From: Mark Millard In-Reply-To: Date: Sat, 17 Apr 2021 17:05:21 -0700 Cc: "freebsd-arm@freebsd.org" Content-Transfer-Encoding: 7bit Message-Id: <97783A23-51D7-46EC-B35A-CF52957FF3CB@yahoo.com> References: To: bugzilla-noreply@freebsd.org X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Rspamd-Queue-Id: 4FN9FP4Hq0z3kX4 X-Spamd-Bar: - X-Spamd-Result: default: False [-1.60 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; DKIM_TRACE(0.00)[yahoo.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[98.137.65.206:from]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; MIME_TRACE(0.00)[0:+]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; NEURAL_SPAM_SHORT(0.90)[0.900]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[98.137.65.206:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.206:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.206:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-arm] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Porting FreeBSD to ARM processors List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Apr 2021 00:05:30 -0000 [In essence my Comment #14 material but for a wider audience.] Comment #5 (the same one that indicates 2711ZPKFSB06C0T as the part) also reported the earliest mmc0 error message from what I can tell: QUOTE scanning bus xhci _pci for devices... 2 USB Device(s) found scanning usb for storage devices... 0 Storage Device(s) found Hit any key to stop autoboot: 0 switch to partitions #0, OK mmc0 is current device ** No partition table - mmc 0** END QUOTE That text is from U-Boot, not from RPi firmware, nor from FreeBSD's loader or FreeBSD's kernel. In other words: U-Boot is having this initial mmc0 problem. It looks necessary (but possibly not sufficient overall) to have a U-Boot that knows how to deal with the model of RPi4B. There is some possibility that the .dtb files from the RPi firmware contribute to what U-Boot is doing and might also need updating. (I would not expect this.) This suggests that testing using 2021.04 U-Boot instead of the 2020.10 U-Boot would be an appropriate substitution. Unfortunately, "pkg upgrade" on 13.0-RELEASE will not get the updated sysutils/u-boot-rpi-arm64 materials in /usr/local/share/u-boot/u-boot-rpi-arm64/ to copy to the msdos file system. The updated U-Boot must be created/copied another way. So, if someone that has hardware that has the problem and is also comfortable with getting U-Boot 2021.04 in place on the microsd card, an attempted boot of such a combination would indicate if the microsd-card-in-slot boot gets further along or not just based on the U-Boot update. === Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-arm@freebsd.org Sun Apr 18 02:43:22 2021 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 6B51D5EC83F for ; Sun, 18 Apr 2021 02:43:22 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from out4-smtp.messagingengine.com (out4-smtp.messagingengine.com [66.111.4.28]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FNDlY3pZGz3sSg for ; Sun, 18 Apr 2021 02:43:21 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from compute1.internal (compute1.nyi.internal [10.202.2.41]) by mailout.nyi.internal (Postfix) with ESMTP id C7BAE5C0109 for ; Sat, 17 Apr 2021 22:43:02 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute1.internal (MEProxy); Sat, 17 Apr 2021 22:43:02 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=zyxst.net; h= date:from:to:subject:message-id:references:mime-version :content-type:in-reply-to; s=fm2; bh=25R9g94xvhmrm7WfC2PW1DjMqSe 8wScdm21mSFPlMH4=; b=k5OJYUy99mkieRWpqjaGXxEqO9lSxMlphwAOAXGmJPc 2dTGUmmSZfR4dKTcixDzKFmdwbCzt6lmU+Wp0St1rlLYqYpiW5oGi1uUSM1XzQ15 M7tRmMhSAJG5GC99vOMJc31qnBc9L7h38r88elNoOID4C0gvoIAu4wkZdshSzj8+ FW0COAbvw+hRKfVryDo2Cqigba74yFk2FiQWacWZNEeSaUqYOH+3LKRA4p73r14z NgGO7xUl/CZL1nHC2XmOWl1teUbEJJCLLupSB38PBaXedp5iPpik5qws0n00nPs6 2k7ov/43k1LG2fcHdRlFkD5pVFteisuNZnMkGX6+1Pw== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm2; bh=25R9g9 4xvhmrm7WfC2PW1DjMqSe8wScdm21mSFPlMH4=; b=uPipOsshCzMZcZGyaliyfK uVjKpXiKDzo7t1VaoXR/kbMFtb/Og2S2X5ystnOkSeb2ZZptsozvr96hZBZCYsrS wx/okxSDkf31Ea7CzHTMCKVsNWTkiWtkHc3HAivIa8BM90Wv9HFaM3HJhBN0MrYf xsKgm4c7PsfhxROkrH/cQfXD/HvimJ04RZ7alkyb9CM+Geu5RtBtrndg9RvSOS7x dI2QscHR7cs2jnzyV5YP1y5tdikKi13ju+eeNSoTppxmGnR5Io7ELsCGqLzpIIJY pcuFmFQTxToG61U++5RWw+Do/a7IOnpaB9yhbGu1ZOffhc9SbpEr8kUQnkobFKuA == X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduledrudeljedgiedtucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpeffhffvuffkfhggtggujgesghdtre ertddtvdenucfhrhhomhepthgvtghhqdhlihhsthhsuceothgvtghhqdhlihhsthhsseii hiigshhtrdhnvghtqeenucggtffrrghtthgvrhhnpeettddtudeugfeggefhkeekteekje elfeffleehjeffgffftdeffedtjeegueeiffenucffohhmrghinhepfhhrvggvsghsugdr ohhrghenucfkphepkedvrdejtddrledurddutddtnecuvehluhhsthgvrhfuihiivgeptd enucfrrghrrghmpehmrghilhhfrhhomhepthgvtghhqdhlihhsthhsseiihiigshhtrdhn vght X-ME-Proxy: Received: from ceres.zyxst.net (ceres.zyxst.net [82.70.91.100]) by mail.messagingengine.com (Postfix) with ESMTPA id 3B8A624005B for ; Sat, 17 Apr 2021 22:43:02 -0400 (EDT) Date: Sun, 18 Apr 2021 03:43:00 +0100 From: tech-lists To: freebsd-arm@freebsd.org Subject: Re: RPi4B 2711ZPKFSB06C0T parts seen in the wild, 13.0-RELEASE fails to boot on them Message-ID: Mail-Followup-To: freebsd-arm@freebsd.org References: <05740E83-5A45-4944-AC87-629D21D7F579.ref@yahoo.com> <05740E83-5A45-4944-AC87-629D21D7F579@yahoo.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="UJ9utMbJ+ouIYJZN" Content-Disposition: inline In-Reply-To: <05740E83-5A45-4944-AC87-629D21D7F579@yahoo.com> X-Rspamd-Queue-Id: 4FNDlY3pZGz3sSg X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=zyxst.net header.s=fm2 header.b=k5OJYUy9; dkim=pass header.d=messagingengine.com header.s=fm2 header.b=uPipOssh; dmarc=none; spf=pass (mx1.freebsd.org: domain of tech-lists@zyxst.net designates 66.111.4.28 as permitted sender) smtp.mailfrom=tech-lists@zyxst.net X-Spamd-Result: default: False [-5.70 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[66.111.4.28:from]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.28]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; DKIM_TRACE(0.00)[zyxst.net:+,messagingengine.com:+]; NEURAL_HAM_SHORT(-1.00)[-1.000]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[66.111.4.28:from]; ASN(0.00)[asn:11403, ipnet:66.111.4.0/24, country:US]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.28:from]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[zyxst.net:s=fm2,messagingengine.com:s=fm2]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-arm@freebsd.org]; DMARC_NA(0.00)[zyxst.net]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[66.111.4.28:from:127.0.2.255]; MAILMAN_DEST(0.00)[freebsd-arm] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Porting FreeBSD to ARM processors List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Apr 2021 02:43:22 -0000 --UJ9utMbJ+ouIYJZN Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sat, Apr 17, 2021 at 11:08:31AM -0700, Mark Millard via freebsd-arm wrot= e: >https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D255080 > >comment #5 reports a comparison/contrast of 4 GiByte >RPi4B's with: > >BROADCOM >2711ZPKFSB06BOT >TE1919 >045-23 B3 W Is there a way, on both linux and freebsd, of reading this information other than looking at the writing on the chip directly? thanks, --=20 J. --UJ9utMbJ+ouIYJZN Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEE8n3tWhxW11Ccvv9/s8o7QhFzNAUFAmB7nKEACgkQs8o7QhFz NAUG1xAAiM+l5kli0UeaY+eoU8TGLbCQCyo2IqRVQT8J8mJPF3mDNJY9lIbvNxeF 7A5rgtx2S2epf66ff2siI3mn0SFf4V43CNM3tfBqPDTJvDqBJguTnML09NBWiSrw DlPcXP7vOP7Noc/RLsBDylwoauVnlODOrUp6h6cH7XCr92XCUEGiq9pUH3jNrNUk MDKbqNVlUn56tvMBJc6ZGPOiBcVRCvgS2chDFNXcMqfezn5eQ9vEjgvFAy96gHqf Ywcm+1mNrdVWVN8MD1jadHMx7SOMZK6mOdm2TnyffnzduWSC1zk/uZG+epuk8puU LKHvekfo2CSdMeGgkMhMolFr00fBLPJYpBfw1yCtx/a+MCdIfiIKDG9Zxb45B/VX I22rzFmW2ygYStoQ2qPd41xAVbm/lvswuQY76xGp0MrmlMTRQ/XaknUYNDpmqlje lF8j4N+5gtfAVm0oF0nURXOdcp5QQw0NkYPRPblxaXaL2uYlbE+t9VQ347BuiHol oM69VAf7kEseFlRI0VN7olzZ23ww+A143knbTvcKhL3vB6sLWgzfxP/HsxvkZPGB loOZxh5sJnNCSR5WbCefyEMdzlUFTZSkE3VEadDdP7O0Ybo8wXMR4Qdu2v0xJPC7 7IDMCTLl2H+8nYZW8SDu10uBZUpsr7nVADvLX3w3JKgQ4eG+Cbw= =OEvv -----END PGP SIGNATURE----- --UJ9utMbJ+ouIYJZN-- From owner-freebsd-arm@freebsd.org Sun Apr 18 03:04:33 2021 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E20C05ED514 for ; Sun, 18 Apr 2021 03:04:33 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic304-23.consmr.mail.gq1.yahoo.com (sonic304-23.consmr.mail.gq1.yahoo.com [98.137.68.204]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FNFD06fc3z3tTs for ; Sun, 18 Apr 2021 03:04:32 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1618715071; bh=zJfsxT5W64nKGfk4mDZ0iSme835D+nVLX6D9s/6fPSO=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=K8A/jbHNDCXb/tbh3Rgn7t3mCDKN9adRmYGncbVe79V6P/Pppql6TPbjKP3Aa0Te+YbKYR9FzB2m3t7VYb5ir5lOpHDPmIFhfBcca/yB2fBuFnB9wCmwGICk4ugv09kPT5OEEtShnlW2k5uWoG2k+uXwk+M/v8ZV+90ZXsJwWcWK0wERCLYeb7726tA3sJD1lI/s1MHpE0IM0VnBo1xLoYsbgSHErD4tsBks+Fru5mdpyDdgGcIDfh4xIzlFM1FYD1J9dW/agW1YJg0wHmXa6u8DymrwVioxRuA4c1ZBWUEE0EeD4H3GzY6UeGse22+etPtrzGGIp1gzuDSQlqPPRg== X-YMail-OSG: MKKqxlkVM1l9CHFVy5J8doStSos_5B67wLKul9ZVXR2JaJvwwNLqrTWUG9dMGPR AzIRLMTk4KAADmybxQ7.HHVQu1koggBHpl7tQOHKdEgdCPx.ywSBXObwE02Hm3FCLGB70kRAFtjx LzS4ufFb3OcfZAurjwcJOIcaM0sp945BdGLULXmmNGlvlgevsUCVP2TvvTVVMEjN.mVDMo3.8zJf MVa_kdQlBY3v.ulSN7N_Q8yCN3q1TOG1P2k1ub1UmdwsHHDUw8eula_cy9PG2W1VoO6diVAGzpP8 stkSLBVCLhsnRo4y0Rjv3r.2o1OqSGvmhtHJwtz2xVjYMAzYIxIcmm_N2MKq26gKOR1IK9HWhxse 1oYhPzJtb9t1lTRzx6T4J1cRjOyQc1TtsOvoL2xN5kvBtIoDMmB6zCppYL460ftoAQADqlVGajhf 8aLMQlhEKvxCUnHTEyQvLAV29geFhfP9XH67kzQ5.sKhLtt5b3gfaRJgQ7dySC5v1HuQBlXnLkaJ JoZhT0JND6hWYqlUgCAluV9m5b0dm.b76qUaxbiB8atWkbajwgqHlbYbgZV_4_IpJDK3wAJ2UinP cnJalPd2RuawKyFKHLwvIk5feBu3V7HhUfY7NWi84WUborQ.bYvBIAGCfyMSP1UP_7Q4x.0DFW_N cxqqi8UkyrgHZdlgmsnN5sIKMJY1vbjzeZyqbf5avgbmR4BRZ9vfY8rTpw101GiLpbnZT4clXZhq hfQFUbeBPhwhnz1BeLBVlTQkmm3EyHC1s4YJ5Ve6FsT_b6ZDFOMV2R5KHvcygHy1Q9Qr7NVUcD6n LDWHaoZRtJIF64B2hL9iHE7ni8SbFqE5VY57nA8YlGlUQ.Klcst5GFiYMLFIBx89cBdhH0ZSFt9z TypljIYHieyBE07fijukaJkmGbZOZqJVABNtfQRXEeoaD.0Qps1rGoVfnrYNGLUerzDCltwLVYt0 9rcwqpF9nxXozoZtLyHRTxIWJbyMX3IaV7CU8_0M4TeHUclY4JS8uff.uAlxmIWB_j00UpIEHM3h JQaHlz1p.YIlP.UBxdK3o9J_fC5O_A1sdGC6W0IWbGPP4yWx98aYe980oDVQyBoOyEaZDzfCZ7Wt fQdgSNGmfabyg13uFxNisix_qm5TPTXKVyqRJC779xxzUQnTCriNrdhx4iK9KHdwOinJBHfR9lEG 1VwMNqKf6f1S092LOcFs7ujrC_7Ejl82AP9uCRdqZV.dC_jIcvmQudktzlVk_CWxFTB1aW7a.BSL 4v3Wq3pWoYKqBew_vj0V0jKYDN6SSWjFL_dkmXrBnvtzy0o7CM8hwfO_UBfn77uq1LVbQTZjrVPJ yoTc5P6_tRPBqbu9NMrzrRbksAFXc2w6qeOaaGvOr3vIVhPTU3n7h3nFzuqEdHTvkau8e2qBWAc6 yVw6EYcOT_8WgYCwayblNUZe5W8gYz7U55.kCpYCXbWjTmoU8BQ0GGA6Abv1iz_yq36EUbdX.mo5 XA3CSgyKTsweSb2ypMMudN12mzxYgwfYlklsJMKWw3nlDaOx.7Tq9vm3oCaCPRQA_cnkDA9rFzCl flCOfRc17nd.6nMzDdS_mJyHa4jLZ936_Zn4RG6iWjIkjOznF6YgS0E8rgCgFxFeO29NqjssCY7I M801gVuuJubC6od9RcIYOgr.iR9BK7PHJNjv97FOmn_ZTYcOYAD1J8qF5NDw26fEvG1zczWHXJrk WWK3rrM_ExkOSzy92GgF__4s5ucTh8_dqYXk40fkynPvKByD60uohOoS_kwGU7SwDwuw.1nbEQcU chKp5rFtD.viJ_g76FtRfmL8xITMx_vuS_cOri3_pnSNANrpaZNjkpn8UUzemibhXo3FBaic_IOY h3b6UekQfQMyM_wgn4hbHWbZ3xeZCwyilpPOkg1SrszSv7Ppvw93LxrRIh0JjImAkNAPn.Cx3a9E yelSsE22zLi_lpW4YDf6GSrGfoUWdjzBBnkveB165D2M63HFhvIQHkbExpBB6C38uAkTg6v0PvnW YRg1b67PMITRi6El0Ve3IzE6y8KeNTAuhwukJls6E3Uz4NDluR1wvHHQ49Sc1cziJZiae3y0Ki_R uKles96reGxMG6o3yZu6uVJz.GY5mR6UJPl.ypf3.oCJ5MA0.t2qtu6KR3b5bRASZo2jnxc2iuYR mILtAVqKxijKw8dUO6Y3yFyHcR0jiLVsc4ale.O758WGE2wKdRjPgUhkF4MK0fe_wyTZM9mBu1hO NQV0SlaVEHXglTJ7eczzxrHljI3ESBYwK3DAmakrfCYUdoouXK3J9TK7gVXumRGXou_sCgKVVg4z ifdWSyMMpvkbD.kf7lYOAle1YqfhVKGYWp3h8CwTSWzLpe2dxO0_G4sKHdMWCZUmPGOe5cxkIzVO SRUoWAr7k_3L8jmh6k_V3kg0vcjV6bTMpuk2KFfPGnB7OQDDv.j9cVFDjz8YnQ9qikkhk9wCWqBM QOtnFP6b9APWFYy8FuOZbBPQWCoZ4Kb3vUuj1anJzjxZrrzJMe2MpIkhULQOXUXCybKDH5bzxv2m 8YWhWN9ulOtZPrlOSydlnU3ccp7ZdyWiL7dpWaTi9.pD7ByH3.ZXNCdROhTWLuwmXFcGbk7hr1Ht WbN1VS..EmqrypkeBeyWTVJuFOHJpph6GsInJ X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic304.consmr.mail.gq1.yahoo.com with HTTP; Sun, 18 Apr 2021 03:04:31 +0000 Received: by kubenode506.mail-prod1.omega.ne1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 6e488f6310892f4b816c43efcdc44358; Sun, 18 Apr 2021 03:04:27 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: RPi4B 2711ZPKFSB06C0T parts seen in the wild, 13.0-RELEASE fails to boot on them From: Mark Millard In-Reply-To: Date: Sat, 17 Apr 2021 20:04:26 -0700 Cc: freebsd-arm@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <39AB95E8-AC86-465C-94E6-C2B8040EB45D@yahoo.com> References: <05740E83-5A45-4944-AC87-629D21D7F579.ref@yahoo.com> <05740E83-5A45-4944-AC87-629D21D7F579@yahoo.com> To: tech-lists X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Rspamd-Queue-Id: 4FNFD06fc3z3tTs X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.50 / 15.00]; RBL_SENDERSCORE_FAIL(0.00)[98.137.68.204:server fail]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; DKIM_TRACE(0.00)[yahoo.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RBL_DBL_DONT_QUERY_IPS(0.00)[98.137.68.204:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[98.137.68.204:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.68.204:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.68.204:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-arm] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Porting FreeBSD to ARM processors List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Apr 2021 03:04:33 -0000 On 2021-Apr-17, at 19:43, tech-lists wrote: > On Sat, Apr 17, 2021 at 11:08:31AM -0700, Mark Millard via freebsd-arm = wrote: >> https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D255080 >>=20 >> comment #5 reports a comparison/contrast of 4 GiByte >> RPi4B's with: >>=20 >> BROADCOM >> 2711ZPKFSB06BOT >> TE1919 >> 045-23 B3 W >=20 > Is there a way, on both linux and freebsd, of reading this information > other than looking at the writing on the chip directly? I've never noticed a reference to a way to do that directly. In some cases you can infer from the RPi revision code's "TTTTTTTT Type" field that it should have C0T (or later?) parts: The 14: CM4 and 13: 400. But, for this new example, the type field is far from sufficient and we can not be sure that even the whole revision code would be sufficient. Some B0T parts might have a b03114 revision code for all I know. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-arm@freebsd.org Sun Apr 18 13:32:39 2021 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id EA9615E9A3D for ; Sun, 18 Apr 2021 13:32:39 +0000 (UTC) (envelope-from denis@ovsienko.info) Received: from aibo.runbox.com (aibo.runbox.com [91.220.196.211]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FNW8k4vQxz3RCg for ; Sun, 18 Apr 2021 13:32:38 +0000 (UTC) (envelope-from denis@ovsienko.info) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=ovsienko.info; s=selector1; h=Content-Transfer-Encoding:Content-Type: MIME-Version:References:In-Reply-To:Message-ID:Subject:To:From:Date; bh=kO/pNK88Nsh9uITjc6PDIBcsxUspqt4UtNfeEvWIoxM=; b=UvtOKVhSNVd9m8MlNjdma/iKMK 92OMHiPCwbM8jpVDozkES38ze9YJaokRP03HaIPFHC4H74NZQ3zHk7q7YIMniT7+1HmEIe1QHC15i 4aswniOF1iV3NMeBrKucTlPzwj2eicrgl7ONLuTdIePbP49opohn4YA94t3SI40JI/O67CsyZRpSI /pgp93O23YMuS75vZLtiWiSDe/sDG4BKmJiczlNpubgkbAj3RB+/9/n72NKIJmzqFGHtQMx3Th1r5 eaBALZnoTf7wvWCd8Y0pUc51FZSk1IoiZ/1uhAcv1ukJDZsZ7N0tpk4Fy1gJnk2ZPigq42MXehOIm GU6Gqo9g==; Received: from [10.9.9.74] (helo=submission03.runbox) by mailtransmit02.runbox with esmtp (Exim 4.86_2) (envelope-from ) id 1lY7XP-00074O-Nt for freebsd-arm@freebsd.org; Sun, 18 Apr 2021 15:32:35 +0200 Received: by submission03.runbox with esmtpsa [Authenticated alias (984599)] (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) id 1lY7XM-0003LZ-AW for freebsd-arm@freebsd.org; Sun, 18 Apr 2021 15:32:32 +0200 Date: Sun, 18 Apr 2021 14:32:30 +0100 From: Denis Ovsienko To: Mark Millard via freebsd-arm Subject: Re: RPi4B 2711ZPKFSB06C0T parts seen in the wild, 13.0-RELEASE fails to boot on them Message-ID: <20210418143230.573a968e@basepc> In-Reply-To: <05740E83-5A45-4944-AC87-629D21D7F579@yahoo.com> References: <05740E83-5A45-4944-AC87-629D21D7F579.ref@yahoo.com> <05740E83-5A45-4944-AC87-629D21D7F579@yahoo.com> MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4FNW8k4vQxz3RCg X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=ovsienko.info header.s=selector1 header.b=UvtOKVhS; dmarc=none; spf=pass (mx1.freebsd.org: domain of denis@ovsienko.info designates 91.220.196.211 as permitted sender) smtp.mailfrom=denis@ovsienko.info X-Spamd-Result: default: False [-3.10 / 15.00]; ARC_NA(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[91.220.196.211:from]; R_DKIM_ALLOW(-0.20)[ovsienko.info:s=selector1]; RCVD_IN_DNSWL_LOW(-0.10)[91.220.196.211:from]; FROM_HAS_DN(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[91.220.196.211:from]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:91.220.196.211]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[ovsienko.info]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[91.220.196.211:from:127.0.2.255]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[ovsienko.info:+]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MID_RHS_NOT_FQDN(0.50)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:50304, ipnet:91.220.196.0/24, country:NO]; RCVD_TLS_LAST(0.00)[]; MAILMAN_DEST(0.00)[freebsd-arm]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Porting FreeBSD to ARM processors List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Apr 2021 13:32:40 -0000 > The C0T RPi4B should be able to DMA outside > the 3 GiByte limit that the B0T ones had: no more > limit. The RPi firmware may configure the C0T parts > differently and FreeBSD might have changes > required if it is to work with the newer parts. As far as these commends make sense to me, the foundation has started shipping RPI4B revision 1.5, but forgot to bump the revision number up and to update https://www.raspberrypi.org/documentation/hardware/raspberrypi/revision-codes/README.md If that's the case, it might be better to solve the problem at the source rather than at run time. It may be more effective to raise this through the shop, as the foundation does not seem to have a bug tracker. -- Denis Ovsienko From owner-freebsd-arm@freebsd.org Sun Apr 18 17:42:25 2021 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 79C195EFF72 for ; Sun, 18 Apr 2021 17:42:25 +0000 (UTC) (envelope-from fuz@fuz.su) Received: from fuz.su (fuz.su [IPv6:2001:41d0:8:e508::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "amnesiac", Issuer "amnesiac" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FNchv6mYsz3t0k for ; Sun, 18 Apr 2021 17:42:23 +0000 (UTC) (envelope-from fuz@fuz.su) Received: from fuz.su (localhost [127.0.0.1]) by fuz.su (8.16.1/8.16.1) with ESMTPS id 13IHgFYE014016 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO) for ; Sun, 18 Apr 2021 19:42:15 +0200 (CEST) (envelope-from fuz@fuz.su) Received: (from fuz@localhost) by fuz.su (8.16.1/8.16.1/Submit) id 13IHgFvG014015 for freebsd-arm@freebsd.org; Sun, 18 Apr 2021 19:42:15 +0200 (CEST) (envelope-from fuz) Date: Sun, 18 Apr 2021 19:42:15 +0200 From: Robert Clausecker To: freebsd-arm@freebsd.org Subject: Re: RPi 4B USB 3 support appears to still be broken in 13.0-RELEASE Message-ID: References: <6D2C75DF-796D-4CC9-9740-A8C15C6A6154@yahoo.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Rspamd-Queue-Id: 4FNchv6mYsz3t0k X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of fuz@fuz.su designates 2001:41d0:8:e508::1 as permitted sender) smtp.mailfrom=fuz@fuz.su X-Spamd-Result: default: False [-3.21 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[2001:41d0:8:e508::1:from]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+a]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-arm@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[2001:41d0:8:e508::1:from:127.0.2.255]; DMARC_NA(0.00)[fuz.su]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.91)[-0.915]; NEURAL_HAM_MEDIUM(-1.00)[-0.998]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:16276, ipnet:2001:41d0::/32, country:FR]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-arm] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Porting FreeBSD to ARM processors List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Apr 2021 17:42:25 -0000 Hi Mark, I was able to test the RPi 4 with a different hard disk (spinning rust based) yesterday and everything worked fine. This is getting super strange. The problem seems to occur only in this specific combination: * the specific drive I have * attached to a USB 3 port * on the Raspberry Pi 4 * trying to import a zpool from the drive If any of these four parameters is changed, everything works just fine. Including cases where... * I use a different drive * I attach it to a USB 2 port * I attach it to my laptop instead of the RPi 4 * I do some other IO operation on the drive or use a different file system Though at this point I would be surprised at this being a power issue. The spinning rust disk probably takes way more power to start up that the SSD could ever take in. Yours, Robert Clausecker Am Sat, Apr 17, 2021 at 10:47:56AM -0700 schrieb Mark Millard: > On 2021-Apr-17, at 05:36, Robert Clausecker wrote: > > > Indeed I use a case with fans. (specifically a Joy-IT milled aluminum > > case with 2 small fans). Apart from the fans and the boot disk, no other > > peripherals are attached (using the serial console to access the system). > > > > Detaching the fans doesn't make a difference. I'll try and see if I can > > find a powered USB3 hub. > > > > It is surprising that the RPi4 is supposedly not powerful enough to power > > a single M.2 SSD in an external enclosure. What's also speaking against > > a power issue is that the drive works just fine on USB2. Perhaps it's > > some sort of bug in the XHCI driver when too many IO requests are > > pending at once? I'm not familiar with the specifics, but I could > > imagine ZFS being more demanding in this regard. > > > > My offer to send you the drive over so you can reproduce this for > > yourself stands. > > I have access to official RPi power supplies, as well as the > 5.1V 3.5A ones that I actually use. So there is some chance > that I'd be able to show a compare/contrast of working vs. not > on the basis of that power supply distinction. > > If the problem is not covered by the power supply issue, I > more likely would manage to repeat the problem but I'd be > unlikely to be able to analyze the problem, much less > provide a fix. Still, a little would be learned if this is > the type of error. > > My co whereabouts is West Coast USA, however. To me, > shipping the device around the world and back for just the > above seems odd. And it might have problems with timing vs. > where I might be some of the time. I'd not want my > whereabouts constrained if I finally get to do some > sustained visiting. (I seem to be talking myself out of the > option.) > > > Am Sat, Apr 17, 2021 at 05:07:28AM -0700 schrieb Mark Millard: > >> > >> > >> On 2021-Apr-17, at 02:29, Robert Clausecker wrote: > >> > >>> Hi Vincent, > >>> > >>> The hard drive is an M.2 SSD in an external USB 3 enclosure. The RPi is > >>> powered using the vendor recommended USB power brick. It could indeed > >>> be a power issue. I'll try to figure out if there is a way to supply > >>> power to the disk externally. > >> > >> I use 5.1V 3.5A power supplies instead for the RPi4B's that I > >> have access to. (I use a CanaKit model of such.) > >> > >> The offical RPi power supplies are 5.1V 3.0A. > >> > >> I also have heat sinks and each has a fan as well. (The > >> case styles vary.) > >> > >> Some USB hubs backpower/backfeed over the connections, > >> bypassing voltage protection. But I use a hub if I'm > >> going to have more than one USB3 SSD attached. The > >> keyboard (and sometimes also: mouse) that I use does > >> not draw much power. Adding the keyboard (and mouse) > >> does not push me to using a hub --but other models > >> of such easily could as I understand. > >> > >>> Yours, > >>> Robert Clausecker > >>> > >>> Am Fri, Apr 16, 2021 at 06:58:12PM -0700 schrieb Vincent Milum Jr: > >>>> What's the power source for the hard drive? From your bug tracker link, it > >>>> looks like this is a SSD of some kind, not a USB thumb drive. It is > >>>> possible that the drive is pulling too much power for the Pi's USB port to > >>>> handle. Remember that the Pi's power source is ALSO a USB port, so that > >>>> power is then shared between both the Pi as well as any devices plugged > >>>> into it. Power brownouts from pulling too much power on the Pi can present > >>>> themselves in a number of ways, including CAM errors for disks. > >>>> > >>>> On Fri, Apr 16, 2021 at 4:00 PM Robert Clausecker wrote: > >>>> > >>>>> Greetings! > >>>>> > >>>>> Last time I experimented with ZFS on the RPi 4B, I noticed that > >>>>> there is a strange problem when attaching the zpool via USB 3 as > >>>>> opposed to USB 2. When doing that, mounting root fails with > >>>>> IO errors like these: > >>>>> > >>>>> (da0:umass-sim0:0:0:0): READ(10). CDB: 28 00 03 c1 b9 65 00 00 07 00 > >>>>> (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an error > >>>>> (da0:umass-sim0:0:0:0): Retrying command, 3 more tries remain > >>>>> (da0:umass-sim0:0:0:0): READ(10). CDB: 28 00 03 c1 b9 65 00 00 07 00 > >>>>> (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an error > >>>>> (da0:umass-sim0:0:0:0): Retrying command, 2 more tries remain > >>>>> > >>>>> Attaching the boot disk through USB 2 instead works. Likewise, > >>>>> using USB 3 with a UFS root file system works (and in fact ran fine > >>>>> in a development system for months). I do not understand this. > >>>>> > >>>>> I had previously reported this issue as PR 249520: > >>>>> https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=249520 > >>>>> > >>>>> There's some stuff about UEFI booting in there which you can ignore. > >>>>> The same problem also appears when booting via U-Boot. > >>>>> > >>>>> Now what surprises me is that this issue still occurs with > >>>>> FreeBSD 13.0-RELEASE. So whatever fixes had been performed > >>>>> did not seem to address the underlying problem at all. > >>>>> > >>>>> Is there any workaround or solution (except for ditching root > >>>>> on ZFS which would be rather painful for my use case?) > >>>>> > >>>> > > > > === > Mark Millard > marklmi at yahoo.com > ( dsl-only.net went > away in early 2018-Mar) > > -- () ascii ribbon campaign - for an 8-bit clean world /\ - against html email - against proprietary attachments From owner-freebsd-arm@freebsd.org Sun Apr 18 20:38:19 2021 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 23D435F42FE for ; Sun, 18 Apr 2021 20:38:19 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic315-55.consmr.mail.gq1.yahoo.com (sonic315-55.consmr.mail.gq1.yahoo.com [98.137.65.31]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FNhbn3DF8z4WZG for ; Sun, 18 Apr 2021 20:38:13 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1618778291; bh=TqJifmeQgFrrKSF+LY89fCu8HNN5hv3Ket4zpDnVtZs=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=r2DJmKFJN12u2lGjXbwjCqUr8ZtkxELV5MAjCudsmkzd3z6R0hqu9Z8tPxZPWNNyVaMHa/nJBj0JnZpg30mJbpM5BSaXG07duelP9BUSjIK9soDkB8cfgxsGQG8+/5Rmwc6dzNA8tL8DXERqnz/32lbmIxMYdIeiQqg53EY7aRngIJ23eultrE2NnAbYTTleM7BsBc5XgC0BZm0s28AdIq23ffarFdhqpAnHgmXCwZEl7ev0H/hQe3928qURWu/Q/SIFMIvxA7eI75gf8OMvMcwnvzJY4tdI0OQCBZmTMnbVVkjTXIBOfYS7FBnPpksERqbJqhZNT4te11AvFMGivQ== X-YMail-OSG: aQsTE48VM1mKv93pP8.jsN0Yu6XXTcIhD3LZIZ2PqcEfHoNrfIDoBHrg9Oa.iGh zCoPxcphALf1bROEgyg_AHlQZF27Uv4hK34zfgLukJ7qImj8REh2.dRDJzAh8ARK95I5DxqxL.Rk uOR_KXobJcE.JYHQuOTMZ6RzdLhVKMyGmD8uuW7Wwxv53hFW8422dd5ylxsQR2yezs.s1cD2_lsd l1_tygLzggc.vykymq_87m5OvFKLnN53FtWuLm1dE2nv9cLrcvaxT4M117fSyRjzRjTYDA13QFiu P8RwUlqHem7cUoBd055WYlK2N4FFihF2TIlkh1cEjgwQu2w404KqghiQC7JtCWpJC0Isd2Oyk9bp KdKC77HLR4yu4gqn0g4IUB8EtDgAOH49L8qIrl9AN3SIq0C.gTkI.hRIyXAWAGXjHZ10zEMYhhwU IHR6LAHqILxl.PTI0Ec30lBCF0ekHNKUKwUpH1242JKYmqlf8LwSKO0iPIf7Fq.46B45Oi_2c6g8 .xxWLQ0S1XFM.muDmTvy9m4SkPIVvvlBmAnmpjXg_J9AHCqRcwY18TuBLnTj6tbXDAVGCboj_IwV MOepxgo7chHSk4o1MTsCEGldoF_JztZT9ztWlQZz122khsasBvyw_P.WQ86iQJawi7naEos3C7i1 mqg1tkw617CPZ28fEFFeQuhHj9TdjZnlumvelsMrwuV48h57O9u_NnGDkb2ll33ueKDdDotxdNSb J6lalSXBQ_TQj9SyExH3Xqle_gvniPXyQHbfZUcTnFkc81MY_HnalS2mXIQxJeTPYMR4ZXu6P5Gx 0Z1dGYjAtJU0Mkr1epTETdYhOq1OlQvP7d_eiZp_wgivO0NuzrXEnhvGwPzcWpj9qsMq.FCqRajG UOF0jkh.teKTlp16GVNBovbc5JMcY2WDmpa88n35s_Yed1t3TKsy9QsS8eTtrh6OxY2rMlQpZ1Fd DEJA5.LknrVL4wYKMREFvj2skPVNugz72tsvWUvD7W0.xba9bE4uiwjORJ_oA3RbdVxX.mDbZQqk x_EfzdZ2gEJgCbunQ.7IvQTZzV0uFk9YoiYzBF2s9mldpyBZUAfDM72P_b4ThuH6yYjVmAZzco7i CD5PlVYaNdly9YTE4PD9wLw35Zhx4I2NbNsEmy.Cb8676eT7YjAv7uJbUWuefGfFNzTtJcz55J37 AMtRi6bzaSM7B9V2zMh0jWzFYPta3PdwfhMXts5CzGBENE9YdSfUUI9eslTccYFm_oHAQkrK9rPI 5tPk_qyTDqHzsr62bm7HDsk5HRpTt0EuaQyEmBmAZT34tLBhDwZjBT20yHBpc7w.9_jig2Lrm58j aRFLgsXM7hmmVTuNfO8ulb6pBcFTawqy0Fd9DoVOPG6y4YVesybkLbtTuVamfBxw7ValCX.tP66D 8.KV7xYRyhlumaacoNDHaBApWOt_NP3MKNXJMUSBrZnziyui0LJL3ZIHR9pl4n0VNOp2rduv9wq. wpEk4diZ2_riXEkmRMUCPmOduvwOLHFvTksG0JAErKS3JUxLtKK2FUnXWe1x74uJ6ZX7oudWnc_W wqnsVz69D49ic.hzgLd1zKgnC1K0IpkdoJn0CRNmlwquQ6Eph5QNki_yR0xgi8hbZ0yQWZz8qsRa 00Qyvt5k923EU_MDrys7HnA.CYCuujKjFeX1Q_4UF3ng1DUbMD0N33H5bImYGRQWqKPGjudX1vqO QMIBT6vJakezkfVj6KiqkraFWtvTm_oHdyjIg6BPt.Xk90fzFZgTENX.37VfW093J0BQDBw5nBy4 3qijFlb1it.KyOOSItwIvWAkh9xNA06wscplnFDrnsylo0ZcHDcu698Pfej3fzuoWZrIo6xinUdw GZAJcjYsG3f17YpOxJCWdEDnDBmSOd3ElxQhUh2GHTZYYPvn8BLrRYwGEwcwaPT9sLYCOnOw5Xs2 _sha3DouOQjLb1N.NDrO592MSHM91FDjLTiQpOUnKrnUgLIO2QrT5DuAaIrqq4WuBk6EE9xydB8I hTn3fIXBe1Ft_pQxoZHv8AT8_gp.q.NkjdUigiACMYVRJ59hIDkQR3VjoUtFSEtKGduEQVRNmVSS JvPGKiM9UerPzNeBNfna9NYMYOkX4hQz19Pm.mVMZnTx.NOJ0D6MLdJ3a87lok0Gb1KtFAXO8GJB knKIKgD8c5Et8OcEx8L1mDJ_OyK3W3DohFzHrG281.M8oHuuKt.EbakOzISJRbxAWgig0Osz.eiv L.6Y1Ot9.bZyPsxH85kcQFg2rQgMcHUQ4EN_UAPLFXhI4yJm05J5BzmHSamZV23nHOiGOfwlv8WA 5kn37L8VMKZuTjrvd1.sPxAGD3.mruoANiSpWSn.V3_9_vpX6ILMlW43NXNrY5djSWwl0VKHshWu 68jym.iGplNS86E40Yv__47r5niZgPD04kJb6AWIvLOPWHxUQdX9buGkXU_HRuOlsSrA0wUooaxP ZbYm2qj4ftT.1EW9DKLvmun4J8T0uAPO8_McoZgYQdrAdp02u3JF.3qwgEvoH8HBEbamLux8i5pH fHtaP57vrR.WNyTIwSpAlLf7H2l3.YFER7xCKZ6vV0s7MN8TYpEYC8sikmcQ1jWiwT4hND_UFhM5 pWAd0wg2QnvFvULl2oU3rWQPQnMGoMHL_c.fFSWfoiHA- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic315.consmr.mail.gq1.yahoo.com with HTTP; Sun, 18 Apr 2021 20:38:11 +0000 Received: by kubenode522.mail-prod1.omega.bf1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 78afe8fa91138fc21a076210be6e1b4e; Sun, 18 Apr 2021 20:38:09 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: RPi4B 2711ZPKFSB06C0T parts seen in the wild, 13.0-RELEASE fails to boot on them From: Mark Millard In-Reply-To: <20210418143230.573a968e@basepc> Date: Sun, 18 Apr 2021 13:38:07 -0700 Cc: freebsd-arm@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <93728D9D-9222-47A8-B6F1-DC6FCCC21915@yahoo.com> References: <05740E83-5A45-4944-AC87-629D21D7F579.ref@yahoo.com> <05740E83-5A45-4944-AC87-629D21D7F579@yahoo.com> <20210418143230.573a968e@basepc> To: Denis Ovsienko X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Rspamd-Queue-Id: 4FNhbn3DF8z4WZG X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.50 / 15.00]; RBL_SENDERSCORE_FAIL(0.00)[98.137.65.31:query timed out]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; DKIM_TRACE(0.00)[yahoo.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-1.00)[-0.999]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RBL_DBL_DONT_QUERY_IPS(0.00)[98.137.65.31:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[98.137.65.31:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.31:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.31:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-arm] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Porting FreeBSD to ARM processors List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Apr 2021 20:38:19 -0000 On 2021-Apr-18, at 06:32, Denis Ovsienko wrote: >=20 >=20 >> The C0T RPi4B should be able to DMA outside >> the 3 GiByte limit that the B0T ones had: no more >> limit. The RPi firmware may configure the C0T parts >> differently and FreeBSD might have changes >> required if it is to work with the newer parts. >=20 > As far as these commends make sense to me, the foundation has started > shipping RPI4B revision 1.5, The 2711ZPKFSB06C0T RPi4B was reported to indicate revision code b03114 for itself (via attachment content), which that README.md lists as v1.4: b03114 4B 1.4 2GB Sony UK (The ending hexadecimal digit indicates what goes after "1." for "new-style revision codes".) But it turns out that the above line was added to the table in the same commit as the line: c03130 Pi 400 1.0 4GB Sony UK which is a known 2711ZPKFSB06C0T context. The commit was back in 2020-Nov. For all I know there may be b03114's that show a B0T suffix. The shared commit may be a red herring. This makes it still unclear if there will be distinct revision codes in general. > but forgot to bump the revision number up > and to update It is a possibility but not a certainty. > = https://www.raspberrypi.org/documentation/hardware/raspberrypi/revision-co= des/README.md >=20 > If that's the case, it might be better to solve the problem at the > source rather than at run time. It may be more effective to raise this > through the shop, as the foundation does not seem to have a bug = tracker. An interesting point about b03114 being a 2GB model's revision code is that the DMA limitation is basically irrelevant since there is < 3 GiByte of RAM to start with. Fixing the DMA limitation would not have been the point of having a 2711ZPKFSB06C0T part in this type of context. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-arm@freebsd.org Sun Apr 18 21:00:15 2021 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9D4985F50C4 for ; Sun, 18 Apr 2021 21:00:15 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FNj5C3bcQz4XWK for ; Sun, 18 Apr 2021 21:00:15 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 5503212F11 for ; Sun, 18 Apr 2021 21:00:15 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 13IL0Fv7008866 for ; Sun, 18 Apr 2021 21:00:15 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 13IL0FFF008865 for freebsd-arm@FreeBSD.org; Sun, 18 Apr 2021 21:00:15 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202104182100.13IL0FFF008865@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: freebsd-arm@FreeBSD.org Subject: Problem reports for freebsd-arm@FreeBSD.org that need special attention Date: Sun, 18 Apr 2021 21:00:15 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Porting FreeBSD to ARM processors List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Apr 2021 21:00:16 -0000 To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 238576 | Raspberry Pi 3B+ "shutdown -p" does not shut off Open | 239673 | Spurious Interrupt message from /dev/led/led1 2 problems total for which you should take action. From owner-freebsd-arm@freebsd.org Sun Apr 18 21:18:13 2021 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 73F2C5F674F for ; Sun, 18 Apr 2021 21:18:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FNjTx2k9jz4Yv6 for ; Sun, 18 Apr 2021 21:18:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 507D713248 for ; Sun, 18 Apr 2021 21:18:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 13ILIDB4017867 for ; Sun, 18 Apr 2021 21:18:13 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 13ILIDVN017866 for freebsd-arm@FreeBSD.org; Sun, 18 Apr 2021 21:18:13 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-arm@FreeBSD.org Subject: [Bug 249520] IO errors while mounting ZFS root on UEFI-booted RPi4 from USB3-attached external USB drive Date: Sun, 18 Apr 2021 21:18:13 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: arm X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: fuz@fuz.su X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Not A Bug X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-arm@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Porting FreeBSD to ARM processors List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Apr 2021 21:18:13 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D249520 Robert Clausecker changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |Not A Bug Status|New |Closed --- Comment #18 from Robert Clausecker --- (In reply to Mark Millard from comment #17) Hi Mark, Apparently bsdinstall sets up vfs.zfs.min_auto_ashift=3D12 in /etc/sysctl.conf to address this potential problem. So you are right in that this possibility is already addressed. However, as I manually set up the zpool, this was not the case for me and I= ran head first into the problem. For future reference: the thing that made me diagnose the problem is the CDB showing a 5 sector read. 5 is not a multiple of 8... Thanks for your excellent help anyway! --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-arm@freebsd.org Sun Apr 18 22:17:15 2021 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 62A9B5F7F55 for ; Sun, 18 Apr 2021 22:17:15 +0000 (UTC) (envelope-from denis@ovsienko.info) Received: from aibo.runbox.com (aibo.runbox.com [91.220.196.211]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FNknx5Tx5z4cS2 for ; Sun, 18 Apr 2021 22:17:09 +0000 (UTC) (envelope-from denis@ovsienko.info) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=ovsienko.info; s=selector1; h=Content-Transfer-Encoding:Content-Type: MIME-Version:References:In-Reply-To:Message-ID:Subject:To:From:Date; bh=SEGQa/WWiAyxwaLTNCxbtjcQZ9Cc1IY1UkpVfH50yFs=; b=tNMxjdZS8Mu5/NnCahXgzpIVBH MJSao4IwBBNpd0mKr8DSA/RLpTALRVX5Xci8sbLNVB1ty6vMWpVghHkwgfEy7aP/Xufs4eyHeaqag shM3A3O158+5GBrydNMmMeuTW9r0HbNojop/7kLyNiO3fphL3ti2sGsv82AzbD/x7v1eGZaIwsflG DOlIx5PzW9L6jSMKwKAH7+DhnRA4FLLuCFVA12SpTl2dysR06VtOSI2ihHI9ATPyUQsXkJG6TYlZo +XkF4NN2Sn4AzyTyyNi4iH1rfaKWN4oTUqwC+7wi8dfrVxbM+5nBHHy7VyQs1B/AWTCxoq6WiYuee QqYqxR8A==; Received: from [10.9.9.72] (helo=submission01.runbox) by mailtransmit03.runbox with esmtp (Exim 4.86_2) (envelope-from ) id 1lYFj1-0005DU-1Q for freebsd-arm@freebsd.org; Mon, 19 Apr 2021 00:17:07 +0200 Received: by submission01.runbox with esmtpsa [Authenticated alias (984599)] (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) id 1lYFin-0001z0-RJ for freebsd-arm@freebsd.org; Mon, 19 Apr 2021 00:16:53 +0200 Date: Sun, 18 Apr 2021 23:16:07 +0100 From: Denis Ovsienko To: freebsd-arm@freebsd.org Subject: Re: RPi4B 2711ZPKFSB06C0T parts seen in the wild, 13.0-RELEASE fails to boot on them Message-ID: <20210418231607.043c0ff2@basepc> In-Reply-To: <93728D9D-9222-47A8-B6F1-DC6FCCC21915@yahoo.com> References: <05740E83-5A45-4944-AC87-629D21D7F579.ref@yahoo.com> <05740E83-5A45-4944-AC87-629D21D7F579@yahoo.com> <20210418143230.573a968e@basepc> <93728D9D-9222-47A8-B6F1-DC6FCCC21915@yahoo.com> MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4FNknx5Tx5z4cS2 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=ovsienko.info header.s=selector1 header.b=tNMxjdZS; dmarc=none; spf=pass (mx1.freebsd.org: domain of denis@ovsienko.info designates 91.220.196.211 as permitted sender) smtp.mailfrom=denis@ovsienko.info X-Spamd-Result: default: False [-3.10 / 15.00]; ARC_NA(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[91.220.196.211:from]; R_DKIM_ALLOW(-0.20)[ovsienko.info:s=selector1]; RCVD_IN_DNSWL_LOW(-0.10)[91.220.196.211:from]; FROM_HAS_DN(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[91.220.196.211:from]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:91.220.196.211]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[ovsienko.info]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[91.220.196.211:from:127.0.2.255]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; DKIM_TRACE(0.00)[ovsienko.info:+]; RBL_SENDERSCORE_FAIL(0.00)[91.220.196.211:query timed out]; NEURAL_HAM_SHORT(-1.00)[-0.997]; NEURAL_HAM_LONG(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MID_RHS_NOT_FQDN(0.50)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:50304, ipnet:91.220.196.0/24, country:NO]; RCVD_TLS_LAST(0.00)[]; MAILMAN_DEST(0.00)[freebsd-arm]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Porting FreeBSD to ARM processors List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Apr 2021 22:17:15 -0000 On Sun, 18 Apr 2021 13:38:07 -0700 Mark Millard wrote: > b03114 4B 1.4 2GB Sony UK If it helps, I have one RPI4B that reports itself as the above (2GB), and another as d03114 (8GB). Both boot FreeBSD 13.0 from an SD card fine. It is too late to confirm the labelling as the chips are under heatsinks, but if anybody needs any debug information from a known-good b03114, let me know. -- Denis Ovsienko From owner-freebsd-arm@freebsd.org Sun Apr 18 23:12:42 2021 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0F1DB5D9754 for ; Sun, 18 Apr 2021 23:12:42 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic313-20.consmr.mail.gq1.yahoo.com (sonic313-20.consmr.mail.gq1.yahoo.com [98.137.65.83]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FNm205Ch2z4fLw for ; Sun, 18 Apr 2021 23:12:40 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1618787558; bh=RcfqUhJZ27nto1mGhTkXrzSd3J7bUeiRgkmQ76TEjpH=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=efHI6BUioYlHNE/9a3NuuUFfHm/807HK3IqhChcNeQzw9YjO/SXOIq6onpuRYII3B5AAOMNB7Y67GwUZ8tf/vPx0sRaVLq8HfuMhIkMlTYRuQ05jUPFFe8j8jW5jI+hO7H5snBJuY0s4fNvTJY8BgQpxLqUyF0D7LrGVi4q6B9NxT+E2+i2poK2KhfGo8A8oEeyTz/G0LHVXT1b8PdsPMbSfRGeMEyI6ZFYU2sJvpGCgEj+TKQXbHGheCnvMbdj6yAamicp3i/OBdqZAHk2MJCBh0FnME34yqG/t+3c48xwEW171IUnfYAwV9rNEw2zQ7hheIHYDgCdmktuGUXrlZA== X-YMail-OSG: FK50wI0VM1nxiZ.FGKrSPxgIcxJPiJ7X8RC1b.CrjlZagdVUqeLAnQvjn0fC59a pTVGoEC1vbEhLrS45z2hIFWxMDr9KyhC4kCdVqbNEm2ImtwoolI_BaQY_tkh9cno.obz4LTYjRca VPlEWlSBIml_qxt_.GtHSnY_R7A2yqsz1AqKuNBAO3s5debw6byG.UkrWvyS1aEVkHqhk2KtaxoE 61eZgOC.ucpItn_EhyLqhip27YXhZs90pcKwEspXzEeZ0CYmVc.p5hJciaiD_U5bNtAutOkY6Kis dH2XertEG5CXeRGCeWBBBYNpqtWSzUpEWSV1uZVqMdG.qkJbq_YbVvFg4M.yYyjnorlr.NP68gGD EKEZbuWZSpsGXRo8dDpJCGSsl10Z6folEksKiVmEStL0uTLSeGsBEK9yzfB168TEAjfl96vEuanx bOSBcFzau34MNA1Fcgl7s2T6DVQLLpSq_.TUqKmXpSZictURMuDG1GYMMAV_9aiFJRt.._v.33nn _bzu0XS2Z1MfWlOK5racTJkq58EW31YhVYV81XgNXlgDB.HVXPnQfW9t4PbstjmVMNsVv445Vhk_ BCcG_m9JouO8eszADELnToKzh.UW2OKwCyJLJzNcHGRYN_L4izpm9Eue.WP0XU4LMfiq0fVds.bf m6jV0dHx0.n3vObxUpK_cvOcpHjjAMUZIchk81C7yhMJLZypVLRZuVRACxciKiyVImx2EfSjRufh 6Gyj4xAyjOk20NYAtM.znjBnBZesG9c1Q8H2bzkCXzF7Opo3KH73EqG25RQ4kJMv7IhrSXFOD32t Mn8oKCyUdQHpSpS.HcWEJoIGtIA6k2nA4Rrt4.wlus6EthwDchL21KU.QHiACAqRTDZLZHC0zACq kL_DmnIUsRmGQgF9Qf4x1kSEClAAyjAJ_j.x4vz4.P3qNesjhGFuHIzB_fM100v7C2W9m9ED1EzQ kKMsDvbq7KV0ZLv.nc_9O1V5FDtRNfROf2d2RbUbZiDUYPoDK1vmLt9WOBLRc1h7O1QBSBxQP8U8 1VFRN35NE1U8t3fNApc5ajTOqFdMHDkHAYVgpHXD0eYrFBynI_z99q5U1a1HvtJqNUE9mwCrrUTq PSjdzv8iBxdy6gG_ERtOuYEdmDUYJOxWjOMy0J_GGb74ko4VLMQK2tzQeGZnNU9zy4XRVak4.m06 G4TyhEtxyWgC_pi9FkLQjrIlEP8BcOM7ObRsoECjnNEyvmQGYrUw75V7JxKFrEFHWD49NWHic1D2 kpxER80n4m3ZrqlGnHnu27fHDy29tOqc7aihSwNR0cKVHeYxyKE8_jdg5m3DzdYcNZwb5Qzj9194 j0DQEeVgSzubaieG6XMX2j80EW5TksIE8d8FA084YML.ZIA9fb3VXIS1l92x3Qh5bO6ZdM3wJbxf zXQBXexUtTmWbNLcLOrClKBfVj6q6jIhdZ6ZS.MqEEoEFqC0lW8CFRT8O4D2CaHPDYS1KEAadBKi jtEmuBrA7hPEDPS0MqfNNbMAUTXXLJ7cXpupEDfRMhPMNDAKvq7eEfv6HoTEajPPSyDC.8WSfxc9 2VSM1TcVZf39KuBxnOQldeZvL1TuAC3OPztgt73DW7JB_s36HATVJ_BZgb4T2us1XDDNvzU8hPd2 gCiQOtBrN4u3fLA_WOukTymeuzik2s_m3HWkE4Hu5MIcRIOxmDXjCJ1hiIz15OHNcGFPlCTt9akW xPbEHJf_GHZLiRmZsOzAPMF3rCOKOLuyg8bXZfboLZdA7BHrgDcCgqNAX0fzJtlL7R2RVHpaE31. rV0WVMGShO1W9TRWcfXkdZrah_QG5PoNVPoWcME_w26NYmsrwzwjd90GJxGZ8uDP9kwkum7xOvEm DSnHwyn6K7gfBw2j6wbItPYN7t0zZaHiG9y4LHszU7WjmI_PohGS1PHMZzSyRFzeBJeErHZ6xbIx 43of3e8WP.RWuQRVuHcXd0mO1EhMIYKbQDQXI11spnQgzan602HB5WPcJvWEtFHJ0l4x_i3bmRvE tXa_5fM_x96p3TiK5_3tgO7yBH0UeCHFGLhDb5bgVHX4IREOyHUXa1W.V95MTGaSXfnemrKO6LyS uoZJrPwVMspXQg0khWwHWjVOyKkghMqN.YeCoc33JSYoObyO10HubZuiRTY_EaVmHitT_XOsjSQQ UAgra_25M4gIcOz8c2FfOtDc2rFDYyOIQdTnbfHhLD5oiwheiidpmmcsWjzzkquhe4ItdWE_hF6n 1XfxKC7PKkj849hBh.qsFJc58ntIWZ_PVnIbS42GKRISVlLQIVYKwXFh2yhUQx7wBOoRx28.nUsx SFnH2FQzz3d5b0FF.kEins_UDU6yP.OqL5tOUif7jo9SinkjuEklqhMG4GGnu36QyNVvcWsNWJ_9 RO_w3aaVMzy.i7mC7ekeXE0E1Ri6Pq1066OhbMhIk_e0od92g4C29STCsFmMRkbgA7KLbv921EzT kkNgpsVhAp.7qadl_GRLIX9otZaxvTC1woNX44uklEsHzutqw3G.CkYwWZU.XO3xHOJr2NeLsL6h RBpyVMyoKDt4DhEznTAInXeWw5aFiTfa5M1noQQeueZQKiWtDy9m__t_iVzRRSe70 X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic313.consmr.mail.gq1.yahoo.com with HTTP; Sun, 18 Apr 2021 23:12:38 +0000 Received: by kubenode533.mail-prod1.omega.ne1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID c386f078be748504a7b228a199fb6168; Sun, 18 Apr 2021 23:12:36 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: RPi4B 2711ZPKFSB06C0T parts seen in the wild, 13.0-RELEASE fails to boot on them From: Mark Millard In-Reply-To: <20210418231607.043c0ff2@basepc> Date: Sun, 18 Apr 2021 16:12:35 -0700 Cc: freebsd-arm@freebsd.org Content-Transfer-Encoding: 7bit Message-Id: <9457100A-0EF8-4CCF-A068-EB1D310792B4@yahoo.com> References: <05740E83-5A45-4944-AC87-629D21D7F579.ref@yahoo.com> <05740E83-5A45-4944-AC87-629D21D7F579@yahoo.com> <20210418143230.573a968e@basepc> <93728D9D-9222-47A8-B6F1-DC6FCCC21915@yahoo.com> <20210418231607.043c0ff2@basepc> To: Denis Ovsienko X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Rspamd-Queue-Id: 4FNm205Ch2z4fLw X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.50 / 15.00]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; DKIM_TRACE(0.00)[yahoo.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RBL_DBL_DONT_QUERY_IPS(0.00)[98.137.65.83:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[98.137.65.83:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.83:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.83:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-arm] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Porting FreeBSD to ARM processors List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Apr 2021 23:12:42 -0000 On 2021-Apr-18, at 15:16, Denis Ovsienko wrote: > On Sun, 18 Apr 2021 13:38:07 -0700 > Mark Millard wrote: > >> b03114 4B 1.4 2GB Sony UK > > If it helps, I have one RPI4B that reports itself as the above (2GB), > and another as d03114 (8GB). Both boot FreeBSD 13.0 from an SD card > fine. It is too late to confirm the labelling as the chips are under > heatsinks, but if anybody needs any debug information from a known-good > b03114, let me know. That does suggest 3 possibiliites: A) Differing EEPROM content versions B) Differing board/CPU revisions C) A combination of both (A) would definitely not lead to b03114 changing. So I propose another test under RaspiOS or RaspiOS64: # vcgencmd bootloader_config and/or: # rpi-eeprom-config === Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-arm@freebsd.org Mon Apr 19 13:18:43 2021 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id EEE0C5F1F9B for ; Mon, 19 Apr 2021 13:18:43 +0000 (UTC) (envelope-from denis@ovsienko.info) Received: from aibo.runbox.com (aibo.runbox.com [91.220.196.211]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FP6pB0tHGz3vX1 for ; Mon, 19 Apr 2021 13:18:41 +0000 (UTC) (envelope-from denis@ovsienko.info) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=ovsienko.info; s=selector1; h=Content-Transfer-Encoding:Content-Type: MIME-Version:References:In-Reply-To:Message-ID:Subject:To:From:Date; bh=ZrnyAzHnj1BfsVuUBjf4ZjhuachSHCDFB76o/o0PxmE=; b=WXETshLEIDwjyAKDiprJUEJRqD DqGag+SlkCirUPncim2JGsSjwIM+3wqvkYIgmiIO3WXUwbGQD/FstcZkLwmEGER2/8WRUHRiLG7uS /SabxtXwQL7NaLTt3xgIkJu1PxgicZbNdlSKDisMpMi+lsE6mBPH9FUguJpy2zfKHwXsGmk/krAea zfGDrhjxv8IYVALJOkmZE4shaognJbPL+oVYaatsUXcehoMwGQPJ/O3LuJLXI8GNKgrcHWEyfOZRB m2o7TUeBfMK32WIyD6+xp/xu+AgPtn4q0jWn5fpeGQHGhfCYS29b9EWmApeJFe3rruUviEXHrtaiH dGxHxoyw==; Received: from [10.9.9.74] (helo=submission03.runbox) by mailtransmit02.runbox with esmtp (Exim 4.86_2) (envelope-from ) id 1lYTnT-00029w-0E for freebsd-arm@freebsd.org; Mon, 19 Apr 2021 15:18:39 +0200 Received: by submission03.runbox with esmtpsa [Authenticated alias (984599)] (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) id 1lYTnG-0004c4-Nm for freebsd-arm@freebsd.org; Mon, 19 Apr 2021 15:18:26 +0200 Date: Mon, 19 Apr 2021 14:18:24 +0100 From: Denis Ovsienko To: freebsd-arm@freebsd.org Subject: Re: RPi4B 2711ZPKFSB06C0T parts seen in the wild, 13.0-RELEASE fails to boot on them Message-ID: <20210419141824.6dd7a102@basepc> In-Reply-To: <9457100A-0EF8-4CCF-A068-EB1D310792B4@yahoo.com> References: <05740E83-5A45-4944-AC87-629D21D7F579.ref@yahoo.com> <05740E83-5A45-4944-AC87-629D21D7F579@yahoo.com> <20210418143230.573a968e@basepc> <93728D9D-9222-47A8-B6F1-DC6FCCC21915@yahoo.com> <20210418231607.043c0ff2@basepc> <9457100A-0EF8-4CCF-A068-EB1D310792B4@yahoo.com> MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4FP6pB0tHGz3vX1 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=ovsienko.info header.s=selector1 header.b=WXETshLE; dmarc=none; spf=pass (mx1.freebsd.org: domain of denis@ovsienko.info designates 91.220.196.211 as permitted sender) smtp.mailfrom=denis@ovsienko.info X-Spamd-Result: default: False [-3.10 / 15.00]; MID_RHS_NOT_FQDN(0.50)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[91.220.196.211:from]; R_DKIM_ALLOW(-0.20)[ovsienko.info:s=selector1]; RBL_SENDERSCORE_FAIL(0.00)[91.220.196.211:server fail]; FROM_HAS_DN(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[91.220.196.211:from]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:91.220.196.211]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; ARC_NA(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[91.220.196.211:from:127.0.2.255]; DMARC_NA(0.00)[ovsienko.info]; DKIM_TRACE(0.00)[ovsienko.info:+]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:50304, ipnet:91.220.196.0/24, country:NO]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-arm]; RCVD_IN_DNSWL_LOW(-0.10)[91.220.196.211:from] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Porting FreeBSD to ARM processors List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Apr 2021 13:18:44 -0000 On Sun, 18 Apr 2021 16:12:35 -0700 Mark Millard wrote: > So I propose another test under RaspiOS or RaspiOS64: > > # vcgencmd bootloader_config > and/or: > # rpi-eeprom-config This is RPI b03114 that can boot and run FreeBSD 13.0 (and OpenBSD 6.8), booted into the latest 32-bit Raspbian: root@raspberrypi:~# grep -E '^[^#]' /boot/config.txt dtparam=i2c_arm=on dtparam=audio=on [pi4] dtoverlay=vc4-fkms-v3d max_framebuffers=2 [all] gpu_mem=16 root@raspberrypi:~# vcgencmd bootloader_config [all] BOOT_UART=0 WAKE_ON_GPIO=1 POWER_OFF_ON_HALT=0 DHCP_TIMEOUT=45000 DHCP_REQ_TIMEOUT=4000 TFTP_FILE_TIMEOUT=30000 ENABLE_SELF_UPDATE=1 DISABLE_HDMI=0 BOOT_ORDER=0xf41 root@raspberrypi:~# rpi-eeprom-config [all] BOOT_UART=0 WAKE_ON_GPIO=1 POWER_OFF_ON_HALT=0 DHCP_TIMEOUT=45000 DHCP_REQ_TIMEOUT=4000 TFTP_FILE_TIMEOUT=30000 ENABLE_SELF_UPDATE=1 DISABLE_HDMI=0 BOOT_ORDER=0xf41 root@raspberrypi:~# rpi-eeprom-update BOOTLOADER: up-to-date CURRENT: Thu 3 Sep 12:11:43 UTC 2020 (1599135103) LATEST: Thu 3 Sep 12:11:43 UTC 2020 (1599135103) RELEASE: default (/lib/firmware/raspberrypi/bootloader/default) Use raspi-config to change the release. VL805_FW: Using bootloader EEPROM VL805: up-to-date CURRENT: 000138a1 LATEST: 000138a1 root@raspberrypi:~# lspci 00:00.0 PCI bridge: Broadcom Limited Device 2711 (rev 10) 01:00.0 USB controller: VIA Technologies, Inc. VL805 USB 3.0 Host Controller (rev 01) root@raspberrypi:~# lsusb Bus 002 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub Bus 001 Device 002: ID 2109:3431 VIA Labs, Inc. Hub Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub -- Denis Ovsienko From owner-freebsd-arm@freebsd.org Mon Apr 19 13:59:44 2021 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2AB355F2CEF for ; Mon, 19 Apr 2021 13:59:44 +0000 (UTC) (envelope-from stefan.haller@stha.de) Received: from deponia.stha.de (deponia.stha.de [IPv6:2001:8d8:1801:133::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mx1.stha.de", Issuer "mx1.stha.de" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FP7jV4Y0yz4RWS for ; Mon, 19 Apr 2021 13:59:42 +0000 (UTC) (envelope-from stefan.haller@stha.de) Received: from mail.stha.de (mail.stha.de [IPv6:2a03:4000:24:7d0:100::15]) by deponia.stha.de (Postfix) with ESMTPS id BF7F611236B for ; Mon, 19 Apr 2021 13:59:40 +0000 (UTC) Received: from [127.0.0.1] (localhost [127.0.0.1]) (Authenticated sender: stefan) by mail.stha.de (Postfix) with ESMTPSA id 7A4EF189F01 for ; Mon, 19 Apr 2021 13:59:40 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=stha.de; s=20200509; t=1618840780; bh=271LvKRLiAUIUUq7Z+u7tMshaPSACbGyAYLKBlyNvZo=; h=Date:From:To:Subject:References:In-Reply-To:From; b=kIC3B4xANe5RypJ0WE9HYQEHM2sT03ZOdooMK5w0oZT9m5vN8zJTbPT9pofR16k4O 1blV7Terfbz23PxO9Y2nccLZIWuOhrNPEQ0fRvCDKXDVrXqtOa1PZo39MRjT9byZ8W L6MnyvKBXO2ovwC4BACZVlFsEvcisoF9P9zJFxnT3HSKtAgXNSZAalcGneOU3x5WJL m3We9Ch3BmjF2SF/8QZHim0W3wK4zhbM8dhxeCDFrubiQEtzXogtR0KexpQTEzdE7J WYXAgvXSYFAY/s07dcq+lSyvBHYN3QfmJwBPJuDF2zPhSjWi5NpYZYuYFPLImJU4hX d5tKMMSXwBhfQ== Date: Mon, 19 Apr 2021 15:59:39 +0200 From: Stefan Haller To: freebsd-arm@freebsd.org Subject: Re: RPi 4B USB 3 support appears to still be broken in 13.0-RELEASE Message-ID: <10b8cbd7-e426-4096-86ed-7f4629b37db2@stha.de> References: <6D2C75DF-796D-4CC9-9740-A8C15C6A6154@yahoo.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Rspamd-Queue-Id: 4FP7jV4Y0yz4RWS X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=stha.de header.s=20200509 header.b=kIC3B4xA; dmarc=pass (policy=none) header.from=stha.de; spf=pass (mx1.freebsd.org: domain of stefan.haller@stha.de designates 2001:8d8:1801:133::1 as permitted sender) smtp.mailfrom=stefan.haller@stha.de X-Spamd-Result: default: False [-2.12 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[stha.de:s=20200509]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+mx:c]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-arm@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; RBL_SENDERSCORE_FAIL(0.00)[2001:8d8:1801:133::1:server fail]; RCVD_COUNT_THREE(0.00)[3]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; SPAMHAUS_ZRD(0.00)[2001:8d8:1801:133::1:from:127.0.2.255]; DKIM_TRACE(0.00)[stha.de:+]; DMARC_POLICY_ALLOW(-0.50)[stha.de,none]; NEURAL_SPAM_SHORT(0.88)[0.876]; NEURAL_HAM_LONG(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[2001:8d8:1801:133::1:from]; ASN(0.00)[asn:8560, ipnet:2001:8d8::/32, country:DE]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-arm] X-Mailman-Approved-At: Mon, 19 Apr 2021 14:17:01 +0000 X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Porting FreeBSD to ARM processors List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Apr 2021 13:59:44 -0000 Hi, I just wanted to add one more data point I observed myself. On Sun, Apr 18, 2021 at 07:42:15PM +0200, Robert Clausecker wrote: > This is getting super strange. The > problem seems to occur only in this specific combination: > > * the specific drive I have > * attached to a USB 3 port > * on the Raspberry Pi 4 > * trying to import a zpool from the drive I had a similar error on my RPi 4B as described in the initial post when using ZFS _on GELI_ on an USB3 attached SATA-SSD. After switching to plain ZFS on USB3 on the same device it magically started working. ZFS on GELI was only working on the USB2 ports. Maybe the errors are related? My dmesg dump from the time when it was not working: > ugen0.3: at usbus0 > umass0 on uhub0 > umass0: on usbus0 > da0 at umass-sim0 bus 0 scbus0 target 0 lun 0 > da0: Fixed Direct Access SPC-4 SCSI device > da0: Serial Number xxxxxxxxxxxx > da0: 400.000MB/s transfers > da0: 457862MB (937703088 512 byte sectors) > da0: quirks=0x2 > GEOM_ELI: Device da0.eli created. > GEOM_ELI: Encryption: AES-CBC 128 > GEOM_ELI: Crypto: software > (da0:umass-sim0:0:0:0): READ(10). CDB: 28 00 13 2a 29 a6 00 00 07 00 > (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an error > (da0:umass-sim0:0:0:0): Retrying command, 3 more tries remain > (da0:umass-sim0:0:0:0): READ(10). CDB: 28 00 13 2a 29 a6 00 00 07 00 > (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an error > (da0:umass-sim0:0:0:0): Retrying command, 2 more tries remain > (da0:umass-sim0:0:0:0): READ(10). CDB: 28 00 08 80 20 36 00 00 07 00 > (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an error As I said, I switched to plain ZFS on the USB3 attached disk and everything works. (I am using ZFS encryption available since FreeBSD 13 without issues.) Kind regards, Stefan From owner-freebsd-arm@freebsd.org Mon Apr 19 15:11:01 2021 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0A8905F554C for ; Mon, 19 Apr 2021 15:11:01 +0000 (UTC) (envelope-from fuz@fuz.su) Received: from fuz.su (fuz.su [IPv6:2001:41d0:8:e508::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "amnesiac", Issuer "amnesiac" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FP9Hm2SFsz4WZh for ; Mon, 19 Apr 2021 15:11:00 +0000 (UTC) (envelope-from fuz@fuz.su) Received: from fuz.su (localhost [127.0.0.1]) by fuz.su (8.16.1/8.16.1) with ESMTPS id 13JFAunt089443 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO) for ; Mon, 19 Apr 2021 17:10:56 +0200 (CEST) (envelope-from fuz@fuz.su) Received: (from fuz@localhost) by fuz.su (8.16.1/8.16.1/Submit) id 13JFAuaU089442 for freebsd-arm@freebsd.org; Mon, 19 Apr 2021 17:10:56 +0200 (CEST) (envelope-from fuz) Date: Mon, 19 Apr 2021 17:10:56 +0200 From: Robert Clausecker To: freebsd-arm@freebsd.org Subject: Re: RPi 4B USB 3 support appears to still be broken in 13.0-RELEASE Message-ID: References: <6D2C75DF-796D-4CC9-9740-A8C15C6A6154@yahoo.com> <10b8cbd7-e426-4096-86ed-7f4629b37db2@stha.de> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <10b8cbd7-e426-4096-86ed-7f4629b37db2@stha.de> X-Rspamd-Queue-Id: 4FP9Hm2SFsz4WZh X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of fuz@fuz.su designates 2001:41d0:8:e508::1 as permitted sender) smtp.mailfrom=fuz@fuz.su X-Spamd-Result: default: False [-3.29 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[2001:41d0:8:e508::1:from]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+a]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-arm@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; RBL_SENDERSCORE_FAIL(0.00)[2001:41d0:8:e508::1:server fail]; SPAMHAUS_ZRD(0.00)[2001:41d0:8:e508::1:from:127.0.2.255]; DMARC_NA(0.00)[fuz.su]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.990]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:16276, ipnet:2001:41d0::/32, country:FR]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-arm] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Porting FreeBSD to ARM processors List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Apr 2021 15:11:01 -0000 Hi Stefan, I've since managed to diagnose the issue and closed the PR. The problem is that the disk is a 4k disk but for some weird reason, FreeBSD thinks 512b sector accesses are ok. As you can see, all failing requests are in fact requests with odd numbers of sectors (in your case, 7 sectors of 512 byte). I managed to fix this problem for me by forcing ZFS into 4k sector mode (ashift=12). For GELI, there's the -s option to force a different sector size. Now the weird thing is why this problem doesn't occur on USB 2. Quite honestly, I have no idea. Yours, Robert Clausecker Am Mon, Apr 19, 2021 at 03:59:39PM +0200 schrieb Stefan Haller: > Hi, > > I just wanted to add one more data point I observed myself. > > On Sun, Apr 18, 2021 at 07:42:15PM +0200, Robert Clausecker wrote: > > This is getting super strange. The > > problem seems to occur only in this specific combination: > > > > * the specific drive I have > > * attached to a USB 3 port > > * on the Raspberry Pi 4 > > * trying to import a zpool from the drive > > I had a similar error on my RPi 4B as described in the initial post when > using ZFS _on GELI_ on an USB3 attached SATA-SSD. After switching to > plain ZFS on USB3 on the same device it magically started working. ZFS > on GELI was only working on the USB2 ports. Maybe the errors are > related? > > My dmesg dump from the time when it was not working: > > > ugen0.3: at usbus0 > > umass0 on uhub0 > > umass0: on usbus0 > > da0 at umass-sim0 bus 0 scbus0 target 0 lun 0 > > da0: Fixed Direct Access SPC-4 SCSI device > > da0: Serial Number xxxxxxxxxxxx > > da0: 400.000MB/s transfers > > da0: 457862MB (937703088 512 byte sectors) > > da0: quirks=0x2 > > GEOM_ELI: Device da0.eli created. > > GEOM_ELI: Encryption: AES-CBC 128 > > GEOM_ELI: Crypto: software > > (da0:umass-sim0:0:0:0): READ(10). CDB: 28 00 13 2a 29 a6 00 00 07 00 > > (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an error > > (da0:umass-sim0:0:0:0): Retrying command, 3 more tries remain > > (da0:umass-sim0:0:0:0): READ(10). CDB: 28 00 13 2a 29 a6 00 00 07 00 > > (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an error > > (da0:umass-sim0:0:0:0): Retrying command, 2 more tries remain > > (da0:umass-sim0:0:0:0): READ(10). CDB: 28 00 08 80 20 36 00 00 07 00 > > (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an error > > As I said, I switched to plain ZFS on the USB3 attached disk and > everything works. (I am using ZFS encryption available since FreeBSD 13 > without issues.) > > > Kind regards, > Stefan > _______________________________________________ > freebsd-arm@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-arm > To unsubscribe, send any mail to "freebsd-arm-unsubscribe@freebsd.org" -- () ascii ribbon campaign - for an 8-bit clean world /\ - against html email - against proprietary attachments From owner-freebsd-arm@freebsd.org Mon Apr 19 15:36:34 2021 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9EA6A5F64A5 for ; Mon, 19 Apr 2021 15:36:34 +0000 (UTC) (envelope-from stefan.haller@stha.de) Received: from deponia.stha.de (deponia.stha.de [IPv6:2001:8d8:1801:133::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mx1.stha.de", Issuer "mx1.stha.de" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FP9sF48lXz4Y3k for ; Mon, 19 Apr 2021 15:36:32 +0000 (UTC) (envelope-from stefan.haller@stha.de) Received: from mail.stha.de (mail.stha.de [IPv6:2a03:4000:24:7d0:100::15]) by deponia.stha.de (Postfix) with ESMTPS id 14E3011239F for ; Mon, 19 Apr 2021 15:36:30 +0000 (UTC) Received: from [127.0.0.1] (localhost [127.0.0.1]) (Authenticated sender: stefan) by mail.stha.de (Postfix) with ESMTPSA id 847F718A089 for ; Mon, 19 Apr 2021 15:35:57 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=stha.de; s=20200509; t=1618846557; bh=8vZFu0sBpU8nVXEdm6CpLlfsyy+CA3LWTvzw6nIr0a4=; h=Date:From:To:Subject:References:In-Reply-To:From; b=MMdBQ2wudX+doDPAxWmFmr878wueFl2c++NOASrXlV4H8iK2z+cqp2WZFe5xb05H1 HXD0mUU0reQ/2DSlDNMd3W7QLhz5HBEbSB0kPpRO77/AkCRFWJzuOnNx+86l/6lt7q y3aNQp6MgiGpTSQZHNaMqRQMj/WmiyhyAVcsBw+5djE3luyh2I73AgmxYXBHKtXdO8 8VM2sxCfIgY5tkLprxQr1T7ZXXN6Y2bRLDLCsfSN1n+5F/BCJNhHl2iT+YNfWzXV30 xXkOsRH/3jZ5RrMfRpBnJ1drV2yM/eOzP356PIMObRqGOZPuBGbk380OaBhCUXTdcX ghiul4r06RCsw== Date: Mon, 19 Apr 2021 17:35:56 +0200 From: Stefan Haller To: freebsd-arm@freebsd.org Subject: Re: RPi 4B USB 3 support appears to still be broken in 13.0-RELEASE Message-ID: References: <6D2C75DF-796D-4CC9-9740-A8C15C6A6154@yahoo.com> <10b8cbd7-e426-4096-86ed-7f4629b37db2@stha.de> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Rspamd-Queue-Id: 4FP9sF48lXz4Y3k X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=stha.de header.s=20200509 header.b=MMdBQ2wu; dmarc=pass (policy=none) header.from=stha.de; spf=pass (mx1.freebsd.org: domain of stefan.haller@stha.de designates 2001:8d8:1801:133::1 as permitted sender) smtp.mailfrom=stefan.haller@stha.de X-Spamd-Result: default: False [-4.00 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[stha.de:s=20200509]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-arm@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[2001:8d8:1801:133::1:from:127.0.2.255]; RCVD_COUNT_THREE(0.00)[3]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; DKIM_TRACE(0.00)[stha.de:+]; DMARC_POLICY_ALLOW(-0.50)[stha.de,none]; NEURAL_HAM_SHORT(-1.00)[-0.999]; NEURAL_HAM_LONG(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[2001:8d8:1801:133::1:from]; ASN(0.00)[asn:8560, ipnet:2001:8d8::/32, country:DE]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-arm] X-Mailman-Approved-At: Mon, 19 Apr 2021 19:15:10 +0000 X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Porting FreeBSD to ARM processors List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Apr 2021 15:36:34 -0000 Hi Robert, On Mon, Apr 19, 2021 at 05:10:56PM +0200, Robert Clausecker wrote: > I've since managed to diagnose the issue and closed the PR. > The problem is that the disk is a 4k disk but for some weird > reason, FreeBSD thinks 512b sector accesses are ok. This makes a lot of sense. For ZFS I always defaulted to ashift=12, because I assume that even for older disks it probably doesn't hurt. As I moved only quite recently to FreeBSD I did not no about this option for GELI. In my case the USB-SATA bridge is most likely doing weird stuff. camcontrol identify /dev/da0 reports this (which is probably wrong): > sector size logical 512, physical 512, offset 0 Now that I know the answer to this old problem of my initial journey to FreeBSD on the Raspberry Pi, I can finally remove the old dmesg dump from my disk. :) Thanks, Stefan From owner-freebsd-arm@freebsd.org Tue Apr 20 22:02:24 2021 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id AD7775EB117 for ; Tue, 20 Apr 2021 22:02:24 +0000 (UTC) (envelope-from sdmitry@parallels.com) Received: from CAN01-QB1-obe.outbound.protection.outlook.com (mail-qb1can01on0615.outbound.protection.outlook.com [IPv6:2a01:111:f400:fe5c::615]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FPyMz64Vvz3ndB for ; Tue, 20 Apr 2021 22:02:23 +0000 (UTC) (envelope-from sdmitry@parallels.com) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=RUmVyPTA/JaIZVVmax+ytg/p6Yfrf8/E4MBDqeohNx3dUl40D7pnWWEtwV2z3DvPCL2IHn7FcQNJ7Ps8ixWXT0FL+bVeHyqP8DXIiKvP3LcSSrI0wbf51Lq/1JBR7yt02Mwc7xSn/Q0DWzbsGvrqn4MFFQ/EMiwIeEi1cEGNb9Vc5BG2s+LobRm7QXCi5b5ldg+ZVN+aRkVt7DmoJrDC84TDwH733hDVfKOFPi4Kczbr8goUQ60uiDUbjuJZ3a8mrSDkhe2I9rZfdw/sOGL0vQAKtBkGNKYJ3VkPlNCDD9RDqJLrD/75Ivf1Xdq5hOkxBbYeRlmBWkQayKGyj8np0Q== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=X4ju7MM2so/dw7+jW7tNb9sfBLR6raDTAzodEZplCRU=; b=h1LWUDFMi/V5JO5kBz1Qik7qM6iGVD+iPPLr3BkjMkAXrK91Ted8orp3iRqguoVHV/Zoh2znyz6m8hcckU4ua/SMV3RmIfcbldgSSrjUntGMxipeAOENuZh35YCWUT6j4QQQGKh617pcJQMPzuiNuufNXpF8ditBr9PYfCXZVVrTZVsb648PG80DtTT1JCpANLPe14NO0Qiz87wXVjtBNCnvpDhkbxyLe5gvkdCgUY9R3EWTom6TsRoV4aO4urNOoDB9XiUlRVWr6dOfgtkS0XVx/G2hB3EvDI54IopjfGLbRwMo1lnRcf0Sv3tUgEbP/aIEAzklF1Cj3jvlNilxIw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=parallels.com; dmarc=pass action=none header.from=parallels.com; dkim=pass header.d=parallels.com; arc=none Received: from YQXPR01MB4691.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c01:1e::22) by QB1PR01MB3026.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c00:3b::26) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4042.20; Tue, 20 Apr 2021 22:02:21 +0000 Received: from YQXPR01MB4691.CANPRD01.PROD.OUTLOOK.COM ([fe80::ad30:b472:ca49:acd1]) by YQXPR01MB4691.CANPRD01.PROD.OUTLOOK.COM ([fe80::ad30:b472:ca49:acd1%4]) with mapi id 15.20.4042.024; Tue, 20 Apr 2021 22:02:21 +0000 From: Dmitry Skorodumov To: "freebsd-arm@freebsd.org" Subject: gic-v2 and SGI interrupts on boot CPU Thread-Topic: gic-v2 and SGI interrupts on boot CPU Thread-Index: AQHXNi4LCeO0ml1xpE67WFQJcTjPYA== Date: Tue, 20 Apr 2021 22:02:21 +0000 Message-ID: Accept-Language: ru-RU, en-US Content-Language: ru-RU X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [176.193.45.64] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: e6ddb19c-fb15-41d2-52a2-08d90447f915 x-ms-traffictypediagnostic: QB1PR01MB3026: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:8882; x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: RHNJ9nq3YbPMYVS9Rjl0u4lWS7HQypbXENDpBRWtqRSDO7lzee/wz2dXCQR1aIuVi9w4DBP3Bx75uf/taComqV8RL/feaZhUJeX3UA/t51Tcfb7ybxjGltLqoN1DaeddFUS5s5MJNWU3noX2GPIr7hHT4qiT0ZNH04qGbKl/E3rj+JjnNyFsTwJuUeU1Wy/fKmwyCs2KKwFYxiGyBjraF377oZ/UIUPdmhIwQO9XVOe6qEDqJ9NKRqppteo6SIeWAAyZm9HAOR2v/4CrSr4TZw2xGWx1bp5D3/sJaXBlq7wVG8DR13w4Tv+1C5Ma8osnlPmUMe5yzdGF7Jz5DCFM2yhntRYr4ibyyYGk01cj56b3uxm0Cq/MWSXiAt01jhiT/fDZWyA1Dssaco00FcO/l/EnqlE+oRUROVVONdgLLL33WgadfjYVWYuqHzbmgPNcQ7tR+DS5BYUaMniuy2JcwbzObajwPIfy3BDgZmRKpKi34eRmwi1XWVWF5Yiqr9HhuQhL3rX7y7rVStAWg5MFD3WiKhbbmTwWt9qTq38h0WXSVh6PjoOfzvA2Zwet1ChaB0Q4OjiiPU9YkfgNwNsHSuHyhJiKJnhU3vl532UgGmJL46801rBNU4SoMZkb4vGaDkur2pSr2WW9QPiBUHNS52KnszTSE2Fkoij5rvFkw0V/bFDWNTM+LGENgyaou4Hs x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:YQXPR01MB4691.CANPRD01.PROD.OUTLOOK.COM; PTR:; CAT:NONE; SFS:(4636009)(396003)(376002)(346002)(39850400004)(136003)(366004)(33656002)(4744005)(26005)(83380400001)(966005)(86362001)(76116006)(166002)(6506007)(8936002)(478600001)(55016002)(6916009)(8676002)(122000001)(19627405001)(91956017)(2906002)(66446008)(66476007)(66556008)(7696005)(66946007)(71200400001)(52536014)(5660300002)(9686003)(186003)(38100700002)(64756008)(316002); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata: =?koi8-r?Q?k+FQCyCYtgWK0oKJg160B0yhCZ011TZKU0QuhWVWrwHH5iHeToYm2HZCkFIDrs?= =?koi8-r?Q?VCIe9dkIJMFAR5D92dzlavHf/un9eWukpaN8yKAOGJ1o6cW2BYtrc5Az/aP/Fq?= =?koi8-r?Q?PPAMmaQfpRGjiIfuRdMYt24UdIhSoAdfWdhIrIQRmr9JoLtVKSinnAMprkA9Le?= =?koi8-r?Q?ciXuabPhik/GFdAtBYZL1jLc5d26A2WPIyipdSwUZ6EFwtSbDED3YWBS9E4adz?= =?koi8-r?Q?rVce/lW9LhjUTYzJsLgOWQYjgfba39SYOkHEXPXgNPpjCW5qveRHNNRSa/+tCJ?= =?koi8-r?Q?eCEkbyhpVmmjQGp1VfwqPCfejblLgbRqOuf3kRT5SSarNFFkrRdrz4uKIchvm5?= =?koi8-r?Q?SlmJzmFcYMDbL57bz1/ij1ifWsgu3iajBcyCh1y6E7KD7+ozdMcT1bYj0k+IP2?= =?koi8-r?Q?G0dH7BGR0a6p6cUscuk63jfYpmRv7tZgheEK72+SHwm8QUQgo154fjvm49aVPY?= =?koi8-r?Q?V0Fhuv/U7ySY7d6tGHmFu+X3Qs0TcWKv0hVl9ha2bRihN3QChIjrLnb0k/nw3d?= =?koi8-r?Q?4s2sJZ5Lb08NvZxqyQpV2fGq7peTCwhnO+DosNytFxBjAMGtlHHt1ipsq/OZeb?= =?koi8-r?Q?CAp7/9SpZD1MpRTnQMYjoJfzn9YrhY0Aov4o+jFEgHuIofHeLHUFKbOtOxIgYr?= =?koi8-r?Q?qtEfdvnI455CHcLUxCJaXCL5p4/QCjti3ig4QpsVSbW4sYSgpiYFAuPVE9xUi2?= =?koi8-r?Q?ClqJt8mpYBLoJvU+m9KXe1P051q5gJlsi2ME9990VsUDQ1IzCaxkLwR8QfdGSv?= =?koi8-r?Q?iPD5iFz1YKPYDTIKEUy+T+AcDchGI+IKYmnRnyECXD/sZKuh1wVJ3hvNUKkxoD?= =?koi8-r?Q?UgEMhyNgmPqF7Ir8nb6YJBOIortnj2Yyg7xaCwjuo6I0m65B7ScdmrLZb+trjJ?= =?koi8-r?Q?L7via42sQVYkGgGrTqUYXioJ7fwDyrdi1hJWOhPJ5kBC3WfDXHWSbS9Es7kZpL?= =?koi8-r?Q?dO3GHwu1cT7H81K2We/OqBlvBOWdjUa7JRAg4x8ZMQRwNMbjAbvuSk+pdX8uzD?= =?koi8-r?Q?4wqbGAl1DwyjViihgi6qjtLB3cf8LNTbbG8OY5bZfQCnl7uC7ICbuNTkVrrhxy?= =?koi8-r?Q?IugGmymUliJp6A4XKb8B3EcVy+gBqblEMRkQiByZ1cUHZxIKBw9JNMSn+aLqWy?= =?koi8-r?Q?3j1QZsrZnelHkXwJ4LHuesQDtzAkbBJcTg/r45ZWWsIAbHiE3bBOOAh8BzNm9r?= =?koi8-r?Q?ECMCOOfoeIysIVRqL+Fv0qfjK7RVO7Jx/NtnxiAisTTl5o8voNJFyFda9ArpCL?= =?koi8-r?Q?5ObfHtS+nValCYJHT4NGM=3D?= x-ms-exchange-transport-forked: True MIME-Version: 1.0 X-OriginatorOrg: parallels.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: YQXPR01MB4691.CANPRD01.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: e6ddb19c-fb15-41d2-52a2-08d90447f915 X-MS-Exchange-CrossTenant-originalarrivaltime: 20 Apr 2021 22:02:21.6564 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 33874721-dd77-4b7e-97b7-863c2cbe7c73 X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: fh+Ve2x0sWjNqPr/auy5ixwwzdqrSJrJN6yRaT03PJlBoSv21OjnLg5mh0EFveWQfNFtBKxHXBNvd5bPB0nkGw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: QB1PR01MB3026 X-Rspamd-Queue-Id: 4FPyMz64Vvz3ndB X-Spamd-Bar: ---- X-Spamd-Result: default: False [-5.00 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; RBL_DBL_DONT_QUERY_IPS(0.00)[2a01:111:f400:fe5c::615:from]; R_DKIM_ALLOW(-0.20)[parallels.com:s=selector1]; HAS_XOIP(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a01:111:f400::/48]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCPT_COUNT_ONE(0.00)[1]; URI_COUNT_ODD(1.00)[1]; RCVD_COUNT_THREE(0.00)[3]; SPAMHAUS_ZRD(0.00)[2a01:111:f400:fe5c::615:from:127.0.2.255]; DKIM_TRACE(0.00)[parallels.com:+]; DMARC_POLICY_ALLOW(-0.50)[parallels.com,reject]; DWL_DNSWL_LOW(-1.00)[parallels.com:dkim]; NEURAL_HAM_SHORT(-1.00)[-1.000]; TO_DN_EQ_ADDR_ALL(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:8075, ipnet:2a01:111:f000::/36, country:US]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; MAILMAN_DEST(0.00)[freebsd-arm] Content-Type: text/plain; charset="koi8-r" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Porting FreeBSD to ARM processors List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Apr 2021 22:02:24 -0000 Hi It looks like code for gic-v2 in FreeBSD not quite correctly relies on impl= ementation defined behaviour of GIC. The gic 2.0 spec https://developer.arm.com/documentation/ihi0048/bb ch= apter 3.2.2 "Interrupt controls in the GIC" states the following: "Whether SGIs are permanently enabled, or can be enabled and disabled by wr= ites to the GICD_ISENABLERn and GICD_ICENABLERn, is IMPLEMENTATION DEFINED.= " But code in sys/arm/arm/gic.c assumes that SGI are always enabled and doesn= 't configure them at initialization. They are initialized only for secondar= y CPUs - in arm_gic_init_secondary(). For sure it is a rather minor issue, since all appears to be ok in gic-v3 (= v3 code enables SGIs for all CPUs, including the boot one). And even if pla= tform supports only gic-v2, likely SGIs are always enabled anyway. So, my p= ost is rather pedantic notice without real life case. Dmitry From owner-freebsd-arm@freebsd.org Tue Apr 20 22:38:56 2021 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id EE6695EBE51 for ; Tue, 20 Apr 2021 22:38:56 +0000 (UTC) (envelope-from tuexen@freebsd.org) Received: from drew.franken.de (drew.ipv6.franken.de [IPv6:2001:638:a02:a001:20e:cff:fe4a:feaa]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.franken.de", Issuer "Sectigo RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FPzB84Spnz3q11 for ; Tue, 20 Apr 2021 22:38:56 +0000 (UTC) (envelope-from tuexen@freebsd.org) Received: from mb.fritz.box (ip4d15f626.dynamic.kabel-deutschland.de [77.21.246.38]) (Authenticated sender: macmic) by mail-n.franken.de (Postfix) with ESMTPSA id 09F31721A5A27; Wed, 21 Apr 2021 00:38:47 +0200 (CEST) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: gic-v2 and SGI interrupts on boot CPU From: Michael Tuexen In-Reply-To: Date: Wed, 21 Apr 2021 00:38:44 +0200 Cc: "freebsd-arm@freebsd.org" Content-Transfer-Encoding: quoted-printable Message-Id: <2B7A227B-245F-4F1B-A700-263C3FE56B68@freebsd.org> References: To: Dmitry Skorodumov X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED,BAYES_00 autolearn=disabled version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mail-n.franken.de X-Rspamd-Queue-Id: 4FPzB84Spnz3q11 X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; ASN(0.00)[asn:680, ipnet:2001:638::/32, country:DE]; local_wl_from(0.00)[freebsd.org] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Porting FreeBSD to ARM processors List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Apr 2021 22:38:57 -0000 > On 21. Apr 2021, at 00:02, Dmitry Skorodumov via freebsd-arm = wrote: >=20 > Hi >=20 >=20 > It looks like code for gic-v2 in FreeBSD not quite correctly relies on = implementation defined behaviour of GIC. >=20 > The = gic 2.0 spec https://developer.arm.com/documentation/ihi0048/bb = chapter 3.2.2 "Interrupt controls in the GIC" states the following: >=20 > "Whether SGIs are permanently enabled, or can be enabled and disabled = by writes to the GICD_ISENABLERn and GICD_ICENABLERn, is IMPLEMENTATION = DEFINED." >=20 > But code in sys/arm/arm/gic.c assumes that SGI are always enabled and = doesn't configure them at initialization. They are initialized only for = secondary CPUs - in arm_gic_init_secondary(). >=20 > For sure it is a rather minor issue, since all appears to be ok in = gic-v3 (v3 code enables SGIs for all CPUs, including the boot one). And = even if platform supports only gic-v2, likely SGIs are always enabled = anyway. So, my post is rather pedantic notice without real life case. Dear all, if I understand things correctly, the problem described is the cause = which does not allow to use more than one CPU core in FreeBSD when running on Parallels = Desktop on an M1 based Mac. It runs perfectly well with one core, but with multiple = cores it locks up during boot. It would be great if some could propose a patch. I would be more than = happy to test it. Best regards Michael >=20 > Dmitry > _______________________________________________ > freebsd-arm@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-arm > To unsubscribe, send any mail to "freebsd-arm-unsubscribe@freebsd.org" From owner-freebsd-arm@freebsd.org Wed Apr 21 00:40:35 2021 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9D2575EF700 for ; Wed, 21 Apr 2021 00:40:35 +0000 (UTC) (envelope-from greg@unrelenting.technology) Received: from out0.migadu.com (out0.migadu.com [IPv6:2001:41d0:2:267::]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FQ1tT3SFXz3vgk; Wed, 21 Apr 2021 00:40:32 +0000 (UTC) (envelope-from greg@unrelenting.technology) Date: Wed, 21 Apr 2021 00:40:22 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=unrelenting.technology; s=key1; t=1618965625; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ax1p0P1zvAEI4X+KTDBF73hSy99VCHsYfCzgi57Yxlg=; b=SbwS1HvgrZYQRGxG+DSHVfibdCNY1yrjksAHxKXd1263mx58GNQtszn0F/f2hfYLDd/bMO K7sbM95jlZwv1b4OLeG0h6scPHfwVNxTdONXYzjfDIKJRYx3+i0U0A/tHek5iyoPn0aHG3 xrt2V2eSrNKIdTTIl6WREwGWo9t4T4XlztkQli+AoKsWC2cxcfB9XfvWac2iYJc79macQk OfJNUKylyWiM4R/XOkQjV9FOwBuCPLKkftiwVNdZ+J8kgpDnaNCurOOeqv+/0L0A0kOMRO p5RIIaDzEYAsIN4pWr6+fJav1cZq/AHYx90N2cvNDQwRpvduuI0Sl427Oq1Fmg== X-Report-Abuse: Please report any abuse attempt to abuse@migadu.com and include these headers. From: Greg V To: freebsd-arm@freebsd.org, Michael Tuexen , Dmitry Skorodumov Subject: Re: gic-v2 and SGI interrupts on boot CPU In-Reply-To: <2B7A227B-245F-4F1B-A700-263C3FE56B68@freebsd.org> References: <2B7A227B-245F-4F1B-A700-263C3FE56B68@freebsd.org> Message-ID: <13A8B0FE-6300-4980-8DA9-49C7A37840CC@unrelenting.technology> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Migadu-Flow: FLOW_OUT X-Migadu-Auth-User: greg@unrelenting.technology X-Rspamd-Queue-Id: 4FQ1tT3SFXz3vgk X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=unrelenting.technology header.s=key1 header.b=SbwS1Hvg; dmarc=pass (policy=none) header.from=unrelenting.technology; spf=pass (mx1.freebsd.org: domain of greg@unrelenting.technology designates 2001:41d0:2:267:: as permitted sender) smtp.mailfrom=greg@unrelenting.technology X-Spamd-Result: default: False [-4.00 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[unrelenting.technology:s=key1]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2001:41d0:2:267::]; MIME_GOOD(-0.10)[text/plain]; NEURAL_HAM_LONG(-1.00)[-1.000]; SPAMHAUS_ZRD(0.00)[2001:41d0:2:267:::from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[unrelenting.technology:+]; DMARC_POLICY_ALLOW(-0.50)[unrelenting.technology,none]; NEURAL_HAM_SHORT(-1.00)[-0.996]; RCVD_COUNT_ZERO(0.00)[0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[2001:41d0:2:267:::from]; ASN(0.00)[asn:16276, ipnet:2001:41d0::/32, country:FR]; MID_RHS_MATCH_FROM(0.00)[]; MAILMAN_DEST(0.00)[freebsd-arm] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Porting FreeBSD to ARM processors List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Apr 2021 00:40:35 -0000 On April 20, 2021 10:38:44 PM UTC, Michael Tuexen w= rote: >> On 21=2E Apr 2021, at 00:02, Dmitry Skorodumov via freebsd-arm wrote: >>=20 >> Hi >>=20 >>=20 >> It looks like code for gic-v2 in FreeBSD not quite correctly relies on = implementation defined behaviour of GIC=2E >>=20 >> The gic 2=2E0 spec https://developer=2Earm=2Ecom/documentation/i= hi0048/bb chapter 3=2E2=2E2 "Interrupt controls in the GIC" states the foll= owing: >>=20 >> "Whether SGIs are permanently enabled, or can be enabled and disabled b= y writes to the GICD_ISENABLERn and GICD_ICENABLERn, is IMPLEMENTATION DEFI= NED=2E" >>=20 >> But code in sys/arm/arm/gic=2Ec assumes that SGI are always enabled and= doesn't configure them at initialization=2E They are initialized only for = secondary CPUs - in arm_gic_init_secondary()=2E >>=20 >> For sure it is a rather minor issue, since all appears to be ok in gic-= v3 (v3 code enables SGIs for all CPUs, including the boot one)=2E And even = if platform supports only gic-v2, likely SGIs are always enabled anyway=2E = So, my post is rather pedantic notice without real life case=2E >Dear all, > >if I understand things correctly, the problem described is the cause whic= h does not >allow to use more than one CPU core in FreeBSD when running on Parallels = Desktop on >an M1 based Mac=2E It runs perfectly well with one core, but with multipl= e cores it >locks up during boot=2E Hmm if I'm reading it correctly, the gicv2 driver *does* do this on second= ary CPUs, just not on the boot one=2E Which doesn't sound like something th= at would cause SMP boot to break but single-core to still work=2E Seems like people using QEMU with Hypervisor=2Eframework patches do have S= MP working fine: https://gist=2Egithub=2Ecom/ctsrc/a1f57933a2cde9abc0f07be12889f97f so go b= other Parallels about their bugs ;) From owner-freebsd-arm@freebsd.org Wed Apr 21 03:00:03 2021 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 6E35D5F29A8 for ; Wed, 21 Apr 2021 03:00:03 +0000 (UTC) (envelope-from freebsd-arm@darkain.com) Received: from MTA-07-4.privateemail.com (mta-07-4.privateemail.com [68.65.122.27]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FQ4zQ4Rwdz4W1k; Wed, 21 Apr 2021 03:00:02 +0000 (UTC) (envelope-from freebsd-arm@darkain.com) Received: from MTA-07.privateemail.com (localhost [127.0.0.1]) by MTA-07.privateemail.com (Postfix) with ESMTP id 7D8FC6004F; Tue, 20 Apr 2021 22:59:59 -0400 (EDT) Received: from mail-lf1-f51.google.com (unknown [10.20.151.223]) by MTA-07.privateemail.com (Postfix) with ESMTPA id E0E4660034; Tue, 20 Apr 2021 22:59:58 -0400 (EDT) Received: by mail-lf1-f51.google.com with SMTP id d27so7765272lfv.9; Tue, 20 Apr 2021 19:59:58 -0700 (PDT) X-Gm-Message-State: AOAM533H691OSHGw9Zts2cSdj/sPkIAQpPggMUk8+0TOs+YHoHtUE86u oC/B/sUUQmh2NEwz5QfzT5rUYzSTsAs5tO15F+0= X-Google-Smtp-Source: ABdhPJwu4IJLkBH6dmPB/Cgb5EIWYsd4CnnGXRCFlHOTJHH0F8eMofjvniXJEvXrPXlaWJGy+DCvW/o4x3JtnqmmSU4= X-Received: by 2002:a05:6512:2114:: with SMTP id q20mr17802824lfr.1.1618973997292; Tue, 20 Apr 2021 19:59:57 -0700 (PDT) MIME-Version: 1.0 References: <2B7A227B-245F-4F1B-A700-263C3FE56B68@freebsd.org> <13A8B0FE-6300-4980-8DA9-49C7A37840CC@unrelenting.technology> In-Reply-To: <13A8B0FE-6300-4980-8DA9-49C7A37840CC@unrelenting.technology> From: Vincent Milum Jr Date: Tue, 20 Apr 2021 19:59:45 -0700 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: gic-v2 and SGI interrupts on boot CPU To: Greg V Cc: freebsd-arm@freebsd.org, Michael Tuexen , Dmitry Skorodumov X-Virus-Scanned: ClamAV using ClamSMTP X-Rspamd-Queue-Id: 4FQ4zQ4Rwdz4W1k X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of freebsd-arm@darkain.com designates 68.65.122.27 as permitted sender) smtp.mailfrom=freebsd-arm@darkain.com X-Spamd-Result: default: False [-3.30 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:68.65.122.0/27]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; DMARC_NA(0.00)[darkain.com]; RBL_DBL_DONT_QUERY_IPS(0.00)[68.65.122.27:from]; SPAMHAUS_ZRD(0.00)[68.65.122.27:from:127.0.2.255]; RCVD_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCVD_IN_DNSWL_NONE(0.00)[68.65.122.27:from]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:22612, ipnet:68.65.122.0/24, country:US]; RCVD_TLS_LAST(0.00)[]; MAILMAN_DEST(0.00)[freebsd-arm] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Porting FreeBSD to ARM processors List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Apr 2021 03:00:03 -0000 This may actually be related to the Parallels issue. We had a similar issue with ESXi ARM Fling initially where it would only work on 1 vCPU but not more, and it was related to the GIC code. This very much is worth investigating for getting FreeBSD functional under Parallels! Oh, and yes, I've bothered Parallels a lot... I unofficially got a reply essentially stating that the bug "isn't a priority" (they primarily care about Windows VMs and seems to only marginally care about Linux, with FreeBSD and other OSes not even remotely in their sights) On Tue, Apr 20, 2021 at 5:40 PM Greg V wrote: > > > On April 20, 2021 10:38:44 PM UTC, Michael Tuexen > wrote: > >> On 21. Apr 2021, at 00:02, Dmitry Skorodumov via freebsd-arm < > freebsd-arm@freebsd.org> wrote: > >> > >> Hi > >> > >> > >> It looks like code for gic-v2 in FreeBSD not quite correctly relies on > implementation defined behaviour of GIC. > >> > >> The > gic > 2.0 spec https://developer.arm.com/documentation/ihi0048/bb chapter 3.2.2 > "Interrupt controls in the GIC" states the following: > >> > >> "Whether SGIs are permanently enabled, or can be enabled and disabled > by writes to the GICD_ISENABLERn and GICD_ICENABLERn, is IMPLEMENTATION > DEFINED." > >> > >> But code in sys/arm/arm/gic.c assumes that SGI are always enabled and > doesn't configure them at initialization. They are initialized only for > secondary CPUs - in arm_gic_init_secondary(). > >> > >> For sure it is a rather minor issue, since all appears to be ok in > gic-v3 (v3 code enables SGIs for all CPUs, including the boot one). And > even if platform supports only gic-v2, likely SGIs are always enabled > anyway. So, my post is rather pedantic notice without real life case. > >Dear all, > > > >if I understand things correctly, the problem described is the cause > which does not > >allow to use more than one CPU core in FreeBSD when running on Parallels > Desktop on > >an M1 based Mac. It runs perfectly well with one core, but with multiple > cores it > >locks up during boot. > > Hmm if I'm reading it correctly, the gicv2 driver *does* do this on > secondary CPUs, just not on the boot one. Which doesn't sound like > something that would cause SMP boot to break but single-core to still work. > > Seems like people using QEMU with Hypervisor.framework patches do have SMP > working fine: > https://gist.github.com/ctsrc/a1f57933a2cde9abc0f07be12889f97f so go > bother Parallels about their bugs ;) > _______________________________________________ > freebsd-arm@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-arm > To unsubscribe, send any mail to "freebsd-arm-unsubscribe@freebsd.org" > From owner-freebsd-arm@freebsd.org Wed Apr 21 04:34:54 2021 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1378C5F5DF7 for ; Wed, 21 Apr 2021 04:34:54 +0000 (UTC) (envelope-from freebsd-arm@darkain.com) Received: from MTA-12-4.privateemail.com (mta-12-4.privateemail.com [198.54.127.107]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FQ74s2Ptnz4bdh; Wed, 21 Apr 2021 04:34:52 +0000 (UTC) (envelope-from freebsd-arm@darkain.com) Received: from mta-12.privateemail.com (localhost [127.0.0.1]) by mta-12.privateemail.com (Postfix) with ESMTP id 5D06980083; Wed, 21 Apr 2021 00:34:51 -0400 (EDT) Received: from mail-lj1-f182.google.com (unknown [10.20.151.243]) by mta-12.privateemail.com (Postfix) with ESMTPA id B0CF38007E; Wed, 21 Apr 2021 00:34:50 -0400 (EDT) Received: by mail-lj1-f182.google.com with SMTP id a5so9191372ljk.0; Tue, 20 Apr 2021 21:34:50 -0700 (PDT) X-Gm-Message-State: AOAM532BrAJaUkD2bSoXfqXdMnz9OcrxKxB9QBLplit2LwxByMclZaac aBDYRu85dsHfnYEqHPVWG+bGhR16pyhQv4HrSAY= X-Google-Smtp-Source: ABdhPJynovTqHmMUBmE+vU/1/UxL97C/aYQ+h1QSwE+XLjHmJhr3Hb/nyCr44m/o+E5zCxvzMmtX4+kDJCMLEZYk7xE= X-Received: by 2002:a05:651c:1306:: with SMTP id u6mr17853576lja.197.1618979689057; Tue, 20 Apr 2021 21:34:49 -0700 (PDT) MIME-Version: 1.0 References: <2B7A227B-245F-4F1B-A700-263C3FE56B68@freebsd.org> <13A8B0FE-6300-4980-8DA9-49C7A37840CC@unrelenting.technology> In-Reply-To: From: Vincent Milum Jr Date: Tue, 20 Apr 2021 21:34:27 -0700 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: gic-v2 and SGI interrupts on boot CPU To: Greg V Cc: freebsd-arm@freebsd.org, Michael Tuexen , Dmitry Skorodumov X-Virus-Scanned: ClamAV using ClamSMTP X-Rspamd-Queue-Id: 4FQ74s2Ptnz4bdh X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of freebsd-arm@darkain.com designates 198.54.127.107 as permitted sender) smtp.mailfrom=freebsd-arm@darkain.com X-Spamd-Result: default: False [-3.28 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:198.54.127.96/27]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; DMARC_NA(0.00)[darkain.com]; RWL_MAILSPIKE_VERYGOOD(0.00)[198.54.127.107:from]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCVD_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-0.98)[-0.977]; RCVD_IN_DNSWL_NONE(0.00)[198.54.127.107:from]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:22612, ipnet:198.54.127.0/24, country:US]; RCVD_TLS_LAST(0.00)[]; MAILMAN_DEST(0.00)[freebsd-arm] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Porting FreeBSD to ARM processors List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Apr 2021 04:34:54 -0000 Doing some more digging, I came across this post from a while ago. https://reviews.freebsd.org/D26975 I just built a kernel with this patch, and am now running 8 vCPUs under Parallels on my MacBook Air M1. You can see evidence of it here! https://twitter.com/DarkainMX/status/1384724684902600706 On Tue, Apr 20, 2021 at 7:59 PM Vincent Milum Jr wrote: > This may actually be related to the Parallels issue. We had a similar > issue with ESXi ARM Fling initially where it would only work on 1 vCPU but > not more, and it was related to the GIC code. This very much is worth > investigating for getting FreeBSD functional under Parallels! > > Oh, and yes, I've bothered Parallels a lot... I unofficially got a reply > essentially stating that the bug "isn't a priority" (they primarily care > about Windows VMs and seems to only marginally care about Linux, with > FreeBSD and other OSes not even remotely in their sights) > > On Tue, Apr 20, 2021 at 5:40 PM Greg V > wrote: > >> >> >> On April 20, 2021 10:38:44 PM UTC, Michael Tuexen >> wrote: >> >> On 21. Apr 2021, at 00:02, Dmitry Skorodumov via freebsd-arm < >> freebsd-arm@freebsd.org> wrote: >> >> >> >> Hi >> >> >> >> >> >> It looks like code for gic-v2 in FreeBSD not quite correctly relies on >> implementation defined behaviour of GIC. >> >> >> >> The >> gic >> 2.0 spec https://developer.arm.com/documentation/ihi0048/bb chapter >> 3.2.2 "Interrupt controls in the GIC" states the following: >> >> >> >> "Whether SGIs are permanently enabled, or can be enabled and disabled >> by writes to the GICD_ISENABLERn and GICD_ICENABLERn, is IMPLEMENTATION >> DEFINED." >> >> >> >> But code in sys/arm/arm/gic.c assumes that SGI are always enabled and >> doesn't configure them at initialization. They are initialized only for >> secondary CPUs - in arm_gic_init_secondary(). >> >> >> >> For sure it is a rather minor issue, since all appears to be ok in >> gic-v3 (v3 code enables SGIs for all CPUs, including the boot one). And >> even if platform supports only gic-v2, likely SGIs are always enabled >> anyway. So, my post is rather pedantic notice without real life case. >> >Dear all, >> > >> >if I understand things correctly, the problem described is the cause >> which does not >> >allow to use more than one CPU core in FreeBSD when running on Parallels >> Desktop on >> >an M1 based Mac. It runs perfectly well with one core, but with multiple >> cores it >> >locks up during boot. >> >> Hmm if I'm reading it correctly, the gicv2 driver *does* do this on >> secondary CPUs, just not on the boot one. Which doesn't sound like >> something that would cause SMP boot to break but single-core to still work. >> >> Seems like people using QEMU with Hypervisor.framework patches do have >> SMP working fine: >> https://gist.github.com/ctsrc/a1f57933a2cde9abc0f07be12889f97f so go >> bother Parallels about their bugs ;) >> _______________________________________________ >> freebsd-arm@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-arm >> To unsubscribe, send any mail to "freebsd-arm-unsubscribe@freebsd.org" >> > From owner-freebsd-arm@freebsd.org Wed Apr 21 06:44:34 2021 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 951CE5F92B4 for ; Wed, 21 Apr 2021 06:44:34 +0000 (UTC) (envelope-from tuexen@freebsd.org) Received: from drew.franken.de (mail-n.franken.de [193.175.24.27]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.franken.de", Issuer "Sectigo RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FQ9yV0wX4z4hT3 for ; Wed, 21 Apr 2021 06:44:33 +0000 (UTC) (envelope-from tuexen@freebsd.org) Received: from [172.20.10.3] (ip-109-41-66-199.web.vodafone.de [109.41.66.199]) (Authenticated sender: macmic) by mail-n.franken.de (Postfix) with ESMTPSA id 7D6AE7B6A02F2; Wed, 21 Apr 2021 08:44:29 +0200 (CEST) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: gic-v2 and SGI interrupts on boot CPU From: Michael Tuexen In-Reply-To: <13A8B0FE-6300-4980-8DA9-49C7A37840CC@unrelenting.technology> Date: Wed, 21 Apr 2021 08:44:25 +0200 Cc: freebsd-arm@freebsd.org, Dmitry Skorodumov Content-Transfer-Encoding: quoted-printable Message-Id: References: <2B7A227B-245F-4F1B-A700-263C3FE56B68@freebsd.org> <13A8B0FE-6300-4980-8DA9-49C7A37840CC@unrelenting.technology> To: Greg V X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED,BAYES_00, URIBL_BLOCKED autolearn=disabled version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mail-n.franken.de X-Rspamd-Queue-Id: 4FQ9yV0wX4z4hT3 X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; local_wl_from(0.00)[freebsd.org]; ASN(0.00)[asn:680, ipnet:193.174.0.0/15, country:DE] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Porting FreeBSD to ARM processors List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Apr 2021 06:44:34 -0000 > On 21. Apr 2021, at 02:40, Greg V wrote: >=20 >=20 >=20 > On April 20, 2021 10:38:44 PM UTC, Michael Tuexen = wrote: >>> On 21. Apr 2021, at 00:02, Dmitry Skorodumov via freebsd-arm = wrote: >>>=20 >>> Hi >>>=20 >>>=20 >>> It looks like code for gic-v2 in FreeBSD not quite correctly relies = on implementation defined behaviour of GIC. >>>=20 >>> The = gic 2.0 spec https://developer.arm.com/documentation/ihi0048/bb = chapter 3.2.2 "Interrupt controls in the GIC" states the following: >>>=20 >>> "Whether SGIs are permanently enabled, or can be enabled and = disabled by writes to the GICD_ISENABLERn and GICD_ICENABLERn, is = IMPLEMENTATION DEFINED." >>>=20 >>> But code in sys/arm/arm/gic.c assumes that SGI are always enabled = and doesn't configure them at initialization. They are initialized only = for secondary CPUs - in arm_gic_init_secondary(). >>>=20 >>> For sure it is a rather minor issue, since all appears to be ok in = gic-v3 (v3 code enables SGIs for all CPUs, including the boot one). And = even if platform supports only gic-v2, likely SGIs are always enabled = anyway. So, my post is rather pedantic notice without real life case. >> Dear all, >>=20 >> if I understand things correctly, the problem described is the cause = which does not >> allow to use more than one CPU core in FreeBSD when running on = Parallels Desktop on >> an M1 based Mac. It runs perfectly well with one core, but with = multiple cores it >> locks up during boot. >=20 > Hmm if I'm reading it correctly, the gicv2 driver *does* do this on = secondary CPUs, just not on the boot one. Which doesn't sound like = something that would cause SMP boot to break but single-core to still = work. >=20 > Seems like people using QEMU with Hypervisor.framework patches do have = SMP working fine: > https://gist.github.com/ctsrc/a1f57933a2cde9abc0f07be12889f97f so go = bother Parallels about their bugs ;) I reported the issue in = https://forum.parallels.com/threads/freebsd-support.352663/ and Dmitry = said that they found the issue and fixed it within Parallels, so FreeBSD 13 = will be supported by a future update of Parallels. But since the cause is based on an = implementation depended behaviour and FreeBSD seems to assume one particular one, I suggested to report it = here. So I think the argument that there is some platform, which works, does not imply that = the FreeBSD behaviour is correct. As Vincent figured out, a potential fix for FreeBSD is in = https://reviews.freebsd.org/D26975. I can't comment on if the patch is architecturally correct, I can confirm that = it resolves the problem. Best regards Michael From owner-freebsd-arm@freebsd.org Wed Apr 21 06:48:37 2021 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E22465F92FE for ; Wed, 21 Apr 2021 06:48:37 +0000 (UTC) (envelope-from tuexen@freebsd.org) Received: from drew.franken.de (mail-n.franken.de [193.175.24.27]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.franken.de", Issuer "Sectigo RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FQB394ynXz4hg8 for ; Wed, 21 Apr 2021 06:48:37 +0000 (UTC) (envelope-from tuexen@freebsd.org) Received: from [172.20.10.3] (ip-109-41-66-199.web.vodafone.de [109.41.66.199]) (Authenticated sender: macmic) by mail-n.franken.de (Postfix) with ESMTPSA id 727967BE902A1; Wed, 21 Apr 2021 08:48:34 +0200 (CEST) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: gic-v2 and SGI interrupts on boot CPU From: Michael Tuexen In-Reply-To: Date: Wed, 21 Apr 2021 08:48:30 +0200 Cc: Greg V , freebsd-arm@freebsd.org, Dmitry Skorodumov Content-Transfer-Encoding: quoted-printable Message-Id: <87287CF3-3B7E-49CF-8186-490BAFD9E18A@freebsd.org> References: <2B7A227B-245F-4F1B-A700-263C3FE56B68@freebsd.org> <13A8B0FE-6300-4980-8DA9-49C7A37840CC@unrelenting.technology> To: Vincent Milum Jr X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED,BAYES_00, URIBL_BLOCKED autolearn=disabled version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mail-n.franken.de X-Rspamd-Queue-Id: 4FQB394ynXz4hg8 X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; local_wl_from(0.00)[freebsd.org]; ASN(0.00)[asn:680, ipnet:193.174.0.0/15, country:DE] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Porting FreeBSD to ARM processors List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Apr 2021 06:48:37 -0000 > On 21. Apr 2021, at 04:59, Vincent Milum Jr = wrote: >=20 > This may actually be related to the Parallels issue. We had a similar = issue with ESXi ARM Fling initially where it would only work on 1 vCPU = but not more, and it was related to the GIC code. This very much is = worth investigating for getting FreeBSD functional under Parallels! >=20 > Oh, and yes, I've bothered Parallels a lot... I unofficially got a = reply essentially stating that the bug "isn't a priority" (they = primarily care about Windows VMs and seems to only marginally care about = Linux, with FreeBSD and other OSes not even remotely in their sights) Eventually they looked into the issue = https://forum.parallels.com/threads/freebsd-support.352663/, figured out what is going wrong and will fix it in their code base...=20 I can understand that they have to prioritise on which guest OS they = focus first. So I'm happy now. Best regards Michael >=20 > On Tue, Apr 20, 2021 at 5:40 PM Greg V = wrote: >=20 >=20 > On April 20, 2021 10:38:44 PM UTC, Michael Tuexen = wrote: > >> On 21. Apr 2021, at 00:02, Dmitry Skorodumov via freebsd-arm = wrote: > >>=20 > >> Hi > >>=20 > >>=20 > >> It looks like code for gic-v2 in FreeBSD not quite correctly relies = on implementation defined behaviour of GIC. > >>=20 > >> The = gic 2.0 spec https://developer.arm.com/documentation/ihi0048/bb = chapter 3.2.2 "Interrupt controls in the GIC" states the following: > >>=20 > >> "Whether SGIs are permanently enabled, or can be enabled and = disabled by writes to the GICD_ISENABLERn and GICD_ICENABLERn, is = IMPLEMENTATION DEFINED." > >>=20 > >> But code in sys/arm/arm/gic.c assumes that SGI are always enabled = and doesn't configure them at initialization. They are initialized only = for secondary CPUs - in arm_gic_init_secondary(). > >>=20 > >> For sure it is a rather minor issue, since all appears to be ok in = gic-v3 (v3 code enables SGIs for all CPUs, including the boot one). And = even if platform supports only gic-v2, likely SGIs are always enabled = anyway. So, my post is rather pedantic notice without real life case. > >Dear all, > > > >if I understand things correctly, the problem described is the cause = which does not > >allow to use more than one CPU core in FreeBSD when running on = Parallels Desktop on > >an M1 based Mac. It runs perfectly well with one core, but with = multiple cores it > >locks up during boot. >=20 > Hmm if I'm reading it correctly, the gicv2 driver *does* do this on = secondary CPUs, just not on the boot one. Which doesn't sound like = something that would cause SMP boot to break but single-core to still = work. >=20 > Seems like people using QEMU with Hypervisor.framework patches do have = SMP working fine: > https://gist.github.com/ctsrc/a1f57933a2cde9abc0f07be12889f97f so go = bother Parallels about their bugs ;) > _______________________________________________ > freebsd-arm@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-arm > To unsubscribe, send any mail to "freebsd-arm-unsubscribe@freebsd.org" From owner-freebsd-arm@freebsd.org Wed Apr 21 06:49:49 2021 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0A7C35F9559 for ; Wed, 21 Apr 2021 06:49:49 +0000 (UTC) (envelope-from tuexen@freebsd.org) Received: from drew.franken.de (mail-n.franken.de [193.175.24.27]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.franken.de", Issuer "Sectigo RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FQB4X5qjbz4j3D for ; Wed, 21 Apr 2021 06:49:48 +0000 (UTC) (envelope-from tuexen@freebsd.org) Received: from [172.20.10.3] (ip-109-41-66-199.web.vodafone.de [109.41.66.199]) (Authenticated sender: macmic) by mail-n.franken.de (Postfix) with ESMTPSA id 9813F7BE902A1; Wed, 21 Apr 2021 08:49:45 +0200 (CEST) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: gic-v2 and SGI interrupts on boot CPU From: Michael Tuexen In-Reply-To: Date: Wed, 21 Apr 2021 08:49:41 +0200 Cc: Greg V , freebsd-arm@freebsd.org, Dmitry Skorodumov Content-Transfer-Encoding: quoted-printable Message-Id: <4EC14700-BDC9-4447-8895-370AE82D5DC7@freebsd.org> References: <2B7A227B-245F-4F1B-A700-263C3FE56B68@freebsd.org> <13A8B0FE-6300-4980-8DA9-49C7A37840CC@unrelenting.technology> To: Vincent Milum Jr X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED,BAYES_00, URIBL_BLOCKED autolearn=disabled version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mail-n.franken.de X-Rspamd-Queue-Id: 4FQB4X5qjbz4j3D X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; local_wl_from(0.00)[freebsd.org]; ASN(0.00)[asn:680, ipnet:193.174.0.0/15, country:DE] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Porting FreeBSD to ARM processors List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Apr 2021 06:49:49 -0000 > On 21. Apr 2021, at 06:34, Vincent Milum Jr = wrote: >=20 > Doing some more digging, I came across this post from a while ago. >=20 > https://reviews.freebsd.org/D26975 >=20 > I just built a kernel with this patch, and am now running 8 vCPUs = under Parallels on my MacBook Air M1. I can also confirm that the patch fixes the issue. Thanks a lot for = finding the patch! Best regards Michael >=20 > You can see evidence of it here! >=20 > https://twitter.com/DarkainMX/status/1384724684902600706 >=20 > On Tue, Apr 20, 2021 at 7:59 PM Vincent Milum Jr = wrote: > This may actually be related to the Parallels issue. We had a similar = issue with ESXi ARM Fling initially where it would only work on 1 vCPU = but not more, and it was related to the GIC code. This very much is = worth investigating for getting FreeBSD functional under Parallels! >=20 > Oh, and yes, I've bothered Parallels a lot... I unofficially got a = reply essentially stating that the bug "isn't a priority" (they = primarily care about Windows VMs and seems to only marginally care about = Linux, with FreeBSD and other OSes not even remotely in their sights) >=20 > On Tue, Apr 20, 2021 at 5:40 PM Greg V = wrote: >=20 >=20 > On April 20, 2021 10:38:44 PM UTC, Michael Tuexen = wrote: > >> On 21. Apr 2021, at 00:02, Dmitry Skorodumov via freebsd-arm = wrote: > >>=20 > >> Hi > >>=20 > >>=20 > >> It looks like code for gic-v2 in FreeBSD not quite correctly relies = on implementation defined behaviour of GIC. > >>=20 > >> The = gic 2.0 spec https://developer.arm.com/documentation/ihi0048/bb = chapter 3.2.2 "Interrupt controls in the GIC" states the following: > >>=20 > >> "Whether SGIs are permanently enabled, or can be enabled and = disabled by writes to the GICD_ISENABLERn and GICD_ICENABLERn, is = IMPLEMENTATION DEFINED." > >>=20 > >> But code in sys/arm/arm/gic.c assumes that SGI are always enabled = and doesn't configure them at initialization. They are initialized only = for secondary CPUs - in arm_gic_init_secondary(). > >>=20 > >> For sure it is a rather minor issue, since all appears to be ok in = gic-v3 (v3 code enables SGIs for all CPUs, including the boot one). And = even if platform supports only gic-v2, likely SGIs are always enabled = anyway. So, my post is rather pedantic notice without real life case. > >Dear all, > > > >if I understand things correctly, the problem described is the cause = which does not > >allow to use more than one CPU core in FreeBSD when running on = Parallels Desktop on > >an M1 based Mac. It runs perfectly well with one core, but with = multiple cores it > >locks up during boot. >=20 > Hmm if I'm reading it correctly, the gicv2 driver *does* do this on = secondary CPUs, just not on the boot one. Which doesn't sound like = something that would cause SMP boot to break but single-core to still = work. >=20 > Seems like people using QEMU with Hypervisor.framework patches do have = SMP working fine: > https://gist.github.com/ctsrc/a1f57933a2cde9abc0f07be12889f97f so go = bother Parallels about their bugs ;) > _______________________________________________ > freebsd-arm@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-arm > To unsubscribe, send any mail to "freebsd-arm-unsubscribe@freebsd.org" From owner-freebsd-arm@freebsd.org Thu Apr 22 01:08:51 2021 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 32B2E5F77D7 for ; Thu, 22 Apr 2021 01:08:51 +0000 (UTC) (envelope-from kiri@truefc.org) Received: from kx.truefc.org (1.212.52.36.ap.yournet.ne.jp [36.52.212.1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp", Issuer "smtp" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FQfSd6kRTz4g3P for ; Thu, 22 Apr 2021 01:08:49 +0000 (UTC) (envelope-from kiri@truefc.org) Received: from kx.truefc.org (kx.truefc.org [36.52.212.1]) by kx.truefc.org (8.16.1/8.16.1) with ESMTP id 13M18dvG021683; Thu, 22 Apr 2021 10:08:39 +0900 (JST) (envelope-from kiri@kx.truefc.org) Message-Id: <202104220108.13M18dvG021683@kx.truefc.org> Date: Thu, 22 Apr 2021 10:08:39 +0900 From: KIRIYAMA Kazuhiko To: freebsd-arm@freebsd.org Cc: kiri@truefc.org Subject: How to build packages on PBP ? User-Agent: Wanderlust/2.15.9 (Almost Unreal) SEMI/1.14.6 (Maruoka) FLIM/1.14.9 (=?ISO-8859-4?Q?Goj=F2?=) APEL/10.8 MULE XEmacs/21.4 (patch 24) (Standard C) (amd64--freebsd) MIME-Version: 1.0 (generated by SEMI 1.14.6 - "Maruoka") Content-Type: text/plain; charset=US-ASCII X-Rspamd-Queue-Id: 4FQfSd6kRTz4g3P X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of kiri@truefc.org has no SPF policy when checking 36.52.212.1) smtp.mailfrom=kiri@truefc.org X-Spamd-Result: default: False [-0.90 / 15.00]; ARC_NA(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[36.52.212.1:from]; FREEFALL_USER(0.00)[kiri]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[truefc.org]; AUTH_NA(1.00)[]; SPAMHAUS_ZRD(0.00)[36.52.212.1:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCPT_COUNT_TWO(0.00)[2]; RCVD_COUNT_ONE(0.00)[1]; R_SPF_NA(0.00)[no SPF record]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:10013, ipnet:36.52.208.0/21, country:JP]; SUBJECT_ENDS_QUESTION(1.00)[]; MAILMAN_DEST(0.00)[freebsd-arm]; ONCE_RECEIVED(0.10)[] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Porting FreeBSD to ARM processors List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Apr 2021 01:08:51 -0000 Hi, all I'm tring to build packages for my desktop use on pineboookpro (PBP), but suddenly crashed during compiled devel/llvm10 and failed to build llvm10-10.0.1_5.txz. The reason why I guess was for too heavy to process to compile llvm10 because it's load average was over 6.0 ! My building environments on PBP are as follows : root@kazu:~ # uname -a FreeBSD kazu.tfc 14.0-CURRENT FreeBSD 14.0-CURRENT #0 n245456-9db44a8e5da9: Thu Mar 18 15:31:29 JST 2021 root@tbedfc:/usr/obj/usr/src/arm64.aarch64/sys/GENERIC arm64 root@kazu:~ # df -h Filesystem Size Used Avail Capacity Mounted on /dev/mmcsd0p3 105G 3.9G 93G 4% / devfs 1.0K 1.0K 0B 100% /dev tmpfs 11G 4.0K 11G 0% /compat/linux/dev/shm linprocfs 4.0K 4.0K 0B 100% /compat/linux/proc devfs 1.0K 1.0K 0B 100% /compat/linux/dev fdescfs 1.0K 1.0K 0B 100% /compat/linux/dev/fd tmpfs 11G 4.0K 11G 0% /compat/linux/dev/shm vm.tfc:/.dake 12T 920G 11T 8% /.dake vm.tfc:/ds/src/freebsd/current/14.0/9db44a8e5da9 11T 59G 11T 1% /usr/src vm.tfc:/ds/obj/freebsd/current/14.0/9db44a8e5da9 11T 419G 11T 4% /usr/obj vm.tfc:/ds/ports/freebsd/ce3df03f4223 11T 88G 11T 1% /usr/ports vm.tfc:/ds/distfiles 11T 43G 11T 0% /var/ports/distfiles vm.tfc:/ds/packages/freebsd/arm64/aarch64/14.0C/9db44a8e5da9/ce3df03f4223 11T 92G 11T 1% /var/ports/packages root@kazu:~ # cat /etc/make.conf PORTSDIR= /var/ports/lpbpkx INDEXDIR= /var/ports/lpbpkx WRKDIRPREFIX= /var/ports/work PACKAGES= /var/ports/packages DISTDIR= /var/ports/distfiles BATCH= yes DEFAULT_VERSIONS= perl5=5.32 ruby=2.7 COMPILER_TYPE= clang USE_PACKAGE_DEPENDS= yes DISABLE_VULNERABILITIES=yes root@kazu:~ # git -C /usr/ports rev-parse --verify --short HEAD ce3df03f4223 root@kazu:~ # ifconfig lo0: flags=8049 metric 0 mtu 16384 options=680003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x1 inet 127.0.0.1 netmask 0xff000000 groups: lo nd6 options=21 ue0: flags=8843 metric 0 mtu 1500 options=80008 ether 00:24:a5:9b:81:97 inet 192.168.1.65 netmask 0xffffff00 broadcast 192.168.1.255 media: Ethernet autoselect (100baseTX ) status: active nd6 options=29 root@kazu:~ # cat /etc/rc.conf defaultrouter="192.168.1.254" hostname="kazu.tfc" ifconfig_ue0="inet 192.168.1.65 netmask 255.255.255.0" nfs_client_enable="YES" rpc_lockd_enable="YES" rpc_statd_enable="YES" saver="logo" sendmail_enable="YES" sshd_enable="YES" ntpd_enable="YES" usbd_enable="YES" usb_load="YES" #keymap="jp.106" moused_enable="YES" powerd_enable="YES" dumpdev="AUTO" linux_enable="YES" root@kazu:~ # kldstat Id Refs Address Size Name 1 49 0xffff000000000000 1286280 kernel 2 1 0xffff000001287000 26ed8 ums.ko 3 1 0xffff0000012af000 25138 uhid.ko 4 1 0xffff0000012d5000 25c78 wmt.ko 5 1 0xffff0000e5400000 29000 linprocfs.ko 6 1 0xffff0000e5429000 38000 linux_common.ko 7 1 0xffff0000e5461000 22000 dwwdt.ko 8 1 0xffff0000e5483000 23000 mx25l.ko 9 1 0xffff0000e54a6000 21000 fdt_slicer.ko 10 1 0xffff0000e54c7000 22000 pwm_backlight.ko 11 1 0xffff0000e54e9000 22000 backlight.ko 12 1 0xffff0000e550b000 27000 if_axe.ko 13 1 0xffff0000e5532000 22000 pty.ko 14 1 0xffff0000e5554000 24000 fdescfs.ko 15 1 0xffff0000e5578000 22000 mac_ntpd.ko root@kazu:~ # Is there any suggestions ? Best regards --- Kazuhiko Kiriyama From owner-freebsd-arm@freebsd.org Thu Apr 22 06:06:18 2021 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 6787F5E027D for ; Thu, 22 Apr 2021 06:06:18 +0000 (UTC) (envelope-from 4250.82.1d4cf000413cd79.995a0cd434b038a9c963c81a5ebe8c99@email-od.com) Received: from s1-b0c6.socketlabs.email-od.com (s1-b0c6.socketlabs.email-od.com [142.0.176.198]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FQn3s3tbhz4vkY for ; Thu, 22 Apr 2021 06:06:17 +0000 (UTC) (envelope-from 4250.82.1d4cf000413cd79.995a0cd434b038a9c963c81a5ebe8c99@email-od.com) DKIM-Signature: v=1; a=rsa-sha256; d=email-od.com;i=@email-od.com;s=dkim; c=relaxed/relaxed; q=dns/txt; t=1619071578; x=1621663578; h=content-transfer-encoding:content-type:mime-version:references:in-reply-to:message-id:subject:cc:to:from:date:x-thread-info; bh=k0gGwQZUa60Yd4z0X8aD2rj2/qNySN24nn2ZF6MU/gc=; b=nYssGeW8/wUgvoWgvAhSsZdRdLSMFd/Uq5B1sM2dwf1GX5d1Hfzy/0Xow1xpjwDsoEtR3HvcJpI9R0SJYD+i/tSQinK1T0AfTnIfosLd/RHKQimtvc+OV3u/SqsnbfKly6WjlgbIYbUHaL2HY/8hRpUVCanzif/pjaHAtpc8+XQ= X-Thread-Info: NDI1MC4xMi4xZDRjZjAwMDQxM2NkNzkuZnJlZWJzZC1hcm09ZnJlZWJzZC5vcmc= Received: from r1.us-west-2.aws.in.socketlabs.com (r1.us-west-2.aws.in.socketlabs.com [142.0.190.1]) by mxsg2.email-od.com with ESMTP(version=Tls12 cipher=Aes256 bits=256); Thu, 22 Apr 2021 02:06:01 -0400 "MachineName": "AW-PR-REC01", "Ehlo": true, "HeloDomain": "smtp.lan.sohara.org", "Timestamp": "2021-04-22T02:05:59.4606156-04:00", "Auth": "CramMd5", "MessageNumber": 1, "RemoteIp": "185.202.17.215", "RemotePort": 0, "LocalIp": "10.17.0.165", "LocalPort": "2526", "MailFrom": { "Email": "steve@sohara.org", "Name": null, "Local": "steve", "Domain": "sohara.org" }, "TlsLogData": { "Enabled": true, "CertSubject": null, "CryptProtocol": 3072, "CryptCipherAlgId": 26128, "CryptHashAlgId": 32781, "CryptExchangeAlgId": 44550 } } Received: from smtp.lan.sohara.org (EMTPY [185.202.17.215]) by r1.us-west-2.aws.in.socketlabs.com with ESMTP(version=Tls12 cipher=Aes256 bits=256); Thu, 22 Apr 2021 02:05:59 -0400 Received: from [192.168.63.1] (helo=steve.lan.sohara.org) by smtp.lan.sohara.org with smtp (Exim 4.94 (FreeBSD)) (envelope-from ) id 1lZSTN-000EQg-Qg; Thu, 22 Apr 2021 07:05:57 +0100 Date: Thu, 22 Apr 2021 07:05:56 +0100 From: Steve O'Hara-Smith To: KIRIYAMA Kazuhiko Cc: freebsd-arm@freebsd.org Subject: Re: How to build packages on PBP ? Message-Id: <20210422070556.b02b17d7ba2c133af028149e@sohara.org> In-Reply-To: <202104220108.13M18dvG021683@kx.truefc.org> References: <202104220108.13M18dvG021683@kx.truefc.org> X-Mailer: Sylpheed 3.7.0 (GTK+ 2.24.33; amd64-portbld-freebsd12.1) X-Clacks-Overhead: "GNU Terry Pratchett" Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4FQn3s3tbhz4vkY X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=pass header.d=email-od.com header.s=dkim header.b=nYssGeW8; dmarc=none; spf=pass (mx1.freebsd.org: domain of 4250.82.1d4cf000413cd79.995a0cd434b038a9c963c81a5ebe8c99@email-od.com designates 142.0.176.198 as permitted sender) smtp.mailfrom=4250.82.1d4cf000413cd79.995a0cd434b038a9c963c81a5ebe8c99@email-od.com X-Spamd-Result: default: False [0.30 / 15.00]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[email-od.com:s=dkim]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ip4:142.0.176.0/20]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[sohara.org]; RBL_DBL_DONT_QUERY_IPS(0.00)[142.0.176.198:from]; NEURAL_SPAM_SHORT(1.00)[1.000]; SPAMHAUS_ZRD(0.00)[142.0.176.198:from:127.0.2.255]; RCVD_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[email-od.com:+]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; FORGED_SENDER(0.30)[steve@sohara.org,4250.82.1d4cf000413cd79.995a0cd434b038a9c963c81a5ebe8c99@email-od.com]; MIME_TRACE(0.00)[0:+]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:7381, ipnet:142.0.176.0/22, country:US]; FROM_NEQ_ENVFROM(0.00)[steve@sohara.org,4250.82.1d4cf000413cd79.995a0cd434b038a9c963c81a5ebe8c99@email-od.com]; MAILMAN_DEST(0.00)[freebsd-arm] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Porting FreeBSD to ARM processors List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Apr 2021 06:06:18 -0000 On Thu, 22 Apr 2021 10:08:39 +0900 KIRIYAMA Kazuhiko wrote: > I'm tring to build packages for my desktop use on pineboookpro (PBP), > but suddenly crashed during compiled devel/llvm10 and failed to build > llvm10-10.0.1_5.txz. The reason why I guess was for too heavy to process > to compile llvm10 because it's load average was over 6.0 ! It probably ran out of memory, try setting NO_PARALLEL=1 in the environment and/or add some swap and try again. -- Steve O'Hara-Smith From owner-freebsd-arm@freebsd.org Sat Apr 24 10:33:43 2021 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 178F45FA17C for ; Sat, 24 Apr 2021 10:33:43 +0000 (UTC) (envelope-from kiri@truefc.org) Received: from kx.truefc.org (1.212.52.36.ap.yournet.ne.jp [36.52.212.1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp", Issuer "smtp" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FS6vV0vCjz4mXQ for ; Sat, 24 Apr 2021 10:33:41 +0000 (UTC) (envelope-from kiri@truefc.org) Received: from kx.truefc.org (kx.truefc.org [36.52.212.1]) by kx.truefc.org (8.16.1/8.16.1) with ESMTP id 13OAXdDH085225; Sat, 24 Apr 2021 19:33:39 +0900 (JST) (envelope-from kiri@kx.truefc.org) Message-Id: <202104241033.13OAXdDH085225@kx.truefc.org> Date: Sat, 24 Apr 2021 19:33:39 +0900 From: KIRIYAMA Kazuhiko To: "Steve O'Hara-Smith" Cc: KIRIYAMA Kazuhiko , freebsd-arm@freebsd.org Subject: Re: How to build packages on PBP ? In-Reply-To: <20210422070556.b02b17d7ba2c133af028149e@sohara.org> References: <202104220108.13M18dvG021683@kx.truefc.org> <20210422070556.b02b17d7ba2c133af028149e@sohara.org> User-Agent: Wanderlust/2.15.9 (Almost Unreal) SEMI/1.14.6 (Maruoka) FLIM/1.14.9 (=?ISO-8859-4?Q?Goj=F2?=) APEL/10.8 MULE XEmacs/21.4 (patch 24) (Standard C) (amd64--freebsd) MIME-Version: 1.0 (generated by SEMI 1.14.6 - "Maruoka") Content-Type: text/plain; charset=US-ASCII X-Rspamd-Queue-Id: 4FS6vV0vCjz4mXQ X-Spamd-Bar: + Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of kiri@truefc.org has no SPF policy when checking 36.52.212.1) smtp.mailfrom=kiri@truefc.org X-Spamd-Result: default: False [1.09 / 15.00]; ARC_NA(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[36.52.212.1:from]; FREEFALL_USER(0.00)[kiri]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[truefc.org]; AUTH_NA(1.00)[]; NEURAL_SPAM_SHORT(0.99)[0.986]; SPAMHAUS_ZRD(0.00)[36.52.212.1:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; RCVD_COUNT_ONE(0.00)[1]; R_SPF_NA(0.00)[no SPF record]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:10013, ipnet:36.52.208.0/21, country:JP]; SUBJECT_ENDS_QUESTION(1.00)[]; MAILMAN_DEST(0.00)[freebsd-arm]; ONCE_RECEIVED(0.10)[] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Porting FreeBSD to ARM processors List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 24 Apr 2021 10:33:43 -0000 On Thu, 22 Apr 2021 15:05:56 +0900, Steve O'Hara-Smith wrote: > > On Thu, 22 Apr 2021 10:08:39 +0900 > KIRIYAMA Kazuhiko wrote: > > > I'm tring to build packages for my desktop use on pineboookpro (PBP), > > but suddenly crashed during compiled devel/llvm10 and failed to build > > llvm10-10.0.1_5.txz. The reason why I guess was for too heavy to process > > to compile llvm10 because it's load average was over 6.0 ! > > It probably ran out of memory, try setting NO_PARALLEL=1 in the > environment and/or add some swap and try again. Unfortunately also crashed with: root@kazu:/var/ports/lpbpkx/devel/llvm90 # env NO_PARALLEL=1 make package-recursive Swap is ready by 8GB: root@kazu:~ # swapinfo -h Device Size Used Avail Capacity /dev/mmcsd0p2 8.0G 0B 8.0G 0% root@kazu:~ # The situation before crash is like [1]. [1] http://www.truefc.org/~kiri/freebsd/pbp/IMG_1417.jpeg Regards --- Kazuhiko Kiriyama > > -- > Steve O'Hara-Smith > _______________________________________________ > freebsd-arm@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-arm > To unsubscribe, send any mail to "freebsd-arm-unsubscribe@freebsd.org" > From owner-freebsd-arm@freebsd.org Sat Apr 24 15:17:56 2021 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C6BA5622ED8 for ; Sat, 24 Apr 2021 15:17:56 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic315-54.consmr.mail.gq1.yahoo.com (sonic315-54.consmr.mail.gq1.yahoo.com [98.137.65.30]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FSFCR6fQWz3HJn for ; Sat, 24 Apr 2021 15:17:55 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1619277473; bh=0BlShyADlsvXmZUL65RqiYqthbZl5xqgi8Q87wtwxy+=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=NPHPTgnJWr05TuclYAwmIHnS/nFtwYicY4YljlOR6xrB2SXZu2M6hPLBP9H3vzHjQCVhFtNp4yCDCfw+xE103S+r9r1lw4qbYqwHJtGu3aMr7LtUi71mDHvWz+54rNhAPdLebwfF6/j9A6jb3Y6Eo7Gl3DlawR+vdGGx4e1nX0NlsvCKBLruIeY15As5NYFS/3qAh50k6qOmc4SbeeDJOSbsZ2r4W73VyY2TCU6VOZ7eaNZqxMUGYmWTFDjfQoFmr+PIFn2wpG/XbuIYDK2MTJa7XssGLN0ZXSzMYH43QPgGaOuPuB6wfevFRoVAOqq+roBztgdC1q5249qGmFAgug== X-YMail-OSG: QAG2q1gVM1mOEvpDAt0NdnIhNr57ptqg5wZ1YQm4hAFHu01eQvzRlQFIK4lPxu8 L5XSntR9WEVKSSWHKltk0EVGPkGG_3Kq0ynalgRIirN_Ayvlp2B9UE9GjQ89lbmtEAsQ60Yr1_uo yrDJ6lFUjFLoPXsued2dh17jcFb7DY_CFSDBCM97L021L3Ek.xea.0WFdjgwtdq8ofsSnlDYdsye Ly0q.vIcep_tTkSfgfoossW.bM8lwdeBoffQOWnBoX84J_9HoItLbEUAwzSFseOgjWcjtWFd8ROI wTuP2RPcOMygqeQSm1I77G9EWw9bj9Wg31IwaJRjb1T1AIuZt9f5srWsX5qkQ1xprL5WsOoP_HSp d5Me.4NiqSuO8fYoVm58LJlAtfoximXe5iaHGluLwfIQV90QoTSu4GBgfgW5g6yy64c_9nKuWNNi zuZT8.jn3vKQDugw2c0TYqskbJPLp4KNrbBpwZrseY_27Z3eh.D61Zb.kVA29_ncpycw0lu5T_TK futihIzuh20hR_YSMN4my.Qcl_8teMumdlawkUdlmOltOStm_s90nsSdO0riKgsiApLD4KoCx5YT sTE9nOvjmFp7WH5YuR4So4ZPZmwnbSDGa1ws4nsRFzBjM0mzT4orABIM1Ctkz48MDmLhkB7kIr4h fLlSbrALQUYtm35qypJ7poSDYAyYu5zR2iVjYJ6oozULx0PxC7da2wcucRgxlc5Fv7n1Og07GcDN 9FfbCd7yjW6gN4fWWl6698p9xX3_TeJaKDuVykcorqfoHhfoZ2jgH2c1nowjiqsEHKsK3yJUqxTp 8ood3Unc2OatnsyYtuTCxifWpszbzdnopnmAkfPjeYdYZafEg7HdjPqpb_82s4dRXJc3TkT8ruDx 3JYZwr4LT7ZxrRZko7xidSP8pxjtjtrlJ6vssrYbj_OgrFDwrWnKkVCPkDlKwveBwkzql4EJ77qe qmFSctNF4XY2ZL3onDYtnExSA7FOv3juvzVZ8JkaV870s4mc9cFKTyI3nE2Sex3BRWiL2V8NKLcQ yCVNkQoLPZ_8T4xCSIDIS1_BoZPqmHyn3HjDxfuwGO53qYbL5QAb4HqZtqQayjUPC_psdViTOWiD 8MDWQ02u7T0gpzLINKedMLB2kBzDahgvoefYsM7q_Mu3tB2ifIPZbs3fKdORSoVUan8m_dS_jL._ 1Nrrrp4bmpve.PBSDgU2l0dz1YhtgAIlBLmIGydvOXaMxOVFm.Yrv2s55V0svZLzCyE5bo4S7Tyn IslsmhNH4K69jhwGJFPjAeuq_ht1KHdXN8_4gBP8Ff_RwQpWAQf5dqO4SBEMX1C9ZsLzXgv1lAjr SLTcZitg20CBdzNC42fSzi3B15LKfIZbGY26Z4t3wujW74WphUavuVmH1Lj0hO6G7WstH7BPeMSm Vr1lMsvmCXkdB7nSXTdhR0JhkuVbGgaADdRoBFlYWxkIIuGMrTGUveQgUQZ1fZD65maCMNgn4pff OJnyYCCjAz5BzNCzQNTu__QvfG336cj3Ux8_PxnQBZgOyN5eSQ7mbMQ1CjQo5dfzECSpHj94Cm2J amUi4SNlKB_J8U.EIdFuLK_EGijPGnu96bKvuoGRGGbwQ2fxlP47FgL6bTGjQRthb9yQPmAsPQXv r9HGkOL6AX1tj9WTx9Ed45T6Psdedmy6FnY5h2zKPw9MvIwELNF2iWHFOiyPZtkmtAFl39ptwAQI HsJBX2CYmdKQY5FB7U09aO0GP2i43wW4YHt.GnHgbjFs0c6OeOBuioYYHr6emAswVU6AY7iZkbg4 zX0DfC_qpBsqLsUKSCH0G1vLjQGQ1A5zes2p7TADfiwSR21p9nf1.r5APLfbn.Z3IB86OxiY839q ef0pYMgZjrRU_mMAI67J56HFekgar0QUu6Py.CrY5M7WS56o2supRwVmsmMQ5FfuRNzpjdNXR.uD nkHqGVrM3.i3rcY1NRu7oybb.PQAVmBC9ADtBmddw0aq2Ov9PlwEJ2faFx7eUgXJ_nw7C_nrIACQ cth7yrjGSu961wqMgO34C1Py1BuwZ.AHoUtmGA5AYpCkRJloyPw4Am1xBnWlons3jKISx15h_6aV qXLXSEA7WzRvpystjKvNkA2u1GAOmZTIxc0QMjWkMqsHyOeR3gs2INzVYnt.FPZpp1eOldnGrwRG GKX9N8rp8nIdjngY2..qgZ8Jpcp3hOYXhNnKj2jMAwZ.NQyWvI4uiAl0DSD4FkdQelXjLvvJ6nwL xAY.aJvbIxrsaE8j4CGs3Nl5cCu_6hOY8gGwpjHpz9s76VzX6l_2GiRk6z6gS_QA0SDRM_4JJU6i VQy2zuE0BXZ_f3.NB8CdshwklTPiLtuGNlg81gKZs0Lslj2lGRxqwM3EIyfKkKoNLML_c9iygXBU lg6QbAqKwU_gS12v32GZMTTKkHFCJPeuZQjjlRo5c9sTKZsofAnevwlOfGJp8GKmjaURl48XeE2I _3exGOnPEciAiNlvxsFx_A2v9GyE.kX8Hoqqhx24OikFljoT7_IUf.g.RukrreUnjeG2_z.M_2dm 8Bhe7zIU_jPta9YgiBA5qb199X1I- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic315.consmr.mail.gq1.yahoo.com with HTTP; Sat, 24 Apr 2021 15:17:53 +0000 Received: by kubenode544.mail-prod1.omega.ne1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID e65d8b44c3e1071e17aac7b96cf2fa1e; Sat, 24 Apr 2021 15:17:50 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: How to build packages on PBP ? From: Mark Millard In-Reply-To: <202104241033.13OAXdDH085225@kx.truefc.org> Date: Sat, 24 Apr 2021 08:17:48 -0700 Cc: Steve O'Hara-Smith , freebsd-arm@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <8A9FBA4D-9BBD-4D67-ACE1-29F2BF91592F@yahoo.com> References: <202104220108.13M18dvG021683@kx.truefc.org> <20210422070556.b02b17d7ba2c133af028149e@sohara.org> <202104241033.13OAXdDH085225@kx.truefc.org> To: KIRIYAMA Kazuhiko X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Rspamd-Queue-Id: 4FSFCR6fQWz3HJn X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.50 / 15.00]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RBL_DBL_DONT_QUERY_IPS(0.00)[98.137.65.30:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; SUBJECT_ENDS_QUESTION(1.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[98.137.65.30:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.30:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.30:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-arm] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Porting FreeBSD to ARM processors List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 24 Apr 2021 15:17:56 -0000 On 2021-Apr-24, at 03:33, KIRIYAMA Kazuhiko wrote: > On Thu, 22 Apr 2021 15:05:56 +0900, > Steve O'Hara-Smith wrote: >>=20 >> On Thu, 22 Apr 2021 10:08:39 +0900 >> KIRIYAMA Kazuhiko wrote: >>=20 >>> I'm tring to build packages for my desktop use on pineboookpro = (PBP), >>> but suddenly crashed during compiled devel/llvm10 and failed to = build >>> llvm10-10.0.1_5.txz. The reason why I guess was for too heavy to = process >>> to compile llvm10 because it's load average was over 6.0 ! >>=20 >> It probably ran out of memory, try setting NO_PARALLEL=3D1 in = the >> environment and/or add some swap and try again. >=20 > Unfortunately also crashed with: >=20 > root@kazu:/var/ports/lpbpkx/devel/llvm90 # env NO_PARALLEL=3D1 make = package-recursive >=20 > Swap is ready by 8GB: >=20 > root@kazu:~ # swapinfo -h > Device Size Used Avail Capacity > /dev/mmcsd0p2 8.0G 0B 8.0G 0% > root@kazu:~ #=20 >=20 > The situation before crash is like [1]. >=20 > [1] http://www.truefc.org/~kiri/freebsd/pbp/IMG_1417.jpeg >=20 I recommend trying the following in, say, /boot/loader.conf=20 and booting with the settings before attempting another build: # # Delay when persistent low free RAM leads to # Out Of Memory killing of processes: vm.pageout_oom_seq=3D120 # # For plunty of swap/paging space (will not # run out), avoid pageout delays leading to # Out Of Memory killing of processes: vm.pfault_oom_attempts=3D-1 # # For possibly insufficient swap/paging space # (might run out), increase the pageout delay # that leads to Out Of Memory killing of # processes (showing defaults at the time): #vm.pfault_oom_attempts=3D 3 #vm.pfault_oom_wait=3D 10 # (The multiplication is the total but there # are other potential tradoffs in the factors # multiplied, even for nearly the same total.) Notes: While I've never done anything that required it, vm.pageout_oom_seq could be set even bigger. Someone once reported using a figure like 1200 instead. No setting gives an unbounded delay. If you decide to not use vm.pfault_oom_attempts=3D-1 : For that last you would want to increase one or both of: vm.pfault_oom_attempts and/or vm.pfault_oom_wait instead of using 3 and 10 as the values. If you do got (or get) one or more "was killed: out of swap space" messages on the console: Be warned that the "out of swap space" part can be a misnomer. Only if you also see message(s) with text of the form "swap_pager_getswapspace(...): failed" is the swap space part of the notice the actual cause as far as I know. Other causes include: Sustained low free RAM (via stays-runnable processes). A sufficiently delayed pageout. The swap blk uma zone was exhausted. The swap pctrie uma zone was exhausted. The earlier tuning attempts to deal with the first two of those, not the last two. The 2 or 3 tunables above can instead be placed in /etc/sysctl.conf if desired. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar)