From owner-freebsd-arm@freebsd.org Wed Mar 17 05:00:54 2021 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 978A157A422 for ; Wed, 17 Mar 2021 05:00:54 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic315-8.consmr.mail.gq1.yahoo.com (sonic315-8.consmr.mail.gq1.yahoo.com [98.137.65.32]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4F0dK12SNWz4f1T for ; Wed, 17 Mar 2021 05:00:52 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1615957251; bh=T9dKW0+sg8vtcZZkA5lb75Aa4TrzFmudNjVim7ieooa=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=aDai/Ob+hz+1wmX6j08hYs4lYAWI1EKdXyUt0HzYRRmsMkW64UWt2Xb/xsUvKlWVh5mutG4VXWTuL6llalgXFHKQNe8dd6wvCu157WdHOelaRKyia0MtlVadHsWlZ8nF8ZJiCKAY4cYGSIE86XY8BQC1SyBZQNbrNsdW6GwmfKWixI3+EgvbkvAKxpEl91PZWjjMZIT1P3hcyIPPsKutARQxpd4KEkFTq/t3XO+WVoHg9HBaalzCU3m1WvSHtfOQXoJSSF2wO8H0EaOV4aWKMG87PeONsbb+2BvZXKZlkiUTZ1TmUxr+JAVqNb1J9y6iju4kaDeCpjchgYG3ECTRHA== X-YMail-OSG: kj2DUHoVM1nk0zVgQGMPq16JwybUhahUh5zp4mjq.htiX2VttqlGai.vMPvjCh4 QSjQe1qyu8V.QIA5h1w3hxehQxUnqHzv94LxulupuBtjhlt2JytYvw.30yrIwdBlY3n8xSDE4ZXf mMhFvQ6AtFu1qH7C_sNXPsyBPBxiKnxoGKH9nWdlKynktNYph7Odj6qgM.ZgZMIqWvAjhYspeknJ VzAFKVc7QS5X4oPJUthe1kmQhDfIn1h8ZgO7d4yEibZZwozmYfDwiZ1RQv7eWUNEXc77knnE1hdI 3NALZR6uV_IWlxVXdaR..RnvFyCA7bo0ufolgZwM1PGIsUfj2JTSE3pfuVqe9yyYWKUF7TJlotJc gsf2ZkCHAsa7fTyj04sZeHVeyfJliWt7zHa863uFYRTEfHGD.jy4cK8ylq7auM8lvEahJyOCltZZ dSAkSLZuVwshmcmsoXji3lOxlGIh.lBqwPXkxe.1LzD4Iwu2lrI965G63eytSIuArKkWgcy5v8W4 WWXLvQ1L_A9mhgaLQLez7iYG1zJ.j1GW62ueauvERQYVLKsZZ6NWu8pHHhxizQNMq4dQIf.9DZoQ fnR9vJTfn_z3qLBSaPdxqAvnzM8BMcP1uK.4ohAeQTChnSZ1o_fz23J.ZQ0RSEogYzxm3mD1AjC9 cZ7x3WpPz0S.5xIJM8BwYWoOykS36VU8N9O46z49VKynUWFpRvNH52LDjI2GCoiolet.uGYS3eXW U2ddfnl4E2BGHTGvPBqkJDt25waszvowrwXl.f08O4pefqysHljGRusspB9IWqVG30fttuCw3ChC F1.Rr4TTJZTy7RiyewRmfGbztRQyBuhTTd7k.p8ayf9OUTGFYa2LXVC1Ukfjdoadz_yWJXS9AXK5 unq2fag6aPclX1x.KDbfBxHZc3DcBchRaC2c8zExYogWfd8XarjVPTJwOoNbmmzbIU1OnCGOLZpM 7kyviu1h8dsLbH9tfEaBKopqzNi0bKjXqNOUagfuk7e.MbozUvMRXF.8EUwe0kx7PG_OU8QZ7Hg7 uFUrbGy9OOGVFPsHpWiHp2taOkJF_uoRQvpAqfkoL2Vld4HXoFeevXz20tCPJ_jja.rxno4lbQXQ 6ljWQgRI3lYD42YwJAVYov9Q8h_riWvZIT8q.Il7j6paDlGq1oUMDrK0Fc0smFDOVLzL.5XjL34X 4l1TXH6i7h_oIRvDBCtqb9RPnPGqxKhuPsIoqfTpxRBATeaqTKr7jJrPdYk617b7DaFbuDzvlUj1 xdeFqqJtai.j1z15djm.ghlr90CIFAvQ2T19FM2KjKHeg0K2J1jzcZVk2v5kYTPP7hnxdfB.BAkC E1Y94WILOQXaCpjfecEpGlJgpoMEjInldkGqYDkjcu6PiwP.UyTqkd4RjbLKkXyF1DusZFlbvoV5 15q6s9m1KNJVIzbZu4VIQ8X4.3.w1Lwwf0B0Z4kI5txE6HLNdUB6HkgbOvIE5C8J2YsmYWoW9gzH P8lMy3eTlKu6_cOpbT9ACUDQ.2QfJ13FaHn6aCpf3n57scvEyA._w3hYggYCrmp0aZ4WNqthhjJG GL9OKTc0dkj7AT58btDGeJVZpzE5OHknYENqQEh6mB3QZHaHA96Xnf1qk3W_AgzhE6tjA4Qkydfu GyaIbb0ojZ6jSVFCUkjILMYD8eAOQYRt52OxoRS0cO6lqjOnd5GmNWpTizzdYskTKt0r7tz6x1Gf heY2fagN8JNBC3L5RZn51OZgwWdKwJpEPxYizNy8Me8Ngkaw4AsTjGS6ojLlurAun2ttJ1rwQJWs W17egWZQ5Vc3Y.hlACcUOoW5ZBzVQT12m_PlM6a5ikpUEtApDDnU3TsEWl7kZf22NSwIrt_.XgLf i8y6A.i9jnBt_9qHmQt8fghBgDsF0L0mbAMa4hhVpgwmzSIZe5.CL.w3cpZTQ6psQdsLhCuUzzgx _PBQUWufSakbVXA3UrmrC.hqH5LFoeaos.HAyn.ZpoSw1YMMukNt5c7bWYfzvmNqg3oqL1wAI.A7 2iWMpyr0s.OGdM8xM6kHIP5M5_5mi7Iih93RxRHQxO20JbV28Dri7Sy_qOunisKdMDLn1mZnkWAP 1hDaiAhHObbeSDj2cPiWeRZMsaSOyRag5_ytxYxFBrAdTy8m7ljIbjFLFSt.Cbfqdhe9eTjvpk8j AS8gG7V5kzHPqVTWkaDszCMsEVbIEEdAdRlfaBSNLU8nARlAhjPXtA5nUC2V4GyL8UjxeKeWViOY WyNXIs8jimwgLgODBQ7yXRW7ubHscDiTHQD.rot2rmR2jzMSAMLwZIDPGhMmF10YL5bivCsRZHe1 Dw6.i9D2keKCN9oU4p25SXbMI20trWBh8T0JtrJaBpUjMKcyDGUjMcI3yjc6YgszA9An0XW6ZfH1 TpMbDe0WX5QQefo462qvsBP6A1oec7gXyMagXovcNkDs0JxN9MRiJRtm0HmwGYGzvIg8FGRxa8Wc WgWNwZRefegDfPhihv.eu0WYLiXKuTfifa39BjFg1AM9pHUgpXFcnlkyvrqQQsfnPyUZCNP9Y6sC Fza2xhWpGw8R50hklNzt4ZLfwfKZTFKGTvFZUKSk9SVNt3SKOHFahOfOQ3y2RqOSqF5NIw374m3u PMsG2k_hmMGejazOZqJDRAMIX1UadgCsJOFJkTSs2VEQ.8n4- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic315.consmr.mail.gq1.yahoo.com with HTTP; Wed, 17 Mar 2021 05:00:51 +0000 Received: by smtp403.mail.ne1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID a40c5d5879a18906db04f34d5bb1659b; Wed, 17 Mar 2021 05:00:48 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: MACHIATOBin Double Shot booted into FreeBSD from Optane in PCIe slot From: Mark Millard In-Reply-To: <80D7FDC3-1143-479C-85B2-DFF8EFB3CF64@yahoo.com> Date: Tue, 16 Mar 2021 22:00:47 -0700 Cc: freebsd-arm , Mark Murray Content-Transfer-Encoding: quoted-printable Message-Id: <7744246D-0F1A-4035-BCAA-0903A3AB030D@yahoo.com> References: <3420FB5B-6499-42E5-8FFE-F9BF57CCECE7@icloud.com> <5D99B7D1-CDF6-4C96-AF62-ADF9626639CF@yahoo.com> <13F0E8C6-639D-4529-8348-79DDCCC3B4F4@yahoo.com> <80D7FDC3-1143-479C-85B2-DFF8EFB3CF64@yahoo.com> To: Greg V X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Rspamd-Queue-Id: 4F0dK12SNWz4f1T X-Spamd-Bar: - X-Spamd-Result: default: False [-1.50 / 15.00]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RBL_DBL_DONT_QUERY_IPS(0.00)[98.137.65.32:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_SPAM_SHORT(1.00)[1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[98.137.65.32:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.32:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.32:from]; FREEMAIL_CC(0.00)[freebsd.org,icloud.com]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-arm] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Porting FreeBSD to ARM processors List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Mar 2021 05:00:54 -0000 I've no plans on generally using the PCIe slot but I decided to test using it with an Optane as the only storage media (besides the microsd card that has the UEFI/ACPI material on it). It worked fine based on UEFI/ACPI being (indirectly) from: = https://unrelentingtech.s3.dualstack.eu-west-1.amazonaws.com/flash-image-2= 020-07-01-mainline-tfa.bin So I did the following (starting with being powered off already), at least in summary: A) Disconnected the usual power source B) Disconnected the SATA disk setup C) Plugged in the Optane into the PCIe slot D) Plugged in power that could handle far more E) Booted from the Optane (I used the UEFI UI to select the "UEFI Misc Device" in Boot Manager.) F) Transfered materials to update the FreeBSD (prebuilt) that was on the Optane. (Using ethernet dongle in the USB3 port, like normal for my context.) G) Ran the procedure for updating FreeBSD on the Macch. (A bunch of chroot directory trees are updated as well, not just the boot context.) H) Rebooted, again selecting "UEFI Misc Device". It is now running based on main 7381bbee29df (form 2021-Mar-12) from the Optane media: # ~/fbsd-based-on-what-freebsd-main.sh=20 merge-base: 7381bbee29df959e88ec59866cf2878263e7f3b2 merge-base: CommitDate: 2021-03-12 20:29:42 +0000 def0058cc690 (HEAD -> mm-src) mm-src snapshot for mm's patched build in = git context. 7381bbee29df (freebsd/main, freebsd/HEAD, pure-src, main) cam: Run all = XPT_ASYNC ccbs in a dedicated thread FreeBSD CA72n16 14.0-CURRENT FreeBSD 14.0-CURRENT = mm-src-n245445-def0058cc690 GENERIC-NODBG arm64 aarch64 1400005 1400005 >> . . . A >> verbose boot reported: >> pcib0: on acpi0 >> pcib0: Bus is cache-coherent >> pcib0: ECAM for bus 0-0 at mem e0000000-e00fffff >> pci0: on pcib0 >> pci0: domain=3D0, physical bus=3D0 >> but that was all for pci*. pciconf -l reported >> an empty output. >=20 > That's all you'll see without a card inserted. > On this device, we can only expose this much with ECAM. Now it shows as follows (verbose boot used): pcib0: on acpi0 pcib0: Bus is cache-coherent pcib0: ECAM for bus 0-0 at mem e0000000-e00fffff pci0: on pcib0 pci0: domain=3D0, physical bus=3D0 found-> vendor=3D0x8086, dev=3D0x2700, revid=3D0x00 domain=3D0, bus=3D0, slot=3D0, func=3D0 class=3D01-08-02, hdrtype=3D0x00, mfdev=3D0 cmdreg=3D0x0006, statreg=3D0x0010, cachelnsz=3D0 (dwords) lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 = ns) intpin=3Da, irq=3D255 powerspec 3 supports D0 D3 current D0 MSI-X supports 32 messages in map 0x10 map[10]: type Memory, range 64, base 0x800000000, size 14, = enabled pcib0: rman_reserve_resource: start=3D0x800000000, end=3D0x800003fff, = count=3D0x4000 nvme0: mem 0x800000000-0x800003fff at device 0.0 = on pci0 nvme0: attempting to allocate 5 MSI-X vectors (32 supported) nvme0: using IRQs 11-15 for MSI-X nvme0: CapLo: 0x04010fff: MQES 4095, CQR, TO 4 nvme0: CapHi: 0x00000020: DSTRD 0, CSS 1, MPSMIN 0, MPSMAX 0 nvme0: Version: 0x00010000: 1.0 . . . pass0 at nvme0 bus 0 scbus4 target 0 lun 1 pass0: pass0: Serial Number *REPLACED* pass0: nvme version 1.0 x4 (max x4) lanes PCIe Gen3 (max Gen3) link nda0 at nvme0 bus 0 scbus4 target 0 lun 1 GEOM: new disk nda0 nda0: nda0: Serial Number *REPLACED* nda0: nvme version 1.0 x4 (max x4) lanes PCIe Gen3 (max Gen3) link nda0: 457862MB (937703088 512 byte sectors) # pciconf -lv nvme0@pci0:0:0:0: class=3D0x010802 rev=3D0x00 hdr=3D0x00 = vendor=3D0x8086 device=3D0x2700 subvendor=3D0x8086 subdevice=3D0x3900 vendor =3D 'Intel Corporation' device =3D 'Optane SSD 900P Series' class =3D mass storage subclass =3D NVM Thanks again. Note on the "image checksum verification failed" notices and such . . . I have seen the rejection of the microsd card UEFI/ACPI material's checksum sometimes (same media both ways, no content update). With your report as well, it seems that reading microsd card media is unreliable at the start. Its simple retries worked in my case, for example: BootROM - 2.03 Starting CP-0 IOROM 1.07 Booting from SD 0 (0x29) Found valid image at boot postion 0x000 lNOTICE: Starting binary extension NOTICE: SVC: SW Revision 0x0. SVC is not supported mv_ddr: mv_ddr-devel-18.08.0-ga881467 (Jul 01 2020 - 21:18:08) mv_ddr: completed successfully NOTICE: Cold boot Error: image checksum verification failed Error: no valid header till end of media Error: Failed boot attempt 01. error =3D 0x041 BootROM - 2.03 Starting CP-0 IOROM 1.07 Booting from SD 0 (0x29) Found valid image at boot postion 0x000 lNOTICE: Starting binary extension NOTICE: SVC: SW Revision 0x0. SVC is not supported mv_ddr: mv_ddr-devel-18.08.0-ga881467 (Jul 01 2020 - 21:18:08) mv_ddr: completed successfully NOTICE: Cold boot NOTICE: Booting Trusted Firmware NOTICE: BL1: v2.3(release):v2.3-269-g568a88172-dirty = (Marvell-devel-18.12.0) NOTICE: BL1: Built : 21:19:59, Jul 1 2020 NOTICE: BL1: Booting BL2 NOTICE: BL2: v2.3(release):v2.3-269-g568a88172-dirty = (Marvell-devel-18.12.0) NOTICE: BL2: Built : 21:20:00, Jul 1 2020 NOTICE: SCP_BL2 contains 5 concatenated images NOTICE: Skipping MSS CP3 related image NOTICE: Skipping MSS CP2 related image NOTICE: Load image to CP1 MSS AP0 NOTICE: Loading MSS image from addr. 0x40269f4 Size 0x1cd8 to MSS at = 0xf4280000 NOTICE: Done NOTICE: Load image to CP0 MSS AP0 NOTICE: Loading MSS image from addr. 0x40286cc Size 0x1cd8 to MSS at = 0xf2280000 NOTICE: Done NOTICE: Load image to AP0 MSS NOTICE: Loading MSS image from addr. 0x402a3a4 Size 0x5420 to MSS at = 0xf0580000 NOTICE: Done NOTICE: SCP Image doesn't contain PM firmware NOTICE: BL1: Booting BL31 lNOTICE: MSS PM is not supported in this build NOTICE: BL31: v2.3(release):v2.3-269-g568a88172-dirty = (Marvell-devel-18.12.0) NOTICE: BL31: Built : 21:19:59, Jul 1 2020 For the sequence: NOTICE: Cold boot Error: image checksum verification failed Error: no valid header till end of media Error: Failed boot attempt 01. error =3D 0x041 Is all that before it is even executing material that is from the microsd card? If it is, then the problem would not seem to be tied to the specific image used but be a more general problem reading microsd media by code that is in use before the microsd card's code is in use. I've not tried other media or any such yet. It is not the media that I'd used for so long before switching images: At the time I kept the original media as it was so that I could revert to it if needed. The two media (older and newer) are not of the same type. I'd never noticed such retries with the older media --but I was not looking for such either. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar)