From nobody Wed Nov 17 19:17:27 2021 X-Original-To: arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 6253E188B708 for ; Wed, 17 Nov 2021 19:17:39 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic311-24.consmr.mail.gq1.yahoo.com (sonic311-24.consmr.mail.gq1.yahoo.com [98.137.65.205]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4HvXkV2d1cz4RPZ for ; Wed, 17 Nov 2021 19:17:38 +0000 (UTC) (envelope-from marklmi@yahoo.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1637176651; bh=dDfbYH4xavsLHtllidO2NoN+PYuhji5v958VppA2i5Y=; h=From:Subject:Date:References:To:In-Reply-To:From:Subject:Reply-To; b=cxt1dJrcTe6LitCgMM1KvENW0FgE8H7SLJjUHkz63pXwK9NafxiVC0adypj23wh7EyCJGBI/guEeRApV+Ril98nAZ35pipTW1mkaKoQeZL8lkSyMPPh/JN9vgwHPrtEMZ7DLxwESHEJa2N0kT7Ib2iDoPieSWm1EFlRv4MUOojIfx+NxsLC5R6rDyX8zCl251GCbjousgTlelaYYEPZXSkA4frWGr5/eEc69Mh7DvenaQZTDNdtj5rJBH7YOWLh6oKqxHCeRhWIjVWBrSPHLEyeB8nY3hQ+iRUod3L8PdCsa14aB1GeQQAn484FSpWAADRcWpJYt2Fp3mvu08CUM2g== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1637176651; bh=X9/4FTtrNoOph1HdFKGO+XMeT4PD3urrSr4exYPkRtf=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=SReXMGkG+hmF7/iJo337KTsay3D2p91cWRNNN3nra/LXd4r8DDWUjqPDU0NK6p2JzmTZkChPcPkA6QNZ4SC1npF9E18n+PhOr4foN80+cznqyuMYQZ6IkXAq6jcoluKNQUFFKiwEeI6KarkpM/NqOdrBTfUD7V2eheLPcbY/vHlNlhzNA64doldjFGq4P+vru4XFfA/O71TUUkaSBBgGlAF9QqWEp3gwXw6zSRr7veHfHGDg9pzjpm8SuMJsZ7TCNznK8A6JGKLCrNCukZLIl1QSxJRnpZvt79cVeYspVM2PYB8k0wOnK01vQg46PEL8oVQrKDBpl/zcIOXL5oUaWg== X-YMail-OSG: oJPqCE8VM1k3U8YNDXMkc0tyUNjp0HqxiPP05x_2sU41sFzQgJrcQLenP_Tps3k coksqHFXCdd46sR36y3CVTU9kzBRoFA2ud4KR.PEXvpM0RIMXs_2d_5g6f9CPvoDF2HwIfwr3fol blNW4hHYW6iRZQC56YsNyexIJ1fe.I6RN.TNcU8pIp530rzV8CRMWlz5WDCxJPjKOMaxuc0o92iu lb.d8CMj1auG1icxM72UugWTtG9zzyHE3cS__EaVkDNX627HkWpEMec4RVAj1I4tj4IQZCrgM.t1 gNJEQq6.Ntes0w_d5hx8n53MugnPQQ.QoXHHwF_PEcOPSCcOkk8eChQvqMbRBPouXhl_xufqzmbG X.s5CPO8v53KF09i6BmdqvcQUXW1mOdUf7lAkfxsonlKCzLNv8IZTFh59VJyGisLCMzkyeY96qZR pRMw_qKE_WkjV10Bhb8gRZhodLmDejxS4gqbxr0fzcAgivjaw_5X04rwjGaqh8948pGV732Avj9p tSpdY7mX4MmxTugO2EFY1t6uUr56Cff2.mA.xkmQx1ceDE83Z_ob6ZMf5IC26XhlCVJEAbtDU0AF P7rtRmQ9jshVBeSNZT_jPE6Efd5UcjdiRceKeXfDB4z6HZO1BFnv_x2ADDFjtM4dyASCK20NjYej 6Co9MYk1DwbhdIfXLClyMuZ0AzwkoSwL9zWDBN1LaCreicLm8MzGRmxme1vCLEP.JtEqdd4ALIcG BoYh4528OWWPvhANW4hElKor5NzG9vjesR4jFx5fg9_BgpIjdLdGRPp7xv6Rgedw4nSOIJrpCDIK IO5lMp6uESVMYqS4yuytEdaK16C4M.SlLIi2p2KMixqhxlAAdeteNeyncPhalIGOW9KHJMS97DuH 34Spz42HwXcOojjkiRwuIssn8rgNl4LAlHy1vAwPf8i99_JBZFcYRZDmIR4YCCu4wXNXp7d.gWWU 3WEru.fCWjAMoMzBWTpgT6GTjal0KSc4bTDYz9uQ3fSnMzjKDU5hP5QrxSA61ZD3hCVR1dhWuXzP UUWtaZvk5rSYjn_CtSmVpLpsdsKD8hvuiBhtjfWrXBH_mEX2wDXnrJKy0qEiU7XGZFjboTL8TzpN GLL5tuNjKYh2gLi.L9_pizGbXS.8d0wMBLtuxqYFG_CEZ8fdx3WKYPWRRWRQZg6e40Iv96NPnOEI ZCHwS8exTK1zPI6LolDNcpomIVeaWUE3tkuefOC8FECvYWgKYOyqONaNjCQATkART4VmWCW06mmo QI5IZbLDorecaM1Tz8ullLwgubHK8Ek9cG8tIoxE7JK7Uvk4M1ZL8svHuMvPdmJmGoLyXsgh.kLj csgaHwgEQxs6N6PR2ImIEW87eLd40aph5xDqvWMJcbWk2wgynUeyUhYuNmrKvh76VotqZv2NYqpk JGDqWto7iBtQugCjdonG1gwjqoWzJev2VSc1WTplZ91G5brIBki6KR8KJnTjRAS_kmAHLXdfqgIh 8lx498rIyUjsB4XxuZywzIHXXg7mtJBN0du9VOunEZMQM6R.IcomKg2mahhAJmnZfC4guUqABC6q Z7wTMiR0TfPOUeGlJxryUYpyAmaAsdTQE4VcEbGOc2SO.OT.8vdH.RgahdX63Pe1m1oE4I3_F7BJ LqHpRCudxxOwTc3yvi_WzCvcY05XKB7.qQt4FtH1ZeO2JxyAALCkq5bhnaLGvTxOkWmSEChiBVNH RvwNKqfhpGrHTpVvGKSVj2al2qnA9RfTz.eCu7SaIYu9NTRJfaoHrWdAokq1RRKqjYBI.XUaTk.V gdqO9oA00kDoghwDmSDg0onGTpVsQdyXEb_yrkNVDa4jEgTgkIwRJEkRBDOutJYkRgzASSfCEZGe pwF3ibCELHeq6r9BebLuNLvQ0fGtXKFSCsffmVYt1xROZ6Xerrxw_X7QqTmq8nXA7wrzIyweI0kY 9G4dXSEbVaqN0c2pMb9VqWqgigCOS.TECW.ThFc0QC0X8b1PxE9rgMX2GwEfDndwOewM_SwAExK7 HO_4LrW8VJgKt6S8aYPtMSiy5wsM8Boks447uwI5Rvb2MVd6J93QWPdo8PziY5t49MId6_k_57ui LsC38mlGT9SBmeo.8Buwd38orNyYRjhcfMNzbaAAewpnBoVhyMJLw2kpSQ_OHFN.E1GLyb6hFxzw 3wnB.9DC.rHx8rtZ.JRw1fc7uRA0GXr1P17WSswTgHHEu97rP1WoBA0tKkaQS5oSY..1Jt9sGjAC GxUwVTHIgQycZVP7TFgW6i2ufAZRv9NWpPijP_1VxeMUp8Fm0.s2_o0rs.1SAoqnfizZQ8tBStP2 5cHgFLUrXFf3YIYgWAgN7rA-- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic311.consmr.mail.gq1.yahoo.com with HTTP; Wed, 17 Nov 2021 19:17:31 +0000 Received: by kubenode517.mail-prod1.omega.gq1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 64521ccdb33749a612aab2229e750149; Wed, 17 Nov 2021 19:17:28 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.120.0.1.13\)) Subject: Re: aarch64(?) poudiere-devel based builds seem to get fairly-rare corrupted files after recent system update(s?) Date: Wed, 17 Nov 2021 11:17:27 -0800 References: <2CA61249-321C-45AA-9755-597146AB8E9F@yahoo.com> <65AA4BCD-EC4B-4A19-B750-C7FC6E5ADDF5@yahoo.com> <9BF4F65B-6437-4D88-AF34-9BCFBF90D6F3@yahoo.com> To: freebsd-current , "freebsd-arm@freebsd.org" In-Reply-To: <9BF4F65B-6437-4D88-AF34-9BCFBF90D6F3@yahoo.com> Message-Id: X-Mailer: Apple Mail (2.3654.120.0.1.13) X-Rspamd-Queue-Id: 4HvXkV2d1cz4RPZ X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=cxt1dJrc; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.65.205 as permitted sender) smtp.mailfrom=marklmi@yahoo.com X-Spamd-Result: default: False [-1.50 / 15.00]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; MID_RHS_MATCH_FROM(0.00)[]; SUBJECT_HAS_QUESTION(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; NEURAL_SPAM_SHORT(1.00)[1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.205:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.205:from]; RCVD_COUNT_TWO(0.00)[2] Reply-To: marklmi@yahoo.com From: Mark Millard via freebsd-current X-Original-From: Mark Millard X-ThisMailContainsUnwantedMimeParts: N On 2021-Nov-15, at 15:43, Mark Millard wrote: > On 2021-Nov-15, at 13:13, Mark Millard wrote: >=20 >> On 2021-Nov-15, at 12:51, Mark Millard wrote: >>=20 >>> On 2021-Nov-15, at 11:31, Mark Millard wrote: >>>=20 >>>> I updated from (shown a system that I've not updated yet): >>>>=20 >>>> # uname -apKU >>>> FreeBSD CA72_4c8G_ZFS 14.0-CURRENT FreeBSD 14.0-CURRENT #18 = main-n250455-890cae197737-dirty: Thu Nov 4 13:43:17 PDT 2021 = root@CA72_16Gp_ZFS:/usr/obj/BUILDs/main-CA72-nodbg-clang/usr/main-src/arm6= 4.aarch64/sys/GENERIC-NODBG-CA72 arm64 aarch64=20 >>>> 1400040 1400040 >>>>=20 >>>> to: >>>>=20 >>>> # uname -apKU >>>> FreeBSD CA72_16Gp_ZFS 14.0-CURRENT FreeBSD 14.0-CURRENT #19 = main-n250667-20aa359773be-dirty: Sun Nov 14 02:57:32 PST 2021 = root@CA72_16Gp_ZFS:/usr/obj/BUILDs/main-CA72-nodbg-clang/usr/main-src/arm6= 4.aarch64/sys/GENERIC-NODBG-CA72 arm64 aarch64 1400042 1400042 >>>>=20 >>>> and then updated /usr/ports/ and started poudriere-devel based = builds of >>>> the ports I's set up to use. However my last round of port builds = from >>>> a general update of /usr/ports/ were on 2021-10-23 before either of = the >>>> above. >>>>=20 >>>> I've had at least two files that seem to be corrupted, where a = later part >>>> of the build hits problematical file(s) from earlier build = activity. For >>>> example: >>>>=20 >>>> /usr/local/include/X11/extensions/XvMC.h:1:1: warning: null = character ignored [-Wnull-character] >>>> =20 >>>> ^ >>>> /usr/local/include/X11/extensions/XvMC.h:1:2: warning: null = character ignored [-Wnull-character] >>>> >>>> ^ >>>> /usr/local/include/X11/extensions/XvMC.h:1:3: warning: null = character ignored [-Wnull-character] >>>> =20 >>>> ^ =20 >>>> /usr/local/include/X11/extensions/XvMC.h:1:4: warning: null = character ignored [-Wnull-character] >>>> >>>> ^ >>>> . . . >>>>=20 >>>> Removing the xorgproto-2021.4 package and rebuilding via >>>> poudiere-devel did not get a failure of any ports dependent >>>> on it. >>>>=20 >>>> This was from a use of: >>>>=20 >>>> # poudriere jail -j13_0R-CA7 -i >>>> Jail name: 13_0R-CA7 >>>> Jail version: 13.0-RELEASE-p5 >>>> Jail arch: arm.armv7 >>>> Jail method: null >>>> Jail mount: /usr/obj/DESTDIRs/13_0R-CA7-poud >>>> Jail fs: =20 >>>> Jail updated: 2021-11-04 01:48:49 >>>> Jail pkgbase: disabled >>>>=20 >>>> but another not-investigated example was from: >>>>=20 >>>> # poudriere jail -j13_0R-CA72 -i >>>> Jail name: 13_0R-CA72 >>>> Jail version: 13.0-RELEASE-p5 >>>> Jail arch: arm64.aarch64 >>>> Jail method: null >>>> Jail mount: /usr/obj/DESTDIRs/13_0R-CA72-poud >>>> Jail fs: =20 >>>> Jail updated: 2021-11-04 01:48:01 >>>> Jail pkgbase: disabled >>>>=20 >>>> (so no 32-bit COMPAT involved). The apparent corruption >>>> was in a different port (autoconfig, noticed by the >>>> build of automake failing via config reporting >>>> /usr/local/share/autoconf-2.69/autoconf/autoconf.m4f >>>> being rejected). >>>>=20 >>>> /usr/obj/DESTDIRs/13_0R-CA7-poud/ and >>>> /usr/obj/DESTDIRs/13_0R-CA72-poud/ and the like track the >>>> system versions. >>>>=20 >>>> The media is an Optane 960 in the PCIe slot of a HoneyComb >>>> (16 Cortex-A72's). The context is a root on ZFS one, ZFS >>>> used in order to have bectl, not redundancy. >>>>=20 >>>> The ThreadRipper 1950X (so amd64) port builds did not give >>>> evidence of such problems based on the updated system. (Also >>>> Optane media in a PCIe slot, also root on ZFS.) But the >>>> errors seem rare enough to not be able to conclude much. >>>=20 >>> For aarch64 targeting aarch64 there was also this >>> explicit corruption notice during the poudriere(-devel) >>> bulk build: >>>=20 >>> . . . >>> [CA72_ZFS] Extracting arm-none-eabi-gcc-8.4.0_3: ......... >>> pkg-static: Fail to extract = /usr/local/libexec/gcc/arm-none-eabi/8.4.0/lto1 from package: Lzma = library error: Corrupted input data >>> [CA72_ZFS] Extracting arm-none-eabi-gcc-8.4.0_3... done >>>=20 >>> Failed to install the following 1 package(s): = /packages/All/arm-none-eabi-gcc-8.4.0_3.pkg >>> *** Error code 1 >>> Stop. >>> make: stopped in /usr/ports/sysutils/u-boot-orangepi-plus-2e >>>=20 >>> I'm not yet to the point of retrying after removing >>> arm-none-eabi-gcc-8.4.0_3 : other things are being built. >>=20 >>=20 >> Another context with my prior general update of /usr/ports/ >> and the matching port builds: Back then I used USE_TMPFS=3Dall >> but the failure is based on USE_TMPFS-"data" instead. So: >> lots more I/O. >>=20 >=20 > None of the 3 corruptions repeated during bulk builds that > retried the builds that generated the files. All of the > ports that failed by hitting the corruptions in what they > depended on, built fine in teh retries. >=20 > For reference: >=20 > I'll note that, back when I was using USE_TMPFS=3Dall , I also > did some separate bulk -a test runs, both aarch64 (Cortex-A72) > native and Cortext-A72 targeting Cortex-A7 (armv7). None of > those showed evidence of file corruptions. In general I've > not had previous file corruptions with this system. (There > was a little more than 245 GiBytes swap, which covered the > tmpfs needs when they were large.) I set up a contrasting test context and got no evidence of corruptions in that context. (Note: the 3 bulk builds total to around 24 hrs of activity for the 3 examples of 460+ ports building.) So, for the Cortex-A72 system, root on UFS on portable USB3 SSD: no evidence of corruptions vs.: root on ZFS on optane in PCIe slot: solid evidence of 3 known = corruptions Both had USE_TMPFS=3D"data" in use. The same system build had been installed and booted for both tests. The evidence of corruptions is rare enough for this not to be determinative, but it is suggestive. Unfortunately, ZFS vs. UFS and Optane-in-PCIe vs. USB3 are not differentiated by this test result. There is also the result that I've not seen evidence of corruptions on the ThreadRipper 1950 X (amd64) system. Again, not determinative, but suggestive, given how rare the corruptions seem to be. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar)