From owner-freebsd-stable@freebsd.org Wed May 5 13:10:09 2021 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 203BB63E67A for ; Wed, 5 May 2021 13:10:09 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic307-54.consmr.mail.gq1.yahoo.com (sonic307-54.consmr.mail.gq1.yahoo.com [98.137.64.30]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FZxrw0Qb0z3qpd for ; Wed, 5 May 2021 13:10:07 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1620220206; bh=ZY4QfGsU7CN9D8nTDPfhWWR8AaL/9Ku86a5h9wMdbEg=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=Zpg79N+CUa7AQ1cGxoJ4VRbkC7mNtajVB/v2w9oTw1rhV8LABrmhktF4UvHDA88yFMt/kacFCIDzlGVhPH/bBhBJL6bBDuFbASbCkvCvt79vuqZ5GlI3SZXDFiN2wgjk5AdHPHI3oeI4Ohg4cJo+YPY0xoIkWH0wUl8zUaEwE4gjQ8+46L6EMY4Ka3FvXIq5FZgrBTdPtRo8OaUvxRn1ITGqhl8b7na+x7kC8uRWXL2QzQBil0xUp24SS5854cDxTtq5HHYXW+34qgQ0HSx/FvnuAqqIkTsONs5rDwIUm/igMColJQiDtKWOEYbcWuRcFhF+flTAXDO4KCHN8X+dHA== X-YMail-OSG: nBUbTQIVM1li.Vc0XIIHhwVFOncw9SNALRSm9eqBkzX_Pu5EcPkhZ65sq9ANjGT M23mejif7C4v4fyBEec.lhIdj3.qm0J5lRH2u3WFJPS3dqANLSrsuvYm6EAZBDJHaI.iA1HozSPY WMW1E9.ulwEWxR_Ai4UVZJcDy0nNhIs49F6L25US0NPP80PigExay2sYw1VR0XDLCphd21h37FvJ R4u8upAp59EB56O1hyF0uTFJfdmT.xXIo.g5DT_NoOiVmQ2hY.4MGCL7xfs_dTCZsivnqduvcsia QGFD10_x97pMbmxP96rvf_3LxrEa.Hi4gulD.XqWlR6nKndr6f6ePiTl25B0MkovGVgmPSA2ZzQb VHSyAfNkuaSJi9vrinYCWbjLBAyySbZfYGQp4Bi_nN.eia6I3Q66ZA6nRXZsuQ2CuPIKAUqjNRaH TWvy1y.TlkYqUgd07Hlg2MhSdM_YgUaZTs51S5DwsKFdTYOl9J.KwNUHXXgr5k1mQlCxyfP5gqJ0 Rh0mibccmXgIzXM.XKHhrK1sP9pOyZNcLsaMJ5k.Ba2jgdzcLna_naaFak8ZgpwiHKGPr5A6jNIs h4dbTXuhI3cYZoHMhAzbNy5no9L6pK3uY_onRm616s4jbrhrRJU6nCzd7S37WbxYj.reXv_huR_Q pkMh6IxoYoEwTAXM2ssfrxbuRgvbcAe96OueIGnTYqwlctPEHv9sES1SZ4m.WkE00G7FyZluJNlH MRysEkL.XMv63xD.dgPQvDj8aCJIt8qCEvgeFmA1NuJdEj8UKB9ehdz9BoVmkJ1Mueqyv0p0.h7t svyro55QLDGlk4cYEl002t5svvleA35.7V4DEzrpFqqkxyMMZu5jXUuaRHmsnE5UeDCz.UDa5Px0 A94Ywj1ZRZG2X3TfzkUwK5AkGLE1gdoQJWMXwdRGtaesfX7my8bndGheyB5j4yLY.DCZj6mLogW9 M_h0ca3zzjx5R_vDvevpELy9embNIMyqlxlSI5S9kvVQdI6s.Y4doEl0FT2VQHO_J_7ccIFy74iE qjNCM52GftmOoukVJjfccXkSArjEqTL4cFDMOkDOmoKJmfInDrdHt7S..aSp1Huywaw9rA1GX3zp mS_EujRvdVhESoiycZO7xyVRhHNU3545hTykvFTdTntZP5In7s7PGioRslOkdKXAfuglx0RMNdbG vApOISsAAieCg13riciSC8Dc2L88Mv3RQR7qisB2eN4OfvANTO.7h9wQjAp91rKniVx5M_CUeH36 bQG61DzNdE80aFWISFy3nidhasp2gG1vCEOtfPZIhT7oGmdaz_p43AtkbOX7XA20q3uO5sgNlrKd p1u0saqiPXWCN5AFHkH9pjujaPOucHZUtR5ScIqIn7lA6AfR7mjNsfT30bHqz5kY9U6YnS6Y8466 QiPuarI4UgmtydzNdjz7CBlQ5hODv8PRh7IqJb4l_6pexN7Wf5jlnUQkPsZSulbY2dI5olv8s8xG 1fa3o1K2WRLqI2sosCJ694pRCqYLZQxNtxhECSuiYq1RuhFEAe3iNNMRpKhlgvGKFKZmDeXBB8Qj PgVfuDmrhj3BpYGLvugqcFnuyjq.vgt07XEQn4dR4AgmJQsE2ehIPVQZhSm0JzlGneDpFEeCKMD5 1MatkIWT1JjMV2AXwHCuif3jYA1P.HiMKKhdkLOVHe5GhAt9VpX7rX_T92x6hHXZ1i6n8.9BsFb4 yjcNMGSlIyg9y9Kma4Ny1PIIYasjdJ.9IET5qi79JNIwEwmvhi7GjVgGb5LX8uL0DpfGlnpvCX4c HlSYTDSss2En3EnI4DUyhNGIand_kPnocDiEhnIsld523RVvQ_qv5tVDkYavtIVkXhmjqXwWoQ1v KojQA3mUQAw0CzSg0ygJzsPGhlu_8MhaTiH8O_ndmejfigOGaPjI2q_Bm7XseKilu3ux_glrTHG7 vEJmlUqMt2l5LKnwpd_ntUbFTbRvxpZ5S3hV4p1GvA5O3P0wzNfBeER3yemzteq9cvyQLxEi5x9j j_YPOtWnrPYWhtRZ8T5CiMVFuRGPMIUKIYDGl6faQItsiJg4hy5jvynMzScL_4woAEN72mcWwyUU _83DdGLbVSAQ5f1OxBX1kqIhRI2rqN5..zRbnooZcC3HuE_V.wFcqiOpN_Y6sP_Bc.rN25aWnITY Y.RaoGF0HXZsjXkTESIbljwHhliamKkrphKMpQkej6WFAbCTkZalQtJPzx.hmAqy6cVbOJleoZfg ZgiUQYsk2iiStt96U5xAXXob1Cb99Nv0vXvqpaxRvae3vbM0GkxTDOAEZ6_X8kff3DXLNFZTMZ2F j0FtiVPpb42PJXaNvC4a2J3F1nscDKz.zcuTD5uaTck06Q0Vyp32ECF9uFp9rCVmXJblN2Fv0rfD Y91xC1UAcMQ2fJIk3V7SuofLPZB.T7XQIDwcpWASWzdlHkhlvoD1Z3Xdd8YKejhpNdiH4tnpF.TL DoWgNAq5Dx4RqpZI.muoW2wX_5rqP99JnntM2hndKCyJrjAQ2C.SSIW74VFshpfs_yPBqfUsuLY6 kg7lnd1AAfkUOshFpA9ZHyl8D.W58rxEmfLZjEFELZqbM03mBHeNyV_Ml3OimYD416EbmDWfujIX cqvF6udbi9cdkhvRsXlzG50Sm.7OaMlbwS_zMt1tQEx6Ip.wTSNZVFYS9vDcd6COw0evr1N2ttn3 As98hZGu7gRq9tZeRrLY6PSRfSvD17wYkryNZkehXel0LySW5nl04JqjkTfXj7NZjKa56ZVLk_sp hE9YGTuzuSplC8loTUoYpmhOZAZuwhq9KUHfNY.7eHQ-- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic307.consmr.mail.gq1.yahoo.com with HTTP; Wed, 5 May 2021 13:10:06 +0000 Received: by kubenode512.mail-prod1.omega.bf1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 8f9d596d715241f5175657af5d33c051; Wed, 05 May 2021 13:10:02 +0000 (UTC) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: FYI: WITH_REPRODUCIBLE_BUILD= problem for some files? [aarch64 test did not reproduce the issue] From: Mark Millard In-Reply-To: Date: Wed, 5 May 2021 06:09:59 -0700 Cc: FreeBSD-STABLE Mailing List , freebsd-current Content-Transfer-Encoding: quoted-printable Message-Id: References: <35482701-95A3-48B2-9A8E-B7E0092119B1.ref@yahoo.com> <35482701-95A3-48B2-9A8E-B7E0092119B1@yahoo.com> <43F20589-A7C7-42FF-9020-09CEE037D1CD@yahoo.com> <91F820A1-8940-4246-A20A-E62685F50079@yahoo.com> <27B5086A-7C98-4AE6-885A-CC7C7BD2F64B@yahoo.com> <3FC6BCDD-5865-4B5D-8238-3EC38AD4E78C@yahoo.com> <2E86A8E9-9F0E-446E-BF80-5FA3B8ECB197@yahoo.com> To: Ed Maste X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Rspamd-Queue-Id: 4FZxrw0Qb0z3qpd X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.11 / 15.00]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-0.61)[-0.606]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RBL_DBL_DONT_QUERY_IPS(0.00)[98.137.64.30:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; MID_RHS_MATCH_FROM(0.00)[]; SUBJECT_HAS_QUESTION(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[98.137.64.30:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.64.30:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.64.30:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-stable] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 05 May 2021 13:10:09 -0000 On 2021-May-4, at 20:26, Mark Millard wrote: > On 2021-May-4, at 13:38, Mark Millard wrote: >=20 >> [The first buidlworld is still in process. So while waiting . . .] >>=20 >> On 2021-May-4, at 10:31, Mark Millard wrote: >>=20 >>> I probably know why the huge count of differences this time >>> unlike the original report . . . >>>=20 >>> Previously I built based on a checked-in branch as part of >>> my experimenting. This time it was in a -dirty form (not >>> checked in), again as part of my experimental exploration. >>>=20 >>> WITH_REPRODUCIBLE_BUILD=3D makes a distinction between these >>> if I remember right: (partially?) disabling itself for >>> -dirty style. >>>=20 >>> To reproduce the original style of test I need to create >>> a branch with my few patches checked in and do the >>> buildworlds from that branch. >>>=20 >>> This will, of course, take a while. >>>=20 >>> Sorry for the noise. >>>=20 >>=20 >> I've confirmed some of the details of the large number of >> files with difference while waiting for the 1st buildworld : >>=20 >> The 4 bytes at the end of the .gnu_debuglink section >> that are ending up different are the checksum for the >> .debug file. The .debug files have differences such as: >>=20 >> =E2=94=82 - <1a> DW_AT_comp_dir : (indirect string) = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/usr/13_0R-src/arm64.aarch64/lib= /csu/aarch64 >> =E2=94=82 + <1a> DW_AT_comp_dir : (indirect string) = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang/usr/13_0R-src/arm64.aarch64/lib/csu= /aarch64 >>=20 >> So I need to build, snapshot (in case need >> to reference), install, clean-out, build, >> install elsewhere, compare. (Or analogous >> that uses the same build base-path for both >> installs despite separate buildworld's.) >> This is separate from any potential -dirty >> vs. checked-in handling variation by >> WITH_REPRODUCIBLE_BUILD=3D . >>=20 >> My process that produced the original armv7 >> report happened to do that before I accidentally >> discovered the presence of the few files with >> differences. My new experiments were different >> and I'd not though of needing to vary the >> procedure to get you the right evidence. >>=20 >=20 > The two aarch64 test installs did not show any > differences in a "diff -rq" . Ignoring *.meta > files generated during the builds, the build > directory tree snapshots showed just the > differences: >=20 > # diff -rq = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-0/= usr = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-1/= usr | grep -v '\.meta' | more > Files = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-0/= usr/13_0R-src/arm64.aarch64/stand/ficl/softcore.c and = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-1/= usr/13_0R-src/arm64.aarch64/stand/ficl/softcore.c differ > Files = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-0/= usr/13_0R-src/arm64.aarch64/toolchain-metadata.mk and = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-1/= usr/13_0R-src/arm64.aarch64/toolchain-metadata.mk differ >=20 > # diff -u = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-0/= usr/13_0R-src/arm64.aarch64/stand/ficl/softcore.c = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-1/= usr/13_0R-src/arm64.aarch64/stand/ficl/softcore.c > --- = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-0/= usr/13_0R-src/arm64.aarch64/stand/ficl/softcore.c 2021-05-04 = 13:45:14.463351000 -0700 > +++ = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-1/= usr/13_0R-src/arm64.aarch64/stand/ficl/softcore.c 2021-05-04 = 19:04:32.338203000 -0700 > @@ -4,7 +4,7 @@ > ** Words from CORE set written in FICL > ** Author: John Sadler (john_sadler@alum.mit.edu) > ** Created: 27 December 1997 > -** Last update: Tue May 4 13:45:14 PDT 2021 > +** Last update: Tue May 4 19:04:32 PDT 2021 > *******************************************************************/ > /* > ** DO NOT EDIT THIS FILE -- it is generated by softwords/softcore.awk >=20 > # diff -u = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-0/= usr/13_0R-src/arm64.aarch64/toolchain-metadata.mk = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-1/= usr/13_0R-src/arm64.aarch64/toolchain-metadata.mk > --- = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-0/= usr/13_0R-src/arm64.aarch64/toolchain-metadata.mk 2021-05-04 = 10:55:26.030179000 -0700 > +++ = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-1/= usr/13_0R-src/arm64.aarch64/toolchain-metadata.mk 2021-05-04 = 16:14:24.513346000 -0700 > @@ -1,4 +1,4 @@ > -.info Using cached toolchain metadata from build at CA72_4c8G_ZFS on = Tue May 4 10:55:26 PDT 2021 > +.info Using cached toolchain metadata from build at CA72_4c8G_ZFS on = Tue May 4 16:14:24 PDT 2021 > _LOADED_TOOLCHAIN_METADATA=3Dt > COMPILER_VERSION=3D110001 > X_COMPILER_VERSION=3D110001 >=20 >=20 >=20 > I may run a 'target cortex-a7 (so: armv7) from aarch64' test > next. That was the context for the original discovery and > report. >=20 >=20 The armv7 builds and installs get the same sort of diff results as the aarch64 ones. So it does not look like I can readily reproduce the problem files that had differences. Given the time it takes to run the experiments, I would not expect to reproduce the problem on any given timescale. I'll stop the reporting as I go along in my activities --unless I end up with a repetition of the problem. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar)