From owner-freebsd-stable@freebsd.org Tue May 4 07:10:28 2021 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9821E6287B7 for ; Tue, 4 May 2021 07:10:28 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic310-20.consmr.mail.gq1.yahoo.com (sonic310-20.consmr.mail.gq1.yahoo.com [98.137.69.146]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FZ9wM535Mz4hSr for ; Tue, 4 May 2021 07:10:27 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1620112225; bh=TXn+exF8+ws+Nv/mmJg8+Lo6gi2ok16zp0rVnBFjxig=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=i9y2XJS8ph1MZy9Zq6b2cNKZUjuQiYIHVcluaZgFk6Q1Xroe+3QoAt7XTvJA2vgKTIjlYjoOX1kClGwf55OcHz3k5Lji+55iZod+kND1NAB5hCvnLB5JfRkb90C/SAoCDT9BB3VFZt6/WfXs9XpkiqQXp5WY7deTX9jpECgGtDRBory0efn8vVJ8kctbWR6tlaiG31pE1Tzsa6rPHHJO1/5R2suIvLvFgHfruJMvtJ5BKyno6Pf+dXefmFuGOAzQNWU6++6Wprpb4tCmk8xBc01JYY00gE9D/Ktj1N8eaAiF7YqlAKArWNz6iiAtUenVBAiq1w7B+DZ2kun8MLnTrA== X-YMail-OSG: z_T7vscVM1mPnc_KHLs0GWzwxZdJOWLxX4WBJlJ5UZfPh5XgNcInxZLpbqKdRhZ vnFz6pVxx.bpxNteBtoIeju02HVMUQsgYr.2OkZr8ql80NnT1VGeuQl2SjBvUEQs3iIS5ff4LT1X EeMYUGDbh0wy54byJ4Qm8JicanTqAQ.zUHiw043rzl6HOdswfNFnXNIzBkoQuccoJUgIkZtGm17H 0BqCfxL61u10PUFK4uTPpTAzqbHk5jVlnxHZ89blker.UmYyF3RaWL9e1vNVfv6nWkKqN8giSujw S1E0Mth97JeCTdFO6IAPaW1x2a86zxhAZeKzAloWCmC5i9T.Xs73HqI2jSQQLfqR62a4BKe5Z3nR wHVZ32GdyrY5URij5GkvN7u8Q05GzOSpvLuV4aouHBkBHfKij5ox8vKX8tWAsBnPRseIvT6MaYJ8 b1DAM3YEM0opRxnTTCfLpDG9KVOEEt1dL7H8XFemP7s2iF8ryZliPFLeJ1qWZ61BJ7WBzNFKuVRV lmMkl_Bt_uiY_RNAKjhFvvKsqJsjBt8CxKOQj97nmnQW08aXefEx16VNvPaVVcJVa_1nMYqYxGtb fk9ajJ6pHzHXQtUeIhVadLi9XOl_r.zfQree1EbAdowdy.SasT7GmdNn6Es.eYTtgvLJT0DmJDLo nc9X3gTXxBMjhjArYmkDVoZma3xTHVWWWMpqIPicT9WuriB1oNhnYIiLi6AIQ.2sOefF6drLgB4z nloujHgmlM6Aij6w.Km_XUmpZcd4SGLgvaqTkFP8JStunSiyyaPTgFgPDA7Qimv8sE2KgnR5lPKI 7f_cnkZcZdW0sXZh6r8Jq8CRWPT0DFHYl4NjDPdaVM2Rl1jWOGcGS3c_y0Kt2e51KIxcWX_kXYGI 0OJt9OwGqpugMl4RN8QMgnYXgTkSxrJNBBT6RNo4p7xaDJKGqtQk2ivsMIAZbZsW.kryIadUlAcm sH1zi3dkIjmuRHC2Z38mflIghIe0vQrY5NpgwGJO8yo6wEaluDwOP4w375eX_e_3BDiWy5HS9_gZ fhXPMjGJw0uZbfRvubKUKyjtvgvzVYEoxuwvtss6OuDNbrvjemSFqiU0dD0Z8p9aQjIKWCrLvUaO PneV4szVoxgB1gkcxMGL3oDK2bFlmLwOUT8h03recyit4bFA.d9mfA97IEeHFP94IyJkr8BD6_aG AphVZg.ibSPEKdx8ygCTgoN4HkdVIv7wUzbH5qiXkzMSE98UzY7rSXsoKGNM2ahUU5yxfhuu7ezh X0e0_ZHJ_ofOwZJ09EqouVvbwJtKLMR2WkTMSqc6Dq2eCAoLX91YzlEUMheoNxBS81_oL352JFuX 0.qf5XLoTopgpVQM8E5Q1xwQpbxnrZO6xKH9i5.MRca6IAwqL1NFvuj.MHPFRTMIVxc3ZxID5RRT FrgGSP96woNxdkXBTgah7xwugeTzSCdcLwQ2HnmuF0xNt346Dt8pnOeKCvYBp2YigMrdchBHWXoM ewvDuNsCkpQz9p_TeU.JhlgcrumDQPwy4ndqMb32TJ9mlen0VpHJ27kz0eAiuJ0OLzBLEWeHDaAn GJNCyELAnjrPI11afW10ZKh9ds7KqsqtwJkWmOJIGsmjxKfYrK1GbkpZ_MrFQdIAqfc9p3.PoEfA 8N52SIxdcWBg9Xsa9hZytp6LmKNZPcz1mPnJmL6AUkcbV3zaN1JW3FrF7OQYblYuMvuFCoIF5yOj mpj4awwxuIkQAKdKKgMk3gGw72t2.Opn7wHRkPFXwKmC1kULmePptPCqgT2TLcfmNbf4CjvKQOtl wMgvr9bpdNOCfTZACK4hYfyYSpAqQUQ8GqGNMG5.BVBALsPqMGpy5NY2IPEVYAYlGouWvi.Q7OEN aeYWlNEmVQBlg7bpdcgW7ZXXYR1gyCvADNRYLEUjvt_RZHNAMHBh9bP6slO6ez_ez0H3qs.E6NZz gd9AKc1nq00LKmE2MoESB5BULb0gBvau_tJgaqcAmcCym_8fcUZORlxGg4_4VVY731pdF46q6R3K m9jLZN9TtoELcFAH7Fi1WF5IC2RkQoVWiUGySBBdBd7TLjGDDKfn.0JFz3nPe6VZPEiPaYXRYojy a6nyHElV_ywFuwqeF140cKjd5khhfCvAif9pbwT.JcgktjyU0WCaL.rKSH3PTt9BLyVeIXqqw_kG VMDDSngekaK07u7VvOb7twgUwiBMbnzf.xzH7sJK3NjCMKhsXUuaYKTTv3SNhUGC9Mz2UKpiYIAj GrBxSn1YhKkXggW4O2XBnHKndvCabM0yJr2WONALwRTCG9JSnh0lvupoHP0deTBOVzHMe8Lj1tR9 6Uo1xcMzapTdag705VrKHtUJ4TM3BcvwFY7R5Js6UgFGYy9l7AhjGmuY3BIqnJ5obFJKuCReKBR3 xzk_kLMVpl0nnXRX9q8oCx7cTCBUlJRtB8cPTc8CHHq0WjpL5kHOS1W7UxEV51yeFLCnehZyDqzF QywLERj.bCWUMivUlW8JAuXmJncOCpCf64tK0y0i5VcCiUNUDRMTfz4htqCNshyIyGCLvPHQ_JxE OZxxEm8BhnE8hs9qbHsYx40aS8QH17UPXchNGs.DtsT.L54wKq9NOjz_i9Vl9zdh6eKGHme7k6cW S1PP5xW_kDb5932PFmNece67Y0gLx0HYGLwcWZm9ItyhkZcr5vSJ42Ystk73VEUy0wP7lYZYfyVI nNfMdz_Uu82WaOKkCXgTdg2anvBNOLhOaU.QRQFl. X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic310.consmr.mail.gq1.yahoo.com with HTTP; Tue, 4 May 2021 07:10:25 +0000 Received: by kubenode547.mail-prod1.omega.bf1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID b42c6738fb9278c8f9dc9d01867b8717; Tue, 04 May 2021 07:10:19 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: FYI: WITH_REPRODUCIBLE_BUILD= problem for some files? From: Mark Millard In-Reply-To: Date: Tue, 4 May 2021 00:10:16 -0700 Cc: FreeBSD-STABLE Mailing List , freebsd-current Content-Transfer-Encoding: quoted-printable Message-Id: <7D83A5C8-FDB4-46D6-A148-15011606B3BE@yahoo.com> References: <35482701-95A3-48B2-9A8E-B7E0092119B1.ref@yahoo.com> <35482701-95A3-48B2-9A8E-B7E0092119B1@yahoo.com> <43F20589-A7C7-42FF-9020-09CEE037D1CD@yahoo.com> <91F820A1-8940-4246-A20A-E62685F50079@yahoo.com> To: Ed Maste X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Rspamd-Queue-Id: 4FZ9wM535Mz4hSr X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.50 / 15.00]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; SUBJECT_ENDS_QUESTION(1.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; RBL_DBL_DONT_QUERY_IPS(0.00)[98.137.69.146:from]; SPAMHAUS_ZRD(0.00)[98.137.69.146:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.69.146:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.69.146:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-stable] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 04 May 2021 07:10:28 -0000 On 2021-May-3, at 21:27, Mark Millard wrote: > On 2021-May-3, at 19:26, Mark Millard wrote: >=20 >> On 2021-May-3, at 10:51, Mark Millard wrote: >>=20 >>> On 2021-May-3, at 07:47, Ed Maste wrote: >>>=20 >>>> On Thu, 29 Apr 2021 at 02:50, Mark Millard via freebsd-current >>>> wrote: >>>>>=20 >>>>> Files /usr/obj/DESTDIRs/13_0R-CA7-chroot/sbin/ping and = /usr/obj/DESTDIRs/13_0R-CA7-poud/sbin/ping differ >>>>> Files /usr/obj/DESTDIRs/13_0R-CA7-chroot/sbin/ping6 and = /usr/obj/DESTDIRs/13_0R-CA7-poud/sbin/ping6 differ >>>>> Files /usr/obj/DESTDIRs/13_0R-CA7-chroot/usr/bin/ntpq and = /usr/obj/DESTDIRs/13_0R-CA7-poud/usr/bin/ntpq differ... >>>>=20 >>>> This is unexpected. Unfortunately I haven't looked at = reproducibility >>>> in a while, and my work was all on x86. This could be a regression = or >>>> a longstanding issue with arm64. >>>>=20 >>>> If you install the diffoscope package (py37-diffoscope) and run it = on >>>> the two directories / files it should give a more convenient view = of >>>> the differences. (Or, if you can make a tarball of the differing = files >>>> I can take a look.) >>>=20 >>> I no longer have the same content in those directory >>> trees: newer rebuild and the same buildworld used to >>> installworld to both places, instead of 2 different >>> buildworld's. I'm also unsure how reproducible getting >>> differences was. >>>=20 >>> I can eventually do experiments to test multiple separate >>> buildworld's and installworld's, but the machine is busy >>> building ports and the llvm builds involved means it >>> will be some time before I'd switch activities. And the >>> buildworld's involve llvm builds as well and take notable >>> time themselves. So my next comparison will not be any >>> time soon. >>>=20 >>> I'll let you know if I manage to generate another example, >>> this time being sure to keep the data. If I try multiple >>> times without finding any differences, I'll eventually >>> decide "enough is enough" and let you know. >>=20 >> I've still got a long ways to go to do the first >> actual comparison of builds. >>=20 >> But I'll note that I've built and stalled py37-diffoscope >> (new to me). A basic quick test showed that it reports: >>=20 >> W: diffoscope.main: Fuzzy-matching is currently disabled as the = "tlsh" module is unavailable. >>=20 >> As I'm not familiar with the tool, you might need to send >> notes about how you want me to use the tool to get the >> output that you would want. (And, so, I get to learn . . .) >=20 > I've tried another experiment (* in the path matches "28" and "30"): >=20 > # diffoscope /.zfs/snapshot/2021-04-*-01:40:48-0/bin/sh > $<3/>2021-05-03 21:08:48 W: diffoscope.main: Fuzzy-matching is = currently disabled as the "tlsh" module is unavailable. > $<3/>Traceback (most recent call last): > File "/usr/local/lib/python3.7/site-packages/diffoscope/main.py", = line 745, in main > sys.exit(run_diffoscope(parsed_args)) > File "/usr/local/lib/python3.7/site-packages/diffoscope/main.py", = line 677, in run_diffoscope > difference =3D load_diff_from_path(path1) > File = "/usr/local/lib/python3.7/site-packages/diffoscope/readers/__init__.py", = line 31, in load_diff_from_path > return load_diff(codecs.getreader("utf-8")(fp), path) > File = "/usr/local/lib/python3.7/site-packages/diffoscope/readers/__init__.py", = line 35, in load_diff > return JSONReaderV1().load(fp, path) > File = "/usr/local/lib/python3.7/site-packages/diffoscope/readers/json.py", = line 33, in load > raw =3D json.load(fp) > File "/usr/local/lib/python3.7/json/__init__.py", line 293, in load > return loads(fp.read(), > File "/usr/local/lib/python3.7/codecs.py", line 504, in read > newchars, decodedbytes =3D self.decode(data, self.errors) > UnicodeDecodeError: 'utf-8' codec can't decode byte 0xb7 in position = 18: invalid start byte >=20 > The two older snapshots of a Boot Environment have > bin/sh files that compare equal. But every program I > tried the above sort of thing against on got the same > UnicodeDecodeError result from diffoscope, byte value > and position matching. >=20 > These snapshots have more than an installworld in them > and so are messy to compare overall. But the > installworld (and installkernel) content show similar > differences to what I reported before as far as > example files with differences go. But this is aarch64, > not armv7. >=20 > It will still be notable time before I have simple > installworld tree's to compare. While waiting for the 2nd buildworld to complete, I used the 1st buildworld's materials to installworld twice (to different, empty directory trees) and then did a diff. The diff reported: # diff -rq /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm/ = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm2/ | more diff: /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm/usr/tests/local: No = such file or directory diff: = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm/usr/tests/sys/pjdfstest/tests/t= ests/tests/tests/tests/tests/tests/tests/tests/tests/tests/tests/tests/tes= ts/tests/tests/tests/tests/tests/tests/tests/tests/tests/tests/tests/tests= /tests/tests/tests/tests/tests/tests/tests: Too many levels of symbolic = links FYI: # ls -Tld /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm/usr/tests/local lrwxr-xr-x 1 root wheel 14 May 3 23:18:22 2021 = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm/usr/tests/local -> = ../local/tests So this looks like the expected result and suggests that the problem(s) are at the buildworld stage. (No surprise.) I should be sleeping by the time the 2nd buildworld for cortex-a72 (aarch64) is done. (That is what I decided to test initially.) So it will be more hours until I have basic comparison results from 2 distinct buildworlds. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar)