From owner-freebsd-stable@freebsd.org Tue May 4 18:14:14 2021 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 97CC95FCAFC for ; Tue, 4 May 2021 18:14:14 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic307-55.consmr.mail.gq1.yahoo.com (sonic307-55.consmr.mail.gq1.yahoo.com [98.137.64.31]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FZSfF514zz3rPs for ; Tue, 4 May 2021 18:14:13 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1620152051; bh=GmPNLOvMfHVGBSRe1VVRcsmnoYcseLJp8+XosYnOH8T=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=ERyzCF6jF5NRqhaW0mzjSPZPRPMlMjzhSE35UOGE/lH0ZLoSsGSUDFHJu0sIemyjBHMnvMthg9Fh1PQlF3eToHJWmWFrYyPHgpPJNUgQeneEOESL010JzDGbDo3dMo8kQ5dugqH/1x85ouePKRXOQqruOSxlunv6QLtKWg6zNkr5Iwo7uejCxINRfRX16e2nwC4sA2sUushtie3hdImkFIyWm7NYMZw2KOYhUKTAMZTwn22RjgGsij3e9w5GwMZve8NThv8wjfDZUomKIT2OvTRFU7JUEK1AZrCEg30yeu7vs8BOKZDm0alsnRqndSaZYPUt9hzYJWZJW60Z8EXzFA== X-YMail-OSG: lGMCIYsVM1kQIXqZ8pRxR_ldKm5mGJEVyl9huDai2XYxoM7laIhznsKPy79GBqT dB7TGhhZUHCv9L0068mGysFagKbMPs1F8o9eo8heU6P1WBm4pyEdPDTeMl7RsZUYfT_zLuiPDvfi .fcjOzz41yBUdP5cNizix2A68de5Dvg_DwPagXp9cKeEJ70T5jslmkz1fu9hkGH12x2QpLCNNeIF ZST9IY73TkTku4UweuJs.NSSpKGkG8Q6PiwNAQ1XHBW1tApcfhWG_EH_uHLfV1mSGA8sOgAzPwS2 DX6bkNcHTdwR59V7iIVAS2ws2LITTXqj6QKydIVqlLiQ3YjEseSwzlzt.aGj2bmCVatKKtL298pr 8xqceTp103qKXpLJ2ntjhnsq4POwIiGlNkexPXCAA1Ewrx8iEhE6My3.TFXlOxL5rcrzrP_oDPO3 KX5Yqz9UHS238RdfCdWBfdhiqYzE6cwtwELiWx3rWw0oUQI2zkKlnwqYuJlkaBHoZmLNaab7UHqm g_yNu27pbE9N46fEat68lRV4_pOdVLfzMVSjjIzaBftwHyj4roz.bUBNGQQrwhWjrVbHFTQPdsdw rQAwtmfQH3ipFIxOPXAUCiIjc3yTKioCYEXTbqu3IpdEB9MxqFk6IzWvQ.eI3ipFKP_0Ce0spCQt kbFeEVpbKtSW08TXqZ.l66a8FreRgI4i6WASRNXRfwR133nck5OEOxEVbLBqai1aKYADz8HsyPFo lAzv3RU_YkhN33siDVpSC2Sj8J0rDhGAV5MaY8WIwqPW7up.wiycE8VHuYWrxSjuKCzn49HhGSgl nHzyqUhAbK_SbzigFbn0r1pA4P4gp5LW3Q95JQisqN6uQAMWykJwZp83H4nRZ_2woQtGWqUTyIVv 0B2QJnoZ5oy1xoi8uh.LOJ9p5ml3X0rEcwQ1fLFgL1wpidu6mi5dsJt_uuex_uFOYUCld6KqnWzU 2vV0nErsn3MUSqretzhperNTfsVpIdPP3cEx.miIGvzAXKTaw.7UHSYK28aA1KUC81v_Av4rtd5I ivHOaze1lUk5ks_tT8GRawjZ3zeHGLzaiBjj824BNpz6uUTovmU742QON04.jZAi8DOiZNXrEVqa OTQr.o7sd5JaUl3MACQTePihGB_E8VMCfHd5BxxG9ZIRaVwUyycTMLGs_7GSq5rexiU6ZG1bu3_K d1GgYDjRMHk0bF01llWnL69qNYl2sh0rL0z3xWoJFATPd.45s0.QylewtB7veAHtCbSlnfI7Lq_M OB.Ce2s7EO14BruWgllvcW8nNjPkec6E_.gXRYlltsGHC8LuBPicPwW7xHy8KdeGkSzSLCTUsPof k.Tjg3t4GxVqfjsdTjAcdDuV_CqNs7SyfMKkL4uchFTvtqmJZVGkuYU1S8K9eeJUzjmaht0zDTSg NMa3BPfehOdiUHLkoMJNXgBvxRpRwIwzx2Q.YQMLLswHd74jfqF.qRnfQLCzjgll6zGqr3y2E1Iy 6zI_sYBWaw8uwu.EO_1dRsAHQg8nmfjOw.QBBTfFikNYuXbx4vodDjs2An.CWVAp5WGC2e3z1jLi kbZJX2X_rJHdeaNVbzzyiSuOBkNyeZAndNfKdj.czAvadti01lIDzNyRNxgSYairkVb8XFpVvcom _j2oPriDhfvHfcRt88saEGm5.okxYAu0XyBL3fHZtB9Y3zL4Hso_YcE379yW7IMDdLYY9Vr2yE5F wh0djQr1YupN4hP7sNmsga1acAr18DwifOl93Oqd.43dRnfLW9WJ9zJh9H9aX9CWfaXJoupQgLzm cEsC62Hk.U3UmqIhpDbdMDO3qE16DeaY3dfLAOPh_9wEJfKvFWuH5orqbbU6IZ0IdlcdVHM7tDU_ UFWYiWBKy64IjxGGugyLVaxM3tpgu_5hf.cnx98zfUNHp_0jpmpD8mD8qruFp4NVEIOd7Zpvfihu X4VGbNid4MDwosu6GX0EL6cBATnzbgZhHwZPNxWLUTlliZOeog8aX_jIwKK7O6fTwSocWRzdTvEg IF1kzPUlR87GxvFlQpVW4SwhExXx.QCD3kAXWU1k9W6odIihZkVZwqYNX9epqhb6uKoRTDjj1wmU P2xnoHz_0Kuh.NSfLhobbhrwMtQhffC1HhKPEfkx.QdVVFISISxGnlkTOoy6ss6LF7IfmmM3Ou4M 8dTU7ELoE5rkoyWFnh4H0IqdB5pgVGJAsZPFblVKF4zpAH_lwc9X9hVD3GM7PU31N9vzn3NuWGEt 9n.078_PgC30Clx9BY6xwFPQHe9hqdR3dLFYdQN0_L8vV9zSlP52PAD.TlXidSNElDEO1qFgna3j 19PiUFgDUTLcLrMbYYKh95iEUyritYhFm_DExomB1.dTAPLx7dBHMuFy1Qf7PalJpkmocT26oBcs eKngfwHJbzPRQ0pUQWI3xuhYmLsV87PT.d0Bmmm98FDBiYJ4X_OcFnXc.t76n6rwsyz3vnVuNtYE 6ucPsf1__nozt0hLx3rwY4m7QRQWvLV99tXB0sdsh56EozevhhIL_PrKP9hPmbnTe66CZ3in9sMp Rq4byqlLx8WBrzOdcErX1DAQQ6va3VpkLk7uWs2ozqRZw0eOKu0ms0q7SYrmWgybC04LChtgDqEX HuHTADmgpgeFMIMeTlOpZnMTl.p5xfRHfm51H3Nuyx1j_ETwyoCsGyoqFmRDwDoeVKN6vHo6T6IU IJo8VBTnHSzuhCb5ETfH0lHcGAxk.8S_j5VE0yz.8cVMkTdWvvfA- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic307.consmr.mail.gq1.yahoo.com with HTTP; Tue, 4 May 2021 18:14:11 +0000 Received: by kubenode544.mail-prod1.omega.bf1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID d3ba890bf511f0744d19eba011966c03; Tue, 04 May 2021 18:14:07 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: diffoscope's odd UnicodeDecodeError error message: reason found Message-Id: <27291038-3538-4A09-A09F-A2202A2D1965@yahoo.com> Date: Tue, 4 May 2021 11:14:02 -0700 Cc: freebsd-current , FreeBSD-STABLE Mailing List To: Ed Maste X-Mailer: Apple Mail (2.3654.60.0.2.21) References: <27291038-3538-4A09-A09F-A2202A2D1965.ref@yahoo.com> X-Rspamd-Queue-Id: 4FZSfF514zz3rPs X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.50 / 15.00]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RBL_DBL_DONT_QUERY_IPS(0.00)[98.137.64.31:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[98.137.64.31:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.64.31:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.64.31:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-stable] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 04 May 2021 18:14:14 -0000 I had reported in the reproducable build list messages: > # diffoscope /.zfs/snapshot/2021-04-*-01:40:48-0/bin/sh > [...] > $<3/>2021-05-04 08:49:21 W: diffoscope.main: Fuzzy-matching is = currently disabled as the "tlsh" module is unavailable. > UnicodeDecodeError: 'utf-8' codec can't decode byte 0xb7 in position = 18: invalid start byte Well, it turns out that the file name pattern was incorrect and only matched one file. By contrast: # diffoscope /.zfs/snapshot/2021-04-*/bin/sh $<3/>2021-05-04 11:05:25 W: diffoscope.main: Fuzzy-matching is currently = disabled as the "tlsh" module is unavailable. worked fine. And making the "one file" status obvious: # diffoscope c_tests/a.out $<3/>2021-05-04 11:11:45 W: diffoscope.main: Fuzzy-matching is currently = disabled as the "tlsh" module is unavailable. $<3/>Traceback (most recent call last): File "/usr/local/lib/python3.7/site-packages/diffoscope/main.py", line = 745, in main sys.exit(run_diffoscope(parsed_args)) File "/usr/local/lib/python3.7/site-packages/diffoscope/main.py", line = 677, in run_diffoscope difference =3D load_diff_from_path(path1) File = "/usr/local/lib/python3.7/site-packages/diffoscope/readers/__init__.py", = line 31, in load_diff_from_path return load_diff(codecs.getreader("utf-8")(fp), path) File = "/usr/local/lib/python3.7/site-packages/diffoscope/readers/__init__.py", = line 35, in load_diff return JSONReaderV1().load(fp, path) File = "/usr/local/lib/python3.7/site-packages/diffoscope/readers/json.py", = line 33, in load raw =3D json.load(fp) File "/usr/local/lib/python3.7/json/__init__.py", line 293, in load return loads(fp.read(), File "/usr/local/lib/python3.7/codecs.py", line 504, in read newchars, decodedbytes =3D self.decode(data, self.errors) UnicodeDecodeError: 'utf-8' codec can't decode byte 0xb7 in position 18: = invalid start byte Not exactly an obvious error message for the issue. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar)