Skip site navigation (1)Skip section navigation (2)
Date:      Tue, 4 May 2021 08:51:50 -0700
From:      Mark Millard <marklmi@yahoo.com>
To:        Ed Maste <emaste@freebsd.org>
Cc:        FreeBSD-STABLE Mailing List <freebsd-stable@freebsd.org>, freebsd-current <freebsd-current@freebsd.org>
Subject:   Re: FYI: WITH_REPRODUCIBLE_BUILD= problem for some files?
Message-ID:  <27B5086A-7C98-4AE6-885A-CC7C7BD2F64B@yahoo.com>
In-Reply-To: <CAPyFy2B0va3FVa0-HKp3MJaJG=h6yPb%2BNMnjCy4kxBdUF=DybQ@mail.gmail.com>
References:  <35482701-95A3-48B2-9A8E-B7E0092119B1.ref@yahoo.com> <35482701-95A3-48B2-9A8E-B7E0092119B1@yahoo.com> <CAPyFy2DQRn1CeiF=yaF6NgpLZ1zU8psbV0xiz-DWiSUy=DM8NA@mail.gmail.com> <43F20589-A7C7-42FF-9020-09CEE037D1CD@yahoo.com> <91F820A1-8940-4246-A20A-E62685F50079@yahoo.com> <F5D8E009-E6E1-42DA-856C-A6D91DA74A40@yahoo.com> <CAPyFy2B0va3FVa0-HKp3MJaJG=h6yPb%2BNMnjCy4kxBdUF=DybQ@mail.gmail.com>

next in thread | previous in thread | raw e-mail | index | archive | help


On 2021-May-4, at 06:01, Ed Maste <emaste at freebsd.org> wrote:

> On Mon, 3 May 2021 at 22:26, Mark Millard <marklmi@yahoo.com> wrote:
>>=20
>> But I'll note that I've built and stalled py37-diffoscope
>> (new to me). A basic quick test showed that it reports:
>>=20
>> W: diffoscope.main: Fuzzy-matching is currently disabled as the =
"tlsh" module is unavailable.
>=20
> I just looked up tlsh - its "A Locality Sensitive Hash"; I presume
> diffoscope uses it to infer file renames. I believe the warning
> emitted here should have no impact on the output we're looking for.

Okay.

> As far as the utf-8 issues go, diffoscope requires a utf-8 locale and
> I suspect that is the issue. If you don't have LANG set already, try
> setting LANG=3DC.UTF-8 in your environment.

That is not the issue for the UnicodeDecodeError:

# echo $LANG
C.UTF-8

# diffoscope /.zfs/snapshot/2021-04-*-01:40:48-0/bin/sh
$<3/>2021-05-04 08:49:21 W: diffoscope.main: Fuzzy-matching is currently =
disabled as the "tlsh" module is unavailable.
$<3/>Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/diffoscope/main.py", line =
745, in main
    sys.exit(run_diffoscope(parsed_args))
  File "/usr/local/lib/python3.7/site-packages/diffoscope/main.py", line =
677, in run_diffoscope
    difference =3D load_diff_from_path(path1)
  File =
"/usr/local/lib/python3.7/site-packages/diffoscope/readers/__init__.py", =
line 31, in load_diff_from_path
    return load_diff(codecs.getreader("utf-8")(fp), path)
  File =
"/usr/local/lib/python3.7/site-packages/diffoscope/readers/__init__.py", =
line 35, in load_diff
    return JSONReaderV1().load(fp, path)
  File =
"/usr/local/lib/python3.7/site-packages/diffoscope/readers/json.py", =
line 33, in load
    raw =3D json.load(fp)
  File "/usr/local/lib/python3.7/json/__init__.py", line 293, in load
    return loads(fp.read(),
  File "/usr/local/lib/python3.7/codecs.py", line 504, in read
    newchars, decodedbytes =3D self.decode(data, self.errors)
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xb7 in position 18: =
invalid start byte

=3D=3D=3D
Mark Millard
marklmi at yahoo.com
( dsl-only.net went
away in early 2018-Mar)




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?27B5086A-7C98-4AE6-885A-CC7C7BD2F64B>