From owner-freebsd-current@freebsd.org Tue May 4 16:56:49 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id DB66F5F939A; Tue, 4 May 2021 16:56:49 +0000 (UTC) (envelope-from carpeddiem@gmail.com) Received: from mail-io1-f52.google.com (mail-io1-f52.google.com [209.85.166.52]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FZQww5bW9z3m0X; Tue, 4 May 2021 16:56:48 +0000 (UTC) (envelope-from carpeddiem@gmail.com) Received: by mail-io1-f52.google.com with SMTP id k25so7770079iob.6; Tue, 04 May 2021 09:56:48 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=yvYZEOLtbQSpF61Px6IhxYagIqcItrcyki0blF33n0w=; b=OdWgi0ve/dosh3c/oeCdA2ZGY10UiW8ItCfNbv7AgqimuBZwgXy7VCVRDJ6l1hRvVB ZLXODyXvagNyyWfcpZbbU2aelU0F6EN2zDw+vEdyj1n79JGXgwznKkaTl7krl8MDsa1w +/EH1aKbyfZKklGE1uIOvI0QFxdX9X0EZqpJ8FYbW57c+N3BjY5WoenwlCmB4PMhf67H 8dMrSUq7Vgwnku2qUpqD1VEueUtx3dSQx+PbGe0u4R0nFz6r6Uh0tlpBYo44dndewGYn /wTDZUhzbVUpG2MSWL/XZcuE88GuXUz6DjkLV7tWv9Iw/QFMj6/D/Lf9EVPIX4bhOF5T Svqg== X-Gm-Message-State: AOAM532b0JpjyEBK6bc7F1V636LFzkOoZy4PFmzWEKZZkoCvzkhBplcF lcEmUiekR9gxoavd2rr6oSYeuI/v6pjq/P1WVLM= X-Google-Smtp-Source: ABdhPJwK2xNBK4OLyYlqmTjSrpckuOd0vteVSsfVvPqY8ujaZmswTH6O4tgR/5xEh6yiQqr9L7nnU0veY61zvMUnIv4= X-Received: by 2002:a05:6638:37a6:: with SMTP id w38mr20980791jal.106.1620147407450; Tue, 04 May 2021 09:56:47 -0700 (PDT) MIME-Version: 1.0 References: <35482701-95A3-48B2-9A8E-B7E0092119B1.ref@yahoo.com> <35482701-95A3-48B2-9A8E-B7E0092119B1@yahoo.com> <43F20589-A7C7-42FF-9020-09CEE037D1CD@yahoo.com> <91F820A1-8940-4246-A20A-E62685F50079@yahoo.com> <27B5086A-7C98-4AE6-885A-CC7C7BD2F64B@yahoo.com> In-Reply-To: <27B5086A-7C98-4AE6-885A-CC7C7BD2F64B@yahoo.com> From: Ed Maste Date: Tue, 4 May 2021 12:55:52 -0400 Message-ID: Subject: Re: FYI: WITH_REPRODUCIBLE_BUILD= problem for some files? To: Mark Millard Cc: FreeBSD-STABLE Mailing List , freebsd-current Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4FZQww5bW9z3m0X X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of carpeddiem@gmail.com designates 209.85.166.52 as permitted sender) smtp.mailfrom=carpeddiem@gmail.com X-Spamd-Result: default: False [-1.99 / 15.00]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17:c]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FREEMAIL_TO(0.00)[yahoo.com]; FORGED_SENDER(0.30)[emaste@freebsd.org,carpeddiem@gmail.com]; R_DKIM_NA(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[209.85.166.52:from]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[emaste@freebsd.org,carpeddiem@gmail.com]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.99)[-0.994]; FREEFALL_USER(0.00)[carpeddiem]; SUBJECT_ENDS_QUESTION(1.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; MIME_GOOD(-0.10)[text/plain]; MIME_TRACE(0.00)[0:+]; DMARC_NA(0.00)[freebsd.org]; SPAMHAUS_ZRD(0.00)[209.85.166.52:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCVD_IN_DNSWL_NONE(0.00)[209.85.166.52:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.166.52:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-stable,freebsd-current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 04 May 2021 16:56:49 -0000 On Tue, 4 May 2021 at 11:52, Mark Millard wrote: > > > As far as the utf-8 issues go, diffoscope requires a utf-8 locale and > > I suspect that is the issue. If you don't have LANG set already, try > > setting LANG=C.UTF-8 in your environment. > > That is not the issue for the UnicodeDecodeError: > > # echo $LANG > C.UTF-8 > > # diffoscope /.zfs/snapshot/2021-04-*-01:40:48-0/bin/sh > [...] > $<3/>2021-05-04 08:49:21 W: diffoscope.main: Fuzzy-matching is currently disabled as the "tlsh" module is unavailable. > UnicodeDecodeError: 'utf-8' codec can't decode byte 0xb7 in position 18: invalid start byte Hmm, interesting - if you don't mind sharing I'd be interested in a copy of /.zfs/snapshot/2021-04-*-01:40:48-0/bin/sh, in order to track down what appears to be a diffoscope issue. To investigate the non-reproducibility though we can just manually run through the same sort of process that Diffoscope uses. I would suggest cmp -x to find the offsets of the difference(s), then use readelf -S to determine which section(s) have differences.