From nobody Mon Dec 9 16:35:01 2024 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y6SC60ydZz5gVxp for ; Mon, 09 Dec 2024 16:35:14 +0000 (UTC) (envelope-from carpeddiem@gmail.com) Received: from mail-il1-f173.google.com (mail-il1-f173.google.com [209.85.166.173]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y6SC54Qsyz4Xjl for ; Mon, 9 Dec 2024 16:35:13 +0000 (UTC) (envelope-from carpeddiem@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-il1-f173.google.com with SMTP id e9e14a558f8ab-3a8180205f3so8935195ab.0 for ; Mon, 09 Dec 2024 08:35:13 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1733762112; x=1734366912; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=P0h3wrixw3m3Vp2nSvbbMPiXmk9C6+br6tdYT354Vrc=; b=XBVMGfvAmqT0TRUdW/fluTrmM5132GbItNg+8oUmQi+6HQDAhg0pwu0+AGl/XI16BI iGaLLS5BDAa7bj6FCumgQJ+AuUljXa0aZ1cu/0TtbPZqDSRBSsOhU4wcDVlX2wCd2/3k 0Zt3W6bI0R0ifrc0uR5BZ5AGYEwvPuQi+nDqFtvtt1f+0fNIVXKBc/jaDVwgMNVv/VxK 9rtGxbzQIKdDyA8W5OhbVKnVDqJ1RtrlwF0MSEor7kr4gqgkMwy7RrFxeLVLmcnEMfRP QbYDQfYqP5BjJ16fVoBicvU+1KMhNHPLllCdjn2Mkzzr/9eKBLbwfAdFiTjbRPgdNQVn +/Lw== X-Gm-Message-State: AOJu0YwcdJxQwioRjjG6nXWTTjd0ETmK7hYL06AfKeHLIkOIOlUbi92m gcB1fNJcEQqHO6+JZJphRiWazr1HjA/9KK5kVV6cNJSWuSkr6gCO+tlybcGKXOJymg88czIWJiP Fz/OdXvr28BN6eS9ViH/Gy24Jkyz7BIyx X-Gm-Gg: ASbGncuKj+e5r3E15QPlRGmbmItQOlhBUrpjqLXg+vzfbmqovRUXTTIWBThBT5AN611 L/fZjy5NlrTJuP9Pju0haMls4E8SFsmpVJhj4aIhsGjV2sRxAKDZlIqGP4DKtbV9DgQ== X-Google-Smtp-Source: AGHT+IFAgEtiNOKDUrPAugGg/NRdotsTJspCKKAFAQZrG2hrkdidYeEdXCUdD+EtX2SeeFvKNmm74Mh/hhtW8PXj4tM= X-Received: by 2002:a05:6e02:1a48:b0:3a9:cb4a:842a with SMTP id e9e14a558f8ab-3a9dd392f87mr219475ab.5.1733762112531; Mon, 09 Dec 2024 08:35:12 -0800 (PST) List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@FreeBSD.org MIME-Version: 1.0 References: <3388409d-479d-4ef0-a8e4-38144a96d9c5@app.fastmail.com> In-Reply-To: <3388409d-479d-4ef0-a8e4-38144a96d9c5@app.fastmail.com> From: Ed Maste Date: Mon, 9 Dec 2024 11:35:01 -0500 Message-ID: Subject: Re: Reproducible builds: are release tarballs a part of it? To: Pat Maddox Cc: freebsd-hackers@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US] X-Rspamd-Queue-Id: 4Y6SC54Qsyz4Xjl X-Spamd-Bar: ---- On Mon, 9 Dec 2024 at 06:08, Pat Maddox wrote: > > I am trying to reproduce https://download.freebsd.org/releases/amd64/14.2-RELEASE/MANIFEST from source. Is that possible? > > As part of this effort, I am having trouble reproducing base.txz across any two builds at all - much less the published one. Thanks for submitting PR283214. It looks like this indeed is due to directory contents being returned in an arbitrary order, and bsdtar's lack of an option to sort them. GNU sort supports --sort=name to address this issue. There's a prototype patch from 2015 to sort directory contents (without an option): https://github.com/libarchive/libarchive/issues/602 As Colin pointed out in PR283214 we can (and should) address this in the short term by using find and sort, but I still would like to see this supported directly in bsdtar.