From owner-freebsd-ports@freebsd.org Fri Jun 17 13:18:31 2016 Return-Path: Delivered-To: freebsd-ports@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1C68BA449B1 for ; Fri, 17 Jun 2016 13:18:31 +0000 (UTC) (envelope-from carpeddiem@gmail.com) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id F0F4919FB for ; Fri, 17 Jun 2016 13:18:30 +0000 (UTC) (envelope-from carpeddiem@gmail.com) Received: by mailman.ysv.freebsd.org (Postfix) id F04A5A449B0; Fri, 17 Jun 2016 13:18:30 +0000 (UTC) Delivered-To: ports@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EFEFAA449AF for ; Fri, 17 Jun 2016 13:18:30 +0000 (UTC) (envelope-from carpeddiem@gmail.com) Received: from mail-it0-x231.google.com (mail-it0-x231.google.com [IPv6:2607:f8b0:4001:c0b::231]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id BBC1D19FA; Fri, 17 Jun 2016 13:18:30 +0000 (UTC) (envelope-from carpeddiem@gmail.com) Received: by mail-it0-x231.google.com with SMTP id h190so68322915ith.1; Fri, 17 Jun 2016 06:18:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:from:date:message-id :subject:to:cc; bh=rWulN5KpfCMtCyoqcZqzg+VBxuHnCKeHcQ64YBt1TMk=; b=XVnFC7R+I0uQQWOVCqHO8cl/b3iN/vLb1FnYSAQyas79r2xN7JJWVzKA/8/cRMG3J0 7PvYYuCMlorYRMSvGzMxAY5mdeavgNEagcfaCP7FMrtkuvfckqBG1eRTmiZMFGsBQ1Ir O6S5AuqQY2RNdWIxnFtF3EZ4mCvJuu39VZN2X9EA3s+0WHW/JI6p2Di39gdY0xflKIR8 0TUeMOO7AT/IXhkt/+IkuXXTFkpL57aTuJRPo1swGb2jmLx3SZMuzfBKONOEDuxamHCT P3jmu7ES5YQ9gzoG4aXNSaSgDj4mFp3P2JhQN9ztMIxokV0HoUsL5FJxP8uw/zULrhg5 H7cQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:sender:in-reply-to:references:from :date:message-id:subject:to:cc; bh=rWulN5KpfCMtCyoqcZqzg+VBxuHnCKeHcQ64YBt1TMk=; b=WxbpdagKgQuR+Wc/e8jqOfQ1foiaRLPYbkDt6Y3F/byd3SRVfiy74aLDDMTwEYif5w 7x/QzQEIAd7KUgpmjKEFqVfJ7GYhuT+D6FhSmzDQvtj08o2BV5LzrL0QWI5BQrWoekuQ wi9TrmVm80DqiOMwgkA0P+gLMbnV/VPBs898CtdUKdRGWzmnNffcbu9FIp7b6yPN9zWz /W2PRkJb2JskPv8lCZEtQdY8AJeKw/+c4A8g9F5Cxh/fauc2hQ1sRlosv+Q4MK1k4Z6o a4mVzglG2P6hxjm2GRB5OFQaDNyjz/tUGNWTUQ/QNd6WUZn5itiN5+GyjEQv/+SrM4HK cegQ== X-Gm-Message-State: ALyK8tK4geHbYvgwJuMbiRnSvUzoOP9DoPbuZwscnlmqjZ9AL4selVR2hmfu6fiqb5We8VjE61g2NDEuILkjwA== X-Received: by 10.36.53.204 with SMTP id k195mr3199342ita.59.1466169510184; Fri, 17 Jun 2016 06:18:30 -0700 (PDT) MIME-Version: 1.0 Sender: carpeddiem@gmail.com Received: by 10.107.27.197 with HTTP; Fri, 17 Jun 2016 06:18:10 -0700 (PDT) In-Reply-To: References: From: Ed Maste Date: Fri, 17 Jun 2016 09:18:10 -0400 X-Google-Sender-Auth: Cpx90GPjaMlFVionQnM6g9haeGU Message-ID: Subject: Re: Some reproducible builds notes To: Maxim Sobolev Cc: ports@freebsd.org Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-ports@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Porting software to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 17 Jun 2016 13:18:31 -0000 On 17 June 2016 at 04:47, Maxim Sobolev wrote: > Hi Ed, I have not got time to look at diffoscope myself yet, but it's > definitely in my short-term TODO list. Quick question for you though. Would > it work given two tar.bz2 packages or does it need two directories? It does in fact process two packages, and will recursively unpack what's inside. It can also take two directories. Note that it has specific support for .deb and .rpm packages, but doesn't know about our pkg format right now. It works fine, but just compares the +MANIFEST etc. as text files rather than doing a slightly more "human-friendly" presentation. To generate the diffoscope results I posted I basically did: for pkg in $(cat nonrepro.txt); do timeout $timeout diffoscope \ --jquery https://code.jquery.com/jquery-2.2.4.min.js \ --html-dir /mumble/diffoscope/${pkg%.txz} \ /mumble/build1/$pkg /mumble/build2/$pkg done > We > have code to do just that (i.e. inspect mtree and extract files that differ, > so if you don't, we can probably contribute that. Yeah, I think something like this would be a good addition when pkg-specific support gets added, although perhaps under some flag -- if we had a case where the content was changed from the hash in the pkg metadata we'd still like to compare and report that. At least for the way I've used it my use case > P.S. For anyone interested in Ed's work, here is his BSDCan talk here live: > https://youtu.be/z7pDnBO5wSM?t=5h37m6s Thank you for recording it!