From owner-freebsd-git@freebsd.org Thu Jul 9 16:58:27 2020 Return-Path: Delivered-To: freebsd-git@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9625E36F76C for ; Thu, 9 Jul 2020 16:58:27 +0000 (UTC) (envelope-from uqs@freebsd.org) Received: from acme.spoerlein.net (acme.spoerlein.net [IPv6:2a05:fc87:1:5::15]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "www.spoerlein.net", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4B2j6p7285z4HHh; Thu, 9 Jul 2020 16:58:26 +0000 (UTC) (envelope-from uqs@freebsd.org) Received: from localhost (acme.spoerlein.net [IPv6:2a05:fc87:1:5:0:0:0:15]) by acme.spoerlein.net (8.15.2/8.15.2) with ESMTPS id 069GwOw0081131 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Thu, 9 Jul 2020 18:58:24 +0200 (CEST) (envelope-from uqs@freebsd.org) Date: Thu, 9 Jul 2020 18:58:24 +0200 From: Ulrich =?utf-8?B?U3DDtnJsZWlu?= To: Ryan Steinmetz Cc: freebsd-git@freebsd.org, clusteradm@freebsd.org Subject: Re: svnsync discrepancies again Message-ID: <20200709165824.GE96323@acme.spoerlein.net> References: <20200709142053.GA60652@exodus.zi0r.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <20200709142053.GA60652@exodus.zi0r.com> User-Agent: Mutt/1.12.2 (2019-09-21) X-Rspamd-Queue-Id: 4B2j6p7285z4HHh X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; local_wl_from(0.00)[freebsd.org]; ASN(0.00)[asn:39540, ipnet:2a05:fc87::/32, country:CH] X-BeenThere: freebsd-git@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussion of git use in the FreeBSD project List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 Jul 2020 16:58:27 -0000 On Thu, 2020-07-09 at 10:20:53 -0400, Ryan Steinmetz wrote: > > On (07/09/20 11:26), Ulrich Spörlein wrote: > >Hi folks > > > >comparing my own output with what cgit produces has surfaced another diff > >in the ports SVN metadata, specifically a 2s delta on r530303 > > > >What I have in my SVN email (!) is this: > >Author: sunpoet > >Date: Thu Apr 2 12:03:10 2020 > >New Revision: 530303 > >URL: https://svnweb.freebsd.org/changeset/ports/530303 > > > >Clicking that link, I get to this metadata instead: > >Author: sunpoet > >Date: Thu Apr 2 12:03:12 2020 UTC (3 months ago) > > > >My local svnsync copy has: > >% svnlook info -r 530303 $PWD > >sunpoet > >2020-04-02 14:03:10 +0200 (Thu, 02 Apr 2020) > > > >The copy on cgit has: > >% svn log -vc530303 file:///$PWD > >------------------------------------------------------------------------ > >r530303 | sunpoet | 2020-04-02 12:03:12 +0000 (Thu, 02 Apr 2020) | 4 lines > > > >From cgit (within the cluster): > >% svn log -c530303 https://svn.freebsd.org/ports > >------------------------------------------------------------------------ > >r530303 | sunpoet | 2020-04-02 12:03:12 +0000 (Thu, 02 Apr 2020) | 4 lines > > > >From a random machine (outside the cluster): > >% svn log -c530303 https://svn.freebsd.org/ports > >------------------------------------------------------------------------ > >r530303 | sunpoet | 2020-04-02 14:03:10 +0200 (Thu, 02 Apr 2020) | 4 lines > > > >Why do we have garbage on svnweb.freebsd.org and why does a machine in the > >cluster get pointed to that host? > > Not sure I'd call this "garbage" nor would I immediately assume that > we've decided to "point cluster machines at garbage" and "give the rest > of the world the good stuff." > > That being said, this is likely related to how svnsync works. It's a > two step operation where commits are replayed first, followed by the > metadata. Since this isn't atomic, there's a brief window that can > sometimes surface between these two operations. > > svnweb has its own local copy of the repos that it looks at. So do the > multiple public, geo-load balanced mirrors (svn.freebsd.org). Yes, sadly I'm intimately familiar with the shortcomings of svnsync in this regard. What I'm wondering is: - who will fix this and - where is the actual canonical source of our SVN and - how can I get access to it from both a machine inside the cluster as well as outside? That would be helpful to know. Cheers Uli