From owner-freebsd-git@freebsd.org Thu Nov 12 16:12:51 2020 Return-Path: Delivered-To: freebsd-git@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 4E2472EDF15 for ; Thu, 12 Nov 2020 16:12:51 +0000 (UTC) (envelope-from david@catwhisker.org) Received: from mx.catwhisker.org (mx.catwhisker.org [107.204.234.170]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4CX68220vnz4Sj0 for ; Thu, 12 Nov 2020 16:12:49 +0000 (UTC) (envelope-from david@catwhisker.org) Received: from albert.catwhisker.org (localhost [127.0.0.1]) by albert.catwhisker.org (8.16.1/8.15.2) with ESMTP id 0ACGCmrJ051318; Thu, 12 Nov 2020 16:12:48 GMT (envelope-from david@albert.catwhisker.org) Received: (from david@localhost) by albert.catwhisker.org (8.16.1/8.16.1/Submit) id 0ACGCloK051317; Thu, 12 Nov 2020 08:12:47 -0800 (PST) (envelope-from david) Date: Thu, 12 Nov 2020 08:12:47 -0800 From: David Wolfskill To: =?iso-8859-1?B?RGF27fA=?= Steinn Geirsson Cc: freebsd-git@freebsd.org Subject: Re: 504 errors from cgit-beta Message-ID: <20201112161247.GK1450@albert.catwhisker.org> Reply-To: git@freebsd.org References: <20201112155659.GQ913@mail> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="K7eaAr91nZCNGuk7" Content-Disposition: inline In-Reply-To: <20201112155659.GQ913@mail> X-Rspamd-Queue-Id: 4CX68220vnz4Sj0 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of david@catwhisker.org designates 107.204.234.170 as permitted sender) smtp.mailfrom=david@catwhisker.org X-Spamd-Result: default: False [-3.40 / 15.00]; HAS_REPLYTO(0.00)[git@freebsd.org]; RBL_DBL_DONT_QUERY_IPS(0.00)[107.204.234.170:from]; FREEFALL_USER(0.00)[david]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:107.204.234.170]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; REPLYTO_DOM_NEQ_FROM_DOM(0.00)[]; ARC_NA(0.00)[]; DMARC_NA(0.00)[catwhisker.org]; SPAMHAUS_ZRD(0.00)[107.204.234.170:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_SPAM_SHORT(1.00)[1.000]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; RCVD_TLS_LAST(0.00)[]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:7018, ipnet:107.192.0.0/12, country:US]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-git] X-BeenThere: freebsd-git@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussion of git use in the FreeBSD project List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 12 Nov 2020 16:12:51 -0000 --K7eaAr91nZCNGuk7 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable I don't have a solution; indeed: I am not seeing the issue, but thought that comparing notes might have some value.... On Thu, Nov 12, 2020 at 03:56:59PM +0000, Dav=ED=F0 Steinn Geirsson wrote: > ... > We are getting frequent 504 errors when running `git fetch` against an > existing checkout of `ports.git` from https://cgit-beta.freebsd.org/ports= =2Egit: >=20 > ``` > $ git fetch cgit-beta > error: RPC failed; HTTP 504 curl 22 The requested URL returned error: 504 > fatal: the remote end hung up unexpectedly > ``` >=20 > We have a scheduled CI pipeline that runs every 4 hours and pulls in new > changes from https://cgit-beta.freebsd.org/ports.git and it seems to > fail about half of the time. Just looking at the last 24 hours: > Thu, 12 Nov 2020 12:29:26 +0000 - failed > Thu, 12 Nov 2020 08:28:49 +0000 - success > Thu, 12 Nov 2020 04:28:44 +0000 - failed > Thu, 12 Nov 2020 00:28:25 +0000 - success > Wed, 11 Nov 2020 20:27:53 +0000 - failed > Wed, 11 Nov 2020 16:29:27 +0000 - success > Wed, 11 Nov 2020 12:29:09 +0000 - failed I only update nightly (in two passes), hitting src, ports, and doc. FWIW, the local repos are "mirror clones" (vs. clones that have/are working directories); I doubt that's significant, but I could easily be quite wrong about that. Anyway, here are the latest status lines from my log: g1-48(12.2-S)[6] grep '^git repo sync' /var/log/git.log | tail -12 git repo sync started at Wed Nov 11 11:15:00 UTC 2020 git repo sync for src ended at Wed Nov 11 11:15:02 UTC 2020 exit status 0 git repo sync for ports ended at Wed Nov 11 11:15:02 UTC 2020 exit status 0 git repo sync for doc ended at Wed Nov 11 11:15:02 UTC 2020 exit status 0 git repo sync started at Thu Nov 12 10:15:00 UTC 2020 git repo sync for src ended at Thu Nov 12 10:16:03 UTC 2020 exit status 0 git repo sync for ports ended at Thu Nov 12 10:17:12 UTC 2020 exit status 0 git repo sync for doc ended at Thu Nov 12 10:17:16 UTC 2020 exit status 0 git repo sync started at Thu Nov 12 11:15:00 UTC 2020 git repo sync for src ended at Thu Nov 12 11:15:02 UTC 2020 exit status 0 git repo sync for ports ended at Thu Nov 12 11:15:02 UTC 2020 exit status 0 git repo sync for doc ended at Thu Nov 12 11:15:02 UTC 2020 exit status 0 > I saw the recent discussion on the change in GC settings > (https://lists.freebsd.org/pipermail/freebsd-git/2020-October/000466.html) > and tried to reset our checkout (deleted the ports project in our gitlab, > created a new clone from cgit-beta and pushed into a new, clean project), > but it did not have any effect. I have not changed mine since 16 Oct 2020; it's documented in http://www.catwhisker.org/~david/FreeBSD/repo-sync.html (in case that's useful or interesting). (That said, I'm not actually trying to use the got repo for anything but to verify that syncing works; I still use svn for my real FreeBSD src.ports/doc syncing.) > Any ideas what could be causing this? >=20 > PS: Has any date been decided on when the switchover will happen and git > becomes the canonical source of truth? I am excited to not have to touch > subversion again :) >=20 > Thanks, > -Dav=ED=F0 Peace, david --=20 David H. Wolfskill david@catwhisker.org Donald Trump is exhibiting the maturity of a 2-year-old in a meltdown. See http://www.catwhisker.org/~david/publickey.gpg for my public key. --K7eaAr91nZCNGuk7 Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQGTBAEBCgB9FiEE4owz2QxMJyaxAefyQLJg+bY2PckFAl+tXv9fFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldEUy OEMzM0Q5MEM0QzI3MjZCMTAxRTdGMjQwQjI2MEY5QjYzNjNEQzkACgkQQLJg+bY2 PcnGEggAsWcawOnZUUOxdFz7p3aW5SxM8VGtpkELjCY+dzV+Mc9GqvTuO3TPUIEM W/1ClGfypDISoqvKaO8INKuyMiXjlwI2z/cOsxjAsp/UxVkh9E/S19n3grWSJkGm 1jdJplAF9QGgX6EG7aJdy3FXyFlQqsfjRCJqmEjo/heHpKhRrkzLDkMlmW53pCf8 fljbwcC9PgkeoPluVHknu0KY3ZTO4vUUPleAGfNmH4fQ2LuWsjC6+ec2xKPiZ6zx iB8h43G3vF4gUPLv0glKdRYgzIVc8MIjIyB2SXaowKGUSwFG+X5CU/TMNav39xIM SgPj4aO7LCsKceUejflJteXMHWPppw== =s90/ -----END PGP SIGNATURE----- --K7eaAr91nZCNGuk7--