From owner-freebsd-ports@freebsd.org Tue Jan 5 11:49:55 2021 Return-Path: Delivered-To: freebsd-ports@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 82E464E26CF for ; Tue, 5 Jan 2021 11:49:55 +0000 (UTC) (envelope-from mat@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4D99ll3DnFz3s5M; Tue, 5 Jan 2021 11:49:55 +0000 (UTC) (envelope-from mat@freebsd.org) Received: from mail.j.mat.cc (owncloud.cube.mat.cc [IPv6:2a01:678:4:1::228]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.mat.cc", Issuer "R3" (verified OK)) (Authenticated sender: mat/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 4774C359D3; Tue, 5 Jan 2021 11:49:55 +0000 (UTC) (envelope-from mat@freebsd.org) Received: from aching.in.mat.cc (unknown [IPv6:2a01:678:ab:50:eb57:c2b:823f:1bc5]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) (Authenticated sender: mat@mat.cc) by mail.j.mat.cc (Postfix) with ESMTPSA id EE2DC942D87; Tue, 5 Jan 2021 11:49:52 +0000 (UTC) Date: Tue, 5 Jan 2021 12:49:50 +0100 From: Mathieu Arnold To: Chris Cc: freebsd-ports Subject: Re: GitHub: size of remote file is not known Message-ID: <20210105114854.zl66zzuwooghxaoz@aching.in.mat.cc> References: MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="zefa6okrjtm7kasy" Content-Disposition: inline In-Reply-To: X-BeenThere: freebsd-ports@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Porting software to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 Jan 2021 11:49:55 -0000 --zefa6okrjtm7kasy Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Jan 04, 2021 at 08:04:32PM -0800, Chris wrote: > I don't use Github. So I'm not familiar with their service(s). > But ports using source fetched from them always return: > size of remote file is not known > Is it that their servers simply refuse to return size/content-length > or is this something else? > I can see where this might turn into a problem for those attempting > to build ports on a system with limited resources -- especially > during a meta-port build, and even more so for newcomers. >=20 > Is anyone familiar with why this is so? I'd like to change this. USE_GITHUB is using a GitHub (and a git) feature to have git-archive(1) files generated and served on the fly. So, the server has no idea how small or large the file will be, as it does not exist yet, so it cannot report the size to the http client. Once one is generated it gets cached for a while, so if the file has been requested not too far back, the server will have it cached and will know the size, but it only happens for files that are requested frequently. --=20 Mathieu Arnold --zefa6okrjtm7kasy Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQKTBAABCgB9FiEEVhwchfRfuV0unqO5KesJApEdfgIFAl/0UlpfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldDU2 MUMxQzg1RjQ1RkI5NUQyRTlFQTNCOTI5RUIwOTAyOTExRDdFMDIACgkQKesJApEd fgIuXRAAhHHKYBTt5LzXSZ8q6RnpmCx4BPEXiYUZux0nfnGAXu7ksGGoOh6ed5NP L7SrrrHod6xsY877bFsyCrATBvs+B/AeyKjT0RmInupnkamxGvg2CFpYoxSijCLO bhhPIhrS4uckotEnpMsSqU7yQ360jzkuXh9jZqrqchhltTwSXKNNEntpCEFBjT9k UuXKvYo+Gyr1jfXU8Z6FiVcJUmymyVZjg5fFt4kuWC63XJSVnNZwkfiUYZcJA7px 9NBAL2+XQJfxud/BfU+0CDd8L590G6xdFQhnmhqmjOjO1wKikEWbJJzxQsfYdoKh 3ZD1/f7P3z6hlwQ6MZKbF39Qjv/X901fP5OXMFtJr/v00onNeemqPeqmkgv7s4OC yWS7+CH17dcnWMFvKI4aybvRvc0Q8qeomP3XUf2RQwVI2IqYYDiTLXhlA020JtIq 4ZSqn6rMzoWyjdZ8xaERXsmqNJfeM24k1+/4BgjFEkLfHVc7U7CyxbQKlZfSzd8H ScfsfDmuo04vWSrBxeOwrN1RQ1mAwYzYX86+e+N5RBk4tW8pP4p30kQBTyBXrCrR AHJqhaqa+5m5wh5qXrvuU1z5mBZTmQnDpmyfZ89d0L9BxSTGnmmF3D1EDoRjsdGh uUtMNU8j14rs83K+cxYNWGY288dfwI6Evb0Ayt8rdlcv/OfEu4o= =vCfT -----END PGP SIGNATURE----- --zefa6okrjtm7kasy--