Date: Sat, 22 Nov 2014 17:03:30 -0500 From: "Mikhail T." <mi+thun@aldan.algebra.com> To: "freebsd-ports@FreeBSD.ORG" <freebsd-ports@FreeBSD.ORG> Subject: Downloading DISTFILES from multiple locations in parallel (torrent or ...)? Message-ID: <54710832.8070709@aldan.algebra.com>
next in thread | raw e-mail | index | archive | help
Has anybody given the idea any thought? Though in addition to the
"upstream" MASTER_SITES, there is a (fast) collection of FreeBSD
mirrors, the downloads currently aren't happening in parallel -- they
are serial...
One solution would be for the downloader (fetch(1) or whatever) to try
to open multiple connections -- to several possible sites -- and
download different ranges of the same tarball from different locations
in parallel thus affording the total download rate of the actually
fastest mirror (almost), rather than the one first on the list.
The alternative would use one of the existing torrent-clients, but we'd
need to think of how to publish the torrent-information with the ports.
It would seem, this second plan can go further even if the first would
require fewer changes to the existing infrastructure.
Any thoughts?
-mi
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?54710832.8070709>