Date: Tue, 24 Apr 2007 20:14:52 GMT From: Marcin Simonides<marcin@studio4plus.com> To: freebsd-gnats-submit@FreeBSD.org Subject: ports/112092: PlanetMirror sites are unsuitable for automatic downloads Message-ID: <200704242014.l3OKEqoK029785@www.freebsd.org> Resent-Message-ID: <200704242020.l3OKK3im052159@freefall.freebsd.org>
next in thread | raw e-mail | index | archive | help
>Number: 112092 >Category: ports >Synopsis: PlanetMirror sites are unsuitable for automatic downloads >Confidential: no >Severity: non-critical >Priority: low >Responsible: freebsd-ports-bugs >State: open >Quarter: >Keywords: >Date-Required: >Class: sw-bug >Submitter-Id: current-users >Arrival-Date: Tue Apr 24 20:20:03 GMT 2007 >Closed-Date: >Last-Modified: >Originator: Marcin Simonides >Release: 6.2-STABLE >Organization: >Environment: >Description: PlanetMirror's sites are used as sites for many port distfiles. When direct links to files are being accessed by HTTP, servers display an HTML page with a "This download will automatically commence shortly..." message and then redirect to the file. Eg.: http://public.planetmirror.com/pub/gnome/sources/bakery/2.4/bakery-2.4.1.tar.bz2 displays page and starts download of: http://downloads.planetmirror.com/pub/gnome/sources/bakery/2.4/bakery-2.4.1.tar.bz2 fetch program used by ports system doesn't follow such redirects (nor should it, afaik), the HTML file is being downloaded and fails checksum tests obviously. This cannot be worked around by downloading from http://downloads.... urls directly because they redirect user agent to http://public.planetmirror.... url (and display the information page), unless that url has been visited a few moments before. >How-To-Repeat: The problem may be repeated by issuing a command: fetch http://public.planetmirror.com/pub/gnome/sources/bakery/2.4/bakery-2.4.1.tar.bz2 The resulting file is an HTML page instead of distfile. >Fix: I attach a patch that removes all http://*.planetmirror.com sites from Mk/bsd.sites.mk file. This is the only solution that I can come up with (and there hasn't been any other proposed on ports@ mailing list). Patch attached with submission follows: --- bsd.sites.mk.bak Tue Apr 24 19:27:54 2007 +++ bsd.sites.mk Tue Apr 24 21:54:54 2007 @@ -198,7 +198,6 @@ http://www.dawnspill.hu/mirror/eclipse/downloads/drops/%SUBDIR%/ \ http://mirrors.ibiblio.org/pub/mirrors/eclipse/eclipse/downloads/drops/%SUBDIR%/ \ http://www.eclipse.ps.pl/downloads/drops/%SUBDIR%/ \ - http://eclipse.planetmirror.com/downloads/drops/%SUBDIR%/ \ ${MASTER_SITE_RINGSERVER:S,%SUBDIR%,misc/eclipse/downloads/drops/&,} \ ftp://sunsite.cnlab-switch.ch/mirror/eclipse/eclipse/downloads/drops/%SUBDIR%/ \ ftp://eclipse.cis.sinica.edu.tw/eclipse.org/%SUBDIR%/ \ @@ -209,7 +208,6 @@ MASTER_SITE_EXIM+= \ ftp://ftp.csx.cam.ac.uk/pub/software/email/exim/%SUBDIR%/ \ ftp://ftp.exim.org/pub/exim/%SUBDIR%/ \ - http://public.planetmirror.com/pub/exim/exim/%SUBDIR%/ \ ftp://ftp.easynet.be/exim/exim/%SUBDIR%/ \ ftp://mirror.kn.vutbr.cz/pub/ftp.exim.org/exim/%SUBDIR%/ \ ftp://sunsite.auc.dk/pub/mail/exim/exim/%SUBDIR%/ \ @@ -299,7 +297,6 @@ ftp://ftp.riken.go.jp/pub/Linux/fedora/core/%SUBDIR%/ \ http://ftp.isu.edu.tw/pub/Linux/Fedora/linux/core/%SUBDIR%/ \ ftp://ftp.isu.edu.tw/pub/Linux/Fedora/linux/core/%SUBDIR%/ \ - http://public.planetmirror.com/pub/fedora/linux/core/%SUBDIR%/ \ ftp://ftp.planetmirror.com/pub/fedora/linux/core/%SUBDIR%/ \ http://www.las.ic.unicamp.br/pub/fedora/linux/core/%SUBDIR%/ \ ftp://www.las.ic.unicamp.br/pub/fedora/linux/core/%SUBDIR%/ \ @@ -383,7 +380,6 @@ http://gentoo.inode.at/%SUBDIR%/ \ http://ftp.rhnet.is/pub/gentoo/%SUBDIR%/ \ http://gentoo.mirror.sdv.fr/%SUBDIR%/ \ - http://public.planetmirror.com/pub/gentoo/%SUBDIR%/ \ http://ftp.gentoo.or.kr/%SUBDIR%/ \ http://mirror.gentoo.gr.jp/%SUBDIR%/ \ http://gentoo.gg3.net/%SUBDIR%/ \ @@ -442,7 +438,6 @@ ftp://ftp.dti.ad.jp/pub/X/gnome/%SUBDIR%/ \ ${MASTER_SITE_RINGSERVER:S,%SUBDIR%,X/gnome/&,} \ ftp://ftp.kddlabs.co.jp/pub/GNOME/%SUBDIR%/ \ - http://public.planetmirror.com/pub/gnome/%SUBDIR%/ \ ftp://ftp.mirrorservice.org/sites/ftp.gnome.org/pub/GNOME/%SUBDIR%/ \ http://ftp.gnome.org/pub/GNOME/%SUBDIR%/ .endif @@ -483,7 +478,6 @@ .if !defined(IGNORE_MASTER_SITE_GNUSTEP) MASTER_SITE_GNUSTEP+= \ - http://downloads.planetmirror.com/pub/gnustep/gnustep/%SUBDIR%/ \ ftp://ftp.planetmirror.com/pub/gnustep/gnustep/%SUBDIR%/ \ ftp://ftp.gnustep.org/pub/gnustep/%SUBDIR%/ \ ftp://ftp.easynet.nl/mirror/GNUstep/pub/gnustep/%SUBDIR%/ @@ -499,8 +493,7 @@ ftp://alpha.gnu.org/pub/gnu/%SUBDIR%/ \ ftp://ftp.funet.fi/pub/mirrors/alpha.gnu.org/gnu/%SUBDIR%/ \ ftp://ftp.lublin.pl/mirror/alpha.gnu.org/gnu/%SUBDIR%/ \ - ftp://ftp.ps.pl/mirrors/alpha.gnu.org/pub/gnu/%SUBDIR%/ \ - http://public.planetmirror.com/pub/gnu-alpha/%SUBDIR%/ + ftp://ftp.ps.pl/mirrors/alpha.gnu.org/pub/gnu/%SUBDIR%/ .endif .if !defined(IGNORE_MASTER_SITE_HORDE) @@ -512,8 +505,7 @@ ftp://ftp.it.horde.org/horde/pub/%SUBDIR%/ \ ftp://ftp.planetmirror.com/pub/horde/%SUBDIR%/ \ ftp://ftp.es.horde.org/pub/%SUBDIR%/ \ - ftp://ftp.nl.horde.org/mirror/horde-ftp/pub/%SUBDIR%/ \ - http://downloads.planetmirror.com/pub/horde/%SUBDIR%/ + ftp://ftp.nl.horde.org/mirror/horde-ftp/pub/%SUBDIR%/ .endif .if !defined(IGNORE_MASTER_SITE_IDSOFTWARE) @@ -528,7 +520,6 @@ ftp://ftp.nsu.ru/mirrors/ftp.idsoftware.com/idstuff/%SUBDIR%/ \ ftp://ftp.ntua.gr/pub/vendors/idgames/idstuff/%SUBDIR%/ \ ftp://ftp.omen.net.au/games/idstuff/%SUBDIR%/ \ - http://ftp.planetmirror.com/pub/idgames/idstuff/%SUBDIR%/ \ ftp://ftp.sunsite.org.uk/sites/ftp.idsoftware.com/idstuff/%SUBDIR%/ \ ftp://ftp.idsoftware.com/idstuff/%SUBDIR%/ .endif @@ -642,7 +633,6 @@ ftp://ftp.funet.fi/pub/mirrors/ftp.kde.org/pub/kde/%SUBDIR%/ \ http://ftp.funet.fi/pub/mirrors/ftp.kde.org/pub/kde/%SUBDIR%/ \ ftp://ftp.planetmirror.com/pub/kde/%SUBDIR%/ \ - http://public.planetmirror.com/pub/kde/%SUBDIR%/ \ ftp://ftp.ussg.iu.edu/pub/kde/%SUBDIR%/ \ http://ftp.ussg.iu.edu/kde/%SUBDIR%/ \ ftp://carroll.aset.psu.edu/pub/kde/%SUBDIR%/ \ @@ -865,7 +855,6 @@ .if !defined(IGNORE_MASTER_SITE_PYTHON) MASTER_SITE_PYTHON+= \ http://www.python.org/%SUBDIR%/ \ - http://python.planetmirror.com/%SUBDIR%/ \ http://python.ilisys.com.au/%SUBDIR%/ \ http://ftp.easynet.be/python/%SUBDIR%/ \ http://www.linux.org.hk/mirror/python/%SUBDIR%/ \ @@ -890,7 +879,6 @@ http://qmail.cdsinet.net/%SUBDIR%/ \ http://qmail.teleglobe.net/%SUBDIR%/ \ http://qmail.glasswings.com.au/%SUBDIR%/ \ - http://qmail.planetmirror.com/%SUBDIR%/ \ http://qmail.hostlink.com.hk/%SUBDIR%/ \ http://qmail.cbn.net.id/%SUBDIR%/ \ http://qmail.manic.co.kr/%SUBDIR%/ \ @@ -1151,7 +1139,6 @@ ftp://ftp.chg.ru/pub/Linux/SuSE/suse/%SUBDIR%/ \ http://mirror.pacific.net.au/linux/suse/%SUBDIR%/ \ ftp://ftp.planetmirror.com/pub/linux/suse/suse/%SUBDIR%/ \ - http://public.planetmirror.com/pub/linux/suse/suse/%SUBDIR%/ \ ftp://mirror.aarnet.edu.au/pub/suse/%SUBDIR%/ .endif >Release-Note: >Audit-Trail: >Unformatted:
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?200704242014.l3OKEqoK029785>