From owner-freebsd-ports@FreeBSD.ORG Sun Mar 7 04:23:04 2004 Return-Path: Delivered-To: freebsd-ports@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 1108E16A4CF for ; Sun, 7 Mar 2004 04:23:04 -0800 (PST) Received: from mail.dt.e-technik.uni-dortmund.de (mail.dt.E-Technik.Uni-Dortmund.DE [129.217.163.1]) by mx1.FreeBSD.org (Postfix) with ESMTP id A7E3943D2D for ; Sun, 7 Mar 2004 04:23:03 -0800 (PST) (envelope-from matthias.andree@gmx.de) Received: from m2a2.dyndns.org (krusty.dt.e-technik.uni-dortmund.de [129.217.163.1])9CEE1235AC for ; Sun, 7 Mar 2004 13:23:02 +0100 (CET) Received: by merlin.emma.line.org (Postfix, from userid 500) id CACFCABBCB; Sun, 7 Mar 2004 13:23:00 +0100 (CET) Date: Sun, 7 Mar 2004 13:23:00 +0100 From: Matthias Andree To: ports@freebsd.org Message-ID: <20040307122300.GB4327@merlin.emma.line.org> Mail-Followup-To: ports@freebsd.org References: <20040306112950.GA37509@xor.obsecurity.org> <4049DF0F.6070301@fillmore-labs.com> <404AA024.2080702@fillmore-labs.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <404AA024.2080702@fillmore-labs.com> User-Agent: Mutt/1.5.5.1i Subject: Re: FYI: eu.dl.sourceforge.net distfile corruption X-BeenThere: freebsd-ports@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Porting software to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 07 Mar 2004 12:23:04 -0000 On Sun, 07 Mar 2004, Oliver Eikemeier wrote: > >Yes. The sites should be randomized so that the load (and possibly > >breakage) is spread. > > We have RANDOMIZE_MASTER_SITES for this. This should probably enabled > by default. Breakage shouldn't be spread, especially it is important > to be able to exculde a defect or hacked server. If a re-fetch (after detecting MD5 mismatch) makes sure that a different server is tried, and reports the original server that the altered file was downloaded from, this should be isolated quickly. > >The way it is now, the first site listed bears the major part of > >ports-induced downloads. This would make the Irish Heanet site suffer > >most of the SourceForge-related downloads for port installs. I consider > >this unfair. If the ports system had tried to re-fetch (after broken > >checksum) from a different site, the download would have succeeded BTW. > > Maybe. On the other hand it may be strange to try twenty mirrors to > find that the checksum mismatches on all of them. I recall having read "checksum mismatch, re-fetching one more time". That's one, not twenty, or is the message misleading? > >And no, I have nothing to do with Heanet, I'm just worried because they > >are on top of your list. Besides, there are more European download sites > >for SF, for instance, Switch and Cesnet. > > Switch and Cesnet don't carry all projects distfiles, I added > MASTER_SITE_SOURCEFORGE_EXTENDED for them. Ah, didn't know about that. Thanks for the clarification. > Generally, the problem you mention are valid, but consider the way the port > system works and are not specific to sourceforge mirrors. A general solution > that includes i.e. MASTER_SITE_APACHE and MASTER_SITE_GNU is appreciated. Of course a general solution is preferred over any special casing - I've just argued about the currently "interesting" example because it's often easier to follow then. -- Matthias Andree Encrypt your mail: my GnuPG key ID is 0x052E7D95