From owner-freebsd-ports@FreeBSD.ORG Tue Nov 11 16:27:32 2008 Return-Path: Delivered-To: freebsd-ports@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 48C191065680 for ; Tue, 11 Nov 2008 16:27:32 +0000 (UTC) (envelope-from wxs@atarininja.org) Received: from syn.atarininja.org (syn.csh.rit.edu [129.21.60.158]) by mx1.freebsd.org (Postfix) with ESMTP id 2B8668FC1B for ; Tue, 11 Nov 2008 16:27:32 +0000 (UTC) (envelope-from wxs@atarininja.org) Received: by syn.atarininja.org (Postfix, from userid 1001) id C29745C38; Tue, 11 Nov 2008 11:27:31 -0500 (EST) Date: Tue, 11 Nov 2008 11:27:31 -0500 From: Wesley Shields To: Eygene Ryabinkin Message-ID: <20081111162731.GB74163@atarininja.org> References: <20081110155616.DA66A1AF424@void.codelabs.ru> <20081111032350.0b22a853@gumby.homeunix.com> <20081111153554.GA4294@wep4035.physik.uni-wuerzburg.de> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.18 (2008-05-17) Cc: Alexey Shuvaev , freebsd-ports@freebsd.org Subject: Re: ports/128754: [port infrastructure] implement master sites randomization X-BeenThere: freebsd-ports@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Porting software to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 11 Nov 2008 16:27:32 -0000 On Tue, Nov 11, 2008 at 07:19:03PM +0300, Eygene Ryabinkin wrote: > Tue, Nov 11, 2008 at 04:35:54PM +0100, Alexey Shuvaev wrote: > > On Tue, Nov 11, 2008 at 03:23:50AM +0000, RW wrote: > > > On Mon, 10 Nov 2008 18:56:16 +0300 (MSK) > > > I think it would be sensible to seed srand from a hash of something > > > reproducible to make better use of caches - maybe DISTNAME+DISTVERSION. > > > > > Maybe I don't understand something, but is RANDOMIZE_MASTER_SITES > > (see bsd.port.mk for details) not enough? It affects though all > > sites, not only SF. > > It is enough, but it requires /usr/games/random to be present. Not all > servers have 'games' distribution installed, but I want them to > randomize master sites. > > For the feeding the hashes: RW, do you mean HTTP caches? In principle, > this is a neat idea: it will achieve load-balancing between the sites. > But as it will use the same master sites order for the given port, this > will be failing when the first download site is almost down: the > download will take very long. But probably stable order of the sites > can be made settable via the variable, e.g. > RANDOMIZE_MASTER_SITE_REPRODUCIBLY. Will it be fine? Please, note that > this can be achievable only for the awk script: random(6) can not be > currently directed to do this. As a side-note to your discussion: If your concern is to pick sites which are fast for you, you may want to look at ports-mgmt/fastest_sites. It handles almost all MASTER_SITE_FOO definitions and is designed to sort based upon round-trip time for the TCP handshake to complete (best guess for least effort). The output is suitable for inclusion into make.conf. -- WXS