From owner-freebsd-hubs Sun Oct 20 14:24:49 2002 Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 6E4BF37B401 for ; Sun, 20 Oct 2002 14:24:46 -0700 (PDT) Received: from canning.wemm.org (canning.wemm.org [192.203.228.65]) by mx1.FreeBSD.org (Postfix) with ESMTP id 318F543E77 for ; Sun, 20 Oct 2002 14:24:46 -0700 (PDT) (envelope-from peter@wemm.org) Received: from wemm.org (localhost [127.0.0.1]) by canning.wemm.org (Postfix) with ESMTP id 1BC142A88D; Sun, 20 Oct 2002 14:24:46 -0700 (PDT) (envelope-from peter@wemm.org) X-Mailer: exmh version 2.5 07/13/2001 with nmh-1.0.4 To: Jun Kuriyama Cc: hubs@FreeBSD.ORG Subject: Re: ftp-master access to HP-internal ftp mirror? In-Reply-To: <7mwuod5jfa.wl@black.imgsrc.co.jp> Date: Sun, 20 Oct 2002 14:24:46 -0700 From: Peter Wemm Message-Id: <20021020212446.1BC142A88D@canning.wemm.org> Sender: owner-freebsd-hubs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Jun Kuriyama wrote: > At Sun, 20 Oct 2002 20:56:12 +0800 (SGT), > mirror-maintainer@mirror.averse.net wrote: > > Indeed; I was unaware of how much hp contributes, and that wasn't explicit > > in his mail ;) If they feel that they do need direct access or require > > freshness better than that achievable (one hours?) by mirroring from one > > of the "tier 1" mirrors, by all means. > > I think we should have ftp-master.us.FreeBSD.org which is dedicated > for tier 2 and important contributors (such as HP?) in U.S. > > I don't know ftp-master.FreeBSD.org is suffered by whether network or > disk i/o. But accepting everyone to original ftp-master doesn't seem > to be correct way. Memory. It only has 2G of ram, and when rsyncd takes 100MB+ per process, and when it takes days to push 30 concurrent seperate copies of new releases and package builds to poorly connected places. The memory adds up. The machine swaps and slows down the better connected machines. I'd really like to restrict access to ftp-master to no more than about a dozen or so well-connected sites who also participate in providing exact mirror replication to everybody else (via either cvsup or rsync to ensure proper permissions and checksums etc). The idea is to get changes out *as fast as possible* to those machines who can then fan it out to the rest of the mirrors. This should dramatically improve the efficiency and scalability of getting stuff out there. I just dont have the time to organize it. I've spoken with some folks who have demonstrated that they have the time and patience to keep track of all this and who is doing what etc. You know who you are. :-) I guess I should follow up on it. Cheers, -Peter -- Peter Wemm - peter@wemm.org; peter@FreeBSD.org; peter@yahoo-inc.com "All of this is for nothing if we don't go to the stars" - JMS/B5 To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-hubs" in the body of the message