Skip site navigation (1)Skip section navigation (2)
Date:      Thu, 31 Jan 2002 11:27:56 +1000 (EST)
From:      jason andrade <jason@dstc.edu.au>
To:        Peter Wemm <peter@wemm.org>
Cc:        Olafur Osvaldsson <oli@isnic.is>, freebsd-hubs@FreeBSD.ORG
Subject:   Re: connection limits on ftp-master 
Message-ID:  <Pine.OSF.4.20.0201311124180.1961-100000@azure.dstc.edu.au>
In-Reply-To: <20020131001530.CC36F3A9A@overcee.wemm.org>

next in thread | previous in thread | raw e-mail | index | archive | help
On Wed, 30 Jan 2002, Peter Wemm wrote:

> > @ERROR: max connections (12) reached - try again later
> 
> Bah.  If only we could get people to switch to cvsup. :-)
> 
> peter@ftp-master[4:01pm]/usr/local/etc-106# ps -aux | grep rsyncd
> ftp    96475  1.9  2.2 46088 45568  ??  Ss   11:08AM   8:35.01 rsyncd --daemon (rsync)
> ftp    97175  0.0  2.1 45220 44736  ??  Ss    3:39PM   1:24.78 rsyncd --daemon (rsync)
> ...
> (yes, 45+MB of ram per client)

this is because i think you have clients who are doing a full rsync of the whole
site.  when you start to mirror the source trees, this is madness to use rsync
and in fact there should be something to disable using rsync for trees which
have > 50,000 files.  this would make a significant difference to memory use
(and cpu use) on ftp-master.

perhaps we should consider adding sub-sections to rsync and get people to
only mirror using those.

e.g

FreeBSD-releases
FreeBSD-ports

and change the default FreeBSD to something like FreeBSD-all (don't use this!)
which lets people use it if they know what they are doing, but makes it clear
people shouldn't be trying to use rsync to mirror the whole ftp-master site.

the right combination of mirroring is (unfortunately) a bix of cvsup and
rsync - since neither does quite everything one wants.  i'm sure just
cvsup is possible too, but then i run into some other issues..

regards,

-jason


To Unsubscribe: send mail to majordomo@FreeBSD.org
with "unsubscribe freebsd-hubs" in the body of the message




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?Pine.OSF.4.20.0201311124180.1961-100000>