From owner-freebsd-hubs@FreeBSD.ORG Tue Oct 19 17:04:13 2004 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 2198716A4CE for ; Tue, 19 Oct 2004 17:04:13 +0000 (GMT) Received: from hex.databits.net (hex.databits.net [216.118.117.77]) by mx1.FreeBSD.org (Postfix) with ESMTP id 8CB2043D54 for ; Tue, 19 Oct 2004 17:04:12 +0000 (GMT) (envelope-from will@csociety.org) Received: by hex.databits.net (Postfix, from userid 1001) id 17BBF57B11; Tue, 19 Oct 2004 12:04:12 -0500 (CDT) Date: Tue, 19 Oct 2004 12:04:12 -0500 From: Will Andrews To: Ken Smith Message-ID: <20041019170412.GV42886@hex.databits.net> Mail-Followup-To: Ken Smith , freebsd-hubs@freebsd.org References: <20041018203143.GB23076@electra.cse.Buffalo.EDU> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="rG09A39trvEtf3rB" Content-Disposition: inline In-Reply-To: <20041018203143.GB23076@electra.cse.Buffalo.EDU> User-Agent: Mutt/1.5.6i cc: freebsd-hubs@freebsd.org Subject: Re: Just curious - cvsup mirror connect rate? X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 19 Oct 2004 17:04:13 -0000 --rG09A39trvEtf3rB Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Oct 18, 2004 at 04:31:43PM -0400, Ken Smith wrote: > I'm just curious what people typically see for connect rates to the > main cvsup mirrors. >=20 > I've got one server here that's desperately in need of more memory > but it typically services around 2500 connections a day. Another > cvsup server I've got access to at another site services roughly > the same number per day. >=20 > The reason I'm asking is I'm cleaning up some servers that vaporized > on us. I've started to take over a dead server's name on a large > server here for at least a day before I turn it over to a new volunteer > site because of the inevitable slamming that happens when a new server > takes over for one that had been down for a while. I've done this > a couple times now and despite the initial load once things settle > down a bit I've been seeing the same typical number - on average > around 2500 connects a day. >=20 > Until now... I just took over cvsup5 for a bit because it had been > down. In less than 6 hours it's serviced about 11,000 connects. And > I'm not seeing tons of "Tree comp failure..." messages, the huge majority > are reporting success. It's been pegged at the 30 connect limit ever > since I made the DNS change almost 6 hours ago... >=20 > So, just kind of wondering what people normally see as average traffic > for a day. If cvsupd has been running all the time your machine has > been up simply taking the current connect number it's allocating and > dividing by the number of days it's been up is close enough. :-) > I'm kind of wondering if the number of hits you get is a function > of what cvsupN number you get - when people first set themselves > up they start at cvsup1 and go up until they find one that doesn't > say its full and then set up their cron job to use that one... :-) I think the imbalance is because people (falsely) rely on a program called "fastest_cvsup" to choose the mirror to use. This program only measures network performance of the cvsup mirrors in question & thus leads them to use a mirror that is not necessarily their best choice. The fact is that the network performance means little when it comes to cvsup, especially for updates. CPU, RAM, disk I/O of the server mean a lot more. This particularly affects cvsup12 since its outbound link is frequently saturated. The statistics are, for this month: will@sanmateo% for i in `jot -w '%02d' 18 1`;do echo -n "2004/10/${i}: ";gr= ep ^2004.10.${i} cvsupd.log | grep ": +"|wc -l;done 2004/10/01: 1255 2004/10/02: 1218 2004/10/03: 1152 2004/10/04: 1305 2004/10/05: 1349 2004/10/06: 1250 2004/10/07: 1314 2004/10/08: 1253 2004/10/09: 1252 2004/10/10: 1188 2004/10/11: 1212 2004/10/12: 866 2004/10/13: 1265 2004/10/14: 1246 2004/10/15: 1288 2004/10/16: 1267 2004/10/17: 1225 2004/10/18: 1324 At last count, this server had served 159,208 connections since it was last restarted July 13th & rarely sees load avgs above 2.0 & almost never above 10.0. On a particularly good day, it serves 1500-1600 clients. Regards, --=20 wca --rG09A39trvEtf3rB Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.6 (FreeBSD) iD8DBQFBdUkLF47idPgWcsURAvLAAJ9hkMcV4bUs/65YupQ22imtFdrUUwCcD1ee BgQYJelG2UTPO6ls7lRqvDQ= =wYi7 -----END PGP SIGNATURE----- --rG09A39trvEtf3rB--