From owner-freebsd-questions Fri May 1 20:17:39 1998 Return-Path: Received: (from majordom@localhost) by hub.freebsd.org (8.8.8/8.8.8) id UAA22443 for freebsd-questions-outgoing; Fri, 1 May 1998 20:17:39 -0700 (PDT) (envelope-from owner-freebsd-questions@FreeBSD.ORG) Received: from freebie.lemis.com (freebie.lemis.com [139.130.136.133]) by hub.freebsd.org (8.8.8/8.8.8) with ESMTP id UAA22397 for ; Fri, 1 May 1998 20:17:19 -0700 (PDT) (envelope-from grog@lemis.com) Received: (from grog@localhost) by freebie.lemis.com (8.8.8/8.8.7) id MAA00627; Sat, 2 May 1998 12:47:11 +0930 (CST) (envelope-from grog) Message-ID: <19980502124711.C395@freebie.lemis.com> Date: Sat, 2 May 1998 12:47:11 +0930 From: Greg Lehey To: "Jason C. Wells" Cc: FreeBSD-questions Subject: Re: Delay References: <19980502105350.D318@freebie.lemis.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Mailer: Mutt 0.91.1i In-Reply-To: ; from Jason C. Wells on Fri, May 01, 1998 at 07:26:32PM -0700 WWW-Home-Page: http://www.lemis.com/~grog Organization: LEMIS, PO Box 460, Echunga SA 5153, Australia Phone: +61-8-8388-8286 Fax: +61-8-8388-8725 Mobile: +61-41-739-7062 Sender: owner-freebsd-questions@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.ORG On Fri, 1 May 1998 at 19:26:32 -0700, Jason C. Wells wrote: > On Sat, 2 May 1998, Greg Lehey wrote: > >> On Fri, 1 May 1998 at 11:17:41 -0700, Jason C. Wells wrote: >>> On Thu, 30 Apr 1998, Sergei Shayevich wrote: > >>> Lets look! >>> >>> Server: dns1.cac.washington.edu >>> Address: 128.95.120.1 >>> >>> Non-authoritative answer: >>> Name: hub.freebsd.org >>> Address: 204.216.27.18 >>> Aliases: www.freebsd.org >>> >>> The ip for these "machines" is the same. Yes, this is busy! >> >> Which other machine? I only see hub. > > www and hub. The point which you were supposed to intuit was that this one > teeny weeny machine was handling all this huge load from this ultra busy > web and mail server. :) Ah. > I wasn't being specific. Without any real data, I just assumed the > machines were busy. > > Since Mr. Lehey is in the know; How much of a percentage of available > bandwidth does hub/www consume. Just curious. Well, I'm not *that* much in the know. I have a login on hub, like many others, and from time to time I observe the amount of traffic. It's seldom more than 50% loaded, and mainly round the 20% mark. It's not the big, heavy machine that you might think, though--that's ftp.FreeBSD.org, better known as wcarchive.cdrom.com. This is the world's largest ftp server. At times it has served up to 3200 users concurrently, though I notice that currently the limit is 2500. This machine is David Greenman's personal responsibility, and he may come in with more details. In the meantime, here are some recent performance statistics. You'll note that the daily sum represents an *average* data rate of 3.78 MB/s. To be fair, I should comment that Microsoft's web/ftp site has more throughput--there used to be information at http://www.microsoft.com/syspro/technet/tnnews/features/mscom.htm, but it currently can't find the page. It was there just a few weeks ago, though, and there's not indication that it's moved. I've noticed frequent connection resets from Microsoft, which I assume are crashing servers, so this might be related. In any case, it's difficult to compare directly, since Microsoft is more interested in showing the system architecture for the 80-odd machines they use, but from memory it would appear that their ftp throughput is somewhere between 2 and 3 times that of wcarchive. Greg From: David Greenman Date: Mon, 27 Apr 1998 01:10:02 -0700 >> Current Record Delta >> --------------------- --------------------- --------------------- >> Bytes 326,412,384,034 326,412,384,034 New Record! >> Files 1,209,747 1,249,597 -39,850 >> >> FTP Bytes 306,166,038,843 306,166,038,843 New Record! >> FTP Files 861,892 861,892 New Record! >> HTTP Bytes 20,246,345,191 58,081,249,072 -37,834,903,881 >> HTTP Files 347,855 567,700 -219,845 > ... >> Total FTP HTTP Total FTP HTTP Total Total >> Bytes Bytes Bytes Files Files Files %Bytes %Files >> -------------- -------- -------- -------- ------- ------- ------- ------ ------ >> /linux 49,009M 48,555M 454M 200,409 192,505 7,904 15.01 16.57 >> /FreeBSD 45,317M 45,305M 12M 287,208 284,913 2,295 13.88 23.74 >> /simtelnet 42,796M 39,473M 3,323M 65,637 55,914 9,723 13.11 5.43 >> /planetquake 26,613M 23,031M 3,581M 26,990 22,829 4,161 8.15 2.23 >> /idgames2 25,628M 19,198M 6,429M 81,952 56,099 25,853 7.85 6.77 >> /idgames 24,040M 23,169M 870M 34,044 28,881 5,163 7.37 2.81 >> /3dfxmania 21,091M 20,998M 93M 10,395 10,110 285 6.46 0.86 >> /gamesdomain 18,404M 17,815M 588M 2,599 2,084 515 5.64 0.21 >> /games 18,081M 17,873M 207M 17,321 14,635 2,686 5.54 1.43 > ... > > Yup, a new record for wcarchive. This beats the old record by about 15%. > I suppose a bit of explanation is in order. For various reasons, I needed to > change the way that ftp's "LIST" (ls) command reports the dates in the file > list so that the time is GMT rather than the machine's local time. This had > the unfortunate side effect of causing mirrors of wcarchive to re-mirror the > files in the archive and thus resulted in more traffic than usual. I have > reason to believe that some corrupted files went out to the mirrors last week > as a result of the memory failure in the machine, so the re-mirror isn't an > entirely bad thing. > Still, mirrors or not, we wouldn't have set the new record without > other things converging as well - such as improved network connectivity > and improvements I've been making to the performance of FTP on wcarchive. -- See complete headers for address and phone numbers finger grog@lemis.com for PGP public key To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-questions" in the body of the message