Skip site navigation (1)Skip section navigation (2)
Date:      Sat, 2 May 1998 12:47:11 +0930
From:      Greg Lehey <grog@lemis.com>
To:        "Jason C. Wells" <jcwells@u.washington.edu>
Cc:        FreeBSD-questions <freebsd-questions@FreeBSD.ORG>
Subject:   Re: Delay
Message-ID:  <19980502124711.C395@freebie.lemis.com>
In-Reply-To: <Pine.BSF.3.96.980501192246.918F-100000@s8-37-26.student.washington.edu>; from Jason C. Wells on Fri, May 01, 1998 at 07:26:32PM -0700
References:  <19980502105350.D318@freebie.lemis.com> <Pine.BSF.3.96.980501192246.918F-100000@s8-37-26.student.washington.edu>

next in thread | previous in thread | raw e-mail | index | archive | help
On Fri,  1 May 1998 at 19:26:32 -0700, Jason C. Wells wrote:
> On Sat, 2 May 1998, Greg Lehey wrote:
>
>> On Fri,  1 May 1998 at 11:17:41 -0700, Jason C. Wells wrote:
>>> On Thu, 30 Apr 1998, Sergei Shayevich wrote:
>
>>> Lets look!
>>>
>>> Server:  dns1.cac.washington.edu
>>> Address:  128.95.120.1
>>>
>>> Non-authoritative answer:
>>> Name:    hub.freebsd.org
>>> Address:  204.216.27.18
>>> Aliases:  www.freebsd.org
>>>
>>> The ip for these "machines" is the same. Yes, this is busy!
>>
>> Which other machine?  I only see hub.
>
> www and hub. The point which you were supposed to intuit was that this one
> teeny weeny machine was handling all this huge load from this ultra busy
> web and mail server. :)

Ah.

> I wasn't being specific. Without any real data, I just assumed the
> machines were busy.
>
> Since Mr. Lehey is in the know; How much of a percentage of available
> bandwidth does hub/www consume. Just curious.

Well, I'm not *that* much in the know.  I have a login on hub, like
many others, and from time to time I observe the amount of traffic.
It's seldom more than 50% loaded, and mainly round the 20% mark.  It's
not the big, heavy machine that you might think, though--that's
ftp.FreeBSD.org, better known as wcarchive.cdrom.com.  This is the
world's largest ftp server.  At times it has served up to 3200 users
concurrently, though I notice that currently the limit is 2500.  This
machine is David Greenman's personal responsibility, and he may come
in with more details.  In the meantime, here are some recent
performance statistics.  You'll note that the daily sum represents an
*average* data rate of 3.78 MB/s.

To be fair, I should comment that Microsoft's web/ftp site has more
throughput--there used to be information at
http://www.microsoft.com/syspro/technet/tnnews/features/mscom.htm, but
it currently can't find the page.  It was there just a few weeks ago,
though, and there's not indication that it's moved.  I've noticed
frequent connection resets from Microsoft, which I assume are crashing
servers, so this might be related.  In any case, it's difficult to
compare directly, since Microsoft is more interested in showing the
system architecture for the 80-odd machines they use, but from memory
it would appear that their ftp throughput is somewhere between 2 and 3
times that of wcarchive.

Greg

From: David Greenman <dg@root.com>
Date: Mon, 27 Apr 1998 01:10:02 -0700
>>                                         Current Record                 Delta
>>            --------------------- --------------------- ---------------------
>>      Bytes       326,412,384,034       326,412,384,034           New Record!
>>      Files             1,209,747             1,249,597               -39,850
>>
>>  FTP Bytes       306,166,038,843       306,166,038,843           New Record!
>>  FTP Files               861,892               861,892           New Record!
>> HTTP Bytes        20,246,345,191        58,081,249,072       -37,834,903,881
>> HTTP Files               347,855               567,700              -219,845
> ...
>>                  Total      FTP     HTTP   Total     FTP    HTTP  Total  Total
>>                  Bytes    Bytes    Bytes   Files   Files   Files %Bytes %Files
>> -------------- -------- -------- -------- ------- ------- ------- ------ ------
>> /linux          49,009M  48,555M     454M 200,409 192,505   7,904  15.01  16.57
>> /FreeBSD        45,317M  45,305M      12M 287,208 284,913   2,295  13.88  23.74
>> /simtelnet      42,796M  39,473M   3,323M  65,637  55,914   9,723  13.11   5.43
>> /planetquake    26,613M  23,031M   3,581M  26,990  22,829   4,161   8.15   2.23
>> /idgames2       25,628M  19,198M   6,429M  81,952  56,099  25,853   7.85   6.77
>> /idgames        24,040M  23,169M     870M  34,044  28,881   5,163   7.37   2.81
>> /3dfxmania      21,091M  20,998M      93M  10,395  10,110     285   6.46   0.86
>> /gamesdomain    18,404M  17,815M     588M   2,599   2,084     515   5.64   0.21
>> /games          18,081M  17,873M     207M  17,321  14,635   2,686   5.54   1.43
> ...
>
>   Yup, a new record for wcarchive. This beats the old record by about 15%.
> I suppose a bit of explanation is in order. For various reasons, I needed to
> change the way that ftp's "LIST" (ls) command reports the dates in the file
> list so that the time is GMT rather than the machine's local time. This had
> the unfortunate side effect of causing mirrors of wcarchive to re-mirror the
> files in the archive and thus resulted in more traffic than usual. I have
> reason to believe that some corrupted files went out to the mirrors last week
> as a result of the memory failure in the machine, so the re-mirror isn't an
> entirely bad thing.
>   Still, mirrors or not, we wouldn't have set the new record without
> other things converging as well - such as improved network connectivity
> and improvements I've been making to the performance of FTP on wcarchive.


--
See complete headers for address and phone numbers
finger grog@lemis.com for PGP public key

To Unsubscribe: send mail to majordomo@FreeBSD.org
with "unsubscribe freebsd-questions" in the body of the message



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?19980502124711.C395>