From owner-freebsd-bugs Wed Jul 11 9:56: 0 2001 Delivered-To: freebsd-bugs@freebsd.org Received: from ussenterprise.ufp.org (ussenterprise.ufp.org [208.185.30.210]) by hub.freebsd.org (Postfix) with ESMTP id 1C28337B401 for ; Wed, 11 Jul 2001 09:55:55 -0700 (PDT) (envelope-from bicknell@ussenterprise.ufp.org) Received: (from bicknell@localhost) by ussenterprise.ufp.org (8.11.1/8.11.1) id f6BGtlA67764; Wed, 11 Jul 2001 12:55:47 -0400 (EDT) (envelope-from bicknell) Date: Wed, 11 Jul 2001 12:55:47 -0400 From: Leo Bicknell To: Jim Pirzyk Cc: Leo Bicknell , freebsd-bugs@FreeBSD.ORG Subject: Re: conf/28882: Network defaults are absurdly low. Message-ID: <20010711125547.A67113@ussenterprise.ufp.org> References: <200107111550.f6BFo2g12771@freefall.freebsd.org> <01071109140103.89158@snoopy> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.2.5i In-Reply-To: <01071109140103.89158@snoopy>; from Jim.Pirzyk@disney.com on Wed, Jul 11, 2001 at 09:14:01AM -0700 Organization: United Federation of Planets Sender: owner-freebsd-bugs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On Wed, Jul 11, 2001 at 09:14:01AM -0700, Jim Pirzyk wrote: > I find in our enviroment that 16K is an optimal size for 10M Flat > enet and 32K is the best for 100Mb switched and 512k works for OC3 > atm. This is though with a maxsockbuf set to 768k and tcp_extentions > turned on. Two FreeBSD 4.2 systems, 100 Meg FE to an ISP network that can support a full 100 Mbps end to end. round-trip min/avg/max/stddev = 66.893/66.952/67.021/0.050 ms (San Jose CA, to Washington DC) System defaults, 16k socket buffers: 36985815 bytes received in 172.74 seconds (209.10 KB/s) It can fill a T1. It's only 20% of a 10 Meg cable modem though, or a 10 Meg ethernet connected host off a high speed line. I don't know about you, but everyone I've talked to finds defaults that produce this sort of rate limit absurd. Customers routinely install boxes on the network, do a transfer between them, and then spend the next 3 days bitching to us about how much the network stinks. However, if you try some other values: 32k socket buffers: 36985815 bytes received in 81.30 seconds (444.29 KB/s) Note, we still can't saturate even a 10 Meg ethernet (almost 20 year old technology), or a 10 Meg cable modem. Getting better though. Can the network support more, sure! 256k socket buffers (FreeBSD's default maximum): 36985815 bytes received in 10.26 seconds (3.44 MB/s) Now we're cooking with gas. I might consider this good enough for the average user on a single connection. Those who really need better performance can tune their systems. Let's do one last try: 1M socket buffers: 36985815 bytes received in 5.39 seconds (6.55 MB/s) But you know what, that 36 Meg file is now too large to get us past slow start and other goodies, and get a good transfer rate! So, let's try a bigger file: 1M socket buffers: 184929075 bytes received in 23.77 seconds (7.42 MB/s) So, FreeBSD's defaults are limiting the install to 209 K / 7.42 MB or 2.8% OF MAXIMUM THROUGHPUT! Even if you consider that my world of 100 meg cross country bandwidth is rare, a fair number of people these days have the ability to get 10Mbps/sec, and they are being liminted to 20% of their available bandwidth. Notably, most Linux installations use 32k defaults, which at least doubles the FreeBSD performance. If nothing else comes out of this I would hope FreeBSD can step up to the same level of performance as Linux and Solaris. I can only assume that if you find 16k sufficient, that your hosts are only running across a LAN segment on the same campus. -- Leo Bicknell - bicknell@ufp.org Systems Engineer - Internetworking Engineer - CCIE 3440 Read TMBG List - tmbg-list-request@tmbg.org, www.tmbg.org To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-bugs" in the body of the message