From owner-freebsd-net@FreeBSD.ORG Sun Jun 17 19:37:17 2007 Return-Path: X-Original-To: net@freebsd.org Delivered-To: freebsd-net@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 03CDA16A41F for ; Sun, 17 Jun 2007 19:37:17 +0000 (UTC) (envelope-from peterjeremy@optushome.com.au) Received: from turion.vk2pj.dyndns.org (c220-239-20-82.belrs4.nsw.optusnet.com.au [220.239.20.82]) by mx1.freebsd.org (Postfix) with ESMTP id 852A313C480 for ; Sun, 17 Jun 2007 19:37:14 +0000 (UTC) (envelope-from peterjeremy@optushome.com.au) Received: from turion.vk2pj.dyndns.org (localhost.vk2pj.dyndns.org [127.0.0.1]) by turion.vk2pj.dyndns.org (8.14.1/8.14.1) with ESMTP id l5HJL9l6024347; Mon, 18 Jun 2007 05:21:09 +1000 (EST) (envelope-from peter@turion.vk2pj.dyndns.org) Received: (from peter@localhost) by turion.vk2pj.dyndns.org (8.14.1/8.14.1/Submit) id l5HJL9Hu024346; Mon, 18 Jun 2007 05:21:09 +1000 (EST) (envelope-from peter) Date: Mon, 18 Jun 2007 05:21:09 +1000 From: Peter Jeremy To: "M. Warner Losh" Message-ID: <20070617192109.GG22547@turion.vk2pj.dyndns.org> References: <20070617.114133.778151882.imp@bsdimp.com> <46757818.5030005@joeholden.co.uk> <20070617.130238.-1435629453.imp@bsdimp.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="tThc/1wpZn/ma/RB" Content-Disposition: inline In-Reply-To: <20070617.130238.-1435629453.imp@bsdimp.com> X-PGP-Key: http://members.optusnet.com.au/peterjeremy/pubkey.asc User-Agent: Mutt/1.5.15 (2007-04-06) Cc: net@freebsd.org Subject: Re: Issue with huge numbers of connections X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 17 Jun 2007 19:37:17 -0000 --tThc/1wpZn/ma/RB Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On 2007-Jun-17 13:02:38 -0600, "M. Warner Losh" wrote: >Doing the math on 10^9 connections in a week translates to ~1650/s, so we'd >expect there are on the order of 100-200 connections steady state at any >time. I suspect that the peak load may be up to 100 times that, which is >still only 20000 connections. The hangs don't seem to hang at a peak, but >randomly. Note that the TCP state machine includes a 2xMSL (128 second) timeout after the connection closes before the kernel releases the TCP control block. There may not be many connections open but at 1650 connections per second, there are about 200,000 control blocks in TCPS_TIME_WAIT - far more if the load is peaky. --=20 Peter Jeremy --tThc/1wpZn/ma/RB Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.7 (FreeBSD) iD8DBQFGdYml/opHv/APuIcRAivWAJ4mHAwI4CH/xLvNKSJo5N1D2BGGJwCfdG78 VkRBP3W/3Wdd5Z3BsLw461U= =mfwv -----END PGP SIGNATURE----- --tThc/1wpZn/ma/RB--