From owner-freebsd-hardware@FreeBSD.ORG Mon Sep 3 21:05:24 2012 Return-Path: Delivered-To: freebsd-hardware@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 49FE4106566B for ; Mon, 3 Sep 2012 21:05:24 +0000 (UTC) (envelope-from peter@rulingia.com) Received: from vps.rulingia.com (host-122-100-2-194.octopus.com.au [122.100.2.194]) by mx1.freebsd.org (Postfix) with ESMTP id B3CE48FC17 for ; Mon, 3 Sep 2012 21:05:23 +0000 (UTC) Received: from aspire.rulingia.com (12.58.233.220.static.exetel.com.au [220.233.58.12]) by vps.rulingia.com (8.14.5/8.14.5) with ESMTP id q83L51e2035046 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK); Tue, 4 Sep 2012 07:05:15 +1000 (EST) (envelope-from peter@rulingia.com) Received: from aspire.rulingia.com (localhost [127.0.0.1]) by aspire.rulingia.com (8.14.5/8.14.5) with ESMTP id q83L4sr7005161 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 4 Sep 2012 07:04:54 +1000 (EST) (envelope-from peter@aspire.rulingia.com) Received: (from peter@localhost) by aspire.rulingia.com (8.14.5/8.14.5/Submit) id q83L4pv5005160; Tue, 4 Sep 2012 07:04:51 +1000 (EST) (envelope-from peter) Date: Tue, 4 Sep 2012 07:04:50 +1000 From: Peter Jeremy To: Ragnar Lonn Message-ID: <20120903210450.GC2654@aspire.rulingia.com> References: <50446681.2080307@gatorhole.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="Qbvjkv9qwOGw/5Fx" Content-Disposition: inline In-Reply-To: <50446681.2080307@gatorhole.com> X-PGP-Key: http://www.rulingia.com/keys/peter.pgp User-Agent: Mutt/1.5.21 (2010-09-15) Cc: freebsd-hardware@freebsd.org Subject: Re: Load testing knocks out network X-BeenThere: freebsd-hardware@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: General discussion of FreeBSD hardware List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 03 Sep 2012 21:05:24 -0000 --Qbvjkv9qwOGw/5Fx Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On 2012-Sep-03 10:12:49 +0200, Ragnar Lonn wrote: >transmit/receive buffers. In newer *Linux* kernels, this memory is being= =20 >allocated in an adaptive manner - i.e. the kernel only allocates a small= =20 >amount of memory to each TCP buffer, and then increases it as necessary=20 >(per connection, depending on transfer speed and network delay to the=20 >other peer). FreeBSD does this as well, though I don't recall when this was added. >I think I actually discussed this with FreeBSD developers a while ago=20 >(on this list even?), and they told me the FreeBSD kernel can only=20 >allocate max 2GB of kernel memory. This is only true on 32-bit kernels. FreeBSD uses a single address space so both kernel and userland need to fit into 4GB on 32-bit systems. On 64-bit systems, KVM is less constrained (it's ~550GB on my amd64). You can check sysctl's vm.kvm_free and vm.kvm_size for exact figures. >100K buffer memory. If you have e.g. 1GB available to network buffers,=20 >it means a max limit of 10k simultaneous connections on a server,=20 >regardless of how much memory it has. If you want a system to usefully cope with 10K network connections, you will probably want to be running amd64 anyway. That said, Rod Grimes was achieving between 100K and 1M TCP connections to FreeBSD i386 systems in the 1990's. --=20 Peter Jeremy --Qbvjkv9qwOGw/5Fx Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.19 (FreeBSD) iEYEARECAAYFAlBFG3IACgkQ/opHv/APuIde8gCgtEiA5BjFU3khGRk6Ha12suN8 tf8AoLbVrQszZHQjc5ofjS/ywURg8X4J =AwPO -----END PGP SIGNATURE----- --Qbvjkv9qwOGw/5Fx--