From owner-freebsd-net@FreeBSD.ORG Tue Aug 12 10:43:52 2014 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id B8BCD1FB for ; Tue, 12 Aug 2014 10:43:52 +0000 (UTC) Received: from mx1.netapp.com (mx1.netapp.com [216.240.18.38]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (Client CN "mx1.netapp.com", Issuer "VeriSign Class 3 Secure Server CA - G3" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 814A329E2 for ; Tue, 12 Aug 2014 10:43:52 +0000 (UTC) X-IronPort-AV: E=Sophos;i="5.01,848,1400050800"; d="asc'?scan'208";a="338527006" Received: from vmwexceht03-prd.hq.netapp.com ([10.106.76.241]) by mx1-out.netapp.com with ESMTP; 12 Aug 2014 03:43:53 -0700 Received: from HIOEXCMBX05-PRD.hq.netapp.com (10.122.105.38) by vmwexceht03-prd.hq.netapp.com (10.106.76.241) with Microsoft SMTP Server (TLS) id 14.3.123.3; Tue, 12 Aug 2014 03:43:21 -0700 Received: from HIOEXCMBX07-PRD.hq.netapp.com (10.122.105.40) by hioexcmbx05-prd.hq.netapp.com (10.122.105.38) with Microsoft SMTP Server (TLS) id 15.0.913.22; Tue, 12 Aug 2014 03:43:02 -0700 Received: from HIOEXCMBX07-PRD.hq.netapp.com ([::1]) by hioexcmbx07-prd.hq.netapp.com ([fe80::f0de:b572:dd26:36b5%21]) with mapi id 15.00.0913.011; Tue, 12 Aug 2014 03:43:03 -0700 From: "Eggert, Lars" To: Michael Tuexen Subject: Re: A problem on TCP in High RTT Environment. Thread-Topic: A problem on TCP in High RTT Environment. Thread-Index: AQHPswaXaqmGo9mF3Ua6+epBNevn4ZvJEqcAgAATYoCAAA7VAIAAA8CAgABXqQCAAANCAP//lMnkgAB+UQCAAASwAIAByiAAgAACkYCAAFJhAIAAeY2AgAADqYCAAAVDgIAAQPcAgACJIICAACltgIAAA24A Date: Tue, 12 Aug 2014 10:43:02 +0000 Message-ID: <56F2C841-6192-4C64-92B0-18BF12D07EAB@netapp.com> References: <20140809184232.GF83475@funkthat.com> <8AE1AC56-D52F-4F13-AAA3-BB96042B37DD@lurchi.franken.de> <20140809204500.GG83475@funkthat.com> <3F6BC212-4223-4AAC-8668-A27075DC55C2@lurchi.franken.de> <20140810022350.GI83475@funkthat.com> <20140810033212.GL83475@funkthat.com> <17A804F3-BEA6-46F4-887F-B68750618FD9@netapp.com> <0CF85443-26AC-4931-9D00-3396C18C7690@lurchi.franken.de> <7A4120EE-60F3-4D32-89C4-C694B8DFEAE4@netapp.com> <5E8A6382-7096-495A-907C-86CE26A163A2@lurchi.franken.de> <5D3CBFDC-362E-4DB6-A132-BA842EF5B1B2@lurchi.franken.de> <45B75806-ECE3-43D0-A75B-1B71A5969234@lurchi.franken.de> In-Reply-To: <45B75806-ECE3-43D0-A75B-1B71A5969234@lurchi.franken.de> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: yes X-MS-TNEF-Correlator: x-mailer: Apple Mail (2.1878.6) x-originating-ip: [10.122.56.79] Content-Type: multipart/signed; boundary="Apple-Mail=_6D45AB0D-ECFA-49AD-AC44-649F95916F0E"; protocol="application/pgp-signature"; micalg=pgp-sha1 MIME-Version: 1.0 Cc: "freebsd-net@freebsd.org" , John-Mark Gurney , Niu Zhixiong , hiren panchasara , Bill Yuan X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 12 Aug 2014 10:43:52 -0000 --Apple-Mail=_6D45AB0D-ECFA-49AD-AC44-649F95916F0E Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii On 2014-8-12, at 12:31, Michael Tuexen = wrote: > On 12 Aug 2014, at 10:02, Eggert, Lars wrote: >> I bumped kern.ipc.nmbclusters by a factor of 100 (from 2036224 to = 203622400). As Hiren said, kern.ipc.nmbufs auto-adjusted (from 13031835 = to 205111860). > Just to double check: You changed it in /boot/loader.conf, right? Yep, and it has taken effect: # sysctl -a | egrep 'nmb|mbuf' kern.ipc.maxmbufmem: 16680744960 kern.ipc.nmbclusters: 203622400 kern.ipc.nmbjumbop: 1018111 kern.ipc.nmbjumbo9: 904986 kern.ipc.nmbjumbo16: 678740 kern.ipc.nmbufs: 205111860 net.inet.sctp.max_chained_mbufs: 5 >> I just noticed that the total "mbufs in use" didn't seem to have = increase when I did the 100x scaling of kern.ipc.nmbclusters (and = kern.ipc.nmbufs auto-adjusted). Neither did "bytes allocated to = network". Is that expected? > I don't think so... Am I hitting some other kernel limit on how much memory in total the = stack can use? Lars --Apple-Mail=_6D45AB0D-ECFA-49AD-AC44-649F95916F0E Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="signature.asc" Content-Type: application/pgp-signature; name="signature.asc" Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- iQCVAwUBU+nv1dZcnpRveo1xAQI0/AP+MwQU7XgTj+ppVbrmflFiQJeL27NrE+pb Y2qxEqzpVEHu6Qzat5at7lMkjeiu88kGL1GNwi5nJeylNgfUYIA9mX+5XaGk1itR /IHtJXd/2w6GQtK1ryFM/u2tUGPYLzvcxJoy+YLMgGyfaiLLKqVbN8LVCLZEzXt5 QBjJmKkUmY4= =Rm5E -----END PGP SIGNATURE----- --Apple-Mail=_6D45AB0D-ECFA-49AD-AC44-649F95916F0E--