From owner-freebsd-net Wed Aug 1 20:37:48 2001 Delivered-To: freebsd-net@freebsd.org Received: from mail.internet2.edu (list.internet2.edu [209.211.239.181]) by hub.freebsd.org (Postfix) with ESMTP id 60E8337B403; Wed, 1 Aug 2001 20:37:43 -0700 (PDT) (envelope-from shalunov@internet2.edu) Received: from cain.internet2.edu (localhost [127.0.0.1]) by mail.internet2.edu (8.11.1/8.11.1/Debian 8.11.0-6) with ESMTP id f723bfh05900; Wed, 1 Aug 2001 23:37:41 -0400 X-Authentication-Warning: mail.internet2.edu: Host localhost [127.0.0.1] claimed to be cain.internet2.edu Received: by cain.internet2.edu (Postfix, from userid 1000) id BD5328E8; Wed, 1 Aug 2001 23:32:29 -0400 (EDT) To: Bill Paul , Ken Merry Cc: freebsd-net@FreeBSD.org Subject: TCP problems with large window sizes on FreeBSD (GigaTCP) From: stanislav shalunov Date: 01 Aug 2001 23:32:29 -0400 Message-ID: <87bslzt9v6.fsf@cain.internet2.edu> Lines: 43 X-Mailer: Gnus v5.7/Emacs 20.4 Sender: owner-freebsd-net@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org We want to build two or more machines that would be capable of achieving TCP throughputs of 700-800Mb/s over WAN (with a single TCP connection). The motivations of this exercise are spelled out on the referred web page. Additionally, I believe that getting through with this exercise with FreeBSD as the OS would advance FreeBSD's cause with network researchers and advanced users of high-performance networks. In order to run at such high throughput over links with RTT of roughly 70ms we'd need window sizes in the vicinity of 8-16MB. (And, naturally, the unidirectional loss event probability has to be less than (.7*MSS/(RTT*bandwidth))^2 = 1e-7. We believe that we have networks that lose less than one packet in ten million.) We have built the boxes now. I have started with back-to-back testing with large window sizes. Back-to-back testing is believed to be valid because it's hard to expect that inserting 70ms delay between the host will make the situation any better. I cannot get it to run with window sizes greater than half a megabyte. The story, with some very preliminary analysis, is at http://www.internet2.edu/~shalunov/gigatcp/ I'm not reposting it here; there are 29KB of text and 3MB of data there. I'm adding and updating stuff as I progress. The questions that I have for you guys are, in decreasing order of importance: 1. How do I fix the ti driver problem that apparently is holding me back? What number of jumbo slots would be "good"? 2. Why doesn't Fast Retransmit kick in? (See the annotated sender's view of the stalled connection.) 3. Is there an off-by-one error in RST handling? (See the end of the annotated receiver's view of the stalled connection.) -- Stanislav Shalunov http://www.internet2.edu/~shalunov/ "Nuclear war would really set back cable [television]." -- Ted Turner To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-net" in the body of the message