From owner-freebsd-net@FreeBSD.ORG  Wed Jan 21 09:16:59 2004
Return-Path: <owner-freebsd-net@FreeBSD.ORG>
Delivered-To: freebsd-net@freebsd.org
Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125])
	by hub.freebsd.org (Postfix) with ESMTP
	id 62A9C16A4CE; Wed, 21 Jan 2004 09:16:59 -0800 (PST)
Received: from duke.cs.duke.edu (duke.cs.duke.edu [152.3.140.1])
	by mx1.FreeBSD.org (Postfix) with ESMTP
	id 1D79843D1D; Wed, 21 Jan 2004 09:16:58 -0800 (PST)
	(envelope-from gallatin@cs.duke.edu)
Received: from grasshopper.cs.duke.edu (grasshopper.cs.duke.edu
	[152.3.145.30])
	by duke.cs.duke.edu (8.12.10/8.12.10) with ESMTP id i0LHGq5P018692
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO);
	Wed, 21 Jan 2004 12:16:52 -0500 (EST)
Received: (from gallatin@localhost)
	by grasshopper.cs.duke.edu (8.12.9p2/8.12.9/Submit) id i0LHGlbu099388;
	Wed, 21 Jan 2004 12:16:47 -0500 (EST)
	(envelope-from gallatin)
From: Andrew Gallatin <gallatin@cs.duke.edu>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit
Message-ID: <16398.46079.127565.221708@grasshopper.cs.duke.edu>
Date: Wed, 21 Jan 2004 12:16:47 -0500 (EST)
To: Andre Oppermann <andre@freebsd.org>
In-Reply-To: <400D9271.1259CBC8@freebsd.org>
References: <16397.36782.415899.626311@grasshopper.cs.duke.edu>
	<400D9271.1259CBC8@freebsd.org>
X-Mailer: VM 6.75 under 21.1 (patch 12) "Channel Islands" XEmacs Lucid
cc: freebsd-net@freebsd.org
cc: dab@cray.com
Subject: Re: tcp mss MCLBYTES restriction
X-BeenThere: freebsd-net@freebsd.org
X-Mailman-Version: 2.1.1
Precedence: list
List-Id: Networking and TCP/IP with FreeBSD <freebsd-net.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-net>,
	<mailto:freebsd-net-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-net>
List-Post: <mailto:freebsd-net@freebsd.org>
List-Help: <mailto:freebsd-net-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-net>,
	<mailto:freebsd-net-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Wed, 21 Jan 2004 17:16:59 -0000


Andre Oppermann writes:
 > 
 > Could you run some bechmarks with the current MCLBYTES rounding
 > and without it on 100Mbit 1.5kMTU and GigE with 9k MTU?

David Borman is totally right.   Clipping the mss is really worth it,
especially with zero-copy sockets.   Forget I said anything.

Here is some data I just took..  Send and receiver are 3GHz P4s.
Test is netperf -- -S131072 -s131072.  Sender is running current
as of Saturday.  Receiver is running 4.9-Release.

"em" is Intel(R) PRO/1000 Network Connection, Version - 1.7.19
"myri" is a M3F2-PCIXE-2. (4Gb/s).

NIC    mtu     BW     %cpu	mss_truncate	zero_copy
       (bytes) (Mb/s) 
----   ------  -----  ----	-----		------
em     16114   727    12.8	0		0
em     16114   730    15.2	1		0
em     16114   728    12.4	0		1
em     16114   743     7.3	1		1
em     9000    870    19.2	0		0
em     9000    900    21.6	1		0
em     9000    867    18.2	0		1
em     9000    845     8.9	1		1
myri   9000    1972   69.0	0		0
myri   9000    2312   68.6	1		0
myri   9000    2609   56.3	0		1
myri   9000    3009   52.3	1		1



Drew