From owner-freebsd-net@FreeBSD.ORG  Fri Dec 12 23:44:28 2003
Return-Path: <owner-freebsd-net@FreeBSD.ORG>
Delivered-To: freebsd-net@freebsd.org
Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125])
	by hub.freebsd.org (Postfix) with ESMTP id D0B6F16A4CE
	for <net@freebsd.org>; Fri, 12 Dec 2003 23:44:28 -0800 (PST)
Received: from www.svzserv.kemerovo.su (www.svzserv.kemerovo.su
	[213.184.65.80])
	by mx1.FreeBSD.org (Postfix) with ESMTP id 15DD143D32
	for <net@freebsd.org>; Fri, 12 Dec 2003 23:44:27 -0800 (PST)
	(envelope-from eugen@www.svzserv.kemerovo.su)
Received: from www.svzserv.kemerovo.su (eugen@localhost [127.0.0.1])
	hBD7iOjL015773;	Sat, 13 Dec 2003 14:44:24 +0700 (KRAT)
	(envelope-from eugen@www.svzserv.kemerovo.su)
Received: (from eugen@localhost)
	by www.svzserv.kemerovo.su (8.12.10/8.12.10/Submit) id hBD7iOoM015771;
	Sat, 13 Dec 2003 14:44:24 +0700 (KRAT)
	(envelope-from eugen)
Date: Sat, 13 Dec 2003 14:44:24 +0700
From: Eugene Grosbein <eugen@grosbein.pp.ru>
To: Clark Gaylord <cgaylord@vt.edu>
Message-ID: <20031213074423.GA2249@svzserv.kemerovo.su>
References: <20031213054654.GA850@grosbein.pp.ru> <3FDAAC5B.5030008@vt.edu>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <3FDAAC5B.5030008@vt.edu>
User-Agent: Mutt/1.4i
cc: net@freebsd.org
Subject: Re: how to saturate 100Mbit
X-BeenThere: freebsd-net@freebsd.org
X-Mailman-Version: 2.1.1
Precedence: list
List-Id: Networking and TCP/IP with FreeBSD <freebsd-net.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-net>,
	<mailto:freebsd-net-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-net>
List-Post: <mailto:freebsd-net@freebsd.org>
List-Help: <mailto:freebsd-net-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-net>,
	<mailto:freebsd-net-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Sat, 13 Dec 2003 07:44:28 -0000

On Sat, Dec 13, 2003 at 01:06:19AM -0500, Clark Gaylord wrote:

> >Is it possible to saturate 100Mbit ethernet using FreeBSD 4.9-STABLE,
> >Pentium-133 & Intel 430VX-based motherboard (PCI-33),
> >Intel 82559 Pro/100 Ethernet (fxp) ? 
> >I tried to use sendfile(2) on /dev/zero but that does not work.
> >Then I created 8Tb holey file and used sendfile() on it.
> >That gave 100% CPU load and only 37Mbit/s on wire.
> I usually use ttcp for tcp throughput measurement.  You may not be able 
> to do 100Mbps, due to tcp-ness, but it has a udp mode as well.  Depends 
> on what you are interested in doing.  But ttcp is pretty low impact. 
> Also, when you use it, boost the buffersize; this can help performance 
> (and lower cpu hit) considerably.

Will ttcp or iperf use zero-copy mechanics like sendfile(2) or
they will make CPU load by copying from/to kernel space?

I made another attempt: set sendspace/recvspace for TCP/UDP to 65536,
mounted filesystem using NFS over UDP with -r 65536, -w 65536
and ran from NFS client:

dd if=holey-file of=/dev/null bs=10m

I've got about 30% of CPU load for the server (P-133) and less than
35mbit/s on wire.

Eugene Grosbein