From owner-freebsd-net@FreeBSD.ORG  Wed Oct  3 23:18:54 2007
Return-Path: <owner-freebsd-net@FreeBSD.ORG>
Delivered-To: freebsd-net@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id A6B3216A418
	for <freebsd-net@freebsd.org>; Wed,  3 Oct 2007 23:18:54 +0000 (UTC)
	(envelope-from lists@codeangels.com)
Received: from mail.codeangels.com (mail.codeangels.com [80.238.223.10])
	by mx1.freebsd.org (Postfix) with ESMTP id 145A113C45D
	for <freebsd-net@freebsd.org>; Wed,  3 Oct 2007 23:18:53 +0000 (UTC)
	(envelope-from lists@codeangels.com)
Received: (qmail-ldap/ctrl 648 invoked from network); 3 Oct 2007 22:52:11 -0000
Received: from monkey.codeangels.com (HELO www.codeangels.com)
	(jraslk@[192.168.5.6]) (envelope-sender <lists@codeangels.com>)
	by monkey.codeangels.com (qmail-ldap-1.03) with SMTP
	for <cristi@net.utcluj.ro>; 3 Oct 2007 22:52:11 -0000
Message-ID: <4532.192.168.2.137.1191451931.squirrel@www.codeangels.com>
In-Reply-To: <4703F9C3.2060601@net.utcluj.ro>
References: <4703F9C3.2060601@net.utcluj.ro>
Date: Thu, 4 Oct 2007 00:52:11 +0200 (CEST)
From: "Kirill Ponazdyr" <lists@codeangels.com>
To: "Cristian KLEIN" <cristi@net.utcluj.ro>
User-Agent: SquirrelMail/Codeangels_GEN
MIME-Version: 1.0
Content-Type: text/plain;charset=iso-8859-1
X-Priority: 3
Importance: Normal
Cc: freebsd-net@freebsd.org
Subject: Re: FreeBSD as a gigabit router
X-BeenThere: freebsd-net@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
Reply-To: lists@codeangels.com
List-Id: Networking and TCP/IP with FreeBSD <freebsd-net.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-net>,
	<mailto:freebsd-net-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-net>
List-Post: <mailto:freebsd-net@freebsd.org>
List-Help: <mailto:freebsd-net-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-net>,
	<mailto:freebsd-net-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Wed, 03 Oct 2007 23:18:54 -0000

> Hi list,
>
> A few days ago I tested whether a FreeBSD 7 box is able to handle Gigabit
> Can anybody point me what the bottleneck of this configuration is? CPU was
> mostly idle and PCIe 1x should carry way more. Or is the experiment
> perhaps
> fundamentally flawed?

ICMP is not a good way to perform such tests as many have mentioned,
better use iperf.

We have a FreeBSD 6.2 / pf box handling 2Gbps of traffic, real traffic, it
will probably handle more, we just had no capacities or need to test.

Hardware is a Single 2.4 Ghz Xeon with 2 x Intel Quad Pro 1000MT PCI-X
Controllers on separate PCI-X Busses.

Here are most optimal options:

Kernel:
------------------------------------
options         DEVICE_POLLING
options         HZ=2000

Sysctl:
------------------------------------
kern.polling.idle_poll=1
kern.polling.user_frac=20
net.inet.ip.fastforwarding=1
net.inet.ip.intr_queue_maxlen=5000
kern.ipc.maxsockbuf=8388608
net.inet.tcp.sendspace=3217968
net.inet.tcp.recvspace=3217968
net.inet.tcp.rfc1323=1

Regards

Kirill