From owner-freebsd-performance@FreeBSD.ORG  Tue Jul  3 16:35:49 2012
Return-Path: <owner-freebsd-performance@FreeBSD.ORG>
Delivered-To: performance@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id 06444106564A;
	Tue,  3 Jul 2012 16:35:49 +0000 (UTC)
	(envelope-from luigi@onelab2.iet.unipi.it)
Received: from onelab2.iet.unipi.it (onelab2.iet.unipi.it [131.114.59.238])
	by mx1.freebsd.org (Postfix) with ESMTP id B85F88FC14;
	Tue,  3 Jul 2012 16:35:48 +0000 (UTC)
Received: by onelab2.iet.unipi.it (Postfix, from userid 275)
	id EB07573027; Tue,  3 Jul 2012 18:55:06 +0200 (CEST)
Date: Tue, 3 Jul 2012 18:55:06 +0200
From: Luigi Rizzo <rizzo@iet.unipi.it>
To: "Alexander V. Chernikov" <melifaro@freebsd.org>
Message-ID: <20120703165506.GA90114@onelab2.iet.unipi.it>
References: <4FF319A2.6070905@FreeBSD.org>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <4FF319A2.6070905@FreeBSD.org>
User-Agent: Mutt/1.4.2.3i
X-Mailman-Approved-At: Tue, 03 Jul 2012 16:43:17 +0000
Cc: hackers@freebsd.org, performance@freebsd.org, net@freebsd.org
Subject: Re: FreeBSD 10G forwarding performance @Intel
X-BeenThere: freebsd-performance@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Performance/tuning <freebsd-performance.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-performance>,
	<mailto:freebsd-performance-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-performance>
List-Post: <mailto:freebsd-performance@freebsd.org>
List-Help: <mailto:freebsd-performance-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-performance>,
	<mailto:freebsd-performance-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Tue, 03 Jul 2012 16:35:49 -0000

On Tue, Jul 03, 2012 at 08:11:14PM +0400, Alexander V. Chernikov wrote:
> Hello list!
> 
> I'm quite stuck with bad forwarding performance on many FreeBSD boxes 
> doing firewalling.
...
> In most cases system can forward no more than 700 (or 1400) kpps which 
> is quite a bad number (Linux does, say, 5MPPs on nearly the same hardware).

among the many interesting tests you have run, i am curious
if you have tried to remove the update of the counters on route
entries. They might be another severe contention point.

cheers
luigi