From owner-freebsd-net@FreeBSD.ORG Fri Feb 10 18:06:41 2006 Return-Path: X-Original-To: freebsd-net@freebsd.org Delivered-To: freebsd-net@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 0B72C16A420 for ; Fri, 10 Feb 2006 18:06:41 +0000 (GMT) (envelope-from cswiger@mac.com) Received: from pi.codefab.com (pi.codefab.com [199.103.21.227]) by mx1.FreeBSD.org (Postfix) with ESMTP id 99F8843D46 for ; Fri, 10 Feb 2006 18:06:40 +0000 (GMT) (envelope-from cswiger@mac.com) Received: from localhost (localhost [127.0.0.1]) by pi.codefab.com (Postfix) with ESMTP id DC0C85CB6; Fri, 10 Feb 2006 13:06:39 -0500 (EST) Received: from pi.codefab.com ([127.0.0.1]) by localhost (pi.codefab.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 52580-01; Fri, 10 Feb 2006 13:06:38 -0500 (EST) Received: from [192.168.1.3] (pool-68-160-209-142.ny325.east.verizon.net [68.160.209.142]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by pi.codefab.com (Postfix) with ESMTP id 9B02D5C50; Fri, 10 Feb 2006 13:06:38 -0500 (EST) Message-ID: <43ECD636.3070403@mac.com> Date: Fri, 10 Feb 2006 13:06:46 -0500 From: Chuck Swiger Organization: The Courts of Chaos User-Agent: Thunderbird 1.5 (Windows/20051201) MIME-Version: 1.0 To: Marcos Bedinelli References: <7bb8f24157080b6aaacb897a99259df9@madhaus.cns.utoronto.ca> <43ECB1E7.8010308@mac.com> <711b7ec873f31bc5be50ce477313fac3@madhaus.cns.utoronto.ca> In-Reply-To: <711b7ec873f31bc5be50ce477313fac3@madhaus.cns.utoronto.ca> X-Enigmail-Version: 0.94.0.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Virus-Scanned: amavisd-new at codefab.com Cc: freebsd-net@freebsd.org Subject: Re: Network performance in a dual CPU system X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Feb 2006 18:06:41 -0000 Marcos Bedinelli wrote: [ ... ] > mull [~]$vmstat -i > interrupt total rate > irq1: atkbd0 3466 0 > irq6: fdc0 10 0 > irq13: npx0 1 0 > irq14: ata0 47 0 > irq21: fxp1 20462527 8 > irq28: bge0 3511765157 1444 > irq29: bge1 3633124373 1494 > irq30: aac0 1842472 0 > cpu0: timer 566751007 233 > Total 7733949060 3181 Interesting, what do you have HZ ("sysctl kern.clockrate") set to? Does setting it to somewhere around 500, 1000, or 2000 help? You're definitely going to want to increase HZ if you enable polling mode... > mull [~]$netstat -m > 644/646/1290 mbufs in use (current/cache/total) > 643/407/1050/17088 mbuf clusters in use (current/cache/total/max) > 0/5/4528 sfbufs in use (current/peak/max) > 1447K/975K/2422K bytes allocated to network (current/cache/total) > 0 requests for sfbufs denied > 0 requests for sfbufs delayed > 0 requests for I/O initiated by sendfile > 0 calls to protocol drain routines You might try increasing the # of kern.ipc.nmbclusters, say by a factor of 2. This may not help much, seems like you're bottlenecking servicing the bge interrupts. I assume you've read "man tuning" and do not have something like WITNESS enabled in your kernel? :-) -- -Chuck