From owner-freebsd-pf@FreeBSD.ORG Thu Jan 27 17:31:57 2011 Return-Path: Delivered-To: freebsd-pf@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 52A1C1065670; Thu, 27 Jan 2011 17:31:57 +0000 (UTC) (envelope-from ml@my.gd) Received: from mail-fx0-f54.google.com (mail-fx0-f54.google.com [209.85.161.54]) by mx1.freebsd.org (Postfix) with ESMTP id BCBEE8FC17; Thu, 27 Jan 2011 17:31:56 +0000 (UTC) Received: by fxm16 with SMTP id 16so2505281fxm.13 for ; Thu, 27 Jan 2011 09:31:55 -0800 (PST) Received: by 10.223.73.206 with SMTP id r14mr1169451faj.126.1296149492773; Thu, 27 Jan 2011 09:31:32 -0800 (PST) Received: from dfleuriot.local ([83.167.62.196]) by mx.google.com with ESMTPS id r24sm6084315fax.27.2011.01.27.09.31.30 (version=SSLv3 cipher=RC4-MD5); Thu, 27 Jan 2011 09:31:31 -0800 (PST) Message-ID: <4D41ABF1.1010405@my.gd> Date: Thu, 27 Jan 2011 18:31:29 +0100 From: Damien Fleuriot User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.13) Gecko/20101207 Thunderbird/3.1.7 MIME-Version: 1.0 To: Jeremy Chadwick References: <4D41417A.20904@my.gd> <20110127172724.GA36587@icarus.home.lan> In-Reply-To: <20110127172724.GA36587@icarus.home.lan> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: freebsd-stable@freebsd.org, "Vogel, Jack" , freebsd-pf@freebsd.org Subject: Re: High interrupt rate on a PF box + performance X-BeenThere: freebsd-pf@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: "Technical discussion and general questions about packet filter \(pf\)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 27 Jan 2011 17:31:57 -0000 On 1/27/11 6:27 PM, Jeremy Chadwick wrote: > On Thu, Jan 27, 2011 at 10:57:14AM +0100, Damien Fleuriot wrote: >> Hello list, >> >> I have a problem with interrupts, network cards, and PF performance. >> >> We have 2 firewalls running FreeBSD 8.0 for the current master and >> FreeBSD 8.1 for the backup host, which I upgraded just yesterday. >> >> [...] >> >> vmstat -i >> --- >> interrupt total rate >> irq14: ata0 36 0 >> irq16: mfi0 353244 1 >> irq21: uhci0 uhci+ 461504 1 >> cpu0: timer 615183815 1996 >> irq256: bce0 1015412475 3295 >> irq257: igb0 1067318584 3464 >> irq258: igb0 695648752 2258 >> irq259: igb0 2 0 >> irq260: igb1 11503857 37 >> irq261: igb1 506598 1 >> irq262: igb1 69 0 >> irq269: bce1 790820 2 >> cpu1: timer 615183757 1996 >> cpu2: timer 615197165 1996 >> cpu3: timer 615197165 1996 >> Total 5252757843 17050 > > There are changes to the igb(4) driver which are in RELENG_8 (8-STABLE), > and some which will be in the upcoming 8.2-RELEASE, which may address > this. Jack Vogel of Intel would be able to confirm for sure; CC'ing him > here. > > Could you please provide output from the following commands? > > * pciconf -lvcb (only include igbX entries, thanks) > * sysctl -a | grep msi > > Thanks. > > I can't help with the CARP-related issues or other stuff you're > experiencing. These issues may all be separate problems, hard to say. > igb0@pci0:14:0:0: class=0x020000 card=0x145a8086 chip=0x10d68086 rev=0x02 hdr=0x00 igb1@pci0:14:0:1: class=0x020000 card=0x145a8086 chip=0x10d68086 rev=0x02 hdr=0x00 igb2@pci0:15:0:0: class=0x020000 card=0x145a8086 chip=0x10d68086 rev=0x02 hdr=0x00 igb3@pci0:15:0:1: class=0x020000 card=0x145a8086 chip=0x10d68086 rev=0x02 hdr=0x00 hw.bce.msi_enable: 1 hw.pci.honor_msi_blacklist: 1 hw.pci.enable_msix: 1 hw.pci.enable_msi: 1 igb0: flags=8943 metric 0 mtu 1500 options=13b ether 00:1b:21:12:ec:38 inet [snip] netmask 0xffffffc0 broadcast [snip] media: Ethernet autoselect (1000baseT ) status: active igb1: flags=8843 metric 0 mtu 1500 options=13b ether 00:1b:21:12:ec:39 inet 10.0.0.252 netmask 0xffffff00 broadcast 10.0.0.255 media: Ethernet autoselect (1000baseT ) status: active Here you go :) Note that the igb2 and 3 interfaces are unused, unplugged, unconfigured