From owner-freebsd-stable@FreeBSD.ORG Thu Jan 27 10:48:38 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 6DD17106564A; Thu, 27 Jan 2011 10:48:38 +0000 (UTC) (envelope-from ml@my.gd) Received: from mail-gx0-f182.google.com (mail-gx0-f182.google.com [209.85.161.182]) by mx1.freebsd.org (Postfix) with ESMTP id 1E15A8FC0A; Thu, 27 Jan 2011 10:48:37 +0000 (UTC) Received: by gxk8 with SMTP id 8so578466gxk.13 for ; Thu, 27 Jan 2011 02:48:37 -0800 (PST) Received: by 10.100.105.16 with SMTP id d16mr461544anc.219.1296125316863; Thu, 27 Jan 2011 02:48:36 -0800 (PST) Received: from dfleuriot.technique-admin.paris.hi-media-techno.com ([83.167.62.196]) by mx.google.com with ESMTPS id f10sm20287328anh.5.2011.01.27.02.48.34 (version=SSLv3 cipher=RC4-MD5); Thu, 27 Jan 2011 02:48:35 -0800 (PST) Message-ID: <4D414D80.3060706@my.gd> Date: Thu, 27 Jan 2011 11:48:32 +0100 From: Damien Fleuriot User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.13) Gecko/20101207 Thunderbird/3.1.7 MIME-Version: 1.0 To: Bartosz Stec References: <4D41417A.20904@my.gd> <4D414304.3090905@it4pro.pl> In-Reply-To: <4D414304.3090905@it4pro.pl> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: "freebsd-stable@freebsd.org" , freebsd-pf@freebsd.org Subject: Re: High interrupt rate on a PF box + performance X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 27 Jan 2011 10:48:38 -0000 On 1/27/11 11:03 AM, Bartosz Stec wrote: > W dniu 2011-01-27 10:57, Damien Fleuriot pisze: >> Hello list, >> >> I have a problem with interrupts, network cards, and PF performance. >> > I think you should try with polling(4) enabled and probably increase > kernel.hz i sysctl.conf :) > As a matter of fact, we tried polling on the backup firewall yesterday with the following kernel options: options DEVICE_POLLING options HZ=1000 This had disastrous results. First, our LAN and DMZ interfaces (bce0 and 1) do not support polling, so no change here. Second, the WAN interface (igb0) supports polling but that caused problems with carp0 and the physical interface resetting itself for god knows what reason: carp0: link state changed to DOWN carp0: INIT -> BACKUP igb0: link state changed to UP carp0: link state changed to DOWN carp0: link state changed to UP carp0: MASTER -> BACKUP (more frequent advertisement received) carp0: link state changed to DOWN carp0: link state changed to UP igb0: Watchdog timeout -- resetting igb0: Queue(1) tdh = 57, hw tdt = 57 igb0: TX(1) desc avail = 967,Next TX to Clean = 0 igb0: link state changed to DOWN carp0: link state changed to DOWN carp0: INIT -> BACKUP igb0: link state changed to UP carp0: link state changed to DOWN carp0: link state changed to UP carp0: link state changed to DOWN igb0: Watchdog timeout -- resetting igb0: Queue(3) tdh = 5, hw tdt = 5 igb0: TX(3) desc avail = 1019,Next TX to Clean = 0 igb0: link state changed to DOWN igb0: link state changed to UP igb0: Watchdog timeout -- resetting igb0: Queue(2) tdh = 53, hw tdt = 53 igb0: TX(2) desc avail = 971,Next TX to Clean = 0 igb0: link state changed to DOWN igb0: link state changed to UP igb0: Watchdog timeout -- resetting igb0: Queue(2) tdh = 19, hw tdt = 19 igb0: TX(2) desc avail = 1005,Next TX to Clean = 0 igb0: link state changed to DOWN igb0: link state changed to UP