From owner-freebsd-performance@FreeBSD.ORG Mon Jan 23 21:23:42 2012 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B5E0E1065673 for ; Mon, 23 Jan 2012 21:23:42 +0000 (UTC) (envelope-from mmarkowski@leon.pl) Received: from kameleon.leon.pl (kameleon.leon.pl [IPv6:2a02:c40:0:10::5bc3:8704]) by mx1.freebsd.org (Postfix) with ESMTP id 486388FC1E for ; Mon, 23 Jan 2012 21:23:42 +0000 (UTC) Received: by kameleon.leon.pl (Postfix, from userid 1080) id BB928358C5B; Mon, 23 Jan 2012 22:23:40 +0100 (CET) To: Jack Vogel X-PHP-Script: mail.leon.pl/index.php for 188.137.111.246 X-PHP-Originating-Script: 1080:main.inc MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit Date: Mon, 23 Jan 2012 22:23:40 +0100 From: Marcin Markowski In-Reply-To: References: Message-ID: <0bcfb39775599ec4be04a710040dab80@leon.pl> X-Sender: mmarkowski@leon.pl User-Agent: Roundcube Webmail/0.6 Cc: freebsd-performance@freebsd.org Subject: Re: Performance problem using Intel X520-DA2 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Jan 2012 21:23:42 -0000 Hi Jack, Thank You for Your answer. I forgot to mention that if the program will run for more than 30-40 sec. server loses connection to the internet. I'm not sure if problem isnt with MSI-X, because NIC (82575EB - igb driver) used for the internet is also using MSI-X. Disabling MSI-X for ixgbe or switching on old NIC (82571EB - em driver) fixes issue (I'm unable to disable MSI-X on igb because the watchdog resets the card if using only MSI). -- Marcin Markowski On 23.01.2012 21:25, Jack Vogel wrote: > There may be some interrupt handling changes coming, but at least for > the moment you need to increase the storm threshold, or set it to 0 > to > disable it. > > Jack > > On Mon, Jan 23, 2012 at 12:20 PM, Marcin Markowski wrote: > >>  Hello, >> >> We use FreeBSD as sniffer (libpcap programs) and we experience >> performance problems when incoming traffic is greater than >> 7.5Gbps/s. >> If we check top we see that first irq from network card is using >> 100% CPU. Ive tested this on FreeBSD 8.2-RELEASE and 9.0-RELEASE >> (on 9.0 we can see also kernel thread named {ix0 que} using 100% >> CPU), >> and both systems behave the same. In logs we see also: >> interrupt storm detected on "irq268:"; throttling interrupt source >> >> Our server platform is Intel SR2600URBRP, 2x Xeon X5650, 6GB RAM >> and >> NIC Intel X520-DA2. >> >> Im not sure if problem is with NIC or motherboard in SR2600URBRP, >> because everything is fine when we use other server configuration: >> Intel SR1630GP, 1x Xeon X3450, 8GB RAM, NIC X520-DA2 >> >> My /boot/loader.conf: >> kern.ipc.nmbclusters=262144 >> hw.ixgbe.rxd=2048 >> hw.ixgbe.txd=2048 >> hw.ixgbe.num_queues=16 >> >> /etc/sysctl.conf >> hw.intr_storm_threshold=10000 >> >> -- >> Marcin Markowski