From owner-freebsd-net@FreeBSD.ORG Tue Jan 24 08:18:43 2012 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id AB1E2106564A for ; Tue, 24 Jan 2012 08:18:43 +0000 (UTC) (envelope-from ndenev@gmail.com) Received: from mail-ee0-f54.google.com (mail-ee0-f54.google.com [74.125.83.54]) by mx1.freebsd.org (Postfix) with ESMTP id 3BECD8FC0C for ; Tue, 24 Jan 2012 08:18:42 +0000 (UTC) Received: by eekb47 with SMTP id b47so1597159eek.13 for ; Tue, 24 Jan 2012 00:18:41 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=subject:mime-version:content-type:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to:x-mailer; bh=GbSl7/uW0VfMNZvf5Z3TxlWdLa4BjHexZyOOLPxxrPE=; b=ujYQpS04GJRuXcUkPKmSvl9IwM1ANG2maZkPqpbDz1O5OR3W9N+sofzGyjaPD90LAc 5huW5LzqcMMJ92dB2EEpUvoJJNj4jG/u4qf4rCH/JQfqHIXa3ErDBVZ44ZeA8O+utw77 IX+xYJcXSHU7rlB/xeYe159rnahU7zlsKG1k4= Received: by 10.14.127.16 with SMTP id c16mr4294257eei.35.1327393121136; Tue, 24 Jan 2012 00:18:41 -0800 (PST) Received: from ndenevsa.sf.moneybookers.net (g1.moneybookers.com. [217.18.249.148]) by mx.google.com with ESMTPS id x4sm64696959eeb.4.2012.01.24.00.18.39 (version=TLSv1/SSLv3 cipher=OTHER); Tue, 24 Jan 2012 00:18:40 -0800 (PST) Mime-Version: 1.0 (Apple Message framework v1251.1) Content-Type: text/plain; charset=us-ascii From: Nikolay Denev In-Reply-To: <159d4fbce722663a84f3cea12da828a5@leon.pl> Date: Tue, 24 Jan 2012 10:18:38 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: <6A254A40-7DA5-4EFE-93C5-4E084F33B78A@gmail.com> References: <159d4fbce722663a84f3cea12da828a5@leon.pl> To: Marcin Markowski X-Mailer: Apple Mail (2.1251.1) Cc: freebsd-net@freebsd.org Subject: Re: Performance problem using Intel X520-DA2 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 Jan 2012 08:18:43 -0000 On Jan 23, 2012, at 11:39 PM, Marcin Markowski wrote: > Hello, >=20 > This message has been sent to freebsd-performance@ but got > the information that should contact also with freebsd-net@. >=20 > We use FreeBSD as sniffer (libpcap programs) and we experience > performance problems when incoming traffic is greater than 7.5Gbps/s. > If we check 'top' we see that first irq from network card is using > 100% CPU. I've tested this on FreeBSD 8.2-RELEASE and 9.0-RELEASE > (on 9.0 we can see also kernel thread named {ix0 que} using 100% CPU), > and both systems behave the same. In logs we see also: > interrupt storm detected on "irq268:"; throttling interrupt source >=20 > Our server platform is Intel SR2600URBRP, 2x Xeon X5650, 6GB RAM and > NIC Intel X520-DA2. >=20 > I'm not sure if problem is with NIC or motherboard in SR2600URBRP, > because everything is fine when we use other server configuration: > Intel SR1630GP, 1x Xeon X3450, 8GB RAM, NIC X520-DA2 >=20 > My /boot/loader.conf: > kern.ipc.nmbclusters=3D262144 > hw.ixgbe.rxd=3D2048 > hw.ixgbe.txd=3D2048 > hw.ixgbe.num_queues=3D16 >=20 > /etc/sysctl.conf > hw.intr_storm_threshold=3D10000 >=20 > --=20 > Marcin Markowski Hi, Maybe you want to take a loot at NETMAP : = http://info.iet.unipi.it/~luigi/netmap/ There is a libpcap wrapper library, so you can use it with unchanged = pcap consumers, and get great performance increase. I'm not sure that the patches are updated for 8 and 9 though, since the = initial commit to HEAD there were several related changes. P.S.: It is important also what is you packet rate, since 7.5Gbps with = jumbo packets or 64 byte packets are very different things :) Regards, Nikolay