From owner-freebsd-net@FreeBSD.ORG Thu Nov 11 19:09:43 2010 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4C13A106564A for ; Thu, 11 Nov 2010 19:09:43 +0000 (UTC) (envelope-from "."@babolo.ru) Received: from smtp1.babolo.ru (smtp1.babolo.ru [195.9.14.139]) by mx1.freebsd.org (Postfix) with ESMTP id C73FF8FC17 for ; Thu, 11 Nov 2010 19:09:42 +0000 (UTC) Received: from cicuta.babolo.ru ([194.58.246.5]) by smtp1.babolo.ru (8.14.2/8.14.2) with SMTP id oABIssuQ048200 for ; Thu, 11 Nov 2010 21:54:54 +0300 (MSK) (envelope-from .@babolo.ru) Received: (nullmailer pid 40653 invoked by uid 136); Thu, 11 Nov 2010 18:58:12 -0000 Date: Thu, 11 Nov 2010 21:58:12 +0300 From: Aleksandr A Babaylov <.@babolo.ru> To: freebsd-net@freebsd.org Message-ID: <20101111185812.GA40610@babolo.ru> References: <20101110110428.GA3505@traktor.dnepro.net> <20101111104952.GA11275@traktor.dnepro.net> <20101111180539.GC11275@traktor.dnepro.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20101111180539.GC11275@traktor.dnepro.net> Subject: Re: igb dual-port adapter 1200Mbps limit - what to tune? X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Nov 2010 19:09:43 -0000 On Thu, Nov 11, 2010 at 08:05:40PM +0200, Eugene Perevyazko wrote: > On Thu, Nov 11, 2010 at 12:49:52PM +0200, Eugene Perevyazko wrote: > > On Thu, Nov 11, 2010 at 01:47:02AM +0100, Ivan Voras wrote: > > > On 11/10/10 12:04, Eugene Perevyazko wrote: > > > > > > >Tried 2 queues and 1 queue per iface, neither hitting cpu limit. > > > > > > Are you sure you are not hitting the CPU limit on individual cores? Have > > > you tried running "top -H -S"? > > > > > Sure, even with 1queue per iface load is 40-60% on busy core, with 2 queues it was much lower. > > Now I've got the module for mb with 2 more ports, going to see if it helps. > The IO module has em interfaces on it and somehow I've already got 2 panics > after moving one of vlans to it. > > In the mean time, can someone explain me what is processed by threads marked > like "irq256: igb0" and "igb0 que". May be understanding this will let me > pin those threads to cores more optimally. > There are (hw.igb.num_queues+1) "irq" threads and (hw.igb.num_queues) > "que" threads. Now I just pin them sequentially to even cores (odd ones are HT). As far as I understand, you are not right about HT cores. Try switch HT off and do not use HT in routers in usual cases. > Now I use hw.igb.num_queues=2, and with traffic limited to 1200Mbits the busiest core is still 60% idle... > > > > -- > Eugene Perevyazko > _______________________________________________ > freebsd-net@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"