From owner-freebsd-performance@FreeBSD.ORG  Wed Jan 25 20:50:51 2012
Return-Path: <owner-freebsd-performance@FreeBSD.ORG>
Delivered-To: freebsd-performance@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id D33701065675
	for <freebsd-performance@freebsd.org>;
	Wed, 25 Jan 2012 20:50:51 +0000 (UTC)
	(envelope-from mmarkowski@leon.pl)
Received: from kameleon.leon.pl (kameleon.leon.pl
	[IPv6:2a02:c40:0:10::5bc3:8704])
	by mx1.freebsd.org (Postfix) with ESMTP id 63C208FC0A
	for <freebsd-performance@freebsd.org>;
	Wed, 25 Jan 2012 20:50:51 +0000 (UTC)
Received: by kameleon.leon.pl (Postfix, from userid 1080)
	id A9557358C5D; Wed, 25 Jan 2012 21:50:48 +0100 (CET)
To: <freebsd-performance@freebsd.org>
X-PHP-Script: mail.leon.pl/index.php for 188.137.111.246
X-PHP-Originating-Script: 1080:main.inc
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8;
 format=flowed
Content-Transfer-Encoding: 7bit
Date: Wed, 25 Jan 2012 21:50:48 +0100
From: Marcin Markowski <mmarkowski@leon.pl>
In-Reply-To: <D048333F-BF93-4A2E-8081-F5AC39C09B35@gmail.com>
References: <a231a44c6c803075c7b456a6189ff6ce@leon.pl>
	<CAFOYbcksi7KBpEjH=-hHEoTr35ynwYk98Ushw9nzR27H+GVBFA@mail.gmail.com>
	<jfmbam$37c$1@dough.gmane.org>
	<909994c3cdd84cb2c47ff8037c23e142@leon.pl>
	<jfoqr8$mld$1@dough.gmane.org>
	<D048333F-BF93-4A2E-8081-F5AC39C09B35@gmail.com>
Message-ID: <94bb160090e45c85083176023a278f85@leon.pl>
X-Sender: mmarkowski@leon.pl
User-Agent: Roundcube Webmail/0.6
Subject: Re: Performance problem using Intel X520-DA2
X-BeenThere: freebsd-performance@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Performance/tuning <freebsd-performance.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-performance>,
	<mailto:freebsd-performance-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-performance>
List-Post: <mailto:freebsd-performance@freebsd.org>
List-Help: <mailto:freebsd-performance-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-performance>,
	<mailto:freebsd-performance-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Wed, 25 Jan 2012 20:50:51 -0000

On 25.01.2012 14:18, Nikolay Denev wrote:
> On Jan 25, 2012, at 1:59 PM, Ivan Voras wrote:
>
>> On 24/01/2012 17:53, Marcin Markowski wrote:
>>> On 24.01.2012 14:22, Ivan Voras wrote:
>>>>> On Mon, Jan 23, 2012 at 12:20 PM, Marcin
>>>>> Markowski<mmarkowski@leon.pl>wrote:
>>>>
>>>>>> (on 9.0 we can see also kernel thread named {ix0 que} using 100% 
>>>>>> CPU),
>>>>
>>>>>> hw.ixgbe.num_queues=16
>>>>
>>>> If there really are 16 hardware queues, shouldn't there be 16 
>>>> kernel
>>>> threads for queue processing?
>>>
>>> There are 16 threads, but only one of them consumes 100% CPU and 
>>> the others
>>> do not use more than 5% CPU:
>>>
>>> http://pastebin.com/BWDWh8kW
>>
>> You need Jack to confirm it but this looks like a serious problem / 
>> bottleneck. It just shouldn't be like that (if the test is exactly the 
>> same).
>>
>
> Is this by any chance non-IP traffic (or encapsulated in some way).
> I remember similar thread :
> 
> http://freebsd.1045724.n5.nabble.com/igb-ixgbe-RSS-RX-queues-for-non-IP-traffic-td4778961.html

Most of the traffic received by the interface is a TCP/UDP, but there 
is also a PPPoE (~2.5Gbps/s).
The whole is divided into a large number of VLANs (>500)

-- 
Marcin Markowski