From owner-freebsd-net@FreeBSD.ORG  Wed Dec 22 17:55:16 2010
Return-Path: <owner-freebsd-net@FreeBSD.ORG>
Delivered-To: net@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id B0649106566B
	for <net@freebsd.org>; Wed, 22 Dec 2010 17:55:16 +0000 (UTC)
	(envelope-from egrosbein@rdtc.ru)
Received: from eg.sd.rdtc.ru (eg.sd.rdtc.ru [62.231.161.221])
	by mx1.freebsd.org (Postfix) with ESMTP id 16E158FC0C
	for <net@freebsd.org>; Wed, 22 Dec 2010 17:55:15 +0000 (UTC)
Received: from eg.sd.rdtc.ru (localhost [127.0.0.1])
	by eg.sd.rdtc.ru (8.14.4/8.14.4) with ESMTP id oBMHtDi9040223;
	Wed, 22 Dec 2010 23:55:14 +0600 (NOVT)
	(envelope-from egrosbein@rdtc.ru)
Message-ID: <4D123B7C.1070104@rdtc.ru>
Date: Wed, 22 Dec 2010 23:55:08 +0600
From: Eugene Grosbein <egrosbein@rdtc.ru>
User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; ru-RU;
	rv:1.9.1.10) Gecko/20100712 Thunderbird/3.0.5
MIME-Version: 1.0
To: Fabien Thomas <fabien.thomas@netasq.com>
References: <4D0CFEFF.3000902@rdtc.ru>	<1292844095.1917.136.camel@stormi>	<4D1083D6.6010707@rdtc.ru>	<84530C06-AC2E-4E2B-BFD4-693902BB0FA6@netasq.com>	<4D10B2F4.1060404@rdtc.ru>	<90F64F73-F9A8-4FD6-9303-2FC0D3424751@netasq.com>	<4D10BE3E.6030506@rdtc.ru>
	<BDB1F984-9F2A-4746-B74E-4CABC952D3E2@netasq.com>
In-Reply-To: <BDB1F984-9F2A-4746-B74E-4CABC952D3E2@netasq.com>
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit
Cc: Jack F Vogel <jfv@freebsd.org>, net@freebsd.org
Subject: Re: lagg/lacp poor traffic distribution
X-BeenThere: freebsd-net@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Networking and TCP/IP with FreeBSD <freebsd-net.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-net>,
	<mailto:freebsd-net-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-net>
List-Post: <mailto:freebsd-net@freebsd.org>
List-Help: <mailto:freebsd-net-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-net>,
	<mailto:freebsd-net-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Wed, 22 Dec 2010 17:55:16 -0000

On 21.12.2010 21:57, Fabien Thomas wrote:

>> irq262: igb0:que 0             157354922       7927
>> irq263: igb0:que 1                577369         29
>> irq264: igb0:que 2                280207         14
>> irq265: igb0:que 3                241826         12
>> irq266: igb0:link                      2          0
>> irq267: igb1:que 0             164620363       8293
>> irq268: igb1:que 1                238678         12
>> irq269: igb1:que 2                248478         12
>> irq270: igb1:que 3                762453         38
>> irq271: igb1:link                      3          0
>> cpu2: timer                     39576052       1993
>> cpu3: timer                     39576095       1993
>> cpu1: timer                     39575913       1993
>> Total                          989503327      49849
>>
>> It seems I have four queues per igb card but only one of them works?
> 
> Yes.
> 
> Jack will certainly confirm but it seems that RSS hash does not seems to take vlan in account and default to queue0 ?

I've just read "Microsoft Receive-Side Scaling" documentation,
http://download.microsoft.com/download/5/d/6/5d6eaf2b-7ddf-476b-93dc-7cf0072878e6/ndis_rss.doc

RSS defines that hash function may take IP and optionally port numbers only, not vlan tags.
In case of PPPoE-only traffic this card's ability to classify traffic voids.
Then, unpatched lagg fails to share load over outgoing interface ports.

It seems, we really need sysctl disabling lagg's use of flows, don't we?

Eugene Grosbein