From owner-freebsd-net@FreeBSD.ORG Tue Dec 21 15:57:43 2010 Return-Path: Delivered-To: net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DE826106564A; Tue, 21 Dec 2010 15:57:43 +0000 (UTC) (envelope-from fabien.thomas@netasq.com) Received: from work.netasq.com (mars.netasq.com [91.212.116.3]) by mx1.freebsd.org (Postfix) with ESMTP id 295388FC0A; Tue, 21 Dec 2010 15:57:42 +0000 (UTC) Received: from [10.20.1.1] (unknown [10.2.1.1]) by work.netasq.com (Postfix) with ESMTPSA id 88EEB74001B; Tue, 21 Dec 2010 16:55:23 +0100 (CET) Mime-Version: 1.0 (Apple Message framework v1082) Content-Type: text/plain; charset=us-ascii From: Fabien Thomas In-Reply-To: <4D10BE3E.6030506@rdtc.ru> Date: Tue, 21 Dec 2010 16:57:40 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: References: <4D0CFEFF.3000902@rdtc.ru> <1292844095.1917.136.camel@stormi> <4D1083D6.6010707@rdtc.ru> <84530C06-AC2E-4E2B-BFD4-693902BB0FA6@netasq.com> <4D10B2F4.1060404@rdtc.ru> <90F64F73-F9A8-4FD6-9303-2FC0D3424751@netasq.com> <4D10BE3E.6030506@rdtc.ru> To: Eugene Grosbein X-Mailer: Apple Mail (2.1082) Cc: Jack F Vogel , net@freebsd.org Subject: Re: lagg/lacp poor traffic distribution X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 21 Dec 2010 15:57:43 -0000 On Dec 21, 2010, at 3:48 PM, Eugene Grosbein wrote: > On 21.12.2010 20:41, Fabien Thomas wrote: >=20 >>>>> 1. Is it a bug or design problem? >>>>=20 >>>> How many queues have you with igb? If it's one it will explain why = the flowid is bad for load balancing with lagg. >>>=20 >>> How do I know? I've read igb(4) manual page and found no words >> vmstat -i will show the queue (intr for the queue) normally it's the = number of CPU available. >=20 > # vmstat -i > interrupt total rate > irq5: uart2 8 0 > irq18: ehci0 uhci5+ 2 0 > irq19: uhci2 uhci4+ 2182 0 > irq23: uhci3 ehci1 124 0 > cpu0: timer 39576224 1993 > irq256: em0:rx 0 115571349 5822 > irq257: em0:tx 0 136632905 6883 > irq259: em1:rx 0 115829181 5835 > irq260: em1:tx 0 138838991 6994 > irq262: igb0:que 0 157354922 7927 > irq263: igb0:que 1 577369 29 > irq264: igb0:que 2 280207 14 > irq265: igb0:que 3 241826 12 > irq266: igb0:link 2 0 > irq267: igb1:que 0 164620363 8293 > irq268: igb1:que 1 238678 12 > irq269: igb1:que 2 248478 12 > irq270: igb1:que 3 762453 38 > irq271: igb1:link 3 0 > cpu2: timer 39576052 1993 > cpu3: timer 39576095 1993 > cpu1: timer 39575913 1993 > Total 989503327 49849 >=20 > It seems I have four queues per igb card but only one of them works? Yes. Jack will certainly confirm but it seems that RSS hash does not seems to = take vlan in account and default to queue0 ? >=20 > Eugene Grosbein