Date: Tue, 21 Dec 2010 22:14:31 +0600 From: Eugene Grosbein <egrosbein@rdtc.ru> To: Fabien Thomas <fabien.thomas@netasq.com> Cc: Jack F Vogel <jfv@freebsd.org>, net@freebsd.org Subject: Re: lagg/lacp poor traffic distribution Message-ID: <4D10D267.4060201@rdtc.ru> In-Reply-To: <BDB1F984-9F2A-4746-B74E-4CABC952D3E2@netasq.com> References: <4D0CFEFF.3000902@rdtc.ru> <1292844095.1917.136.camel@stormi> <4D1083D6.6010707@rdtc.ru> <84530C06-AC2E-4E2B-BFD4-693902BB0FA6@netasq.com> <4D10B2F4.1060404@rdtc.ru> <90F64F73-F9A8-4FD6-9303-2FC0D3424751@netasq.com> <4D10BE3E.6030506@rdtc.ru> <BDB1F984-9F2A-4746-B74E-4CABC952D3E2@netasq.com>
index | next in thread | previous in thread | raw e-mail
On 21.12.2010 21:57, Fabien Thomas wrote: >>>>>> 1. Is it a bug or design problem? >>>>> >>>>> How many queues have you with igb? If it's one it will explain why the flowid is bad for load balancing with lagg. >>>> >>>> How do I know? I've read igb(4) manual page and found no words >>> vmstat -i will show the queue (intr for the queue) normally it's the number of CPU available. >> >> # vmstat -i >> interrupt total rate >> irq5: uart2 8 0 >> irq18: ehci0 uhci5+ 2 0 >> irq19: uhci2 uhci4+ 2182 0 >> irq23: uhci3 ehci1 124 0 >> cpu0: timer 39576224 1993 >> irq256: em0:rx 0 115571349 5822 >> irq257: em0:tx 0 136632905 6883 >> irq259: em1:rx 0 115829181 5835 >> irq260: em1:tx 0 138838991 6994 >> irq262: igb0:que 0 157354922 7927 >> irq263: igb0:que 1 577369 29 >> irq264: igb0:que 2 280207 14 >> irq265: igb0:que 3 241826 12 >> irq266: igb0:link 2 0 >> irq267: igb1:que 0 164620363 8293 >> irq268: igb1:que 1 238678 12 >> irq269: igb1:que 2 248478 12 >> irq270: igb1:que 3 762453 38 >> irq271: igb1:link 3 0 >> cpu2: timer 39576052 1993 >> cpu3: timer 39576095 1993 >> cpu1: timer 39575913 1993 >> Total 989503327 49849 >> >> It seems I have four queues per igb card but only one of them works? > > Yes. > > Jack will certainly confirm but it seems that RSS hash does not seems to take vlan in account and default to queue0 ? Perhaps, this is the reason I cannot achieve even 133Kpps at igb0+igb1 grouped to lagg1 ?.. mrtg shows horizontal line for pps graph after input load reaches 560Mbps for lagg1, and traffic does not grow more too. Eugene Grosbeinhome | help
Want to link to this message? Use this
URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?4D10D267.4060201>