Date: Fri, 20 Jul 2007 16:10:04 -0700 From: "Jack Vogel" <jfvogel@gmail.com> To: "Alexandre Biancalana" <biancalana@gmail.com> Cc: =?ISO-8859-1?Q?St=E5le_Kristoffersen?= <staalebk@ifi.uio.no>, Vince <jhary@unsane.co.uk>, =?ISO-8859-1?Q?St=E5le_Kristoffersen?= <staale@kristoffersen.ws>, current@freebsd.org Subject: Re: Slow networkperformance in current? Message-ID: <2a41acea0707201610o48ed9b20ub3d22a0206982b19@mail.gmail.com> In-Reply-To: <2a41acea0707201600x3ae07833m1a54b2e5ae3d1b7c@mail.gmail.com> References: <20070716190441.GA19282@eschew.pusen.org> <20070716213425.GB19282@eschew.pusen.org> <20070718041159.GC37935@cdnetworks.co.kr> <20070718044700.GE37935@cdnetworks.co.kr> <20070718124350.GA25799@eschew.pusen.org> <46A06D8D.1070604@unsane.co.uk> <20070720122443.GA29372@eschew.pusen.org> <2a41acea0707200810n21843c76s9b0f4f37ef92722f@mail.gmail.com> <8e10486b0707201548r18aabeddt9655ed5372a1aaa7@mail.gmail.com> <2a41acea0707201600x3ae07833m1a54b2e5ae3d1b7c@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
On 7/20/07, Jack Vogel <jfvogel@gmail.com> wrote: > On 7/20/07, Alexandre Biancalana <biancalana@gmail.com> wrote: > > On 7/20/07, Jack Vogel <jfvogel@gmail.com> wrote: > > > > > > I am actually quite impressed with the stack right now, with our new > > > Oplin hardware and the ixgbe driver I have 9.8 Gb/s pumping thru > > > it. Of course its all about adequate hardware, configuration, and > > > tuning. > > > > > > Can you post the configuration tuning done ? > > > > > > Get rid of INVARIANT and WITNESS of course. > Use ULE scheduler > Use MTU of 9000 > Set interrupt storm threshold up to 8000 (default is 1000), if we didnt > do this the channel would get throttled. > > Then we need to make sure MSI/X is enabled, and set the number > of RX queues to 8 (this is Oplin specific). > > The ixgbe driver uses 4K jumbo clusters as long as you set MTU > up. I have experimented with Kip's patch for 9K and it helps a bit > but mainly it improves cpu utilization. > > Beyond this doing 10G is very sensitive to things like cpu's, frontside bus, > memory, etc, but these are things that I didn't personally set up, I just > tell them to give me a kick ass machine :) OH, one other item I forgot, use TSO, I think thats significant help.
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?2a41acea0707201610o48ed9b20ub3d22a0206982b19>