Date: Fri, 20 Jul 2007 16:00:28 -0700 From: "Jack Vogel" <jfvogel@gmail.com> To: "Alexandre Biancalana" <biancalana@gmail.com> Cc: =?ISO-8859-1?Q?St=E5le_Kristoffersen?= <staalebk@ifi.uio.no>, Vince <jhary@unsane.co.uk>, =?ISO-8859-1?Q?St=E5le_Kristoffersen?= <staale@kristoffersen.ws>, current@freebsd.org Subject: Re: Slow networkperformance in current? Message-ID: <2a41acea0707201600x3ae07833m1a54b2e5ae3d1b7c@mail.gmail.com> In-Reply-To: <8e10486b0707201548r18aabeddt9655ed5372a1aaa7@mail.gmail.com> References: <20070716190441.GA19282@eschew.pusen.org> <b1fa29170707161247r1a9421cbxf4ec9be1e4c63f7d@mail.gmail.com> <20070716213425.GB19282@eschew.pusen.org> <20070718041159.GC37935@cdnetworks.co.kr> <20070718044700.GE37935@cdnetworks.co.kr> <20070718124350.GA25799@eschew.pusen.org> <46A06D8D.1070604@unsane.co.uk> <20070720122443.GA29372@eschew.pusen.org> <2a41acea0707200810n21843c76s9b0f4f37ef92722f@mail.gmail.com> <8e10486b0707201548r18aabeddt9655ed5372a1aaa7@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
On 7/20/07, Alexandre Biancalana <biancalana@gmail.com> wrote: > On 7/20/07, Jack Vogel <jfvogel@gmail.com> wrote: > > > > I am actually quite impressed with the stack right now, with our new > > Oplin hardware and the ixgbe driver I have 9.8 Gb/s pumping thru > > it. Of course its all about adequate hardware, configuration, and > > tuning. > > > Can you post the configuration tuning done ? > > Get rid of INVARIANT and WITNESS of course. Use ULE scheduler Use MTU of 9000 Set interrupt storm threshold up to 8000 (default is 1000), if we didnt do this the channel would get throttled. Then we need to make sure MSI/X is enabled, and set the number of RX queues to 8 (this is Oplin specific). The ixgbe driver uses 4K jumbo clusters as long as you set MTU up. I have experimented with Kip's patch for 9K and it helps a bit but mainly it improves cpu utilization. Beyond this doing 10G is very sensitive to things like cpu's, frontside bus, memory, etc, but these are things that I didn't personally set up, I just tell them to give me a kick ass machine :) Jack
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?2a41acea0707201600x3ae07833m1a54b2e5ae3d1b7c>