Date: Mon, 3 Aug 2009 08:20:46 -0700 From: Jack Vogel <jfvogel@gmail.com> To: Invernizzi Fabrizio <fabrizio.invernizzi@telecomitalia.it> Cc: "freebsd-performance@freebsd.org" <freebsd-performance@freebsd.org>, Stefan Lambrev <stefan.lambrev@moneybookers.com> Subject: Re: Test on 10GBE Intel based network card Message-ID: <2a41acea0908030820o40438f6erda78927733529a9@mail.gmail.com> In-Reply-To: <36A93B31228D3B49B691AD31652BCAE9A4560DF96A@GRFMBX702BA020.griffon.local> References: <36A93B31228D3B49B691AD31652BCAE9A4560DF911@GRFMBX702BA020.griffon.local> <0E567C7E-4EAA-4B89-9A8D-FD0450D32ED7@moneybookers.com> <36A93B31228D3B49B691AD31652BCAE9A4560DF947@GRFMBX702BA020.griffon.local> <18AAC16B-3CC0-4C70-A009-00A325AB5932@moneybookers.com> <36A93B31228D3B49B691AD31652BCAE9A4560DF96A@GRFMBX702BA020.griffon.local>
next in thread | previous in thread | raw e-mail | index | archive | help
If you go to FreeBSD 8 you will get the improved stack code, and the RX/TX queue pairs will be pinned to cpus. It should improve performance. Make sure you have enough mbuf memory allocated, try increasing the descriptors. Jack On Mon, Aug 3, 2009 at 3:26 AM, Invernizzi Fabrizio < fabrizio.invernizzi@telecomitalia.it> wrote: > > > If you are meaning in term of Packet per second, you are right. > > > These are the packet per second measured during tests: > > > > > > 64 byte: 610119 Pps > > > 512 byte: 516917 Pps > > > 1492 byte: 464962 Pps > > > > > > > > >> Am I correct that the maximum you can reach is around 639,000 packets > > >> per second? > > > > > > Yes, as you can see the maximum is 610119 Pps. > > > Where does this limit come from? > > > > I duno - the tests I did before were with SYN packets (random source) > > which was my worst scenario, > > and the server CPU were busy generating MD5 check sums for > > "syncache" (around 35% of the time). > > > > If I have to compare my results with your, you beat me with factor > > 2.5, may be because you use ICMP for the test > > and your processor is better then my test stations :) > > Also my experience is only with gigabit cards (em driver) and FreeBSD > > 7.something_before_1 where the em thread was eating 100% cpu. > > If you are lucky LOCK_PROFILING(9) will help you to see where the CPUs > > spend their time, if not you will see kernel panic :) > > > I will check, thanks for the hint. > > > Once problematic locks identified they can be reworked, but I think > > the first part is already done > > and work on the second already started. > > > > In my experience increasing hw.em.rxd and hw.em.txd yelled better > > results, but I think ixgb already comes tuned by default > > as it still doesn't have to support such a large number of different > > cards. > > I did some tuning in the code of the driver e recompiled the kernel in > order to reduce context switching (interrupt mitigation) since the driver > does not support POLLING. > > > Also at the time of my tests there were not support for multi queues > > in the OS even if they were supported by the HW, which is changed in > > 7.2 (?) > > It looks like multi queue is working since I can see the load distributed > over the 4 cores. > > > Fabrizio > > Questo messaggio e i suoi allegati sono indirizzati esclusivamente alle > persone indicate. La diffusione, copia o qualsiasi altra azione derivante > dalla conoscenza di queste informazioni sono rigorosamente vietate. Qualora > abbiate ricevuto questo documento per errore siete cortesemente pregati di > darne immediata comunicazione al mittente e di provvedere alla sua > distruzione, Grazie. > > This e-mail and any attachments is confidential and may contain privileged > information intended for the addressee(s) only. Dissemination, copying, > printing or use by anybody else is unauthorised. If you are not the intended > recipient, please delete this message and any attachments and advise the > sender by return e-mail, Thanks. > > _______________________________________________ > freebsd-performance@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-performance > To unsubscribe, send any mail to " > freebsd-performance-unsubscribe@freebsd.org" >
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?2a41acea0908030820o40438f6erda78927733529a9>