Date: Wed, 28 Mar 2018 15:20:43 -0700 From: christian russell <christian.baltini@gmail.com> To: "Rodney W. Grimes" <freebsd-rwg@pdx.rh.CN85.dnsmgr.net> Cc: "Muenz, Michael" <m.muenz@spam-fetish.org>, freebsd-net@freebsd.org Subject: Re: Current state of Intel XL710 40G NIC ixl performance Message-ID: <6794C8E9-4136-441D-9C48-D0EA7938F566@gmail.com> In-Reply-To: <201803281638.w2SGcWNp057893@pdx.rh.CN85.dnsmgr.net> References: <201803281638.w2SGcWNp057893@pdx.rh.CN85.dnsmgr.net>
next in thread | previous in thread | raw e-mail | index | archive | help
As would I.=20 Christian=20 On Mar 28, 2018, at 9:38 AM, Rodney W. Grimes <freebsd-rwg@pdx.rh.CN85.dnsmg= r.net> wrote: >>> Am 28.03.2018 um 06:11 schrieb christian russell: >>> I am having trouble getting an Intel XL710-DA2 NIC to get even close to >>> line rate. It is a 4x10 Gbps card. The box is running FreeBSD 11 (Free= NAS >>> in particular). >>>=20 >>> We have tried both 1.7 and 1.9 driver revisions with similar results. T= he >>> NVM version is 5.05. The card is in a confirmed 8x slot on a SuperMicro= >>> X10DRL-i with two Xeon E5-2600 processors and 256 GB DDR4 RAM. After >>> upping the interrupt threshold to 9000 dmesg doesn't log anything unusua= l. >>>=20 >>> We have added the tunes that are standard for 10 Gbps configurations. >>>=20 >>> On a single-client basis the fastest rates we see are around 5 Gbps. >>> Hitting this server from multiple boxes we see peaks of 20 Gbps at the v= ery >>> highest. More frequently things top off around 13 Gbps. These numbers a= re >>> coming from iperf tests. We are seeing similar numbers with direct >>> point-to-point as well as switched topologies. >>>=20 >>> These threads from 2015 describe similar issues but fizzled out: >>> https://lists.freebsd.org/pipermail/freebsd-net/2015-May/042273.html >>> https://lists.freebsd.org/pipermail/freebsd-net/2015-October/043584.html= >>>=20 >>> Is there very particular tuning required to get these cards working at >>> proper speed? Any insights? >>>=20 >>>> =46rom Googling around it appears frustration with this card and FreeBS= D is >>> pretty common. >>>=20 >>> Thanks in advance. >>>=20 >>> Christian >>=20 >> I can't deliver any special insights but we had many problems with X710=20= >> (without L) and Linux. >> Did some testing a while ago with OPNsense (based on 11.1) and got line=20= >> rate with iperf and single client. >> ixl0 in and ixl1 out. So this should be fine. If you like I can send you=20= >> the sysctl values to compare. >=20 > I would be interested in your sysctl values. >=20 > --=20 > Rod Grimes rgrimes@freebsd= .org > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?6794C8E9-4136-441D-9C48-D0EA7938F566>