Date: Thu, 21 Jul 2016 14:07:15 -0700 From: Jack Vogel <jfvogel@gmail.com> To: Chris Dunbar <chris@dunbar.net> Cc: freebsd-net <freebsd-net@freebsd.org> Subject: Re: Slow performance with Intel X540-T2 10Gb NIC Message-ID: <CAFOYbc=2Ls20ct0onwsV758Hpt6nvRBGJF2cgY0peq8ad1pkzw@mail.gmail.com> In-Reply-To: <1441424852.712842.1469134420198.JavaMail.zimbra@dunbar.net> References: <1244557023.708807.1469061382192.JavaMail.zimbra@dunbar.net> <CA%2Bb0zg-mXiDZzKmcomfLNxKbpb_R1F50k=vo%2B32sxQwLkRNGvg@mail.gmail.com> <1441424852.712842.1469134420198.JavaMail.zimbra@dunbar.net>
next in thread | previous in thread | raw e-mail | index | archive | help
NUMA issues maybe? They have been a problem on some recent system architectures. On Thu, Jul 21, 2016 at 1:53 PM, Chris Dunbar <chris@dunbar.net> wrote: > Eric, et al: > > I haven't tried netperf yet, but I do have some new information to share. > I have two systems that I am using for testing: the new server and an older > (not too old) desktop PC. I installed CentOS on the new server again > because I know it can achieve >9 GB/s with the X540. I replaced Windows on > the desktop PC with FreeBSD 10.3 (it also has an X540) and ran iperf3 > again. I was able to achieve >9 GB/s so I know the problem isn't the X540 > and I know the problem isn't anything with the default installation of > FreeBSD 10.3. So, what in the world might be nutty in my BIOS settings (or > elsewhere) that would cause the new server + FreeBSD 10.3 + X540 to equal > slow performance? > > Regards, > Chris > > > From: "Eric Joyner" <erj@freebsd.org> > To: "chris" <chris@dunbar.net>, "freebsd-net" <freebsd-net@freebsd.org> > Sent: Thursday, July 21, 2016 1:27:10 PM > Subject: Re: Slow performance with Intel X540-T2 10Gb NIC > > (Replying-all this time) > > Did you try to set these settings that ESnet recommends? > https://fasterdata.es.net/host-tuning/freebsd/ > > We don't use iperf3 here at Intel (we use netperf instead), so I'm not > sure I can be much help diagnosing what's wrong. > > On Wed, Jul 20, 2016 at 5:39 PM Chris Dunbar < chris@dunbar.net > wrote: > > > Hello, > > I am new to FreeBSD and recently built a file server out of new components > running FreeBSD 10.3. I installed an Intel X540-T2 10 Gb NIC and am > experiencing what I consider to be slow transfer speeds. I am using iperf3 > to measure the speed and test the results of modifications. So far nothing > I have done has made a noticeable difference. If I run iperf3 -s on the > FreeBSD server, I see transfer speeds of approximately 1.6 Gb/s. If I run > iperf3 in client mode, the speed improves to ~2.75 Gb/s. However, if I > replace FreeBSD with CentOS 7 on the same hardware, I see iperf3 speeds > surpassing 8 GB/s. The other end of my iperf3 test is a Windows 10 box that > also has an Intel X540-T2 installed. > > I did notice that FreeBSD 10.3 (and 11.0 alpha 6 for that matter) includes > a slightly older Intel driver (v3.1.13-k). I managed to build a custom > kernel that removed the Intel PRO/10GbE PCIE NIC drivers. That allowed me > to manually load the latest 3.1.14 driver downloaded from Intel's web site. > Unfortunately that did not produce any improvements. I am working my way > through man tuning() and some other articles on network performance. So far > nothing I tweak makes a noticeable difference. I'm increasingly skeptical > that I am going to find a setting or two that more than doubles the speed I > am currently experiencing. > > I am open to any and all suggestions at this point. > > Thank you! > Chris > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to " freebsd-net-unsubscribe@freebsd.org " > > > > > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" >
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAFOYbc=2Ls20ct0onwsV758Hpt6nvRBGJF2cgY0peq8ad1pkzw>