Date: Fri, 22 Jul 2011 16:10:34 -0400 From: "Michael W. Lucas" <mwlucas@blackhelicopters.org> To: Mike Tancsa <mike@sentex.net> Cc: questions@freebsd.org Subject: Re: em0 NIC slow on 8.2-p1 amd64? Message-ID: <20110722201034.GA56830@bewilderbeast.blackhelicopters.org> In-Reply-To: <4E29D37E.8070908@sentex.net> References: <4D6348DC01B1E406@> <20110720191640.GA42821@bewilderbeast.blackhelicopters.org> <4D301C9702145855@> <20110721141011.GB47190@bewilderbeast.blackhelicopters.org> <4D7F86D5017EB3D8@> <20110721151210.GA47663@bewilderbeast.blackhelicopters.org> <4D301C9702253683@> <4E29BC1F.6060103@sentex.net> <20110722190821.GA55040@bewilderbeast.blackhelicopters.org> <4E29D37E.8070908@sentex.net>
next in thread | previous in thread | raw e-mail | index | archive | help
On Fri, Jul 22, 2011 at 03:46:06PM -0400, Mike Tancsa wrote:
> On 7/22/2011 3:08 PM, Michael W. Lucas wrote:
> >
> > Basically the same. I don't think it's disk.
>
> Are you able to saturate the ethernet ? Try something like
>
>
> /usr/src/tools/tools/netrate/netblast/netblast
>
> on the local ethernet and see if you can generate and receive a full
> gigabit on the wire
Very helpful, thank you. Copied ifstat and netblast from an 8.0 box to
the freenas box, and started firing traffic at a machine on the local
network.
./netblast x.x.x.x 500 250 10
start: 1311364875.158297086
finish: 1311364885.158882731
send calls: 1826947
send errors: 11
approx send rate: 182693
approx error rate: 0
ifstat -b -i em0 shows:
17.84 214390.1
3.65 419155.4
4.12 418916.4
3.65 419466.2
410.14 417715.7
5.06 418383.2
3120.18 410983.4
em0
Kbps in Kbps out
3.65 412871.2
3.65 416097.9
3.65 416431.1
5.65 195233.8
So no, I'm not saturating this network. Not even close. I have a
machine with a 100Mbs vr0 that can spit out twice that much.
==ml
> # ./netblast 10.11.11.243 500 250 10
>
> start: 1311363559.619619931
> finish: 1311363569.619418229
> send calls: 5210086
> send errors: 1249890
> approx send rate: 396019
> approx error rate: 0
>
>
> ./netblast 10.11.11.241 500 300 10
>
> start: 1311346264.584043978
> finish: 1311346274.583848423
> send calls: 7417664
> send errors: 4214676
> approx send rate: 320298
> approx error rate: 0
>
>
> When the sender if an igb nic, I am able to push out 955Mb to the em0
> nic acting as a sink. The other way around, 855Mb
> The em nic is
>
> em1@pci0:5:0:0: class=0x020000 card=0x34ec8086 chip=0x10d38086 rev=0x00
> hdr=0x00
> vendor = 'Intel Corporation'
> device = 'Intel 82574L Gigabit Ethernet Controller (82574L)'
> class = network
> subclass = ethernet
> bar [10] = type Memory, range 32, base 0xb2500000, size 131072,
> enabled
> bar [18] = type I/O Port, range 32, base 0x1000, size 32, enabled
> bar [1c] = type Memory, range 32, base 0xb2520000, size 16384, enabled
> cap 01[c8] = powerspec 2 supports D0 D3 current D0
> cap 05[d0] = MSI supports 1 message, 64 bit
> cap 10[e0] = PCI-Express 1 endpoint max data 128(256) link x1(x1)
> cap 11[a0] = MSI-X supports 5 messages in map 0x1c enabled
> ecap 0001[100] = AER 1 0 fatal 0 non-fatal 1 corrected
> ecap 0003[140] = Serial 1 001517ffffed36e4
>
> em1: <Intel(R) PRO/1000 Network Connection 7.2.3> port 0x1000-0x101f mem
> 0xb2500000-0xb251ffff,0xb2520000-0xb2523fff irq 16 at device 0.0 on pci5
> em1: Using MSIX interrupts with 3 vectors
> em1: [ITHREAD]
> em1: [ITHREAD]
> em1: [ITHREAD]
> em1: Ethernet address: 00:15:17:ed:36:e4
>
>
>
> ifstat -b shows
>
> # ifstat -b -i igb0
> igb0
> Kbps in Kbps out
> 0.00 0.00
> 0.00 0.00
> 578794.0 0.00
> 855298.0 0.00
> 855365.9 0.00
> 855316.6 0.00
> 855335.2 0.00
> 855346.5 0.00
> 855358.6 0.00
> 855368.7 0.00
> 855356.6 0.00
> 727163.6 0.00
> 0.00 0.00
>
> thats the em equipped machine generating the traffic
>
>
> ---Mike
>
>
>
>
>
> >
> > There's kern/152828 claiming a performance regression with em under
> > 8.2, but I'm not sure if that is applicable to my system. I'd upgrade
> > the kernel to test, but I'm not brave enough to downgrade the kernel
> > to 8.0 for comparison. (I've never had good luck running an old kernel
> > on a new userland.)
> >
> > ==ml
> >
>
>
> --
> -------------------
> Mike Tancsa, tel +1 519 651 3400
> Sentex Communications, mike@sentex.net
> Providing Internet services since 1994 www.sentex.net
> Cambridge, Ontario Canada http://www.tancsa.com/
--
Michael W. Lucas
http://www.MichaelWLucas.com/, http://blather.MichaelWLucas.com/
Latest book: Network Flow Analysis http://www.networkflowanalysis.com/
mwlucas@BlackHelicopters.org, Twitter @mwlauthor
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20110722201034.GA56830>