From owner-freebsd-questions@FreeBSD.ORG Fri Jul 22 20:10:37 2011 Return-Path: Delivered-To: questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 42838106564A for ; Fri, 22 Jul 2011 20:10:37 +0000 (UTC) (envelope-from mwlucas@bewilderbeast.blackhelicopters.org) Received: from bewilderbeast.blackhelicopters.org (mwlucas-2-pt.tunnel.tserv9.chi1.ipv6.he.net [IPv6:2001:470:1f10:b9c::2]) by mx1.freebsd.org (Postfix) with ESMTP id CF3AA8FC0C for ; Fri, 22 Jul 2011 20:10:36 +0000 (UTC) Received: from bewilderbeast.blackhelicopters.org (localhost [127.0.0.1]) by bewilderbeast.blackhelicopters.org (8.14.4/8.14.4) with ESMTP id p6MKAYj3056885; Fri, 22 Jul 2011 16:10:35 -0400 (EDT) (envelope-from mwlucas@bewilderbeast.blackhelicopters.org) Received: (from mwlucas@localhost) by bewilderbeast.blackhelicopters.org (8.14.4/8.14.4/Submit) id p6MKAYfv056884; Fri, 22 Jul 2011 16:10:34 -0400 (EDT) (envelope-from mwlucas) Date: Fri, 22 Jul 2011 16:10:34 -0400 From: "Michael W. Lucas" To: Mike Tancsa Message-ID: <20110722201034.GA56830@bewilderbeast.blackhelicopters.org> References: <4D6348DC01B1E406@> <20110720191640.GA42821@bewilderbeast.blackhelicopters.org> <4D301C9702145855@> <20110721141011.GB47190@bewilderbeast.blackhelicopters.org> <4D7F86D5017EB3D8@> <20110721151210.GA47663@bewilderbeast.blackhelicopters.org> <4D301C9702253683@> <4E29BC1F.6060103@sentex.net> <20110722190821.GA55040@bewilderbeast.blackhelicopters.org> <4E29D37E.8070908@sentex.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <4E29D37E.8070908@sentex.net> User-Agent: Mutt/1.4.2.3i X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.2.6 (bewilderbeast.blackhelicopters.org [127.0.0.1]); Fri, 22 Jul 2011 16:10:35 -0400 (EDT) Cc: questions@freebsd.org Subject: Re: em0 NIC slow on 8.2-p1 amd64? X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 22 Jul 2011 20:10:37 -0000 On Fri, Jul 22, 2011 at 03:46:06PM -0400, Mike Tancsa wrote: > On 7/22/2011 3:08 PM, Michael W. Lucas wrote: > > > > Basically the same. I don't think it's disk. > > Are you able to saturate the ethernet ? Try something like > > > /usr/src/tools/tools/netrate/netblast/netblast > > on the local ethernet and see if you can generate and receive a full > gigabit on the wire Very helpful, thank you. Copied ifstat and netblast from an 8.0 box to the freenas box, and started firing traffic at a machine on the local network. ./netblast x.x.x.x 500 250 10 start: 1311364875.158297086 finish: 1311364885.158882731 send calls: 1826947 send errors: 11 approx send rate: 182693 approx error rate: 0 ifstat -b -i em0 shows: 17.84 214390.1 3.65 419155.4 4.12 418916.4 3.65 419466.2 410.14 417715.7 5.06 418383.2 3120.18 410983.4 em0 Kbps in Kbps out 3.65 412871.2 3.65 416097.9 3.65 416431.1 5.65 195233.8 So no, I'm not saturating this network. Not even close. I have a machine with a 100Mbs vr0 that can spit out twice that much. ==ml > # ./netblast 10.11.11.243 500 250 10 > > start: 1311363559.619619931 > finish: 1311363569.619418229 > send calls: 5210086 > send errors: 1249890 > approx send rate: 396019 > approx error rate: 0 > > > ./netblast 10.11.11.241 500 300 10 > > start: 1311346264.584043978 > finish: 1311346274.583848423 > send calls: 7417664 > send errors: 4214676 > approx send rate: 320298 > approx error rate: 0 > > > When the sender if an igb nic, I am able to push out 955Mb to the em0 > nic acting as a sink. The other way around, 855Mb > The em nic is > > em1@pci0:5:0:0: class=0x020000 card=0x34ec8086 chip=0x10d38086 rev=0x00 > hdr=0x00 > vendor = 'Intel Corporation' > device = 'Intel 82574L Gigabit Ethernet Controller (82574L)' > class = network > subclass = ethernet > bar [10] = type Memory, range 32, base 0xb2500000, size 131072, > enabled > bar [18] = type I/O Port, range 32, base 0x1000, size 32, enabled > bar [1c] = type Memory, range 32, base 0xb2520000, size 16384, enabled > cap 01[c8] = powerspec 2 supports D0 D3 current D0 > cap 05[d0] = MSI supports 1 message, 64 bit > cap 10[e0] = PCI-Express 1 endpoint max data 128(256) link x1(x1) > cap 11[a0] = MSI-X supports 5 messages in map 0x1c enabled > ecap 0001[100] = AER 1 0 fatal 0 non-fatal 1 corrected > ecap 0003[140] = Serial 1 001517ffffed36e4 > > em1: port 0x1000-0x101f mem > 0xb2500000-0xb251ffff,0xb2520000-0xb2523fff irq 16 at device 0.0 on pci5 > em1: Using MSIX interrupts with 3 vectors > em1: [ITHREAD] > em1: [ITHREAD] > em1: [ITHREAD] > em1: Ethernet address: 00:15:17:ed:36:e4 > > > > ifstat -b shows > > # ifstat -b -i igb0 > igb0 > Kbps in Kbps out > 0.00 0.00 > 0.00 0.00 > 578794.0 0.00 > 855298.0 0.00 > 855365.9 0.00 > 855316.6 0.00 > 855335.2 0.00 > 855346.5 0.00 > 855358.6 0.00 > 855368.7 0.00 > 855356.6 0.00 > 727163.6 0.00 > 0.00 0.00 > > thats the em equipped machine generating the traffic > > > ---Mike > > > > > > > > > There's kern/152828 claiming a performance regression with em under > > 8.2, but I'm not sure if that is applicable to my system. I'd upgrade > > the kernel to test, but I'm not brave enough to downgrade the kernel > > to 8.0 for comparison. (I've never had good luck running an old kernel > > on a new userland.) > > > > ==ml > > > > > -- > ------------------- > Mike Tancsa, tel +1 519 651 3400 > Sentex Communications, mike@sentex.net > Providing Internet services since 1994 www.sentex.net > Cambridge, Ontario Canada http://www.tancsa.com/ -- Michael W. Lucas http://www.MichaelWLucas.com/, http://blather.MichaelWLucas.com/ Latest book: Network Flow Analysis http://www.networkflowanalysis.com/ mwlucas@BlackHelicopters.org, Twitter @mwlauthor