From owner-freebsd-net@FreeBSD.ORG Fri Jul 9 18:48:58 2010 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 90D7D1065672 for ; Fri, 9 Jul 2010 18:48:58 +0000 (UTC) (envelope-from smithi@nimnet.asn.au) Received: from sola.nimnet.asn.au (paqi.nimnet.asn.au [115.70.110.159]) by mx1.freebsd.org (Postfix) with ESMTP id E437B8FC16 for ; Fri, 9 Jul 2010 18:48:57 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by sola.nimnet.asn.au (8.14.2/8.14.2) with ESMTP id o69ImtAW056034; Sat, 10 Jul 2010 04:48:56 +1000 (EST) (envelope-from smithi@nimnet.asn.au) Date: Sat, 10 Jul 2010 04:48:55 +1000 (EST) From: Ian Smith To: Ryan Stone In-Reply-To: Message-ID: <20100710040032.F54166@sola.nimnet.asn.au> References: <1278330234.10826.18.camel@stormi-desktop> <1278356796.10826.35.camel@stormi-desktop> <1278404933.20433.26.camel@stormi-desktop> <1278496982.21743.50.camel@stormi-desktop> <20100709233505.J54166@sola.nimnet.asn.au> <1278688046.20612.45.camel@stormi-desktop> <1278696249.20612.96.camel@stormi-desktop> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Cc: freebsd-net@freebsd.org, Shtorm , Jack Vogel Subject: Re: Intel 82574L Gigabit Ethernet Controller X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 09 Jul 2010 18:48:58 -0000 On Fri, 9 Jul 2010, Ryan Stone wrote: > No, defining EM_WATCHDOG as 10 * hz should mean that the watchdog > expires after 10 seconds no matter what your kern.hz is. hz is set to > the number of ticks in a second. Ok, one more probably wild punt .. Shtorm you say HZ=4000, giving: === And here is vmstat -i interrupt total rate irq16: uhci0 2673 2 irq18: ehci0 uhci5 2 0 irq19: uhci2 uhci4 70 0 irq23: uhci3 ehci1 8835 9 cpu0: timer 3743479 3957 irq256: em0 662219 700 irq257: em0 717531 758 irq259: em0 12142 12 irq260: em0 6100 6 irq261: em1 694169 733 irq262: em1 217388 229 irq264: em1 463023 489 irq265: em1 11 0 cpu1: timer 3743411 3957 cpu6: timer 3743408 3957 cpu7: timer 3743407 3957 cpu4: timer 3743408 3957 cpu5: timer 3743407 3957 cpu3: timer 3743408 3957 cpu2: timer 3743409 3957 Total 32731500 34599 === a little more variant from 4000 than expected? Originally: === but vmstat -i shows only one pair is used %vmstat -i interrupt total rate irq1: atkbd0 391 0 irq18: ehci0 uhci5 2 0 irq19: uhci2 uhci4 27 0 irq23: uhci3 ehci1 8463 0 cpu0: timer 107412943 7864 irq256: em0 93311951 6832 irq257: em0 90479067 6624 irq260: em0 2 0 irq261: em1 92966894 6806 irq262: em1 80298240 5879 irq265: em1 1 0 cpu1: timer 107412607 7864 cpu2: timer 107412785 7864 cpu3: timer 107412830 7864 cpu5: timer 107413210 7864 cpu4: timer 107413389 7864 cpu7: timer 107407337 7864 cpu6: timer 107413132 7864 Total 1216363271 89058 === Was that with HZ=8000 ? Or what? In any case, em interrupt rates were a whole lot higher then - but maybe it was just a lot busier on the net? HZ=4000 ticks are 250ns, not 25ms. Seems like you're not lacking horsepower .. unless you're using POLLING (not indicated) or, say, dummynet pipes needing finer-grained output queue scheduling, it might be worth trying the default HZ=1000 ? Just curious along similar lines: what says sysctl kern.timecounter ? cheers, Ian