From owner-freebsd-net@FreeBSD.ORG Fri May 29 17:24:54 2009 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id AD7371065679; Fri, 29 May 2009 17:24:54 +0000 (UTC) (envelope-from smallpox@gmail.com) Received: from mail-gx0-f218.google.com (mail-gx0-f218.google.com [209.85.217.218]) by mx1.freebsd.org (Postfix) with ESMTP id 4F20B8FC0C; Fri, 29 May 2009 17:24:54 +0000 (UTC) (envelope-from smallpox@gmail.com) Received: by gxk18 with SMTP id 18so1322915gxk.19 for ; Fri, 29 May 2009 10:24:53 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from :user-agent:mime-version:to:cc:subject:references:in-reply-to :content-type:content-transfer-encoding; bh=5uPfs7HXiJ7RoDuVnNS5LVyXzLjUvCg7Kmm6SBEMlHs=; b=kV0E1M91C9Zr5psQ1n1ThGTxmDs2DUHVVPta1h+fAI8bdn4vO5DxnFXiRiU2B9VW8U G0UXJolP9vvM7I/oUSRcrcicRd1mKtaFTUhCCpRAa7L52e4Kpq5lF2GUWFPE5dFds+bd c0aN38HFQ/lB+UEmzWbS99lCDriejp/hm28Pg= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:content-type:content-transfer-encoding; b=F+2IYOs9Ruer9bLn9nu1zdwrZDxqYei/ozwj20mDEj/76Jiit93SUe57Y39wbhQFDM n+Ce7dq8APvBSIyWhLxXKC56RWzUacWg3zVW/bqRqjecFWpPaqdkWxFlQm5dHf9r8zob nGwfKGCvnYMBAFGpGAyoUDM0gIhqqBlcFcmXI= Received: by 10.90.66.14 with SMTP id o14mr2247424aga.94.1243617893730; Fri, 29 May 2009 10:24:53 -0700 (PDT) Received: from ?192.168.2.2? (24-180-16-19.dhcp.mtpk.ca.charter.com [24.180.16.19]) by mx.google.com with ESMTPS id 32sm2679381aga.4.2009.05.29.10.24.52 (version=SSLv3 cipher=RC4-MD5); Fri, 29 May 2009 10:24:53 -0700 (PDT) Message-ID: <4A201A4D.1000301@gmail.com> Date: Fri, 29 May 2009 10:24:29 -0700 From: smallpox User-Agent: Thunderbird 2.0.0.21 (Windows/20090302) MIME-Version: 1.0 To: Harti Brandt References: <4A1F2706.2080304@gmail.com> <20090529142757.X22933@beagle.kn.op.dlr.de> <4A1FF0B1.8040209@gmail.com> <20090529165809.O23256@beagle.kn.op.dlr.de> In-Reply-To: <20090529165809.O23256@beagle.kn.op.dlr.de> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-net@freebsd.org Subject: Re: bsnmpd + netsnmp & 64bits counters problem, bce interface problems maybe ? X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 29 May 2009 17:24:54 -0000 me: is it supposed to be sequential ? me: from low to high ? netsnmpguy: no, it's the difference between on poll period to the next he did admit that he doesn't monitor high speed networks so he can't be too sure. ifconfig bce0 -tso bce0: flags=8843 metric 0 mtu 1500 options=bb [10:13:21 5/29] IF-MIB::ifInOctets.1 /1 sec: 157715996 [10:13:21 5/29] IF-MIB::ifOutOctets.1 /1 sec: 161365331 [10:13:36 5/29] IF-MIB::ifInOctets.1 /1 sec: 181177076 [10:13:36 5/29] IF-MIB::ifOutOctets.1 /1 sec: 172743760 [10:13:51 5/29] IF-MIB::ifInOctets.1 /1 sec: 173974646 [10:13:51 5/29] IF-MIB::ifOutOctets.1 /1 sec: 179701472 and [10:21:06 5/29] IF-MIB::ifHCInOctets.1 /1 sec: 189562690 [10:21:06 5/29] IF-MIB::ifHCOutOctets.1 /1 sec: 193086153 [10:21:21 5/29] IF-MIB::ifHCInOctets.1 /1 sec: 162102286 [10:21:21 5/29] IF-MIB::ifHCOutOctets.1 /1 sec: 174412564 [10:21:36 5/29] IF-MIB::ifHCInOctets.1 /1 sec: 163761580 [10:21:36 5/29] IF-MIB::ifHCOutOctets.1 /1 sec: 178587294 then i kill snmpd and launch bsnmpd.. and i know it's growing but probably just like everything else, it's not going to be at 90mbit already. [10:21:52 5/29] IF-MIB::ifHCInOctets.1 /1 sec: 824582 [10:21:52 5/29] IF-MIB::ifHCOutOctets.1 /1 sec: 726172 [10:21:52 5/29] IF-MIB::ifHCInOctets.1 /1 sec: 810400 [10:21:52 5/29] IF-MIB::ifHCOutOctets.1 /1 sec: 714542 [10:21:53 5/29] IF-MIB::ifHCInOctets.1 /1 sec: 8073610 [10:21:53 5/29] IF-MIB::ifHCOutOctets.1 /1 sec: 8263915 [10:21:54 5/29] IF-MIB::ifHCInOctets.1 /1 sec: 8950868 [10:21:54 5/29] IF-MIB::ifHCOutOctets.1 /1 sec: 10064090 [10:21:55 5/29] IF-MIB::ifHCInOctets.1 /1 sec: 8734086 [10:21:55 5/29] IF-MIB::ifHCOutOctets.1 /1 sec: 9477418 [10:21:56 5/29] IF-MIB::ifHCInOctets.1 /1 sec: 8764476 [10:21:56 5/29] IF-MIB::ifHCOutOctets.1 /1 sec: 9738831 [10:21:57 5/29] IF-MIB::ifHCInOctets.1 /1 sec: 9398614 [10:21:57 5/29] IF-MIB::ifHCOutOctets.1 /1 sec: 9894332 [10:21:58 5/29] IF-MIB::ifHCInOctets.1 /1 sec: 9497888 [10:21:58 5/29] IF-MIB::ifHCOutOctets.1 /1 sec: 10337890 [10:21:59 5/29] IF-MIB::ifHCInOctets.1 /1 sec: 10057064 [10:21:59 5/29] IF-MIB::ifHCOutOctets.1 /1 sec: 10657596 [10:22:00 5/29] IF-MIB::ifHCInOctets.1 /1 sec: 10379198 [10:22:00 5/29] IF-MIB::ifHCOutOctets.1 /1 sec: 11772401 [10:22:01 5/29] IF-MIB::ifHCInOctets.1 /1 sec: 10863412 [10:22:01 5/29] IF-MIB::ifHCOutOctets.1 /1 sec: 12284506 [10:22:02 5/29] IF-MIB::ifHCInOctets.1 /1 sec: 10204962 [10:22:02 5/29] IF-MIB::ifHCOutOctets.1 /1 sec: 10745774 bsnmpd does it every second. also, as far as this " options=bb" jumbo is disabled on the switch. in comparison to another gigabit, (em0) on that switch. options=9b they're both at MTU 1500 though. thanks Harti Brandt wrote: > On Fri, 29 May 2009, smallpox wrote: > > s>well, from what im told by snmp people, it's what's happening at that time, so > s>up and down is normal... but not at the rate that the non-working one is > s>going. and this one's upload and download are spread out normallly, 24 mbit > s>out, 2mbit in... > s> > s>current figures on the messed up system: > s> > s>[07:25:32 5/29] IF-MIB::ifInOctets.1 /1 sec: 238914024 > s>[07:25:32 5/29] IF-MIB::ifOutOctets.1 /1 sec: 223977573 > s>[07:25:47 5/29] IF-MIB::ifInOctets.1 /1 sec: 235054494 > s>[07:25:47 5/29] IF-MIB::ifOutOctets.1 /1 sec: 222830449 > s> > s>one of the differences between bsnmpd and net-snmpd is net-snmpd updates every > s>15 sec, anyway. see how the in/out are so close? that's totally off. > s> > s>the driver in question is bce... im not sure > > Hmm. Why would these numbers go up and down? As I understand it they > should go up and wrap at either 32-bit or 64-bit. There are only two cases > when they go down: a wrap or a discontinuity, which would be recorded in > ifCounterDiscontinuityTime. > > Just to check: could you please disable TSO on the interface and look what > it does? > > harti > > s>Harti Brandt wrote: > s>> On Thu, 28 May 2009, smallpox wrote: > s>> > s>> s>hey guys, i've read > s>> s> > s>> > s>> [SNIP] > s>> > s>> s> > s>> s>in comparison to an intel em.. 32bit, it's linked at a gigabit though.. > s>> but no > s>> s>heavy traffic there. > s>> s> > s>> s>--BEGIN WORKING > s>> s>IF-MIB::ifInOctets.1 /15 sec: 1932426 > s>> s>IF-MIB::ifOutOctets.1 /15 sec: 24270520 > s>> s>IF-MIB::ifInOctets.1 /15 sec: 2199107 > s>> s>IF-MIB::ifOutOctets.1 /15 sec: 28672350 > s>> s>IF-MIB::ifInOctets.1 /15 sec: 2049073 > s>> s>IF-MIB::ifOutOctets.1 /15 sec: 22716321 > s>> s>IF-MIB::ifInOctets.1 /15 sec: 2036279 > s>> s>IF-MIB::ifOutOctets.1 /15 sec: 24361972 > s>> s>IF-MIB::ifInOctets.1 /15 sec: 2571021 > s>> s>IF-MIB::ifOutOctets.1 /15 sec: 32539047 > s>> s>IF-MIB::ifInOctets.1 /15 sec: 2416155 > s>> s>IF-MIB::ifOutOctets.1 /15 sec: 30571680 > s>> s>IF-MIB::ifInOctets.1 /15 sec: 2583795 > s>> s>IF-MIB::ifOutOctets.1 /15 sec: 35712392 > s>> s>IF-MIB::ifInOctets.1 /15 sec: 2665891 > s>> s>IF-MIB::ifOutOctets.1 /15 sec: 34761228 > s>> s>IF-MIB::ifInOctets.1 /15 sec: 2249559 > s>> s>IF-MIB::ifOutOctets.1 /15 sec: 27438273 > s>> s> > s>> s>--END WORKING > s>> > s>> Do I get it wrong or do the 32-bit counters also go up and down? Given that > s>> bsnmpd just retrieves the values from the kernel and sends them over SNMP > s>> without looking at the values (for the 32-bit counters) this looks rather > s>> like a problem in the kernel/driver. Do these drivers perhaps use multiple > s>> threads for receiving? > s>> > s>> harti > s>> > s>> > s> > s> > >