From owner-freebsd-fs@FreeBSD.ORG Tue Jun 15 18:31:01 2010 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A34101065670; Tue, 15 Jun 2010 18:31:01 +0000 (UTC) (envelope-from pyunyh@gmail.com) Received: from mail-pv0-f182.google.com (mail-pv0-f182.google.com [74.125.83.182]) by mx1.freebsd.org (Postfix) with ESMTP id 62E7E8FC15; Tue, 15 Jun 2010 18:31:01 +0000 (UTC) Received: by pvg2 with SMTP id 2so346692pvg.13 for ; Tue, 15 Jun 2010 11:31:00 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:received:from:date:to:cc :subject:message-id:reply-to:references:mime-version:content-type :content-disposition:in-reply-to:user-agent; bh=muwMOg2LVCJEZUkzK+ArnxyisIwx5fRcjcN9HmEx7Jc=; b=djPpnaQIjPG/AaCrcx+bOcLmjqhIZ0ustPfHnEsuzS/qqCCQACnMVFWQwDHqVPlQu/ gbBLOlilmAjXIPz4MEvweJibav8RclLApqsIQr24zU1vBIl4Edt3P4vS7es7i32M2wGo X0q32Cy3wytS0CGxwwbgQRVIR9hdQc2bcM/oo= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=from:date:to:cc:subject:message-id:reply-to:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; b=huzVZ/Ig6zCa9Oeoa3VZfUU7pMCabqtjpezaSrcCjMg27pCPZRLrTsQdOmB1fkdWOY hLSU449Vesy9lQp+2lF2FxLv/4bWC2d3UeOwhe1hTwFvHdUcxtnGYg3/e+DrykR4DMcc bpDsBbo+gGFDMiS0rERMzabqT0YKUEgZvwUps= Received: by 10.141.4.17 with SMTP id g17mr6039039rvi.166.1276626660787; Tue, 15 Jun 2010 11:31:00 -0700 (PDT) Received: from pyunyh@gmail.com ([174.35.1.224]) by mx.google.com with ESMTPS id b12sm6056157rvn.10.2010.06.15.11.30.59 (version=TLSv1/SSLv3 cipher=RC4-MD5); Tue, 15 Jun 2010 11:31:00 -0700 (PDT) Received: by pyunyh@gmail.com (sSMTP sendmail emulation); Tue, 15 Jun 2010 11:30:18 -0700 From: Pyun YongHyeon Date: Tue, 15 Jun 2010 11:30:18 -0700 To: Anders Nordby Message-ID: <20100615183018.GI4257@michelle.cdnetworks.com> References: <20100610081710.GA64350@server.vk2pj.dyndns.org> <20100610110609.GA87243@fupp.net> <20100610114831.GB71432@icarus.home.lan> <20100610130307.GA33285@fupp.net> <20100610133859.GA74094@icarus.home.lan> <20100611031809.GA93666@icarus.home.lan> <20100611163314.GA84574@fupp.net> <20100611175805.GE13776@michelle.cdnetworks.com> <20100611230120.GA89356@fupp.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20100611230120.GA89356@fupp.net> User-Agent: Mutt/1.4.2.3i Cc: freebsd-fs@freebsd.org, Peter Jeremy Subject: Re: Odd network issues on ZFS based NFS server X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: pyunyh@gmail.com List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 Jun 2010 18:31:01 -0000 On Sat, Jun 12, 2010 at 01:01:20AM +0200, Anders Nordby wrote: > Hi, > > On Fri, Jun 11, 2010 at 10:58:05AM -0700, Pyun YongHyeon wrote: > >> Let me know if there's anything bge related I can try/test. It might > >> take a day or two or more. Customer is sort of getting annoyed by these > >> problems, so the room for testing is getting smaller. But of course I > >> want to help get a fix for this. > > Show me dmesg output to know which bge(4) controller you had. And > > show me output of "netstat -ndI bge0". Some bge(4) controllers > > supports detailed MAC counters and these are exported via sysctl. > > If your controller is one of these controller, you can check the > > statistics of controller with "sysctl dev.bge.0.stat" and post it > > if you can see them. > > Since running on rue NIC I didn't retry bge again. But I did not reboot > since I had problems last time either, I just changed NIC from bge1 to > ue0. So I'm not sure if these numbers are interesting or if I should > retry using a bge NIC, but here goes: > > anders@unixfile:~$ grep ^bge1 /var/run/dmesg.boot > bge1: mem > 0xfdce0000-0xfdceffff irq 26 at device 1.1 on pci3 > bge1: Ethernet address: 00:16:35:03:e6:3e > bge1: [ITHREAD] > anders@unixfile:~$ netstat -ndI bge1 > Name Mtu Network Address Ipkts Ierrs Idrop > Opkts Oerrs Coll Drop > bge1* 1500 00:16:35:03:e6:3e 21417404 0 0 > 20313076 0 0 0 > anders@unixfile:~$ sysctl dev.bge.1.stats > dev.bge.1.stats.FramesDroppedDueToFilters: 0 > dev.bge.1.stats.DmaWriteQueueFull: 34 > dev.bge.1.stats.DmaWriteHighPriQueueFull: 0 > dev.bge.1.stats.NoMoreRxBDs: 0 > dev.bge.1.stats.InputDiscards: 0 > dev.bge.1.stats.InputErrors: 0 > dev.bge.1.stats.RecvThresholdHit: 12086131 > dev.bge.1.stats.DmaReadQueueFull: 957280 > dev.bge.1.stats.DmaReadHighPriQueueFull: 4835 > dev.bge.1.stats.SendDataCompQueueFull: 0 > dev.bge.1.stats.RingSetSendProdIndex: 20515417 > dev.bge.1.stats.RingStatusUpdate: 20492506 > dev.bge.1.stats.Interrupts: 20492506 > dev.bge.1.stats.AvoidedInterrupts: 0 > dev.bge.1.stats.SendThresholdHit: 0 > dev.bge.1.stats.rx.Octets: 0 > dev.bge.1.stats.rx.Fragments: 0 > dev.bge.1.stats.rx.UcastPkts: 0 This MAC statistics look odd. netstat(1) showed you had 21417404 input packets and 20313076 output packets. But these counters show all 0s. I have no idea how this can happen. Did the controller ever work? If the controller used to work before, I suspect hardware failure(NIC part). > dev.bge.1.stats.rx.MulticastPkts: 0 > dev.bge.1.stats.rx.FCSErrors: 0 > dev.bge.1.stats.rx.AlignmentErrors: 0 > dev.bge.1.stats.rx.xonPauseFramesReceived: 0 > dev.bge.1.stats.rx.xoffPauseFramesReceived: 0 > dev.bge.1.stats.rx.ControlFramesReceived: 0 > dev.bge.1.stats.rx.xoffStateEntered: 0 > dev.bge.1.stats.rx.FramesTooLong: 0 > dev.bge.1.stats.rx.Jabbers: 0 > dev.bge.1.stats.rx.UndersizePkts: 0 > dev.bge.1.stats.rx.inRangeLengthError: 0 > dev.bge.1.stats.rx.outRangeLengthError: 0 > dev.bge.1.stats.tx.Octets: 0 > dev.bge.1.stats.tx.Collisions: 0 > dev.bge.1.stats.tx.XonSent: 0 > dev.bge.1.stats.tx.XoffSent: 0 > dev.bge.1.stats.tx.flowControlDone: 0 > dev.bge.1.stats.tx.InternalMacTransmitErrors: 0 > dev.bge.1.stats.tx.SingleCollisionFrames: 0 > dev.bge.1.stats.tx.MultipleCollisionFrames: 0 > dev.bge.1.stats.tx.DeferredTransmissions: 0 > dev.bge.1.stats.tx.ExcessiveCollisions: 0 > dev.bge.1.stats.tx.LateCollisions: 0 > dev.bge.1.stats.tx.UcastPkts: 0 > dev.bge.1.stats.tx.MulticastPkts: 0 > dev.bge.1.stats.tx.BroadcastPkts: 0 > dev.bge.1.stats.tx.CarrierSenseErrors: 0 > dev.bge.1.stats.tx.Discards: 0 > dev.bge.1.stats.tx.Errors: 0 > > Regards, > > -- > Anders.