From owner-freebsd-fs@FreeBSD.ORG Fri Jun 11 23:01:21 2010 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id CBF5A106566B for ; Fri, 11 Jun 2010 23:01:21 +0000 (UTC) (envelope-from anders@FreeBSD.org) Received: from fupp.net (totem.fix.no [80.91.36.20]) by mx1.freebsd.org (Postfix) with ESMTP id 52AF38FC12 for ; Fri, 11 Jun 2010 23:01:20 +0000 (UTC) Received: from localhost (totem.fix.no [80.91.36.20]) by fupp.net (Postfix) with ESMTP id C16B347194; Sat, 12 Jun 2010 01:01:20 +0200 (CEST) Received: from fupp.net ([80.91.36.20]) by localhost (totem.fix.no [80.91.36.20]) (amavisd-new, port 10024) with LMTP id Lpuwp0wZHxGg; Sat, 12 Jun 2010 01:01:20 +0200 (CEST) Received: by fupp.net (Postfix, from userid 1000) id 545BD47193; Sat, 12 Jun 2010 01:01:20 +0200 (CEST) Date: Sat, 12 Jun 2010 01:01:20 +0200 From: Anders Nordby To: Pyun YongHyeon Message-ID: <20100611230120.GA89356@fupp.net> References: <20100609122517.GA16231@fupp.net> <20100610081710.GA64350@server.vk2pj.dyndns.org> <20100610110609.GA87243@fupp.net> <20100610114831.GB71432@icarus.home.lan> <20100610130307.GA33285@fupp.net> <20100610133859.GA74094@icarus.home.lan> <20100611031809.GA93666@icarus.home.lan> <20100611163314.GA84574@fupp.net> <20100611175805.GE13776@michelle.cdnetworks.com> Mime-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline In-Reply-To: <20100611175805.GE13776@michelle.cdnetworks.com> User-Agent: Mutt/1.4.2.3i X-PGP-Key: http://anders.fix.no/pgp/ X-PGP-Key-FingerPrint: 1E0F C53C D8DF 6A8F EAAD 19C5 D12A BC9F 0083 5956 Cc: freebsd-fs@freebsd.org, Peter Jeremy Subject: Re: Odd network issues on ZFS based NFS server X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Jun 2010 23:01:21 -0000 Hi, On Fri, Jun 11, 2010 at 10:58:05AM -0700, Pyun YongHyeon wrote: >> Let me know if there's anything bge related I can try/test. It might >> take a day or two or more. Customer is sort of getting annoyed by these >> problems, so the room for testing is getting smaller. But of course I >> want to help get a fix for this. > Show me dmesg output to know which bge(4) controller you had. And > show me output of "netstat -ndI bge0". Some bge(4) controllers > supports detailed MAC counters and these are exported via sysctl. > If your controller is one of these controller, you can check the > statistics of controller with "sysctl dev.bge.0.stat" and post it > if you can see them. Since running on rue NIC I didn't retry bge again. But I did not reboot since I had problems last time either, I just changed NIC from bge1 to ue0. So I'm not sure if these numbers are interesting or if I should retry using a bge NIC, but here goes: anders@unixfile:~$ grep ^bge1 /var/run/dmesg.boot bge1: mem 0xfdce0000-0xfdceffff irq 26 at device 1.1 on pci3 bge1: Ethernet address: 00:16:35:03:e6:3e bge1: [ITHREAD] anders@unixfile:~$ netstat -ndI bge1 Name Mtu Network Address Ipkts Ierrs Idrop Opkts Oerrs Coll Drop bge1* 1500 00:16:35:03:e6:3e 21417404 0 0 20313076 0 0 0 anders@unixfile:~$ sysctl dev.bge.1.stats dev.bge.1.stats.FramesDroppedDueToFilters: 0 dev.bge.1.stats.DmaWriteQueueFull: 34 dev.bge.1.stats.DmaWriteHighPriQueueFull: 0 dev.bge.1.stats.NoMoreRxBDs: 0 dev.bge.1.stats.InputDiscards: 0 dev.bge.1.stats.InputErrors: 0 dev.bge.1.stats.RecvThresholdHit: 12086131 dev.bge.1.stats.DmaReadQueueFull: 957280 dev.bge.1.stats.DmaReadHighPriQueueFull: 4835 dev.bge.1.stats.SendDataCompQueueFull: 0 dev.bge.1.stats.RingSetSendProdIndex: 20515417 dev.bge.1.stats.RingStatusUpdate: 20492506 dev.bge.1.stats.Interrupts: 20492506 dev.bge.1.stats.AvoidedInterrupts: 0 dev.bge.1.stats.SendThresholdHit: 0 dev.bge.1.stats.rx.Octets: 0 dev.bge.1.stats.rx.Fragments: 0 dev.bge.1.stats.rx.UcastPkts: 0 dev.bge.1.stats.rx.MulticastPkts: 0 dev.bge.1.stats.rx.FCSErrors: 0 dev.bge.1.stats.rx.AlignmentErrors: 0 dev.bge.1.stats.rx.xonPauseFramesReceived: 0 dev.bge.1.stats.rx.xoffPauseFramesReceived: 0 dev.bge.1.stats.rx.ControlFramesReceived: 0 dev.bge.1.stats.rx.xoffStateEntered: 0 dev.bge.1.stats.rx.FramesTooLong: 0 dev.bge.1.stats.rx.Jabbers: 0 dev.bge.1.stats.rx.UndersizePkts: 0 dev.bge.1.stats.rx.inRangeLengthError: 0 dev.bge.1.stats.rx.outRangeLengthError: 0 dev.bge.1.stats.tx.Octets: 0 dev.bge.1.stats.tx.Collisions: 0 dev.bge.1.stats.tx.XonSent: 0 dev.bge.1.stats.tx.XoffSent: 0 dev.bge.1.stats.tx.flowControlDone: 0 dev.bge.1.stats.tx.InternalMacTransmitErrors: 0 dev.bge.1.stats.tx.SingleCollisionFrames: 0 dev.bge.1.stats.tx.MultipleCollisionFrames: 0 dev.bge.1.stats.tx.DeferredTransmissions: 0 dev.bge.1.stats.tx.ExcessiveCollisions: 0 dev.bge.1.stats.tx.LateCollisions: 0 dev.bge.1.stats.tx.UcastPkts: 0 dev.bge.1.stats.tx.MulticastPkts: 0 dev.bge.1.stats.tx.BroadcastPkts: 0 dev.bge.1.stats.tx.CarrierSenseErrors: 0 dev.bge.1.stats.tx.Discards: 0 dev.bge.1.stats.tx.Errors: 0 Regards, -- Anders.