From owner-freebsd-fs@FreeBSD.ORG Fri Jun 11 16:33:17 2010 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B39461065673 for ; Fri, 11 Jun 2010 16:33:17 +0000 (UTC) (envelope-from anders@FreeBSD.org) Received: from fupp.net (totem.fix.no [80.91.36.20]) by mx1.freebsd.org (Postfix) with ESMTP id 510298FC14 for ; Fri, 11 Jun 2010 16:33:16 +0000 (UTC) Received: from localhost (totem.fix.no [80.91.36.20]) by fupp.net (Postfix) with ESMTP id 5036547C36; Fri, 11 Jun 2010 18:33:15 +0200 (CEST) Received: from fupp.net ([80.91.36.20]) by localhost (totem.fix.no [80.91.36.20]) (amavisd-new, port 10024) with LMTP id apHlpcw7u46C; Fri, 11 Jun 2010 18:33:14 +0200 (CEST) Received: by fupp.net (Postfix, from userid 1000) id C22D947C35; Fri, 11 Jun 2010 18:33:14 +0200 (CEST) Date: Fri, 11 Jun 2010 18:33:14 +0200 From: Anders Nordby To: Jeremy Chadwick Message-ID: <20100611163314.GA84574@fupp.net> References: <20100608083649.GA77452@fupp.net> <20100609122517.GA16231@fupp.net> <20100610081710.GA64350@server.vk2pj.dyndns.org> <20100610110609.GA87243@fupp.net> <20100610114831.GB71432@icarus.home.lan> <20100610130307.GA33285@fupp.net> <20100610133859.GA74094@icarus.home.lan> <20100611031809.GA93666@icarus.home.lan> Mime-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline In-Reply-To: <20100611031809.GA93666@icarus.home.lan> User-Agent: Mutt/1.4.2.3i X-PGP-Key: http://anders.fix.no/pgp/ X-PGP-Key-FingerPrint: 1E0F C53C D8DF 6A8F EAAD 19C5 D12A BC9F 0083 5956 Cc: freebsd-fs@FreeBSD.org, Peter Jeremy Subject: Re: Odd network issues on ZFS based NFS server X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Jun 2010 16:33:17 -0000 Hi, On Thu, Jun 10, 2010 at 08:18:09PM -0700, Jeremy Chadwick wrote: >> Given that you stated FreeBSD8.1-Prerelease I think you should have the >> patch, but please make sure that your sys/nfsserver/nfs_srvsubs.c is >> at least r206406. I didn't have any time to dump and look at the network traffic much yet (life is busy). But, the issue in this thread also happens/happened in FreeBSD 7.3-RELEASE, so I don't see how it's a recent change that makes this happen. Last night I had some progress, by switching to an old 100 Mbps USB NIC of mine (nerds sure do have lots of handy things at home eh) I got rid of the packet loss: Jun 11 01:25:14 unixfile kernel: rue0: on usbus3 Jun 11 01:25:14 unixfile kernel: miibus2: on rue0 Jun 11 01:25:14 unixfile kernel: ruephy0: PHY 0 on miibus2 Performance is quite lousy however. Just in case I am trying to get hold of a PCI-X Intel NIC to see how that goes, as this is a production server after all (or supposed to be). > With regards to possible bge(4) issues, Yong-Hyeon works on this driver > fairly often. If it turns out to be a driver issue of some sort, he can > probably help. Relevant commits are here (to give you some idea of > activity): > > http://www.freebsd.org/cgi/cvsweb.cgi/src/sys/dev/bge/if_bge.c > > One commit caught my eye (rev 1.226.2.15), but that seems to be more > focused on mbuf issues (your system doesn't appear to be having any, > given your netstat -m output). > > CC'ing Yong-Hyeong, as he might know of some edge case where bge(4) > could go crazy with interrupts. :-) Yong-Hyeon, the entire thread is > here: > > http://lists.freebsd.org/pipermail/freebsd-fs/2010-June/008654.html Let me know if there's anything bge related I can try/test. It might take a day or two or more. Customer is sort of getting annoyed by these problems, so the room for testing is getting smaller. But of course I want to help get a fix for this. Regards, -- Anders.