From owner-freebsd-fs@FreeBSD.ORG Fri Jun 11 18:30:43 2010 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 03B101065678; Fri, 11 Jun 2010 18:30:43 +0000 (UTC) (envelope-from pyunyh@gmail.com) Received: from mail-pw0-f54.google.com (mail-pw0-f54.google.com [209.85.160.54]) by mx1.freebsd.org (Postfix) with ESMTP id 6F21F8FC16; Fri, 11 Jun 2010 18:30:42 +0000 (UTC) Received: by pwj1 with SMTP id 1so976169pwj.13 for ; Fri, 11 Jun 2010 11:30:41 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:received:from:date:to:cc :subject:message-id:reply-to:references:mime-version:content-type :content-disposition:in-reply-to:user-agent; bh=cb6N/hi4tPsh8RXsxGECMvteyup7Qjnfqn9C6dF610c=; b=mzBcOiKtVrB9Me0LSvEwQo1GWU7qzlYWqrjwwMTlx4unTzbjVR98URePda4Izr3ACC zcdqsfnRflDbq4RENz0kxCqSL7PCXoxe5+FTty8FIHmbyaoGBU9eJmiz7fLwlNWPhiSZ wLQ+tevt04A8N85P1BigIOjg+VZ2KhuTu02HI= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=from:date:to:cc:subject:message-id:reply-to:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; b=nXb1jkn2T7RQ+yq3o4iuziTYxoDQnpy9nsYlQbESm4Glou7RLEsssfY9UoI8vZD+il UWlBIeR9mmeC4sKEaCC53i+BJSVyaUdwRDfIHMHo2DPuKoLuKLW96wkmcAmh/5ECY87A tKPv9NIw/LJ+86CJ9LvBpbV9G8WlfL9+de2aI= Received: by 10.140.55.13 with SMTP id d13mr1674983rva.119.1276279167128; Fri, 11 Jun 2010 10:59:27 -0700 (PDT) Received: from pyunyh@gmail.com ([174.35.1.224]) by mx.google.com with ESMTPS id b12sm1435975rvn.22.2010.06.11.10.59.25 (version=TLSv1/SSLv3 cipher=RC4-MD5); Fri, 11 Jun 2010 10:59:26 -0700 (PDT) Received: by pyunyh@gmail.com (sSMTP sendmail emulation); Fri, 11 Jun 2010 10:58:05 -0700 From: Pyun YongHyeon Date: Fri, 11 Jun 2010 10:58:05 -0700 To: Anders Nordby Message-ID: <20100611175805.GE13776@michelle.cdnetworks.com> References: <20100609122517.GA16231@fupp.net> <20100610081710.GA64350@server.vk2pj.dyndns.org> <20100610110609.GA87243@fupp.net> <20100610114831.GB71432@icarus.home.lan> <20100610130307.GA33285@fupp.net> <20100610133859.GA74094@icarus.home.lan> <20100611031809.GA93666@icarus.home.lan> <20100611163314.GA84574@fupp.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20100611163314.GA84574@fupp.net> User-Agent: Mutt/1.4.2.3i Cc: freebsd-fs@freebsd.org, Peter Jeremy Subject: Re: Odd network issues on ZFS based NFS server X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: pyunyh@gmail.com List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Jun 2010 18:30:43 -0000 On Fri, Jun 11, 2010 at 06:33:14PM +0200, Anders Nordby wrote: > Hi, > > On Thu, Jun 10, 2010 at 08:18:09PM -0700, Jeremy Chadwick wrote: > >> Given that you stated FreeBSD8.1-Prerelease I think you should have the > >> patch, but please make sure that your sys/nfsserver/nfs_srvsubs.c is > >> at least r206406. > > I didn't have any time to dump and look at the network traffic much yet > (life is busy). But, the issue in this thread also happens/happened in > FreeBSD 7.3-RELEASE, so I don't see how it's a recent change that makes > this happen. Last night I had some progress, by switching to an old 100 > Mbps USB NIC of mine (nerds sure do have lots of handy things at home > eh) I got rid of the packet loss: > > Jun 11 01:25:14 unixfile kernel: rue0: 0/0, rev > 1.10/1.00, addr 2> on usbus3 > Jun 11 01:25:14 unixfile kernel: miibus2: on rue0 > Jun 11 01:25:14 unixfile kernel: ruephy0: media interf > ace> PHY 0 on miibus2 > > Performance is quite lousy however. Just in case I am trying to get hold > of a PCI-X Intel NIC to see how that goes, as this is a production > server after all (or supposed to be). > > > With regards to possible bge(4) issues, Yong-Hyeon works on this driver > > fairly often. If it turns out to be a driver issue of some sort, he can > > probably help. Relevant commits are here (to give you some idea of > > activity): > > > > http://www.freebsd.org/cgi/cvsweb.cgi/src/sys/dev/bge/if_bge.c > > > > One commit caught my eye (rev 1.226.2.15), but that seems to be more > > focused on mbuf issues (your system doesn't appear to be having any, > > given your netstat -m output). > > > > CC'ing Yong-Hyeong, as he might know of some edge case where bge(4) > > could go crazy with interrupts. :-) Yong-Hyeon, the entire thread is > > here: > > > > http://lists.freebsd.org/pipermail/freebsd-fs/2010-June/008654.html > > Let me know if there's anything bge related I can try/test. It might > take a day or two or more. Customer is sort of getting annoyed by these > problems, so the room for testing is getting smaller. But of course I > want to help get a fix for this. > Show me dmesg output to know which bge(4) controller you had. And show me output of "netstat -ndI bge0". Some bge(4) controllers supports detailed MAC counters and these are exported via sysctl. If your controller is one of these controller, you can check the statistics of controller with "sysctl dev.bge.0.stat" and post it if you can see them. > Regards, > > -- > Anders.