From owner-freebsd-stable@FreeBSD.ORG Mon Jun 28 04:58:55 2010 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 099D6106564A for ; Mon, 28 Jun 2010 04:58:55 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from qmta14.emeryville.ca.mail.comcast.net (qmta14.emeryville.ca.mail.comcast.net [76.96.27.212]) by mx1.freebsd.org (Postfix) with ESMTP id E34838FC0C for ; Mon, 28 Jun 2010 04:58:54 +0000 (UTC) Received: from omta03.emeryville.ca.mail.comcast.net ([76.96.30.27]) by qmta14.emeryville.ca.mail.comcast.net with comcast id bGeC1e0060b6N64AEGyuTU; Mon, 28 Jun 2010 04:58:54 +0000 Received: from koitsu.dyndns.org ([98.248.46.159]) by omta03.emeryville.ca.mail.comcast.net with comcast id bGyt1e0033S48mS8PGytDe; Mon, 28 Jun 2010 04:58:54 +0000 Received: by icarus.home.lan (Postfix, from userid 1000) id 0DE659B425; Sun, 27 Jun 2010 21:58:53 -0700 (PDT) Date: Sun, 27 Jun 2010 21:58:53 -0700 From: Jeremy Chadwick To: "Rick C. Petty" Message-ID: <20100628045852.GA75380@icarus.home.lan> References: <20100627221607.GA31646@kay.kiwi-computer.com> <20100628031401.GA45282@kay.kiwi-computer.com> <20100628034741.GA45748@kay.kiwi-computer.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20100628034741.GA45748@kay.kiwi-computer.com> User-Agent: Mutt/1.5.20 (2009-06-14) Cc: Rick Macklem , freebsd-stable@freebsd.org Subject: Re: Why is NFSv4 so slow? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Jun 2010 04:58:55 -0000 On Sun, Jun 27, 2010 at 10:47:41PM -0500, Rick C. Petty wrote: > On Sun, Jun 27, 2010 at 08:04:28PM -0400, Rick Macklem wrote: > > > > Weird, I don't see that here. The only thing I can think of is that the > > experimental client/server will try to do I/O at the size of MAXBSIZE > > by default, which might be causing a burst of traffic your net interface > > can't keep up with. (This can be turned down to 32K via the > > rsize=32768,wsize=32768 mount options. I found this necessary to avoid > > abissmal performance on some Macs for the Mac OS X port.) > > I just ran into the speed problem again after remounting. This time > I tried to do a "make buildworld" and make got stuck on [newnfsreq] for > ten minutes, with no other filesystem activity on either client or server. > > The file system corruption is still pretty bad. I can no longer build any > ports on one machine, because after the port is extracted, the config.sub > files are being filled with all zeros. It took me awhile to track this > down while trying to build devel/libtool22: > > + ac_build_alias=amd64-portbld-freebsd8.1 > + test xamd64-portbld-freebsd8.1 = x > + test xamd64-portbld-freebsd8.1 = x > + /bin/sh libltdl/config/config.sub amd64-portbld-freebsd8.1 > + ac_cv_build='' > + printf '%s\n' 'configure:4596: result: ' > + printf '%s\n' '' > > + as_fn_error 'invalid value of canonical build' 4600 5 > + as_status=0 > + test 0 -eq 0 > + as_status=1 > + test 5 > > And although my work dir is on local disk, > > % hd work/libtool-2.2.6b/libltdl/config/config.sub: > > 00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > |................| > * > 00007660 > > Again, my ports tree is mounted as FSType nfs with option nfsv4. > FreeBSD/amd64 8.1-PRERELEASE r208408M GENERIC kernel. This sounds like NFSv4 is "tickling" some kind of bug in your NIC driver but I'm not entirely sure. Can you provide output from: 1) ifconfig -a (you can X out the IPs + MACs if you want) 2) netstat -m 3) vmstat -i 4) prtconf -lvc (only need the Ethernet-related entries) 5) sysctl dev.XXX.N (ex. for em0, XXX=em, N=0) And also check "dmesg" to see if there's any messages the kernel has been spitting out which look relevant? Thanks. -- | Jeremy Chadwick jdc@parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB |