From owner-freebsd-stable@FreeBSD.ORG Tue May 16 01:23:41 2006 Return-Path: X-Original-To: stable@freebsd.org Delivered-To: freebsd-stable@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 508B516A95A for ; Tue, 16 May 2006 01:23:41 +0000 (UTC) (envelope-from grafan@gmail.com) Received: from nz-out-0102.google.com (nz-out-0102.google.com [64.233.162.203]) by mx1.FreeBSD.org (Postfix) with ESMTP id C3FFA43D45 for ; Tue, 16 May 2006 01:23:40 +0000 (GMT) (envelope-from grafan@gmail.com) Received: by nz-out-0102.google.com with SMTP id s18so169016nze for ; Mon, 15 May 2006 18:23:40 -0700 (PDT) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=hcEbg2ccd3bHRoHZBwY5wKf++G2vtdCVt+0XrKVtRujSx/BCkkhkFOLgr8/zyuH2t6/Mm3o+GHxylrvNm8KwXigjHkn0k3h0aISCzErj00pnWYp75yBlCUxDXyqPMg2bsH8jRFCn2v9JAuPr60CjzOv5sznLeHjk+kQ48bPcU48= Received: by 10.36.19.18 with SMTP id 18mr3609105nzs; Mon, 15 May 2006 18:23:40 -0700 (PDT) Received: by 10.36.60.19 with HTTP; Mon, 15 May 2006 18:23:40 -0700 (PDT) Message-ID: <6eb82e0605151823x270b10f5j12c7fa2216b52f3f@mail.gmail.com> Date: Mon, 15 May 2006 21:23:40 -0400 From: "Rong-en Fan" To: stable@freebsd.org In-Reply-To: <20060515191628.GC4555@dimma.mow.oilspace.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: quoted-printable Content-Disposition: inline References: <6eb82e0605151115x28522ac5i3790febecb2f0691@mail.gmail.com> <20060515191628.GC4555@dimma.mow.oilspace.com> Cc: Subject: Re: 6.1-RELEASE, em0 high interrupt rate and nfsd eats lots of cpu X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 May 2006 01:23:41 -0000 On 5/15/06, Dmitriy Kirhlarov wrote: > On Mon, May 15, 2006 at 02:15:08PM -0400, Rong-en Fan wrote: > > Hi, > > > > After upgrading from 5.5-PRERELEASE to 6.1-RELEASE on one > > nfs server today, I noticed that the load is very high, ranging from 4.= x > > to 30.x, depends how many nfsd I run. From mrtg traffic graph, I did > > not notice there is high traffic. This box is 2 physical Xeon CPU w/ > > I have same situation today on RC2. > One client installing world from nfs share. > nfsd eat 91% CPU, load average 6-8. Very small disk activitie. > I don't look interrupt rate. > I, also, have em0. After some digging, I found the cpu-eater nfsd can be triggered by running ``du'' on nfs client (both FreeBSD 6.1-R and Linux box). The nfsd will eat lots of CPU. After the client's du is finished, the nfsd still eat lots of CPU. The workaround is to /etc/rc.d/nfsd restart Everything will be just fine. Besides du, on FreeBSD 6.1-R client, buildkernel over nfs will trigger the same behavior. I just downgraded this box to 6.0-RELEASE and everything works fine. Running du or buildkernel from nfs client do not trigger the same behavior. I will try to do a binary search from 6.0-R to 6.1-R see if I can find out related commits. By the way, I have another nfs server running 6.1-RELEASE, but it does not exhibit this behavior. Kernel conf and sysctl are basically the same for both boxes. Regards, Rong-En Fan