From owner-freebsd-stable@FreeBSD.ORG Fri Feb 26 15:35:58 2010 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B40591065672 for ; Fri, 26 Feb 2010 15:35:58 +0000 (UTC) (envelope-from wjw@digiware.nl) Received: from mail.digiware.nl (mail.ip6.digiware.nl [IPv6:2001:4cb8:1:106::2]) by mx1.freebsd.org (Postfix) with ESMTP id 4AA9E8FC28 for ; Fri, 26 Feb 2010 15:35:58 +0000 (UTC) Received: from localhost (localhost.digiware.nl [127.0.0.1]) by mail.digiware.nl (Postfix) with ESMTP id 94C3E153433; Fri, 26 Feb 2010 16:35:56 +0100 (CET) X-Virus-Scanned: amavisd-new at digiware.nl Received: from mail.digiware.nl ([127.0.0.1]) by localhost (rack1.digiware.nl [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id NHFZRl4wP0mf; Fri, 26 Feb 2010 16:35:54 +0100 (CET) Received: from [192.168.10.67] (opteron [192.168.10.67]) by mail.digiware.nl (Postfix) with ESMTP id 6B6E615342F; Fri, 26 Feb 2010 16:35:54 +0100 (CET) Message-ID: <4B87EACC.80105@digiware.nl> Date: Fri, 26 Feb 2010 16:37:48 +0100 From: Willem Jan Withagen Organization: Digiware User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.7) Gecko/20100111 Thunderbird/3.0.1 MIME-Version: 1.0 To: Daniel Braniss References: <4B86F384.3010308@digiware.nl> <2a41acea1002251459v40e8c6ddxd0437decbada4594@mail.gmail.com> <4B8795B1.4020006@digiware.nl> <20100226120339.GB17798@icarus.home.lan> <20100226133138.d47dd080.gerrit@pmp.uni-hannover.de> <20100226134429.041ea6f2.gerrit@pmp.uni-hannover.de> <20100226141754.86ae5a3f.gerrit@pmp.uni-hannover.de> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: stable@freebsd.org, =?ISO-8859-1?Q?Gerrit_K=FChn?= , Jack Vogel , Jeremy Chadwick Subject: Re: em0 freezes on ZFS server X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Feb 2010 15:35:58 -0000 On 26-2-2010 16:07, Daniel Braniss wrote: >> On Fri, 26 Feb 2010 15:04:37 +0200 Daniel Braniss >> wrote about Re: em0 freezes on ZFS server : >> >> DB> > At least in my case I found out what is eating the buffers: nfsd >> DB> > does! The buffers stop increasing as soon as I stop nfsd. However, >> DB> > they start increasing as soon as I start nfsd again. >> DB> > Are there any ideas how to fix this? Downgrading back to 7-stable is >> DB> > not really an easy task as far as I know, and I need the server to >> DB> > run without having to reboot it once for twice a day... >> >> DB> I want to add some spices to this stew: :-) >> >> You're welcome. :-) >> >> DB> Some few day later it hung, and it's now hanging every few days. >> DB> Most of the hangs are because there is no network, but the NIC is bce >> DB> not em! I doubled kern.ipc.nmbclusters and lets see what happens ... >> >> Do you have nfsd running and serving clients? If so, we should maybe >> change the topic to something like "possible nfs mbuf leakage"... >> > it's only purpose in life is a nfs server. > but I wouldn't exclude zfs from the equation yet. > I have othere nfs servers, not doing zfs and I don't see this. > >> DB> 23066/6634/29700 mbufs in use (current/cache/total) >> >> My server is at 22k now, and the buffer number is still increasing every >> few seconds... >> Can you monitor your mbuf usage and report if it grows? >> > I am, and in the last 2hs. it grew by about 300, it does oscilate, i.e. it > grows some, then > it goes down, but it seems that the low always increases. > > when I have enough data i'll plot it. Same here, from the odd samples I make. If I don't run my compiles, but just let the server sit. It just oscilates +- 500 mbufs. Once I start compiling, mbufs starts growing. I'm now at 22K Main network (NFS) traffic is than postfix writing Maildir dovecot - Maildir work Next to that it is also Samba server, but that doesn't seem to matter that much..... --WjW