From owner-freebsd-stable@FreeBSD.ORG Wed Mar 10 00:18:30 2010 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id BD6DC106564A for ; Wed, 10 Mar 2010 00:18:30 +0000 (UTC) (envelope-from oberman@es.net) Received: from mailgw.es.net (mail1.es.net [IPv6:2001:400:201:1::2]) by mx1.freebsd.org (Postfix) with ESMTP id 6C57B8FC0A for ; Wed, 10 Mar 2010 00:18:29 +0000 (UTC) Received: from ptavv.es.net (ptavv.es.net [IPv6:2001:400:910::29]) by mailgw.es.net (8.14.3/8.14.3) with ESMTP id o2A0IPpk007321 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Tue, 9 Mar 2010 16:18:25 -0800 Received: from ptavv.es.net (localhost [127.0.0.1]) by ptavv.es.net (Tachyon Server) with ESMTP id 4B2061CC0D; Tue, 9 Mar 2010 16:18:25 -0800 (PST) To: Peter Jeremy In-reply-to: Your message of "Tue, 09 Mar 2010 21:53:55 +1100." <20100309105355.GD3978@server.vk2pj.dyndns.org> Date: Tue, 09 Mar 2010 16:18:25 -0800 From: "Kevin Oberman" Message-Id: <20100310001825.4B2061CC0D@ptavv.es.net> X-Proofpoint-Virus-Version: vendor=fsecure engine=1.12.8161:2.4.5, 1.2.40, 4.0.166 definitions=2010-03-10_01:2010-02-06, 2010-03-10, 2010-03-09 signatures=0 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 spamscore=0 ipscore=0 phishscore=0 bulkscore=0 adultscore=0 classifier=spam adjust=0 reason=mlx engine=5.0.0-0908210000 definitions=main-1003090242 Cc: FreeBSD Stable , Stefan Bethke Subject: Re: Many processes stuck in zfs X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Mar 2010 00:18:30 -0000 > Date: Tue, 9 Mar 2010 21:53:55 +1100 > From: Peter Jeremy > Sender: owner-freebsd-stable@freebsd.org > > On 2010-Mar-09 10:15:53 +0100, Stefan Bethke wrote: > >Over the past couple of months, I've more or less regularly observed machines having more and more processes stuck in the zfs wchan. The processes never recover from that, > > How long have you waited? > > There seems to be a problem with low free memory handling that causes ZFS > to turn into cold molasses. The work-around is to run a program that > allocates a decent size chunk of memory and then exits. The original > suggestion was something like: > perl -e '@x = (0) x 1000000;' > I've written a short program that allocates and dirties ~100MB and then > exits and run it from cron. Sigh! I found it. I build my systems without NIS and I had the stock nsswitch.conf file. Fixed. /me banging my head against the desk. Thanks! -- R. Kevin Oberman, Network Engineer Energy Sciences Network (ESnet) Ernest O. Lawrence Berkeley National Laboratory (Berkeley Lab) E-mail: oberman@es.net Phone: +1 510 486-8634 Key fingerprint:059B 2DDF 031C 9BA3 14A4 EADA 927D EBB3 987B 3751