From owner-freebsd-stable@FreeBSD.ORG Mon Aug 23 23:43:51 2010 Return-Path: Delivered-To: freebsd-stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D9FBB10656D4 for ; Mon, 23 Aug 2010 23:43:51 +0000 (UTC) (envelope-from tdb@carrick.bishnet.net) Received: from carrick.bishnet.net (carrick.bishnet.net [IPv6:2a01:348:132:1::1]) by mx1.freebsd.org (Postfix) with ESMTP id 9A3BD8FC1B for ; Mon, 23 Aug 2010 23:43:51 +0000 (UTC) Received: from [2a01:348:132:51::10] (helo=carrick-users) by carrick.bishnet.net with esmtps (TLSv1:AES256-SHA:256) (Exim 4.72 (FreeBSD)) (envelope-from ) id 1OnggB-000EQt-Rm; Tue, 24 Aug 2010 00:43:51 +0100 Received: (from tdb@localhost) by carrick-users (8.14.4/8.14.4/Submit) id o7NNhpPF055482; Tue, 24 Aug 2010 00:43:51 +0100 (BST) (envelope-from tdb) Date: Tue, 24 Aug 2010 00:43:51 +0100 From: Tim Bishop To: Peter Jeremy Message-ID: <20100823234351.GC5352@carrick-users.bishnet.net> References: <20100821220435.GA6208@carrick-users.bishnet.net> <20100823204923.GA7142@server.vk2pj.dyndns.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20100823204923.GA7142@server.vk2pj.dyndns.org> X-PGP-Key: 0x5AE7D984, http://www.bishnet.net/tim/tim-bishnet-net.asc X-PGP-Fingerprint: 1453 086E 9376 1A50 ECF6 AE05 7DCE D659 5AE7 D984 User-Agent: Mutt/1.5.20 (2009-06-14) Cc: freebsd-stable@FreeBSD.org Subject: Re: 8.1R ZFS almost locking up system X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Aug 2010 23:43:51 -0000 On Tue, Aug 24, 2010 at 06:49:23AM +1000, Peter Jeremy wrote: > On 2010-Aug-21 23:04:35 +0100, Tim Bishop wrote: > >I've had a problem on a FreeBSD 8.1R system for a few weeks. It seems > >that ZFS gets in to an almost unresponsive state. Last time it did it > >(two weeks ago) I couldn't even log in, although the system was up, this > >time I could manage a reboot but couldn't stop any applications (they > >were likely hanging on I/O). > > Unless you have a ZFS-only system, it's possible you are running out > of free memory (see the "free" entry in top(1) or 'systat -v') - in > which case r211581 (and r211599 which fixes a mismerge) should help. > Your very high kstat.zfs.misc.arcstats.memory_throttle_count suggests > this is your problem. Thanks. At the time I had a reasonable amount free (~450MB from 3GB), but it had dropped lower than that at some points previously. I'll take a closer look at that next time, and look at that patch (or upgrade to 8-STABLE). And the system has a UFS root, but all the apps/data are stored in ZFS. Tim. -- Tim Bishop http://www.bishnet.net/tim/ PGP Key: 0x5AE7D984