From owner-freebsd-fs@FreeBSD.ORG Tue Apr 10 01:42:37 2007 Return-Path: X-Original-To: freebsd-fs@FreeBSD.org Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id C1F2D16A400; Tue, 10 Apr 2007 01:42:37 +0000 (UTC) (envelope-from craig@xfoil.gank.org) Received: from ion.gank.org (ion.gank.org [69.55.238.164]) by mx1.freebsd.org (Postfix) with ESMTP id A4AEF13C455; Tue, 10 Apr 2007 01:42:35 +0000 (UTC) (envelope-from craig@xfoil.gank.org) Received: by ion.gank.org (Postfix, from userid 1001) id 6B05D110C5; Mon, 9 Apr 2007 20:42:35 -0500 (CDT) Date: Mon, 9 Apr 2007 20:42:33 -0500 From: Craig Boston To: Kris Kennaway , freebsd-current@FreeBSD.org, Pawel Jakub Dawidek , freebsd-fs@FreeBSD.org Message-ID: <20070410014233.GD8189@nowhere> Mail-Followup-To: Craig Boston , Kris Kennaway , freebsd-current@FreeBSD.org, Pawel Jakub Dawidek , freebsd-fs@FreeBSD.org References: <20070407131353.GE63916@garage.freebsd.pl> <4617A3A6.60804@kasimir.com> <20070407165759.GG8831@cicely12.cicely.de> <20070407180319.GH8831@cicely12.cicely.de> <20070407191517.GN63916@garage.freebsd.pl> <20070407212413.GK8831@cicely12.cicely.de> <20070410003505.GA8189@nowhere> <20070410003837.GB8189@nowhere> <20070410011125.GB38535@xor.obsecurity.org> <20070410013034.GC8189@nowhere> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20070410013034.GC8189@nowhere> User-Agent: Mutt/1.4.2.2i Cc: Subject: Re: ZFS committed to the FreeBSD base. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 10 Apr 2007 01:42:37 -0000 On Mon, Apr 09, 2007 at 08:30:35PM -0500, Craig Boston wrote: > Even the vm.zone breakdown seems to be gone in current so apparently my > knowledge of such things is becoming obsolete :) But vmstat -m still works ... solaris 145806 122884K - 15319671 16,32,64,128,256,512,1024,2048,4096 ... Whoa! That's a lot of kernel memory. Meanwhile... kstat.zfs.misc.arcstats.size: 33554944 (which is just barely above vfs.zfs.arc_min) So I don't think it's the arc cache (yeah I know that's redundant) that is the problem. Seems like something elsewhere in zfs is allocating large amounts of memory and not letting it go, and even the cache is having to shrink to its minimum size due to the memory pressure. It didn't panic this time, so when the tar finished I tried a "zfs unmount /usr/ports". This caused the "solaris" entry to drop down to about 64MB, so it's not a leak. It could just be that ZFS needs lots of memory to operate if it keeps a lot of metadata for each file in memory. The sheer # of allocations still seems excessive though. It was well over 20 million by the time the tar process exited. Craig