From owner-freebsd-fs@FreeBSD.ORG Mon May 21 16:10:07 2007 Return-Path: X-Original-To: freebsd-fs@FreeBSD.org Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 01E7C16A468; Mon, 21 May 2007 16:10:07 +0000 (UTC) (envelope-from jhary@unsane.co.uk) Received: from unsane.co.uk (www.unsane.co.uk [85.233.185.162]) by mx1.freebsd.org (Postfix) with ESMTP id 4DCEC13C44B; Mon, 21 May 2007 16:10:05 +0000 (UTC) (envelope-from jhary@unsane.co.uk) Received: from prawn.unsane.co.uk (150.117-84-212.staticip.namesco.net [212.84.117.150]) (authenticated bits=0) by unsane.co.uk (8.14.0/8.14.0) with ESMTP id l4LFeKLo093159 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Mon, 21 May 2007 16:40:21 +0100 (BST) (envelope-from jhary@unsane.co.uk) Message-ID: <4651BD6F.5050301@unsane.co.uk> Date: Mon, 21 May 2007 16:40:31 +0100 From: Vince User-Agent: Thunderbird 2.0.0.0 (X11/20070516) MIME-Version: 1.0 To: Craig Boston , Kris Kennaway , freebsd-current@FreeBSD.org, Pawel Jakub Dawidek , freebsd-fs@FreeBSD.org References: <20070407131353.GE63916@garage.freebsd.pl> <4617A3A6.60804@kasimir.com> <20070407165759.GG8831@cicely12.cicely.de> <20070407180319.GH8831@cicely12.cicely.de> <20070407191517.GN63916@garage.freebsd.pl> <20070407212413.GK8831@cicely12.cicely.de> <20070410003505.GA8189@nowhere> <20070410003837.GB8189@nowhere> <20070410011125.GB38535@xor.obsecurity.org> <20070410013034.GC8189@nowhere> <20070410014233.GD8189@nowhere> In-Reply-To: <20070410014233.GD8189@nowhere> X-Enigmail-Version: 0.95.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: Subject: Re: ZFS committed to the FreeBSD base. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 21 May 2007 16:10:07 -0000 Craig Boston wrote: > On Mon, Apr 09, 2007 at 08:30:35PM -0500, Craig Boston wrote: >> Even the vm.zone breakdown seems to be gone in current so apparently my >> knowledge of such things is becoming obsolete :) > > But vmstat -m still works > > ... > > solaris 145806 122884K - 15319671 16,32,64,128,256,512,1024,2048,4096 > ... > > Whoa! That's a lot of kernel memory. Meanwhile... > > kstat.zfs.misc.arcstats.size: 33554944 > (which is just barely above vfs.zfs.arc_min) > > So I don't think it's the arc cache (yeah I know that's redundant) that > is the problem. Seems like something elsewhere in zfs is allocating > large amounts of memory and not letting it go, and even the cache is > having to shrink to its minimum size due to the memory pressure. > > It didn't panic this time, so when the tar finished I tried a "zfs > unmount /usr/ports". This caused the "solaris" entry to drop down to > about 64MB, so it's not a leak. It could just be that ZFS needs lots of > memory to operate if it keeps a lot of metadata for each file in memory. > > The sheer # of allocations still seems excessive though. It was well > over 20 million by the time the tar process exited. > I dont suppose that there are any other tunables people could suggest? I got a shiny new(well old but new to me) dual opteron board and dual 250 sata drives and though i'd try putting it in as my home server with everything but / on zfs since i've had my /usr/ports on my laptop as compressed zfs since very shortly after it was commited. After a few kmem_map: too small" panics I re-read this thread and put vm.kmem_size_max and vm.kmem_size up to 512M and vfs.zfs.arc_min vfs.zfs.arc_max down to 65 megs. This did get me past "portsnap extract" but a make buildworld still got me the same panic. vmstat -z showed a steady growth. This is with a generic -CURRENT from friday. I'm happy to provide any useful information once I get home and reboot it. Thanks, Vince > Craig > _______________________________________________ > freebsd-current@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-current > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org"