From owner-freebsd-stable@FreeBSD.ORG Tue Aug 2 19:59:50 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5DD3B1065674 for ; Tue, 2 Aug 2011 19:59:50 +0000 (UTC) (envelope-from ronald-freebsd8@klop.yi.org) Received: from fep21.mx.upcmail.net (fep21.mx.upcmail.net [62.179.121.41]) by mx1.freebsd.org (Postfix) with ESMTP id 0DDBF8FC0C for ; Tue, 2 Aug 2011 19:59:48 +0000 (UTC) Received: from edge02.upcmail.net ([192.168.13.237]) by viefep17-int.chello.at (InterMail vM.8.01.02.02 201-2260-120-106-20100312) with ESMTP id <20110802195939.YVOG8134.viefep17-int.chello.at@edge02.upcmail.net> for ; Tue, 2 Aug 2011 21:59:39 +0200 Received: from pinky ([95.96.138.26]) by edge02.upcmail.net with edge id FXzd1h06T0aMTqv02Xzeva; Tue, 02 Aug 2011 21:59:39 +0200 X-SourceIP: 95.96.138.26 Content-Type: text/plain; charset=utf-8; format=flowed; delsp=yes To: freebsd-stable@freebsd.org References: <20110802090830.GA92646@icarus.home.lan> <20110802094226.GA93114@icarus.home.lan> <42039B84-D6CE-4780-AA70-8500B1B32036@gsoft.com.au> <4E37CD13.1070402@digsys.bg> Date: Tue, 02 Aug 2011 21:59:37 +0200 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit From: "Ronald Klop" Message-ID: In-Reply-To: User-Agent: Opera Mail/11.50 (Win32) X-Cloudmark-Analysis: v=1.1 cv=HQ3F56nxkum+cgCiDL7AXQpbvw7DWrWCBJRnYYnM0Zc= c=1 sm=0 a=jSLzLkXI7GEA:10 a=vcqGe1LRAV8A:10 a=bgpUlknNv7MA:10 a=IkcTkHD0fZMA:10 a=pGLkceISAAAA:8 a=D9flXBp1TUvwEZZsISwA:9 a=QEXdDO2ut3YA:10 a=MSl-tDqOz04A:10 a=HpAAvcLHHh0Zw7uRqdWCyQ==:117 Subject: zpool doesn't upgrade - Re: ZFS directory with a large number of files X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 02 Aug 2011 19:59:50 -0000 On Tue, 02 Aug 2011 12:55:43 +0200, seanrees@gmail.com wrote: > On Tue, Aug 2, 2011 at 11:10 AM, Daniel Kalchev wrote: >>> If it is a limitation in ZFS it would be nice to know that, perhaps it >>> truly, really is a bug that can be avoided (or it's inherent in the >>> way ZFS >>> handles such things) >> >> It is possible that there is not enough memory in ARC to cache that >> large >> directory. >> >> Other than that, perhaps in ZFS it would be easier to prune the unused >> directory entries, than it is in UFS. It looks like this is not >> implemented. >> >> Another reason might be some FreeBSD specific implementation issue for >> fstatfs. >> >> In any case, the data available is not sufficient. More information >> would >> help, like how much RAM this system has, how much ARC uses, some ARC >> stats. > > Which sysctl's would you like? > > I grabbed these to start: > kstat.zfs.misc.arcstats.size: 118859656 > kstat.zfs.misc.arcstats.hdr_size: 3764416 > kstat.zfs.misc.arcstats.data_size: 53514240 > kstat.zfs.misc.arcstats.other_size: 61581000 > > kstat.zfs.misc.arcstats.hits: 46762467 > kstat.zfs.misc.arcstats.misses: 16999907 > > The machine has 2GB of memory. > >> What made me wonder is .. how exactly the kernel and zpool disagree on >> zpool >> version? What is the pool version in fact? > > % dmesg | grep ZFS > ZFS NOTICE: Prefetch is disabled by default if less than 4GB of RAM is > present; > to enable, add "vfs.zfs.prefetch_disable=0" to > /boot/loader.conf. > ZFS filesystem version 5 > ZFS storage pool version 28 > > % zpool get version tank > NAME PROPERTY VALUE SOURCE > tank version 15 local > > % zpool upgrade tank > This system is currently running ZFS pool version 15. > > Pool 'tank' is already formatted using the current version. > > > Sean I think this zpool upgrade thing is weird. Can you try 'zpool upgrade -a'? Mine says: zpool get version zroot NAME PROPERTY VALUE SOURCE zroot version 28 default Mind the SOURCE=default vs. SOURCE=local. Is it possible you did 'zpool set version=15 tank' in the past? You can check that with 'zpool history'. NB: if you upgrade the boot pool, don't forget to upgrade to boot loader. (See UPDATING) Ronald.