From owner-freebsd-fs@FreeBSD.ORG Sun Mar 27 09:41:23 2011 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7FC5E106564A for ; Sun, 27 Mar 2011 09:41:23 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from qmta05.emeryville.ca.mail.comcast.net (qmta05.emeryville.ca.mail.comcast.net [76.96.30.48]) by mx1.freebsd.org (Postfix) with ESMTP id 6456B8FC17 for ; Sun, 27 Mar 2011 09:41:22 +0000 (UTC) Received: from omta07.emeryville.ca.mail.comcast.net ([76.96.30.59]) by qmta05.emeryville.ca.mail.comcast.net with comcast id Q9fy1g0021GXsucA59hNhK; Sun, 27 Mar 2011 09:41:22 +0000 Received: from koitsu.dyndns.org ([67.180.84.87]) by omta07.emeryville.ca.mail.comcast.net with comcast id Q9hM1g00M1t3BNj8U9hMC1; Sun, 27 Mar 2011 09:41:22 +0000 Received: by icarus.home.lan (Postfix, from userid 1000) id 9AB549B429; Sun, 27 Mar 2011 02:41:21 -0700 (PDT) Date: Sun, 27 Mar 2011 02:41:21 -0700 From: Jeremy Chadwick To: Dr Josef Karthauser Message-ID: <20110327094121.GA72701@icarus.home.lan> References: <9CF23177-92D6-40C5-8C68-B7E2F88236E6@unitedlane.com> <20110326225430.00006a76@unknown> <3BBB1E36-8E09-4D07-B49E-ACA8548B0B44@unitedlane.com> <20110327075814.GA71131@icarus.home.lan> <20110327084355.GA71864@icarus.home.lan> <094E71D9-B28B-46DB-8EA9-B11F17D5A32A@unitedlane.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <094E71D9-B28B-46DB-8EA9-B11F17D5A32A@unitedlane.com> User-Agent: Mutt/1.5.21 (2010-09-15) Cc: freebsd-fs@freebsd.org Subject: Re: ZFS Problem - full disk, can't recover space :(. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 27 Mar 2011 09:41:23 -0000 On Sun, Mar 27, 2011 at 10:31:05AM +0100, Dr Josef Karthauser wrote: > On 27 Mar 2011, at 09:43, Jeremy Chadwick wrote: > >>>> > >>>> This is the problematic filesystem: > >>>> > >>>> void/j/legacy-alpha 56.6G 3.41G 56.6G /j/legacy-alpha > >>>> > >>>> No chance that an application is holding any data - I rebooting and came up > >>>> in single user mode to try and get this resolved, but no cookie. > >>> > >>> Are these filesystems using compression? Have any quota or reservation > >>> filesystem settings set? > >>> > >>> "zfs get all" might help, but it'll be a lot of data. We don't mind. > >>> > >> > >> Ok, here you are. ( http://www.josef-k.net/misc/zfsall.txt.bz2 ) > >> > >> I suspect that the problem is the same as reported here: > >> http://web.archiveorange.com/archive/v/Lmwutp4HZLFDEkQ1UlX5 namely that there was a bug with the handling of sparse files on zfs. The file in question that caused the problem is a bayes database from spam assassin. > > > > That was going to be my next question, actually (yep really :-) ). > > So, I guess my next question is, would I be mad to apply the zpool version 28 patch to 8.2 and run with that? Or are sparse files so broken on zfs that I ought to find some ufs to run the bayesdb on? There have been a lot of problem reports (as far as the patch applying fine but then things breaking badly) from what I've seen regarding the ZFS v28 patch on RELENG_8. I will also point out that the administrator of cvsup9.freebsd.org just tried moving to that patch on RELENG_8 and broke the server badly. I have the mails, but they're off-list/private and I don't feel comfortable just dumping those here. My advice is that if you care about stability, don't run the v28 patch, period. I'm curious about something -- we use RELENG_8 systems with a mirror zpool (kinda funny how I did it too, since the system only has 2 disks) for /home. Our SpamAssassin configuration is set to obviously writes to $user/.spamassassin/bayes_* files. Yet, we do not see this sparse file problem that others are reporting. $ df -k /home Filesystem 1024-blocks Used Avail Capacity Mounted on data/home 239144704 107238740 131905963 45% /home $ zfs list data/home NAME USED AVAIL REFER MOUNTPOINT data/home 102G 126G 102G /home $ zpool status data pool: data state: ONLINE scrub: resilver completed after 0h9m with 0 errors on Wed Oct 20 03:08:22 2010 config: NAME STATE READ WRITE CKSUM data ONLINE 0 0 0 mirror ONLINE 0 0 0 ada1 ONLINE 0 0 0 ada0s1g ONLINE 0 0 0 26.0G resilvered $ grep bayes /usr/local/etc/mail/spamassassin/local.cf use_bayes 1 bayes_auto_learn 1 bayes_ignore_header X-Bogosity bayes_ignore_header X-Spam-Flag bayes_ignore_header X-Spam-Status $ ls -l .spamassassin/ total 4085 -rw------- 1 jdc users 102192 Mar 27 02:30 bayes_journal -rw------- 1 jdc users 360448 Mar 27 02:30 bayes_seen -rw------- 1 jdc users 4947968 Mar 27 02:30 bayes_toks -rw------- 1 jdc users 8719 Mar 20 04:11 user_prefs -- | Jeremy Chadwick jdc@parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP 4BD6C0CB |