From owner-freebsd-fs@FreeBSD.ORG Fri Oct 15 18:11:50 2010 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A9EF7106566B for ; Fri, 15 Oct 2010 18:11:50 +0000 (UTC) (envelope-from freebsd-fs@m.gmane.org) Received: from lo.gmane.org (lo.gmane.org [80.91.229.12]) by mx1.freebsd.org (Postfix) with ESMTP id 32ECB8FC17 for ; Fri, 15 Oct 2010 18:11:49 +0000 (UTC) Received: from list by lo.gmane.org with local (Exim 4.69) (envelope-from ) id 1P6oku-0002vv-GS for freebsd-fs@freebsd.org; Fri, 15 Oct 2010 20:11:48 +0200 Received: from cpe-24-210-63-182.columbus.res.rr.com ([24.210.63.182]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Fri, 15 Oct 2010 20:11:48 +0200 Received: from dsamms by cpe-24-210-63-182.columbus.res.rr.com with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Fri, 15 Oct 2010 20:11:48 +0200 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-fs@freebsd.org From: David Samms Date: Fri, 15 Oct 2010 14:11:36 -0400 Lines: 61 Message-ID: References: <20101015174833.GA14662@icarus.home.lan> Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Complaints-To: usenet@dough.gmane.org X-Gmane-NNTP-Posting-Host: cpe-24-210-63-182.columbus.res.rr.com User-Agent: Mozilla/5.0 (X11; U; FreeBSD amd64; en-US; rv:1.9.1.10) Gecko/20100630 Thunderbird/3.0.5 In-Reply-To: <20101015174833.GA14662@icarus.home.lan> Subject: Re: ZFS trouble: unbelievably large files created X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 15 Oct 2010 18:11:50 -0000 On 10/15/10 13:48, Jeremy Chadwick wrote: > On Fri, Oct 15, 2010 at 01:07:37PM -0400, David Samms wrote: >> I am running into issues with ZFS where perl, specifically amavisd >> running spamassassin creates unbelievably large files, as in files >> 100x the size of the hard disk. >> >> My setup is a host run a dozen jails. The host is amd64 FreeBSD >> 8.1-RELEASE-p1 #6 as of Thu Sep 30. The jails are running 8.0 >> release as I have not yet upgraded them. This setup has been very >> stable till I introduced ZFS. Below is the zpool setup: >> >> zpool status >> pool: m1012 >> state: ONLINE >> scrub: none requested >> config: >> >> NAME STATE READ WRITE CKSUM >> m1012 ONLINE 0 0 0 >> mirror ONLINE 0 0 0 >> ad10 ONLINE 0 0 0 >> ad12 ONLINE 0 0 0 >> >> Last night I moved six jails from my UFS+S RAID5 file system to the >> new ZFS file system. Since then perl occasionally runs at 100% disk >> usage accessing files in /var/amavis/.spamassassin Here is the >> current directory listing: >> >> ls -l .spamassassin >> total 13352131 >> -rw------- 1 vscan vscan 684032 Oct 15 12:02 auto-whitelist >> -rw------- 1 vscan vscan 40 Oct 15 12:37 bayes.lock >> -rw------- 1 vscan vscan 1294336 Oct 15 12:38 bayes_seen >> -rw------- 1 vscan vscan 4227072 Oct 15 12:38 bayes_toks >> -rw------- 1 vscan vscan 553184002048 Oct 15 12:38 >> bayes_toks.expire3515 >> -rw------- 1 vscan vscan 140743122878464 Oct 15 12:14 >> bayes_toks.expire97254 >> >> The last file is 140TB which is pretty good sized for a 1TB disk. >> Disk compression is OFF. du -hs reports 13G int the .spamassassin >> directory. >> >> Any thoughts? > > Thread titled "Strange ZFS problem, filesystem claims to be full when > clearly not full": > > http://lists.freebsd.org/pipermail/freebsd-fs/2010-September/thread.html#9610 > I don't think it is related, but could be. I am not seeing the disk as full, although I do know that if I let perl continue to write it does fill the ZFS partition. df -h Filesystem Size Used Avail Capacity Mounted on m1012/shawxp 40G 19G 21G 48% / zfs list m1012/shawxp 20.0G 20.9G 19.1G /m1012/shawxp