From owner-freebsd-fs@FreeBSD.ORG  Fri Oct 15 17:40:08 2010
Return-Path: <owner-freebsd-fs@FreeBSD.ORG>
Delivered-To: freebsd-fs@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id 38B651065672
	for <freebsd-fs@freebsd.org>; Fri, 15 Oct 2010 17:40:08 +0000 (UTC)
	(envelope-from freebsd-fs@m.gmane.org)
Received: from lo.gmane.org (lo.gmane.org [80.91.229.12])
	by mx1.freebsd.org (Postfix) with ESMTP id E73D38FC1B
	for <freebsd-fs@freebsd.org>; Fri, 15 Oct 2010 17:40:06 +0000 (UTC)
Received: from list by lo.gmane.org with local (Exim 4.69)
	(envelope-from <freebsd-fs@m.gmane.org>) id 1P6oGB-0004HE-QO
	for freebsd-fs@freebsd.org; Fri, 15 Oct 2010 19:40:03 +0200
Received: from cpe-24-210-63-182.columbus.res.rr.com ([24.210.63.182])
	by main.gmane.org with esmtp (Gmexim 0.1 (Debian))
	id 1AlnuQ-0007hv-00
	for <freebsd-fs@freebsd.org>; Fri, 15 Oct 2010 19:40:03 +0200
Received: from dsamms by cpe-24-210-63-182.columbus.res.rr.com with local
	(Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00
	for <freebsd-fs@freebsd.org>; Fri, 15 Oct 2010 19:40:03 +0200
X-Injected-Via-Gmane: http://gmane.org/
To: freebsd-fs@freebsd.org
From: David Samms <dsamms@nw-ds.com>
Date: Fri, 15 Oct 2010 13:07:37 -0400
Lines: 41
Message-ID: <i9a1or$la0$1@dough.gmane.org>
Mime-Version: 1.0
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Complaints-To: usenet@dough.gmane.org
X-Gmane-NNTP-Posting-Host: cpe-24-210-63-182.columbus.res.rr.com
User-Agent: Mozilla/5.0 (X11; U; FreeBSD amd64; en-US;
	rv:1.9.1.10) Gecko/20100630 Thunderbird/3.0.5
Subject: ZFS trouble: unbelievably large files created
X-BeenThere: freebsd-fs@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Filesystems <freebsd-fs.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-fs>,
	<mailto:freebsd-fs-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-fs>
List-Post: <mailto:freebsd-fs@freebsd.org>
List-Help: <mailto:freebsd-fs-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-fs>,
	<mailto:freebsd-fs-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Fri, 15 Oct 2010 17:40:08 -0000

I am running into issues with ZFS where perl, specifically amavisd 
running spamassassin creates unbelievably large files, as in files 100x 
the size of the hard disk.

My setup is a host run a dozen jails.  The host is amd64 FreeBSD 
8.1-RELEASE-p1 #6 as of Thu Sep 30.  The jails are running 8.0 release 
as I have not yet upgraded them.  This setup has been very stable till I 
introduced ZFS.  Below is the zpool setup:

zpool status
   pool: m1012
  state: ONLINE
  scrub: none requested
config:

         NAME        STATE     READ WRITE CKSUM
         m1012       ONLINE       0     0     0
           mirror    ONLINE       0     0     0
             ad10    ONLINE       0     0     0
             ad12    ONLINE       0     0     0

Last night I moved six jails from my UFS+S RAID5 file system to the new 
ZFS file system.  Since then perl occasionally runs at 100% disk usage 
accessing files in /var/amavis/.spamassassin  Here is the current 
directory listing:

ls -l .spamassassin
total 13352131
-rw-------  1 vscan  vscan           684032 Oct 15 12:02 auto-whitelist
-rw-------  1 vscan  vscan               40 Oct 15 12:37 bayes.lock
-rw-------  1 vscan  vscan          1294336 Oct 15 12:38 bayes_seen
-rw-------  1 vscan  vscan          4227072 Oct 15 12:38 bayes_toks
-rw-------  1 vscan  vscan     553184002048 Oct 15 12:38 
bayes_toks.expire3515
-rw-------  1 vscan  vscan  140743122878464 Oct 15 12:14 
bayes_toks.expire97254

The last file is 140TB which is pretty good sized for a 1TB disk.  Disk 
compression is OFF.  du -hs reports 13G int the .spamassassin directory.

Any thoughts?