From owner-freebsd-fs@FreeBSD.ORG Fri Oct 15 17:48:35 2010 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DBC621065674 for ; Fri, 15 Oct 2010 17:48:35 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from qmta14.emeryville.ca.mail.comcast.net (qmta14.emeryville.ca.mail.comcast.net [76.96.27.212]) by mx1.freebsd.org (Postfix) with ESMTP id C2BAF8FC1B for ; Fri, 15 Oct 2010 17:48:35 +0000 (UTC) Received: from omta10.emeryville.ca.mail.comcast.net ([76.96.30.28]) by qmta14.emeryville.ca.mail.comcast.net with comcast id K02A1f0010cQ2SLAE5ob0T; Fri, 15 Oct 2010 17:48:35 +0000 Received: from koitsu.dyndns.org ([98.248.41.155]) by omta10.emeryville.ca.mail.comcast.net with comcast id K5oa1f0023LrwQ28W5oaJi; Fri, 15 Oct 2010 17:48:34 +0000 Received: by icarus.home.lan (Postfix, from userid 1000) id EC5CB9B418; Fri, 15 Oct 2010 10:48:33 -0700 (PDT) Date: Fri, 15 Oct 2010 10:48:33 -0700 From: Jeremy Chadwick To: David Samms Message-ID: <20101015174833.GA14662@icarus.home.lan> References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) Cc: freebsd-fs@freebsd.org Subject: Re: ZFS trouble: unbelievably large files created X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 15 Oct 2010 17:48:35 -0000 On Fri, Oct 15, 2010 at 01:07:37PM -0400, David Samms wrote: > I am running into issues with ZFS where perl, specifically amavisd > running spamassassin creates unbelievably large files, as in files > 100x the size of the hard disk. > > My setup is a host run a dozen jails. The host is amd64 FreeBSD > 8.1-RELEASE-p1 #6 as of Thu Sep 30. The jails are running 8.0 > release as I have not yet upgraded them. This setup has been very > stable till I introduced ZFS. Below is the zpool setup: > > zpool status > pool: m1012 > state: ONLINE > scrub: none requested > config: > > NAME STATE READ WRITE CKSUM > m1012 ONLINE 0 0 0 > mirror ONLINE 0 0 0 > ad10 ONLINE 0 0 0 > ad12 ONLINE 0 0 0 > > Last night I moved six jails from my UFS+S RAID5 file system to the > new ZFS file system. Since then perl occasionally runs at 100% disk > usage accessing files in /var/amavis/.spamassassin Here is the > current directory listing: > > ls -l .spamassassin > total 13352131 > -rw------- 1 vscan vscan 684032 Oct 15 12:02 auto-whitelist > -rw------- 1 vscan vscan 40 Oct 15 12:37 bayes.lock > -rw------- 1 vscan vscan 1294336 Oct 15 12:38 bayes_seen > -rw------- 1 vscan vscan 4227072 Oct 15 12:38 bayes_toks > -rw------- 1 vscan vscan 553184002048 Oct 15 12:38 > bayes_toks.expire3515 > -rw------- 1 vscan vscan 140743122878464 Oct 15 12:14 > bayes_toks.expire97254 > > The last file is 140TB which is pretty good sized for a 1TB disk. > Disk compression is OFF. du -hs reports 13G int the .spamassassin > directory. > > Any thoughts? Thread titled "Strange ZFS problem, filesystem claims to be full when clearly not full": http://lists.freebsd.org/pipermail/freebsd-fs/2010-September/thread.html#9610 -- | Jeremy Chadwick jdc@parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB |