From owner-freebsd-fs@FreeBSD.ORG Fri May 3 18:36:04 2013 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id B47A9DED for ; Fri, 3 May 2013 18:36:04 +0000 (UTC) (envelope-from jdc@koitsu.org) Received: from qmta11.emeryville.ca.mail.comcast.net (qmta11.emeryville.ca.mail.comcast.net [IPv6:2001:558:fe2d:44:76:96:27:211]) by mx1.freebsd.org (Postfix) with ESMTP id 9A3151BCC for ; Fri, 3 May 2013 18:36:04 +0000 (UTC) Received: from omta07.emeryville.ca.mail.comcast.net ([76.96.30.59]) by qmta11.emeryville.ca.mail.comcast.net with comcast id XVFj1l0091GXsucABWc3WQ; Fri, 03 May 2013 18:36:03 +0000 Received: from koitsu.strangled.net ([67.180.84.87]) by omta07.emeryville.ca.mail.comcast.net with comcast id XWc31l0041t3BNj8UWc39J; Fri, 03 May 2013 18:36:03 +0000 Received: by icarus.home.lan (Postfix, from userid 1000) id E1F3973A33; Fri, 3 May 2013 11:36:02 -0700 (PDT) Date: Fri, 3 May 2013 11:36:02 -0700 From: Jeremy Chadwick To: Mike Carlson Subject: Re: zfs issue - disappearing data Message-ID: <20130503183602.GA46512@icarus.home.lan> References: <5183F739.2040908@bayphoto.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <5183F739.2040908@bayphoto.com> User-Agent: Mutt/1.5.21 (2010-09-15) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=comcast.net; s=q20121106; t=1367606163; bh=SASZnVEpUy8zKMvIhh9NEi7+QDsaP3lfhQxLHsDsDz0=; h=Received:Received:Received:Date:From:To:Subject:Message-ID: MIME-Version:Content-Type; b=CtJK0vAtUVqVt2fFUlwhok2rC+l+IICq8HqmBgsRZch9Aa+moBK+LgQoGt/Q9K6+7 lRrKe4FuD0OMWhrzI0kJOR27RTJmWkiUV2ZamGeJ0/+PqaYfCL0cIkcskS/MxnIekH eOoZEI7zYRF9cJjhJTtKNpB/SiCrQW5WJ7F4v2ho1bymLAqGyPTeCp6snwslxvxqnU JS2/YqnJWZ1n+NTYL6C3wzE+8u1tDCQRYaRMoRP+nTlPger/vr/exDB3Idj5ZRyr+R ztY/+LfCzIzSIvVAVDcGbIFNJhpmu/nAdVfwp4nFRHuS1RkKIC11MWEfH4DRALkuKZ OKTuNMZ46CMAw== Cc: freebsd-fs@freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 03 May 2013 18:36:04 -0000 On Fri, May 03, 2013 at 10:43:21AM -0700, Mike Carlson wrote: > {snipping parts I have no knowledge of} > > History for 'data': > {snip} > 2013-02-25.17:12:22 zfs set compression=lzjb data > > We had a file structure drop off: > > /data/XML_WORKFLOW/XML_ORDERS/ > > around 5/2/2012 @ 17:00 > > In that directory, there were a few thousand directories (containing > images and a couple metadata text/xml files) > > What is odd, is doing a du -h in the parent XML_WORKFLOW directory, > only reports ~150MB: > > # find . -type f |wc -l > 86 > # du -sh . > 130M . > > > however, df reports 1.5GB: > > # df -h . > Filesystem Size Used Avail Capacity Mounted on > data/XML_WORKFLOW 28T 1.5G 28T 0% /data/XML_WORKFLOW This is one of the side effects of ZFS compression. Google "zfs compression df du freebsd". You'll find lots of chat about this. To be clear: it is not a FreeBSD-specific thing. You may also find the -A flag to du(1) useful. -- | Jeremy Chadwick jdc@koitsu.org | | UNIX Systems Administrator http://jdc.koitsu.org/ | | Mountain View, CA, US | | Making life hard for others since 1977. PGP 4BD6C0CB |