From owner-freebsd-fs@FreeBSD.ORG  Fri Oct  1 04:25:42 2010
Return-Path: <owner-freebsd-fs@FreeBSD.ORG>
Delivered-To: freebsd-fs@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id 63A051065673
	for <freebsd-fs@freebsd.org>; Fri,  1 Oct 2010 04:25:42 +0000 (UTC)
	(envelope-from gpalmer@freebsd.org)
Received: from noop.in-addr.com (mail.in-addr.com [IPv6:2001:470:8:162::1])
	by mx1.freebsd.org (Postfix) with ESMTP id 315D78FC13
	for <freebsd-fs@freebsd.org>; Fri,  1 Oct 2010 04:25:42 +0000 (UTC)
Received: from gjp by noop.in-addr.com with local (Exim 4.54 (FreeBSD))
	id 1P1XBk-0009QM-CQ; Fri, 01 Oct 2010 00:25:40 -0400
Date: Fri, 1 Oct 2010 00:25:40 -0400
From: Gary Palmer <gpalmer@freebsd.org>
To: Alexander Leidinger <Alexander@Leidinger.net>
Message-ID: <20101001042540.GA48601@in-addr.com>
References: <AANLkTimRmBi=th1oia5ZuKcEtLR+YjK04KNYeZhu931A@mail.gmail.com>
	<20100929192534.GA97031@icarus.home.lan>
	<AANLkTi=q6adZv57mwNZVivOwLsfXBjVHki7tzP6-jD0G@mail.gmail.com>
	<AANLkTikqX1Y3qbcdr-2six+Pwv61k-Exwh142w5FFqbS@mail.gmail.com>
	<20100929221549.GA343@icarus.home.lan>
	<20100930103647.62193lbkp9yqx5k4@webmail.leidinger.net>
	<4CA45444.6070002@dannysplace.net>
	<AANLkTi=x5irhAM8uhiZJLztE230=Q9CAMDeja=Bo4fVL@mail.gmail.com>
	<20100930163406.330767vpzidjygow@webmail.leidinger.net>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <20100930163406.330767vpzidjygow@webmail.leidinger.net>
Cc: freebsd-fs@freebsd.org
Subject: Re: Strange ZFS problem,
	filesystem claims to be full when clearly not full
X-BeenThere: freebsd-fs@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Filesystems <freebsd-fs.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-fs>,
	<mailto:freebsd-fs-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-fs>
List-Post: <mailto:freebsd-fs@freebsd.org>
List-Help: <mailto:freebsd-fs-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-fs>,
	<mailto:freebsd-fs-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Fri, 01 Oct 2010 04:25:42 -0000

On Thu, Sep 30, 2010 at 04:34:06PM +0200, Alexander Leidinger wrote:
> Quoting Torbjorn Kristoffersen <torbjoern@gmail.com> (from Thu, 30 Sep  
> 2010 15:28:25 +0200):
> 
> >That could very well be.  Interestingly, dtrace is not installed and
> >doesn't even load.  When I do
> >kldload dtraceall it says:
> >
> >    kldload: can't load dtraceall: Exec format error
> >
> >??Perhaps I should recompile the kernel on this server, and build in
> >Dtrace into the kernel.  Perhaps I should first update to
> >FreeBSD-STABLE, as it is more cutting edge?
> >
> >Actually, I'll first do a complete backup of this jail, remove the zfs
> >filesystem, then re-create it, put the files back, and see what
> >happens.  The unfortunate thing is that I will be ruining a chance to
> >find out what really happened.
> 
> I would give lsof a try first. Installing it from ports or packages is  
> not as much time consuming as updating the server, and may pinpoint  
> the problem.
> 
> Bye,
> Alexander.

It might be worth running

ktrace -C

as root.  I do not believe ktrace output files show up in lsof or fstat.
It seems at least theoretically possible that a ktrace output file has
been deleted so it no longer shows up in ls/du but the trace is ongoing.

Regards,

Gary