From owner-freebsd-questions@FreeBSD.ORG Sun May 16 20:43:22 2004 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 8863016A4CE for ; Sun, 16 May 2004 20:43:22 -0700 (PDT) Received: from otter3.centtech.com (moat3.centtech.com [207.200.51.50]) by mx1.FreeBSD.org (Postfix) with ESMTP id BAF9143D4C for ; Sun, 16 May 2004 20:43:21 -0700 (PDT) (envelope-from anderson@centtech.com) Received: from centtech.com ([192.168.42.25]) by otter3.centtech.com (8.12.3/8.12.3) with ESMTP id i4H3hJE8034662; Sun, 16 May 2004 22:43:19 -0500 (CDT) (envelope-from anderson@centtech.com) Message-ID: <40A834B0.60806@centtech.com> Date: Sun, 16 May 2004 22:42:40 -0500 From: Eric Anderson User-Agent: Mozilla Thunderbird 0.5 (X11/20040406) X-Accept-Language: en-us, en MIME-Version: 1.0 To: Dan Nelson References: <40A82BAB.7030005@centtech.com> <20040517032438.GE80376@dan.emsphone.com> In-Reply-To: <20040517032438.GE80376@dan.emsphone.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit cc: freebsd-questions@freebsd.org Subject: Re: Disk full / NFS, df, and du X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 May 2004 03:43:22 -0000 Dan Nelson wrote: >In the last episode (May 16), Eric Anderson said: > > >>I have a few large NFS file servers, holding about 1Tb of diskspace >>each. I break those logical disks (it's on a hardware RAID) into >>partitions, and share them. My users fill up the partitions often >>enough, and when they do, they rm entire directory trees to free the >>space. They use du to determine how much space is in a directory and >>how much they are hogging. >> >>The problem I'm having is, after they do the rm's, it doesn't free the >>disk space. df shows it still being used, but du claims their >>directories are empty. >> >>If I reboot the file server, the space magically appears. >> >>I was thinking that it was because a process was using the data, or >>directories the data was removed from, so the blocks weren't actually >>freed, but that seems a little odd to me, since they claim (and >>different users have the same issues, and make the same claims) that >>nothing should be touching those areas at all. >> >>How do I get FreeBSD to release those blocks without rebooting? >> >> > >Does a du on server itself show files? How about "lsof +L1"? The NFS >protocol doesn't allow clients to unlink files they have open, so >FreeBSD clients (at least) rename open files that are unlinked to >.nfs##### until the last process closes the file, and then they delete >it. If you've got unlinked files held open, it's got to be on the >server itself. > Du on the server shows the same as on the client - only a small amount used (36Gb used) whereas a df shows 152Gb used. I am using solaris and linux clients mostly. This happened on FreeBSD 4.6, and continues on this 4.9-RELEASE machine (same partitions, just an upgraded OS). Eric -- ------------------------------------------------------------------ Eric Anderson Sr. Systems Administrator Centaur Technology Today is the tomorrow you worried about yesterday. ------------------------------------------------------------------