From owner-freebsd-fs@FreeBSD.ORG Tue Apr 17 06:32:40 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 8D9941065672 for ; Tue, 17 Apr 2012 06:32:40 +0000 (UTC) (envelope-from c.kworr@gmail.com) Received: from mail-wg0-f42.google.com (mail-wg0-f42.google.com [74.125.82.42]) by mx1.freebsd.org (Postfix) with ESMTP id 15ADB8FC12 for ; Tue, 17 Apr 2012 06:32:39 +0000 (UTC) Received: by wgbds11 with SMTP id ds11so320496wgb.1 for ; Mon, 16 Apr 2012 23:32:39 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=eemJHcMwq1i+SpT2qdMNWPEgAgd67KAxxHIF4XL1unM=; b=CYdAmcm3eNUl+mWtblbZIq5V8WVrfsoyZtf565oISi1ttOI+A0SjGcCk5TbWGo3rku Ydl1umXHQyGxWzxv7V+iuawd3+GRGSPsdwSB+JCyrWdPkSVkT3iSjlSwvA2eAeqr0gPG AfLf3lEEOhJ5vxF4BdbiZYrU21PO5OITbxqvwKfPCt/2yHZP3i4JZ9foaslB3Lh9+ycT uajayL6/xGQxn92NKqJsiTvkZ5EPIo7qKMaKb7se1+DKRg0avp24xkuwtbbXnJ9J4CPh 5tzv+mqWH7nPpkNa+Wip4tjPbjlbKfLsuHVsxST9zRAdeGaUHn/fITROrolN9vpT6+jz bwzA== Received: by 10.216.214.84 with SMTP id b62mr8156460wep.20.1334644357769; Mon, 16 Apr 2012 23:32:37 -0700 (PDT) Received: from green.tandem.local (185-104-201-46.pool.ukrtel.net. [46.201.104.185]) by mx.google.com with ESMTPS id ea6sm24748268wib.5.2012.04.16.23.32.34 (version=SSLv3 cipher=OTHER); Mon, 16 Apr 2012 23:32:35 -0700 (PDT) Message-ID: <4F8D0E81.5050703@gmail.com> Date: Tue, 17 Apr 2012 09:32:33 +0300 From: Volodymyr Kostyrko User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:11.0) Gecko/20120315 Firefox/11.0 SeaMonkey/2.8 MIME-Version: 1.0 To: Mark Schouten References: <4F88553B.5030005@gmail.com> <1334565339.4f8bd9db1134e@www.hyperdesktop.nl> In-Reply-To: <1334565339.4f8bd9db1134e@www.hyperdesktop.nl> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Cc: "freebsd-fs@freebsd.org" Subject: Re: ZFS and disk usage X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Apr 2012 06:32:40 -0000 Mark Schouten wrote: >> Just curious, what `ls -la /storage/' and `ls -la /storage/.zfs/s*` show? It's plain weird. > > [root@storage ~]# zfs list -o name,used,referenced,usedbychildren,usedbydataset,usedbysnapshots,available,mountpoint,quota,reserv,refquota,refreserv "$@" | sed -r "s/none/ -/g" > NAME USED REFER USEDCHILD USEDDS USEDSNAP AVAIL MOUNTPOINT QUOTA RESERV REFQUOTA REFRESERV > storage 1.60T 431G 1.18T 431G 0 138G /storage - - - - > storage/av.https-ict.nl..OS 20G 16K 0 16K 0 158G - - - - 20G > storage/bestandonline.https-ict.nl.OS 20G 16K 0 16K 0 158G - - - - 20G Let's take this one for example. It's not mounted! It shouldn't be listed in next command output. > storage/crm.fastbenelux.DATA 100G 16K 0 16K 0 238G - - - - 100G > storage/crm.fastbenelux.OS 20G 16K 0 16K 0 158G - - - - 20G > storage/default.do.not.remove 1G 16K 0 16K 0 139G - - - - 1G > storage/mail.https-ict.nl.DATA 400G 16K 0 16K 0 538G - - - - 400G > storage/mail.https-ict.nl.OS 20G 16K 0 16K 0 158G - - - - 20G > storage/webserver.https-ict.nl.DATA 400G 16K 0 16K 0 538G - - - - 400G > storage/webserver.https-ict.nl.OS 20G 16K 0 16K 0 158G - - - - 20G > storage/webserver2.https-ict.nl.DATA 20G 16K 0 16K 0 158G - - - - 20G > storage/webserver2.https-ict.nl.OS 20G 16K 0 16K 0 158G - - - - 20G > storage/xlmail.xladsl.nl.DATA 150G 16K 0 16K 0 288G - - - - 150G > storage/xlmail.xladsl.nl.os 20G 16K 0 16K 0 158G - - - - 20G > > [root@storage /storage]# ls -al > total 452101743 > drwxr-xr-x 2 root wheel 18 Mar 24 17:42 . > drwxr-xr-x 20 root wheel 512 May 10 2011 .. > -rw-r--r-- 1 root wheel 21474836480 Apr 16 12:40 av.https-ict.nl.OS > -rw-r--r-- 1 root wheel 155692564480 Mar 24 17:42 bestandonline.https-ict.nl.DATA > -rw-r--r-- 1 root wheel 21474836480 Apr 5 12:19 bestandonline.https-ict.nl.OS This is not a zfs dataset. This is a file. It has no relevance to named dataset. And it drains space from /storage. > -rw-r--r-- 1 root wheel 107374182400 Apr 16 12:40 crm.fastbenelux.DATA > -rw-r--r-- 1 root wheel 21474836480 Apr 16 12:39 crm.fastbenelux.OS > -rw-r--r-- 1 root wheel 1073741824 Apr 5 12:19 default.do.not.remove > -rw-r--r-- 1 root wheel 10737418240 May 12 2011 documentatievm.https-ict.nl > -rw-r--r-- 1 root wheel 429496729600 Apr 15 02:07 mail.https-ict.nl.DATA > -rw-r--r-- 1 root wheel 21474836480 Apr 16 12:40 mail.https-ict.nl.OS > -rw-r--r-- 1 root wheel 16106127360 May 16 2011 testvm1.https-ict.nl > -rw-r--r-- 1 root wheel 429496729600 Apr 16 12:40 webserver.https-ict.nl.DATA > -rw-r--r-- 1 root wheel 21474836480 Apr 16 12:40 webserver..https-ict.nl.OS > -rw-r--r-- 1 root wheel 21474836480 Apr 5 12:19 webserver2.https-ict.nl.DATA > -rw-r--r-- 1 root wheel 21474836480 Apr 16 12:40 webserver2.https-ict.nl.OS > -rw-r--r-- 1 root wheel 161061273600 Apr 16 12:40 xlmail.xladsl.nl.DATA > -rw-r--r-- 1 root wheel 21474836480 Apr 16 12:40 xlmail.xladsl.nl.os > > [root@storage /storage]# ls -la /storage/.zfs/s* > /storage/.zfs/shares: > total 2 > dr-xr-xr-x 2 root wheel 2 May 10 2011 . > dr-xr-xr-x 4 root wheel 4 May 10 2011 .. > > /storage/.zfs/snapshot: > total 0 > dr-xr-xr-x 2 root wheel 2 May 10 2011 . > dr-xr-xr-x 4 root wheel 4 May 10 2011 .. There's also another discrepancies in your output like: * "av.https-ict.nl..OS" != "av.https-ict.nl.OS", seems like copy-and-paste error(?); * "bestandonline.https-ict.nl.DATA" and "documentatievm.https-ict.nl" doesn't exist in datasets, it looks like correspondent datasets were already removed, but not files. > It definitly looks like the reserved space for the zvols is counted in /storage, but the written data is counted for /storage as well, instead of the zvols.. > > Will an upgrade fix this? > -- Sphinx of black quartz judge my vow.