From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 2 21:01:47 2009 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4B5431065693 for ; Wed, 2 Sep 2009 21:01:47 +0000 (UTC) (envelope-from rol@robert-eckardt.de) Received: from mo-p00-ob.rzone.de (mo-p00-ob.rzone.de [81.169.146.161]) by mx1.freebsd.org (Postfix) with ESMTP id CACEC8FC15 for ; Wed, 2 Sep 2009 21:01:46 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; t=1251925305; l=2060; s=domk; d=robert-eckardt.de; h=Content-Type:MIME-Version:References:In-Reply-To:Date:Subject:To: From:X-RZG-CLASS-ID:X-RZG-AUTH; bh=h9CLOjz/mS1VyteriZ/TxXFM5Rs=; b=KHB6FPexuNfchqcxlNsgwCDwkJCv44oi/RTXvG2WnbNS2jykXWjqWebPANnzBxDsUAU tpKw0FRnwPX5VOl67wq37KxO1QqLYObQ6h4f+/vsTKuDNK+BaCwdHtYhuX4iZ11tonsrD 1Pwls9DZ9QEFhes63i6R7ODqsAa5POjJYH8= X-RZG-AUTH: :PmMGcFK8ft/ijOzYQwKyRQtU5O3aHqLcetKYQCNo0Y/QGlinQo1iUUAGQjwVEjDNt1fe8clWPQ== X-RZG-CLASS-ID: mo00 Received: from postit (p4FDD6D97.dip.t-dialin.net [79.221.109.151]) by post.strato.de (klopstock mo62) (RZmta 21.0) with ESMTP id v069c4l82K7Fey for ; Wed, 2 Sep 2009 22:49:57 +0200 (MEST) Received: from www.home.roberte.eu (localhost.home.roberte.eu [127.0.0.1]) by postit (8.13.8/8.13.8) with ESMTP id n82Knun2097109 for ; Wed, 2 Sep 2009 22:49:56 +0200 (CEST) (envelope-from rol@robert-eckardt.de) From: "Robert Eckardt" To: hackers@freebsd.org Date: Wed, 2 Sep 2009 22:49:56 +0200 Message-Id: <20090902204845.M67171@Robert-Eckardt.de> In-Reply-To: <20090902193059.M336@Robert-Eckardt.de> References: <20090902193059.M336@Robert-Eckardt.de> X-Mailer: OpenWebMail 2.52 20060502 X-OriginatingIP: 192.168.183.52 (roberte) MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Cc: Subject: ZFS continuously growing X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 Sep 2009 21:01:47 -0000 Hi folks, after upgrading my backup server to 8.0-BETA2, I noticed that the available space shrinks from backup to backup (a tree each day with differential rsync) although with each new tree the oldest tree gets removed. Since I removed some subdirectories on my active server the number of used inodes now is reduced by approx. 90000 on each run. At the same time used space grows by between 650MB and 6.7GB and free space gets reduced by 4.4 to 9GB (see table below). The output of "df" and "zfs list" is consistent. Although I understand that the backed-up file by rsync can be much larger than the data transferred I get worried that without changing much the available space shrinks continuously. (Remember, the number of backup trees stays constant since the oldest gets removed and 6GB/d results in more that 1TB over half a year.) Do I have to be worried? Is there a memory leak in the current ZFS implementation? Why is used space growing slower than free space is shrinking? Is there some garbage collection needed in ZFS? Besides, although the backup server has 3 GB RAM I had to tune arc_max to 150MB to copy the backed-up data from an 2.8TB ZFS (v6) to the 4.5 TB ZFS (v13) by "zfs send|zfs recv" without kmalloc panic. (I.e., the defaults algorithm was not sufficient.) Regards, Robert day rsynced Used free inodes oldest dir newest dir d-used d-free d-inode 27 57018987 2792986368 1914681984 43854571 20090224-0917 20090827-0916 28 67181251 2794269440 1910242176 43765134 20090225-0917 20090828-0916 1.283.072 -4.439.808 -89.437 30 52078382 2800983296 1897022720 43586320 20090227-0917 20090830-0916 6.713.856 -13.219.456 -178.814 31 2647268060 2803757056 1891064192 43496712 20090228-0917 20090831-0916 2.773.760 -5.958.528 -89.608 1 92096258 2804415616 1881965184 43406059 20090301-0917 20090901-0916 658.560 -9.099.008 -90.653 2 121590303 2807900288 1875341440 43316517 20090302-0917 20090902-0916 3.484.672 -6.623.744 -89.542 -- Dr. Robert Eckardt --- Robert.Eckardt@Robert-Eckardt.de