From owner-freebsd-hackers@FreeBSD.ORG Thu Sep 3 07:42:22 2009 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C0C581065670 for ; Thu, 3 Sep 2009 07:42:22 +0000 (UTC) (envelope-from ady@ady.ro) Received: from ey-out-2122.google.com (ey-out-2122.google.com [74.125.78.26]) by mx1.freebsd.org (Postfix) with ESMTP id 3038B8FC08 for ; Thu, 3 Sep 2009 07:42:21 +0000 (UTC) Received: by ey-out-2122.google.com with SMTP id 4so960795eyf.3 for ; Thu, 03 Sep 2009 00:42:21 -0700 (PDT) MIME-Version: 1.0 Sender: ady@ady.ro Received: by 10.211.168.3 with SMTP id v3mr9077445ebo.97.1251961761924; Thu, 03 Sep 2009 00:09:21 -0700 (PDT) In-Reply-To: <20090902193059.M336@Robert-Eckardt.de> References: <20090902193059.M336@Robert-Eckardt.de> Date: Thu, 3 Sep 2009 09:09:19 +0200 X-Google-Sender-Auth: b547805cf4ef5777 Message-ID: <78cb3d3f0909030009y505a30by769052258576bfeb@mail.gmail.com> From: Adrian Penisoara To: Robert Eckardt Content-Type: text/plain; charset=ISO-8859-1 Cc: hackers@freebsd.org Subject: Re: ZFS continuously growing X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 03 Sep 2009 07:42:22 -0000 Hi, On Wed, Sep 2, 2009 at 10:22 PM, Robert Eckardt wrote: > > Hi folks, > > after upgrading my backup server to 8.0-BETA2, I noticed that the > available space shrinks from backup to backup (a tree each day with > differential rsync) although with each new tree the oldest tree gets > removed. > > Since I removed some subdirectories on my active server the number > of used inodes now is reduced by approx. 90000 on each run. > At the same time used space grows by between 650MB and 6.7GB and > free space gets reduced by 4.4 to 9GB (see table below). The output > of "df" and "zfs list" is consistent. > > Although I understand that the backed-up file by rsync can be much > larger than the data transferred I get worried that without changing > much the available space shrinks continuously. (Remember, the number > of backup trees stays constant since the oldest gets removed and > 6GB/d results in more that 1TB over half a year.) > > Do I have to be worried? > Is there a memory leak in the current ZFS implementation? > Why is used space growing slower than free space is shrinking? > Is there some garbage collection needed in ZFS? > > Besides, although the backup server has 3 GB RAM I had to tune arc_max > to 150MB to copy the backed-up data from an 2.8TB ZFS (v6) to the > 4.5 TB ZFS (v13) by "zfs send|zfs recv" without kmalloc panic. > (I.e., the defaults algorithm was not sufficient.) Do I take you are using ZFS snapshots in between rsync'ing (send/recv requires snapshots) ? Could you please post the "zfs list" output after subsequent runs to clarify ? Regards, Adrian EnterpriseBSD