Date: Thu, 3 Sep 2009 09:09:19 +0200 From: Adrian Penisoara <ady@freebsd.ady.ro> To: Robert Eckardt <Robert.Eckardt@robert-eckardt.de> Cc: hackers@freebsd.org Subject: Re: ZFS continuously growing Message-ID: <78cb3d3f0909030009y505a30by769052258576bfeb@mail.gmail.com> In-Reply-To: <20090902193059.M336@Robert-Eckardt.de> References: <20090902193059.M336@Robert-Eckardt.de>
next in thread | previous in thread | raw e-mail | index | archive | help
Hi, On Wed, Sep 2, 2009 at 10:22 PM, Robert Eckardt <Robert.Eckardt@robert-eckardt.de> wrote: > > Hi folks, > > after upgrading my backup server to 8.0-BETA2, I noticed that the > available space shrinks from backup to backup (a tree each day with > differential rsync) although with each new tree the oldest tree gets > removed. > > Since I removed some subdirectories on my active server the number > of used inodes now is reduced by approx. 90000 on each run. > At the same time used space grows by between 650MB and 6.7GB and > free space gets reduced by 4.4 to 9GB (see table below). The output > of "df" and "zfs list" is consistent. > > Although I understand that the backed-up file by rsync can be much > larger than the data transferred I get worried that without changing > much the available space shrinks continuously. (Remember, the number > of backup trees stays constant since the oldest gets removed and > 6GB/d results in more that 1TB over half a year.) > > Do I have to be worried? > Is there a memory leak in the current ZFS implementation? > Why is used space growing slower than free space is shrinking? > Is there some garbage collection needed in ZFS? > > Besides, although the backup server has 3 GB RAM I had to tune arc_max > to 150MB to copy the backed-up data from an 2.8TB ZFS (v6) to the > 4.5 TB ZFS (v13) by "zfs send|zfs recv" without kmalloc panic. > (I.e., the defaults algorithm was not sufficient.) Do I take you are using ZFS snapshots in between rsync'ing (send/recv requires snapshots) ? Could you please post the "zfs list" output after subsequent runs to clarify ? Regards, Adrian EnterpriseBSD
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?78cb3d3f0909030009y505a30by769052258576bfeb>