Date: Fri, 21 Dec 2007 16:25:35 -0800 From: Alfred Perlstein <alfred@freebsd.org> To: Alexandre Biancalana <biancalana@gmail.com> Cc: freebsd-performance@freebsd.org Subject: Re: Bad performance when accessing a lot of small files Message-ID: <20071222002535.GL16982@elvis.mu.org> In-Reply-To: <8e10486b0712211555n3efe8729qff14387be128cf10@mail.gmail.com> References: <8e10486b0712191109n3d21b02cyf5183ee0cd01d8ce@mail.gmail.com> <20071221201625.GZ16982@elvis.mu.org> <8e10486b0712211249v4c5571ddud21b277f686992b2@mail.gmail.com> <20071221212808.GE16982@elvis.mu.org> <8e10486b0712211555n3efe8729qff14387be128cf10@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
* Alexandre Biancalana <biancalana@gmail.com> [071221 15:53] wrote: > On 12/21/07, Alfred Perlstein <alfred@freebsd.org> wrote: > > > > What application are you scanning these files with? I know I had > > issues with rsync in particular where I had to have it rsync > > smaller pieces of a collection for it to work nicely instead of > > going for the whole heirarchy. > > tar > > I run tar in the /backup/<hostname>/YYYYMMDD writing to LTO3 tape > drive, the problem is that when origin directory contains a lot of > small files the process is *much* more slow.... this is my question > since the thread start. Have you tried the 'noatime' mount option? That should help. Can you provide a histogram of the count of files per directory? -- - Alfred Perlstein
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20071222002535.GL16982>