Skip site navigation (1)Skip section navigation (2)
Date:      Tue, 10 May 2005 14:37:35 +0200
From:      Michael Schuh <michael.schuh@gmail.com>
To:        Charles Swiger <cswiger@mac.com>
Cc:        freebsd-stable@freebsd.org
Subject:   Re: Disk-Performace issue?
Message-ID:  <1dbad31505051005371a503dd9@mail.gmail.com>
In-Reply-To: <393c3aa463b5360a3d9fbdca81f1cdce@mac.com>
References:  <1dbad315050510034688a7fb@mail.gmail.com> <393c3aa463b5360a3d9fbdca81f1cdce@mac.com>

next in thread | previous in thread | raw e-mail | index | archive | help

Hallo Charles,

thank you for this hint, but this is not the source....
i have this option as default in my kernels.

Iknow that putting tons of files in one directory is not really good for the
performance. I think also that the way get better by using subdirs.

But my problem ist that the performance fall from one moment to
another from 100% to ~10%........ this was not linear, ist was not a
ramp, it was the grand canion.... or the "Eiger Nordwand".  :-))

not that the performance at all is bad.



Thank you for your Hint

Michael

2005/5/10, Charles Swiger <cswiger@mac.com>:
> On May 10, 2005, at 6:46 AM, Michael Schuh wrote:
> > Now i have 2 Directories with ~500.000-600.000 files with an size of
> > ~5kByte.
> > by copying the files from one disk to another or an direktory on the
> > same disk
> > (equal behavior), i can see this behavior:
> > [ ... ]
> > Can anyone explain me from where this behavior can come?
> > Come thie eventually from the filesytem, or from my disks, so that
> > these are to hot? (I think not)
> 
> Directories are kept as lists.  Adding files to the end of a list takes
> a longer time, as the list gets bigger.  There is a kernel option
> called DIRHASH (UFS_DIRHASH?) which can be enabled which will help this
> kind of situation out significantly, but even with it, you aren't going
> to get great performance when you put a half-million files into a
> single directory.
> 
> Try breaking this content up into one or two levels of subdirectories.
> See the way the Squid cache works...
> 
> --
> -Chuck
> 
>



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?1dbad31505051005371a503dd9>