Skip site navigation (1)Skip section navigation (2)
Date:      Tue, 10 May 2005 08:21:10 -0400
From:      Charles Swiger <cswiger@mac.com>
To:        Michael Schuh <michael.schuh@gmail.com>
Cc:        freebsd-stable@freebsd.org
Subject:   Re: Disk-Performace issue?
Message-ID:  <393c3aa463b5360a3d9fbdca81f1cdce@mac.com>
In-Reply-To: <1dbad315050510034688a7fb@mail.gmail.com>
References:  <1dbad315050510034688a7fb@mail.gmail.com>

next in thread | previous in thread | raw e-mail | index | archive | help
On May 10, 2005, at 6:46 AM, Michael Schuh wrote:
> Now i have 2 Directories with ~500.000-600.000 files with an size of 
> ~5kByte.
> by copying the files from one disk to another or an direktory on the 
> same disk
> (equal behavior), i can see this behavior:
> [ ... ]
> Can anyone explain me from where this behavior can come?
> Come thie eventually from the filesytem, or from my disks, so that
> these are to hot? (I think not)

Directories are kept as lists.  Adding files to the end of a list takes 
a longer time, as the list gets bigger.  There is a kernel option 
called DIRHASH (UFS_DIRHASH?) which can be enabled which will help this 
kind of situation out significantly, but even with it, you aren't going 
to get great performance when you put a half-million files into a 
single directory.

Try breaking this content up into one or two levels of subdirectories.  
See the way the Squid cache works...

-- 
-Chuck



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?393c3aa463b5360a3d9fbdca81f1cdce>