Date: Thu, 2 Jan 2003 15:13:22 +0100 From: Roman Neuhauser <neuhauser@bellavista.cz> To: MikeM <MyRaQ@mgm51.com> Cc: freebsd-questions@FreeBSD.ORG Subject: Re: Lots of files in a directory Message-ID: <20030102141322.GH348@freepuppy.bellavista.cz> In-Reply-To: <200301020901270548.09C1C68B@sentry.24cl.com> References: <200301020901270548.09C1C68B@sentry.24cl.com>
index | next in thread | previous in thread | raw e-mail
# MyRaQ@mgm51.com / 2003-01-02 09:01:27 -0500:
> I'm considering setting up my server as a mirror site for the freedb.org
> lookup database. Unfortunately, I've seem to have run into a stumbling
> block. The server app requires over 250,000 files in a single directory.
> Each file is about 2k in size.
>
> It was a surprise to me (but probably not to those on this list) that the
> file system does not handle that many files in an expeditious manner (I'm
> being kind here).
>
> Is there anything I can do so that the file system works faster with such a
> large number of files? I'm looking for an increase in the area of 5 to 1.
> For example, the command "rm -rf misc" where "misc" is the directory
> containing the 250,000 files takes a couple of hours to run. If "misc" is
> my current working directory, and I type "rm *" I get the message that
> there are too many arguments being passed into rm.
>
> Some details:
> FreeBSD 4.5, dmesg below.
> Filesystem containing the files: /dev/da0s1f on /usr (ufs, local, with
> quotas)
would this help? (I don't know if this was available in 4.5, look in
your /sys/i386/conf/LINT)
roman@freepuppy ~ 1003:0 > grep -B2 DIRHASH /sys/i386/conf/LINT
# Directory hashing improves the speed of operations on very large
# directories at the expense of some memory.
options UFS_DIRHASH
--
If you cc me or remove the list(s) completely I'll most likely ignore
your message. see http://www.eyrie.org./~eagle/faqs/questions.html
To Unsubscribe: send mail to majordomo@FreeBSD.org
with "unsubscribe freebsd-questions" in the body of the message
help
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20030102141322.GH348>