Skip site navigation (1)Skip section navigation (2)
Date:      Wed, 19 Dec 2007 15:14:42 -0500
From:      Mike Tancsa <mike@sentex.net>
To:        "Alexandre Biancalana" <biancalana@gmail.com>
Cc:        freebsd-performance@freebsd.org
Subject:   Re: Bad performance when accessing a lot of small files
Message-ID:  <200712192014.lBJKEfpY018975@lava.sentex.ca>
In-Reply-To: <8e10486b0712191207r5e256b84xf6cb0bbafc6cfd20@mail.gmail.co m>
References:  <8e10486b0712191109n3d21b02cyf5183ee0cd01d8ce@mail.gmail.com> <200712191942.lBJJgWmJ018860@lava.sentex.ca> <8e10486b0712191207r5e256b84xf6cb0bbafc6cfd20@mail.gmail.com>

next in thread | previous in thread | raw e-mail | index | archive | help
At 03:07 PM 12/19/2007, Alexandre Biancalana wrote:
>On 12/19/07, Mike Tancsa <mike@sentex.net> wrote:
> > At 02:09 PM 12/19/2007, Alexandre Biancalana wrote:
> >
> > >The behavior that I'm observing and that want your help is when the
> > >system is accessing some directory with many small files ( directories
> > >with ~ 1 million of ~30kb files), the performance is very poor.
> >
> > Hi,
>
>I'm using zfs, I think this change the things.. no ?

Hmmm, I dont know.  Quite possibly / probably.  Based on your values 
below, its not hitting the max if it were effected. I dont know 
anything about ZFS to know if there is some specific tuning that 
needs to be done for many files :(

         ---Mike

> >          Have you adjusted the dirhash value ? What does
> >
> >   sysctl -a vfs.ufs | grep dirhash
>
># sysctl -a vfs.ufs | grep dirhash
>vfs.ufs.dirhash_docheck: 0
>vfs.ufs.dirhash_mem: 1410338
>vfs.ufs.dirhash_maxmem: 2097152
>vfs.ufs.dirhash_minsize: 2560
>
>
> >
> > show on your box ?  Also, do you have a lot of UIDs in your passwd file ?
>
>No.
>
># wc -l /etc/passwd
>       45 /etc/passwd
>_______________________________________________
>freebsd-performance@freebsd.org mailing list
>http://lists.freebsd.org/mailman/listinfo/freebsd-performance
>To unsubscribe, send any mail to "freebsd-performance-unsubscribe@freebsd.org"




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?200712192014.lBJKEfpY018975>