From owner-freebsd-performance@FreeBSD.ORG Wed Dec 19 20:14:43 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 6F0E916A474 for ; Wed, 19 Dec 2007 20:14:43 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost2.sentex.ca (smarthost2.sentex.ca [205.211.164.50]) by mx1.freebsd.org (Postfix) with ESMTP id 3AB2913C4CE for ; Wed, 19 Dec 2007 20:14:43 +0000 (UTC) (envelope-from mike@sentex.net) Received: from lava.sentex.ca (pyroxene.sentex.ca [199.212.134.18]) by smarthost2.sentex.ca (8.14.1/8.13.8) with ESMTP id lBJKEgX0011243; Wed, 19 Dec 2007 15:14:42 -0500 (EST) (envelope-from mike@sentex.net) Received: from mdt-xp.sentex.net (simeon.sentex.ca [192.168.43.27]) by lava.sentex.ca (8.13.8/8.13.3) with ESMTP id lBJKEfpY018975 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Wed, 19 Dec 2007 15:14:42 -0500 (EST) (envelope-from mike@sentex.net) Message-Id: <200712192014.lBJKEfpY018975@lava.sentex.ca> X-Mailer: QUALCOMM Windows Eudora Version 7.1.0.9 Date: Wed, 19 Dec 2007 15:14:42 -0500 To: "Alexandre Biancalana" From: Mike Tancsa In-Reply-To: <8e10486b0712191207r5e256b84xf6cb0bbafc6cfd20@mail.gmail.co m> References: <8e10486b0712191109n3d21b02cyf5183ee0cd01d8ce@mail.gmail.com> <200712191942.lBJJgWmJ018860@lava.sentex.ca> <8e10486b0712191207r5e256b84xf6cb0bbafc6cfd20@mail.gmail.com> Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii"; format=flowed Cc: freebsd-performance@freebsd.org Subject: Re: Bad performance when accessing a lot of small files X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Dec 2007 20:14:43 -0000 At 03:07 PM 12/19/2007, Alexandre Biancalana wrote: >On 12/19/07, Mike Tancsa wrote: > > At 02:09 PM 12/19/2007, Alexandre Biancalana wrote: > > > > >The behavior that I'm observing and that want your help is when the > > >system is accessing some directory with many small files ( directories > > >with ~ 1 million of ~30kb files), the performance is very poor. > > > > Hi, > >I'm using zfs, I think this change the things.. no ? Hmmm, I dont know. Quite possibly / probably. Based on your values below, its not hitting the max if it were effected. I dont know anything about ZFS to know if there is some specific tuning that needs to be done for many files :( ---Mike > > Have you adjusted the dirhash value ? What does > > > > sysctl -a vfs.ufs | grep dirhash > ># sysctl -a vfs.ufs | grep dirhash >vfs.ufs.dirhash_docheck: 0 >vfs.ufs.dirhash_mem: 1410338 >vfs.ufs.dirhash_maxmem: 2097152 >vfs.ufs.dirhash_minsize: 2560 > > > > > > show on your box ? Also, do you have a lot of UIDs in your passwd file ? > >No. > ># wc -l /etc/passwd > 45 /etc/passwd >_______________________________________________ >freebsd-performance@freebsd.org mailing list >http://lists.freebsd.org/mailman/listinfo/freebsd-performance >To unsubscribe, send any mail to "freebsd-performance-unsubscribe@freebsd.org"