From owner-freebsd-performance@FreeBSD.ORG Wed Dec 19 20:07:09 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D505F16A474 for ; Wed, 19 Dec 2007 20:07:09 +0000 (UTC) (envelope-from biancalana@gmail.com) Received: from py-out-1112.google.com (py-out-1112.google.com [64.233.166.181]) by mx1.freebsd.org (Postfix) with ESMTP id 9B17E13C468 for ; Wed, 19 Dec 2007 20:07:09 +0000 (UTC) (envelope-from biancalana@gmail.com) Received: by py-out-1112.google.com with SMTP id u77so379512pyb.3 for ; Wed, 19 Dec 2007 12:07:06 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=X7K2rJ0IrasVYlpNhqoWPVWDhLluRolZHni9Et+76iA=; b=pGMoe8pAfkmMt/5t9ScTBYfpjB868HdU+vB6gjkBxTTAssdXGsV59mUaWlbRtCPglzSm2ypFGEc/gR8O/jjWMxLH0Kk0Zj026cwT8JuBSh+2XDDRMSICx8DLjQFqdTazKWDzwVobjhL6uEmDDxyAFH8aK7+sBD+SBTE4L50Hosk= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=MyuHbRQxjPJLb0P2+KpZaj+5D4mmQzRhEig4iZjHG7l2ve+I0mBMYmS0dPQkRmjcvtkMTI2qoxGd1/ktbbmI+vNBDCg/qa15A+A6p/9Pp4872H7K/ScNwCRVBEllsX1ztPs1z4dpoOnfuiXm432hKQn/oIJKIXleEniT28JYJ8A= Received: by 10.65.153.10 with SMTP id f10mr21548035qbo.33.1198094825113; Wed, 19 Dec 2007 12:07:05 -0800 (PST) Received: by 10.64.184.9 with HTTP; Wed, 19 Dec 2007 12:07:05 -0800 (PST) Message-ID: <8e10486b0712191207r5e256b84xf6cb0bbafc6cfd20@mail.gmail.com> Date: Wed, 19 Dec 2007 18:07:05 -0200 From: "Alexandre Biancalana" To: "Mike Tancsa" In-Reply-To: <200712191942.lBJJgWmJ018860@lava.sentex.ca> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <8e10486b0712191109n3d21b02cyf5183ee0cd01d8ce@mail.gmail.com> <200712191942.lBJJgWmJ018860@lava.sentex.ca> Cc: freebsd-performance@freebsd.org Subject: Re: Bad performance when accessing a lot of small files X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Dec 2007 20:07:09 -0000 On 12/19/07, Mike Tancsa wrote: > At 02:09 PM 12/19/2007, Alexandre Biancalana wrote: > > >The behavior that I'm observing and that want your help is when the > >system is accessing some directory with many small files ( directories > >with ~ 1 million of ~30kb files), the performance is very poor. > > Hi, I'm using zfs, I think this change the things.. no ? > Have you adjusted the dirhash value ? What does > > sysctl -a vfs.ufs | grep dirhash # sysctl -a vfs.ufs | grep dirhash vfs.ufs.dirhash_docheck: 0 vfs.ufs.dirhash_mem: 1410338 vfs.ufs.dirhash_maxmem: 2097152 vfs.ufs.dirhash_minsize: 2560 > > show on your box ? Also, do you have a lot of UIDs in your passwd file ? No. # wc -l /etc/passwd 45 /etc/passwd