From owner-freebsd-stable@FreeBSD.ORG Tue May 10 12:21:13 2005 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id CBA4416A4CE for ; Tue, 10 May 2005 12:21:13 +0000 (GMT) Received: from smtpout.mac.com (smtpout.mac.com [17.250.248.46]) by mx1.FreeBSD.org (Postfix) with ESMTP id 9871A43D1D for ; Tue, 10 May 2005 12:21:13 +0000 (GMT) (envelope-from cswiger@mac.com) Received: from mac.com (smtpin07-en2 [10.13.10.152]) id j4ACLDHG011968; Tue, 10 May 2005 05:21:13 -0700 (PDT) Received: from [192.168.1.6] (pool-68-161-53-96.ny325.east.verizon.net [68.161.53.96]) (authenticated bits=0)j4ACLBbi012763; Tue, 10 May 2005 05:21:12 -0700 (PDT) In-Reply-To: <1dbad315050510034688a7fb@mail.gmail.com> References: <1dbad315050510034688a7fb@mail.gmail.com> Mime-Version: 1.0 (Apple Message framework v622) Content-Type: text/plain; charset=US-ASCII; format=flowed Message-Id: <393c3aa463b5360a3d9fbdca81f1cdce@mac.com> Content-Transfer-Encoding: 7bit From: Charles Swiger Date: Tue, 10 May 2005 08:21:10 -0400 To: Michael Schuh X-Mailer: Apple Mail (2.622) cc: freebsd-stable@freebsd.org Subject: Re: Disk-Performace issue? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 10 May 2005 12:21:13 -0000 On May 10, 2005, at 6:46 AM, Michael Schuh wrote: > Now i have 2 Directories with ~500.000-600.000 files with an size of > ~5kByte. > by copying the files from one disk to another or an direktory on the > same disk > (equal behavior), i can see this behavior: > [ ... ] > Can anyone explain me from where this behavior can come? > Come thie eventually from the filesytem, or from my disks, so that > these are to hot? (I think not) Directories are kept as lists. Adding files to the end of a list takes a longer time, as the list gets bigger. There is a kernel option called DIRHASH (UFS_DIRHASH?) which can be enabled which will help this kind of situation out significantly, but even with it, you aren't going to get great performance when you put a half-million files into a single directory. Try breaking this content up into one or two levels of subdirectories. See the way the Squid cache works... -- -Chuck