From owner-freebsd-stable@FreeBSD.ORG Tue May 10 13:11:41 2005 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id C590416A4CE for ; Tue, 10 May 2005 13:11:41 +0000 (GMT) Received: from rproxy.gmail.com (rproxy.gmail.com [64.233.170.204]) by mx1.FreeBSD.org (Postfix) with ESMTP id 5FFFE43D46 for ; Tue, 10 May 2005 13:11:41 +0000 (GMT) (envelope-from michael.schuh@gmail.com) Received: by rproxy.gmail.com with SMTP id a41so951940rng for ; Tue, 10 May 2005 06:11:40 -0700 (PDT) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=cX+a1qxbt5OU19sOiVALs7NRNe/vCStYrCiC5viZf8uWc4Rref3cDHV1zrGbFAiwl3bS3tmm2XuiHvr1rYz3VWEris12jXGhhVaIMKRVzsdF9LF97Ebw0xcF3akYoa1pUdbemxvvbzcKyaP72pDUgheP9Qqg+HMiz4ERsl/G4Fc= Received: by 10.38.74.31 with SMTP id w31mr2044774rna; Tue, 10 May 2005 06:11:40 -0700 (PDT) Received: by 10.38.207.79 with HTTP; Tue, 10 May 2005 06:11:40 -0700 (PDT) Message-ID: <1dbad315050510061122442717@mail.gmail.com> Date: Tue, 10 May 2005 15:11:40 +0200 From: Michael Schuh To: Charles Swiger In-Reply-To: <393c3aa463b5360a3d9fbdca81f1cdce@mac.com> Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline References: <1dbad315050510034688a7fb@mail.gmail.com> <393c3aa463b5360a3d9fbdca81f1cdce@mac.com> cc: freebsd-stable@freebsd.org Subject: SOLVED Disk-Performace issue? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: Michael Schuh List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 10 May 2005 13:11:41 -0000 Hello, thanks to all who gave me any suggestion on my request. The Tip from Charles was only the beginning. The last step was to setting vfs.ufs.dirhash_maxmem via sysctl to an higher value, in my case 20MB. The copying from all 523000 files has used over 7MB dirhash_mem. Now after setting the ufs.dirhash_maxmem i have the performance from 4-5 MByte/s. i thanks all people that gave me the Power to serve :-))) regards Michael 2005/5/10, Charles Swiger : > On May 10, 2005, at 6:46 AM, Michael Schuh wrote: > > Now i have 2 Directories with ~500.000-600.000 files with an size of > > ~5kByte. > > by copying the files from one disk to another or an direktory on the > > same disk > > (equal behavior), i can see this behavior: > > [ ... ] > > Can anyone explain me from where this behavior can come? > > Come thie eventually from the filesytem, or from my disks, so that > > these are to hot? (I think not) >=20 > Directories are kept as lists. Adding files to the end of a list takes > a longer time, as the list gets bigger. There is a kernel option > called DIRHASH (UFS_DIRHASH?) which can be enabled which will help this > kind of situation out significantly, but even with it, you aren't going > to get great performance when you put a half-million files into a > single directory. >=20 > Try breaking this content up into one or two levels of subdirectories. > See the way the Squid cache works... >=20 > -- > -Chuck >=20 >