From owner-freebsd-hackers Fri Jun 1 19: 3:52 2001 Delivered-To: freebsd-hackers@freebsd.org Received: from earth.backplane.com (earth-nat-cw.backplane.com [208.161.114.67]) by hub.freebsd.org (Postfix) with ESMTP id 721FC37B424; Fri, 1 Jun 2001 19:03:50 -0700 (PDT) (envelope-from dillon@earth.backplane.com) Received: (from dillon@localhost) by earth.backplane.com (8.11.3/8.11.2) id f5223mZ97356; Fri, 1 Jun 2001 19:03:48 -0700 (PDT) (envelope-from dillon) Date: Fri, 1 Jun 2001 19:03:48 -0700 (PDT) From: Matt Dillon Message-Id: <200106020203.f5223mZ97356@earth.backplane.com> To: Terry Lambert Cc: Robert Watson , Ian Dowse , freebsd-hackers@FreeBSD.ORG Subject: Re: UFS large directory performance References: <200106011806.f51I6PK85431@earth.backplane.com> <3B18338C.4641B4F4@mindspring.com> Sender: owner-freebsd-hackers@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.ORG :The new code is interesting; it will be enlightening to :see it's real world performance. I'd definitely suggest :using a zone for the allocations, however. : :FWIW: I guess if you are having problems with mail queue :perofrmance, you are running postfix or qmail or something, :instead of sendmail, with the mail queue divisions, or with :my and David Wolfskill's per-domain mail queue patches? : :-- Terry No problems at Backplane. I was speaking historically. The multi-queue stuff certainly helps, I hacked up a multi-queue sendmail setup at BEST Internet, but it still wasn't perfect. It just changed O(X^2) to O(Y * [X/Y]^2) (e.g. try with X=1000 and Y=10). A definitely improvement, but Ian's stuff can get it down to O(Y) for all intents and purposes. There is still sheer drop in regards to scaling Ian's solution after a directory grows past a few hundred thousand files, but I'm not too worried about it. The memory use ratio is good enough that that adding a little memory to a machine lets you pile on a whole bunch more files in the hash solution. -Matt To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-hackers" in the body of the message