From owner-freebsd-questions Fri Jan 24 4:13:11 2003 Delivered-To: freebsd-questions@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9ECD737B401 for ; Fri, 24 Jan 2003 04:13:10 -0800 (PST) Received: from spork.pantherdragon.org (spork.pantherdragon.org [206.29.168.146]) by mx1.FreeBSD.org (Postfix) with ESMTP id F073343F13 for ; Fri, 24 Jan 2003 04:13:09 -0800 (PST) (envelope-from dmp@pantherdragon.org) Received: from sparx.techno.pagans (12-224-208-117.client.attbi.com [12.224.208.117]) by spork.pantherdragon.org (Postfix) with ESMTP id 8F57A1005F for ; Fri, 24 Jan 2003 04:13:03 -0800 (PST) Received: from pantherdragon.org (speck.techno.pagans [172.21.42.2]) by sparx.techno.pagans (Postfix) with ESMTP id 43C68AA92 for ; Fri, 24 Jan 2003 04:13:02 -0800 (PST) Message-ID: <3E312DCE.8010607@pantherdragon.org> Date: Fri, 24 Jan 2003 04:13:02 -0800 From: Darren Pilgrim User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.2b) Gecko/20030119 X-Accept-Language: en-us, en MIME-Version: 1.0 To: questions@freebsd.org Subject: Filesystem tuning for lots of small files (a Maildir)? Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Sender: owner-freebsd-questions@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.ORG I'm currently facing a problem of having used Netscape (now Mozilla) for years in Windows and now trying to find something I can regularly use in FreeBSD without losing Mozilla in Windows. I've mostly settled on IMAP (courier) with procmail filters, but that raises the issue of filesystem performance for directories with large numbers of files/subdirectories in them. I have more than 32,000 emails stored. How do I calculate/see the number of available inodes? The existing filesystem was newfs'd with the sysinstall defaults. Should I re-newfs it with different values? What would I want to set them at? I know I'd need to adjust things to make sure I have enough inodes for 40,000+ files, but what about the block and fragment size? Should I use smaller values like 8192/1024 or 4096/512 or is the default 16384/2048 best? Higher values would just increase slack space, right? What are the impacts of lower values? Some folders, like the one for the postfix-users list, can have 3000-4000 messages in them. For growth, we'll say 5000 messages. The IMAP layout with Courier means all the folders sit all on one level under ~/Maildir, which means I'd have 200 or so subdirectories in one place. I have the UFS_DIRHASH option enabled for the my MP3 collection, but that's as case of 300 subdirecories in one directory, not 5000 files. What else can I do to tune for this kind of (ab)use? P.S. I really would like to stick with Maildirs and Courier-IMAP for this. I know CIMAP well and it has proven very fast and stable for what I do with it. However, if these demands are just too much to expect from an IMAP-accessed Maildir, Courier, or FreeBSD, what are my alternatives? To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-questions" in the body of the message