From owner-freebsd-fs@FreeBSD.ORG  Sat Jan 10 12:19:19 2004
Return-Path: <owner-freebsd-fs@FreeBSD.ORG>
Delivered-To: freebsd-fs@freebsd.org
Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125])
	by hub.freebsd.org (Postfix) with ESMTP id 517F816A4CE
	for <freebsd-fs@freebsd.org>; Sat, 10 Jan 2004 12:19:19 -0800 (PST)
Received: from carver.gumbysoft.com (carver.gumbysoft.com [66.220.23.50])
	by mx1.FreeBSD.org (Postfix) with ESMTP id 71F4443D3F
	for <freebsd-fs@freebsd.org>; Sat, 10 Jan 2004 12:19:18 -0800 (PST)
	(envelope-from dwhite@gumbysoft.com)
Received: by carver.gumbysoft.com (Postfix, from userid 1000)
	id 62B4472DC9; Sat, 10 Jan 2004 12:19:18 -0800 (PST)
Received: from localhost (localhost [127.0.0.1])
	by carver.gumbysoft.com (Postfix) with ESMTP
	id 5D79472DC7; Sat, 10 Jan 2004 12:19:18 -0800 (PST)
Date: Sat, 10 Jan 2004 12:19:18 -0800 (PST)
From: Doug White <dwhite@gumbysoft.com>
To: Tom Arnold <xyzzy@sysabend.org>
In-Reply-To: <20040110010514.GA79577@moo.sysabend.org>
Message-ID: <20040110121707.J36595@carver.gumbysoft.com>
References: <20040108002627.GH22041@moo.sysabend.org>
	<20040110010514.GA79577@moo.sysabend.org>
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII
cc: freebsd-fs@freebsd.org
Subject: Re: Large filesystems with massive inodes on BSD5.2
X-BeenThere: freebsd-fs@freebsd.org
X-Mailman-Version: 2.1.1
Precedence: list
List-Id: Filesystems <freebsd-fs.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-fs>,
	<mailto:freebsd-fs-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-fs>
List-Post: <mailto:freebsd-fs@freebsd.org>
List-Help: <mailto:freebsd-fs-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-fs>,
	<mailto:freebsd-fs-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Sat, 10 Jan 2004 20:19:19 -0000

On Fri, 9 Jan 2004, Tom Arnold wrote:

> On Fri, Jan 09, 2004 at 04:56:39PM -0800, Doug White wrote:
> > Unless you're going to fill the filesystem with 512 byte files, you
> > probably have the sizes set too low.  You're probably OK with the default
> > of 4096 bytes/inode.
>
> Its actually gonna be filled with gzipped spam which we find seems to be
> under 1k. 512bytes is probably too small, but even doubling the fragment
> and inode size to 1024 still leaves me with a billion inodes...

This is a really inefficient filing system for this kind of data .. you
are really going to be sorry if you ever have to move it.  Can you stick
it in a database, or combine it into larger files? The gzip overhead is
going to consume a significant fraction of the space.

-- 
Doug White                    |  FreeBSD: The Power to Serve
dwhite@gumbysoft.com          |  www.FreeBSD.org