From owner-freebsd-current@FreeBSD.ORG  Tue Jun 15 18:04:07 2004
Return-Path: <owner-freebsd-current@FreeBSD.ORG>
Delivered-To: freebsd-current@freebsd.org
Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125])
	by hub.freebsd.org (Postfix) with ESMTP id E547516A4CE
	for <freebsd-current@freebsd.org>;
	Tue, 15 Jun 2004 18:04:07 +0000 (GMT)
Received: from hourri.hittite.isp.9tel.net (hourri.hittite.isp.9tel.net
	[62.62.156.10])	by mx1.FreeBSD.org (Postfix) with ESMTP id 5B1D343D39
	for <freebsd-current@freebsd.org>;
	Tue, 15 Jun 2004 18:04:07 +0000 (GMT)
	(envelope-from clefevre-lists@9online.fr)
Received: from pc2k (28-216-118-80.kaptech.net [80.118.216.28])
	by hourri.hittite.isp.9tel.net (Postfix) with SMTP
	id 13766157DB7; Tue, 15 Jun 2004 20:40:21 +0200 (CEST)
Message-ID: <005501c45302$08d2a8c0$7890a8c0@dyndns.org>
From: "Cyrille Lefevre" <clefevre-lists@9online.fr>
To: "Eugene" <el2000@km.ru>, <freebsd-current@freebsd.org>
References: <40CEFAA8.00B9A6.08476@e-post02.e-se.ru>
Date: Tue, 15 Jun 2004 19:56:06 +0200
Organization: ACME
MIME-Version: 1.0
Content-Type: text/plain;
	charset="Windows-1251"
Content-Transfer-Encoding: 7bit
X-Priority: 3
X-MSMail-Priority: Normal
X-Mailer: Microsoft Outlook Express 6.00.2800.1409
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1409
Subject: Re: Storing a lot of little files
X-BeenThere: freebsd-current@freebsd.org
X-Mailman-Version: 2.1.1
Precedence: list
List-Id: Discussions about the use of FreeBSD-current
	<freebsd-current.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-current>,
	<mailto:freebsd-current-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-current>
List-Post: <mailto:freebsd-current@freebsd.org>
List-Help: <mailto:freebsd-current-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-current>,
	<mailto:freebsd-current-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Tue, 15 Jun 2004 18:04:08 -0000

"Eugene" <el2000@km.ru> wrote:
> Hello freebsd-current,
>
>   I need to store a lot (hundreds of millions) of very little files (from 8
bytes
>   to 50K) in my filesystem.

some times ago, there where something called "inode fs" (aka IFS).
unfortunatelly, this was killed from -current (5.x) two years ago.

more details here (google "freebsd +ifs +inode"):

http://www.squid-cache.org/mail-archive/squid-dev/200101/0432.html
http://www.freebsd.org/cgi/cvsweb.cgi/src/sys/ufs/ifs/Attic/README
http://lists.freebsd.org/pipermail/freebsd-fs/2003-June/000129.html

>   What's the best way to optimize it? Which newfs options can you
>   recommend me?

so, the best way would be to have multi-level directories to reduce
the number of entries in one directory whatever the underlying file
system is (except, maybe, database-like filesystems).

something like :

/a/b/c/cfile
/a/b/d/dfile
/a/c/e/efile
etc.

using google "million +files +directory +fs" :

http://aa11.cjb.net/sun_managers/2000/01/msg00303.html

Cyrille Lefevre.
-- 
home: mailto:cyrille.lefevre@laposte.net