From owner-freebsd-fs@FreeBSD.ORG Mon May 28 16:00:34 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 00B9A106564A for ; Mon, 28 May 2012 16:00:34 +0000 (UTC) (envelope-from nowakpl@platinum.linux.pl) Received: from platinum.linux.pl (platinum.edu.pl [81.161.192.4]) by mx1.freebsd.org (Postfix) with ESMTP id A2FFD8FC1B for ; Mon, 28 May 2012 16:00:33 +0000 (UTC) Received: by platinum.linux.pl (Postfix, from userid 87) id 6DA3C5FD0A; Mon, 28 May 2012 17:54:07 +0200 (CEST) X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on platinum.linux.pl X-Spam-Level: X-Spam-Status: No, score=-1.5 required=3.0 tests=ALL_TRUSTED,AWL autolearn=disabled version=3.3.2 Received: from [172.19.191.4] (unknown [83.151.38.73]) by platinum.linux.pl (Postfix) with ESMTPA id 3F29F5FD06 for ; Mon, 28 May 2012 17:54:05 +0200 (CEST) Message-ID: <4FC39F99.5010906@platinum.linux.pl> Date: Mon, 28 May 2012 17:54:01 +0200 From: Adam Nowacki User-Agent: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-GB; rv:1.9.2.28) Gecko/20120306 Thunderbird/3.1.20 MIME-Version: 1.0 To: freebsd-fs@freebsd.org References: <2134924725.5040.1338211317460.JavaMail.root@zimbra.interconnessioni.it> In-Reply-To: <2134924725.5040.1338211317460.JavaMail.root@zimbra.interconnessioni.it> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Subject: Re: Millions of small files: best filesystem / best options X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 May 2012 16:00:34 -0000 I don't think any regular file system will be able to cope. If you really need this as files start with sysutils/fusefs-sqlfs and then maybe look for postgresql or mysql fusefs modules. On 2012-05-28 15:21, Alessio Focardi wrote: > Hi, > > I'm pretty new to BSD, but I do have some knowledge in Linux. > > I'm looking for some advice to efficiently pack millions of small files (200 bytes or less) over a freebsd fs. > > Those files will be stored in an hierarchical directory structure to limit the number of files for any directory and so (I hope!) speed up file lookups/deletion. > > I have to say that I'm looking at fbsd for my project because both UFS2 and ZFS have some flavour of "block suballocation" "tail packing" "variable record size", at least documentation says so. > > My hope is to waste as less space as possible, even sacrificing some speed: can't use a full block for a single file: I will end up wasting 99% of the space! > > > Do someone got some experience in a similar situation, and it's willing to give some advice on which fs I should choose and how to tune it for this particular scenario? > > > Thank you very much, appreciated! > > > ps > > I know that probably a database will fit better in this situation, but in my case I can't take that route :( > > > > Alessio Focardi > ------------------ > > > _______________________________________________ > freebsd-fs@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org"