From owner-freebsd-fs@FreeBSD.ORG Mon May 28 13:28:12 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 76A53106566C for ; Mon, 28 May 2012 13:28:12 +0000 (UTC) (envelope-from alessio@interconnessioni.it) Received: from zimbra.interconnessioni.it (zimbra.interconnessioni.it [194.126.148.30]) by mx1.freebsd.org (Postfix) with ESMTP id 295FD8FC16 for ; Mon, 28 May 2012 13:28:11 +0000 (UTC) Received: from localhost (localhost.localdomain [127.0.0.1]) by zimbra.interconnessioni.it (Postfix) with ESMTP id B838B64011 for ; Mon, 28 May 2012 15:21:57 +0200 (CEST) X-Virus-Scanned: amavisd-new at zimbra.interconnessioni.it.interconnessioni.it Received: from zimbra.interconnessioni.it ([127.0.0.1]) by localhost (zimbra.interconnessioni.it [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 0zAG4uCdZFen for ; Mon, 28 May 2012 15:21:57 +0200 (CEST) Received: from zimbra.interconnessioni.it (localhost.localdomain [127.0.0.1]) by zimbra.interconnessioni.it (Postfix) with ESMTP id 9035A64007 for ; Mon, 28 May 2012 15:21:57 +0200 (CEST) Date: Mon, 28 May 2012 15:21:57 +0200 (CEST) From: Alessio Focardi To: freebsd-fs@freebsd.org Message-ID: <2134924725.5040.1338211317460.JavaMail.root@zimbra.interconnessioni.it> In-Reply-To: <588211375.4794.1338210497900.JavaMail.root@zimbra.interconnessioni.it> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [83.149.137.176] X-Mailer: Zimbra 7.1.4_GA_2555 (ZimbraWebClient - FF3.0 (Win)/7.1.4_GA_2555) Subject: Millions of small files: best filesystem / best options X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 May 2012 13:28:12 -0000 Hi, I'm pretty new to BSD, but I do have some knowledge in Linux. I'm looking for some advice to efficiently pack millions of small files (200 bytes or less) over a freebsd fs. Those files will be stored in an hierarchical directory structure to limit the number of files for any directory and so (I hope!) speed up file lookups/deletion. I have to say that I'm looking at fbsd for my project because both UFS2 and ZFS have some flavour of "block suballocation" "tail packing" "variable record size", at least documentation says so. My hope is to waste as less space as possible, even sacrificing some speed: can't use a full block for a single file: I will end up wasting 99% of the space! Do someone got some experience in a similar situation, and it's willing to give some advice on which fs I should choose and how to tune it for this particular scenario? Thank you very much, appreciated! ps I know that probably a database will fit better in this situation, but in my case I can't take that route :( Alessio Focardi ------------------