Date: Mon, 28 May 2012 15:21:57 +0200 (CEST) From: Alessio Focardi <alessiof@gmail.com> To: freebsd-fs@freebsd.org Subject: Millions of small files: best filesystem / best options Message-ID: <2134924725.5040.1338211317460.JavaMail.root@zimbra.interconnessioni.it> In-Reply-To: <588211375.4794.1338210497900.JavaMail.root@zimbra.interconnessioni.it>
next in thread | previous in thread | raw e-mail | index | archive | help
Hi, I'm pretty new to BSD, but I do have some knowledge in Linux. I'm looking for some advice to efficiently pack millions of small files (200 bytes or less) over a freebsd fs. Those files will be stored in an hierarchical directory structure to limit the number of files for any directory and so (I hope!) speed up file lookups/deletion. I have to say that I'm looking at fbsd for my project because both UFS2 and ZFS have some flavour of "block suballocation" "tail packing" "variable record size", at least documentation says so. My hope is to waste as less space as possible, even sacrificing some speed: can't use a full block for a single file: I will end up wasting 99% of the space! Do someone got some experience in a similar situation, and it's willing to give some advice on which fs I should choose and how to tune it for this particular scenario? Thank you very much, appreciated! ps I know that probably a database will fit better in this situation, but in my case I can't take that route :( Alessio Focardi ------------------
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?2134924725.5040.1338211317460.JavaMail.root>