From owner-freebsd-fs@FreeBSD.ORG Mon May 28 17:01:38 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 0295B106564A for ; Mon, 28 May 2012 17:01:38 +0000 (UTC) (envelope-from alessio@interconnessioni.it) Received: from zimbra.interconnessioni.it (zimbra.interconnessioni.it [194.126.148.30]) by mx1.freebsd.org (Postfix) with ESMTP id AE6988FC0C for ; Mon, 28 May 2012 17:01:37 +0000 (UTC) Received: from localhost (localhost.localdomain [127.0.0.1]) by zimbra.interconnessioni.it (Postfix) with ESMTP id 503A464012 for ; Mon, 28 May 2012 19:01:08 +0200 (CEST) X-Virus-Scanned: amavisd-new at zimbra.interconnessioni.it.interconnessioni.it Received: from zimbra.interconnessioni.it ([127.0.0.1]) by localhost (zimbra.interconnessioni.it [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id wpXDy+DIJeVf for ; Mon, 28 May 2012 19:01:08 +0200 (CEST) Received: from zimbra.interconnessioni.it (localhost.localdomain [127.0.0.1]) by zimbra.interconnessioni.it (Postfix) with ESMTP id 25DC564006 for ; Mon, 28 May 2012 19:01:08 +0200 (CEST) Date: Mon, 28 May 2012 19:01:08 +0200 (CEST) From: Alessio Focardi To: freebsd-fs@freebsd.org Message-ID: <1490568508.7110.1338224468089.JavaMail.root@zimbra.interconnessioni.it> In-Reply-To: <922B261C-4AB8-49A9-96CE-16C98B265604@fisglobal.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [83.149.137.176] X-Mailer: Zimbra 7.1.4_GA_2555 (ZimbraWebClient - FF3.0 (Win)/7.1.4_GA_2555) Subject: Re: Millions of small files: best filesystem / best options X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 May 2012 17:01:38 -0000 > FreeBSD handles this wonderfully thanks to all the people that have > put in time and effort over the years. That's a great news and I recognize the effort of the community! > I wasn't aware that FreeBSD was unique in this respect, but yes, > FreeBSD has a block size and a fragment size. While formatting a UFS > filesystem you can specify these sizes with the "-b SIZE" and "-f > SIZE" arguments to newfs(8), for example: > > newfs -b 16384 -f 2048 /dev/da0s1a -b block-size The block size of the file system, in bytes. It must be a power of 2. The default size is 16384 bytes, and the smallest allow- able size is 4096 bytes. -f frag-size The fragment size of the file system in bytes. It must be a power of two ranging in value between blocksize/8 and blocksize. The default is 2048 bytes. So in my case I would have to use -b 4096 -f 512 It's an improvement, but still is not ideal: still a big waste with 200 bytes files! ZFS with compression, maybe? > Choose your hardware wisely. After you have chosen your hardware > wisely, set it up even more wisely. That's a good advice! I'm still working on the theory of the system, trying to find a solution for the "slack" problem, then it will come the time to look at a storage platform and surely we will choose something we can trust! Tnx for you reply, informative and well written!