From owner-freebsd-hackers@FreeBSD.ORG Thu Sep 4 16:25:26 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id D2C1216A4BF for ; Thu, 4 Sep 2003 16:25:26 -0700 (PDT) Received: from HAL9000.homeunix.com (12-233-57-131.client.attbi.com [12.233.57.131]) by mx1.FreeBSD.org (Postfix) with ESMTP id 0730F43FB1 for ; Thu, 4 Sep 2003 16:25:26 -0700 (PDT) (envelope-from das@FreeBSD.ORG) Received: from HAL9000.homeunix.com (localhost [127.0.0.1]) by HAL9000.homeunix.com (8.12.9/8.12.9) with ESMTP id h84NPLG7014176; Thu, 4 Sep 2003 16:25:21 -0700 (PDT) (envelope-from das@FreeBSD.ORG) Received: (from das@localhost) by HAL9000.homeunix.com (8.12.9/8.12.9/Submit) id h84NPLEn014175; Thu, 4 Sep 2003 16:25:21 -0700 (PDT) (envelope-from das@FreeBSD.ORG) Date: Thu, 4 Sep 2003 16:25:21 -0700 From: David Schultz To: Andrew Kinney Message-ID: <20030904232520.GA13977@HAL9000.homeunix.com> Mail-Followup-To: Andrew Kinney , freebsd-hackers@freebsd.org References: <3F56352F.7050701@acm.org> <3F573729.8917.53574D7@localhost> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <3F573729.8917.53574D7@localhost> cc: freebsd-hackers@FreeBSD.ORG Subject: Re: 20TB Storage System (fsck????) X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 04 Sep 2003 23:25:26 -0000 On Thu, Sep 04, 2003, Andrew Kinney wrote: > Our experience has been that with 4GB of RAM (or more) you > really must increase your KVA to 2GB, leaving only 2GB of UVA. > So, I would concur with what Julian said. > > thrown> ;-) > > With the lack of third party filesystem support in FreeBSD, might > you be better served by looking at a Linux system running > ReiserFS or one of the other file systems designed for such > behemoth disk systems? I understand that ReiserFS fares rather poorly on large filesystems. People have complained about it overflowing the kernel heap when they try to create massive volumes. Perhaps more recent versions have addressed this, and I haven't verified this myself. > These days, I think Sun even gives away Solaris licenses with their > low end x86 servers, so that might even be an option. Umm...the Sun UFS implementation doesn't support >2TB volumes, since it uses 32-bit block numbers. > UFS is great, but there are other filesystems out there that have > already addressed such problems from their use in academic, > government, and scientific computing where gigantic filesystems > tend to be more prevalent. Yep. The most significant problem I see with UFS is that recovering from a crash or power failure is an O(data) operation, and that just doesn't scale well. Other designs (the most prevalent of which involve logging) support O(1) recovery. > >From my brief research on the subject, the FreeBSD community > has been highly resistant to supporting third party filesystems > precisely because nobody with such needs as yours has ever > contributed the code necessary to make third party filesystem > support a reality. The response is usually something like "if you > want it, go program it and submit it to a committer for review," > which is really the only reasonable response that can be made > given FreeBSD's goals. There's probably only a handful of committers who have access to the quantities of storage that would make this kind of filesystem development interesting. Meanwhile, UFS2 is perfectly adequate for most systems. I would imagine that an interested company would have to step forward and fund this sort of work. Moreover, there are licensing issues that would have to be considered to do a port of an existing filesystem...