From owner-freebsd-fs Mon Feb 5 7:39:30 2001 Delivered-To: freebsd-fs@freebsd.org Received: from mercury.ccmr.cornell.edu (mercury.ccmr.cornell.edu [128.84.231.97]) by hub.freebsd.org (Postfix) with ESMTP id A33F337B491; Mon, 5 Feb 2001 07:39:08 -0800 (PST) Received: from ruby.ccmr.cornell.edu (IDENT:0@ruby.ccmr.cornell.edu [128.84.231.115]) by mercury.ccmr.cornell.edu (8.9.3/8.9.3) with ESMTP id KAA13217; Mon, 5 Feb 2001 10:39:04 -0500 Received: from localhost (mitch@localhost) by ruby.ccmr.cornell.edu (8.9.3/8.9.3) with ESMTP id KAA06449; Mon, 5 Feb 2001 10:39:02 -0500 X-Authentication-Warning: ruby.ccmr.cornell.edu: mitch owned process doing -bs Date: Mon, 5 Feb 2001 10:39:02 -0500 (EST) From: Mitch Collinsworth To: "Michael C . Wu" Cc: hackers@FreeBSD.ORG, fs@FreeBSD.ORG Subject: Re: Extremely large (70TB) File system/server planning In-Reply-To: <20010205092658.A97400@peorth.iteration.net> Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-freebsd-fs@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.org You didn't say what applications this thing is going to support. That does matter. A lot. One thing worth looking at is AFS, or maybe MR-AFS. And now OpenAFS. -Mitch On Mon, 5 Feb 2001, Michael C . Wu wrote: > Hello Everyone, > > While talking to a friend about what his company is planning to do, > I found out that he is planning a 70TB filesystem/servers/cluster/db. > (Yes, seventy t-e-r-a-b-y-t-e...) > > Apparently, he has files that go up to 2gb each, and actually require > such a horribly sized cluster. > > If he wanted a PC cluster, and having 5TB on each PC, he would have > 350 machines to maintain. From past experience maintaining clusters, > I guarantee that he will have at least 1 box failing every other day. > And I really do not think his idea of using NFS is that good. ;-) > > Now if we were to go to the high-end route (and probably more cost > effective), we can pick SAN's, large Sun fileservers, or somesuch. > I still cannot picture him being able to maintain file integrity. > > I say that he should attempt to split his filesystems into much > smaller chunks, say 1TB each. And attempt some way of having a RAID5 > array. Mirroring or other RAID configurations would prove too costly. > What would you guys do in this case? :) > -- > +------------------------------------------------------------------+ > | keichii@peorth.iteration.net | keichii@bsdconspiracy.net | > | http://peorth.iteration.net/~keichii | Yes, BSD is a conspiracy. | > +------------------------------------------------------------------+ > > > To Unsubscribe: send mail to majordomo@FreeBSD.org > with "unsubscribe freebsd-fs" in the body of the message > To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-fs" in the body of the message