From owner-freebsd-questions@FreeBSD.ORG Fri Oct 26 12:44:43 2007 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 3B1E516A421 for ; Fri, 26 Oct 2007 12:44:43 +0000 (UTC) (envelope-from freebsd@meijome.net) Received: from sigma.octantis.com.au (ns2.octantis.com.au [207.44.189.124]) by mx1.freebsd.org (Postfix) with ESMTP id 03D5013C4C8 for ; Fri, 26 Oct 2007 12:44:42 +0000 (UTC) (envelope-from freebsd@meijome.net) Received: (qmail 29304 invoked from network); 26 Oct 2007 07:44:41 -0500 Received: from 124-170-10-134.dyn.iinet.net.au (HELO localhost) (124.170.10.134) by sigma.octantis.com.au with (DHE-RSA-AES256-SHA encrypted) SMTP; 26 Oct 2007 07:44:41 -0500 Date: Fri, 26 Oct 2007 22:44:37 +1000 From: Norberto Meijome To: Wojciech Puchar Message-ID: <20071026224437.27b778e2@meijome.net> In-Reply-To: <20071026134905.L84884@wojtek.tensor.gdynia.pl> References: <20071026104209.3c0628ba@meijome.net> <20071026102559.A83146@wojtek.tensor.gdynia.pl> <20071026212158.5c990f7a@meijome.net> <20071026134905.L84884@wojtek.tensor.gdynia.pl> X-Mailer: Claws Mail 3.0.2 (GTK+ 2.10.14; i386-portbld-freebsd6.2) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Cc: FreeBSD Questions ML Subject: Re: Storage cluster with FreeBSD X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Oct 2007 12:44:43 -0000 On Fri, 26 Oct 2007 13:51:36 +0200 (CEST) Wojciech Puchar wrote: > > cool, thanks for the pointers... I had a side note to review these in conjunction with ggate. > So, is there any logical volume manager that works properly under 6.x or 7, ala LVM2 in Linux? > > there is gvinum, but i can't say "it works right". it's quite easy to > crash, at least was for me. so i've read... > > but - freebsd allows 7 partitions, but partitions can be recurrent - i > mean you can use bsdlabel on partitions and get things like ad0aa etc. > > i used this to make 30 partitions. interesting... > > so it's "manual LVM" as then you can ggate, gmirror or gconcat or gstripe > with that partitions. sorry, i don't see how this recursive formatting of partitions can be used as a 'manual lvm'... see below > > precise more clearly what you need. as always - simple solutions are best > solutions. and unix == simplicity. indeed. Well, as I said in OP, similar to what Lustre offers. Let's see : what I am after is a way to hook up a few computers ( say, 6) with a few HD (say, 6 x 400 GB), and setup across the whole thing a RAID that would let me : - keep running with no loss of data in case of a disk or node failure (or minimal in case of a node failure) - can be accessed by clients over standard network protocols (NFS, CIFS, etc) - the clients see volumes of x GB (maybe 1 of the total size, maybe 3 of different sizes...doesn't matter) All this until hear seems doable with FBSD + GEOM architecture. Now the tricky ones : - scales linearly - if I add 90 storage hosts, the system doesnt get bogged down with the management of the disks / stripe distributoin - I can add new hosts (from 6 to 10) and the new storage is available for the cluster. If I had LVM, I could simply add the new disks to the physical group, and then grow the logical volume... I don't see how 7.0's recursive partitioning can help me here.... Can you please explain ? thanks! B _________________________ {Beto|Norberto|Numard} Meijome "There are two kinds of stupid people. One kind says,'This is old and therefore good'. The other kind says, 'This is new, and therefore better.'" John Brunner, 'The Shockwave Rider'. I speak for myself, not my employer. Contents may be hot. Slippery when wet. Reading disclaimers makes you go blind. Writing them is worse. You have been Warned.