From owner-freebsd-questions@FreeBSD.ORG Sat Apr 14 04:00:18 2007 Return-Path: X-Original-To: freebsd-questions@freebsd.org Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id A053316A400 for ; Sat, 14 Apr 2007 04:00:18 +0000 (UTC) (envelope-from freebsd@skyhawk.ca) Received: from pd3mo1so.prod.shaw.ca (shawidc-mo1.cg.shawcable.net [24.71.223.10]) by mx1.freebsd.org (Postfix) with ESMTP id 8298413C45E for ; Sat, 14 Apr 2007 04:00:18 +0000 (UTC) (envelope-from freebsd@skyhawk.ca) Received: from pd2mr5so.prod.shaw.ca (pd2mr5so-qfe3.prod.shaw.ca [10.0.141.8]) by l-daemon (Sun ONE Messaging Server 6.0 HotFix 1.01 (built Mar 15 2004)) with ESMTP id <0JGG00K9IZ4I68D0@l-daemon> for freebsd-questions@freebsd.org; Fri, 13 Apr 2007 22:00:18 -0600 (MDT) Received: from pn2ml2so.prod.shaw.ca ([10.0.121.146]) by pd2mr5so.prod.shaw.ca (Sun Java System Messaging Server 6.2-7.05 (built Sep 5 2006)) with ESMTP id <0JGG002BUZ4II2U0@pd2mr5so.prod.shaw.ca> for freebsd-questions@freebsd.org; Fri, 13 Apr 2007 22:00:19 -0600 (MDT) Received: from mail.skyhawk.ca ([70.68.196.45]) by l-daemon (Sun ONE Messaging Server 6.0 HotFix 1.01 (built Mar 15 2004)) with ESMTP id <0JGG00CFHZ4HFNA3@l-daemon> for freebsd-questions@freebsd.org; Fri, 13 Apr 2007 22:00:18 -0600 (MDT) Received: from [192.168.1.20] (seinar.skyhawk [192.168.1.20]) by mail.skyhawk.ca with esmtp; Fri, 13 Apr 2007 20:58:11 -0700 Date: Fri, 13 Apr 2007 21:00:19 -0700 From: Andrew Fremantle To: freebsd-questions@freebsd.org Message-id: <462051D3.2000608@skyhawk.ca> MIME-version: 1.0 Content-type: text/plain; charset=ISO-8859-1; format=flowed Content-transfer-encoding: 7bit User-Agent: Thunderbird 1.5.0.10 (Windows/20070221) Subject: Flexible fault-tolerant storage for new system - Many questions X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 14 Apr 2007 04:00:18 -0000 Hello, I'm wondering what is the current "correct" way to implement fault-tolerant storage on FreeBSD? I know that in ages past, it was vinum, or vinum patched up for GEOM, gvinum. I just set up a new server with gvinum, and I've already had it crash once, which makes me very wary of putting the machine into production. According to this forum thread, http://www.bsdforums.org/forums/showthread.php?threadid=48430 vinum is all but dead, and the way forward is direct GEOM implementations. I'm somewhat distressed at the almost total absence of GEOM documentation, at least as compared to vinum. Should I re-do the server using GEOM instead of gvinum? I want a configuration something like the following : /dev/gvinum/root on / (ufs, local) (6-way mirror, all drives BIOS bootable) devfs on /dev (devfs, local) /dev/gvinum/tmp on /tmp (ufs, local, soft-updates) (3-way stripe mirrored on 3-way stripe) /dev/gvinum/usr on /usr (ufs, local, soft-updates) (3-way stripe mirrored on 3-way stripe) /dev/gvinum/var on /var (ufs, local, soft-updates) (3-way stripe mirrored on 3-way stripe) /dev/gvinum/home on /home (ufs, local, soft-updates) (3-way stripe mirrored on 3-way stripe) /dev/gvinum/software on /software (ufs, local, soft-updates) (6-way RAID5) /dev/gvinum/bigraid on /bigraid (ufs, local, soft-updates) (6-way RAID5) My inclination is to make two BIOS partitions (slices) on each disk, one for OS related partitions and one for non-OS partitions. I'm not at all certain how GEOM relates and interacts with BSD Disklabels. ( Would I be better off with three GEOM "devices" (One RAID1, one RAID1+0, one RAID3), with multiple partitions on them, or many GEOM "devices" each containing one filesystem?) Will direct GEOM implementation be more stable than vinum? How does direct GEOM perform compared to vinum? Is there any chance sysinstall supports installing onto GEOM volumes? Is anyone aware of any of this stuff being documented more than is in the Handbook? I'd love to digest a primer before trying to jump into the paint. My apologies if this makes you mutter "rtFM!". If you would be so kind as to direct me to the manual, I will gladly read it. - Andrew