From owner-freebsd-stable@FreeBSD.ORG Wed Jan 19 06:11:35 2005 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id F37C116A4CE for ; Wed, 19 Jan 2005 06:11:34 +0000 (GMT) Received: from smtp815.mail.sc5.yahoo.com (smtp815.mail.sc5.yahoo.com [66.163.170.1]) by mx1.FreeBSD.org (Postfix) with SMTP id C9AA943D46 for ; Wed, 19 Jan 2005 06:11:34 +0000 (GMT) (envelope-from noackjr@alumni.rice.edu) Received: from unknown (HELO optimator.noacks.org) (noacks@swbell.net@70.240.249.100 with login) by smtp815.mail.sc5.yahoo.com with SMTP; 19 Jan 2005 06:11:34 -0000 Received: from localhost (localhost [127.0.0.1]) by optimator.noacks.org (Postfix) with ESMTP id D027E629E; Wed, 19 Jan 2005 00:11:33 -0600 (CST) Received: from optimator.noacks.org ([127.0.0.1]) by localhost (optimator.noacks.org [127.0.0.1]) (amavisd-new, port 10024) with LMTP id 72289-02; Wed, 19 Jan 2005 00:10:15 -0600 (CST) Received: from compgeek.noacks.org (compgeek [192.168.1.10]) by optimator.noacks.org (Postfix) with ESMTP id B688261EC; Wed, 19 Jan 2005 00:10:15 -0600 (CST) Received: from [127.0.0.1] (localhost [127.0.0.1]) by compgeek.noacks.org (8.13.1/8.13.1) with ESMTP id j0J6AExu051632; Wed, 19 Jan 2005 00:10:15 -0600 (CST) (envelope-from noackjr@alumni.rice.edu) Message-ID: <41EDF9C6.4040709@alumni.rice.edu> Date: Wed, 19 Jan 2005 00:10:14 -0600 From: Jon Noack User-Agent: Mozilla Thunderbird 1.0 (X11/20050103) X-Accept-Language: en-us, en MIME-Version: 1.0 To: Karl Denninger References: <20050118234606.C11398@Denninger.Net> In-Reply-To: <20050118234606.C11398@Denninger.Net> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: amavisd-new at noacks.org cc: freebsd-stable@freebsd.org Subject: Re: Trials and tribulations on mirroring.... X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: noackjr@alumni.rice.edu List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Jan 2005 06:11:35 -0000 On 01/18/05 23:46, Karl Denninger wrote: > > > So, my next attempt (with a new, fresh load) was to give gmirror a shot > instead, since I only need Raid 1, and this looks like a "better" option > from that perspective given gvinum's squirrely and not-all-there status at > the moment. > > Weeeeellll.. the manual page (and the archives on the list here) implies that > I can do the following: > > 1. Set up the system on one of the two mirror disks. > > 2. In single user mode, use "gmirror label -v -b round-robin disk ad4" > to set up the pre-existing disk (with data on it), which I booted from, > as the "primary". > > 3. Then use "gmirror insert disk ad6" to add the secondary (mirrored) disk, > which will automatically sync it and bring them into a consistent state. > > Only one small problem - the first command (in #2) fails, with: > > "Can't store metadata on ad4: Operation not permitted" > > This is true if the system is mounted read-only (in single user mode) or > read-write (in multiuser, with all filesystems mounted) > > Attempting to label the SECOND (bare) disk works, but of course that's > backwards and an "insert" would immediately destroy the running system (I > assume it would also fail with the same permission error, but I've not tried > it) - so that's not an option. > > I also tried it from the fixit disk, but the KLD cannot be loaded from the > fixit disk, and none of the commands work - so that appears to not be an > option either. > > How do you get this thing set up? The archives here (and man pages) > strongly imply that this works for a root filesystem and boot drive - > what am I missing? > > Need a Raid 1 solution that works to move over to the 5.x world out here... If any filesystem is mounted then GEOM will not allow metadata updates for the drive. Here's a solution given over on the geom@ list: http://lists.freebsd.org/pipermail/freebsd-geom/2004-November/000379.html I converted to gmirror from ataraid, so I already had 2 disks with identical contents. I worked around this problem as outlined here (the instructions have errors that are corrected later in the thread): http://lists.freebsd.org/pipermail/freebsd-current/2004-October/039907.html I wish we handled this in the installer, but as I can't produce the code to do it I'll shut up now... Jon