From owner-freebsd-questions@FreeBSD.ORG Thu Oct 6 17:18:56 2005 Return-Path: X-Original-To: freebsd-questions@freebsd.org Delivered-To: freebsd-questions@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 3FAA216A41F for ; Thu, 6 Oct 2005 17:18:56 +0000 (GMT) (envelope-from freebsd-questions-local@be-well.ilk.org) Received: from mail22.sea5.speakeasy.net (mail22.sea5.speakeasy.net [69.17.117.24]) by mx1.FreeBSD.org (Postfix) with ESMTP id 8711543D62 for ; Thu, 6 Oct 2005 17:18:49 +0000 (GMT) (envelope-from freebsd-questions-local@be-well.ilk.org) Received: (qmail 8417 invoked from network); 6 Oct 2005 17:18:48 -0000 Received: from dsl092-078-145.bos1.dsl.speakeasy.net (HELO be-well.ilk.org) ([66.92.78.145]) (envelope-sender ) by mail22.sea5.speakeasy.net (qmail-ldap-1.03) with SMTP for ; 6 Oct 2005 17:18:48 -0000 Received: by be-well.ilk.org (Postfix, from userid 1147) id C2EA437; Thu, 6 Oct 2005 13:18:47 -0400 (EDT) Sender: lowell@be-well.ilk.org To: "Chad Leigh -- Shire.Net LLC" References: <67F3ED9B-5977-41E1-BABE-F4F17399EAF6@shire.net> <44oe62zizr.fsf@be-well.ilk.org> <380986F7-B6AA-4F66-88FE-722D45E1AC80@shire.net> From: Lowell Gilbert Date: 06 Oct 2005 13:18:47 -0400 In-Reply-To: <380986F7-B6AA-4F66-88FE-722D45E1AC80@shire.net> Message-ID: <44ek6yzhqg.fsf@be-well.ilk.org> Lines: 50 User-Agent: Gnus/5.09 (Gnus v5.9.0) Emacs/21.3 MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Cc: freebsd-questions@freebsd.org Subject: Re: md device backing files on nfs mounts? X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 Oct 2005 17:18:56 -0000 "Chad Leigh -- Shire.Net LLC" writes: > On Oct 6, 2005, at 10:51 AM, Lowell Gilbert wrote: > > > "Chad Leigh -- Shire.Net LLC" writes: > > > > > >> Can the files that back an md device be resident on an nfs mount? > >> > >> I run some jails with each having its own root based on an md > >> device. > >> I am thinking of having a backend nfs server have all the storage > >> and > >> serve it to various front end servers. If one front end server went > >> down I could easily bring it up on another one. Kind of poor-man's > >> redundancy > >> > > > > How do you get the NFS mount before you have a root? > > Just the jails would be on md devices on the nfs mounted filesystem. > Ie, main computer boots normally, mounts nfs filesystem, then mounts > md devices backed by files on the nfs fielsystem Yes, okay, that seems obvious now. Maybe I need more caffeine. I just tried it without the jails and was able to mount and use the filesystem. The permissions *are* a little tricky, because root is (as usual) mapped to nobody on my NFS mounts, and needs write access on the backing file. I did the procedure from the last example in the mdconfig(8) manual, and it worked just like on a local disk. There might have been some anomalies with the output of ls(1), but I can't reproduce those now. You might want to try measuring performance if you implement this; it could have some strange interactions with VM and buffering. Clever idea, by the way. > > Chad > > > Also, I suspect the permissions might be a little tricky... > > > > Some kind of netbooting might work. -- Lowell Gilbert, embedded/networking software engineer, Boston area http://be-well.ilk.org/~lowell/