From owner-freebsd-fs@FreeBSD.ORG Tue Jan 22 14:51:58 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 61F8C16A41B for ; Tue, 22 Jan 2008 14:51:58 +0000 (UTC) (envelope-from bra@fsn.hu) Received: from people.fsn.hu (people.fsn.hu [195.228.252.137]) by mx1.freebsd.org (Postfix) with ESMTP id 2EF7313C455 for ; Tue, 22 Jan 2008 14:51:57 +0000 (UTC) (envelope-from bra@fsn.hu) Received: from japan.t-online.private (people [192.168.2.4]) by people.fsn.hu (Postfix) with ESMTP id 5A16813C908 for ; Tue, 22 Jan 2008 15:36:09 +0100 (CET) Message-ID: <4795FF59.7010708@fsn.hu> Date: Tue, 22 Jan 2008 15:36:09 +0100 From: Attila Nagy User-Agent: Thunderbird 2.0.0.9 (X11/20071204) MIME-Version: 1.0 To: freebsd-fs@freebsd.org Content-Type: text/plain; charset=ISO-8859-2; format=flowed Content-Transfer-Encoding: 7bit Subject: Redundant NFS with ZFS X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 22 Jan 2008 14:51:58 -0000 Hello, I have some machines running FreeBSD as redundant NFS servers (using CARP). The way they work is the following: - I have a master (content) machine on which I maintain an UFS filesystem image on an UFS - I have this image mounted through md - there are (any) number of NFS servers, one that is the master (from the client PoV) and the others as slaves - everytime I need changes in the content of the image, I make them, then do a mount -o ro -u /nfs and issue an rsync to the NFS (slave) servers, then I switch over the master and do a sync to there too This works wonderfully, although the image distribution is slow and painful (thanks to rsync). With ZFS there is a more simple oppurtunity: make snapshots on the content master and distribute them via zfs send&receive. However there's a little problem: the fsids are not in sync and the clients get stale NFS filehandle errors. This is solved in the current scenario by distributing whole UFS images with their static fsids, but I don't know how it would be possible with ZFS. Currently I see two possibilities: - changing the NFS server, so it can be manually set (like in Linux, where it's possible to give an fsid parameter in exports) - synchronize ZFS fsids across the machines The second would be perfect for me, I just couldn't figure out how could I do this (a cursory glance on the ZFS source didn't result a clean and simple solution). Any ideas on this? (I've seen some discussions on this topic in a ZFS list, but there was no solution, just a little misunderstanding with shared storages and Sun clusters) Thanks, -- Attila Nagy e-mail: Attila.Nagy@fsn.hu Free Software Network (FSN.HU) phone: +3630 306 6758 http://www.fsn.hu/