From owner-freebsd-fs@FreeBSD.ORG Sat Apr 7 16:00:10 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id CF2E916A407 for ; Sat, 7 Apr 2007 16:00:10 +0000 (UTC) (envelope-from mike@nux.co.uk) Received: from smtp.nildram.co.uk (smtp.nildram.co.uk [195.112.4.54]) by mx1.freebsd.org (Postfix) with ESMTP id 4844813C480 for ; Sat, 7 Apr 2007 16:00:09 +0000 (UTC) (envelope-from mike@nux.co.uk) Received: from office.nux.co.uk (unknown [82.133.40.67]) by smtp.nildram.co.uk (Postfix) with ESMTP id 9D2A32B73C4 for ; Sat, 7 Apr 2007 17:00:05 +0100 (BST) Received: (qmail 34288 invoked by uid 2223); 7 Apr 2007 16:00:08 -0000 Received: from localhost (sendmail-bs@127.0.0.1) by localhost with SMTP; 7 Apr 2007 16:00:08 -0000 Date: Sat, 7 Apr 2007 17:00:08 +0100 (BST) From: Mike Wolman X-X-Sender: mike@nux.eros.office To: Jim Rees , freebsd-fs@freebsd.org, freebsd-questions@freebsd.org In-Reply-To: <20070407115854.GA14402@citi.umich.edu> Message-ID: <20070407164235.F33915@nux.eros.office> References: <219395.34786.qm@web30302.mail.mud.yahoo.com> <20070407103057.P20396@nux.eros.office> <20070407115854.GA14402@citi.umich.edu> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: Subject: Re: some thoughts about gmirror X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 07 Apr 2007 16:00:10 -0000 > if you were keeping track of the blocks which had changed > then you do not need to generate this list and simply send over the > changed blocks. > > Unison keeps a list of files at each end and only exchanges block lists for > files that have changed. I use it to sync 40GB (10K files) over a 1Mbps > link and it's very fast. It also will do two-way sync. > Unison and rsync both work on the filesystem level and not with the blocks directly so would not be able to achieve the same result as the live network backup on netbsd - ie allowing a simple dd restore of a machine. As this would be filesystem independent and if you are running zfs or other snapshot capable filesystem i think rsync or unison would have a problem working with the snapshots. i do use rsync with close to about 1Tb of data and a lot hard links for - but if the remote file changes you have to store the entire copy of new file and not just the actual blocks which have changed. Mike. On Sat, 7 Apr 2007, Jim Rees wrote: > Mike Wolman wrote: > >