From owner-freebsd-hackers@FreeBSD.ORG Wed Oct 8 11:20:05 2008 Return-Path: Delivered-To: freebsd-hackers@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B97681065690 for ; Wed, 8 Oct 2008 11:20:05 +0000 (UTC) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (unknown [IPv6:2a01:170:102f::2]) by mx1.freebsd.org (Postfix) with ESMTP id 314CE8FC1E for ; Wed, 8 Oct 2008 11:20:04 +0000 (UTC) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (localhost [127.0.0.1]) by lurza.secnetix.de (8.14.3/8.14.3) with ESMTP id m98BK3Vb043546; Wed, 8 Oct 2008 13:20:03 +0200 (CEST) (envelope-from oliver.fromme@secnetix.de) Received: (from olli@localhost) by lurza.secnetix.de (8.14.3/8.14.3/Submit) id m98BK2fV043545; Wed, 8 Oct 2008 13:20:02 +0200 (CEST) (envelope-from olli) Date: Wed, 8 Oct 2008 13:20:02 +0200 (CEST) Message-Id: <200810081120.m98BK2fV043545@lurza.secnetix.de> From: Oliver Fromme To: freebsd-hackers@FreeBSD.ORG, "Zaphod Beeblebrox" , Volker , Evren Yurtesen In-Reply-To: <86iqs3sdtp.fsf@ds4.des.no> X-Newsgroups: list.freebsd-hackers User-Agent: tin/1.8.3-20070201 ("Scotasay") (UNIX) (FreeBSD/6.4-PRERELEASE-20080904 (i386)) MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 8bit X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-2.1.2 (lurza.secnetix.de [127.0.0.1]); Wed, 08 Oct 2008 13:20:03 +0200 (CEST) Cc: Subject: Re: continuous backup solution for FreeBSD X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: freebsd-hackers@FreeBSD.ORG, Zaphod Beeblebrox , Volker , Evren Yurtesen List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Oct 2008 11:20:05 -0000 Dag-Erling Smørgrav wrote: > "Zaphod Beeblebrox" writes: > > "Dag-Erling Smørgrav" writes: > > > What really annoys me with this thread is that nobody has provided > > > any information at all that would allow someone to understand what > > > needs to be done and estimate how hard it would be. > > Well... I hinted that a hammer port would be sufficient (although they > > need to finish their replication design) and I hinted that the hammer > > approach may be graftable to ZFS. Both reasonably large effort-wise > > (but probably within the scope of a single developer with sufficient > > time). > > No... you're so far off the mark it's not even funny, especially when > it's been repeatedly pointed out to you. This is not a file system, > it's a backup system. It's not designed to survive a disk crash or an > accidental file deletion, it's designed to survive a direct missile > strike on your colo center. > > To quote Wikipedia, "CDP is a service that captures changes to data to a > separate storage location" - emphasis on "separate". FWIW, the HAMMER file system _does_ support replication to remote targets (thus "separate"). Unfortunately they call this feature "mirroring", which is misleading at best. It's really rather a replication mechanism, much like the binlog of MySQL. It can be used for various purposes, including live mirroring, delayed mirroring, archiving, backup and point-in-time recovery. Well, of course, all of that doesn't help us at all because HAMMER doesn't exist on FreeBSD. However, ZFS does exist on FreeBSD, and I think it wouldn't be impossible to add similar features to ZFS. Another possibility would be to extend gjournal by adding time stamps to journal transactions and a possibility to feed the journal to a pipe, socket or whatever. And of course a client-side implementation that does something useful with the journal stream. This might even be a good SoC project. Best regards Oliver -- Oliver Fromme, secnetix GmbH & Co. KG, Marktplatz 29, 85567 Grafing b. M. Handelsregister: Registergericht Muenchen, HRA 74606, Geschäftsfuehrung: secnetix Verwaltungsgesellsch. mbH, Handelsregister: Registergericht Mün- chen, HRB 125758, Geschäftsführer: Maik Bachmann, Olaf Erb, Ralf Gebhart FreeBSD-Dienstleistungen, -Produkte und mehr: http://www.secnetix.de/bsd "File names are infinite in length, where infinity is set to 255 characters." -- Peter Collinson, "The Unix File System"