From owner-freebsd-questions@FreeBSD.ORG Thu Dec 17 23:36:10 2009 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B5948106566C for ; Thu, 17 Dec 2009 23:36:10 +0000 (UTC) (envelope-from lostlogic@lostlogicx.com) Received: from erudite.lostlogicx.com (erudite.lostlogicx.com [74.208.67.179]) by mx1.freebsd.org (Postfix) with ESMTP id 69F2B8FC12 for ; Thu, 17 Dec 2009 23:36:10 +0000 (UTC) Received: by erudite.lostlogicx.com (Postfix, from userid 1001) id 0F6E6277AC; Thu, 17 Dec 2009 15:19:58 -0800 (PST) Date: Thu, 17 Dec 2009 15:19:58 -0800 From: Brandon Low To: Roland Smith Message-ID: <20091217231957.GH73162@lostlogicx.com> References: <74692B50-D390-4CE4-9ED3-CA5B46CE8697@todoo.biz> <20091217171207.GB93764@slackbox.xs4all.nl> <20091217223940.GA33412@slackbox.xs4all.nl> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20091217223940.GA33412@slackbox.xs4all.nl> X-Operating-System: FreeBSD 8.0-RELEASE amd64 User-Agent: Mutt/1.5.20 (2009-06-14) Cc: Liste FreeBSD Subject: Re: incremental FTP backup program X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 17 Dec 2009 23:36:10 -0000 I have a backup system that I created for rougly that scenario. It's not bullet proof, not well tested in the community, etc. I haven't even tried the FTP Transport on FreeBSD yet. http://lostlogicx.com/backupsblow/ I use it over S3 to backup my server personally. --Brandon On 2009-12-17 (Thu) at 23:39:40 +0100, Roland Smith wrote: > On Thu, Dec 17, 2009 at 10:55:54PM +0100, bsd wrote: > > > Are there any specific scripting tools that I could use in order to achieve > > that ? > > Well, /bin/sh and 'man sh' spring to mind. :-) Or use another scripting > language if you are more familiar with that, e.g. perl or python. But since > you are mainly invoking programs, a plain shell-script would be my first choice. > > > From what you are describing a tool that would automate the dump process and > > take care of snapshots versions would be a must??? ?? > > See e.g. the dodumps script on my scripts page; http://www.xs4all.nl/~rsmith/software/scripts.html > > It just names the dumps 'filesystem-dumplevel-date.dump', > e.g. root-0-20091217.dump. You could extend this script to transfer the dumps > via ftp, and remove old dumps from the FTP site. After testing, you could even > run it from cron. > > Start off with a level 0 dump, and then perform higher level dumps as often as > you need. Google for 'dump levels', and you'll find lots of different schemes, > e.g. http://docs.sun.com/app/docs/doc/817-5093/bkupconcepts-21?a=view > > I would urge you to keep things simple. The more complicated the your > solution, the easier things can go wrong. > > One caveat about dump though. If one of your filesystems contains just one big > database in a huge file, dump will copy the whole file even if just one byte > has changed. In such a case you should see if the database has tools to just > copy the records changed since the last backup and use that instead. > > > Roland > -- > R.F.Smith http://www.xs4all.nl/~rsmith/ > [plain text _non-HTML_ PGP/GnuPG encrypted/signed email much appreciated] > pgp: 1A2B 477F 9970 BA3C 2914 B7CE 1277 EFB0 C321 A725 (KeyID: C321A725)