From owner-freebsd-isp Fri Dec 13 8:43:41 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 0EFDB37B401 for ; Fri, 13 Dec 2002 08:43:40 -0800 (PST) Received: from cobra.acceleratedweb.net (cobra-gw.acceleratedweb.net [207.99.79.37]) by mx1.FreeBSD.org (Postfix) with SMTP id 5420343ED1 for ; Fri, 13 Dec 2002 08:43:39 -0800 (PST) (envelope-from simon@optinet.com) Received: (qmail 35685 invoked by uid 106); 13 Dec 2002 16:48:14 -0000 Received: from 24-90-121-13.nyc.rr.com (HELO station1) (24.90.121.13) by cobra.acceleratedweb.net with SMTP; 13 Dec 2002 16:48:14 -0000 From: "Simon" To: "Marcus Reid" Cc: "freebsd-isp@FreeBSD.ORG" Date: Fri, 13 Dec 2002 11:45:31 -0500 Reply-To: "Simon" X-Mailer: PMMail 2000 Professional (2.10.2010) For Windows 2000 (5.0.2195;2) In-Reply-To: <20021213142728.GA92171@blazingdot.com> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Subject: Re: network backup Message-Id: <20021213164339.5420343ED1@mx1.FreeBSD.org> Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org They don't change a whole lot, but they do change and new ones are uploaded. What I'm trying to do is build massive network backup server, backing up 6+ servers simultaneously. Each server has about 50-100gb worth of data to be backed up daily. I did look at dump, looks great, the only problem is that it can't backup individual directories, rather whole filesystems, if I didn't misread something. -Simon On Fri, 13 Dec 2002 06:27:29 -0800, Marcus Reid wrote: >On Fri, Dec 13, 2002 at 03:22:06AM -0500, Simon wrote: >> >> rsync is nice, but it can't (afaik) compress data being synced on the fly to >> save disk space :-( Is there anything out there which works like rsync and >> can compress on the fly to space disk space? having 100GB of text files >> compressed can save quite a few gigs. > >The -z option for rsync will compress for the transfer, but the file will be >decompressed before it is written to the disk (having the same file at both >ends being the point of rsync..) > >If the files change a lot and you need to do a lot of incremental backups, >I'd use rsync and just give up the space to store the uncompressed files if >you can. > >Otherwise, if the files are generally small or rarely change, you could pipe >the output of dump over ssh and through gzip and into an archive, and then do >incremental dumps the same way. Can be automated nicely if you set up an >authorized keypair so you don't need to enter a password. > >Note that I've removed the hackers list from the recipients. This is totally >off-topic for that list. > >Marcus > >> >> Thanks, >> Simon > To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message