Date: Mon, 10 Jul 2006 14:38:41 -0700 From: John-Mark Gurney <gurney_j@resnet.uoregon.edu> To: Brad Falzon <brad.mailing@adam.com.au> Cc: freebsd-hackers@freebsd.org Subject: Re: File Mirror Software Message-ID: <20060710213841.GP734@funkthat.com> In-Reply-To: <44B1D0F6.1050809@adam.com.au> References: <44B1D0F6.1050809@adam.com.au>
next in thread | previous in thread | raw e-mail | index | archive | help
Brad Falzon wrote this message on Mon, Jul 10, 2006 at 13:30 +0930:
> Currently, we're building our replacement file mirror box. (Its a beefy
> 5TB Server) Anyway, currently, we use the application 'mirror' to handle
> ftp mirrors and our own rsynctool which connects to a database for our
> rsync mirrors. However, this is beginning to be a pain, ie no reports
> are generated, hard to maintain etc.
>
> I was wondering if anybody has similar experiences and can recommend any
> software that could handle ftp and rsync mirrors better than our home
> grown scripts.
>
> I've spent along time researching this, but could never get a good
> enough google query.
>
> Simba seems to have much potential, however, being version 0.8 has more
> than its fair share of bugs at the moment. And the only other ftp mirror
> utility (weex) can only handle ftp mirrors, not rsync.
>
> Does anyone have any recommended ports that we should be looking into
> before making our final choice.
If you're looking for software to do mirroring, I'd recommend you look
at cvsup... Yes, this software is a general mirroring tool, and a few
orders of a magnitude faster than rsync...
It does have issues with really large files (like 2gb+) as the 10/15
minute timeout can be shorter than the time taken to generate a checksum
for the file... Though w/ faster cpu's these days, it's probably no
longer the case..
A number of years back, we used it to mirror 140GB of data between sites..
--
John-Mark Gurney Voice: +1 415 225 5579
"All that I will do, has been done, All that I have, has not."
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20060710213841.GP734>