From owner-freebsd-hubs Mon Sep 15 08:25:48 1997 Return-Path: Received: (from root@localhost) by hub.freebsd.org (8.8.7/8.8.7) id IAA04181 for hubs-outgoing; Mon, 15 Sep 1997 08:25:48 -0700 (PDT) Received: from jealousy.doc.ic.ac.uk (jealousy.doc.ic.ac.uk [146.169.2.19]) by hub.freebsd.org (8.8.7/8.8.7) with SMTP id IAA04168 for ; Mon, 15 Sep 1997 08:25:37 -0700 (PDT) Received: from doc.ic.ac.uk [146.169.24.12] by jealousy.doc.ic.ac.uk with esmtp (Exim 1.71 #2) id 0xAd1J-0002hr-00; Mon, 15 Sep 1997 16:25:01 +0100 Message-ID: <341D52F6.14291EF0@doc.ic.ac.uk> Date: Mon, 15 Sep 1997 16:23:34 +0100 From: Lee McLoughlin Organization: IC-Parc, Imperial College, London, UK X-Mailer: Mozilla 4.03 [en] (X11; I; Linux 2.0.30 i586) MIME-Version: 1.0 To: Carl Harris CC: freebsd-hubs@freebsd.org Subject: Re: ftp4.freebsd.org down References: <199709142053.QAA08931@thumper.cns.vt.edu> Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Sender: owner-freebsd-hubs@freebsd.org X-Loop: FreeBSD.org Precedence: bulk Carl Harris wrote: > > In attempting to rebuild our mirrors of FreeBSD, NetBSD, and others I > have once again come to the conclusion that 'mirror', the Perl script, > seems wholly unsuited to the task of maintaining *large* mirrors. Even I (the author of the perl mirror) have to admit that very large areas give mirror serious grief. Some of these problems will be overcome in mirror-2.9 (due out in about 1 month). That version can mirror directory-by-directory. This avoids the nasty memory requirements of mirror-2.8. The downside is that it needs to do a 'dir' command in each directory - which makes it harder on the server (a get of one ls-lR file .vs. several hundred 'dir' commands). I'm busy on a complete rewrite from scratch of mirror with one of its main goals being the ability to handle multi-gigabyte mirrors efficiently. It should go into beta tests in a few months time (if I can find enough time to work on it !!) > I > recall seeing a post to this list (or perhaps freebsd-announce) about > a new official mirror that mentioned a mirroring software package. > However, I can't seem to find that post anywhere. Can someone bounce > a copy of that post to me? Or better yet, offer suggestions of better > software to take care of this task -- I find it hard to believe that > ftp mirrors the world over are getting by with 'mirror'. Excluding very large areas mirror is OK. I'm hoping to do a lot better than just "OK" with the mirror 3. Lee -- Lee McLoughlin. Phone: +44 171 594 8388 IC-Parc, Imperial College, Fax: +44 171 594 8432 South Kensington, London. SW7 2AZ. UK. Email: L.McLoughlin@doc.ic.ac.uk