From owner-freebsd-hubs Sun Sep 14 13:54:02 1997 Return-Path: Received: (from root@localhost) by hub.freebsd.org (8.8.7/8.8.7) id NAA29968 for hubs-outgoing; Sun, 14 Sep 1997 13:54:02 -0700 (PDT) Received: from thumper.cns.vt.edu (thumper.cns.vt.edu [128.173.12.196]) by hub.freebsd.org (8.8.7/8.8.7) with ESMTP id NAA29957 for ; Sun, 14 Sep 1997 13:53:57 -0700 (PDT) Received: (ceharris@localhost) by thumper.cns.vt.edu (8.8.5/8.8.5) id QAA08931 for freebsd-hubs@freebsd.org; Sun, 14 Sep 1997 16:53:49 -0400 (EDT) From: Carl Harris Message-Id: <199709142053.QAA08931@thumper.cns.vt.edu> Subject: ftp4.freebsd.org down To: freebsd-hubs@freebsd.org Date: Sun, 14 Sep 1997 16:53:49 -0400 (EDT) X-Mailer: ELM [version 2.4 PL25] Content-Type: text Sender: owner-freebsd-hubs@freebsd.org X-Loop: FreeBSD.org Precedence: bulk ftp4.freebsd.org (a.k.a. ftp.cslab.vt.edu) is down while I try to put the pieces back together -- it suffered a major disk crash. Hopefully, it won't be down for more than a few days. In attempting to rebuild our mirrors of FreeBSD, NetBSD, and others I have once again come to the conclusion that 'mirror', the Perl script, seems wholly unsuited to the task of maintaining *large* mirrors. I recall seeing a post to this list (or perhaps freebsd-announce) about a new official mirror that mentioned a mirroring software package. However, I can't seem to find that post anywhere. Can someone bounce a copy of that post to me? Or better yet, offer suggestions of better software to take care of this task -- I find it hard to believe that ftp mirrors the world over are getting by with 'mirror'. -- Carl Harris Communication Systems Lead Engineer CNS Research and Development, Virginia Tech ceharris@vt.edu From owner-freebsd-hubs Sun Sep 14 16:21:21 1997 Return-Path: Received: (from root@localhost) by hub.freebsd.org (8.8.7/8.8.7) id QAA10127 for hubs-outgoing; Sun, 14 Sep 1997 16:21:21 -0700 (PDT) Received: from schubert.promo.de (schubert.Promo.DE [194.45.188.65]) by hub.freebsd.org (8.8.7/8.8.7) with ESMTP id QAA10100 for ; Sun, 14 Sep 1997 16:21:07 -0700 (PDT) Received: from [194.45.188.81] (stefan.Promo.DE [194.45.188.81]) by schubert.promo.de (8.8.5/8.8.5) with ESMTP id BAA17224; Mon, 15 Sep 1997 01:19:16 +0200 (MET DST) X-Sender: stefan@mail.promo.de Message-Id: In-Reply-To: <199709142053.QAA08931@thumper.cns.vt.edu> Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Date: Mon, 15 Sep 1997 01:20:18 +0200 To: Carl Harris , freebsd-hubs@FreeBSD.ORG From: Stefan Bethke Subject: Re: ftp4.freebsd.org down Sender: owner-freebsd-hubs@FreeBSD.ORG X-Loop: FreeBSD.org Precedence: bulk At 22:53 Uhr +0200 14.09.1997, Carl Harris wrote: >ftp4.freebsd.org (a.k.a. ftp.cslab.vt.edu) is down while I try to put >the pieces back together -- it suffered a major disk crash. Hopefully, >it won't be down for more than a few days. > >In attempting to rebuild our mirrors of FreeBSD, NetBSD, and others I >have once again come to the conclusion that 'mirror', the Perl script, >seems wholly unsuited to the task of maintaining *large* mirrors. I >recall seeing a post to this list (or perhaps freebsd-announce) about >a new official mirror that mentioned a mirroring software package. >However, I can't seem to find that post anywhere. Can someone bounce >a copy of that post to me? Or better yet, offer suggestions of better >software to take care of this task -- I find it hard to believe that >ftp mirrors the world over are getting by with 'mirror'. Personally, I use a C++ program named cwftp; it definitly has some flaws, but works find for me (on ~400 MB/2000 files). I think this doesn't count as "large". A (not very recent) version can be found at ftp://ftp.promo.de/pub/people/stefan/ ; if you're interested in it, I believe the author has done some work on it recently. Stefan -- Stefan Bethke Promo Datentechnik | Tel. +49-40-851744-0 + Systemberatung GmbH | Fax. +49-40-851744-44 Eduardstrasse 46-48 | e-mail: stefan@Promo.DE D-20257 Hamburg | http://www.Promo.DE/ From owner-freebsd-hubs Mon Sep 15 08:25:48 1997 Return-Path: Received: (from root@localhost) by hub.freebsd.org (8.8.7/8.8.7) id IAA04181 for hubs-outgoing; Mon, 15 Sep 1997 08:25:48 -0700 (PDT) Received: from jealousy.doc.ic.ac.uk (jealousy.doc.ic.ac.uk [146.169.2.19]) by hub.freebsd.org (8.8.7/8.8.7) with SMTP id IAA04168 for ; Mon, 15 Sep 1997 08:25:37 -0700 (PDT) Received: from doc.ic.ac.uk [146.169.24.12] by jealousy.doc.ic.ac.uk with esmtp (Exim 1.71 #2) id 0xAd1J-0002hr-00; Mon, 15 Sep 1997 16:25:01 +0100 Message-ID: <341D52F6.14291EF0@doc.ic.ac.uk> Date: Mon, 15 Sep 1997 16:23:34 +0100 From: Lee McLoughlin Organization: IC-Parc, Imperial College, London, UK X-Mailer: Mozilla 4.03 [en] (X11; I; Linux 2.0.30 i586) MIME-Version: 1.0 To: Carl Harris CC: freebsd-hubs@freebsd.org Subject: Re: ftp4.freebsd.org down References: <199709142053.QAA08931@thumper.cns.vt.edu> Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Sender: owner-freebsd-hubs@freebsd.org X-Loop: FreeBSD.org Precedence: bulk Carl Harris wrote: > > In attempting to rebuild our mirrors of FreeBSD, NetBSD, and others I > have once again come to the conclusion that 'mirror', the Perl script, > seems wholly unsuited to the task of maintaining *large* mirrors. Even I (the author of the perl mirror) have to admit that very large areas give mirror serious grief. Some of these problems will be overcome in mirror-2.9 (due out in about 1 month). That version can mirror directory-by-directory. This avoids the nasty memory requirements of mirror-2.8. The downside is that it needs to do a 'dir' command in each directory - which makes it harder on the server (a get of one ls-lR file .vs. several hundred 'dir' commands). I'm busy on a complete rewrite from scratch of mirror with one of its main goals being the ability to handle multi-gigabyte mirrors efficiently. It should go into beta tests in a few months time (if I can find enough time to work on it !!) > I > recall seeing a post to this list (or perhaps freebsd-announce) about > a new official mirror that mentioned a mirroring software package. > However, I can't seem to find that post anywhere. Can someone bounce > a copy of that post to me? Or better yet, offer suggestions of better > software to take care of this task -- I find it hard to believe that > ftp mirrors the world over are getting by with 'mirror'. Excluding very large areas mirror is OK. I'm hoping to do a lot better than just "OK" with the mirror 3. Lee -- Lee McLoughlin. Phone: +44 171 594 8388 IC-Parc, Imperial College, Fax: +44 171 594 8432 South Kensington, London. SW7 2AZ. UK. Email: L.McLoughlin@doc.ic.ac.uk From owner-freebsd-hubs Thu Sep 18 03:57:17 1997 Return-Path: Received: (from root@localhost) by hub.freebsd.org (8.8.7/8.8.7) id DAA28293 for hubs-outgoing; Thu, 18 Sep 1997 03:57:17 -0700 (PDT) Received: from florence.pavilion.net (florence.pavilion.net [194.242.128.25]) by hub.freebsd.org (8.8.7/8.8.7) with ESMTP id DAA28285 for ; Thu, 18 Sep 1997 03:57:12 -0700 (PDT) Received: (from joe@localhost) by florence.pavilion.net (8.8.7/8.8.7) id LAA12533; Thu, 18 Sep 1997 11:56:09 +0100 (BST) Message-ID: <19970918115608.04393@pavilion.net> Date: Thu, 18 Sep 1997 11:56:08 +0100 From: Josef Karthauser To: hubs@freebsd.org Cc: ftp4@uk.freebsd.org Subject: Announcing ftp4.uk.freebsd.org Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Mailer: Mutt 0.81 X-NCC-RegID: uk.pavilion Sender: owner-freebsd-hubs@freebsd.org X-Loop: FreeBSD.org Precedence: bulk Hiya, The UK has a new ftp mirror. ftp4.uk.freebsd.org is now being kindly provided by Christiaan Keet (also ftp4@uk.freebsd.org). Jordan shall I announce this on announce@freebsd.org, or can you? Joe. -- Josef Karthauser Technical Manager Email: joe@pavilion.net Pavilion Internet plc. [Tel: +44 1273 607072 Fax: +44 1273 607073]