From owner-freebsd-hubs Fri Apr 27 0: 1:15 2001 Delivered-To: freebsd-hubs@freebsd.org Received: from peter3.wemm.org (c1315225-a.plstn1.sfba.home.com [65.0.135.147]) by hub.freebsd.org (Postfix) with ESMTP id B92C337B424 for ; Fri, 27 Apr 2001 00:01:02 -0700 (PDT) (envelope-from peter@wemm.org) Received: from overcee.netplex.com.au (overcee.wemm.org [10.0.0.3]) by peter3.wemm.org (8.11.0/8.11.0) with ESMTP id f3R712M70145 for ; Fri, 27 Apr 2001 00:01:02 -0700 (PDT) (envelope-from peter@wemm.org) Received: from wemm.org (localhost [127.0.0.1]) by overcee.netplex.com.au (Postfix) with ESMTP id 89DEA380A; Fri, 27 Apr 2001 00:01:02 -0700 (PDT) (envelope-from peter@wemm.org) X-Mailer: exmh version 2.3.1 01/18/2001 with nmh-1.0.4 To: Garrett Wollman , freebsd-hubs@FreeBSD.ORG Subject: Re: ftp-master.freebsd.org is alive ... In-Reply-To: <20010426194345.3E2EB380A@overcee.netplex.com.au> Date: Fri, 27 Apr 2001 00:01:02 -0700 From: Peter Wemm Message-Id: <20010427070102.89DEA380A@overcee.netplex.com.au> Sender: owner-freebsd-hubs@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.org Peter Wemm wrote: > Garrett Wollman wrote: > > < said: > > > > > I think for sanity, this means rsyncd only. > > > > Many people want (need) the added flexibility of mirror/spegla in > > order to select on a fine-grained basis which files their mirrors will > > carry. rsync can do this, but it is very complicated. So long as > > individual mirrors don't switch back and forth between mechanisms > > there should be no problem supporting both. > > Also, Andrey mentioned that ftpd's and mirror etc generally use UTC. I > will check into that as well. So far it is not looking good: fetched via rsync from a site in the bay area (same timezone as me) ftp-master# ls -lT Xlk98.tgz -rw-r--r-- 1 106 106 5175711 Sep 9 21:00:00 1999 Xlk98.tgz fetched via ftp from ftp10.freebsd.org (one hour advanced) ftp-master# ls -lT Xlk98.tgz -r--r--r-- 1 root 106 5175711 Sep 10 00:00:00 1999 Xlk98.tgz ie: running mirror on something that rsync fetched causes a 100% complete refetch. And on a different site: $ rsync -vaz -P rsync://ftp3.freebsd.org/freebsd/branches/-current/XF86335/ ... -rw-r--r-- 5175711 1999/09/09 17:00:00 Xlk98.tgz ... and a ftp to ftp3.freebsd.org and dir in the same directory reports: -rw-r--r-- 1 root wheel 5175711 Sep 10 1999 Xlk98.tgz (ftp3 is 3 hours advanced) ftp to ftp4 on the same thing again (same timezone as me): -r--rw-r-- 1 root wheel 5175711 Sep 10 1999 Xlk98.tgz ftp to ftp2.freebsd.org (3 hours advanced, but with the -T flag) -rw-r--r-- 1 root wheel 5175711 Sep 10 04:00:00 1999 Xlk98.tgz peter@overcee[11:48pm]~-104> env TZ=America/New_York date Fri Apr 27 02:48:41 EDT 2001 peter@overcee[11:48pm]~-105> env TZ=America/Los_Angeles date Thu Apr 26 23:49:07 PDT 2001 I think the basic problem is that when the mirror programs see "Sep 10 1999" they have no indication of the actual time of day. Ie: switching from rsync to ftp is impossible without a refetch or ignoring and resetting the dates. Regarding exclusion.. rsync seems to have improved somewhat over the last few years. Are you sure the --exclude-from FILE stuff wont work? You can block out entire trees with ease. From the manual: o --exclude "*.o" would exclude all filenames match- ing *.o o --exclude "/foo" would exclude a file in the base directory called foo o --exclude "foo/" would exclude any directory called foo o --include "*/" --include "*.c" --exclude "*" would include all directories and C source files. o --include "foo/" --include "foo/bar.c" --exclude "*" would include only foo/bar.c (the foo/ direc- tory must be explicitly included or it would be excluded by the "*") ie: --exclude "/releases/2.*" --exclude "/releases/3.*" etc should work. (or use the exclude file rather than on a command line.) Cheers, -Peter -- Peter Wemm - peter@FreeBSD.org; peter@yahoo-inc.com; peter@netplex.com.au "All of this is for nothing if we don't go to the stars" - JMS/B5 To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-hubs" in the body of the message