Date: Fri, 27 Apr 2001 00:01:02 -0700 From: Peter Wemm <peter@wemm.org> To: Garrett Wollman <wollman@khavrinen.lcs.mit.edu>, freebsd-hubs@FreeBSD.ORG Subject: Re: ftp-master.freebsd.org is alive ... Message-ID: <20010427070102.89DEA380A@overcee.netplex.com.au> In-Reply-To: <20010426194345.3E2EB380A@overcee.netplex.com.au>
next in thread | previous in thread | raw e-mail | index | archive | help
Peter Wemm wrote:
> Garrett Wollman wrote:
> > <<On Thu, 26 Apr 2001 01:03:24 -0700, Peter Wemm <peter@wemm.org> said:
> >
> > > I think for sanity, this means rsyncd only.
> >
> > Many people want (need) the added flexibility of mirror/spegla in
> > order to select on a fine-grained basis which files their mirrors will
> > carry. rsync can do this, but it is very complicated. So long as
> > individual mirrors don't switch back and forth between mechanisms
> > there should be no problem supporting both.
>
> Also, Andrey mentioned that ftpd's and mirror etc generally use UTC. I
> will check into that as well.
So far it is not looking good:
fetched via rsync from a site in the bay area (same timezone as me)
ftp-master# ls -lT Xlk98.tgz
-rw-r--r-- 1 106 106 5175711 Sep 9 21:00:00 1999 Xlk98.tgz
fetched via ftp from ftp10.freebsd.org (one hour advanced)
ftp-master# ls -lT Xlk98.tgz
-r--r--r-- 1 root 106 5175711 Sep 10 00:00:00 1999 Xlk98.tgz
ie: running mirror on something that rsync fetched causes a 100% complete
refetch.
And on a different site:
$ rsync -vaz -P rsync://ftp3.freebsd.org/freebsd/branches/-current/XF86335/
...
-rw-r--r-- 5175711 1999/09/09 17:00:00 Xlk98.tgz
...
and a ftp to ftp3.freebsd.org and dir in the same directory reports:
-rw-r--r-- 1 root wheel 5175711 Sep 10 1999 Xlk98.tgz
(ftp3 is 3 hours advanced)
ftp to ftp4 on the same thing again (same timezone as me):
-r--rw-r-- 1 root wheel 5175711 Sep 10 1999 Xlk98.tgz
ftp to ftp2.freebsd.org (3 hours advanced, but with the -T flag)
-rw-r--r-- 1 root wheel 5175711 Sep 10 04:00:00 1999 Xlk98.tgz
peter@overcee[11:48pm]~-104> env TZ=America/New_York date
Fri Apr 27 02:48:41 EDT 2001
peter@overcee[11:48pm]~-105> env TZ=America/Los_Angeles date
Thu Apr 26 23:49:07 PDT 2001
I think the basic problem is that when the mirror programs see "Sep 10
1999" they have no indication of the actual time of day. Ie: switching
from rsync to ftp is impossible without a refetch or ignoring and resetting
the dates.
Regarding exclusion.. rsync seems to have improved somewhat over the last
few years. Are you sure the --exclude-from FILE stuff wont work? You can
block out entire trees with ease. From the manual:
o --exclude "*.o" would exclude all filenames match-
ing *.o
o --exclude "/foo" would exclude a file in the base
directory called foo
o --exclude "foo/" would exclude any directory called
foo
o --include "*/" --include "*.c" --exclude "*" would
include all directories and C source files.
o --include "foo/" --include "foo/bar.c" --exclude
"*" would include only foo/bar.c (the foo/ direc-
tory must be explicitly included or it would be
excluded by the "*")
ie: --exclude "/releases/2.*" --exclude "/releases/3.*" etc should work.
(or use the exclude file rather than on a command line.)
Cheers,
-Peter
--
Peter Wemm - peter@FreeBSD.org; peter@yahoo-inc.com; peter@netplex.com.au
"All of this is for nothing if we don't go to the stars" - JMS/B5
To Unsubscribe: send mail to majordomo@FreeBSD.org
with "unsubscribe freebsd-hubs" in the body of the message
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20010427070102.89DEA380A>