Date: Sun, 16 Jun 2002 17:45:35 +0800 From: "Ch Ild" <wearitdown@myrealbox.com> To: freebsd-hubs@freebsd.org Subject: intent to set up a mirror. Message-ID: <1024220735.5132aff5wearitdown@myrealbox.com>
next in thread | raw e-mail | index | archive | help
This is a multi-part message in MIME format.
--------=_ModWebBOUNDARY_5132aff5_1024220735
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
(I've tried to send this mail a couple of times in the past, but the freebs=
d.org mail exchanger refuses to accept mail from servers with broken - de=
liberately or otherwise - reverse dns. If this is an antispam measure, =
surely there are other, more effective means?)
Date: Thu, 13 Jun 2002 13:33:34 +0800 (SGT)
From: pyng@spam.averse.net
To: freebsd-hubs@freebsd.org
Subject: intent to set up a mirror
Hi. Hope this is the right place to ask these questions.
I'm considering setting up an ftp and/or cvsup mirror in Singapore. My int=
ended machine has pretty good network connecitivity within singapore, and=
has decent connectivity to asian countries. sg.freebsd.org used to be h=
osted on an adsl connection, which is too slow, and currently does not ev=
en resolve.
Is there a requirement to mirror everything? I'm considering not mirroring=
the alpha ports, alpha images, gnats, mailing lists. I'm also consideri=
ng dropping the older releases such as 2.2, 3.x, 4.[01234]. Is this advi=
sable?
Does anyone have statistics on how much space these actually use, how many =
people still rely on them? Would be best if these statistics have an asi=
an slant - my impression is that freebsd on the alpha doesn't have a high=
take-up rate here.
If I wish to allocate, say, 30GB or 40GB of disk space to my freebsd mirror=
, which areas would I best serve users by mirroring?
Lastly, can someone give me tips on exactly how to do the mirroring while e=
xcluding the stuff I don't want? I haven't been able to find anonymous c=
vsup access to the ftp archive, so I'm falling back onto using rsync. Thi=
s is my command line, but it still ends up retrieving all the alpha, etc,=
files and directories that I don't want:
rsync --recursive --links --hard-links --times --verbose --compress \
--delete --exclude "Archive-Update-in-Progress-mirror.averse.net" \
--exclude-from=3D/home/cvsupin/bin/mirror-freebsd-ftp.exclude \
planetmirror.com::freebsd /home/mirrors/ftp_root/pub/FreeBSD
where /home/cvsupin/bin/mirror-freebsd-ftp.exclude is:
alpha/
releases/**/2*/
releases/**/3*/
releases/**/4.0*/
releases/**/4.1*/
releases/**/4.2*/
releases/**/4.3*/
releases/**/ISO-IMAGES/2.2*/
releases/**/ISO-IMAGES/3.4*/
releases/**/ISO-IMAGES/3.5*/
releases/**/ISO-IMAGES/4.0*/
releases/**/ISO-IMAGES/4.1*/
releases/**/ISO-IMAGES/4.2*/
releases/**/ISO-IMAGES/4.3*/
releases/**/ISO-IMAGES/4.4*/
doc/de*/
doc/el*/
doc/es*/
doc/fr*/
doc/it*/
doc/ja*/
doc/ru*/
doc/sr*/
ports/i386/packages-2.2-stable/
ports/i386/packages-3-stable/
I have also tried to do my rsync from ftp4.de with the same results (alpha
packages get pulled across) so there's probably something wrong with my
excludes somewhere.
Regards,
Pui Yong
--------=_ModWebBOUNDARY_5132aff5_1024220735
Content-Type: message/rfc822;
name="intent to set up a mirror.eml"
Content-Transfer-Encoding: 8bit
Content-Disposition: inline
X-Auth-No:
Return-Path: <pyng@spam.averse.net>
Received: from spam.averse.net not authenticated [210.193.6.237]
by smtp-send.myrealbox.com with NetMail SMTP Agent $Revision: 3.9 $ on Novell NetWare;
Sun, 16 Jun 2002 03:40:47 -0600
Received: by spam.averse.net (Postfix, from userid 1000)
id AEFDC67735; Sun, 16 Jun 2002 17:40:33 +0800 (SGT)
Received: from localhost (localhost [127.0.0.1])
by spam.averse.net (Postfix) with ESMTP id 9F99C2BCD7
for <wearitdown@myrealbox.com>; Sun, 16 Jun 2002 17:40:33 +0800 (SGT)
Date: Sun, 16 Jun 2002 17:40:33 +0800 (SGT)
From: pyng@spam.averse.net
To: wearitdown@myrealbox.com
Subject: intent to set up a mirror
Message-ID: <Pine.LNX.4.44.0206161740060.21625-100000@spam.averse.net>
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII
Hi. Hope this is the right place to ask these questions.
I'm considering setting up an ftp and/or cvsup mirror in Singapore. My
intended machine has pretty good network connecitivity within singapore,
and has decent connectivity to asian countries. sg.freebsd.org used to be
hosted on an adsl connection, which is too slow, and currently does not
even resolve.
Is there a requirement to mirror everything? I'm considering not
mirroring the alpha ports, alpha images, gnats, mailing lists. I'm also
considering dropping the older releases such as 2.2, 3.x, 4.[01234]. Is
this advisable?
Does anyone have statistics on how much space these actually use, how many
people still rely on them? Would be best if these statistics have an
asian slant - my impression is that freebsd on the alpha doesn't have a
high take-up rate here.
If I wish to allocate, say, 30GB or 40GB of disk space to my freebsd
mirror, which areas would I best serve users by mirroring?
Lastly, can someone give me tips on exactly how to do the mirroring while
excluding the stuff I don't want? I haven't been able to find anonymous
cvsup access to the ftp archive, so I'm falling back onto using rsync.
This is my command line, but it still ends up retrieving all the alpha,
etc, files and directories that I don't want:
rsync --recursive --links --hard-links --times --verbose --compress \
--delete --exclude "Archive-Update-in-Progress-mirror.averse.net" \
--exclude-from=/home/cvsupin/bin/mirror-freebsd-ftp.exclude \
planetmirror.com::freebsd /home/mirrors/ftp_root/pub/FreeBSD
where /home/cvsupin/bin/mirror-freebsd-ftp.exclude is:
alpha/
releases/**/2*/
releases/**/3*/
releases/**/4.0*/
releases/**/4.1*/
releases/**/4.2*/
releases/**/4.3*/
releases/**/ISO-IMAGES/2.2*/
releases/**/ISO-IMAGES/3.4*/
releases/**/ISO-IMAGES/3.5*/
releases/**/ISO-IMAGES/4.0*/
releases/**/ISO-IMAGES/4.1*/
releases/**/ISO-IMAGES/4.2*/
releases/**/ISO-IMAGES/4.3*/
releases/**/ISO-IMAGES/4.4*/
doc/de*/
doc/el*/
doc/es*/
doc/fr*/
doc/it*/
doc/ja*/
doc/ru*/
doc/sr*/
ports/i386/packages-2.2-stable/
ports/i386/packages-3-stable/
I have also tried to do my rsync from ftp4.de with the same results (alpha
packages get pulled across) so there's probably something wrong with my
excludes somewhere.
Regards,
Pui Yong
--------=_ModWebBOUNDARY_5132aff5_1024220735--
To Unsubscribe: send mail to majordomo@FreeBSD.org
with "unsubscribe freebsd-hubs" in the body of the message
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?1024220735.5132aff5wearitdown>