From owner-freebsd-hubs Mon Nov 18 23:39:26 1996 Return-Path: owner-hubs Received: (from root@localhost) by freefall.freebsd.org (8.7.5/8.7.3) id XAA21371 for hubs-outgoing; Mon, 18 Nov 1996 23:39:26 -0800 (PST) Received: from phoenix.csie.nctu.edu.tw (root@phoenix.csie.nctu.edu.tw [140.113.17.171]) by freefall.freebsd.org (8.7.5/8.7.3) with ESMTP id XAA21361 for ; Mon, 18 Nov 1996 23:39:00 -0800 (PST) Received: from FreeBSD.csie.NCTU.edu.tw (jdli@freebsd.csie.nctu.edu.tw [140.113.235.250]) by phoenix.csie.nctu.edu.tw (8.8.3/8.7.5) with ESMTP id PAA26306 for ; Tue, 19 Nov 1996 15:36:18 +0800 (CST) Received: (from jdli@localhost) by FreeBSD.csie.NCTU.edu.tw (8.8.2/8.7.3) id PAA01532 for freebsd-hubs@freebsd.org; Tue, 19 Nov 1996 15:38:43 +0800 (CST) From: Jian-Da Li Message-Id: <199611190738.PAA01532@FreeBSD.csie.NCTU.edu.tw> Subject: Please help for mailing list !! To: freebsd-hubs@freebsd.org Date: Tue, 19 Nov 1996 15:38:39 +0800 (CST) X-Mailer: ELM [version 2.4ME+ PL28 (25)] MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 8bit Sender: owner-hubs@freebsd.org X-Loop: FreeBSD.org Precedence: bulk Hi : I was running a freebsd-mailing-list-to-news-gateway for a long time, and last week Majordomo removed us out of all lists. (maybe b'cos this site was down for 3 days last week) I tried to re-subscribe all lists last week, but not get approval yet. This gateway serves all Taiwan readers, so please help me to join ths lists. Thanks very much !! === the following are the lists that we subscribed === subscribe aic7xxx freebsd-aic7xxx@freebsd.csie.nctu.edu.tw subscribe bsd-serious freebsd-commercial@freebsd.csie.nctu.edu.tw subscribe commercial freebsd-commercial@freebsd.csie.nctu.edu.tw subscribe ctm-announce freebsd-announce@freebsd.csie.nctu.edu.tw subscribe ctm-cvs-cur-fast ctm-cvs-cur@freebsd.csie.nctu.edu.tw subscribe ctm-gnats ctm-gnats@freebsd.csie.nctu.edu.tw subscribe ctm-ports-cur ctm-ports-cur@freebsd.csie.nctu.edu.tw subscribe ctm-src-2_1-fast ctm-src-2_1@freebsd.csie.nctu.edu.tw subscribe ctm-src-2_2-fast ctm-src-2_2@freebsd.csie.nctu.edu.tw subscribe ctm-src-cur-fast ctm-src-cur@freebsd.csie.nctu.edu.tw subscribe cvs-all freebsd-cvs-all@freebsd.csie.nctu.edu.tw subscribe freebsd-announce freebsd-announce@freebsd.csie.nctu.edu.tw subscribe freebsd-arch freebsd-arch@freebsd.csie.nctu.edu.tw subscribe freebsd-atm freebsd-atm@freebsd.csie.nctu.edu.tw subscribe freebsd-bugs freebsd-bugs@freebsd.csie.nctu.edu.tw subscribe freebsd-chat freebsd-chat@freebsd.csie.nctu.edu.tw subscribe freebsd-current freebsd-current@freebsd.csie.nctu.edu.tw subscribe freebsd-doc freebsd-doc@freebsd.csie.nctu.edu.tw subscribe freebsd-emulation freebsd-emulator@freebsd.csie.nctu.edu.tw subscribe freebsd-fs freebsd-fs@freebsd.csie.nctu.edu.tw subscribe freebsd-hackers freebsd-hackers@freebsd.csie.nctu.edu.tw subscribe freebsd-hardware freebsd-hardware@freebsd.csie.nctu.edu.tw subscribe freebsd-hubs freebsd-hubs@freebsd.csie.nctu.edu.tw subscribe freebsd-install freebsd-install@freebsd.csie.nctu.edu.tw subscribe freebsd-isp freebsd-isp@freebsd.csie.nctu.edu.tw subscribe freebsd-mobile freebsd-mobile@freebsd.csie.nctu.edu.tw subscribe freebsd-multimedia freebsd-multimedia@freebsd.csie.nctu.edu.tw subscribe freebsd-platforms freebsd-platforms@freebsd.csie.nctu.edu.tw subscribe freebsd-ports freebsd-ports@freebsd.csie.nctu.edu.tw subscribe freebsd-questions freebsd-questions@freebsd.csie.nctu.edu.tw subscribe freebsd-realtime freebsd-realtime@freebsd.csie.nctu.edu.tw subscribe freebsd-scsi freebsd-scsi@freebsd.csie.nctu.edu.tw subscribe freebsd-security freebsd-security@freebsd.csie.nctu.edu.tw subscribe freebsd-smp smp@freebsd.csie.nctu.edu.tw subscribe freebsd-stable freebsd-stable@freebsd.csie.nctu.edu.tw subscribe freebsd-user-groups freebsd-user-groups@freebsd.csie.nctu.edu.tw subscribe translators freebsd-translators@freebsd.csie.nctu.edu.tw subscribe www freebsd-translators@freebsd.csie.nctu.edu.tw -- 李 建 達 (Jian-Da Li) 交 大 資 工 E-Mail : http://www.csie.nctu.edu.tw/~jdli From owner-freebsd-hubs Tue Nov 19 09:31:20 1996 Return-Path: owner-hubs Received: (from root@localhost) by freefall.freebsd.org (8.7.5/8.7.3) id JAA19137 for hubs-outgoing; Tue, 19 Nov 1996 09:31:20 -0800 (PST) Received: from phoenix.csie.nctu.edu.tw (root@phoenix.csie.nctu.edu.tw [140.113.17.171]) by freefall.freebsd.org (8.7.5/8.7.3) with ESMTP id JAA19132 for ; Tue, 19 Nov 1996 09:31:15 -0800 (PST) Received: from FreeBSD.csie.NCTU.edu.tw (jdli@freebsd.csie.nctu.edu.tw [140.113.235.250]) by phoenix.csie.nctu.edu.tw (8.8.3/8.7.5) with ESMTP id BAA10978 for ; Wed, 20 Nov 1996 01:25:45 +0800 (CST) Received: (from jdli@localhost) by FreeBSD.csie.NCTU.edu.tw (8.8.2/8.7.3) id BAA04580 for freebsd-hubs@freebsd.org; Wed, 20 Nov 1996 01:28:25 +0800 (CST) From: Jian-Da Li Message-Id: <199611191728.BAA04580@FreeBSD.csie.NCTU.edu.tw> Subject: www.freebsd.org mirror ? To: freebsd-hubs@freebsd.org Date: Wed, 20 Nov 1996 01:28:25 +0800 (CST) X-Mailer: ELM [version 2.4ME+ PL28 (25)] MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 8bit Sender: owner-hubs@freebsd.org X-Loop: FreeBSD.org Precedence: bulk Hi : I used to mirror www.freebsd.org by supping from sup.freebsd.org, but it seems that the sup service was closed (and replaced with cvsup). I then change to cvsup, but I got *.sgml only, and it requires "sgmlnorm" command to re-format *.sgml to *.html. But I can't find where to get "sgmlnorm". Please either tell me where can I get *.html version or tell me where the "sgmlnorm" is. Thanks. -- 李 建 達 (Jian-Da Li) 交 大 資 工 E-Mail : http://www.csie.nctu.edu.tw/~jdli From owner-freebsd-hubs Tue Nov 19 09:51:26 1996 Return-Path: owner-hubs Received: (from root@localhost) by freefall.freebsd.org (8.7.5/8.7.3) id JAA20152 for hubs-outgoing; Tue, 19 Nov 1996 09:51:26 -0800 (PST) Received: from kremvax.demos.su (kremvax.demos.su [194.87.0.20]) by freefall.freebsd.org (8.7.5/8.7.3) with SMTP id JAA20146 for ; Tue, 19 Nov 1996 09:51:23 -0800 (PST) Received: by kremvax.demos.su (8.6.13/D) from 0@megillah.demos.su [194.87.0.21] with ESMTP id UAA18748; Tue, 19 Nov 1996 20:48:40 +0300 Received: by megillah.demos.su id UAA10220; (8.8.3/D) Tue, 19 Nov 1996 20:48:16 +0300 (MSK) Message-Id: <199611191748.UAA10220@megillah.demos.su> Subject: Re: www.freebsd.org mirror ? To: jdli@FreeBSD.csie.NCTU.edu.tw (Jian-Da Li) Date: Tue, 19 Nov 1996 20:48:16 +0300 (MSK) Cc: freebsd-hubs@freebsd.org In-Reply-To: <199611191728.BAA04580@FreeBSD.csie.NCTU.edu.tw> from "Jian-Da Li" at Nov 20, 96 01:28:25 am From: "Mikhail A. Sokolov" X-Class: Fast Organization: Demos Company, Ltd. Reply-To: mishania@demos.su X-Mailer: ELM [version 2.4 PL24 ME7a] Content-Type: text Sender: owner-hubs@freebsd.org X-Loop: FreeBSD.org Precedence: bulk > Hi : > I used to mirror www.freebsd.org by supping from sup.freebsd.org, > but it seems that the sup service was closed (and replaced with > cvsup). > I then change to cvsup, but I got *.sgml only, and it requires > "sgmlnorm" command to re-format *.sgml to *.html. But I can't > find where to get "sgmlnorm". > Please either tell me where can I get *.html version or tell me > where the "sgmlnorm" is. Errr, fix your sendmai not to convert 8-bit to quoted-printable, eh?;-) Use webcopy, neat perl thingie, /usr/ports/www/webcopy. Do not forget -t 1 in flags so www.freebsd.org will be mirrored in say, 1 day (thanks to ~jhs which is ~15Mb ;)). And, well, friendly advice, use cvsup for cvsup's? freezer will never poor a tea for you, don't make programms do what they aren't supposed to do... > Thanks. > jdli -mishania www.ru.freebsd.org ;-) From owner-freebsd-hubs Tue Nov 19 10:04:32 1996 Return-Path: owner-hubs Received: (from root@localhost) by freefall.freebsd.org (8.7.5/8.7.3) id KAA21029 for hubs-outgoing; Tue, 19 Nov 1996 10:04:32 -0800 (PST) Received: from grackle.grondar.za (grackle.grondar.za [196.7.18.131]) by freefall.freebsd.org (8.7.5/8.7.3) with ESMTP id KAA21023; Tue, 19 Nov 1996 10:04:25 -0800 (PST) Received: from grackle.grondar.za (localhost.grondar.za [127.0.0.1]) by grackle.grondar.za (8.8.3/8.7.3) with ESMTP id UAA17540; Tue, 19 Nov 1996 20:04:21 +0200 (SAT) Message-Id: <199611191804.UAA17540@grackle.grondar.za> To: comitters@freebsd.org, root@freebsd.org, postmaster@freebsd.org cc: hubs@freebsd.org Subject: Too much cruft Date: Tue, 19 Nov 1996 20:04:20 +0200 From: Mark Murray Sender: owner-hubs@freebsd.org X-Loop: FreeBSD.org Precedence: bulk Hi Walnut Creek folk, Jordan(?), Satoshi(?) We at internat.freebsd.org, AKA za.freebsd.org have been maintaining a mirror for quite a while, now. We are attempting to get this to be as complete as possible without being ridiculous. I am also setting up a mirror on a different net (My own work machine). I have noticed an _enormous_ amount of wasted space in the master site's distribution/ directory. It seems that as ports get upgraded, many out-of-date tarballs do not get nuked. I created this directory on my machine by doin a "make fetch" in /usr/ports, but internat's is a mirror of the dir on ftp.freebsd.org. This latter dir is nearly 200MB larger that mine! Could someone please clean this out? An easy way is to move the files somwhere else and let "make fetch" pull them back (from either a locallly networked drive, or pretend that they are on a CDROM). M -- Mark Murray PGP key fingerprint = 80 36 6E 40 83 D6 8A 36 This .sig is umop ap!sdn. BC 06 EA 0E 7A F2 CE CE From owner-freebsd-hubs Tue Nov 19 10:09:15 1996 Return-Path: owner-hubs Received: (from root@localhost) by freefall.freebsd.org (8.7.5/8.7.3) id KAA21232 for hubs-outgoing; Tue, 19 Nov 1996 10:09:15 -0800 (PST) Received: from grackle.grondar.za (grackle.grondar.za [196.7.18.131]) by freefall.freebsd.org (8.7.5/8.7.3) with ESMTP id KAA21227; Tue, 19 Nov 1996 10:09:06 -0800 (PST) Received: from grackle.grondar.za (localhost.grondar.za [127.0.0.1]) by grackle.grondar.za (8.8.3/8.7.3) with ESMTP id UAA17600; Tue, 19 Nov 1996 20:08:59 +0200 (SAT) Message-Id: <199611191808.UAA17600@grackle.grondar.za> To: committers@freebsd.org, root@freebsd.org, postmaster@freebsd.org cc: hubs@freebsd.org Subject: Too much cruft Date: Tue, 19 Nov 1996 20:08:58 +0200 From: Mark Murray Sender: owner-hubs@freebsd.org X-Loop: FreeBSD.org Precedence: bulk Hi Walnut Creek folk, Jordan(?), Satoshi(?) We at internat.freebsd.org, AKA za.freebsd.org have been maintaining a mirror for quite a while, now. We are attempting to get this to be as complete as possible without being ridiculous. I am also setting up a mirror on a different net (My own work machine). I have noticed an _enormous_ amount of wasted space in the master site's distribution/ directory. It seems that as ports get upgraded, many out-of-date tarballs do not get nuked. I created this directory on my machine by doin a "make fetch" in /usr/ports, but internat's is a mirror of the dir on ftp.freebsd.org. This latter dir is nearly 200MB larger that mine! Could someone please clean this out? An easy way is to move the files somwhere else and let "make fetch" pull them back (from either a locallly networked drive, or pretend that they are on a CDROM). M -- Mark Murray PGP key fingerprint = 80 36 6E 40 83 D6 8A 36 This .sig is umop ap!sdn. BC 06 EA 0E 7A F2 CE CE From owner-freebsd-hubs Tue Nov 19 10:32:12 1996 Return-Path: owner-hubs Received: (from root@localhost) by freefall.freebsd.org (8.7.5/8.7.3) id KAA22635 for hubs-outgoing; Tue, 19 Nov 1996 10:32:12 -0800 (PST) Received: from labinfo.iet.unipi.it (labinfo.iet.unipi.it [131.114.9.5]) by freefall.freebsd.org (8.7.5/8.7.3) with SMTP id KAA22600; Tue, 19 Nov 1996 10:31:56 -0800 (PST) Received: from localhost (luigi@localhost) by labinfo.iet.unipi.it (8.6.5/8.6.5) id SAA03436; Tue, 19 Nov 1996 18:52:39 +0100 From: Luigi Rizzo Message-Id: <199611191752.SAA03436@labinfo.iet.unipi.it> Subject: Re: Too much cruft To: mark@grondar.za (Mark Murray) Date: Tue, 19 Nov 1996 18:52:39 +0100 (MET) Cc: committers@freebsd.org, root@freebsd.org, postmaster@freebsd.org, hubs@freebsd.org In-Reply-To: <199611191808.UAA17600@grackle.grondar.za> from "Mark Murray" at Nov 19, 96 08:08:39 pm X-Mailer: ELM [version 2.4 PL23] Content-Type: text Sender: owner-hubs@freebsd.org X-Loop: FreeBSD.org Precedence: bulk > Hi Walnut Creek folk, Jordan(?), Satoshi(?) > > > I have noticed an _enormous_ amount of wasted space in the master > site's distribution/ directory. It seems that as ports get upgraded, > many out-of-date tarballs do not get nuked. I created this directory > on my machine by doin a "make fetch" in /usr/ports, but internat's > is a mirror of the dir on ftp.freebsd.org. This latter dir is nearly > 200MB larger that mine! > > Could someone please clean this out? I second this. I tried to save a full distribution on a cdrom, and I couldnt because all the out-of-date files in distfiles overflowed the available space by far. Luigi ==================================================================== Luigi Rizzo Dip. di Ingegneria dell'Informazione email: luigi@iet.unipi.it Universita' di Pisa tel: +39-50-568533 via Diotisalvi 2, 56126 PISA (Italy) fax: +39-50-568522 http://www.iet.unipi.it/~luigi/ ==================================================================== From owner-freebsd-hubs Tue Nov 19 10:51:00 1996 Return-Path: owner-hubs Received: (from root@localhost) by freefall.freebsd.org (8.7.5/8.7.3) id KAA23836 for hubs-outgoing; Tue, 19 Nov 1996 10:51:00 -0800 (PST) Received: from brasil.moneng.mei.com (brasil.moneng.mei.com [151.186.109.160]) by freefall.freebsd.org (8.7.5/8.7.3) with ESMTP id KAA23831; Tue, 19 Nov 1996 10:50:57 -0800 (PST) Received: (from jgreco@localhost) by brasil.moneng.mei.com (8.7.Beta.1/8.7.Beta.1) id MAA04795; Tue, 19 Nov 1996 12:48:40 -0600 From: Joe Greco Message-Id: <199611191848.MAA04795@brasil.moneng.mei.com> Subject: Re: Too much cruft To: luigi@labinfo.iet.unipi.it (Luigi Rizzo) Date: Tue, 19 Nov 1996 12:48:40 -0600 (CST) Cc: mark@grondar.za, committers@FreeBSD.ORG, root@FreeBSD.ORG, postmaster@FreeBSD.ORG, hubs@FreeBSD.ORG In-Reply-To: <199611191752.SAA03436@labinfo.iet.unipi.it> from "Luigi Rizzo" at Nov 19, 96 06:52:39 pm X-Mailer: ELM [version 2.4 PL24] Content-Type: text Sender: owner-hubs@FreeBSD.ORG X-Loop: FreeBSD.org Precedence: bulk > > Hi Walnut Creek folk, Jordan(?), Satoshi(?) > > > > > > I have noticed an _enormous_ amount of wasted space in the master > > site's distribution/ directory. It seems that as ports get upgraded, > > many out-of-date tarballs do not get nuked. I created this directory > > on my machine by doin a "make fetch" in /usr/ports, but internat's > > is a mirror of the dir on ftp.freebsd.org. This latter dir is nearly > > 200MB larger that mine! > > > > Could someone please clean this out? > > I second this. I tried to save a full distribution on a cdrom, and I > couldnt because all the out-of-date files in distfiles overflowed the > available space by far. Would it be possible to put distfiles in a per-version location? i.e. distfiles that were shipped with ports-2.1 should go in distfiles-2.1, etc. This will help the namespace collision problems, also. ... JG From owner-freebsd-hubs Tue Nov 19 14:56:45 1996 Return-Path: owner-hubs Received: (from root@localhost) by freefall.freebsd.org (8.7.5/8.7.3) id OAA12852 for hubs-outgoing; Tue, 19 Nov 1996 14:56:45 -0800 (PST) Received: from genesis.atrad.adelaide.edu.au (genesis.atrad.adelaide.edu.au [129.127.96.120]) by freefall.freebsd.org (8.7.5/8.7.3) with ESMTP id OAA12845; Tue, 19 Nov 1996 14:56:40 -0800 (PST) Received: (from msmith@localhost) by genesis.atrad.adelaide.edu.au (8.8.2/8.7.3) id JAA03262; Wed, 20 Nov 1996 09:26:06 +1030 (CST) From: Michael Smith Message-Id: <199611192256.JAA03262@genesis.atrad.adelaide.edu.au> Subject: Re: Too much cruft In-Reply-To: <199611191752.SAA03436@labinfo.iet.unipi.it> from Luigi Rizzo at "Nov 19, 96 06:52:39 pm" To: luigi@labinfo.iet.unipi.it (Luigi Rizzo) Date: Wed, 20 Nov 1996 09:26:05 +1030 (CST) Cc: mark@grondar.za, committers@freebsd.org, root@freebsd.org, postmaster@freebsd.org, hubs@freebsd.org X-Mailer: ELM [version 2.4ME+ PL28 (25)] MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Sender: owner-hubs@freebsd.org X-Loop: FreeBSD.org Precedence: bulk Luigi Rizzo stands accused of saying: > > I second this. I tried to save a full distribution on a cdrom, and I > couldnt because all the out-of-date files in distfiles overflowed the > available space by far. I'm working on a tool that should automate the process for this, but bear in mind that there are lots of out-of-date port skeletons out there that will go to ftp.freebsd.org in desperation once they can't find the right distfile anywhere else. This will make it easier for you to keep your own collections up-to-date though. I should have something usable by the end of the week. > Luigi Rizzo Dip. di Ingegneria dell'Informazione -- ]] Mike Smith, Software Engineer msmith@gsoft.com.au [[ ]] Genesis Software genesis@gsoft.com.au [[ ]] High-speed data acquisition and (GSM mobile) 0411-222-496 [[ ]] realtime instrument control. (ph) +61-8-8267-3493 [[ ]] Unix hardware collector. "Where are your PEZ?" The Tick [[ From owner-freebsd-hubs Tue Nov 19 15:21:26 1996 Return-Path: owner-hubs Received: (from root@localhost) by freefall.freebsd.org (8.7.5/8.7.3) id PAA14586 for hubs-outgoing; Tue, 19 Nov 1996 15:21:26 -0800 (PST) Received: from labinfo.iet.unipi.it (labinfo.iet.unipi.it [131.114.9.5]) by freefall.freebsd.org (8.7.5/8.7.3) with SMTP id PAA14571; Tue, 19 Nov 1996 15:21:15 -0800 (PST) Received: from localhost (luigi@localhost) by labinfo.iet.unipi.it (8.6.5/8.6.5) id XAA04399; Tue, 19 Nov 1996 23:42:26 +0100 From: Luigi Rizzo Message-Id: <199611192242.XAA04399@labinfo.iet.unipi.it> Subject: Re: Too much cruft To: msmith@atrad.adelaide.edu.au (Michael Smith) Date: Tue, 19 Nov 1996 23:42:26 +0100 (MET) Cc: mark@grondar.za, committers@freebsd.org, root@freebsd.org, postmaster@freebsd.org, hubs@freebsd.org In-Reply-To: <199611192256.JAA03262@genesis.atrad.adelaide.edu.au> from "Michael Smith" at Nov 20, 96 09:25:46 am X-Mailer: ELM [version 2.4 PL23] Content-Type: text Sender: owner-hubs@freebsd.org X-Loop: FreeBSD.org Precedence: bulk > Luigi Rizzo stands accused of saying: > > > > I second this. I tried to save a full distribution on a cdrom, and I > > couldnt because all the out-of-date files in distfiles overflowed the > > available space by far. > > I'm working on a tool that should automate the process for this, but > bear in mind that there are lots of out-of-date port skeletons > out there that will go to ftp.freebsd.org in desperation once > they can't find the right distfile anywhere else. not necessarily if, as someone proposed, the distfiles are stored in different directories depending on the release. i.e, distfiles contains _all_ the files, distfiles.2.1.6 contains links to the files in "distfiles" relevant to 2.1.6, and so on Perhaps some good solution is required to avoid transferring everything when there is a version change. > This will make it easier for you to keep your own collections > up-to-date though. I should have something usable by the end of > the week. Luigi From owner-freebsd-hubs Wed Nov 20 05:29:25 1996 Return-Path: owner-hubs Received: (from root@localhost) by freefall.freebsd.org (8.7.5/8.7.3) id FAA02994 for hubs-outgoing; Wed, 20 Nov 1996 05:29:25 -0800 (PST) Received: from dfw-ix2.ix.netcom.com (dfw-ix2.ix.netcom.com [206.214.98.2]) by freefall.freebsd.org (8.7.5/8.7.3) with SMTP id FAA02988; Wed, 20 Nov 1996 05:29:23 -0800 (PST) Received: from silvia.HIP.Berkeley.EDU (ala-ca8-35.ix.netcom.com [207.93.141.163]) by dfw-ix2.ix.netcom.com (8.6.13/8.6.12) with ESMTP id FAA22895; Wed, 20 Nov 1996 05:16:08 -0800 Received: (from asami@localhost) by silvia.HIP.Berkeley.EDU (8.8.2/8.6.9) id FAA02280; Wed, 20 Nov 1996 05:15:24 -0800 (PST) Date: Wed, 20 Nov 1996 05:15:24 -0800 (PST) Message-Id: <199611201315.FAA02280@silvia.HIP.Berkeley.EDU> To: jgreco@brasil.moneng.mei.com CC: luigi@labinfo.iet.unipi.it, mark@grondar.za, committers@FreeBSD.org, root@FreeBSD.org, postmaster@FreeBSD.org, hubs@FreeBSD.org In-reply-to: <199611191848.MAA04795@brasil.moneng.mei.com> (message from Joe Greco on Tue, 19 Nov 1996 12:48:40 -0600 (CST)) Subject: Re: Too much cruft From: asami@FreeBSD.org (Satoshi Asami) Sender: owner-hubs@FreeBSD.org X-Loop: FreeBSD.org Precedence: bulk * > > I have noticed an _enormous_ amount of wasted space in the master * > > site's distribution/ directory. It seems that as ports get upgraded, * > > many out-of-date tarballs do not get nuked. I created this directory * > > on my machine by doin a "make fetch" in /usr/ports, but internat's * > > is a mirror of the dir on ftp.freebsd.org. This latter dir is nearly * > > 200MB larger that mine! Note that it is not only because of old distfiles. For instance, how large is your pkfonts/ subdir? You need to run "make fetch" multiple times in japanese/pkfonts and print/pkfonts with RESOLUTION set to various values to get what wcarchive has (89MB). * > > Could someone please clean this out? I usually delete the old tarball if it hasn't been used in the previous release (2.1.5 in this case). I said "usually" because sometimes I forget. I occasionally go there and do a manual check of the whole place too. If someone is willing to help me do this, I'll be eternally grateful. It's not that hard, just do a cvs diff -D 07/20/96 /usr/ports/*/*/files/md5 to get the list of all distfiles that were needed for 2.1.5R as well as the ones that are needed now, and compare that to an output of ls at wcarchive. Then send me a list of files I need to delete. * Would it be possible to put distfiles in a per-version location? i.e. * distfiles that were shipped with ports-2.1 should go in distfiles-2.1, * etc. I thought about this before, but came to the conclusion that that would be too hard to maintain unless we are willing to waste even more space. (I.e., "mv distfiles distfiles-2.2; mkdir distfiles" and then just update the new "distfiles" dir. :) * This will help the namespace collision problems, also. This is true. I've always been bothered by the fact that when I put a new lynx tarball (for instance) up there, I might be breaking the build for 2.1.5R users. But these ports are the vast minority, and I don't think it's worth the added administrative overhead. Satoshi From owner-freebsd-hubs Wed Nov 20 06:14:23 1996 Return-Path: owner-hubs Received: (from root@localhost) by freefall.freebsd.org (8.7.5/8.7.3) id GAA06064 for hubs-outgoing; Wed, 20 Nov 1996 06:14:23 -0800 (PST) Received: from grackle.grondar.za (grackle.grondar.za [196.7.18.131]) by freefall.freebsd.org (8.7.5/8.7.3) with ESMTP id GAA06051; Wed, 20 Nov 1996 06:14:07 -0800 (PST) Received: from grackle.grondar.za (localhost.grondar.za [127.0.0.1]) by grackle.grondar.za (8.8.3/8.7.3) with ESMTP id QAA26422; Wed, 20 Nov 1996 16:13:57 +0200 (SAT) Message-Id: <199611201413.QAA26422@grackle.grondar.za> To: asami@FreeBSD.org (Satoshi Asami) cc: jgreco@brasil.moneng.mei.com, luigi@labinfo.iet.unipi.it, mark@grondar.za, committers@FreeBSD.org, root@FreeBSD.org, postmaster@FreeBSD.org, hubs@FreeBSD.org Subject: Re: Too much cruft Date: Wed, 20 Nov 1996 16:13:55 +0200 From: Mark Murray Sender: owner-hubs@FreeBSD.org X-Loop: FreeBSD.org Precedence: bulk > I usually delete the old tarball if it hasn't been used in the > previous release (2.1.5 in this case). I said "usually" because > sometimes I forget. I occasionally go there and do a manual check of > the whole place too. > > If someone is willing to help me do this, I'll be eternally grateful. > It's not that hard, just do a > > cvs diff -D 07/20/96 /usr/ports/*/*/files/md5 > > to get the list of all distfiles that were needed for 2.1.5R as well > as the ones that are needed now, and compare that to an output of ls > at wcarchive. Then send me a list of files I need to delete. I'll do it when I get home - in an hour or two. M -- Mark Murray PGP key fingerprint = 80 36 6E 40 83 D6 8A 36 This .sig is umop ap!sdn. BC 06 EA 0E 7A F2 CE CE From owner-freebsd-hubs Wed Nov 20 06:37:40 1996 Return-Path: owner-hubs Received: (from root@localhost) by freefall.freebsd.org (8.7.5/8.7.3) id GAA07746 for hubs-outgoing; Wed, 20 Nov 1996 06:37:40 -0800 (PST) Received: from brasil.moneng.mei.com (brasil.moneng.mei.com [151.186.109.160]) by freefall.freebsd.org (8.7.5/8.7.3) with ESMTP id GAA07719; Wed, 20 Nov 1996 06:37:27 -0800 (PST) Received: (from jgreco@localhost) by brasil.moneng.mei.com (8.7.Beta.1/8.7.Beta.1) id IAA07214; Wed, 20 Nov 1996 08:36:54 -0600 From: Joe Greco Message-Id: <199611201436.IAA07214@brasil.moneng.mei.com> Subject: Re: Too much cruft To: asami@FreeBSD.org (Satoshi Asami) Date: Wed, 20 Nov 1996 08:36:53 -0600 (CST) Cc: jgreco@brasil.moneng.mei.com, luigi@labinfo.iet.unipi.it, mark@grondar.za, committers@FreeBSD.org, root@FreeBSD.org, postmaster@FreeBSD.org, hubs@FreeBSD.org In-Reply-To: <199611201315.FAA02280@silvia.HIP.Berkeley.EDU> from "Satoshi Asami" at Nov 20, 96 05:15:24 am X-Mailer: ELM [version 2.4 PL24] Content-Type: text Sender: owner-hubs@FreeBSD.org X-Loop: FreeBSD.org Precedence: bulk > * > > I have noticed an _enormous_ amount of wasted space in the master > * > > site's distribution/ directory. It seems that as ports get upgraded, > * > > many out-of-date tarballs do not get nuked. I created this directory > * > > on my machine by doin a "make fetch" in /usr/ports, but internat's > * > > is a mirror of the dir on ftp.freebsd.org. This latter dir is nearly > * > > 200MB larger that mine! > > Note that it is not only because of old distfiles. For instance, how > large is your pkfonts/ subdir? You need to run "make fetch" multiple > times in japanese/pkfonts and print/pkfonts with RESOLUTION set to > various values to get what wcarchive has (89MB). I don't want to have to run "make" anything. I want to be able to intelligently mirror FreeBSD releases. Now here is my problem, explained in some detail, so that you can see why I am suggesting what I am. Disk space is not cheap. CDROM space is, and I can burn CDROM's. I want to be able to maintain - MINIMALLY - the entire set of releases in production use here. That would include 2.0.5R, 2.1.0R, 2.1.5R, and 2.2A at this point in time. I export an interface to my archive via FTP, both for my own convenience and for the convenience of others. (Often what I do is I add "ftp.freebsd.org 206.55.64.117" in a host's /etc/hosts file to cause it to look on my local archive. There may be a more elegant way to do this...) In any case.. Assuming that I want to take 2.0.5R and 2.1.0R and jam them on CD, all I really need to do is (for 2.1.0R) grab "2.1.0-RELEASE", "packages-2.1", "ports-2.1" (a symlink), "distfiles", and the XFree package for that release. However, distfiles has all this other irrelevant crap in it. Worse, distfiles has some distfiles that have been overwritten with newer (2.1.6R, whatever) distfiles corresponding with ports in some later version of FreeBSD, causing the older port to fail with a checksum error. So, I have shit. :-( My choices, as I see them: 1) Take a whole lot of disk space and mirror wcarchive verbatim. a) This is expensive, particularly considering the low access rate for the 2.0.5R stuff. b) This does not resolve the name space collision problems in 'distfiles' c) I lose support for really old distributions (2.0.5R, 2.1.0R) 2) Manually break up distfiles myself into "distfiles-2.1", etc. a) LOTS of work. b) Breaks the ability to transparently use the "make" and auto fetch paradigm. 3) Manually break up distfiles and use symlinks from "distfiles". a) LOTS of work. b) This does not resolve the name space collision problems in 'distfiles' 4) Scream in agony and dump the whole thing. a) Very easy. b) Fails to provide a mechanism with which to support production systems. Or I could ask if there is some very good reason that we do not versionize distfiles, which would effectively solve the problem. > * Would it be possible to put distfiles in a per-version location? i.e. > * distfiles that were shipped with ports-2.1 should go in distfiles-2.1, > * etc. > > I thought about this before, but came to the conclusion that that > would be too hard to maintain unless we are willing to waste even more > space. (I.e., "mv distfiles distfiles-2.2; mkdir distfiles" and then > just update the new "distfiles" dir. :) Me, in that situation, I might use links... depends. But maybe the disk space is worth it. I know in my case I would prefer to do it, because CDROM's are cheap. > * This will help the namespace collision problems, also. > > This is true. I've always been bothered by the fact that when I put a > new lynx tarball (for instance) up there, I might be breaking the > build for 2.1.5R users. But these ports are the vast minority, and I > don't think it's worth the added administrative overhead. Well I will simply say that I am not particularly happy with this as it stands, because I do not have the ability to properly archive this stuff in an easy-to-retrieve fashion. ... JG