From owner-freebsd-hubs Sun Mar 9 13:54:54 2003 Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9317C37B404 for ; Sun, 9 Mar 2003 13:54:49 -0800 (PST) Received: from dragon.nuxi.com (trang.nuxi.com [66.93.134.19]) by mx1.FreeBSD.org (Postfix) with ESMTP id E332443F3F for ; Sun, 9 Mar 2003 13:54:48 -0800 (PST) (envelope-from obrien@NUXI.com) Received: from dragon.nuxi.com (smmsp@localhost [127.0.0.1]) by dragon.nuxi.com (8.12.7/8.12.7) with ESMTP id h29Lsmdh030174 for ; Sun, 9 Mar 2003 13:54:48 -0800 (PST) (envelope-from obrien@dragon.nuxi.com) Received: (from obrien@localhost) by dragon.nuxi.com (8.12.7/8.12.7/Submit) id h29Lsmck030173 for hubs@freebsd.org; Sun, 9 Mar 2003 13:54:48 -0800 (PST) Date: Sun, 9 Mar 2003 13:54:48 -0800 From: "David O'Brien" To: hubs@freebsd.org Subject: Poor state of some top-level FTP mirrors Message-ID: <20030309215448.GB30033@dragon.nuxi.com> Reply-To: obrien@freebsd.org Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.4i X-Operating-System: FreeBSD 5.0-CURRENT Organization: The NUXI BSD Group X-Pgp-Rsa-Fingerprint: B7 4D 3E E9 11 39 5F A3 90 76 5D 69 58 D9 98 7A X-Pgp-Rsa-Keyid: 1024/34F9F9D5 Sender: owner-freebsd-hubs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org In my never ending quest to find an alternate ftp site for "pkg_add -r", I've tried many of our ftpX.freebsd.org mirrors. The problem is the mirrors only seem to be consistent for short periods of time. As a simple test, the documented mirrors was polled for the file ftp://${SITE}/pub/FreeBSD/ports/i386/packages-4-stable/All/bonnie++-1.93.03.tgz which was updated on ftp.freebsd.org 2-March-2003. I am most concerned about ftp1-14.freebsd.org and ftp. as those are the "top level" mirrors. Summary: 53 bad, 25 unknown problem, 57 good. Bad sites: ftp8.FreeBSD.org ftp11.FreeBSD.org ftp.au.FreeBSD.org ftp.bg.FreeBSD.org ftp.br.FreeBSD.org ftp.cn.FreeBSD.org ftp.dk.FreeBSD.org ftp.es.FreeBSD.org ftp.fr.FreeBSD.org ftp.hk.FreeBSD.org ftp.ie.FreeBSD.org ftp.is.FreeBSD.org ftp.isu.net.sa ftp.nectec.or.th ftp.nz.FreeBSD.org ftp.ro.FreeBSD.org ftp.sg.FreeBSD.org ftp.sk.FreeBSD.org ftp.ua.FreeBSD.org ftp.za.FreeBSD.org ftp2.br.FreeBSD.org ftp2.de.FreeBSD.org ftp2.dk.FreeBSD.org ftp2.es.FreeBSD.org ftp2.fr.FreeBSD.org ftp2.ie.FreeBSD.org ftp2.pl.FreeBSD.org ftp2.pt.FreeBSD.org ftp2.se.FreeBSD.org ftp2.ua.FreeBSD.org ftp2.za.FreeBSD.org ftp3.au.FreeBSD.org ftp3.de.FreeBSD.org ftp3.dk.FreeBSD.org ftp3.fi.FreeBSD.org ftp3.kr.FreeBSD.org ftp3.no.FreeBSD.org ftp3.pt.FreeBSD.org ftp3.uk.FreeBSD.org ftp3.za.FreeBSD.org ftp4.au.FreeBSD.org ftp4.br.FreeBSD.org ftp4.kr.FreeBSD.org ftp4.uk.FreeBSD.org ftp4.za.FreeBSD.org ftp5.au.FreeBSD.org ftp6.au.FreeBSD.org ftp6.br.FreeBSD.org ftp6.de.FreeBSD.org ftp6.uk.FreeBSD.org ftp7.de.FreeBSD.org ftp7.tw.FreeBSD.org ftp8.fr.FreeBSD.org Unknown problem: ftp4.FreeBSD.org skipped: Net::FTP: Socket is not connected ftp7.FreeBSD.org skipped: Net::FTP: Socket is not connected ftp.gr.FreeBSD.org skipped: Net::FTP: Bad hostname 'ftp.gr.FreeBSD.org' ftp.hu.FreeBSD.org skipped: Net::FTP: ftp.tw.FreeBSD.org skipped: 000 ftp2.au.FreeBSD.org skipped: Net::FTP: Socket is not connected ftp2.ca.FreeBSD.org skipped: Net::FTP: Bad hostname 'ftp2.ca.FreeBSD.org' ftp2.cn.FreeBSD.org skipped: Net::FTP: Socket is not connected ftp2.gr.FreeBSD.org skipped: Net::FTP: Bad hostname 'ftp2.gr.FreeBSD.org' ftp2.it.FreeBSD.org skipped: Net::FTP: Bad hostname 'ftp2.it.FreeBSD.org' ftp2.ru.FreeBSD.org skipped: Net::FTP: Socket is not connected ftp2.sk.FreeBSD.org skipped: Net::FTP: Bad hostname 'ftp2.sk.FreeBSD.org' ftp2.tw.FreeBSD.org changing directory pub/FreeBSD 000 ftp3.cn.FreeBSD.org skipped: Net::FTP: Bad hostname 'ftp3.cn.FreeBSD.org' ftp3.pl.FreeBSD.org skipped: Net::FTP: Socket is not connected ftp3.tw.FreeBSD.org skipped: unexpected Net::FTP error ftp3.ua.FreeBSD.org skipped: Net::FTP: Socket is not connected ftp4.tw.FreeBSD.org skipped: unexpected Net::FTP error ftp5.br.FreeBSD.org skipped: Net::FTP: Socket is not connected ftp5.kr.FreeBSD.org skipped: Net::FTP: Socket is not connected ftp5.tw.FreeBSD.org changing directory pub 000 ftp5.ua.FreeBSD.org skipped: Net::FTP: Socket is not connected ftp6.kr.FreeBSD.org skipped: Net::FTP: Socket is not connected ftp9.tw.FreeBSD.org skipped: 000 Good sites: ftp.freebsd.org ftp1.FreeBSD.org ftp2.FreeBSD.org ftp3.FreeBSD.org ftp5.FreeBSD.org ftp6.FreeBSD.org ftp9.FreeBSD.org ftp10.FreeBSD.org ftp12.FreeBSD.org ftp13.FreeBSD.org ftp14.FreeBSD.org ftp.ar.FreeBSD.org ftp.at.FreeBSD.org ftp.ca.FreeBSD.org ftp.ch.FreeBSD.org ftp.cz.FreeBSD.org ftp.de.FreeBSD.org ftp.ee.FreeBSD.org ftp.fi.FreeBSD.org ftp.it.FreeBSD.org ftp.jp.FreeBSD.org ftp.kr.FreeBSD.org ftp.lt.FreeBSD.org ftp.nl.FreeBSD.org ftp.no.FreeBSD.org ftp.pl.FreeBSD.org ftp.ru.FreeBSD.org ftp.se.FreeBSD.org ftp.uk.FreeBSD.org ftp2.at.FreeBSD.org ftp2.jp.FreeBSD.org ftp2.kr.FreeBSD.org ftp2.nl.freebsd.org ftp2.si.FreeBSD.org ftp2.uk.FreeBSD.org ftp3.br.FreeBSD.org ftp3.es.FreeBSD.org ftp3.fr.FreeBSD.org ftp3.ie.FreeBSD.org ftp3.jp.FreeBSD.org ftp3.ru.FreeBSD.org ftp3.se.FreeBSD.org ftp4.de.FreeBSD.org ftp4.jp.FreeBSD.org ftp4.ru.FreeBSD.org ftp5.de.FreeBSD.org ftp5.fr.FreeBSD.org ftp5.jp.FreeBSD.org ftp5.se.FreeBSD.org ftp5.uk.FreeBSD.org ftp6.fr.FreeBSD.org ftp6.jp.FreeBSD.org ftp6.tw.FreeBSD.org ftp7.br.FreeBSD.org ftp7.jp.FreeBSD.org ftp7.kr.FreeBSD.org ftp8.tw.FreeBSD.org To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-hubs" in the body of the message From owner-freebsd-hubs Sun Mar 9 15:54:27 2003 Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id B689C37B401; Sun, 9 Mar 2003 15:54:25 -0800 (PST) Received: from amun.isnic.is (amun.isnic.is [193.4.58.10]) by mx1.FreeBSD.org (Postfix) with ESMTP id 8C43343FB1; Sun, 9 Mar 2003 15:54:23 -0800 (PST) (envelope-from oli@amun.isnic.is) Received: from amun.isnic.is (oli@localhost [127.0.0.1]) by amun.isnic.is (8.12.8/8.12.8/isnic) with ESMTP id h29NsGj4082915; Sun, 9 Mar 2003 23:54:16 GMT (envelope-from oli@amun.isnic.is) Received: (from oli@localhost) by amun.isnic.is (8.12.8/8.12.8/Submit) id h29NsFcd082914; Sun, 9 Mar 2003 23:54:15 GMT Date: Sun, 9 Mar 2003 23:54:15 +0000 From: Olafur Osvaldsson To: "David O'Brien" Cc: hubs@FreeBSD.ORG Subject: Re: Poor state of some top-level FTP mirrors Message-ID: <20030309235415.GA82572@isnic.is> References: <20030309215448.GB30033@dragon.nuxi.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20030309215448.GB30033@dragon.nuxi.com> User-Agent: Mutt/1.3.28i X-Spam-Status: No, hits=-3.3 required=6.0 tests=IN_REP_TO,QUOTED_EMAIL_TEXT,REFERENCES,SPAM_PHRASE_01_02, USER_AGENT,USER_AGENT_MUTT version=2.43-isnic Sender: owner-freebsd-hubs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org David, On Sun, 09 Mar 2003, David O'Brien wrote: > In my never ending quest to find an alternate ftp site for "pkg_add -r", > I've tried many of our ftpX.freebsd.org mirrors. The problem is the > mirrors only seem to be consistent for short periods of time. > > As a simple test, the documented mirrors was polled for the file > ftp://${SITE}/pub/FreeBSD/ports/i386/packages-4-stable/All/bonnie++-1.93.03.tgz > which was updated on ftp.freebsd.org 2-March-2003. > > I am most concerned about ftp1-14.freebsd.org and ftp. as those > are the "top level" mirrors. > > Summary: 53 bad, 25 unknown problem, 57 good. Thank you for the notice, the problem at ftp.is.* has been fixed and I'm syncing it now. /Oli -- Olafur Osvaldsson Systems Administrator Internet a Islandi hf. Tel: +354 525-5291 Email: oli@isnic.is To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-hubs" in the body of the message From owner-freebsd-hubs Sun Mar 9 17:25:29 2003 Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id E2E0C37B401; Sun, 9 Mar 2003 17:25:27 -0800 (PST) Received: from luna.rtfmconsult.com (luna.rtfmconsult.com [202.83.72.190]) by mx1.FreeBSD.org (Postfix) with ESMTP id 150C443FBD; Sun, 9 Mar 2003 17:25:27 -0800 (PST) (envelope-from jason@rtfmconsult.com) Received: by luna.rtfmconsult.com (Postfix, from userid 42) id 8D2C848E6F; Mon, 10 Mar 2003 11:25:25 +1000 (EST) Received: from localhost (localhost [127.0.0.1]) by luna.rtfmconsult.com (Postfix) with ESMTP id 8562952D92; Mon, 10 Mar 2003 11:25:25 +1000 (EST) Date: Mon, 10 Mar 2003 11:25:25 +1000 (EST) From: jason andrade To: David O'Brien Cc: hubs@FreeBSD.ORG Subject: Re: Poor state of some top-level FTP mirrors In-Reply-To: <20030309215448.GB30033@dragon.nuxi.com> Message-ID: References: <20030309215448.GB30033@dragon.nuxi.com> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-freebsd-hubs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On Sun, 9 Mar 2003, David O'Brien wrote: > In my never ending quest to find an alternate ftp site for "pkg_add -r", > I've tried many of our ftpX.freebsd.org mirrors. The problem is the > mirrors only seem to be consistent for short periods of time. > > As a simple test, the documented mirrors was polled for the file > ftp://${SITE}/pub/FreeBSD/ports/i386/packages-4-stable/All/bonnie++-1.93.03.tgz > which was updated on ftp.freebsd.org 2-March-2003. the methodology of the way the packages tree is set out makes it very difficult to provide a stable and uptodate mirror. the freebsd archive is one of the few that has a system which causes an entire package tree to be rebuilt (and hence refetched) over and over again with no ability to only fetch updated or changed packages and the packages trees make up the bulk of the freebsd archive. keeping that in mind, as well as the load this puts on bandwidth (how many freebsd mirrors are there ? say 135 from below's stats) where at 6G for this tree, that is almost a Terabyte of data that is pushed out in various directions almost weekly for one tree. would anyone say that there is even half a terabyte of (compressed) code that is changing weekly ? or monthly.. i'd be happy to be proven wrong on this but i suspect it is one of the major issues behind the impossibility of keeping an up to date mirror of the packages tree, and this is made worse by having multiple architectures and releases now, e.g packages-4-stable, packages-5-current for i386, alpha, and eventually sparc64 and others. here at ftp.au.freebsd.org i try and keep the packages-4-stable tree updated once a week to once a fortnight. it still takes most of a day - sometimes 3 or 4 days, to update one tree. regards, -jason To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-hubs" in the body of the message From owner-freebsd-hubs Sun Mar 9 17:29:39 2003 Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 60BE437B401 for ; Sun, 9 Mar 2003 17:29:38 -0800 (PST) Received: from procyon.firepipe.net (procyon.firepipe.net [198.78.66.151]) by mx1.FreeBSD.org (Postfix) with ESMTP id E546543F93 for ; Sun, 9 Mar 2003 17:29:37 -0800 (PST) (envelope-from will@csociety.org) Received: by procyon.firepipe.net (Postfix, from userid 1000) id 3FAD121FC5; Sun, 9 Mar 2003 17:29:37 -0800 (PST) Date: Sun, 9 Mar 2003 17:29:37 -0800 From: Will Andrews To: jason andrade Cc: hubs@FreeBSD.org Subject: Re: Poor state of some top-level FTP mirrors Message-ID: <20030310012937.GA57178@procyon.firepipe.net> References: <20030309215448.GB30033@dragon.nuxi.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4i Sender: owner-freebsd-hubs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On Mon, Mar 10, 2003 at 11:25:25AM +1000, jason andrade wrote: > the methodology of the way the packages tree is set out makes it > very difficult to provide a stable and uptodate mirror. the freebsd > archive is one of the few that has a system which causes an entire package > tree to be rebuilt (and hence refetched) over and over again with > no ability to only fetch updated or changed packages and the packages trees > make up the bulk of the freebsd archive. Please tell us how other OS projects update their packages without this kind of problem. What do they do (or not do) that we don't (or do)? Regards, -- wca To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-hubs" in the body of the message From owner-freebsd-hubs Sun Mar 9 17:33:59 2003 Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 5230637B401; Sun, 9 Mar 2003 17:33:58 -0800 (PST) Received: from obsecurity.dyndns.org (adsl-63-207-60-52.dsl.lsan03.pacbell.net [63.207.60.52]) by mx1.FreeBSD.org (Postfix) with ESMTP id 6C43143FBF; Sun, 9 Mar 2003 17:33:56 -0800 (PST) (envelope-from kris@obsecurity.org) Received: from rot13.obsecurity.org (rot13.obsecurity.org [10.0.0.5]) by obsecurity.dyndns.org (Postfix) with ESMTP id 2327466CFB; Sun, 9 Mar 2003 17:33:56 -0800 (PST) Received: by rot13.obsecurity.org (Postfix, from userid 1000) id 102488D4; Sun, 9 Mar 2003 17:33:56 -0800 (PST) Date: Sun, 9 Mar 2003 17:33:56 -0800 From: Kris Kennaway To: jason andrade Cc: David O'Brien , hubs@FreeBSD.ORG Subject: Re: Poor state of some top-level FTP mirrors Message-ID: <20030310013355.GA70336@rot13.obsecurity.org> References: <20030309215448.GB30033@dragon.nuxi.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="vkogqOf2sHV7VnPd" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4i Sender: owner-freebsd-hubs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org --vkogqOf2sHV7VnPd Content-Type: text/plain; charset=us-ascii Content-Disposition: inline On Mon, Mar 10, 2003 at 11:25:25AM +1000, jason andrade wrote: > the methodology of the way the packages tree is set out makes it > very difficult to provide a stable and uptodate mirror. the freebsd > archive is one of the few that has a system which causes an entire package > tree to be rebuilt (and hence refetched) over and over again with > no ability to only fetch updated or changed packages and the packages trees > make up the bulk of the freebsd archive. I suspect you're wrong. Can you provide supporting evidence? Kris --vkogqOf2sHV7VnPd Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.1 (FreeBSD) iD8DBQE+a+uDWry0BWjoQKURAiAkAJ9V/OoQTUsVuZXqDzTY2EkhPSWUGwCdGDo/ D9Xueq7buhMgGqco3r6ChLA= =l9kv -----END PGP SIGNATURE----- --vkogqOf2sHV7VnPd-- To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-hubs" in the body of the message From owner-freebsd-hubs Sun Mar 9 17:38:58 2003 Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9ED6B37B401 for ; Sun, 9 Mar 2003 17:38:56 -0800 (PST) Received: from luna.rtfmconsult.com (luna.rtfmconsult.com [202.83.72.190]) by mx1.FreeBSD.org (Postfix) with ESMTP id C9AE643F93 for ; Sun, 9 Mar 2003 17:38:55 -0800 (PST) (envelope-from jason@rtfmconsult.com) Received: by luna.rtfmconsult.com (Postfix, from userid 42) id 837B648E6F; Mon, 10 Mar 2003 11:38:54 +1000 (EST) Received: from localhost (localhost [127.0.0.1]) by luna.rtfmconsult.com (Postfix) with ESMTP id 7B62F52D92; Mon, 10 Mar 2003 11:38:54 +1000 (EST) Date: Mon, 10 Mar 2003 11:38:54 +1000 (EST) From: jason andrade To: Will Andrews Cc: hubs@FreeBSD.org Subject: Re: Poor state of some top-level FTP mirrors In-Reply-To: <20030310012937.GA57178@procyon.firepipe.net> Message-ID: References: <20030309215448.GB30033@dragon.nuxi.com> <20030310012937.GA57178@procyon.firepipe.net> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-freebsd-hubs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On Sun, 9 Mar 2003, Will Andrews wrote: > Please tell us how other OS projects update their packages > without this kind of problem. What do they do (or not do) that > we don't (or do)? their release trees are structured differently. i am not making a judgement call here (i hear equal amounts of religious statements on people who love freebsd's package management and other OSes systems..) so please don't see any of this as my preference. o redhat has a package management system that is built into the OS tree. because the OS tree is quite "static" this lends itself well to a single fetch and then periodic (but much smaller) updates via a separate "update" tree. packages that are not released via the OS are available via a separate "contrib" tree. they have been less than good about keeping this updated but at least it does have some theoretical structure for how to add things later. o debian has a system which divides the OS and packages into separate trees via "dist" and "pool". the pool area changes a fair bit but only certain packages get rebuilt/updated - not the entire poo. o a lot of smaller OSes have some combination of the above but again the main difference from FreeBSD would be that they only rebuild/release packages that have been updated or have been patched for security reasons. i am making the assumption (that could well be completely wrong) that the freebsd package trees are completely rebuilt for each tree (packages-4-stable/packages-5-current) and architecture at roughly the same interval (weekly?) necessitating a refetch of the whole tree - is that correct ? regards, -jason To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-hubs" in the body of the message From owner-freebsd-hubs Sun Mar 9 17:44:11 2003 Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 4381C37B401; Sun, 9 Mar 2003 17:44:10 -0800 (PST) Received: from luna.rtfmconsult.com (luna.rtfmconsult.com [202.83.72.190]) by mx1.FreeBSD.org (Postfix) with ESMTP id 7829943FCB; Sun, 9 Mar 2003 17:44:09 -0800 (PST) (envelope-from jason@rtfmconsult.com) Received: by luna.rtfmconsult.com (Postfix, from userid 42) id 53FD748E6F; Mon, 10 Mar 2003 11:44:08 +1000 (EST) Received: from localhost (localhost [127.0.0.1]) by luna.rtfmconsult.com (Postfix) with ESMTP id 4000752D92; Mon, 10 Mar 2003 11:44:08 +1000 (EST) Date: Mon, 10 Mar 2003 11:44:08 +1000 (EST) From: jason andrade To: Kris Kennaway Cc: David O'Brien , "" Subject: Re: Poor state of some top-level FTP mirrors In-Reply-To: <20030310013355.GA70336@rot13.obsecurity.org> Message-ID: References: <20030309215448.GB30033@dragon.nuxi.com> <20030310013355.GA70336@rot13.obsecurity.org> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-freebsd-hubs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On Sun, 9 Mar 2003, Kris Kennaway wrote: > I suspect you're wrong. Can you provide supporting evidence? not really - i should try and go back to some logs we kept, but most of the evidence was anecdotal by asking on this list how package trees are maintained. in any case, the up to dateness of mirrors is quite an important issue and i guess worth pursuing. a lot of the other projects either have systems in place or are also looking at putting systems in place to provide verification and feedback on mirrors that fall out of date. and (i am speaking out loud) with the efforts in organizing a US master mirror, an EU master mirror and possible one other, it is starting to again look good for organizing tiers of mirrors to spread out the load of updating and hopefully making it more reliable/faster. we stopped updating the packages tree daily at one point where it reached the stage that the first update was not completing before the next one started to delete files already - this was some months ago though. regards, -jason To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-hubs" in the body of the message From owner-freebsd-hubs Sun Mar 9 17:48: 7 2003 Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id BEE9637B401 for ; Sun, 9 Mar 2003 17:48:05 -0800 (PST) Received: from procyon.firepipe.net (procyon.firepipe.net [198.78.66.151]) by mx1.FreeBSD.org (Postfix) with ESMTP id 5313843FBD for ; Sun, 9 Mar 2003 17:48:05 -0800 (PST) (envelope-from will@csociety.org) Received: by procyon.firepipe.net (Postfix, from userid 1000) id 4FA9E21FC5; Sun, 9 Mar 2003 17:48:04 -0800 (PST) Date: Sun, 9 Mar 2003 17:48:04 -0800 From: Will Andrews To: jason andrade Cc: Will Andrews , hubs@FreeBSD.org Subject: Re: Poor state of some top-level FTP mirrors Message-ID: <20030310014804.GB57178@procyon.firepipe.net> References: <20030309215448.GB30033@dragon.nuxi.com> <20030310012937.GA57178@procyon.firepipe.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4i Sender: owner-freebsd-hubs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On Mon, Mar 10, 2003 at 11:38:54AM +1000, jason andrade wrote: > their release trees are structured differently. i am not making > a judgement call here (i hear equal amounts of religious statements > on people who love freebsd's package management and other OSes > systems..) so please don't see any of this as my preference. Right, I am not looking for a fight, just technical facts. > o redhat has a package management system that is built into the OS > tree. because the OS tree is quite "static" this lends itself well > to a single fetch and then periodic (but much smaller) updates > via a separate "update" tree. packages that are not released via > the OS are available via a separate "contrib" tree. they have been > less than good about keeping this updated but at least it does > have some theoretical structure for how to add things later. > > o debian has a system which divides the OS and packages into separate > trees via "dist" and "pool". the pool area changes a fair bit but > only certain packages get rebuilt/updated - not the entire poo. > > o a lot of smaller OSes have some combination of the above but again > the main difference from FreeBSD would be that they only rebuild/release > packages that have been updated or have been patched for security > reasons. > > > i am making the assumption (that could well be completely wrong) > that the freebsd package trees are completely rebuilt for each > tree (packages-4-stable/packages-5-current) and architecture at > roughly the same interval (weekly?) necessitating a refetch of > the whole tree - is that correct ? I guess the reason for this is because, theoretically, the build environment could change between builds, or if a package is upgraded, it could affect code for packages that depend on that. We build everything about daily for i386 and less frequently for alpha, sparc64, and powerpc (in that order, I believe). But uploading only occurs when the upload job is run manually, and it usually only happens about once a week or fortnight. I guess what we could do is add some code to portbuild that only builds things that have changed, but still allow for a manual override for complete rebuilds (in case, e.g., we update the base environment used in the builds). This can probably reduce the amount of package building done during each build and possibly allow us to increase the update frequency without drastically increasing the amount of mirroring needed (or just leaving it at weekly updates and cron'ing that). Regards, -- wca To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-hubs" in the body of the message From owner-freebsd-hubs Sun Mar 9 17:54:55 2003 Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id EBD4337B404; Sun, 9 Mar 2003 17:54:53 -0800 (PST) Received: from obsecurity.dyndns.org (adsl-63-207-60-52.dsl.lsan03.pacbell.net [63.207.60.52]) by mx1.FreeBSD.org (Postfix) with ESMTP id EC12643FDD; Sun, 9 Mar 2003 17:54:52 -0800 (PST) (envelope-from kris@obsecurity.org) Received: from rot13.obsecurity.org (rot13.obsecurity.org [10.0.0.5]) by obsecurity.dyndns.org (Postfix) with ESMTP id AABD066CFB; Sun, 9 Mar 2003 17:54:52 -0800 (PST) Received: by rot13.obsecurity.org (Postfix, from userid 1000) id 6E83289E; Sun, 9 Mar 2003 17:54:52 -0800 (PST) Date: Sun, 9 Mar 2003 17:54:52 -0800 From: Kris Kennaway To: jason andrade Cc: Kris Kennaway , David O'Brien , hubs@FreeBSD.ORG Subject: Re: Poor state of some top-level FTP mirrors Message-ID: <20030310015452.GA70681@rot13.obsecurity.org> References: <20030309215448.GB30033@dragon.nuxi.com> <20030310013355.GA70336@rot13.obsecurity.org> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="rwEMma7ioTxnRzrJ" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4i Sender: owner-freebsd-hubs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org --rwEMma7ioTxnRzrJ Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Mar 10, 2003 at 11:44:08AM +1000, jason andrade wrote: > On Sun, 9 Mar 2003, Kris Kennaway wrote: >=20 > > I suspect you're wrong. Can you provide supporting evidence? >=20 > not really - i should try and go back to some logs we kept, but > most of the evidence was anecdotal by asking on this list how > package trees are maintained. The major difficulty in "only updating packages that have changed" is identifying those packages. You can't compare the tarballs because there are all sorts of embedded timestamps in the tarball (and in files like lib*.a). I tried doing this once and it didn't actually provide much benefit for all the extra work it causes, because the majority of packages do change from build to build (e.g. because of updated dependencies, changes to the base system that change the generated code, etc). Of course, it's not fair to compare FreeBSD to an OS that almost never updates their packages (like Redhat). The only case you mentioned in your other mail that might compare is Debian. I'd need to have more information about their update strategy to make informed comment. I suspect it might come down to either not having the ability to rebuild their entire package tree more frequently (i.e. lack of build cluster resources), or a more conservative policy of how they choose to update packages. Kris --rwEMma7ioTxnRzrJ Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.1 (FreeBSD) iD8DBQE+a/BsWry0BWjoQKURAhJZAKDnY8QK1bQJwggZVN+BcuOlMTqeCwCgmzxv f8cw/cPPW1u2eT9EKFN4Z6w= =2vUi -----END PGP SIGNATURE----- --rwEMma7ioTxnRzrJ-- To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-hubs" in the body of the message From owner-freebsd-hubs Sun Mar 9 18: 9:36 2003 Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id D48FE37B401; Sun, 9 Mar 2003 18:09:34 -0800 (PST) Received: from drago.fomokka.net (drago.fomokka.net [140.117.205.99]) by mx1.FreeBSD.org (Postfix) with ESMTP id 93CA443F93; Sun, 9 Mar 2003 18:09:33 -0800 (PST) (envelope-from foxfair@drago.fomokka.net) Received: from drago.fomokka.net (FooBar@localhost [127.0.0.1]) by drago.fomokka.net (8.12.8/8.12.6) with ESMTP id h2A29WIM027889; Mon, 10 Mar 2003 10:09:32 +0800 (CST) (envelope-from foxfair@drago.fomokka.net) Received: (from foxfair@localhost) by drago.fomokka.net (8.12.8/8.12.6/Submit) id h2A29Wuf027888; Mon, 10 Mar 2003 10:09:32 +0800 (CST) Date: Mon, 10 Mar 2003 10:09:32 +0800 From: Foxfair Hu To: obrien@freebsd.org Cc: freebsd-hubs@freebsd.org Subject: Re: Poor state of some top-level FTP mirrors Message-ID: <20030310020932.GA27838@drago.fomokka.net> References: <20030309215448.GB30033@dragon.nuxi.com> <20030310013355.GA70336@rot13.obsecurity.org> <20030310015452.GA70681@rot13.obsecurity.org> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="8t9RHnE3ZwKMSgU+" Content-Disposition: inline In-Reply-To: <20030310015452.GA70681@rot13.obsecurity.org> X-Operating-System: FreeBSD 4.7-STABLE X-Pgp-Rsa-Fingerprint: E05E A572 2F0C 166E 3711 17C7 B168 790B 0DC2 57EA X-Pgp-Rsa-Keyid: 1024D/0DC257EA X-PGP-Fingerprint: E05E A572 2F0C 166E 3711 17C7 B168 790B 0DC2 57EA X-PGP-KeyID: 1024D/0x0DC257EA User-Agent: Mutt/1.5.3i Sender: owner-freebsd-hubs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org --8t9RHnE3ZwKMSgU+ Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sun, 09 Mar 2003, David O'Brien wrote: > In my never ending quest to find an alternate ftp site for "pkg_add -r", > I've tried many of our ftpX.freebsd.org mirrors. The problem is the > mirrors only seem to be consistent for short periods of time. > > As a simple test, the documented mirrors was polled for the file > ftp://${SITE}/pub/FreeBSD/ports/i386/packages-4-stable/All/bonnie++-1.93.= 03.tg z > which was updated on ftp.freebsd.org 2-March-2003. > > I am most concerned about ftp1-14.freebsd.org and ftp. as those > are the "top level" mirrors. > > Summary: 53 bad, 25 unknown problem, 57 good. > Bad sites: [....] > Unknown problem: > >ftp.tw.FreeBSD.org skipped: 000 >ftp2.tw.FreeBSD.org changing directory pub/FreeBSD 000 [ Speaking for Taiwan local mirror sites ] I can fetch the bonie++ package and download it from ftp client in ftp2.tw.FreeBSD.org, what does error code '000' mean? I know ftp2.tw has a symbol link structure, pub/FreeBSD is linked to another partition.=20 Maybe it causes this kind of problems. For ftp.tw, yes. The newest bonie++ package doesn't exist :) -Foxfair --8t9RHnE3ZwKMSgU+ Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.1 (FreeBSD) iD8DBQE+a/PbsWh5Cw3CV+oRAgoZAJ4yK4fytWCJm1emhJXO+1xB09aORACfUN5l 1N/kE23iY+YkgcKnor3SoUs= =Zm3K -----END PGP SIGNATURE----- --8t9RHnE3ZwKMSgU+-- To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-hubs" in the body of the message From owner-freebsd-hubs Sun Mar 9 18:45: 8 2003 Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9BA7637B401 for ; Sun, 9 Mar 2003 18:45:07 -0800 (PST) Received: from mail-blue.research.att.com (H-135-207-30-102.research.att.com [135.207.30.102]) by mx1.FreeBSD.org (Postfix) with ESMTP id C414343F3F for ; Sun, 9 Mar 2003 18:45:06 -0800 (PST) (envelope-from fenner@research.att.com) Received: from alliance.research.att.com (alliance.research.att.com [135.207.26.26]) by mail-blue.research.att.com (Postfix) with ESMTP id 2103B4CE17; Sun, 9 Mar 2003 21:45:06 -0500 (EST) Received: from windsor.research.att.com (windsor.research.att.com [135.207.26.46]) by alliance.research.att.com (8.8.7/8.8.7) with ESMTP id VAA13556; Sun, 9 Mar 2003 21:45:05 -0500 (EST) From: Bill Fenner Received: (from fenner@localhost) by windsor.research.att.com (8.11.6+Sun/8.8.5) id h2A2j5D13680; Sun, 9 Mar 2003 18:45:05 -0800 (PST) Message-Id: <200303100245.h2A2j5D13680@windsor.research.att.com> MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII To: foxfair@drago.fomokka.net Subject: Re: Poor state of some top-level FTP mirrors Cc: freebsd-hubs@FreeBSD.ORG References: <20030309215448.GB30033@dragon.nuxi.com> <20030310013355.GA70336@rot13.obsecurity.org> <20030310015452.GA70681@rot13.obsecurity.org> <20030310020932.GA27838@drago.fomokka.net> Date: Sun, 9 Mar 2003 18:45:04 -0800 Versions: dmail (solaris) 2.5a/makemail 2.9d Sender: owner-freebsd-hubs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Some of the "unknown problems" could be bugs in the checking script or in Net::FTP. In particular, the "000" entries are timeouts: ftp.tw.freebsd.org: Net::FTP=GLOB(0x83ef520)>>> user anonymous Net::FTP=GLOB(0x83ef520): Timeout at /home/fenner/bin/portftpcheck line 127 ftp2.tw.freebsd.org: Net::FTP=GLOB(0x83aadec)>>> CWD pub Net::FTP=GLOB(0x83aadec)<<< 250 OK. Current directory is /pub Net::FTP=GLOB(0x83aadec)>>> CWD FreeBSD Net::FTP=GLOB(0x83aadec): Timeout at /home/fenner/bin/portftpcheck line 169 I can't tell whether it's a Net::FTP bug or a portftpcheck bug that is causing the "000" instead of "Timeout" message. In any case, these can only be taken as an indication of the quality of the network between bento.freebsd.org and the server being tested. Bill To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-hubs" in the body of the message From owner-freebsd-hubs Sun Mar 9 22:59: 8 2003 Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 801D137B401; Sun, 9 Mar 2003 22:59:06 -0800 (PST) Received: from web000.govital.net (ns.govital.net [209.202.88.1]) by mx1.FreeBSD.org (Postfix) with ESMTP id DFD2A43FAF; Sun, 9 Mar 2003 22:58:59 -0800 (PST) (envelope-from admin@govital.net) Received: from govital.net (localhost [127.0.0.1]) by web000.govital.net (8.12.8/8.12.8) with ESMTP id h2A6wvoK025249; Mon, 10 Mar 2003 01:58:58 -0500 (EST) (envelope-from admin@govital.net) From: "Chris Demers" To: jason andrade , Kris Kennaway Cc: "David O'Brien" , "" Subject: Re: Poor state of some top-level FTP mirrors Date: Mon, 10 Mar 2003 01:58:57 -0500 Message-Id: <20030310064332.M84136@govital.net> In-Reply-To: References: <20030309215448.GB30033@dragon.nuxi.com> <20030310013355.GA70336@rot13.obsecurity.org> X-Mailer: Open WebMail 1.90 20030212 X-OriginatingIP: 64.228.137.139 (admin) MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Sender: owner-freebsd-hubs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Greetings, On Mon, 10 Mar 2003 11:44:08 +1000 (EST), jason andrade wrote > On Sun, 9 Mar 2003, Kris Kennaway wrote: > > > I suspect you're wrong. Can you provide supporting evidence? > > not really - i should try and go back to some logs we kept, but > most of the evidence was anecdotal by asking on this list how > package trees are maintained. > > in any case, the up to dateness of mirrors is quite an important > issue and i guess worth pursuing. a lot of the other projects > either have systems in place or are also looking at putting > systems in place to provide verification and feedback on > mirrors that fall out of date. and (i am speaking out loud) > with the efforts in organizing a US master mirror, an EU > master mirror and possible one other, it is starting to again > look good for organizing tiers of mirrors to spread out the > load of updating and hopefully making it more reliable/faster. > > we stopped updating the packages tree daily at one point where it > reached the stage that the first update was not completing before > the next one started to delete files already - this was some > months ago though. > > regards, > > -jason > > To Unsubscribe: send mail to majordomo@FreeBSD.org > with "unsubscribe freebsd-hubs" in the body of the message I don't normally say too much around here but i thought i would throw in my two cents. :-) I took a quick look around to find out just how this was being done and i couldn't find it. So i'm going to do some assuming and make some suggestions. Assuming a full package build is normally just pushed out for distribution, this would cause much unneeded bandwidth usage among all of the mirror sites. Wouldn't it be just better to maybe keep a record of the fingerprint of a port and if it matched from the last build not send it out to the mirrors so that only things that have been updated get pushed out? The only problem with this method is that it would slow down the build system a bit while it checks the files. Or maybe instead of just blindly building the entire collection all the time, keep a database of the versions that have been built and only build the ones that change. There would have to be some extra checking in there too to make sure that all dependacys affected by a version change of any port also get rebuilt, but that method would probably work better as the build system wouldn't have to work as hard all the time to churn out packages for ports that rarely change. And then just do a full build from time to time to double check everything. Just some ideas... -- Chris Demers admin@govital.net www.govital.net www.govitalhosting.com To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-hubs" in the body of the message From owner-freebsd-hubs Sun Mar 9 23: 8:27 2003 Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 5EDCB37B401; Sun, 9 Mar 2003 23:08:25 -0800 (PST) Received: from obsecurity.dyndns.org (adsl-63-207-60-52.dsl.lsan03.pacbell.net [63.207.60.52]) by mx1.FreeBSD.org (Postfix) with ESMTP id 6EE5E43FDD; Sun, 9 Mar 2003 23:08:18 -0800 (PST) (envelope-from kris@obsecurity.org) Received: from rot13.obsecurity.org (rot13.obsecurity.org [10.0.0.5]) by obsecurity.dyndns.org (Postfix) with ESMTP id 1D00C66D16; Sun, 9 Mar 2003 23:08:18 -0800 (PST) Received: by rot13.obsecurity.org (Postfix, from userid 1000) id F22BE786; Sun, 9 Mar 2003 23:08:17 -0800 (PST) Date: Sun, 9 Mar 2003 23:08:17 -0800 From: Kris Kennaway To: Chris Demers Cc: jason andrade , Kris Kennaway , David O'Brien , hubs@FreeBSD.ORG Subject: Re: Poor state of some top-level FTP mirrors Message-ID: <20030310070817.GA72834@rot13.obsecurity.org> References: <20030309215448.GB30033@dragon.nuxi.com> <20030310013355.GA70336@rot13.obsecurity.org> <20030310064332.M84136@govital.net> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="YiEDa0DAkWCtVeE4" Content-Disposition: inline In-Reply-To: <20030310064332.M84136@govital.net> User-Agent: Mutt/1.4i Sender: owner-freebsd-hubs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org --YiEDa0DAkWCtVeE4 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline On Mon, Mar 10, 2003 at 01:58:57AM -0500, Chris Demers wrote: > I took a quick look around to find out just how this was being done and i > couldn't find it. So i'm going to do some assuming and make some suggestions. > Assuming a full package build is normally just pushed out for distribution, > this would cause much unneeded bandwidth usage among all of the mirror sites. > Wouldn't it be just better to maybe keep a record of the fingerprint of a > port and if it matched from the last build not send it out to the mirrors so > that only things that have been updated get pushed out? The only problem with > this method is that it would slow down the build system a bit while it checks > the files. Or maybe instead of just blindly building the entire collection > all the time, keep a database of the versions that have been built and only > build the ones that change. There would have to be some extra checking in > there too to make sure that all dependacys affected by a version change of any > port also get rebuilt, but that method would probably work better as the build > system wouldn't have to work as hard all the time to churn out packages for > ports that rarely change. And then just do a full build from time to time to > double check everything. Not really practical..see my other mail. Kris --YiEDa0DAkWCtVeE4 Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.1 (FreeBSD) iD8DBQE+bDnhWry0BWjoQKURAosLAKDYLOwcE974x2lp5Q4btFjzgYE+nACgxg0K mJ58X5rg5XHV6qgo7ex1nB0= =taRQ -----END PGP SIGNATURE----- --YiEDa0DAkWCtVeE4-- To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-hubs" in the body of the message From owner-freebsd-hubs Sun Mar 9 23:26:30 2003 Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 20EC837B401; Sun, 9 Mar 2003 23:26:29 -0800 (PST) Received: from ns1.xcllnt.net (209-128-86-226.BAYAREA.NET [209.128.86.226]) by mx1.FreeBSD.org (Postfix) with ESMTP id A7FAD43FB1; Sun, 9 Mar 2003 23:26:24 -0800 (PST) (envelope-from marcel@xcllnt.net) Received: from athlon.pn.xcllnt.net (athlon.pn.xcllnt.net [192.168.4.3]) by ns1.xcllnt.net (8.12.8/8.12.8) with ESMTP id h2A7QDSd037715; Sun, 9 Mar 2003 23:26:15 -0800 (PST) (envelope-from marcel@piii.pn.xcllnt.net) Received: from athlon.pn.xcllnt.net (localhost [127.0.0.1]) by athlon.pn.xcllnt.net (8.12.8/8.12.8) with ESMTP id h2A7QDvd002369; Sun, 9 Mar 2003 23:26:13 -0800 (PST) (envelope-from marcel@athlon.pn.xcllnt.net) Received: (from marcel@localhost) by athlon.pn.xcllnt.net (8.12.8/8.12.8/Submit) id h2A7QBGg002368; Sun, 9 Mar 2003 23:26:11 -0800 (PST) (envelope-from marcel) Date: Sun, 9 Mar 2003 23:26:11 -0800 From: Marcel Moolenaar To: Chris Demers Cc: jason andrade , Kris Kennaway , "David O'Brien" , hubs@FreeBSD.ORG Subject: Re: Poor state of some top-level FTP mirrors Message-ID: <20030310072611.GB2126@athlon.pn.xcllnt.net> References: <20030309215448.GB30033@dragon.nuxi.com> <20030310013355.GA70336@rot13.obsecurity.org> <20030310064332.M84136@govital.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20030310064332.M84136@govital.net> User-Agent: Mutt/1.5.3i Sender: owner-freebsd-hubs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On Mon, Mar 10, 2003 at 01:58:57AM -0500, Chris Demers wrote: > > I took a quick look around to find out just how this was being done and i > couldn't find it. So i'm going to do some assuming and make some suggestions. > Assuming a full package build is normally just pushed out for distribution, > this would cause much unneeded bandwidth usage among all of the mirror sites. > Wouldn't it be just better to maybe keep a record of the fingerprint of a > port and if it matched from the last build not send it out to the mirrors so > that only things that have been updated get pushed out? Compilers put a timestamp in the object file. Rebuilding from identical sources will yield a different object file. With some wrapping and preprocessor magic, you should be able to compare at the source level. The logic would work something like this: Create a wrapper for cc(1) or c++(1) that runs the compiler as usual, but also runs "cc -E" with the arguments passed to the wrapper. The output of each "cc -E" is appended to a single file (call it port.src). After the build has completed, you compare the current port.src with the previous port.src and if they are equal then build system variation did not affect this port and you can ignore the build. If they are different then there's a possibility that the port is affected (no guarantees), which means you redistribute to be on the safe side. In practice this means that when we branch, bump the FreeBSD version or upgrade the C compiler *all* packages are going to be redistributed. This is what you want. The penalty is minimal if the wrapper does it right (ie run cc -E to a temporary file, append the temporary file to port.src and also use it for the actual compilation). -- Marcel Moolenaar USPA: A-39004 marcel@xcllnt.net To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-hubs" in the body of the message From owner-freebsd-hubs Mon Mar 10 0:59:43 2003 Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 0AB0237B401; Mon, 10 Mar 2003 00:59:43 -0800 (PST) Received: from starbug.ugh.net.au (starbug.ugh.net.au [203.31.238.37]) by mx1.FreeBSD.org (Postfix) with ESMTP id 57A0143FB1; Mon, 10 Mar 2003 00:59:42 -0800 (PST) (envelope-from andrew@ugh.net.au) Received: by starbug.ugh.net.au (Postfix, from userid 1000) id A9E8DA804; Mon, 10 Mar 2003 19:59:42 +1100 (EST) Received: from localhost (localhost [127.0.0.1]) by starbug.ugh.net.au (Postfix) with ESMTP id A6414543F; Mon, 10 Mar 2003 19:59:42 +1100 (EST) Date: Mon, 10 Mar 2003 19:59:42 +1100 (EST) From: Andrew To: Kris Kennaway Cc: jason andrade , David O'Brien , Subject: Re: Poor state of some top-level FTP mirrors In-Reply-To: <20030310015452.GA70681@rot13.obsecurity.org> Message-ID: <20030310195842.A93062-100000@starbug.ugh.net.au> X-WonK: *wibble* MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-freebsd-hubs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On Sun, 9 Mar 2003, Kris Kennaway wrote: > The major difficulty in "only updating packages that have changed" is > identifying those packages. You can't compare the tarballs because Is it safe to use PORTVERSION? You'd still have to catch compiler updates and the like with some other mechanism... Andrew To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-hubs" in the body of the message From owner-freebsd-hubs Mon Mar 10 1:47:22 2003 Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id AB36937B401; Mon, 10 Mar 2003 01:47:20 -0800 (PST) Received: from obsecurity.dyndns.org (adsl-63-207-60-52.dsl.lsan03.pacbell.net [63.207.60.52]) by mx1.FreeBSD.org (Postfix) with ESMTP id 80E7D43FAF; Mon, 10 Mar 2003 01:47:19 -0800 (PST) (envelope-from kris@obsecurity.org) Received: from rot13.obsecurity.org (rot13.obsecurity.org [10.0.0.5]) by obsecurity.dyndns.org (Postfix) with ESMTP id 3878666D16; Mon, 10 Mar 2003 01:47:19 -0800 (PST) Received: by rot13.obsecurity.org (Postfix, from userid 1000) id 18C6A8F9; Mon, 10 Mar 2003 01:47:19 -0800 (PST) Date: Mon, 10 Mar 2003 01:47:19 -0800 From: Kris Kennaway To: Andrew Cc: Kris Kennaway , jason andrade , David O'Brien , hubs@FreeBSD.ORG Subject: Re: Poor state of some top-level FTP mirrors Message-ID: <20030310094719.GB73108@rot13.obsecurity.org> References: <20030310015452.GA70681@rot13.obsecurity.org> <20030310195842.A93062-100000@starbug.ugh.net.au> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="24zk1gE8NUlDmwG9" Content-Disposition: inline In-Reply-To: <20030310195842.A93062-100000@starbug.ugh.net.au> User-Agent: Mutt/1.4i Sender: owner-freebsd-hubs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org --24zk1gE8NUlDmwG9 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Mar 10, 2003 at 07:59:42PM +1100, Andrew wrote: >=20 >=20 > On Sun, 9 Mar 2003, Kris Kennaway wrote: >=20 > > The major difficulty in "only updating packages that have changed" is > > identifying those packages. You can't compare the tarballs because >=20 > Is it safe to use PORTVERSION? You'd still have to catch compiler updates > and the like with some other mechanism... Like I said, it's a lot of extra work and it doesn't buy you much in reality. Packages change too much when you rebuild them from scratch. Kris --24zk1gE8NUlDmwG9 Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.1 (FreeBSD) iD8DBQE+bF8mWry0BWjoQKURAt7bAKDlGR4MglfBY8ZD0RUf50kpcrWmgACg2k12 +I8ryVIryXiarKKiaGATgns= =AgPP -----END PGP SIGNATURE----- --24zk1gE8NUlDmwG9-- To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-hubs" in the body of the message From owner-freebsd-hubs Mon Mar 10 5:16: 3 2003 Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id AD11237B404 for ; Mon, 10 Mar 2003 05:16:02 -0800 (PST) Received: from bast.unixathome.org (bast.unixathome.org [66.11.174.150]) by mx1.FreeBSD.org (Postfix) with ESMTP id 91A9343FB1 for ; Mon, 10 Mar 2003 05:16:01 -0800 (PST) (envelope-from dan@langille.org) Received: from wocker (wocker.unixathome.org [192.168.0.99]) by bast.unixathome.org (Postfix) with ESMTP id 4E7783D29 for ; Mon, 10 Mar 2003 08:17:28 -0500 (EST) From: "Dan Langille" To: hubs@freebsd.org Date: Mon, 10 Mar 2003 08:16:11 -0500 MIME-Version: 1.0 Subject: Re: Poor state of some top-level FTP mirrors Message-ID: <3E6C49CB.18437.F9806C1@localhost> In-reply-to: <20030309215448.GB30033@dragon.nuxi.com> X-mailer: Pegasus Mail for Windows (v4.02a) Content-type: text/plain; charset=US-ASCII Content-transfer-encoding: 7BIT Content-description: Mail message body Sender: owner-freebsd-hubs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On 9 Mar 2003 at 13:54, David O'Brien wrote: > ftp.nz.FreeBSD.org This site doesn't mirror all of the FTP repo because of bandwidth and space constraints. -- Dan Langille : http://www.langille.org/ To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-hubs" in the body of the message From owner-freebsd-hubs Mon Mar 10 7: 3: 3 2003 Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 02F6837B401; Mon, 10 Mar 2003 07:03:02 -0800 (PST) Received: from mail.tcoip.com.br (erato.tco.net.br [200.220.254.10]) by mx1.FreeBSD.org (Postfix) with ESMTP id 0B6A143FA3; Mon, 10 Mar 2003 07:03:00 -0800 (PST) (envelope-from dcs@tcoip.com.br) Received: from tcoip.com.br ([10.0.2.6]) by mail.tcoip.com.br (8.11.6/8.11.6) with ESMTP id h2AF2w932315; Mon, 10 Mar 2003 12:02:58 -0300 Message-ID: <3E6CA922.2060501@tcoip.com.br> Date: Mon, 10 Mar 2003 12:02:58 -0300 From: "Daniel C. Sobral" User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.3b) Gecko/20030214 X-Accept-Language: en-us, en, pt-br, ja MIME-Version: 1.0 To: obrien@FreeBSD.ORG Cc: hubs@FreeBSD.ORG Subject: Re: Poor state of some top-level FTP mirrors References: <20030309215448.GB30033@dragon.nuxi.com> In-Reply-To: <20030309215448.GB30033@dragon.nuxi.com> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Sender: owner-freebsd-hubs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org David O'Brien wrote: > In my never ending quest to find an alternate ftp site for "pkg_add -r", > I've tried many of our ftpX.freebsd.org mirrors. The problem is the > mirrors only seem to be consistent for short periods of time. > > As a simple test, the documented mirrors was polled for the file > ftp://${SITE}/pub/FreeBSD/ports/i386/packages-4-stable/All/bonnie++-1.93.03.tgz > which was updated on ftp.freebsd.org 2-March-2003. > > I am most concerned about ftp1-14.freebsd.org and ftp. as those > are the "top level" mirrors. > > Summary: 53 bad, 25 unknown problem, 57 good. > > Bad sites: > > ftp4.br.FreeBSD.org Not enough space for packages, as much as it pains me. -- Daniel C. Sobral (8-DCS) Gerencia de Operacoes Divisao de Comunicacao de Dados Coordenacao de Seguranca TCO Fones: 55-61-313-7654/Cel: 55-61-9618-0904 E-mail: Daniel.Capo@tco.net.br Daniel.Sobral@tcoip.com.br dcs@tcoip.com.br Outros: dcs@newsguy.com dcs@freebsd.org capo@notorious.bsdconspiracy.net Why don't you fix your little problem... and light this candle? -- Alan Shepherd, the first man into space, Gemini program To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-hubs" in the body of the message From owner-freebsd-hubs Mon Mar 10 7:14:35 2003 Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 19E7737B401; Mon, 10 Mar 2003 07:14:34 -0800 (PST) Received: from visor.qala.com.sg (visor.qala.com.sg [210.193.2.43]) by mx1.FreeBSD.org (Postfix) with ESMTP id 98F9643F85; Mon, 10 Mar 2003 07:14:32 -0800 (PST) (envelope-from mirror-maintainer@mirror.averse.net) Received: from spam.averse.net (mirror [210.193.6.237] (may be forged)) by visor.qala.com.sg (8.11.3/8.11.3) with ESMTP id h2AFESg04563; Mon, 10 Mar 2003 23:14:29 +0800 (SGT) Date: Mon, 10 Mar 2003 23:14:27 +0800 (SGT) From: mirror-maintainer@mirror.averse.net X-X-Sender: pyng@spam.averse.net To: "David O'Brien" Cc: hubs@freebsd.org Subject: Re: Poor state of some top-level FTP mirrors In-Reply-To: <20030309215448.GB30033@dragon.nuxi.com> Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-freebsd-hubs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On Sun, 9 Mar 2003, David O'Brien wrote: > As a simple test, the documented mirrors was polled for the file > ftp://${SITE}/pub/FreeBSD/ports/i386/packages-4-stable/All/bonnie++-1.93.03.tgz > which was updated on ftp.freebsd.org 2-March-2003. > I am most concerned about ftp1-14.freebsd.org and ftp. as those > are the "top level" mirrors. > > Bad sites: > > ftp.sg.FreeBSD.org I sync from ftp.au, so I'll experience the same things as jason does. Fully agree with his view though; syncing freebsd is usually more time consuming than the other sites I mirror. To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-hubs" in the body of the message From owner-freebsd-hubs Mon Mar 10 7:31:37 2003 Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 938A337B401 for ; Mon, 10 Mar 2003 07:31:36 -0800 (PST) Received: from mail.inka.de (quechua.inka.de [193.197.184.2]) by mx1.FreeBSD.org (Postfix) with ESMTP id 6977143F93 for ; Mon, 10 Mar 2003 07:31:35 -0800 (PST) (envelope-from mailnull@mips.inka.de) Received: from kemoauc.mips.inka.de (uucp@) by mail.inka.de with gbsmtp id 18sPFV-00076E-05; Mon, 10 Mar 2003 16:31:33 +0100 Received: from kemoauc.mips.inka.de (localhost [127.0.0.1]) by kemoauc.mips.inka.de (8.12.8/8.12.6) with ESMTP id h2AFL7Z8032662 for ; Mon, 10 Mar 2003 16:21:07 +0100 (CET) (envelope-from mailnull@localhost.mips.inka.de) Received: (from mailnull@localhost) by kemoauc.mips.inka.de (8.12.8/8.12.8/Submit) id h2AFL6g0032661 for freebsd-hubs@freebsd.org; Mon, 10 Mar 2003 16:21:07 +0100 (CET) From: naddy@mips.inka.de (Christian Weisgerber) Subject: Re: Poor state of some top-level FTP mirrors Date: Mon, 10 Mar 2003 15:21:03 +0000 (UTC) Message-ID: References: <20030309215448.GB30033@dragon.nuxi.com> <20030310012937.GA57178@procyon.firepipe.net> Originator: naddy@mips.inka.de (Christian Weisgerber) To: freebsd-hubs@freebsd.org Sender: owner-freebsd-hubs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Will Andrews wrote: > Please tell us how other OS projects update their packages > without this kind of problem. What do they do (or not do) that > we don't (or do)? Accounting for different -stable/-current strategies, OpenBSD does this just the same way as FreeBSD. When I upload a new set of OpenBSD i386 snapshot packages to the master, I wipe the old ones and put the new ones there, all 1.4GB of them. Since all the packages are rebuilt, they will have changed anyway, at a minimum due to the timestamps in the .tgz archives. -- Christian "naddy" Weisgerber naddy@mips.inka.de To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-hubs" in the body of the message From owner-freebsd-hubs Mon Mar 10 8:39: 1 2003 Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id E931437B404 for ; Mon, 10 Mar 2003 08:39:00 -0800 (PST) Received: from dragon.nuxi.com (trang.nuxi.com [66.93.134.19]) by mx1.FreeBSD.org (Postfix) with ESMTP id EC8CA43FD7 for ; Mon, 10 Mar 2003 08:38:59 -0800 (PST) (envelope-from obrien@NUXI.com) Received: from dragon.nuxi.com (smmsp@localhost [127.0.0.1]) by dragon.nuxi.com (8.12.7/8.12.7) with ESMTP id h2AGcudh077137; Mon, 10 Mar 2003 08:38:56 -0800 (PST) (envelope-from obrien@dragon.nuxi.com) Received: (from obrien@localhost) by dragon.nuxi.com (8.12.7/8.12.7/Submit) id h2AGcscZ077136; Mon, 10 Mar 2003 08:38:54 -0800 (PST) Date: Mon, 10 Mar 2003 08:38:54 -0800 From: "David O'Brien" To: Andrew Cc: Kris Kennaway , jason andrade , hubs@FreeBSD.ORG Subject: Re: Poor state of some top-level FTP mirrors Message-ID: <20030310163854.GA77083@dragon.nuxi.com> Reply-To: obrien@FreeBSD.ORG References: <20030310015452.GA70681@rot13.obsecurity.org> <20030310195842.A93062-100000@starbug.ugh.net.au> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20030310195842.A93062-100000@starbug.ugh.net.au> User-Agent: Mutt/1.4i X-Operating-System: FreeBSD 5.0-CURRENT Organization: The NUXI BSD Group X-Pgp-Rsa-Fingerprint: B7 4D 3E E9 11 39 5F A3 90 76 5D 69 58 D9 98 7A X-Pgp-Rsa-Keyid: 1024/34F9F9D5 Sender: owner-freebsd-hubs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On Mon, Mar 10, 2003 at 07:59:42PM +1100, Andrew wrote: > > > On Sun, 9 Mar 2003, Kris Kennaway wrote: > > > The major difficulty in "only updating packages that have changed" is > > identifying those packages. You can't compare the tarballs because > > Is it safe to use PORTVERSION? You'd still have to catch compiler updates > and the like with some other mechanism... Nope. Well maybe, but that isn't just the PORTVERSION of the package you is under consideration, but also of *every* dependancy. To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-hubs" in the body of the message From owner-freebsd-hubs Mon Mar 10 9: 9:28 2003 Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id B032137B401; Mon, 10 Mar 2003 09:09:26 -0800 (PST) Received: from kurush.osdn.org.ua (external.osdn.org.ua [212.40.34.156]) by mx1.FreeBSD.org (Postfix) with ESMTP id 2E1BC43FBD; Mon, 10 Mar 2003 09:09:23 -0800 (PST) (envelope-from never@kurush.osdn.org.ua) Received: from kurush.osdn.org.ua (never@localhost [127.0.0.1]) by kurush.osdn.org.ua (8.12.6/8.12.6) with ESMTP id h2AH8dDE024982; Mon, 10 Mar 2003 19:09:21 +0200 (EET) (envelope-from never@kurush.osdn.org.ua) Received: (from never@localhost) by kurush.osdn.org.ua (8.12.6/8.12.6/Submit) id h2AH8cBC024981; Mon, 10 Mar 2003 19:08:39 +0200 (EET) Date: Mon, 10 Mar 2003 19:08:38 +0200 From: Alexandr Kovalenko To: "David O'Brien" Cc: hubs@FreeBSD.ORG Subject: Re: Poor state of some top-level FTP mirrors Message-ID: <20030310170837.GA21676@nevermind.kiev.ua> References: <20030309215448.GB30033@dragon.nuxi.com> Mime-Version: 1.0 Content-Type: text/plain; charset=koi8-r Content-Disposition: inline In-Reply-To: <20030309215448.GB30033@dragon.nuxi.com> User-Agent: Mutt/1.5.1i Sender: owner-freebsd-hubs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Hello, David O'Brien! On Sun, Mar 09, 2003 at 01:54:48PM -0800, you wrote: > In my never ending quest to find an alternate ftp site for "pkg_add -r", > I've tried many of our ftpX.freebsd.org mirrors. The problem is the > mirrors only seem to be consistent for short periods of time. > > As a simple test, the documented mirrors was polled for the file > ftp://${SITE}/pub/FreeBSD/ports/i386/packages-4-stable/All/bonnie++-1.93.03.tgz > which was updated on ftp.freebsd.org 2-March-2003. > > I am most concerned about ftp1-14.freebsd.org and ftp. as those > are the "top level" mirrors. > > Summary: 53 bad, 25 unknown problem, 57 good. > > Bad sites: > [dd] > ftp.ua.FreeBSD.org [dd] > ftp2.ua.FreeBSD.org Those 2 above actually single site. > Unknown problem: > > ftp5.ua.FreeBSD.org skipped: Net::FTP: Socket is not connected This one only offers access from Ukrain (due to high cost and slowness of outer world link). > Good sites: > > ftp7.br.FreeBSD.org > ftp7.jp.FreeBSD.org > ftp7.kr.FreeBSD.org ftp7.ua.freebsd.org should be in this line. It is being updated hourly from ftp-master.cz.freebsd.org (the .eu regional ftp-master for now). -- NEVE-RIPE, will build world for food Ukrainian FreeBSD User Group http://uafug.org.ua/ To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-hubs" in the body of the message From owner-freebsd-hubs Mon Mar 10 11:51:15 2003 Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id E9DE237B404; Mon, 10 Mar 2003 11:51:14 -0800 (PST) Received: from khavrinen.lcs.mit.edu (khavrinen.lcs.mit.edu [18.24.4.193]) by mx1.FreeBSD.org (Postfix) with ESMTP id E3A2743FCB; Mon, 10 Mar 2003 11:51:11 -0800 (PST) (envelope-from wollman@khavrinen.lcs.mit.edu) Received: from khavrinen.lcs.mit.edu (localhost.ipv6.lcs.mit.edu [IPv6:::1]) by khavrinen.lcs.mit.edu (8.12.8/8.12.8) with ESMTP id h2AJpACd054672 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK); Mon, 10 Mar 2003 14:51:10 -0500 (EST) (envelope-from wollman@khavrinen.lcs.mit.edu) Received: (from wollman@localhost) by khavrinen.lcs.mit.edu (8.12.8/8.12.8/Submit) id h2AJpALN054669; Mon, 10 Mar 2003 14:51:10 -0500 (EST) (envelope-from wollman) Date: Mon, 10 Mar 2003 14:51:10 -0500 (EST) From: Garrett Wollman Message-Id: <200303101951.h2AJpALN054669@khavrinen.lcs.mit.edu> To: obrien@FreeBSD.ORG Cc: hubs@FreeBSD.ORG Subject: Re: Poor state of some top-level FTP mirrors In-Reply-To: <20030310163854.GA77083@dragon.nuxi.com> References: <20030310015452.GA70681@rot13.obsecurity.org> <20030310195842.A93062-100000@starbug.ugh.net.au> <20030310163854.GA77083@dragon.nuxi.com> Sender: owner-freebsd-hubs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org < said: > Nope. Well maybe, but that isn't just the PORTVERSION of the package you > is under consideration, but also of *every* dependancy. So diff the old and new INDEX files, and that should give the list of all the packages that have meaningfully changed. -GAWollman To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-hubs" in the body of the message From owner-freebsd-hubs Wed Mar 12 23:33:45 2003 Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id BDDD137B404 for ; Wed, 12 Mar 2003 23:33:43 -0800 (PST) Received: from hotmail.com (f45.law12.hotmail.com [64.4.19.45]) by mx1.FreeBSD.org (Postfix) with ESMTP id 2680B43FE0 for ; Wed, 12 Mar 2003 23:33:43 -0800 (PST) (envelope-from ddgirl289@hotmail.com) Received: from mail pickup service by hotmail.com with Microsoft SMTPSVC; Wed, 12 Mar 2003 23:33:42 -0800 Received: from 211.189.26.142 by lw12fd.law12.hotmail.msn.com with HTTP; Thu, 13 Mar 2003 07:33:42 GMT X-Originating-IP: [211.189.26.142] From: "Dduk Girl" To: hubs@edunet4u.net Subject: =?ks_c_5601-1987?B?yK3BpsDHILHXIL/lxcEgvL29ur7AfiE=?= Date: Thu, 13 Mar 2003 16:33:42 +0900 Mime-Version: 1.0 Content-Type: text/html; charset=ks_c_5601-1987 Message-ID: X-OriginalArrivalTime: 13 Mar 2003 07:33:42.0946 (UTC) FILETIME=[DFA36820:01C2E932] Sender: owner-freebsd-hubs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org ÁøÂ¥ ¿Ü±¹ Æ÷¸£³ë »çÀÌÆ®ÀÔ´Ï´Ù. ¹Ì¼º³âÀÚ Àý´ë°ü¶÷ºÒ°¡!!
ÇöÀç º¸½Ã´Â »çÀÌÆ®´Â ¿ÏÀü ¿Ü±¹ Æ÷¸£³ë »çÀÌÆ®ÀÔ´Ï´Ù. ¹Ì¼º³âÀÚ´Â Àý´ëÃâÀÔÀ»
±ÝÇϸç ÀÌ·± »çÀÌÆ®¿¡ Çø¿À°¨ÀÌ ÀÖÀ¸½Å ºÐÀº ¹Ù·Î »èÁ¦ÇÏ¿© ÁֽʽÿÀ.

´õ ÀÌ»ó ¸»ÀÌ ÇÊ¿ä ¾ø½À´Ï´Ù. ÀÏ´Ü Å¬¸¯Çϼ¼¿ä. »õ·Î¿î »õ»óÀÌ ÆîÃÄÁý´Ï´Ù.

º» À¥»çÀÌÆ®´Â ÀÎÅÍ³Ý ¼ºÀÎ Àü¹® Æ÷¸£³ë »çÀÌÆ®·Î, ¹ýÀûÀ¸·Î ÀÌ·¯ÇÑ ³»¿ëÀ» ¿­¶÷ÇÒ ¼ö ¾ø´Â ¸¸ 20¼¼ÀÇ ¿¬·É ¹Ì¸¸À̳ª ÀÌ¿Í°°Àº À½¶õÇÑ ³»¿ë¿¡ °ÅºÎ°¨À» °®´Â »ç¶÷µéÀº ÀÔÀåÀ» ±ÝÇÕ´Ï´Ù.
¶ÇÇÑ º» »çÀÌÆ®´Â ¹ýÀûÀ¸·Î ÀÎÅͳݿ¡¼­ À½¶õ¹°À» Àü¼ÛÇÏ´Â °ÍÀÌ ±ÝÁöµÈ Áö¿ªÀ̳ª ±¹°¡¸¦ ´ë»óÀ¸·Î ÇÏ´Â ¼­ºñ½º°¡ ¾Æ´ÔÀ» ¹àÈü´Ï´Ù. À§ÀÇ »çÇ׿¡ µ¿ÀÇÇÏÁö ¾Ê´Â´Ù¸é Àý´ë·Î µé¾î¿ÀÁö ¸¶½Ê½Ã¿À.

This web site contains sexually oriented adult material which is not suitable for those who are under the age of 20. If you are under the age of 20 or find material of an adult nature offensive, or if you are accessing this site from a country where adult material is specifically prohibited by law, please leave this site immediately. By entering this web page you are acknowledging that you are in fact 20 years of age or older, and therefore we will hold no responsibility for any adult material you find on this web site. All models on this site are 20 years of age or older. We do not promote violent, malignant, or child pornography. If you understand and accept these terms you may enter.



»óÅ­ÇÑ ¸¸³²°ú µû¶æÇÑ °øµ¿Ã¼ »ýÈ°... Áö±Ý MSN Ä¿¹Â´ÏƼ ¿¡¼­ ½ÃÀÛÇϼ¼¿ä! To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-hubs" in the body of the message From owner-freebsd-hubs Thu Mar 13 7:24:12 2003 Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id A168137B401; Thu, 13 Mar 2003 07:24:11 -0800 (PST) Received: from kurush.osdn.org.ua (external.osdn.org.ua [212.40.34.156]) by mx1.FreeBSD.org (Postfix) with ESMTP id 8552743F3F; Thu, 13 Mar 2003 07:24:09 -0800 (PST) (envelope-from never@kurush.osdn.org.ua) Received: from kurush.osdn.org.ua (never@localhost [127.0.0.1]) by kurush.osdn.org.ua (8.12.6/8.12.6) with ESMTP id h2DFNVDE097924; Thu, 13 Mar 2003 17:24:01 +0200 (EET) (envelope-from never@kurush.osdn.org.ua) Received: (from never@localhost) by kurush.osdn.org.ua (8.12.6/8.12.6/Submit) id h2DFNVZq097923; Thu, 13 Mar 2003 17:23:31 +0200 (EET) Date: Thu, 13 Mar 2003 17:21:37 +0200 From: Alexandr Kovalenko To: freebsd-hubs@freebsd.org Cc: freebsd-doc@freebsd.org Subject: en_US/books/handbook/book.pd* b0rken Message-ID: <20030313152137.GA97343@nevermind.kiev.ua> Mime-Version: 1.0 Content-Type: text/plain; charset=koi8-r Content-Disposition: inline User-Agent: Mutt/1.5.1i Sender: owner-freebsd-hubs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Looks like pdf version of handbook on ftp-master b0rken: $ pwd /pub/FreeBSD/doc/en_US.ISO8859-1/books/handbook $ ls -la book.pdf.* -r--r--r-- 1 91 maildrop 275 Mar 11 08:04 book.pdf.bz2 -r--r--r-- 1 91 maildrop 232 Mar 11 08:04 book.pdf.gz -r--r--r-- 1 91 maildrop 362 Mar 11 08:04 book.pdf.zip -- NEVE-RIPE, will build world for food Ukrainian FreeBSD User Group http://uafug.org.ua/ To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-hubs" in the body of the message From owner-freebsd-hubs Fri Mar 14 7:50: 9 2003 Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 1DF4837B401 for ; Fri, 14 Mar 2003 07:50:08 -0800 (PST) Received: from daemon.uop.edu (daemon.uop.edu [138.9.200.11]) by mx1.FreeBSD.org (Postfix) with ESMTP id 7BFFB43F93 for ; Fri, 14 Mar 2003 07:50:07 -0800 (PST) (envelope-from wfroning@uop.edu) Received: from daemon (localhost [127.0.0.1]) by daemon.uop.edu (8.12.8/8.12.8) with SMTP id h2EFoGcl049349 for ; Fri, 14 Mar 2003 07:50:16 -0800 (PST) (envelope-from wfroning@uop.edu) Date: Fri, 14 Mar 2003 07:50:16 -0800 From: Will Froning To: freebsd-hubs@freebsd.org Subject: Connection refused for cvsup Message-Id: <20030314075016.4411520e.wfroning@uop.edu> Organization: OISR, University of the Pacific X-Mailer: Sylpheed version 0.8.10 (GTK+ 1.2.10; i386-portbld-freebsd4.7) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Sender: owner-freebsd-hubs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Not sure if this is the correct place to ask, so sorry if it isn't. I've noticed that sometime this week my local cvsup mirror for my University stopped updating. After trying all the USA hosts I still have no joy. It seems that 138.9/16 has been blacklisted, or is that not done? If we aren't BL'd, then I'll get to have a talk with those networking guys (always messing with stuff). Thanks for any help on this, and please CC me on the reply. Will -- Will Froning Unix Sys. Admin. University of the Pacific wfroning@uop.edu To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-hubs" in the body of the message From owner-freebsd-hubs Fri Mar 14 12:51:57 2003 Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id A2C4037B401 for ; Fri, 14 Mar 2003 12:51:56 -0800 (PST) Received: from srv1.cosmo-project.de (srv1.cosmo-project.de [213.83.6.106]) by mx1.FreeBSD.org (Postfix) with ESMTP id 44AAA43FD7 for ; Fri, 14 Mar 2003 12:51:55 -0800 (PST) (envelope-from ticso@cicely9.cicely.de) Received: from cicely5.cicely.de (cicely5.cicely.de [IPv6:3ffe:400:8d0:301:200:92ff:fe9b:20e7]) by srv1.cosmo-project.de (8.12.8/8.12.8) with ESMTP id h2EKphgt099889 (version=TLSv1/SSLv3 cipher=EDH-RSA-DES-CBC3-SHA bits=168 verify=OK); Fri, 14 Mar 2003 21:51:50 +0100 (CET) (envelope-from ticso@cicely9.cicely.de) Received: from cicely9.cicely.de (cicely9.cicely.de [IPv6:3ffe:400:8d0:301:210:5aff:fe30:1c1a]) by cicely5.cicely.de (8.12.8/8.12.8) with ESMTP id h2EKperf031819 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Fri, 14 Mar 2003 21:51:42 +0100 (CET) (envelope-from ticso@cicely9.cicely.de) Received: from cicely9.cicely.de (localhost [127.0.0.1]) by cicely9.cicely.de (8.12.8/8.12.8) with ESMTP id h2EKpXkv085044; Fri, 14 Mar 2003 21:51:39 +0100 (CET) (envelope-from ticso@cicely9.cicely.de) Received: (from ticso@localhost) by cicely9.cicely.de (8.12.8/8.12.8/Submit) id h2EKpVTt085043; Fri, 14 Mar 2003 21:51:31 +0100 (CET) Date: Fri, 14 Mar 2003 21:51:30 +0100 From: Bernd Walter To: Will Froning Cc: freebsd-hubs@FreeBSD.ORG Subject: Re: Connection refused for cvsup Message-ID: <20030314205129.GJ83455@cicely9.cicely.de> Reply-To: ticso@cicely.de References: <20030314075016.4411520e.wfroning@uop.edu> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20030314075016.4411520e.wfroning@uop.edu> X-Operating-System: FreeBSD cicely9.cicely.de 5.0-CURRENT alpha User-Agent: Mutt/1.5.3i Sender: owner-freebsd-hubs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On Fri, Mar 14, 2003 at 07:50:16AM -0800, Will Froning wrote: > Not sure if this is the correct place to ask, so sorry if it isn't. > > I've noticed that sometime this week my local cvsup mirror for my > University stopped updating. After trying all the USA hosts I still > have no joy. > > It seems that 138.9/16 has been blacklisted, or is that not done? If > we aren't BL'd, then I'll get to have a talk with those networking guys > (always messing with stuff). There are no centralised access lists. It's more likely that a missconfigured local firewall drops your connect. -- B.Walter BWCT http://www.bwct.de ticso@bwct.de info@bwct.de To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-hubs" in the body of the message From owner-freebsd-hubs Fri Mar 14 12:59: 4 2003 Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id E148637B401 for ; Fri, 14 Mar 2003 12:59:02 -0800 (PST) Received: from coe.ufrj.br (roma.coe.ufrj.br [146.164.53.65]) by mx1.FreeBSD.org (Postfix) with ESMTP id 8C2C243FB1 for ; Fri, 14 Mar 2003 12:59:01 -0800 (PST) (envelope-from jonny@jonny.eng.br) Received: by coe.ufrj.br (Postfix, from userid 2000) id CE7A4D901A; Fri, 14 Mar 2003 17:58:37 -0300 (BRT) Date: Fri, 14 Mar 2003 17:58:37 -0300 To: ticso@cicely.de Cc: Will Froning , freebsd-hubs@FreeBSD.ORG Subject: Re: Connection refused for cvsup Message-ID: <20030314205837.GK70594@roma.coe.ufrj.br> References: <20030314075016.4411520e.wfroning@uop.edu> <20030314205129.GJ83455@cicely9.cicely.de> Mime-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <20030314205129.GJ83455@cicely9.cicely.de> User-Agent: Mutt/1.4i X-Quote: What are you looking for in my mail headers ? X-Operating-System: FreeBSD X-URL: http://www.jonny.eng.br From: jonny@jonny.eng.br (Joao Carlos Mendes Luis) Sender: owner-freebsd-hubs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Somebody told me that Bernd Walter said: > On Fri, Mar 14, 2003 at 07:50:16AM -0800, Will Froning wrote: > > Not sure if this is the correct place to ask, so sorry if it isn't. > > > > I've noticed that sometime this week my local cvsup mirror for my > > University stopped updating. After trying all the USA hosts I still > > have no joy. > > > > It seems that 138.9/16 has been blacklisted, or is that not done? If > > we aren't BL'd, then I'll get to have a talk with those networking guys > > (always messing with stuff). > > There are no centralised access lists. > It's more likely that a missconfigured local firewall drops your > connect. Try passive mode, -P - But if the default does not work, I really doubt this would work also. Try to check the local firewall access to external TCP port 5999... Jonny -- João Carlos Mendes Luís jonny@jonny.eng.br Networking Engineer jonny@coe.ufrj.br To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-hubs" in the body of the message