From owner-freebsd-hubs@FreeBSD.ORG Tue Feb 21 02:39:27 2012 Return-Path: Delivered-To: hubs@FreeBSD.org Received: from hub.freebsd.org (hub.freebsd.org [IPv6:2001:4f8:fff6::36]) by hub.freebsd.org (Postfix) with ESMTP id 14514106566C; Tue, 21 Feb 2012 02:39:26 +0000 (UTC) (envelope-from tabthorpe@FreeBSD.org) Date: Mon, 20 Feb 2012 21:39:26 -0500 From: Thomas Abthorpe To: hubs@FreeBSD.org Message-ID: <20120221023926.GA20266@hub.freebsd.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="fdj2RfSjLxBAspz7" Content-Disposition: inline X-URL: http://www.goodking.org/ X-PGP-Key: http://people.freebsd.org/~tabthorpe/tabthorpe.asc X-PGP-Key-ID: 0xA473C990 X-PGP-Key-Fingerprint: D883 2D7C EB78 944A 69FC 36A6 D937 1097 A473 C990 User-Agent: Mutt/1.5.21 (2010-09-15) Cc: Subject: Query about the usage of FreeBSD mirror sites for other projects X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: "FreeBSD Distributions Hubs: mail sup ftp" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 21 Feb 2012 02:39:27 -0000 --fdj2RfSjLxBAspz7 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Greetings mirror maintainers and others. Recently, a question came up within our community, should we be using other project sites for distfile fetching? Sites like Debian and Gentoo mirror many of the tarballs we use for our ports. I engaged the infrastructure people and the mirror maintainers at the Debian and Gentoo projects, and the answer was simply yes, feel free to use them for your purposes, basically use but don't abuse it, standard rules of the sandbox :) Which now rather begs to ask the question, what is the opinion of our mirror maintainers? How do you feel about non-FreeBSD projects using our resources? Our community supports and sponsors some of these sites, should others be allowed to use them? Please feel free to reply publicly, and private emails directly to me will be held in the strictist of confidence. I am curious to see how our people feel on the matter. Thanks for your time and attention to this matter. Thomas --=20 Thomas Abthorpe | FreeBSD Committer tabthorpe@FreeBSD.org | http://people.freebsd.org/~tabthorpe --fdj2RfSjLxBAspz7 Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.18 (FreeBSD) iQEcBAEBAgAGBQJPQwPeAAoJENk3EJekc8mQ9PEIAKn3FFd69E2aUCMhy6XT9Bcu j3JohFcDo6Kjhey79PkAvn2FQazhz9rMNqZuE1rtRXrYqO6yKlZYUp6lfFDfGpge e4CUcOtnQEfw7ncab+77xkQbK6cUjyl0KQOj1bwkO04fTUgPy6Oi1AZeRMKuH60b XprxO9qg9QgpSewiMbAsmz0fOOKTOCX6zpBmzJX2k+dQm/OU8tm+WF2k1LrkCi/U Wbx8PubC4iMHkjyHr7+IeRqikEZs3+96UkoD0GjI/kSlNfgELmFnj+o/zf/933Vq FEUFlIGxogvRjcdgw6NSuTcIks5CmEqfc9ijSH7x6Ag1ekeAkJwCmYUGf9XigwY= =YL8c -----END PGP SIGNATURE----- --fdj2RfSjLxBAspz7-- From owner-freebsd-hubs@FreeBSD.ORG Tue Feb 21 14:00:10 2012 Return-Path: Delivered-To: hubs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id EFD81106566C; Tue, 21 Feb 2012 14:00:08 +0000 (UTC) (envelope-from pfmeec@rit.edu) Received: from sc3app27.rit.edu (sc3app27.rit.edu [129.21.35.56]) by mx1.freebsd.org (Postfix) with ESMTP id A93E68FC0C; Tue, 21 Feb 2012 14:00:08 +0000 (UTC) Received: from ex02ht01b.ad.rit.edu (ex02ht01b.ad.rit.edu [10.12.2.4]) by smtp-server.rit.edu (PMDF V6.3-x14 #31420) with ESMTPS id <0LZQ006XTWD3DW@smtp-server.rit.edu>; Tue, 21 Feb 2012 08:34:15 -0500 (EST) Received: from ex02mail02.ad.rit.edu ([10.12.2.2]) by ex02ht01b.ad.rit.edu ([10.12.2.4]) with mapi; Tue, 21 Feb 2012 08:34:14 -0500 Date: Tue, 21 Feb 2012 08:34:13 -0500 From: Paul Mezzanini In-reply-to: <20120221023926.GA20266@hub.freebsd.org> To: "hubs@FreeBSD.org" Message-id: MIME-version: 1.0 Content-type: text/plain; charset=us-ascii Content-language: en-US Content-transfer-encoding: quoted-printable Thread-Topic: Query about the usage of FreeBSD mirror sites for other projects Thread-Index: AczwnYCqZa2UvceSQ1Gdf5oYnSazWQ== Accept-Language: en-US user-agent: Microsoft-MacOutlook/14.14.0.111121 acceptlanguage: en-US X-RIT-Received-From: 10.12.2.4 X-MS-Has-Attach: X-MS-TNEF-Correlator: x-tm-as-product-ver: SMEX-10.0.0.4211-6.800.1017-18722.007 x-tm-as-result: No--52.157100-8.000000-31 x-tm-as-user-approved-sender: No x-tm-as-user-blocked-sender: No Cc: Thomas Abthorpe Subject: Re: Query about the usage of FreeBSD mirror sites for other projects X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: "FreeBSD Distributions Hubs: mail sup ftp" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 21 Feb 2012 14:00:10 -0000 Personally, I mirror all of the mentioned projects and more. I don't mind if we "cross the streams" but it would mess up when I run stats on my log files. A very minor issue for me but it may mess up other mirror setups. The real issue is what if FreeBSD relies on a package that Gentoo has in the mirror structure and then Gentoo prunes it out. (Examples only, feel free to change the project names to any that fit your mental model) I wonder how useful a setup would be that is just a giant bucket for all project to pull from. It has the potential to be great but also horrible. If hardlinking was used across the whole tree then each project could have its own directory hardlinked across each other. Each project could then add and delete from their own tree without worry about destroying a dependency somewhere else. I'm going to run a hardlink.py dry run on my whole mirror to see what the potential savings will be. I'm betting it will actually be fairly low. -paul (aka mirrors.rit.edu) On 2/20/12 9:39 PM, "Thomas Abthorpe" wrote: >Greetings mirror maintainers and others. > >Recently, a question came up within our community, should we be using >other project sites for distfile fetching? Sites like Debian and Gentoo >mirror many of the tarballs we use for our ports. > >I engaged the infrastructure people and the mirror maintainers at the >Debian and Gentoo projects, and the answer was simply yes, feel free to >use them for your purposes, basically use but don't abuse it, standard >rules of the sandbox :) > >Which now rather begs to ask the question, what is the opinion of our >mirror maintainers? How do you feel about non-FreeBSD projects using >our resources? Our community supports and sponsors some of these sites, >should others be allowed to use them? > >Please feel free to reply publicly, and private emails directly to me >will be held in the strictist of confidence. > >I am curious to see how our people feel on the matter. > >Thanks for your time and attention to this matter. > > >Thomas > >--=20 >Thomas Abthorpe | FreeBSD Committer >tabthorpe@FreeBSD.org | http://people.freebsd.org/~tabthorpe From owner-freebsd-hubs@FreeBSD.ORG Tue Feb 21 14:12:58 2012 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 6F1C6106564A for ; Tue, 21 Feb 2012 14:12:57 +0000 (UTC) (envelope-from fabian@wenks.ch) Received: from batman.home4u.ch (batman.home4u.ch [IPv6:2001:8a8:1005:1::2]) by mx1.freebsd.org (Postfix) with ESMTP id 05D7A8FC14 for ; Tue, 21 Feb 2012 14:12:56 +0000 (UTC) X-Virus-Scanned: amavisd-new at home4u.ch Received: from flashback.wenks.ch (fabian@flashback.wenks.ch [62.12.173.4]) (authenticated bits=0) by batman.home4u.ch (8.14.4/8.14.4) with ESMTP id q1LECsvK074447 (version=TLSv1/SSLv3 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO) for ; Tue, 21 Feb 2012 15:12:55 +0100 (CET) (envelope-from fabian@wenks.ch) Message-ID: <4F43A666.4050107@wenks.ch> Date: Tue, 21 Feb 2012 15:12:54 +0100 From: Fabian Wenk User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:10.0.2) Gecko/20120216 Thunderbird/10.0.2 MIME-Version: 1.0 To: freebsd-hubs@freebsd.org References: <20120221023926.GA20266@hub.freebsd.org> In-Reply-To: <20120221023926.GA20266@hub.freebsd.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Subject: Re: Query about the usage of FreeBSD mirror sites for other projects X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: "FreeBSD Distributions Hubs: mail sup ftp" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 21 Feb 2012 14:12:58 -0000 Hello Thomas On 21.02.2012 03:39, Thomas Abthorpe wrote: > Recently, a question came up within our community, should we be using > other project sites for distfile fetching? Sites like Debian and Gentoo > mirror many of the tarballs we use for our ports. For my local FreeBSD and Gentoo servers I use a shared distfiles folder over NFS. All systems are allowed to save new downloads, and if the file already exists, they are using it instead of downloading. As far as I see it, in the FreeBSD distfiles there are also sub directories, where Gentoo does not use sub directories. I did a quick check with sysutils/fdupes and there are a few files which are saved at two different locations. On my systems the following projects are affected from this: Perl, Ruby, Apache and Gnome The files with root:wheel have been downloaded from FreeBSD Ports, and the files with portage:portage from Gentoo (sorry for the line wraps): # cd /usr/ports/distfiles # find . -name perl-5.12.4.tar.bz2 -ls 329842 24160 -rw-r--r-- 1 root wheel 12350353 Jun 20 2011 ./perl/perl-5.12.4.tar.bz2 237981 24160 -rw-rw-r-- 1 portage portage 12350353 Nov 10 2010 ./perl-5.12.4.tar.bz2 # find . -name ruby-1.8.7-p352.tar.bz2 -ls 237747 8256 -rw-r--r-- 1 root wheel 4207576 Jul 2 2011 ./ruby/ruby-1.8.7-p352.tar.bz2 237991 8256 -rw-rw-r-- 1 portage portage 4207576 Jul 2 2011 ./ruby-1.8.7-p352.tar.bz2 # find . -name httpd-2.2.21.tar.bz2 -ls 282742 10464 -rw-r--r-- 1 root wheel 5324905 Sep 12 19:02 ./apache22/httpd-2.2.21.tar.bz2 237936 10464 -rw-rw-r-- 1 portage portage 5324905 Sep 15 11:50 ./httpd-2.2.21.tar.bz2 # find . -name glib-2.28.8.tar.xz -ls 259229 10240 -rw-r--r-- 1 root wheel 5223564 Jun 6 2011 ./gnome2/glib-2.28.8.tar.xz 237741 10240 -rw-rw-r-- 1 portage portage 5223564 Jun 6 2011 ./glib-2.28.8.tar.xz As far as I see it, it is the same structure on the mirror servers too. So I guess to really be able to use each others mirrors, some adjustments are needed either in Ports (FreeBSD) or in Portage (Gentoo). Else some of the downloads will fail or use the fall back download source. bye Fabian From owner-freebsd-hubs@FreeBSD.ORG Tue Feb 21 15:29:59 2012 Return-Path: Delivered-To: hubs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 2B31F106566B; Tue, 21 Feb 2012 15:29:59 +0000 (UTC) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (lurza.secnetix.de [IPv6:2a01:170:102f::2]) by mx1.freebsd.org (Postfix) with ESMTP id 68B358FC15; Tue, 21 Feb 2012 15:29:58 +0000 (UTC) Received: from lurza.secnetix.de (localhost [127.0.0.1]) by lurza.secnetix.de (8.14.3/8.14.3) with ESMTP id q1LFTeMg033737; Tue, 21 Feb 2012 16:29:55 +0100 (CET) (envelope-from oliver.fromme@secnetix.de) Received: (from olli@localhost) by lurza.secnetix.de (8.14.3/8.14.3/Submit) id q1LFTeSd033735; Tue, 21 Feb 2012 16:29:40 +0100 (CET) (envelope-from olli) From: Oliver Fromme Message-Id: <201202211529.q1LFTeSd033735@lurza.secnetix.de> To: pfmeec@rit.edu (Paul Mezzanini) Date: Tue, 21 Feb 2012 16:29:40 +0100 (CET) In-Reply-To: X-Mailer: ELM [version 2.5 PL8] MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 8bit X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.3.9 (lurza.secnetix.de [127.0.0.1]); Tue, 21 Feb 2012 16:29:56 +0100 (CET) Cc: "hubs@FreeBSD.org" Subject: Re: Query about the usage of FreeBSD mirror sites for other projects X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: "FreeBSD Distributions Hubs: mail sup ftp" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 21 Feb 2012 15:29:59 -0000 Paul Mezzanini wrote: > The real issue is what if FreeBSD relies on a package that Gentoo has in > the mirror structure and then Gentoo prunes it out. (Examples only, feel > free to change the project names to any that fit your mental model) > > I wonder how useful a setup would be that is just a giant bucket for all > project to pull from. It has the potential to be great but also horrible. Ultimately, it would be cool to have a more flexible and dynamic system for distfiles. Clients wouldn't download directly from certain FTP mirrors anymore, but they would contact an "index server". The index servers maintain a list of locations where each distfile can be found, similar to a very specialized search engine. These locations can be FreeBSD mirrors or mirrors of other projects (Debian, Gentoo, whatever) or just random sites anywhere on the internet. The "MASTER_SITES" information currently contained in the ports' Makefiles will be moved to the index servers. Either the index server returns a list of locations back to the client (just like a search engine), so the client can choose to download from one of them. Or, alternatively, the index server also acts as a proxy, so it fetches the distfile from one of the known locations and hands it to the client. In this case it might also make sense to cache the distfiles on the index server for a limited time (depending on how often this file is requested, or its size). I'm aware that such a system would require quite some work. It's just an idea that came to my mind, but maybe it's worth further investigation. Maybe it should get an entry on FreeBSD's "project ideas" page. Best regards Oliver -- Oliver Fromme, secnetix GmbH & Co. KG, Marktplatz 29, 85567 Grafing b. M. Handelsregister: Registergericht Muenchen, HRA 74606, Geschäftsfuehrung: secnetix Verwaltungsgesellsch. mbH, Handelsregister: Registergericht Mün- chen, HRB 125758, Geschäftsführer: Maik Bachmann, Olaf Erb, Ralf Gebhart FreeBSD-Dienstleistungen, -Produkte und mehr: http://www.secnetix.de/bsd "The ITU has offered the IETF formal alignment with its corresponding technology, Penguins, but that won't fly." -- RFC 2549 From owner-freebsd-hubs@FreeBSD.ORG Tue Feb 21 16:23:41 2012 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1D0EC106564A for ; Tue, 21 Feb 2012 16:23:41 +0000 (UTC) (envelope-from fabian@wenks.ch) Received: from batman.home4u.ch (batman.home4u.ch [IPv6:2001:8a8:1005:1::2]) by mx1.freebsd.org (Postfix) with ESMTP id A8F1A8FC14 for ; Tue, 21 Feb 2012 16:23:40 +0000 (UTC) X-Virus-Scanned: amavisd-new at home4u.ch Received: from flashback.wenks.ch (fabian@flashback.wenks.ch [62.12.173.4]) (authenticated bits=0) by batman.home4u.ch (8.14.4/8.14.4) with ESMTP id q1LGNb3L084647 (version=TLSv1/SSLv3 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO) for ; Tue, 21 Feb 2012 17:23:38 +0100 (CET) (envelope-from fabian@wenks.ch) Message-ID: <4F43C508.2090005@wenks.ch> Date: Tue, 21 Feb 2012 17:23:36 +0100 From: Fabian Wenk User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:10.0.2) Gecko/20120216 Thunderbird/10.0.2 MIME-Version: 1.0 To: freebsd-hubs@freebsd.org References: <201202211529.q1LFTeSd033735@lurza.secnetix.de> In-Reply-To: <201202211529.q1LFTeSd033735@lurza.secnetix.de> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Subject: Re: Query about the usage of FreeBSD mirror sites for other projects X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: "FreeBSD Distributions Hubs: mail sup ftp" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 21 Feb 2012 16:23:41 -0000 Hello Oliver On 21.02.2012 16:29, Oliver Fromme wrote: > Ultimately, it would be cool to have a more flexible and > dynamic system for distfiles. > > Clients wouldn't download directly from certain FTP mirrors > anymore, but they would contact an "index server". The index > servers maintain a list of locations where each distfile can > be found, similar to a very specialized search engine. These > locations can be FreeBSD mirrors or mirrors of other projects > (Debian, Gentoo, whatever) or just random sites anywhere on > the internet. The "MASTER_SITES" information currently I really like it, that I can download from a mirror which is near on the network, as it is much faster then from anywhere else on the internet. So random distribution will just generate more global network traffic, which is often more costly (for the ISPs) then local traffic with free peering between regional ISPs. > I'm aware that such a system would require quite some work. > It's just an idea that came to my mind, but maybe it's worth > further investigation. Maybe it should get an entry on > FreeBSD's "project ideas" page. Eventually doing something with regional reverse caching proxy, which is able to get missing files in the background from the master. Subsequent request will then be served from the local cache. bye Fabian From owner-freebsd-hubs@FreeBSD.ORG Tue Feb 21 18:05:21 2012 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7D81D106566B for ; Tue, 21 Feb 2012 18:05:21 +0000 (UTC) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (lurza.secnetix.de [IPv6:2a01:170:102f::2]) by mx1.freebsd.org (Postfix) with ESMTP id F1FE58FC14 for ; Tue, 21 Feb 2012 18:05:20 +0000 (UTC) Received: from lurza.secnetix.de (localhost [127.0.0.1]) by lurza.secnetix.de (8.14.3/8.14.3) with ESMTP id q1LI54T8039779; Tue, 21 Feb 2012 19:05:19 +0100 (CET) (envelope-from oliver.fromme@secnetix.de) Received: (from olli@localhost) by lurza.secnetix.de (8.14.3/8.14.3/Submit) id q1LI54qJ039777; Tue, 21 Feb 2012 19:05:04 +0100 (CET) (envelope-from olli) From: Oliver Fromme Message-Id: <201202211805.q1LI54qJ039777@lurza.secnetix.de> To: fabian@wenks.ch (Fabian Wenk) Date: Tue, 21 Feb 2012 19:05:04 +0100 (CET) In-Reply-To: <4F43C508.2090005@wenks.ch> X-Mailer: ELM [version 2.5 PL8] MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 8bit X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.3.9 (lurza.secnetix.de [127.0.0.1]); Tue, 21 Feb 2012 19:05:19 +0100 (CET) Cc: freebsd-hubs@freebsd.org Subject: Re: Query about the usage of FreeBSD mirror sites for other projects X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: "FreeBSD Distributions Hubs: mail sup ftp" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 21 Feb 2012 18:05:21 -0000 Fabian Wenk wrote: > On 21.02.2012 16:29, Oliver Fromme wrote: > > Ultimately, it would be cool to have a more flexible and > > dynamic system for distfiles. > > > > Clients wouldn't download directly from certain FTP mirrors > > anymore, but they would contact an "index server". The index > > servers maintain a list of locations where each distfile can > > be found, similar to a very specialized search engine. These > > locations can be FreeBSD mirrors or mirrors of other projects > > (Debian, Gentoo, whatever) or just random sites anywhere on > > the internet. The "MASTER_SITES" information currently > > I really like it, that I can download from a mirror which is near > on the network, as it is much faster then from anywhere else on > the internet. The index server / proxy system that I suggested would also allow that, of course. Best regards Oliver -- Oliver Fromme, secnetix GmbH & Co. KG, Marktplatz 29, 85567 Grafing b. M. Handelsregister: Registergericht Muenchen, HRA 74606, Geschäftsfuehrung: secnetix Verwaltungsgesellsch. mbH, Handelsregister: Registergericht Mün- chen, HRB 125758, Geschäftsführer: Maik Bachmann, Olaf Erb, Ralf Gebhart FreeBSD-Dienstleistungen, -Produkte und mehr: http://www.secnetix.de/bsd $ dd if=/dev/urandom of=test.pl count=1 $ file test.pl test.pl: perl script text executable From owner-freebsd-hubs@FreeBSD.ORG Tue Feb 21 18:37:32 2012 Return-Path: Delivered-To: hubs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 015E41065670; Tue, 21 Feb 2012 18:37:32 +0000 (UTC) (envelope-from toasty@dragondata.com) Received: from mail-iy0-f182.google.com (mail-iy0-f182.google.com [209.85.210.182]) by mx1.freebsd.org (Postfix) with ESMTP id B10F38FC13; Tue, 21 Feb 2012 18:37:31 +0000 (UTC) Received: by iaeo4 with SMTP id o4so12508714iae.13 for ; Tue, 21 Feb 2012 10:37:31 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dragondata.com; s=google; h=subject:mime-version:content-type:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to:x-mailer; bh=7Z3XoFOLTqkNE5JUR/BwvvfC0G9Ed+W7mQ1qwrnAO80=; b=dQOeDPrcjfLIqBbJTojEZJPOUZUTYZGoRHS1LOE6NFPpsLDJPIZa3wdKtP1NcXLfgt OsSTabQzV9yQgJt3sn0V7rVNka7OWSdur7Ogj1liJx3OzNQWj7Y/DqEEbzk19Z/Z2XV0 KxcL/psUSsFv891oZStyeEuBKlt/F4ueOG7Mk= Received: by 10.42.150.200 with SMTP id b8mr22919677icw.43.1329847841340; Tue, 21 Feb 2012 10:10:41 -0800 (PST) Received: from static177.us.your.org (static177.us.your.org. [204.9.55.177]) by mx.google.com with ESMTPS id df2sm10776512igb.0.2012.02.21.10.10.39 (version=TLSv1/SSLv3 cipher=OTHER); Tue, 21 Feb 2012 10:10:40 -0800 (PST) Mime-Version: 1.0 (Apple Message framework v1257) Content-Type: text/plain; charset=us-ascii From: Kevin Day In-Reply-To: <20120221023926.GA20266@hub.freebsd.org> Date: Tue, 21 Feb 2012 12:10:38 -0600 Content-Transfer-Encoding: quoted-printable Message-Id: <11A0B7D3-8216-4E1A-B327-42186A9E579F@dragondata.com> References: <20120221023926.GA20266@hub.freebsd.org> To: Thomas Abthorpe X-Mailer: Apple Mail (2.1257) X-Gm-Message-State: ALoCoQkSipCs0p99ZI2fevJ84PQJB/berOHZpU97Ec9Lpo81KeLr0swtg8LBl+nz3mTB5ESGJekt Cc: hubs@FreeBSD.org Subject: Re: Query about the usage of FreeBSD mirror sites for other projects X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: "FreeBSD Distributions Hubs: mail sup ftp" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 21 Feb 2012 18:37:32 -0000 On Feb 20, 2012, at 8:39 PM, Thomas Abthorpe wrote: > Which now rather begs to ask the question, what is the opinion of our > mirror maintainers? How do you feel about non-FreeBSD projects using > our resources? Our community supports and sponsors some of these = sites, > should others be allowed to use them? >=20 > Please feel free to reply publicly, and private emails directly to me > will be held in the strictist of confidence. >=20 > I am curious to see how our people feel on the matter. >=20 > Thanks for your time and attention to this matter. >=20 We run ftp3.us.freebsd.org, cvsup6.us.freebsd.org, etc which is also = home to several other projects available by ftp/http/rsync/cvsup/etc.=20 We really don't care who uses the data we've mirrored, if we're putting = it up to the public, anyone is free to grab/link to it. -- Kevin From owner-freebsd-hubs@FreeBSD.ORG Tue Feb 21 20:30:19 2012 Return-Path: Delivered-To: hubs@freebsd.org Received: from hub.freebsd.org (hub.freebsd.org [IPv6:2001:4f8:fff6::36]) by hub.freebsd.org (Postfix) with ESMTP id 5CD95106564A; Tue, 21 Feb 2012 20:30:19 +0000 (UTC) (envelope-from tabthorpe@freebsd.org) Date: Tue, 21 Feb 2012 15:30:18 -0500 From: Thomas Abthorpe To: Kevin Day Message-ID: <20120221203018.GD20266@hub.freebsd.org> References: <20120221023926.GA20266@hub.freebsd.org> <11A0B7D3-8216-4E1A-B327-42186A9E579F@dragondata.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="MAH+hnPXVZWQ5cD/" Content-Disposition: inline In-Reply-To: <11A0B7D3-8216-4E1A-B327-42186A9E579F@dragondata.com> X-URL: http://www.goodking.org/ X-PGP-Key: http://people.freebsd.org/~tabthorpe/tabthorpe.asc X-PGP-Key-ID: 0xA473C990 X-PGP-Key-Fingerprint: D883 2D7C EB78 944A 69FC 36A6 D937 1097 A473 C990 User-Agent: Mutt/1.5.21 (2010-09-15) Cc: hubs@freebsd.org Subject: Re: Query about the usage of FreeBSD mirror sites for other projects X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: "FreeBSD Distributions Hubs: mail sup ftp" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 21 Feb 2012 20:30:20 -0000 --MAH+hnPXVZWQ5cD/ Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Feb 21, 2012 at 12:10:38PM -0600, Kevin Day wrote: >=20 > On Feb 20, 2012, at 8:39 PM, Thomas Abthorpe wrote: > > Which now rather begs to ask the question, what is the opinion of our > > mirror maintainers? How do you feel about non-FreeBSD projects using > > our resources? Our community supports and sponsors some of these sites, > > should others be allowed to use them? > >=20 > > Please feel free to reply publicly, and private emails directly to me > > will be held in the strictist of confidence. > >=20 > > I am curious to see how our people feel on the matter. > >=20 > > Thanks for your time and attention to this matter. > >=20 >=20 >=20 > We run ftp3.us.freebsd.org, cvsup6.us.freebsd.org, etc which is also home= to several other projects available by ftp/http/rsync/cvsup/etc.=20 >=20 > We really don't care who uses the data we've mirrored, if we're putting i= t up to the public, anyone is free to grab/link to it. >=20 > -- Kevin >=20 Thanks Kevin. The general sentiment I have been receiving from mirror maintainers who have replied is just that, it is a public site, feel free to use it, just don't abuse it. I suspect that the sense of sharing comes from our choice to work in opensource projects. Thomas --=20 Thomas Abthorpe | FreeBSD Committer tabthorpe@FreeBSD.org | http://people.freebsd.org/~tabthorpe --MAH+hnPXVZWQ5cD/ Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.18 (FreeBSD) iQEcBAEBAgAGBQJPQ/7aAAoJENk3EJekc8mQ9qoH/1M7J9lRUZyjmGJd2adxLVhc 4B2BkTCnHZtZ35H7afzsx85qG7Ebq6ObSHVzLtSXo5tNOVv91ZHVxlsbAQtllCKZ MlBsVTGRDAXJmXiKckiv2D1K3eGQ9NTRuC+doJOGEtaE+tt/mJ5kekK9Pf9DL5+5 GIETMqfOf/37lwTkG1cZXUS8QxtWs76/2aCQWVEASm5gpXXnbx1cjTcTwfAhC1Gj OTCuDLU69e5e3WAK+4z9qPKBPU5rmcmJu336Sa9jGOoEjFCzHD66/mUrq9XEOp5H 04E5Z605d4E9DfLSvgHtSMkQAra9Ac90fY5E1w4/i0MkhiIaR38ZukCymzQk58Y= =iU2t -----END PGP SIGNATURE----- --MAH+hnPXVZWQ5cD/-- From owner-freebsd-hubs@FreeBSD.ORG Tue Feb 21 23:23:41 2012 Return-Path: Delivered-To: hubs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1251F106566C for ; Tue, 21 Feb 2012 23:23:41 +0000 (UTC) (envelope-from wollman@hergotha.csail.mit.edu) Received: from hergotha.csail.mit.edu (wollman-1-pt.tunnel.tserv4.nyc4.ipv6.he.net [IPv6:2001:470:1f06:ccb::2]) by mx1.freebsd.org (Postfix) with ESMTP id BD9448FC14 for ; Tue, 21 Feb 2012 23:23:40 +0000 (UTC) Received: from hergotha.csail.mit.edu (localhost [127.0.0.1]) by hergotha.csail.mit.edu (8.14.4/8.14.4) with ESMTP id q1LNNdqa021125 for ; Tue, 21 Feb 2012 18:23:39 -0500 (EST) (envelope-from wollman@hergotha.csail.mit.edu) Received: (from wollman@localhost) by hergotha.csail.mit.edu (8.14.4/8.14.4/Submit) id q1LNNd78021122; Tue, 21 Feb 2012 18:23:39 -0500 (EST) (envelope-from wollman) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Message-ID: <20292.10107.777434.417092@hergotha.csail.mit.edu> Date: Tue, 21 Feb 2012 18:23:39 -0500 From: Garrett Wollman To: hubs@freebsd.org X-Mailer: VM 7.17 under 21.4 (patch 22) "Instant Classic" XEmacs Lucid X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.2.7 (hergotha.csail.mit.edu [127.0.0.1]); Tue, 21 Feb 2012 18:23:39 -0500 (EST) X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED autolearn=disabled version=3.3.2 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on hergotha.csail.mit.edu Cc: Subject: Status of cvsup3/ftp5 X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: "FreeBSD Distributions Hubs: mail sup ftp" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 21 Feb 2012 23:23:41 -0000 cvsup3/ftp5 was down over the weekend as a result of some sort of ZFS problem that locks the machine hard whenever it touches the "tank" zpool, where the FTP archives are located. The CVS tree is on the root zpool, which mounts just fine, so cvsup3 is back, but ftp5 is down until I can figure out how to get that zpool to work again. (Even "zpool status" hangs if it can access the drives.) Any troubleshooting suggestions will be gratefully accepted. -GAWollman From owner-freebsd-hubs@FreeBSD.ORG Wed Feb 22 18:06:11 2012 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 382D31065672 for ; Wed, 22 Feb 2012 18:06:11 +0000 (UTC) (envelope-from maxim.konovalov@gmail.com) Received: from mp2.macomnet.net (ipv6.irc.int.ru [IPv6:2a02:28:1:2::1b:2]) by mx1.freebsd.org (Postfix) with ESMTP id B56D28FC08 for ; Wed, 22 Feb 2012 18:06:10 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by mp2.macomnet.net (8.14.5/8.14.5) with ESMTP id q1MI68ej079993 for ; Wed, 22 Feb 2012 22:06:08 +0400 (MSK) (envelope-from maxim.konovalov@gmail.com) Date: Wed, 22 Feb 2012 22:06:08 +0400 (MSK) From: Maxim Konovalov To: freebsd-hubs@freebsd.org In-Reply-To: Message-ID: References: User-Agent: Alpine 2.00 (BSF 1167 2008-08-23) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Subject: Re: Content of /snapshots/ X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: "FreeBSD Distributions Hubs: mail sup ftp" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Feb 2012 18:06:11 -0000 Hello, reading the old thread: it would be really nice to remove 2010 snapshots. On Fri, 20 Jan 2012, 02:08+0100, Eberhard Moenkeberg wrote: > Hi, > > does it really make sense to still keep snapshots from 2010 ? > > emoenke@ftp4:0 01:51:34 /mirr/bin > du -s /pub/FreeBSD/snapshots/201011 > 31917144 /pub/FreeBSD/snapshots/201011 > emoenke@ftp4:0 01:52:45 /mirr/bin > du -s /pub/FreeBSD/snapshots/201012 > 19357096 /pub/FreeBSD/snapshots/201012 > emoenke@ftp4:0 01:52:50 /mirr/bin > > > A huge waste of space, isn't it? > > Next question: 20110?, four versions actually presented. > > emoenke@ftp4:0 02:05:21 /mirr/bin > du -s /pub/FreeBSD/snapshots/2011* > 18917340 /pub/FreeBSD/snapshots/201101 > 2584728 /pub/FreeBSD/snapshots/201102 > 12596740 /pub/FreeBSD/snapshots/201105 > 1737556 /pub/FreeBSD/snapshots/201107 > emoenke@ftp4:0 02:05:39 /mirr/bin > > > OK, much less, but why so much outdates stuff still there? > > Remember, you are not only wasting space on your master servers, but also on > your willing mirrors. > > I guess the FreeBSD maintainers need a little bit more consciousness for the > behalf of the mirror servers. You are - I guess - in the same "space wasting" > unconsciousness like mandrivalinux and debian. > > A positive example for me is OpenSuSE. They are just aware, not more is > needed. > > OK, I can silently disable mirroring /snapshots/, but the true way should be > better. > > > Viele Gruesse > Eberhard Moenkeberg (emoenke@gwdg.de, em@kki.org) > > -- Maxim Konovalov From owner-freebsd-hubs@FreeBSD.ORG Thu Feb 23 18:59:35 2012 Return-Path: Delivered-To: hubs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 36E4610656E3 for ; Thu, 23 Feb 2012 18:59:35 +0000 (UTC) (envelope-from mitayai@gmail.com) Received: from mail-wi0-f182.google.com (mail-wi0-f182.google.com [209.85.212.182]) by mx1.freebsd.org (Postfix) with ESMTP id AA2D68FC27 for ; Thu, 23 Feb 2012 18:59:32 +0000 (UTC) Received: by wibhn14 with SMTP id hn14so1484346wib.13 for ; Thu, 23 Feb 2012 10:59:31 -0800 (PST) Received-SPF: pass (google.com: domain of mitayai@gmail.com designates 10.180.83.97 as permitted sender) client-ip=10.180.83.97; Authentication-Results: mr.google.com; spf=pass (google.com: domain of mitayai@gmail.com designates 10.180.83.97 as permitted sender) smtp.mail=mitayai@gmail.com; dkim=pass header.i=mitayai@gmail.com Received: from mr.google.com ([10.180.83.97]) by 10.180.83.97 with SMTP id p1mr5408237wiy.19.1330023571695 (num_hops = 1); Thu, 23 Feb 2012 10:59:31 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:reply-to:date:message-id:subject:from:to:content-type; bh=Xx1vUe/OmLPW98falVF/emeb0G7n61mlP+Y8OgnEUR0=; b=trweEKO8Ct2/YsQ2y1TQsC/gMiZzUk2sDCOnx1qoq0NSNIHU5eHWmIqM4rICnWKKRk cBD3/EFvW063B8rdjtTXM6AQL7a15Nw9Wj3BbTsJjU/nVa5+NH2xhNfD/mntbXU8v/Tf GeC8dxdpGa/f/6gIOZ1IyDy4uZc/7+5rpTUR8= MIME-Version: 1.0 Received: by 10.180.83.97 with SMTP id p1mr4273952wiy.19.1330022019640; Thu, 23 Feb 2012 10:33:39 -0800 (PST) Received: by 10.227.155.208 with HTTP; Thu, 23 Feb 2012 10:33:39 -0800 (PST) Date: Thu, 23 Feb 2012 13:33:39 -0500 Message-ID: From: Mitayai To: hubs@freebsd.org X-Mailman-Approved-At: Thu, 23 Feb 2012 19:17:16 +0000 Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: Subject: cvsup.ca.freebsd.org down indefinitely X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: mit@mitayai.org List-Id: "FreeBSD Distributions Hubs: mail sup ftp" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Feb 2012 18:59:35 -0000 I've received word from our cvsup mirror provider here in Canada that they would be discontinuing the mirror cvsup.ca.freebsd.org I've received offers from other organizations to set up a replacement, but it will take a few days to arrange. While i work out the final details of the replacement, I've temporarily aliased cvsup.ca.freebsd.org to cvsup.freebsd.org. Cheers, Mit -- Mit Rowe Toronto, Canada mitayai@gmail.com From owner-freebsd-hubs@FreeBSD.ORG Thu Feb 23 22:31:25 2012 Return-Path: Delivered-To: hubs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 77CCC1065670 for ; Thu, 23 Feb 2012 22:31:25 +0000 (UTC) (envelope-from wollman@hergotha.csail.mit.edu) Received: from hergotha.csail.mit.edu (wollman-1-pt.tunnel.tserv4.nyc4.ipv6.he.net [IPv6:2001:470:1f06:ccb::2]) by mx1.freebsd.org (Postfix) with ESMTP id 2F0558FC13 for ; Thu, 23 Feb 2012 22:31:25 +0000 (UTC) Received: from hergotha.csail.mit.edu (localhost [127.0.0.1]) by hergotha.csail.mit.edu (8.14.4/8.14.4) with ESMTP id q1NMVOV6024056 for ; Thu, 23 Feb 2012 17:31:24 -0500 (EST) (envelope-from wollman@hergotha.csail.mit.edu) Received: (from wollman@localhost) by hergotha.csail.mit.edu (8.14.4/8.14.4/Submit) id q1NMVO1f024053; Thu, 23 Feb 2012 17:31:24 -0500 (EST) (envelope-from wollman) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Message-ID: <20294.48700.344971.143704@hergotha.csail.mit.edu> Date: Thu, 23 Feb 2012 17:31:24 -0500 From: Garrett Wollman To: hubs@freebsd.org X-Mailer: VM 7.17 under 21.4 (patch 22) "Instant Classic" XEmacs Lucid X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.2.7 (hergotha.csail.mit.edu [127.0.0.1]); Thu, 23 Feb 2012 17:31:24 -0500 (EST) X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED autolearn=disabled version=3.3.2 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on hergotha.csail.mit.edu Cc: Subject: ftp5.freebsd.org is back X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: "FreeBSD Distributions Hubs: mail sup ftp" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Feb 2012 22:31:25 -0000 After transferring one of its zpools to another machine that had more memory, I was able to get ZFS to be happy again, and ftp5.freebsd.org is once again updating and serving bits. -GAWollman