From owner-freebsd-hubs@FreeBSD.ORG Mon Jul 18 08:59:11 2011 Return-Path: Delivered-To: hubs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 11254106566C for ; Mon, 18 Jul 2011 08:59:10 +0000 (UTC) (envelope-from linimon@lonesome.com) Received: from mail.soaustin.net (pancho.soaustin.net [76.74.250.40]) by mx1.freebsd.org (Postfix) with ESMTP id B34528FC0C for ; Mon, 18 Jul 2011 08:59:10 +0000 (UTC) Received: by mail.soaustin.net (Postfix, from userid 502) id 27517561B2; Mon, 18 Jul 2011 03:43:42 -0500 (CDT) Date: Mon, 18 Jul 2011 03:43:42 -0500 From: Mark Linimon To: hubs@FreeBSD.org Message-ID: <20110718084342.GA17517@lonesome.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.5.20 (2009-06-14) Cc: linimon@FreeBSD.org Subject: ftp5.us.freebsd.org X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: "FreeBSD Distributions Hubs: mail sup ftp" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Jul 2011 08:59:11 -0000 Anyone else having trouble downloading things from this site? mcl From owner-freebsd-hubs@FreeBSD.ORG Mon Jul 18 10:16:59 2011 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 09D7D1065670 for ; Mon, 18 Jul 2011 10:16:59 +0000 (UTC) (envelope-from maximili@npalm.de) Received: from wp254.webpack.hosteurope.de (wp254.webpack.hosteurope.de [IPv6:2a01:488:42::50ed:8517]) by mx1.freebsd.org (Postfix) with ESMTP id 9DBE78FC16 for ; Mon, 18 Jul 2011 10:16:58 +0000 (UTC) Received: from blfd-4d08651e.pool.mediaways.net ([77.8.101.30] helo=[192.168.1.83]); authenticated by wp254.webpack.hosteurope.de running ExIM with esmtpsa (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) id 1Qiksj-0006rB-Ay; Mon, 18 Jul 2011 12:16:57 +0200 Message-ID: <4E24081B.9010909@npalm.de> Date: Mon, 18 Jul 2011 12:16:59 +0200 From: Maximilian Palm User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.2.18) Gecko/20110617 Lightning/1.0b2 Thunderbird/3.1.11 MIME-Version: 1.0 To: freebsd-hubs@freebsd.org X-Enigmail-Version: 1.1.2 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-bounce-key: webpack.hosteurope.de;maximili@npalm.de;1310984218;fe83c2d7; Subject: BSD mirror statistics and need for torrents X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: "FreeBSD Distributions Hubs: mail sup ftp" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Jul 2011 10:16:59 -0000 Hello everyone, I'm having a look at how useful .torrent downloads could potentially be for the BSD community. I saw Andrew from http://openbsd.somedomain.net/ is basically running a complete OpenBSD mirror on his tracker, but has to seed most of the files himself. Currently I'm looking for statistics from FreeBSD FTP/HTTP download sites and mirrors to see how traffic is distributed among the files. Is everybody really only downloading the recent release or is there a broader range of things that people download? This data could be compared to the FreeBSD tracker statistics. Does anyone gather such information and would be willing to share it? Regards, Max From owner-freebsd-hubs@FreeBSD.ORG Mon Jul 18 11:23:00 2011 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 30FBD106564A for ; Mon, 18 Jul 2011 11:23:00 +0000 (UTC) (envelope-from otto@informatik.rwth-aachen.de) Received: from mta-1.ms.rz.rwth-aachen.de (mta-1.ms.rz.RWTH-Aachen.DE [134.130.7.72]) by mx1.freebsd.org (Postfix) with ESMTP id D61488FC08 for ; Mon, 18 Jul 2011 11:22:59 +0000 (UTC) MIME-version: 1.0 Received: from ironport-out-1.rz.rwth-aachen.de ([134.130.5.40]) by mta-1.ms.rz.RWTH-Aachen.de (Sun Java(tm) System Messaging Server 6.3-7.04 (built Sep 26 2008)) with ESMTP id <0LOI002DCZK9W5H0@mta-1.ms.rz.RWTH-Aachen.de> for freebsd-hubs@freebsd.org; Mon, 18 Jul 2011 12:52:57 +0200 (CEST) X-IronPort-AV: E=Sophos;i="4.67,221,1309730400"; d="asc'?scan'208";a="125587033" Received: from smarthost-1.ms.rz.rwth-aachen.de (HELO smarthost.rwth-aachen.de) ([134.130.7.89]) by ironport-in-1.rz.rwth-aachen.de with ESMTP; Mon, 18 Jul 2011 12:52:57 +0200 Received: from server-mail.halifax.rwth-aachen.de (ip2-199.halifax.RWTH-Aachen.DE [137.226.109.199]) by smarthost.rwth-aachen.de (8.14.4+Sun/8.13.8/1) with ESMTP id p6IAqvhE026027; Mon, 18 Jul 2011 12:52:57 +0200 (CEST) Received: from daedalus.informatik.rwth-aachen.de ([137.226.194.64]) by server-mail.halifax.rwth-aachen.de with smtp (Exim 4.72) (envelope-from ) id 1QilYr-0001gy-Qf; Mon, 18 Jul 2011 13:00:31 +0200 Received: (nullmailer pid 25090 invoked by uid 550); Mon, 18 Jul 2011 10:52:55 +0000 Date: Mon, 18 Jul 2011 12:52:55 +0200 From: Carsten Otto To: Maximilian Palm Message-id: <20110718105255.GM26856@daedalus.informatik.rwth-aachen.de> Mail-followup-to: Maximilian Palm , freebsd-hubs@freebsd.org, FTP References: <4E24081B.9010909@npalm.de> Content-type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="95sqq/H8MHju+kJM" Content-disposition: inline In-reply-to: <4E24081B.9010909@npalm.de> User-Agent: Mutt/1.5.20 (2009-06-14) Cc: freebsd-hubs@freebsd.org Subject: Re: BSD mirror statistics and need for torrents X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: FTP List-Id: "FreeBSD Distributions Hubs: mail sup ftp" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Jul 2011 11:23:00 -0000 --95sqq/H8MHju+kJM Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hi, On Mon, Jul 18, 2011 at 12:16:59PM +0200, Maximilian Palm wrote: > Currently I'm looking for statistics from FreeBSD FTP/HTTP download > sites and mirrors to see how traffic is distributed among the files. Is > everybody really only downloading the recent release or is there a > broader range of things that people download? This data could be > compared to the FreeBSD tracker statistics. >=20 > Does anyone gather such information and would be willing to share it? I can easily provide information about the traffic caused by FreeBSD, split into HTTP, RSYNC, FTP. As you can see in the following graphic, we (ftp.halifax.rwth-aachen.de) have about no traffic at all to other users. Therefore, I do not see the need to use BitTorrent (assuming the current BitTorrent setup does not have way more traffic than HTTP/FTP). http://ftp.halifax.rwth-aachen.de/~cotto/rrd/freebsd%23month.png As a comparison, we only see significant BitTorrent traffic for the huge Linux distributions, especially after some release. Based on our numbers, I do not think that FreeBSD needs a very sophisticated solution here. Bye, --=20 Carsten Otto otto@informatik.rwth-aachen.de LuFG Informatik 2 http://verify.rwth-aachen.de/otto/ RWTH Aachen phone: +49 241 80-21211 --95sqq/H8MHju+kJM Content-Type: application/pgp-signature; name="signature.asc" Content-Description: Digital signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.10 (GNU/Linux) iEYEARECAAYFAk4kEIcACgkQjUF4jpCSQBTRHQCeIUoiKR/zoihfbl5g8sYx6ce/ ehIAoJQkCQFtm+QoPP259yk7JB/7CW5U =TGg7 -----END PGP SIGNATURE----- --95sqq/H8MHju+kJM-- From owner-freebsd-hubs@FreeBSD.ORG Mon Jul 18 13:48:22 2011 Return-Path: Delivered-To: hubs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4136E106566B; Mon, 18 Jul 2011 13:48:22 +0000 (UTC) (envelope-from wollman@hergotha.csail.mit.edu) Received: from hergotha.csail.mit.edu (wollman-1-pt.tunnel.tserv4.nyc4.ipv6.he.net [IPv6:2001:470:1f06:ccb::2]) by mx1.freebsd.org (Postfix) with ESMTP id EDBF98FC14; Mon, 18 Jul 2011 13:48:21 +0000 (UTC) Received: from hergotha.csail.mit.edu (localhost [127.0.0.1]) by hergotha.csail.mit.edu (8.14.4/8.14.4) with ESMTP id p6IDmGAW057558; Mon, 18 Jul 2011 09:48:16 -0400 (EDT) (envelope-from wollman@hergotha.csail.mit.edu) Received: (from wollman@localhost) by hergotha.csail.mit.edu (8.14.4/8.14.4/Submit) id p6IDmGVI057555; Mon, 18 Jul 2011 09:48:16 -0400 (EDT) (envelope-from wollman) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Message-ID: <20004.14752.156115.247284@hergotha.csail.mit.edu> Date: Mon, 18 Jul 2011 09:48:16 -0400 From: Garrett Wollman To: Mark Linimon In-Reply-To: <20110718084342.GA17517@lonesome.com> References: <20110718084342.GA17517@lonesome.com> X-Mailer: VM 7.17 under 21.4 (patch 22) "Instant Classic" XEmacs Lucid X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.2.7 (hergotha.csail.mit.edu [127.0.0.1]); Mon, 18 Jul 2011 09:48:16 -0400 (EDT) X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED autolearn=disabled version=3.3.2 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on hergotha.csail.mit.edu Cc: hubs@freebsd.org Subject: Re: ftp5.us.freebsd.org X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: "FreeBSD Distributions Hubs: mail sup ftp" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Jul 2011 13:48:22 -0000 < said: > Anyone else having trouble downloading things from this site? It crashed Friday night and did not come back up cleanly. I'll be working on it later today. -GAWollman From owner-freebsd-hubs@FreeBSD.ORG Tue Jul 19 22:20:50 2011 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 88946106566C for ; Tue, 19 Jul 2011 22:20:50 +0000 (UTC) (envelope-from maximili@npalm.de) Received: from wp254.webpack.hosteurope.de (wp254.webpack.hosteurope.de [IPv6:2a01:488:42::50ed:8517]) by mx1.freebsd.org (Postfix) with ESMTP id 24ED18FC17 for ; Tue, 19 Jul 2011 22:20:49 +0000 (UTC) Received: from blfd-4db1ae3a.pool.mediaways.net ([77.177.174.58] helo=[192.168.1.83]); authenticated by wp254.webpack.hosteurope.de running ExIM with esmtpsa (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) id 1QjIem-0007lZ-ED; Wed, 20 Jul 2011 00:20:48 +0200 Message-ID: <4E260347.3090507@npalm.de> Date: Wed, 20 Jul 2011 00:20:55 +0200 From: Maximilian Palm User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.2.18) Gecko/20110617 Lightning/1.0b2 Thunderbird/3.1.11 MIME-Version: 1.0 To: FTP , freebsd-hubs@freebsd.org References: <4E24081B.9010909@npalm.de> <20110718105255.GM26856@daedalus.informatik.rwth-aachen.de> In-Reply-To: <20110718105255.GM26856@daedalus.informatik.rwth-aachen.de> X-Enigmail-Version: 1.1.2 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-bounce-key: webpack.hosteurope.de;maximili@npalm.de;1311114050;69ed3734; Cc: Subject: Re: BSD mirror statistics and need for torrents X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: "FreeBSD Distributions Hubs: mail sup ftp" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 19 Jul 2011 22:20:50 -0000 Hello Carsten, On 18.07.2011 12:52, Carsten Otto wrote: > Based on our numbers, I do not think that FreeBSD needs a very > sophisticated solution here. Thank you for that. Having seen the data, I share your opinion. The torrents on the FreeBSD tracker handle more traffic than your mirror, mainly the installation .iso files, and that seems to work fine. Regards, Max From owner-freebsd-hubs@FreeBSD.ORG Wed Jul 20 16:41:28 2011 Return-Path: Delivered-To: hubs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5A37E106566B for ; Wed, 20 Jul 2011 16:41:28 +0000 (UTC) (envelope-from dimitar.vassilev@gmail.com) Received: from mail-qy0-f182.google.com (mail-qy0-f182.google.com [209.85.216.182]) by mx1.freebsd.org (Postfix) with ESMTP id 1BF628FC22 for ; Wed, 20 Jul 2011 16:41:27 +0000 (UTC) Received: by qyk38 with SMTP id 38so288963qyk.13 for ; Wed, 20 Jul 2011 09:41:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:date:message-id:subject:from:to:content-type; bh=F3x8QQrLt7paUSG3u8QvtuFZKpoXbK4jxEEiGwFfQy0=; b=iGqn+uxkKWxLzyvC5FO/ACnI1HFVxzDTeIohJYN3I4wekSyKLHHEc2mWzJdrJOJYmq 4SVgfZX225Ylw01qHmyvru6uVNIkqdWwC/tlaoa7+R2SxzdEni1J/FNN/aJSnPF0J5s5 EK09jXASfpqb+pE972WyeQ9umq5eW6FPsMeBg= MIME-Version: 1.0 Received: by 10.229.86.79 with SMTP id r15mr3968239qcl.7.1311178653956; Wed, 20 Jul 2011 09:17:33 -0700 (PDT) Received: by 10.229.84.8 with HTTP; Wed, 20 Jul 2011 09:17:33 -0700 (PDT) Date: Wed, 20 Jul 2011 19:17:33 +0300 Message-ID: From: Dimitar Vassilev To: hubs@freebsd.org Content-Type: text/plain; charset=UTF-8 Cc: Subject: bg.freebsd.org back with full set of services X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: "FreeBSD Distributions Hubs: mail sup ftp" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 20 Jul 2011 16:41:28 -0000 Hi, box is back. Updated the Areca FW to the latest one for ARC 1120 and got an additional Sil 3124 as Areca is not happy to work with desktop disks. So now the disks are rebalanced - most of them are on the Sil3124 and we will see how long we will last online. When the FTP distribution exceeds 2TB, I will think of new box. Till then it will be beg, borrow or steal approach. Dimitar last of the mohawks