From owner-freebsd-hubs Thu Oct 10 9: 6:40 2002 Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id A0AEE37B401; Thu, 10 Oct 2002 09:06:38 -0700 (PDT) Received: from mail.freebsdmall.com (ns1.freebsdmall.com [66.220.2.194]) by mx1.FreeBSD.org (Postfix) with ESMTP id 1452943E91; Thu, 10 Oct 2002 09:06:38 -0700 (PDT) (envelope-from murray@freebsdmall.com) Received: by mail.freebsdmall.com (Postfix, from userid 2074) id 755DA2E89E; Thu, 10 Oct 2002 09:06:35 -0700 (PDT) Date: Thu, 10 Oct 2002 09:06:35 -0700 From: Murray Stokely To: Daniel Lang Cc: Murray Stokely , hubs@FreeBSD.org, re@FreeBSD.org Subject: Re: 4.7 Download Statistics Message-ID: <20021010090635.K1982@freebsdmall.com> References: <20021010082732.G1982@freebsdmall.com> <20021010155247.GB20985@atrbg11.informatik.tu-muenchen.de> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.2.5.1i In-Reply-To: <20021010155247.GB20985@atrbg11.informatik.tu-muenchen.de>; from dl@leo.org on Thu, Oct 10, 2002 at 05:52:47PM +0200 X-GPG-Key-ID: 1024D/0E451F7D X-GPG-Key-Fingerprint: E2CA 411D DD44 53FD BB4B 3CB5 B4D7 10A2 0E45 1F7D Sender: owner-freebsd-hubs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On Thu, Oct 10, 2002 at 05:52:47PM +0200, Daniel Lang wrote: > I think it will be difficult to get real numbers, but maybe > its possible to get an idea or a trend. 1. Number of bytes transferred from ${dir} directory. 2. Number of files transferred from ${dir} directory. where ${dir} is /pub/FreeBSD, /pub/FreeBSD/releases/i386/4.7-RELEASE, the ISO images dirs, etc.. > The question remains, whole ISO files? Just the install-iso? > How about repeated downloads? Are repeated downloads substantial? I assumed they would be insignificant. > To track accesses in the releases/4.7-RELEASE and > releases/ISO-IMAGES/4.7 directories would be a good start. > However, even this is tricky using FTP, since a RETR of "bin.aa" > would no longer reflect that it followed a > CWD "pub/FreeBSD/releases/i386/4.7-RELEASE". I don't understand why thats a problem. The log is not going to report "bin.aa", it is going to report the full pathname. The number of files and number of bytes is a good start, and something we can compare to the old ftp.cdrom.com numbers. These should include FTP and HTTP traffic. > I would grateful for any tools and suggestion, how to efficiently > track downloads in a sensible way. I tried 'xferstats' once > trimming our proftpd to provide wu-ftpd compatible logfiles, > but xferstats crashed after a few 100MBs of logdata and has no > way of 'remembering' once analysed results. > "analog" may work, but I remember I tried that once, but > gave up. We'll see what others say, I always just wrote Perl scripts to generate reports the way I wanted them. I've used analog for web data though. > I am willing to provide any stats, you might find useful. Cool, thanks. - Murray To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-hubs" in the body of the message