Date: Thu, 18 Jan 2001 11:20:18 +1100 From: "Corey Ralph" <corey.ralph@datafast.net.au> To: Daniel Conlon <daniel@donhost.co.uk> Cc: freebsd-isp@freebsd.org Subject: Re: Access statistics for apache Message-ID: <20010118112018.A480@corey.datafast.net.au> In-Reply-To: <NCBBIPFNJNGFMHHDAHMFAEAOCMAA.daniel@donhost.co.uk>; from daniel@donhost.co.uk on Wed, Jan 17, 2001 at 10:18:46PM -0000 References: <20010118090220.B30093@corey.datafast.net.au> <NCBBIPFNJNGFMHHDAHMFAEAOCMAA.daniel@donhost.co.uk>
next in thread | previous in thread | raw e-mail | index | archive | help
Daniel, I just rotate them monthly. Webalizer keeps a history so it knows what parts have already been analysed and skips them. I have it running in a cron job every 5 minutes. The stats pages are broken into one per month, see the webalizer website for a demo. I once tried to output all sites to one access log then grep it for the domain name to sort it out. Only problem was that it misses the first hit to the site for the session as it the hit to / doesn't seem to be recorded with the full url. That first hit is the most important to log because the referrer is where the search keywords can be found. About the file descriptor limit, I haven't had any problems with it. I have just over 300 sites on my main server. Cheers, Corey On Wed, Jan 17, 2001 at 10:18:46PM -0000, Daniel Conlon wrote: > With reference to the subject of apache logs: > > I am currently putting a CustomLog directive and also an ErrorLog directive > in each VirtualHost. How many virtual hosts can you have on a FBSD box with > this configuration before you begin to encounter file descriptor problems? > Is it better to pipe all the logging to some process at the other end which > sorts them all out and puts them in the correct place? > > Also, what solutions are available to rotate/compress/trim apache log files. > I currently just run a script on the 1st of every month which deletes the > existing logs and starts new ones. It would be nice to be able to trim the > log files so that there is always the last 30 days available in them. Better > still, process the logs on the 1st of every month, save the actual produced > statistics and delete the log. Then be able to access the pre-processed, > saved statistics from previous months, enabling customers to view statistics > from several years back without consuming excessive disk space and processor > time to produce the reports. > > Thanks, > > Daniel Conlon > Donhost > > ########################## > Tel: +44 (0)800 956 7642 > Mob: +44 (0)7939 268 799 > Fax: +44 (0)8707 41 51 07 > http://www.donhost.co.uk > ########################## > > -----Original Message----- > From: owner-freebsd-isp@FreeBSD.ORG > [mailto:owner-freebsd-isp@FreeBSD.ORG]On Behalf Of Corey Ralph > Sent: 17 January 2001 22:02 > To: freebsd-isp@freebsd.org > Subject: Re: Access statistics for apache > > > I'll second that. The users love it. It is very comprehensive and the > graphs > make it easy to understand. > > I wrote a short perl script to find the CustomLog lines in the <VirtualHost> > sections of httpd.conf, and run webalizer over all the sites on the server. > > Cheers > Corey > > On Wed, Jan 17, 2001 at 10:24:40PM +0100, Michael Lyngbøl wrote: > > On Wed, Jan 17, 2001 at 04:21:28PM -0500, Jan Knepper wrote: > > > > > > Does any of you know about a package that does access statistics for > apache? > > > Looking through the apache log files I would figure there is something > > > around,... > > > > http://www.mrunix.net/webalizer/ does a pretty good job > > > > /Michael > > > > > > > > To Unsubscribe: send mail to majordomo@FreeBSD.org > > with "unsubscribe freebsd-isp" in the body of the message > > > > > To Unsubscribe: send mail to majordomo@FreeBSD.org > with "unsubscribe freebsd-isp" in the body of the message > > > > > > To Unsubscribe: send mail to majordomo@FreeBSD.org > with "unsubscribe freebsd-isp" in the body of the message > To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20010118112018.A480>