Date: Mon, 1 Oct 2007 17:53:18 -0400 From: Chuck Swiger <cswiger@mac.com> To: "Bahman M." <b.movaqar@adempiere.org> Cc: freebsd-questions@freebsd.org Subject: Re: Is Apache rotatelogs efficienct for real world use? Message-ID: <3EAD7F56-D4D4-4D83-B501-3DEF3C7039AE@mac.com> In-Reply-To: <20071001231334.71ddc9ac@attila> References: <20071001231334.71ddc9ac@attila>
next in thread | previous in thread | raw e-mail | index | archive | help
On Oct 1, 2007, at 3:43 PM, Bahman M. wrote: > Is Apache rotatelogs suitable for handling large volumes of > access logs, i.e. around 50K requests per hour at _peak_ time which is > 1.2M requests per day. According to Apache website > (http://httpd.apache.org/docs/1.3/logs.html#rotation) this becomes > about 120MB in size per day. > > Does somebody have similar experience with rotatelogs? Absolutely-- rotatelogs did just fine with one of the sites I used to admin which was getting between 1 and 2.5 million hits a day, depending on the day of the week it was. Storing the logfiles and doing analysis on them afterwards started getting pretty challenging, however: even doing reverse DNS lookups took a fair amount of work, and once you started piling up a year or so's worth, doing things like analog or webalyzer or Unison started taking close to 24-hours to finish running and produce a report. -- -Chuck
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?3EAD7F56-D4D4-4D83-B501-3DEF3C7039AE>