Date: Thu, 28 Oct 1999 22:35:52 -0400 From: Sergey Babkin <babkin@bellatlantic.net> To: Matthew Dillon <dillon@apollo.backplane.com> Cc: Michael Beckmann <petzi@apfel.de>, Scott Hess <scott@avantgo.com>, hackers@FreeBSD.ORG Subject: Re: Limitations in FreeBSD Message-ID: <38190808.7B403D4E@bellatlantic.net> References: <19991029011348.B2757@apfel.de> <199910282253.PAA02302@dingo.cdrom.com> <19991029020253.A3005@apfel.de> <15f901bf219e$20df55c0$1e80000a@avantgo.com> <19991029024742.B3005@apfel.de> <199910290054.RAA13725@apollo.backplane.com>
next in thread | previous in thread | raw e-mail | index | archive | help
Matthew Dillon wrote: > > :> If you have a genuine need for 500Gig of news spool, > : > :This is roughly 10 days of newsfeed, btw. > > This is roughly 20 days of newsfeed if one take the porn, warez, and > binaries groups, which contain mostly junk, and try to hold onto them > for the full expiration time. If the person setting up the system > were to spend a little time filtering out the junk and/or adjusting the > expiration it is fairly easy to get away with much smaller spools and an > order of magnitude cheaper system. At BEST I wound up using around a > 40G spool. If the person isn't willing to filter he pretty much deserves > all the pain he creates for himself :-(. Roughly speaking, less then 1% > of a typical userbase even bothers to read usenet news. I think if such a high amount of space with such a high number of parallel users is a must then a lot simpler approach would be to divide the news spool (say, by newsgroups) among multiple machines and set up one machine as a kind of proxy, to accept requests from the users and forward them to a machine which really has this particular newsgroup on it. That would also solve the problem with the CPU load and memory size. For further scalability there may be multiple proxy machines and a load balancing appliance of the same kind as the ones used for the web servers. -SB To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-hackers" in the body of the message
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?38190808.7B403D4E>