Date: Fri, 09 Jan 2004 10:49:15 -0500 From: Marty Landman <MLandman@face2interface.com> To: "Jack L. Stone" <jacks@sage-american.com>, freebsd-questions@freebsd.org Subject: Re: Scripting help Message-ID: <6.0.0.22.0.20040109104024.03690628@pop.face2interface.com> In-Reply-To: <3.0.5.32.20040109091937.014b2378@10.0.0.15> References: <3.0.5.32.20040109091937.014b2378@10.0.0.15>
next in thread | previous in thread | raw e-mail | index | archive | help
At 10:19 AM 1/9/2004, Jack L. Stone wrote: >My scripting skills are very limited and need help on how to purge my mail >lists. We maintain several majordomo mail lists on a Tech magazine site >(www.antennex.com) with 60,000 readers. Needless to say, it is real tedious >to try and keep the lists up to date (groan). > >I have scripted a way to capture the bounces (by list) into a plain text >file (1 address per line), but haven't figured out how to purge those from >the lists. In other words, if the address is found in the bounce list, then >delete from the main lists (also one address per line). Jack, with that volume of subscribers I think it's a good example of where a database is appropriate. MySQL, postGreSQL etc.. with an application written in Perl or PHP. Oh, that happens to be just the sort of work I do. :) But is a very small effort and would be cleaner imho; maybe triggered via a cron to keep things updated. You'd need an initial load then a simple program to attempt key matches by email from bounces which then delete/write to a report file and email to you so you have an idea of what's going on day to day. I don't know if overhead doing a flat file approach would cause your system noticeable degradation or not. 60K subscribers, assume 100 bounces/day, linear search averages 30K comparisons per search (because on average a key is found 1/2 way through the file, if all the bounces are there which they should be) if you're going line by line so 3M comparisons to run the daily bounce processor w/ my assumption of 100 bounces a day. TBH 3M comparisons, i/o's with a 2ish GH processor, 1GB of ram or whatever... you may not even feel it. Just thinking out loud, sorry. Marty Landman Face 2 Interface Inc 845-679-9387 Sign On Required: Web membership software for your site Make a Website: http://face2interface.com/Home/Demo.shtml
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?6.0.0.22.0.20040109104024.03690628>