From owner-freebsd-questions@FreeBSD.ORG Fri Jan 9 07:49:30 2004 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 3813016A4D0 for ; Fri, 9 Jan 2004 07:49:30 -0800 (PST) Received: from www6.web2010.com (www6.web2010.com [216.157.5.254]) by mx1.FreeBSD.org (Postfix) with ESMTP id 6CDBC43D39 for ; Fri, 9 Jan 2004 07:49:28 -0800 (PST) (envelope-from MLandman@face2interface.com) Received: from delliver.face2interface.com (dialup-wash-129-203.thebiz.net [64.30.129.203] (may be forged)) by www6.web2010.com (8.12.10/8.9.0) with ESMTP id i09FnHn9027890; Fri, 9 Jan 2004 10:49:20 -0500 (EST) Message-Id: <6.0.0.22.0.20040109104024.03690628@pop.face2interface.com> X-Sender: face@pop.face2interface.com X-Mailer: QUALCOMM Windows Eudora Version 6.0.0.22 Date: Fri, 09 Jan 2004 10:49:15 -0500 To: "Jack L. Stone" , freebsd-questions@freebsd.org From: Marty Landman In-Reply-To: <3.0.5.32.20040109091937.014b2378@10.0.0.15> References: <3.0.5.32.20040109091937.014b2378@10.0.0.15> Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii"; format=flowed Subject: Re: Scripting help X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 09 Jan 2004 15:49:30 -0000 At 10:19 AM 1/9/2004, Jack L. Stone wrote: >My scripting skills are very limited and need help on how to purge my mail >lists. We maintain several majordomo mail lists on a Tech magazine site >(www.antennex.com) with 60,000 readers. Needless to say, it is real tedious >to try and keep the lists up to date (groan). > >I have scripted a way to capture the bounces (by list) into a plain text >file (1 address per line), but haven't figured out how to purge those from >the lists. In other words, if the address is found in the bounce list, then >delete from the main lists (also one address per line). Jack, with that volume of subscribers I think it's a good example of where a database is appropriate. MySQL, postGreSQL etc.. with an application written in Perl or PHP. Oh, that happens to be just the sort of work I do. :) But is a very small effort and would be cleaner imho; maybe triggered via a cron to keep things updated. You'd need an initial load then a simple program to attempt key matches by email from bounces which then delete/write to a report file and email to you so you have an idea of what's going on day to day. I don't know if overhead doing a flat file approach would cause your system noticeable degradation or not. 60K subscribers, assume 100 bounces/day, linear search averages 30K comparisons per search (because on average a key is found 1/2 way through the file, if all the bounces are there which they should be) if you're going line by line so 3M comparisons to run the daily bounce processor w/ my assumption of 100 bounces a day. TBH 3M comparisons, i/o's with a 2ish GH processor, 1GB of ram or whatever... you may not even feel it. Just thinking out loud, sorry. Marty Landman Face 2 Interface Inc 845-679-9387 Sign On Required: Web membership software for your site Make a Website: http://face2interface.com/Home/Demo.shtml