From owner-freebsd-hackers Tue Dec 19 11:24:13 1995 Return-Path: owner-hackers Received: (from root@localhost) by freefall.freebsd.org (8.7.3/8.7.3) id LAA29258 for hackers-outgoing; Tue, 19 Dec 1995 11:24:13 -0800 (PST) Received: from zeus.bbcc.ctc.edu (ZEUS.BBCC.CTC.EDU [134.39.180.6]) by freefall.freebsd.org (8.7.3/8.7.3) with SMTP id LAA29194 for ; Tue, 19 Dec 1995 11:23:49 -0800 (PST) Received: (from chris@localhost) by zeus.bbcc.ctc.edu (8.6.12/8.6.12) id LAA02126; Tue, 19 Dec 1995 11:26:25 GMT Date: Tue, 19 Dec 1995 11:26:25 GMT Message-ID: X-Mailer: XFMail 0.3-beta [p0] on FreeBSD In-Reply-To: <4akk79$89r$1@haywire.DIALix.COM> Reply-To: chrisc@MAIL.bbcc.ctc.edu Organization: Big Bend Community College From: Chris Coleman To: Peter Wemm Subject: Re: mail storm Cc: Sender: owner-hackers@freebsd.org Precedence: bulk On Wed Dec 13 03:12:41 1995 Peter Wemm wrote: >>wosch@cs.tu-berlin.de (Wolfram Schneider) writes: > >>Jonathan M. Bresler writes: >>>On Sun, 10 Dec 1995, Wolfram Schneider wrote: >>> >>>> Christoph P. Kukulies writes: >>>> >Overnight I had received 650 mails or so (instead of 120 - my >>>> >normal daily load) and many of these are deja-vu mails. >>>> >>>> Me too. I detect funny ``Received: '' lines, 550 mails via ra.dkuug.dk >>>> and 100 mails via th-darmstadt.de. >>> >>> send me one, including headers please, if you have any that you >>>have not deleted > >>I received 2760 Mails since november 29. 83 Mails are dups, mostly >>cross postings (cc: hackers, current). 10 Mails seems really dups, but >>10 Mails is not a problem for me ... > >>Wolfram > >I have an explaination for the volume and a theory about the duplicates.. > >The basic problem was that due to bad connectivity from freefall to >europe and other places, there was a MAJOR pileup of queued mail on >freefall. There were nearly 1000 emails to *.de sites that had been >sitting there for 5 days, and were just about to be bounced to the User error could also account for alot of it. I am using xfmail and it core dumps everytime i try to cut and paste from a reply message. It took me three or four times to realize exactly what was happening But in the meantime, unbeknownst to me, it was sending a copy of the letter I was working on out to the mailing list. oops >postmaster on freefall (5 day timeout). > >I split the mail queue from one "deferred" queue on freefall to 5 >queues, one for each day of backlog. > >After making arrangements with a FreeBSD core member in Denmark >(Poul-Henning Kamp), *all* of the backlogged mail was sent to a >machine under his control for exploding and delivery to the *.de and >other north-eastern european sites. This would account for the >massive flood of email. You could have receieved as many as 900 to >1000 emails over a few hours. > >Also, there is an race condition in the SMTP protocol that is >tickled on bad internet links. Picture this: The originator >(freefall) writes out the message and the trailing "." to end the >body, and waits for the response for a few minutes. If it doesn't get >a response, it times out and requeues the message... *however*, the >network may be slow, and the final 10 or 20K of data including the "." >may take a few minutes to arrive, and the numberic response code may >be delayed due to the pathological TCP retransmit backoff.. But in >reality, the remote machine receieved the mail via SMTP and responded, >but freefall had given up waiting. At this point, there is now a >duplicate mail in the system..... > >Considering the sheer volume of mail sent, and the current extreme >packet losses across international links, I suspect it is most likely >a manifestation of the SMTP race condition. We can only fix that by >lengthening the SMTP transaction timeouts, which will cause freefall's >mail queue to suffer even more in the face of the numerous genuine >broken mailers out there, that genuinely timeout. If the problem >persists, we may have to try something... > >-Peter