From owner-freebsd-questions@FreeBSD.ORG  Fri Jun 30 15:37:04 2006
Return-Path: <owner-freebsd-questions@FreeBSD.ORG>
X-Original-To: questions@freebsd.org
Delivered-To: freebsd-questions@FreeBSD.ORG
Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125])
	by hub.freebsd.org (Postfix) with ESMTP id 7BCFF16A40F
	for <questions@freebsd.org>; Fri, 30 Jun 2006 15:37:04 +0000 (UTC)
	(envelope-from hakmi@rogers.com)
Received: from smtp102.rog.mail.re2.yahoo.com (smtp102.rog.mail.re2.yahoo.com
	[206.190.36.80]) by mx1.FreeBSD.org (Postfix) with SMTP id A5BD143D45
	for <questions@freebsd.org>; Fri, 30 Jun 2006 15:37:03 +0000 (GMT)
	(envelope-from hakmi@rogers.com)
Received: (qmail 20261 invoked from network); 30 Jun 2006 15:37:02 -0000
DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=rogers.com;
	h=Received:From:To:Cc:Subject:Date:MIME-Version:Content-Type:Content-Transfer-Encoding:X-Mailer:In-Reply-To:X-MimeOLE:Thread-Index;
	b=zgpsoo7SgvAsghnbBXLlW/CHUzTbCdfzZ5cBY9NsY+xVLHjdeaiKT5jceEAfTmvhJT0DS9LvxkEGn1x6kTwWbJ+C86AAJ4hRjEeZxKHyQnSgUoFJhy0gDxvNnAVu7VcJ7jxFU9glIzeWOX4IoSEoHOH4lcxkT42F/D9vV5N417M=
	; 
Received: from unknown (HELO tamouh) (hakmi@rogers.com@70.27.160.99 with login)
	by smtp102.rog.mail.re2.yahoo.com with SMTP; 30 Jun 2006 15:37:02 -0000
From: "Tamouh H." <hakmi@rogers.com>
To: "'Alex Zbyslaw'" <xfb52@dial.pipex.com>,
	"'Olivier Nicole'" <on@cs.ait.ac.th>
Date: Fri, 30 Jun 2006 11:37:04 -0400
MIME-Version: 1.0
Content-Type: text/plain;
	charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
X-Mailer: Microsoft Office Outlook, Build 11.0.6353
In-Reply-To: <44A50C2E.7080500@dial.pipex.com>
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.2869
Thread-Index: AcacPYqqvBcU840LTBKOgVzZdM9l5gAHUj6Q
Message-Id: <20060630153703.A5BD143D45@mx1.FreeBSD.org>
Cc: questions@freebsd.org
Subject: RE: Slow server
X-BeenThere: freebsd-questions@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: User questions <freebsd-questions.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-questions>, 
	<mailto:freebsd-questions-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-questions>
List-Post: <mailto:freebsd-questions@freebsd.org>
List-Help: <mailto:freebsd-questions-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-questions>, 
	<mailto:freebsd-questions-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Fri, 30 Jun 2006 15:37:04 -0000

=20
>=20
> Olivier Nicole wrote:
>=20
> >2) as there are many connections comming from search engines siders
> >   (90% of all the established connections), I'd like to limit the
> >   ressources that spiders are using. One way would be through IPFW,
> >   but are there better ways? Is there a way to limit/prioritize in
> >   Apache (not that I know any).
> > =20
> >

Lookup mod_security rules for Apache and mod_dosevasive. mod_evasive =
will help prevent the spiders from opening many pages at one time

mod_security has rules to detect some fake spiders and other bots and =
block them from the get go.=20

Both though will add a little bit of overhead to Apache.