Skip site navigation (1)Skip section navigation (2)
Date:      Wed, 4 Sep 2002 15:35:11 +0200
From:      Stijn Hoop <stijn@win.tue.nl>
To:        Daniel Bye <dan@slightlystrange.org>
Cc:        questions@freebsd.org
Subject:   Re: Macros in ipfw rules
Message-ID:  <20020904133511.GD20573@pcwin002.win.tue.nl>
In-Reply-To: <20020904133053.GA91519@catflap.home.slightlystrange.org>
References:  <20020903142632.GA71601@catflap.home.slightlystrange.org> <443cspq4ll.fsf@be-well.ilk.org> <20020904133053.GA91519@catflap.home.slightlystrange.org>

next in thread | previous in thread | raw e-mail | index | archive | help

--/NkBOFFp2J2Af1nK
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable

On Wed, Sep 04, 2002 at 02:30:53PM +0100, Daniel Bye wrote:
> However, I wanted to prevent googlebot.com et al from=20
> cataloguing the site, while allowing pretty much unrestricted access to
> everyone else.

If that's all you want:

http://www.robotstxt.org/wc/robots.html

No need for firewall rules for that kind of thing.

--Stijn

--=20
I have great faith in fools -- self confidence my friends call it.
		-- Edgar Allan Poe

--/NkBOFFp2J2Af1nK
Content-Type: application/pgp-signature
Content-Disposition: inline

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.0.7 (FreeBSD)

iD8DBQE9dgwOY3r/tLQmfWcRAqd4AKCEvFnE6qAGQreRdV5y/fzp5TJIxgCgrzWx
Yw8E+PkMJlH5JzX2LuTq0Tc=
=NtBf
-----END PGP SIGNATURE-----

--/NkBOFFp2J2Af1nK--

To Unsubscribe: send mail to majordomo@FreeBSD.org
with "unsubscribe freebsd-questions" in the body of the message




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20020904133511.GD20573>