Skip site navigation (1)Skip section navigation (2)
Date:      Wed, 4 Sep 2002 15:35:11 +0200
From:      Stijn Hoop <stijn@win.tue.nl>
To:        Daniel Bye <dan@slightlystrange.org>
Cc:        questions@freebsd.org
Subject:   Re: Macros in ipfw rules
Message-ID:  <20020904133511.GD20573@pcwin002.win.tue.nl>
In-Reply-To: <20020904133053.GA91519@catflap.home.slightlystrange.org>
References:  <20020903142632.GA71601@catflap.home.slightlystrange.org> <443cspq4ll.fsf@be-well.ilk.org> <20020904133053.GA91519@catflap.home.slightlystrange.org>

next in thread | previous in thread | raw e-mail | index | archive | help

[-- Attachment #1 --]
On Wed, Sep 04, 2002 at 02:30:53PM +0100, Daniel Bye wrote:
> However, I wanted to prevent googlebot.com et al from 
> cataloguing the site, while allowing pretty much unrestricted access to
> everyone else.

If that's all you want:

http://www.robotstxt.org/wc/robots.html

No need for firewall rules for that kind of thing.

--Stijn

-- 
I have great faith in fools -- self confidence my friends call it.
		-- Edgar Allan Poe

[-- Attachment #2 --]
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.0.7 (FreeBSD)

iD8DBQE9dgwOY3r/tLQmfWcRAqd4AKCEvFnE6qAGQreRdV5y/fzp5TJIxgCgrzWx
Yw8E+PkMJlH5JzX2LuTq0Tc=
=NtBf
-----END PGP SIGNATURE-----

Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20020904133511.GD20573>