Date: Thu, 14 Jun 2007 09:15:47 -0400 From: "Bob" <bob@a1poweruser.com> To: "freebsd-questions@FreeBSD. ORG" <freebsd-questions@FreeBSD.ORG> Subject: apache deining robots.txt 404 Message-ID: <NBECLJEKGLBKHHFFANMBCEJJCDAA.bob@a1poweruser.com>
next in thread | raw e-mail | index | archive | help
I just moved FBSD 6.2 / apache-1.3.37.1 into production. In the httpd-access,log I see all the search engines requests for robots.txt getting a 404 code. The previous production world was FBSD 6.0 /apache-1.3.33_2 and all the search engines requests for robots.txt got a 200 code. I use the same httpd-conf in both. So the only thing changed is the version of FBSD and apache. Has anybody else noticed this? How can I allow robots.txt to be handled like before??
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?NBECLJEKGLBKHHFFANMBCEJJCDAA.bob>