From owner-freebsd-questions@FreeBSD.ORG Thu Jun 14 13:15:52 2007 Return-Path: X-Original-To: freebsd-questions@FreeBSD.ORG Delivered-To: freebsd-questions@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id AADCE16A46C for ; Thu, 14 Jun 2007 13:15:52 +0000 (UTC) (envelope-from bob@a1poweruser.com) Received: from mta11.adelphia.net (mta11.adelphia.net [68.168.78.205]) by mx1.freebsd.org (Postfix) with ESMTP id 734D613C469 for ; Thu, 14 Jun 2007 13:15:52 +0000 (UTC) (envelope-from bob@a1poweruser.com) Received: from laptop ([76.190.225.105]) by mta11.adelphia.net (InterMail vM.6.01.05.02 201-2131-123-102-20050715) with SMTP id <20070614131551.TAJH3934.mta11.adelphia.net@laptop> for ; Thu, 14 Jun 2007 09:15:51 -0400 From: "Bob" To: "freebsd-questions@FreeBSD. ORG" Date: Thu, 14 Jun 2007 09:15:47 -0400 Message-ID: MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit X-Priority: 3 (Normal) X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook IMO, Build 9.0.6604 (9.0.2911.0) Importance: Normal X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.3028 Cc: Subject: apache deining robots.txt 404 X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: bob@a1poweruser.com List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 14 Jun 2007 13:15:52 -0000 I just moved FBSD 6.2 / apache-1.3.37.1 into production. In the httpd-access,log I see all the search engines requests for robots.txt getting a 404 code. The previous production world was FBSD 6.0 /apache-1.3.33_2 and all the search engines requests for robots.txt got a 200 code. I use the same httpd-conf in both. So the only thing changed is the version of FBSD and apache. Has anybody else noticed this? How can I allow robots.txt to be handled like before??