From owner-freebsd-hackers Thu Nov 9 17:52:54 1995 Return-Path: owner-hackers Received: (from root@localhost) by freefall.freebsd.org (8.6.12/8.6.6) id RAA21936 for hackers-outgoing; Thu, 9 Nov 1995 17:52:54 -0800 Received: from dtihost.datatrek.com (dtihost.datatrek.com [204.31.148.2]) by freefall.freebsd.org (8.6.12/8.6.6) with ESMTP id RAA21928 for ; Thu, 9 Nov 1995 17:52:48 -0800 Received: from laptop.nightflight ([205.162.141.3]) by dtihost.datatrek.com (8.6.12/8.6.9) with SMTP id RAA11236 for ; Thu, 9 Nov 1995 17:50:44 -0800 Date: Thu, 9 Nov 1995 17:50:44 -0800 Message-Id: <199511100150.RAA11236@dtihost.datatrek.com> X-Sender: gcrutcher@datatrek.com X-Mailer: Windows Eudora Version 2.1.1 Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii" To: hackers@freebsd.org From: Gary Crutcher Subject: robot.txt file Sender: owner-hackers@freebsd.org Precedence: bulk I have been checking my apache server's logfile and noticed that a number sites have been trying to access a file called "robot.txt". What is this file and do I need it on my system. Thanks, Gary Crutcher