Date: Thu, 9 Nov 1995 17:50:44 -0800 From: Gary Crutcher <gcrutcher@datatrek.com> To: hackers@freebsd.org Subject: robot.txt file Message-ID: <199511100150.RAA11236@dtihost.datatrek.com>
next in thread | raw e-mail | index | archive | help
I have been checking my apache server's logfile and noticed that a number sites have been trying to access a file called "robot.txt". What is this file and do I need it on my system. Thanks, Gary Crutcher
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?199511100150.RAA11236>