From owner-freebsd-questions@FreeBSD.ORG Thu Apr 17 16:21:15 2003 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 7E43537B404 for ; Thu, 17 Apr 2003 16:21:15 -0700 (PDT) Received: from pa-plum1b-166.pit.adelphia.net (pa-plum1b-122.pit.adelphia.net [24.53.161.122]) by mx1.FreeBSD.org (Postfix) with ESMTP id 61D6443FAF for ; Thu, 17 Apr 2003 16:21:14 -0700 (PDT) (envelope-from wmoran@potentialtech.com) Received: from potentialtech.com (working [172.16.0.95]) h3HNLDJP018932; Thu, 17 Apr 2003 19:21:13 -0400 (EDT) (envelope-from wmoran@potentialtech.com) Message-ID: <3E9F36E9.3080506@potentialtech.com> Date: Thu, 17 Apr 2003 19:21:13 -0400 From: Bill Moran User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.2.1) Gecko/20030301 X-Accept-Language: en-us, en MIME-Version: 1.0 To: Ashley Gillard References: <000701c30532$0ea7fda0$6510200a@corp.google.com> In-Reply-To: <000701c30532$0ea7fda0$6510200a@corp.google.com> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit cc: freebsd-questions@FreeBSD.ORG Subject: Re: Free BSD in Googles's Index X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 17 Apr 2003 23:21:15 -0000 Ashley Gillard wrote: > Dear Free BSD Representative: > > Our crawl team has discovered that Google is currently blocked from > crawling your site by the robot.txt that is on your site. We would like > to index your site at http://bento.freebsd.org to provide you better > coverage and are interested in working with you to do this. > > Google's mission is to deliver the best search experience on the > Internet by making the world's information universally accessible and > useful. To find out more about Google.com visit: > http://www.google.com/webmasters/. > > I look forward to hearing from you. First off, bento is a ports build cluster and it's probably impractical to have google index it, as the information probably changes before it can even reach your index. If you still think it would be practical to alter the robots.txt file, it's probably best to contact Satoshi Asami (asami@freebsd.org) as he appears to maintain that site. -- Bill Moran Potential Technologies http://www.potentialtech.com