From owner-svn-doc-all@FreeBSD.ORG  Fri May 31 22:54:45 2013
Return-Path: <owner-svn-doc-all@FreeBSD.ORG>
Delivered-To: svn-doc-all@freebsd.org
Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115])
 by hub.freebsd.org (Postfix) with ESMTP id B8B61A51;
 Fri, 31 May 2013 22:54:45 +0000 (UTC)
 (envelope-from eadler@FreeBSD.org)
Received: from svn.freebsd.org (svn.freebsd.org
 [IPv6:2001:1900:2254:2068::e6a:0])
 by mx1.freebsd.org (Postfix) with ESMTP id AB0387C;
 Fri, 31 May 2013 22:54:45 +0000 (UTC)
Received: from svn.freebsd.org ([127.0.1.70])
 by svn.freebsd.org (8.14.6/8.14.6) with ESMTP id r4VMsjle003071;
 Fri, 31 May 2013 22:54:45 GMT (envelope-from eadler@svn.freebsd.org)
Received: (from eadler@localhost)
 by svn.freebsd.org (8.14.6/8.14.5/Submit) id r4VMsjo0003070;
 Fri, 31 May 2013 22:54:45 GMT (envelope-from eadler@svn.freebsd.org)
Message-Id: <201305312254.r4VMsjo0003070@svn.freebsd.org>
From: Eitan Adler <eadler@FreeBSD.org>
Date: Fri, 31 May 2013 22:54:45 +0000 (UTC)
To: doc-committers@freebsd.org, svn-doc-all@freebsd.org,
 svn-doc-head@freebsd.org
Subject: svn commit: r41802 - head/en_US.ISO8859-1/htdocs
X-SVN-Group: doc-head
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 8bit
X-BeenThere: svn-doc-all@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: "SVN commit messages for the entire doc trees \(except for &quot;
 user&quot; , &quot; projects&quot; , and &quot; translations&quot;
 \)" <svn-doc-all.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/svn-doc-all>,
 <mailto:svn-doc-all-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/svn-doc-all>
List-Post: <mailto:svn-doc-all@freebsd.org>
List-Help: <mailto:svn-doc-all-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/svn-doc-all>,
 <mailto:svn-doc-all-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Fri, 31 May 2013 22:54:45 -0000

Author: eadler
Date: Fri May 31 22:54:45 2013
New Revision: 41802
URL: http://svnweb.freebsd.org/changeset/doc/41802

Log:
  There appear to be configuration errors causing an absurd amount of links to be generated.
  For now, block access to search engines until the problem is properly resolved.
  
  While here, add $FreeBSD$

Modified:
  head/en_US.ISO8859-1/htdocs/robots.txt

Modified: head/en_US.ISO8859-1/htdocs/robots.txt
==============================================================================
--- head/en_US.ISO8859-1/htdocs/robots.txt	Fri May 31 19:10:06 2013	(r41801)
+++ head/en_US.ISO8859-1/htdocs/robots.txt	Fri May 31 22:54:45 2013	(r41802)
@@ -1,4 +1,8 @@
+# $FreeBSD$
+
 User-agent: *
 
 Disallow: /cgi/
 Disallow: /statistic
+Disallow: /publish.html/hu-hu/
+Disallow: /cgi/