From owner-svn-doc-all@FreeBSD.ORG  Fri May 31 23:10:54 2013
Return-Path: <owner-svn-doc-all@FreeBSD.ORG>
Delivered-To: svn-doc-all@freebsd.org
Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115])
 by hub.freebsd.org (Postfix) with ESMTP id B9DDB1F3;
 Fri, 31 May 2013 23:10:54 +0000 (UTC)
 (envelope-from eadler@FreeBSD.org)
Received: from svn.freebsd.org (svn.freebsd.org
 [IPv6:2001:1900:2254:2068::e6a:0])
 by mx1.freebsd.org (Postfix) with ESMTP id AC61DFF;
 Fri, 31 May 2013 23:10:54 +0000 (UTC)
Received: from svn.freebsd.org ([127.0.1.70])
 by svn.freebsd.org (8.14.6/8.14.6) with ESMTP id r4VNAsbt009678;
 Fri, 31 May 2013 23:10:54 GMT (envelope-from eadler@svn.freebsd.org)
Received: (from eadler@localhost)
 by svn.freebsd.org (8.14.6/8.14.5/Submit) id r4VNAsVM009674;
 Fri, 31 May 2013 23:10:54 GMT (envelope-from eadler@svn.freebsd.org)
Message-Id: <201305312310.r4VNAsVM009674@svn.freebsd.org>
From: Eitan Adler <eadler@FreeBSD.org>
Date: Fri, 31 May 2013 23:10:54 +0000 (UTC)
To: doc-committers@freebsd.org, svn-doc-all@freebsd.org,
 svn-doc-head@freebsd.org
Subject: svn commit: r41803 - head/en_US.ISO8859-1/htdocs
X-SVN-Group: doc-head
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 8bit
X-BeenThere: svn-doc-all@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: "SVN commit messages for the entire doc trees \(except for &quot;
 user&quot; , &quot; projects&quot; , and &quot; translations&quot;
 \)" <svn-doc-all.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/svn-doc-all>,
 <mailto:svn-doc-all-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/svn-doc-all>
List-Post: <mailto:svn-doc-all@freebsd.org>
List-Help: <mailto:svn-doc-all-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/svn-doc-all>,
 <mailto:svn-doc-all-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Fri, 31 May 2013 23:10:54 -0000

Author: eadler
Date: Fri May 31 23:10:53 2013
New Revision: 41803
URL: http://svnweb.freebsd.org/changeset/doc/41803

Log:
  The folder blocked previously seems to be a special case of a broader problem which clusteradm@ is looking into.
  
  However, /sites/downloads.sourceforge.net/ should be blocked as
  - it is not our code
  - some mirrors are serving malware from it which we don't want to be associated with us

Modified:
  head/en_US.ISO8859-1/htdocs/robots.txt

Modified: head/en_US.ISO8859-1/htdocs/robots.txt
==============================================================================
--- head/en_US.ISO8859-1/htdocs/robots.txt	Fri May 31 22:54:45 2013	(r41802)
+++ head/en_US.ISO8859-1/htdocs/robots.txt	Fri May 31 23:10:53 2013	(r41803)
@@ -4,5 +4,4 @@ User-agent: *
 
 Disallow: /cgi/
 Disallow: /statistic
-Disallow: /publish.html/hu-hu/
-Disallow: /cgi/
+Disallow: /sites/downloads.sourceforge.net/