From owner-svn-doc-head@FreeBSD.ORG  Wed Jul 23 11:38:57 2014
Return-Path: <owner-svn-doc-head@FreeBSD.ORG>
Delivered-To: svn-doc-head@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 851B667D;
 Wed, 23 Jul 2014 11:38:57 +0000 (UTC)
Received: from svn.freebsd.org (svn.freebsd.org
 [IPv6:2001:1900:2254:2068::e6a:0])
 (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
 (Client did not present a certificate)
 by mx1.freebsd.org (Postfix) with ESMTPS id 7293F209C;
 Wed, 23 Jul 2014 11:38:57 +0000 (UTC)
Received: from svn.freebsd.org ([127.0.1.70])
 by svn.freebsd.org (8.14.8/8.14.8) with ESMTP id s6NBcvEv007551;
 Wed, 23 Jul 2014 11:38:57 GMT (envelope-from gavin@svn.freebsd.org)
Received: (from gavin@localhost)
 by svn.freebsd.org (8.14.8/8.14.8/Submit) id s6NBcvp1007550;
 Wed, 23 Jul 2014 11:38:57 GMT (envelope-from gavin@svn.freebsd.org)
Message-Id: <201407231138.s6NBcvp1007550@svn.freebsd.org>
From: Gavin Atkinson <gavin@FreeBSD.org>
Date: Wed, 23 Jul 2014 11:38:57 +0000 (UTC)
To: doc-committers@freebsd.org, svn-doc-all@freebsd.org,
 svn-doc-head@freebsd.org
Subject: svn commit: r45357 - head/en_US.ISO8859-1/htdocs
X-SVN-Group: doc-head
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 8bit
X-BeenThere: svn-doc-head@freebsd.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: SVN commit messages for the doc tree for head
 <svn-doc-head.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/svn-doc-head>,
 <mailto:svn-doc-head-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/svn-doc-head/>
List-Post: <mailto:svn-doc-head@freebsd.org>
List-Help: <mailto:svn-doc-head-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/svn-doc-head>,
 <mailto:svn-doc-head-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Wed, 23 Jul 2014 11:38:57 -0000

Author: gavin
Date: Wed Jul 23 11:38:56 2014
New Revision: 45357
URL: http://svnweb.freebsd.org/changeset/doc/45357

Log:
  Re-add /cgi/url.cgi to the disallowed list, this is now served by Varnish.

Modified:
  head/en_US.ISO8859-1/htdocs/robots.txt

Modified: head/en_US.ISO8859-1/htdocs/robots.txt
==============================================================================
--- head/en_US.ISO8859-1/htdocs/robots.txt	Wed Jul 23 09:51:09 2014	(r45356)
+++ head/en_US.ISO8859-1/htdocs/robots.txt	Wed Jul 23 11:38:56 2014	(r45357)
@@ -16,5 +16,6 @@ Disallow: /cgi/ports.cgi
 Disallow: /cgi/query-pr-summary.cgi
 Disallow: /cgi/query-pr.cgi
 Disallow: /cgi/search.cgi
+Disallow: /cgi/url.cgi
 Disallow: /statistic
 Disallow: /sites/downloads.sourceforge.net/