Date: Fri, 31 May 2013 22:54:45 +0000 (UTC) From: Eitan Adler <eadler@FreeBSD.org> To: doc-committers@freebsd.org, svn-doc-all@freebsd.org, svn-doc-head@freebsd.org Subject: svn commit: r41802 - head/en_US.ISO8859-1/htdocs Message-ID: <201305312254.r4VMsjo0003070@svn.freebsd.org>
next in thread | raw e-mail | index | archive | help
Author: eadler Date: Fri May 31 22:54:45 2013 New Revision: 41802 URL: http://svnweb.freebsd.org/changeset/doc/41802 Log: There appear to be configuration errors causing an absurd amount of links to be generated. For now, block access to search engines until the problem is properly resolved. While here, add $FreeBSD$ Modified: head/en_US.ISO8859-1/htdocs/robots.txt Modified: head/en_US.ISO8859-1/htdocs/robots.txt ============================================================================== --- head/en_US.ISO8859-1/htdocs/robots.txt Fri May 31 19:10:06 2013 (r41801) +++ head/en_US.ISO8859-1/htdocs/robots.txt Fri May 31 22:54:45 2013 (r41802) @@ -1,4 +1,8 @@ +# $FreeBSD$ + User-agent: * Disallow: /cgi/ Disallow: /statistic +Disallow: /publish.html/hu-hu/ +Disallow: /cgi/
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?201305312254.r4VMsjo0003070>