Skip site navigation (1)Skip section navigation (2)
Date:      Sun, 31 Mar 2024 13:43:46 GMT
From:      Wolfram Schneider <wosch@FreeBSD.org>
To:        doc-committers@FreeBSD.org, dev-commits-doc-all@FreeBSD.org
Subject:   git: cc3c174a51 - main - allow to crawl the ports search homepage at ports.freebsd.org
Message-ID:  <202403311343.42VDhk0h016094@gitrepo.freebsd.org>

next in thread | raw e-mail | index | archive | help
The branch main has been updated by wosch:

URL: https://cgit.FreeBSD.org/doc/commit/?id=cc3c174a51455e0c69d056bb331da8b97963d7ea

commit cc3c174a51455e0c69d056bb331da8b97963d7ea
Author:     Wolfram Schneider <wosch@FreeBSD.org>
AuthorDate: 2024-03-31 13:42:52 +0000
Commit:     Wolfram Schneider <wosch@FreeBSD.org>
CommitDate: 2024-03-31 13:42:52 +0000

    allow to crawl the ports search homepage at ports.freebsd.org
---
 website/themes/beastie/layouts/robots.txt | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/website/themes/beastie/layouts/robots.txt b/website/themes/beastie/layouts/robots.txt
index 70cc4362be..220b64bd77 100644
--- a/website/themes/beastie/layouts/robots.txt
+++ b/website/themes/beastie/layouts/robots.txt
@@ -1,6 +1,6 @@
 User-agent: *
 Disallow: /cgi/man.cgi?apropos=2&
-Disallow: /cgi/ports.cgi
+Disallow: /cgi/ports.cgi?
 Disallow: /cgi/man-autocomplete.cgi
 Disallow: /cgi/ports-autocomplete.cgi
 Disallow: /statistic



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?202403311343.42VDhk0h016094>