[Bps-public-commit] RT-Extension-rt_cpan_org branch, master, updated. 6d2145c25859018c035a0cdd47a78ded89c0c7ac

[Thomas Sibley]

The branch, master has been updated
       via  6d2145c25859018c035a0cdd47a78ded89c0c7ac (commit)
      from  a532023f0b530aa5f0ec632d81cdcc9bc35004b8 (commit)

Summary of changes:
 html/robots.txt | 15 ++++++++++++++-
 1 file changed, 14 insertions(+), 1 deletion(-)

- Log -----------------------------------------------------------------
commit 6d2145c25859018c035a0cdd47a78ded89c0c7ac
Author: Thomas Sibley <trs at bestpractical.com>
Date:   Thu Jun 6 12:24:21 2013 -0700

    Allow /Ticket/ and /Public/ to be indexed
    
    /Ticket/ because it will redirect to Public for a non-logged in user,
    thus allowing links to /Ticket/ to be indexed.
    
    Searching for bug reports via Google is useful.

diff --git a/html/robots.txt b/html/robots.txt
index a4c07c5..4ca922c 100644
--- a/html/robots.txt
+++ b/html/robots.txt
@@ -47,6 +47,19 @@
 %# END BPS TAGGED BLOCK }}}
 <%init>$r->content_type('text/plain');</%init>
 User-agent: *
-Disallow: /
+Disallow: /Admin/
+Disallow: /Approvals/
+Disallow: /Articles/
+Disallow: /Download/
+Disallow: /Helpers/
+Disallow: /Install/
+Disallow: /m/
+Disallow: /Prefs/
+Disallow: /REST/
+Disallow: /Search/
+Disallow: /SelfService/
+Disallow: /Tools/
+Disallow: /User/
+Disallow: /Widgets/
 
 % $m->abort;

-----------------------------------------------------------------------