[libre-riscv-dev] [Bug 150] New: bugzilla robots.txt blocking web crawlers such as archive.org

bugzilla-daemon at libre-riscv.org bugzilla-daemon at libre-riscv.org
Sun Dec 22 01:24:13 GMT 2019


http://bugs.libre-riscv.org/show_bug.cgi?id=150

            Bug ID: 150
           Summary: bugzilla robots.txt blocking web crawlers such as
                    archive.org
           Product: Libre-RISC-V Website
           Version: unspecified
          Hardware: All
                OS: All
            Status: CONFIRMED
          Severity: normal
          Priority: ---
         Component: website
          Assignee: lkcl at lkcl.net
          Reporter: programmerjake at gmail.com
                CC: libre-riscv-dev at lists.libre-riscv.org
   NLnet milestone: ---

We should switch robots.txt to allow more things, a good template to use would
be Mozilla's bugzilla robots.txt:
https://bugzilla.mozilla.org/robots.txt

-- 
You are receiving this mail because:
You are on the CC list for the bug.


More information about the libre-riscv-dev mailing list