[libre-riscv-dev] [Bug 150] New: bugzilla robots.txt blocking web crawlers such as archive.org
bugzilla-daemon at libre-riscv.org
bugzilla-daemon at libre-riscv.org
Sun Dec 22 01:24:13 GMT 2019
http://bugs.libre-riscv.org/show_bug.cgi?id=150
Bug ID: 150
Summary: bugzilla robots.txt blocking web crawlers such as
archive.org
Product: Libre-RISC-V Website
Version: unspecified
Hardware: All
OS: All
Status: CONFIRMED
Severity: normal
Priority: ---
Component: website
Assignee: lkcl at lkcl.net
Reporter: programmerjake at gmail.com
CC: libre-riscv-dev at lists.libre-riscv.org
NLnet milestone: ---
We should switch robots.txt to allow more things, a good template to use would
be Mozilla's bugzilla robots.txt:
https://bugzilla.mozilla.org/robots.txt
--
You are receiving this mail because:
You are on the CC list for the bug.
More information about the libre-riscv-dev
mailing list