[libre-riscv-dev] [Bug 150] bugzilla robots.txt blocking web crawlers such as archive.org

bugzilla-daemon at libre-riscv.org bugzilla-daemon at libre-riscv.org
Sun Dec 22 02:00:24 GMT 2019


--- Comment #1 from Luke Kenneth Casson Leighton <lkcl at lkcl.net> ---
yep this apparently is quite common, web-crawling of bugzilla can be pretty
heavy so mozilla set up a default that banned pretty much everything.  i'm not
so bothered so have set it to "Allow /"

You are receiving this mail because:
You are on the CC list for the bug.

More information about the libre-riscv-dev mailing list