[libre-riscv-dev] [Bug 150] bugzilla robots.txt blocking web crawlers such as archive.org

[bugzilla-daemon at libre-riscv.org]

http://bugs.libre-riscv.org/show_bug.cgi?id=150

--- Comment #1 from Luke Kenneth Casson Leighton <lkcl at lkcl.net> ---
yep this apparently is quite common, web-crawling of bugzilla can be pretty
heavy so mozilla set up a default that banned pretty much everything.  i'm not
so bothered so have set it to "Allow /"

-- 
You are receiving this mail because:
You are on the CC list for the bug.