[libre-riscv-dev] [Bug 150] bugzilla robots.txt blocking web crawlers such as archive.org

Luke Kenneth Casson Leighton lkcl at lkcl.net
Sun Dec 22 04:33:56 GMT 2019


On Sunday, December 22, 2019, <bugzilla-daemon at libre-riscv.org> wrote:

> http://bugs.libre-riscv.org/show_bug.cgi?id=150
>
> --- Comment #3 from Jacob Lifshay <programmerjake at gmail.com> ---
> (In reply to Luke Kenneth Casson Leighton from comment #2)
> > (In reply to Jacob Lifshay from comment #0)
> > > a good template to use
> > > would be Mozilla's bugzilla robots.txt:
> > > https://bugzilla.mozilla.org/robots.txt
> >
> > just copied it entirely, just... because :)
>
> Thanks, sounds good to me!
>
> if you have more time, it would be nice to also fix #149


to fix that i should have retrospectively changed the past and not
experimented with individual server certificates in combibation with HSTS.

too late now.

l.



-- 
---
crowd-funded eco-conscious hardware: https://www.crowdsupply.com/eoma68


More information about the libre-riscv-dev mailing list