Date: Sun, 6 Sep 2020 14:47:00 +0200 From: Michael Gmelin <freebsd@grem.de> To: Niclas Zeising <zeising+freebsd@daemonic.se> Cc: grarpamp <grarpamp@gmail.com>, freebsd-current@freebsd.org Subject: Re: Is pkg site forbidden by brower? Message-ID: <C1671375-2EA8-4878-B5ED-2E74D81543BE@grem.de> In-Reply-To: <bb429319-0b29-c221-b3d6-b6d344726f6e@daemonic.se> References: <bb429319-0b29-c221-b3d6-b6d344726f6e@daemonic.se>
next in thread | previous in thread | raw e-mail | index | archive | help
> On 6. Sep 2020, at 12:00, Niclas Zeising <zeising+freebsd@daemonic.se> wro= te: >=20 > =EF=BB=BFOn 2020-09-06 09:00, grarpamp wrote: >>> On 9/6/20, Kevin Oberman <rkoberman@gmail.com> wrote: >>> On Sat, Sep 5, 2020 at 8:04 PM Yoshihiro Ota <ota@j.email.ne.jp> wrote: >>>> Is "403 Forbidden" an intended response for a brower access to >>>> http://pkg.freebsd.org/FreeBSD:12:i386/ nowdays? >>>>=20 >>>> I used to see available packages with a brower and decided which one to= >>>> use. >> Some more people have noted this change >> as breaking tool scripts, etc. >> And useful meta files are unfortunately now invisible: >> packagesite.txz, meta.txz, pkg.txz, pkg.txz.sig >> If someone want to block the '/.../All/' dir full of pkgs, >> maybe, but do not block any other part of the hier. >=20 > The reason that folder listing was disabled on the package download sites i= s that it used too much resources. For every hit on those URLs, the web ser= ver had to dynamically generate the folder listing, and send it. This cause= d DDoS-like scenarios, where these were hit repeatedly, which caused problem= s for legitimate traffic. Since the relevant information is available in th= e txz files above, and also on freshports, and since pkg have no need for di= rectory listing, it was disabled. >=20 Is this part of why pkg repos are performing so much better recently? I=E2=80= =98m quite happy about that :) If there=E2=80=99s a use case for having access to this information, we coul= d simply provide it through a static index.html that=E2=80=99s recreated eve= ry time the directory changes. Cheers, Michael
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?C1671375-2EA8-4878-B5ED-2E74D81543BE>